Embeddin Tools #159
hypersniper05
started this conversation in
Ideas
Replies: 1 comment 1 reply
-
This should be made as a suggestion to the MCP spec instead. I have an open proposal for a new capability which could do this (in fact tool filtering is one of the examples I used). I agree that RAG techniques to narrow down tool sets to avoid overloading models when you're working with a very large number of tools is a very useful technique in some cases. I don't think SDKs should implement such features until/if they're part of the protocol spec. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Pre-submission Checklist
Your Idea
For many tools, it would be easier for the LLM to query the server for the appropriate tool to use using a cosine similarity search. I have tested this using plain old JSON function calling and it works great and also minimizes the tokens sent to the endpoint.
Scope
Beta Was this translation helpful? Give feedback.
All reactions