Tracking similar projects in this space

[technicalpickles]

I wanted somewhere to track projects and news around with similar proxy / LLM tool selection functionality. This could be a discussion if we had those.

Leaving specific things as comments.

[technicalpickles]

From Claude: Introducing advanced tool use on the Claude Developer Platform

Instead of loading all tool definitions upfront, the Tool Search Tool discovers tools on-demand. Claude only sees the tools it actually needs for the current task.

Tool Search Tool diagram
Tool Search Tool preserves 191,300 tokens of context compared to 122,800 with Claude’s traditional approach.
Traditional approach:

All tool definitions loaded upfront (~72K tokens for 50+ MCP tools)
Conversation history and system prompt compete for remaining space
Total context consumption: ~77K tokens before any work begins
With the Tool Search Tool:

Only the Tool Search Tool loaded upfront (~500 tokens)
Tools discovered on-demand as needed (3-5 relevant tools, ~3K tokens)
Total context consumption: ~8.7K tokens, preserving 95% of context window
This represents an 85% reduction in token usage while maintaining access to your full tool library. Internal testing showed significant accuracy improvements on MCP evaluations when working with large tool libraries. Opus 4 improved from 49% to 74%, and Opus 4.5 improved from 79.5% to 88.1% with Tool Search Tool enabled.

This seems to be part of the Agent SDK, rather than part of Claude Code at this time

[technicalpickles]

From Docker: MCP Gateway

MCP Gateway runs MCP servers in isolated Docker containers with restricted privileges, network access, and resource usage. It includes built-in logging and call-tracing capabilities to ensure full visibility and governance of AI tool activity.

GitHub

[Dumbris]

I wanted somewhere to track projects and news around with similar proxy / LLM tool selection functionality. This could be a discussion if we had those.

Leaving specific things as comments.

Great idea starting a consolidated place to track projects in this space.
Since the Discussions tab is now enabled, we can use it as a home for links, comparisons, and any design notes around tool-selection strategies or proxy patterns. That should keep the issue list focused while still giving us a running knowledge base.