Code Mode: the Better Way to Use Mcp

> Why, then, do MCP interfaces have to "dumb it down"? Writing code and calling tools are almost the same thing, but it seems like LLMs can do one much better than the other?

> The answer is simple: LLMs have seen a lot of code. They have not seen a lot of "tool calls". In fact, the tool calls they have seen are probably limited to a contrived training set constructed by the LLM's own developers, in order to try to train it. Whereas they have seen real-world code from millions of open source projects.

I am curious: Is this a generally agreed upon fact or an assumption/conjecture?

It's laughable to not realize that the solution is to simply remove the absolutely useless layer that is MCP and call APIs straight away.

smolagents provides something very similar: https://huggingface.co/blog/llchahn/ai-agents-output-schema

yup, we've been using this approach with our product to make composing different integrations easier for the LLM and also give it the flexibility of code. Main difference is we use quick-js instead of v8 isolates. Seeing a TS interface instead of ugly JSON schema and simply writing code is far simpler for the LLM

It makes somewhat sense that composing an API call would be easier (for an LLM) than inferring a tool call. It will make it easier to observe.

I remember generating and executing pymongo based python code in May 2024 when llama3 came out. It was to search mongodb through natural language interface. This was before MCP came into existence. It had the risk of NL injection just like sql injection but since it was for a closed user base, it was ok.

Your approach seems similar. It certainly avoids the complications of chain of tool calls in MCP paradigm.

you stole my idea seriously, i think it works so well because typescript is very clear in .. well type definitions. the llm can't get lost so fast between function calls because it understands exactly what data structures goes in and out.

Then you need a bigger, expensive and poor performance LLM to create an agentic AI.

I was curious about how are user elicitations being handled in this? If a tool raises an elicitation request, how will the request travel back to the user?

If this is the case, do you really need MCP? Does this not work with FastAPI?