I Built a CLI to Test and Eval Mcp Servers
Posted3 months ago
npmjs.comTechstory
supportivepositive
Debate
0/100
CLIMcp ServersTesting ToolsNpm Package
Key topics
CLI
Mcp Servers
Testing Tools
Npm Package
The author created a CLI tool to test and evaluate MCP servers and shared it as an npm package, receiving a generally positive response from the community.
Snapshot generated from the HN discussion
Discussion Activity
Light discussionFirst comment
N/A
Peak period
1
Start
Avg / period
1
Key moments
- 01Story posted
Sep 24, 2025 at 7:12 PM EDT
3 months ago
Step 01 - 02First comment
Sep 24, 2025 at 7:12 PM EDT
0s after posting
Step 02 - 03Peak activity
1 comments in Start
Hottest window of the conversation
Step 03 - 04Latest activity
Sep 24, 2025 at 7:12 PM EDT
3 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
ID: 45367044Type: storyLast synced: 11/17/2025, 1:12:16 PM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.
Let's say you're testing PayPal MCP. You can write a test case prompt "Create a refund order for order 412". The test will run the prompt and check if the right PayPal tool was called.
The CLI helps with: 1. Test different prompts and observe how LLMs interact with your MCP server. The CLI shows a trace of the conversation. 2. Examine your server's tool name / description quality. See where LLMs are hallucinating using your server. 3. Analyze your MCP server's performance, like token consumption, and performance with different models. 4. Benchmarking your MCP server's performance to catch future regressions.
The nice thing about CLI is that you can run these tests iteratively! Please give it a try, and would really appreciate your feedback.