mcprobe
by Liquescent-Development
Overview
A testing framework that validates Model Context Protocol (MCP) servers by simulating LLM agents interacting with them via synthetic users and LLM judges.
Installation
mcprobe run examples/scenarios/simple_greeting.yaml --model llama3.2 --base-url http://localhost:11434Environment Variables
- GOOGLE_API_KEY
- MCP_URL
- MCP_TOKEN
Security Notes
CRITICAL: The `extract_tools_from_server` function in `src/mcprobe/generator/mcp_client.py` directly executes a user-provided `server_command` via `subprocess.run`. This is a severe command injection vulnerability, allowing arbitrary system commands to be run if the input to `--server` CLI option is untrusted. Similarly, `load_agent_factory` in `src/mcprobe/agents/adk.py` uses `importlib.util.spec_from_file_location` and `spec.loader.exec_module`, which can execute arbitrary Python code from a user-specified path (via `--agent-factory` CLI option). This represents a significant arbitrary code execution risk if inputs are not fully trusted.
Similar Servers
fastmcp
FastMCP is a Python framework for building and managing Model Context Protocol (MCP) servers and clients. It facilitates the creation of AI agents by defining tools, resources, and prompts, supporting both local and distributed execution, flexible communication transports (HTTP/S, SSE, Stdio), advanced authentication, background task management, and integration with large language models (LLMs) and external APIs. It's designed for creating robust and observable AI-powered microservices.
mcp-interviewer
A Python CLI tool to evaluate Model Context Protocol (MCP) servers for agentic use-cases, by inspecting capabilities, running functional tests, and providing LLM-as-a-judge evaluations.
1xn-vmcp
An open-source platform for composing, customizing, and extending multiple Model Context Protocol (MCP) servers into a single logical, virtual MCP server, enabling fine-grained context engineering for AI workflows and agents.
mcp-advisor
Provides LLMs and humans with structured access to the Model Context Protocol (MCP) specification and documentation for understanding and compliance evaluation.