server-tester
Verified Safeby mcp-testing
Overview
A Playwright-based testing framework for evaluating and testing Model Context Protocol (MCP) servers, including protocol conformance and LLM host simulation.
Installation
playwright testEnvironment Variables
- OPENAI_API_KEY
- ANTHROPIC_API_KEY
- MCP_ACCESS_TOKEN
- MCP_REFRESH_TOKEN
- MCP_TOKEN_TYPE
- MCP_TOKEN_EXPIRES_AT
Security Notes
The framework allows direct execution of shell commands for `stdio` transport configurations (e.g., `node server.js`). While this is a core feature for launching local servers under test, it represents a critical security risk if the `mcpConfig.command` is sourced from an untrusted input, potentially leading to arbitrary code execution. The HTTP transport connects to configured `serverUrl`, which also requires trust in the configuration source. There are no apparent hardcoded secrets or obfuscation. HTML reports and UI elements sanitize user-provided content (e.g., `JSON.stringify`, `escapeHtml`, `stripAnsiCodes`) to mitigate XSS risks.
Similar Servers
playwright-mcp
Provides a Model Context Protocol (MCP) server for LLMs to automate browser interactions using Playwright's accessibility tree, avoiding pixel-based vision models.
verdex-mcp
AI-first browser automation for Playwright test authoring, enabling AI coding assistants to generate robust, container-scoped, and content-filtered Playwright selectors for end-to-end tests.
playwright-mcp-server
Provides a robust, token-aware Playwright browser automation server for Large Language Models (LLMs) and coding agents to interact with web content, supporting advanced features like anti-detection and multi-page management.
server-tester
A Playwright-based testing framework for Model Context Protocol (MCP) servers, enabling validation of server behavior, tool functionality, protocol conformance, and LLM-driven evaluations.