Back to Home
osins icon

crawler-mcp-server

Verified Safe

by osins

Overview

An MCP server providing web crawling, browser automation, and content extraction capabilities with support for multiple output formats and LLM integration.

Installation

Run Command
dev-tool-mcp

Environment Variables

  • TEST_URL
  • MCP_STREAMING_MODE
  • MCP_SERVER_NAME
  • MCP_DEFAULT_TOOL_TIMEOUT
  • MCP_LOG_LEVEL
  • OPENAI_API_KEY

Security Notes

The server demonstrates good security awareness with explicit URL validation and sanitization, Playwright browser hardening (headless mode, no-sandbox), and clear statements on file system security (files saved only to specified paths, no arbitrary access). Input validation is performed for tool arguments, including URL length limits. There are no obvious 'eval' or hardcoded secrets. Potential risks include: 1) if the 'save_path' argument for crawl_web_page is sourced from untrusted input, it could lead to directory traversal in some edge cases if not properly handled by the calling system (though os.path.join provides some protection); 2) LLM integration with an 'instruction' parameter could be susceptible to prompt injection if the user input is not sanitized by the calling agent.

Similar Servers

Stats

Interest Score0
Security Score9
Cost ClassHigh
Avg Tokens50000
Stars0
Forks0
Last Update2025-11-22

Tags

Web CrawlingBrowser AutomationContent ExtractionLLM IntegrationPlaywright