Back to Home
nirholas icon

extract-llms-docs

Verified Safe

by nirholas

Overview

Extracts, parses, and organizes documentation from websites (llms.txt, install.md) for AI agents, LLMs, and automation workflows, offering structured, agent-ready formats and generation tools.

Installation

Run Command
cd mcp-server && pnpm install && pnpm start

Environment Variables

  • ADMIN_KEY
  • ANTHROPIC_API_KEY

Security Notes

The application inherently performs network requests to arbitrary, user-provided URLs for web scraping and API interactions (e.g., GitHub, sitemaps, llms.txt files). While a `fetchWithTimeout` function is implemented to prevent hanging requests and `User-Agent` headers are set for identification, this type of functionality always carries an inherent risk of Server-Side Request Forgery (SSRF) if not meticulously controlled, though no obvious direct vulnerabilities were identified in the provided snippets. Rate limiting is robustly implemented via a sliding window algorithm and applied across critical API endpoints, which is a strong positive for preventing abuse. Environment variables (`ANTHROPIC_API_KEY`, `ADMIN_KEY`) are correctly used for sensitive information instead of hardcoding. No direct `eval` or other highly dangerous code patterns were found.

Similar Servers

Stats

Interest Score48
Security Score8
Cost ClassMedium
Avg Tokens3000
Stars2
Forks1
Last Update2026-01-18

Tags

documentationAI agentsLLMsextractionweb scrapinginstall.mdllms.txtMCP