Download_Tools
Verified Safeby EricRollei
Overview
Provides web scraping and media downloading capabilities from over 1000 websites, including social media platforms, exposed via a Model Context Protocol (MCP) server for integration with AI clients like Claude Desktop and LM Studio.
Installation
python mcp_web_scraper_server.pyEnvironment Variables
- PYTHONPATH
- FLICKR_API_KEY
- FLICKR_API_SECRET
- BSKY_USERNAME
- BSKY_PASSWORD
- REDDIT_CLIENT_ID
- REDDIT_CLIENT_SECRET
- REDDIT_USERNAME
- REDDIT_PASSWORD
- KAVYAR_API_KEY
- PINTEREST_APP_ID
- PINTEREST_APP_SECRET
- TUMBLR_CONSUMER_KEY
- TUMBLR_CONSUMER_SECRET
- TUMBLR_OAUTH_TOKEN
- TUMBLR_OAUTH_TOKEN_SECRET
- YOUTUBE_API_KEY
- ARTSTATION_API_KEY
Security Notes
The project performs inherently risky operations like fetching arbitrary external content, browser automation, and running external binaries (yt-dlp, gallery-dl). It uses `subprocess.Popen` to execute `yt-dlp` and `gallery-dl` commands, which are built using user-provided `extra_options`. While `shlex.split` is used to mitigate shell injection, complex exploits could still exist. The `eval` function is used in `base_handler.py` for regex matching and in `gallery_dl_downloader.py` for filter expressions (inherent to gallery-dl's design), which could be a vulnerability if input strings are not sufficiently sanitized from untrusted sources. Browser cookie extraction (`browser_cookie3`) accesses local sensitive data, and for Chrome/Edge, may require elevated privileges (admin rights), increasing exposure risk if the system is compromised. The project explicitly warns users not to commit `auth_config.json` containing credentials, which is good practice. Output directories are sanitized to prevent path traversal outside the ComfyUI output folder.
Similar Servers
XHS-Downloader
A tool for extracting links and downloading watermark-free images and videos from Xiaohongshu (RedNote), supporting multiple operational modes including a server-based MCP interface.
yt-dlp-mcp
Integrate video platform capabilities like search, metadata extraction, and content download into AI agents using yt-dlp.
comfyui-mcp-server
The server enables AI agents to generate and iteratively refine images, audio, and video using a local ComfyUI instance through the Model Context Protocol (MCP).
media-downloader
The primary use case is to download videos and audio from various online sources, and it functions as an MCP server and an A2A agent for integration into agentic frameworks.