Download_Tools
Verified Safeby EricRollei
Overview
Provides web scraping and media downloading capabilities from over 1000 websites, including social media platforms, exposed via a Model Context Protocol (MCP) server for integration with AI clients like Claude Desktop and LM Studio.
Installation
python mcp_web_scraper_server.pyEnvironment Variables
- PYTHONPATH
- FLICKR_API_KEY
- FLICKR_API_SECRET
- BSKY_USERNAME
- BSKY_PASSWORD
- REDDIT_CLIENT_ID
- REDDIT_CLIENT_SECRET
- REDDIT_USERNAME
- REDDIT_PASSWORD
- KAVYAR_API_KEY
- PINTEREST_APP_ID
- PINTEREST_APP_SECRET
- TUMBLR_CONSUMER_KEY
- TUMBLR_CONSUMER_SECRET
- TUMBLR_OAUTH_TOKEN
- TUMBLR_OAUTH_TOKEN_SECRET
- YOUTUBE_API_KEY
- ARTSTATION_API_KEY
Security Notes
The project performs inherently risky operations like fetching arbitrary external content, browser automation, and running external binaries (yt-dlp, gallery-dl). It uses `subprocess.Popen` to execute `yt-dlp` and `gallery-dl` commands, which are built using user-provided `extra_options`. While `shlex.split` is used to mitigate shell injection, complex exploits could still exist. The `eval` function is used in `base_handler.py` for regex matching and in `gallery_dl_downloader.py` for filter expressions (inherent to gallery-dl's design), which could be a vulnerability if input strings are not sufficiently sanitized from untrusted sources. Browser cookie extraction (`browser_cookie3`) accesses local sensitive data, and for Chrome/Edge, may require elevated privileges (admin rights), increasing exposure risk if the system is compromised. The project explicitly warns users not to commit `auth_config.json` containing credentials, which is good practice. Output directories are sanitized to prevent path traversal outside the ComfyUI output folder.
Similar Servers
XHS-Downloader
A tool for extracting links and downloading watermark-free images and videos from Xiaohongshu (RedNote), supporting multiple operational modes including a server-based MCP interface.
mcp-server-youtube-transcript
Provides a Model Context Protocol server to retrieve YouTube video transcripts, including language fallback, timestamps, and ad filtering.
yt-dlp-mcp
Integrate video platform capabilities like search, metadata extraction, and content download into AI agents using yt-dlp.
comfyui-mcp-server
The server enables AI agents to generate and iteratively refine images, audio, and video using a local ComfyUI instance through the Model Context Protocol (MCP).