ai-spark-mcp-server
by vgiri2015
Overview
Optimizes Apache Spark code for performance using an AI model (Claude) via a client-server architecture, including performance analysis and comparison.
Installation
python v1/run_server.pyEnvironment Variables
- ANTHROPIC_API_KEY
Security Notes
CRITICAL: The `run_optimized.py` script uses `exec(open(code_path).read())` to execute both original and AI-optimized Spark code files. This allows arbitrary code execution if `spark_code_input.py` or the AI-generated `optimized_spark_code.py` contain malicious code. This makes the system extremely unsafe to run with untrusted inputs or AI models without robust sandboxing. API keys are handled via environment variables, which is good practice.
Similar Servers
claude-code-mcp
Acts as an MCP server to enable LLMs to run Claude Code CLI in one-shot mode, bypassing permissions for complex coding, file system, Git, and terminal operations.
mcp-apache-spark-history-server
Connect AI agents to Apache Spark History Server for intelligent job analysis and performance monitoring.
consult-llm-mcp
An MCP server that allows AI agents like Claude Code to consult stronger, more capable AI models (e.g., GPT-5.2, Gemini 3.0 Pro) for complex code analysis, debugging, and architectural advice.
memcord
A privacy-first, self-hosted MCP server for organizing chat history, summarizing messages, and searching past conversations using AI, particularly for Claude interactions.