llm-mcp-gateway-rs
Verified Safeby eztakesin
Overview
An OpenAI Responses API-compatible gateway for LLM applications that integrates local knowledge base (RAG) and database tool-using MCP servers, designed for use with `big-agi.com`.
Installation
./target/release/gateway-openaiEnvironment Variables
- OPENAI_API_KEY
- INDEX_DIR
- DOCS_MCP_COMMAND
- BIND_ADDR
- ORACLE_MCP_DIR
- TNS_ADMIN
- ORACLE_CONNECTION_STRING
Security Notes
The server employs robust guardrails for SQL tools, including strict allowlisting of commands (only SELECT/WITH, no DML/DDL/PLSQL) and automatic row limits. It also enforces a tool allowlist for MCP tools. Environment variables for spawning MCP servers (`DOCS_MCP_COMMAND`, `ORACLE_MCP_COMMAND`) could pose a risk if misconfigured to arbitrary executables, but are intended for internal components. Network best practices (CORS, PNA, recommendations for DB network isolation and Caddy/Nginx authentication) are noted in the documentation. No hardcoded secrets or 'eval' equivalents were found in the provided code.
Similar Servers
mcpo
Exposes Model Context Protocol (MCP) tools as OpenAPI-compatible HTTP servers.
bifrost
A high-performance AI gateway with a unified interface for multiple LLM providers, offering real-time monitoring and configuration.
context-portal
Manages structured project context for AI assistants and developer tools, enabling Retrieval Augmented Generation (RAG) and prompt caching within IDEs.
mcp-rubber-duck
An MCP (Model Context Protocol) server that acts as a bridge to query multiple OpenAI-compatible LLMs, enabling multi-agent AI workflows and providing an AI 'rubber duck' debugging panel.