MCP-server-client-computer-use-ai-sdk
by Omkarjamadar
Overview
Provides an AI-driven interface to control a macOS computer by automating tasks through accessibility features and a conversational agent loop.
Installation
cd mcp-server-os-level && cargo run --bin serverEnvironment Variables
- ANTHROPIC_API_KEY
Security Notes
The system grants AI direct control over the operating system, allowing it to perform actions like launching applications, typing, clicking, and pressing keys. This is inherently a high-risk operation. While the client-side components (Next.js and CLI) communicate with the Rust-based desktop control server over a local HTTP connection (127.0.0.1:8080), a compromised AI model or malicious prompt could execute arbitrary, potentially destructive commands on the user's machine (e.g., 'delete all files'). The macOS server explicitly requires user-granted accessibility permissions, which is a necessary safeguard. No hardcoded API keys are found within the client code that would be exposed to the browser, as they are loaded from environment variables and used server-side in Next.js API routes. The core risk is the nature of giving AI full system control and the trust placed in the AI's reasoning and the input prompts.
Similar Servers
UI-TARS-desktop
UI-TARS-desktop is a native GUI Agent application powered by multimodal AI models, enabling users to control their computer and browser through natural language instructions.
Windows-MCP
This MCP server enables AI agents to directly interact with the Windows operating system, performing tasks such as file navigation, application control, UI interaction, and QA testing.
Peekaboo
macOS automation server that integrates AI for screen capture analysis, UI interaction, and agentic workflows.
macos-automator-mcp
Transforms an AI assistant into a macOS automation agent, enabling it to execute AppleScript and JXA commands to control applications and system functions.