Swift MCP GUI Server
MCP server that can execute commands such as keyboard input and mouse movement on macOS
NakaokaRei
README
Swift MCP GUI Server
A Model Context Protocol (MCP) server that allows controlling Mac OS X through SwiftAutoGUI. This server provides tools for programmatically controlling the mouse and keyboard through MCP clients.
Requirements
- macOS 15.0 or later
- Swift 6.0 or later
- Xcode 16.0 or later
Installation
- Clone this repository:
git clone https://github.com/NakaokaRei/swift-mcp-gui.git
cd swift-mcp-gui
- Install
swift package experimental-install
- Add command to your MCP client.
{
"mcpServers" : {
"swift-mcp-gui" : {
"command" : "/Users/USERNAME/.swiftpm/bin/swift-mcp-gui"
}
}
}
Available Tools
The server provides the following tools for controlling macOS:
1. Mouse Movement
- Tool name:
moveMouse - Input:
x: double (x-coordinate)y: double (y-coordinate)
- Moves the mouse cursor to the specified coordinates
2. Mouse Clicks
- Tool name:
mouseClick - Input:
button: String ("left" or "right")
- Performs a mouse click at the current cursor position
3. Keyboard Input
- Tool name:
sendKeys - Input:
keys: Array of strings (key names)
- Sends keyboard shortcuts or key combinations
- Example keys: "command", "control", "option", "shift", "return", "space", "a", "1", etc.
4. Scrolling
- Tool name:
scroll - Input:
direction: String ("up", "down", "left", "right")clicks: Integer (number of scroll clicks)
- Performs scrolling in the specified direction
Security Considerations
This server has full control over your mouse and keyboard. Be careful when running it and only connect trusted MCP clients.
License
MIT License
Recommended Servers
@kazuph/mcp-taskmanager
Model Context Protocol server for Task Management. This allows Claude Desktop (or any MCP client) to manage and execute tasks in a queue-based system.
Claude Code MCP
An implementation of Claude Code as a Model Context Protocol server that enables using Claude's software engineering capabilities (code generation, editing, reviewing, and file operations) through the standardized MCP interface.
Beamlit MCP Server
An MCP server implementation that enables seamless integration between Beamlit CLI and AI models using the Model Context Protocol standard.
ThingsPanel MCP
An integration server that connects AI models with ThingsPanel IoT platform, allowing AI assistants to interact with IoT devices through natural language for device control, data retrieval, and management operations.
macOS Defaults MCP Server
MCP server that enables reading and writing macOS system preferences and application settings through the defaults system.
Shell MCP Server
A Model Context Protocol server that allows LLMs to execute shell commands and receive their output in a controlled manner.
MCP Command Server
A secure server that allows LLM applications like Claude to execute whitelisted system commands with user confirmation and comprehensive security features.
iTerm MCP Server
This MCP server enables users to execute shell commands in the current iTerm2 session through integration with Claude Desktop, facilitating seamless command execution via the Model Context Protocol.
WinTerm MCP
A Model Context Protocol server that provides programmatic access to the Windows terminal, enabling AI models to interact with the Windows command line through standardized tools for writing commands, reading output, and sending control signals.
MCP Server: SSH Rails Runner
Enables secure remote execution of Rails console commands over SSH for read-only operations, mutation planning, and executing approved changes in a deployed Rails environment.