MiMo Multimodal Understanding MCP Server
Integrates Xiaomi MiMo's multimodal API to enable understanding of images, audio, and video through natural language prompts.
README
MiMo Multimodal Understanding MCP Server
MCP server for Xiaomi MiMo multimodal understanding API (image, audio, video).
Features
- Image Understanding: Single/multiple images, URL and local file support
- Audio Understanding: Single/multiple audio, URL and local file support
- Video Understanding: Single/multiple video, URL and local file support, configurable fps and resolution
Setup
1. Install dependencies
uv sync
2. Configure API Key
Copy .env.example to .env and fill in your API key:
cp .env.example .env
Or set environment variable directly:
export MIMO_API_KEY=your_api_key_here
Get your API key from: https://platform.xiaomimimo.com
3. (Optional) Configure API Base URL
The default API endpoint is determined by your API key prefix:
| Key Prefix | Default Endpoint |
|---|---|
tp-* |
https://token-plan-cn.xiaomimimo.com/v1 |
sk-* or others |
https://api.xiaomimimo.com/v1 |
To use a different API endpoint:
export MIMO_API_BASE=https://your-custom-endpoint/v1
Or add it to your .env file:
MIMO_API_BASE=https://your-custom-endpoint/v1
Usage
Quick Start (with uvx)
export MIMO_API_KEY=your_api_key_here
uvx mimo-multimodal-mcp
Development mode (with MCP Inspector)
uv run mcp dev src/mimo_multimodal_mcp/server.py
Install to Claude Desktop
uv run mcp install src/mimo_multimodal_mcp/server.py
Direct execution
uv run python src/mimo_multimodal_mcp/server.py
Claude Desktop Configuration
Add to ~/.config/claude/claude_desktop_config.json:
{
"mcpServers": {
"mimo-multimodal": {
"command": "uvx",
"args": ["mimo-multimodal-mcp"],
"env": {
"MIMO_API_KEY": "your_api_key_here"
}
}
}
}
Tools
understand_image
Analyze images using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Image understanding task description |
image_url |
string | No | Single image URL or data:image base64 |
image_path |
string | No | Single local image file path |
image_urls |
list[string] | No | Multiple image URLs |
image_paths |
list[string] | No | Multiple local image file paths |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: JPEG, PNG, GIF, WebP Size limit: 10MB
understand_audio
Analyze audio using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Audio understanding task description |
audio_url |
string | No | Single audio URL |
audio_path |
string | No | Single local audio file path |
audio_urls |
list[string] | No | Multiple audio URLs |
audio_paths |
list[string] | No | Multiple local audio file paths |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: MP3, WAV, FLAC, M4A, OGG Size limit: URL 100MB, Base64 50MB
understand_video
Analyze video using Xiaomi MiMo multimodal model.
| Parameter | Type | Required | Description |
|---|---|---|---|
prompt |
string | Yes | Video understanding task description |
video_url |
string | No | Single video URL |
video_path |
string | No | Single local video file path |
video_urls |
list[string] | No | Multiple video URLs |
video_paths |
list[string] | No | Multiple local video file paths |
fps |
float | No | Frames per second, range [0.1, 10], default: 2 |
media_resolution |
string | No | Resolution: "default" or "max" |
system_prompt |
string | No | Custom system prompt |
max_tokens |
integer | No | Max output length (default: 8192, max: 32768) |
Supported formats: MP4, MOV, AVI, WMV Size limit: URL 300MB, Base64 50MB
Examples
Image Understanding
# URL
await understand_image(prompt="Describe this image", image_url="https://example.com/image.jpg")
# Local file
await understand_image(prompt="What text is in this?", image_path="/path/to/screenshot.png")
# Multiple images
await understand_image(prompt="Compare these", image_urls=["url1", "url2"])
Audio Understanding
# URL
await understand_audio(prompt="Transcribe this audio", audio_url="https://example.com/audio.wav")
# Local file
await understand_audio(prompt="What is being said?", audio_path="/path/to/audio.mp3")
Video Understanding
# URL with default settings
await understand_video(prompt="Describe this video", video_url="https://example.com/video.mp4")
# URL with custom fps and resolution
await understand_video(
prompt="Describe the action",
video_url="https://example.com/video.mp4",
fps=5.0,
media_resolution="max"
)
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.