Contendeo
Contendeo is a multimodal MCP server that gives AI agents frame-level context from videos—transcription, keyframe vision analysis, OCR, and structured output—so they can analyze what's shown, not just what's said.
README
Contendeo
Give your agent eyes.
Contendeo is the multimodal layer that lets your AI actually see video — not just read its transcript.
What it is
Contendeo is a remote MCP server that gives LLMs frame-level context from video — transcription, keyframe vision analysis, OCR, and structured output, unified into a single response your agent can reason over.
Paste a YouTube, Instagram Reels, Vimeo, Twitter/X, TikTok, or direct video URL into Claude (or any MCP client). Contendeo downloads, transcribes, extracts keyframes, runs OCR, analyzes visuals, and returns a structured document.
Live at contendeo.app. MCP endpoint at contendeo.app/mcp/.
Why it exists
Transcripts capture what was said. They don't capture what was shown — chart values, UI states, overlays, code on screen, circled regions, dashboard numbers. For any video where the visual layer carries information (trading tutorials, product demos, technical walkthroughs, data dashboards, design reviews), transcript-only analysis misses half the signal.
Contendeo closes that gap.
See the side-by-side comparison at contendeo.app/demo.
Tools
Four tools exposed over MCP. Credit costs charged per successful call. Cache hits are free.
| Tool | Credits | What it does |
|---|---|---|
quick_transcribe |
1 | Timestamped transcript with speaker identification. Audio-only. Fast. |
deep_analyze |
5 | Full multimodal pipeline — transcript + keyframe vision + OCR, unified output. |
clip_context |
1 (quick) / 3 (deep) | Analyze a specific timestamp range without paying for the full video. |
batch_analyze |
per-video, −10% at 5+ | Process up to 10 videos in parallel with cross-video synthesis. |
Full schemas and response formats: docs/tools.md.
Installation
Contendeo is a remote MCP server — no local install, no package download. Connect via URL from your MCP client.
Claude Desktop
Add to your claude_desktop_config.json:
{
"mcpServers": {
"contendeo": {
"url": "https://contendeo.app/mcp/"
}
}
}
Claude will walk you through OAuth on first use.
Claude Code
claude mcp add --transport http contendeo https://contendeo.app/mcp/
Other MCP clients (Cursor, Continue, Cline, etc.)
Any client that supports remote MCP servers over streamable HTTP. Point it at https://contendeo.app/mcp/.
Full walkthrough with screenshots: docs/installation.md.
Authentication
Contendeo uses OAuth 2.0. First use flow:
- Your MCP client initiates a connection
- Browser redirect to contendeo.app sign-in (Google OAuth or email)
- Approve the MCP client
- Bearer token issued, client reconnects, tools become available
New accounts get 10 free credits. No card required.
Details: docs/authentication.md.
Pricing
| Plan | Price | Credits | Notes |
|---|---|---|---|
| Free | $0 | 10 on signup | All 4 tools, no card |
| Pro | $12/mo (₹999) | 100/mo | Priority queue, rollover to 200 |
| Power | $39/mo (₹3,299) | 500/mo | Batch, webhooks, rollover to 1000 |
| PAYG | $0.15/credit | on demand | No subscription |
Cache hits are free. Failed analyses auto-refund.
Details: docs/pricing.md.
Stack
Under the hood:
- yt-dlp — video download across 1000+ sites
- Apify — Instagram Reels fetching
- Webshare — residential proxy pool for YouTube anti-bot
- ffmpeg — audio extraction + keyframe scene detection
- Groq Whisper (large-v3) — transcription
- Tesseract OCR — deterministic text extraction from frames
- Claude Vision (Sonnet 4.6) — visual frame analysis
- Supabase — auth + Postgres
- Redis — URL-hash result cache
- FastAPI + MCP Python SDK — server, streamable HTTP transport
- Traefik — SSL termination + routing
Links
- Landing — contendeo.app
- Demo — contendeo.app/demo
- MCP endpoint — contendeo.app/mcp/
- Dashboard — contendeo.app/dashboard
- Docs —
docs/ - Server card — contendeo.app/.well-known/mcp/server-card.json
Support
Questions, bug reports, feature requests: open an issue.
Commercial/partnership inquiries: @0xKaroshi on X.
License
MIT — covers this wrapper repo (documentation, examples, manifest). The production server source is not open-sourced.
See LICENSE.
Contendeo — every frame, every word, every edge.
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
Neon Database
MCP server for interacting with Neon Management API and databases
E2B
Using MCP to run code via e2b.
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.