kafka-dataops-mcp
A DataOps-focused Kafka MCP server with consumer lag diagnosis and broker health monitoring, featuring incident-based diagnosis logic derived from real CDC pipeline operational experience.
README
kafka-dataops-mcp
mcp-name: io.github.Aguantar/kafka-dataops-mcp
A DataOps-focused Kafka MCP server with consumer lag diagnosis and broker health monitoring. Diagnosis logic is based on actual CDC pipeline operational experience.
Features
kafka_consumer_lag— Consumer group lag with incident-pattern diagnosiskafka_topic_info— Topic details with ISR/replication health checkskafka_broker_status— Cluster health: brokers, controller, under-replicated partitionskafka_list_topics— Topic catalog with built-in descriptions
Diagnosis based on real incidents
The diagnosis logic is not generic — it's based on actual operational experience:
- Flink crash detection: "no active members" + growing lag = likely Flink Job failure (based on a 50-hour outage caused by MySQL DELETE → Debezium tombstone → Flink NPE)
- Checkpoint vs consumer group: warns that Kafka consumer group reset alone is insufficient for Flink — checkpoints must be deleted first
- ClusterIdMismatch: detects missing brokers and suggests Docker volume conflict as root cause
- ISR monitoring: ISR < min.insync.replicas = write failures (critical)
Installation
pip install kafka-dataops-mcp
Usage with Claude Code
Add to your .mcp.json:
{
"mcpServers": {
"kafka": {
"command": "kafka-dataops-mcp",
"env": {
"KAFKA_BOOTSTRAP_SERVERS": "localhost:9092"
}
}
}
}
Environment Variables
| Variable | Default | Description |
|---|---|---|
KAFKA_BOOTSTRAP_SERVERS |
localhost:9092 |
Kafka bootstrap servers |
KAFKA_COMMAND_TIMEOUT |
10 |
Command timeout in seconds |
License
MIT
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.