QQ Channel Data Collector
Enables automated collection and downloading of multimedia content (images, GIFs, videos) from QQ channels. Features efficient video scraping, incremental updates, and intelligent fallback mechanisms for comprehensive media harvesting.
README
QQ频道MCP数据采集工具
一个高效的QQ频道数据采集工具,支持图片、动图、视频等多种媒体类型的自动下载。
🚀 主要功能
- 高效视频抓取: 直接解析JSON-LD,无需浏览器
- 完整媒体支持: 图片、GIF动图、视频全支持
- 智能回退机制: 高效抓取失败时自动回退到Chrome方案
- 增量更新: 避免重复下载,提高效率
📁 项目结构
QQChannelMCP/
├── src/ # 源代码目录
│ ├── collector/ # 数据采集器
│ ├── core/ # 核心组件
│ ├── models/ # 数据模型
│ └── utils/ # 工具函数
├── server/ # MCP服务器
├── data/ # 数据存储目录
├── run_mcp_server.py # 启动脚本
└── requirements.txt # 依赖包
🛠️ 快速开始
-
安装依赖
pip install -r requirements.txt -
启动MCP服务器
python run_mcp_server.py -
使用MCP工具
test_connection: 测试频道连接collect_daily_hellokitty: 收集今日HelloKitty内容get_storage_info: 获取存储信息
📊 支持功能
- ✅ 高效视频检测和下载
- ✅ 图片和GIF动图下载
- ✅ 完整帖子信息采集
- ✅ 增量更新机制
- ✅ 异步并发下载
- ✅ 标准化文件命名
🔧 技术特点
- FastVideoScraper: 无需浏览器的快速抓取器
- EnhancedQQChannelScraper: 增强版Chrome抓取器
- MultimediaHelloKittyDownloader: 多媒体下载器
- 异步并发: 提高下载效率
- 智能媒体类型检测: 自动识别文件类型
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.