MCP Servers

Web Reader

Converts web pages to Markdown for MCP clients like Claude, with support for single and batch reads, caching, fallback rendering, and SSRF protection.

README

MCP Web Reader

一个自托管的 MCP (Model Context Protocol) 服务器，把网页内容读取并转换为 Markdown，供 Claude、Cursor 等 MCP 客户端使用。零第三方付费 API 依赖。

功能特点

🔌 两个工具：read_url（单个）/ read_urls（批量，并发上限 3）
🛤️ 专用通道：GitHub（raw README / Issue API）、arXiv（Atom API）、PDF 交接
📄 统一提取：本地 fetch + Mozilla Readability + turndown，代码语言 / 表格 / 链接 / og: 元数据保真
🌐 站点适配：微信公众号、知乎、掘金等按 host 优先选择器
🧯 降级策略：本地解析 → 检测到访问限制（403 / 429 / Cloudflare 等）→ Playwright 浏览器渲染
⚡ 缓存：文件系统缓存，按 host 分级 TTL；失败 URL 短期负缓存；自动淘汰
🔁 重试：5xx / 429 / 网络错误指数退避重试
🛡️ SSRF 防护：拦截私有 IP / 云元数据端点 / 危险 host

安装

git clone https://github.com/PPParticle/web-reader.git
cd web-reader
npm install
npm run build
npx playwright install chromium   # 可选，用于 JS 渲染 / 反爬降级

配置

在任意 MCP 客户端的配置中添加（以 Claude Desktop 为例）：

Windows: %APPDATA%\Claude\claude_desktop_config.json macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Linux: 自行查阅所用客户端的配置路径

{
  "mcpServers": {
    "web-reader": {
      "command": "node",
      "args": ["/absolute/path/to/web-reader/dist/index.js"]
    }
  }
}

环境变量（可选）：

变量	作用
`GITHUB_TOKEN`	提升 GitHub API 限额（60 → 5000/小时）；不设也能用公开仓库
`WEB_READER_CACHE_DIR`	覆盖缓存目录（默认 `~/.cache/mcp-web-reader/`）

工具

`read_url`

读取单个 URL 并转为 Markdown。

参数	类型	默认	说明
`url`	string	（必填）	http/https URL
`engine`	enum	`auto`	`auto`=自动；`local`=强制本地解析；`playwright`=强制浏览器；`jina`=已移除（付费第三方，调用会返回明确错误）
`no_cache`	bool	`false`	为 `true` 时跳过缓存、重新抓取
`with_links`	bool	`false`	为 `true` 时在结果末尾附上正文链接清单，供 agent 决定是否进一步探索

`read_urls`

批量读取（最多 10 个 URL），参数同上（urls 数组 + engine + no_cache），单条失败不影响其他。

贡献

欢迎提交 Pull Request。

许可证

MIT License

Recommended Servers

playwright-mcp

A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.

Official

Featured

TypeScript

Magic Component Platform (MCP)

An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.

Audiense Insights MCP Server

Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.

VeyraX MCP

Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.

Official

Featured

Local

graphlit-mcp-server

The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.

Official

Featured

TypeScript

Kagi MCP Server

An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.

Official

Featured

Python

E2B

Using MCP to run code via e2b.

Official

Featured

Neon Database

MCP server for interacting with Neon Management API and databases

Official

Featured

Exa Search

A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.

Official

Featured

Qdrant Server

This repository is an example of how to create a MCP server for Qdrant, a vector search engine.

Official

Featured