MCP Servers

webx-mcp-server

An MCP server for web content extraction, providing tools to fetch clean text, extract links, query by CSS selector, and search the web via DuckDuckGo.

README

WebX MCP Server 🌐

A Model Context Protocol (MCP) server for web content extraction — fetch clean text, extract links, query by CSS selector, and search the web.

Built for AI agents. Works with Hermes Agent, Claude Code, Cursor, and any MCP-compatible client.

✨ Features

Tool	Description
`fetch_clean_text`	Fetch a URL and extract clean readable text (up to 50K chars)
`extract_links`	Extract all links with anchor text, optionally filtered by domain
`extract_by_selector`	Extract content by CSS selector (text, HTML, or attribute)
`search_web`	Search the web via DuckDuckGo HTML search

🚀 Quick Start

# Install from GitHub
pip install git+https://github.com/ceeyang-ai/webx-mcp-server.git

# Run as MCP server
webx-mcp-server

🔌 Usage with AI Agents

Hermes Agent

Add to ~/.hermes/config.yaml:

mcp_servers:
  webx:
    command: "webx-mcp-server"

Restart → use mcp_webx_fetch_clean_text, mcp_webx_extract_links, etc.

Claude Code / Cursor / Any MCP Client

Add to your MCP config:

{
  "mcpServers": {
    "webx": {
      "command": "webx-mcp-server"
    }
  }
}

📖 Examples

Fetch clean text

result = fetch_clean_text(
    url="https://en.wikipedia.org/wiki/Web_scraping",
    max_chars=5000
)

Extract links

result = extract_links(
    url="https://example.com",
    filter_domain=True,
    max_links=20
)

Search the web

result = search_web(
    query="latest AI research papers",
    max_results=10
)

🛠 Requirements

Python 3.10+
requests ≥ 2.28
beautifulsoup4 ≥ 4.11
lxml ≥ 4.9
mcp ≥ 1.0

👨‍💻 Development

git clone https://github.com/ceeyang-ai/webx-mcp-server.git
cd webx-mcp-server
pip install -e .
webx-mcp-server  # Start MCP server

📄 License

MIT — free for personal and commercial use.

Recommended Servers

playwright-mcp

A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.

Official

Featured

TypeScript

Magic Component Platform (MCP)

An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.

Audiense Insights MCP Server

Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.

VeyraX MCP

Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.

Official

Featured

Local

graphlit-mcp-server

The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.

Official

Featured

TypeScript

Kagi MCP Server

An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.

Official

Featured

Python

Neon Database

MCP server for interacting with Neon Management API and databases

Official

Featured

E2B

Using MCP to run code via e2b.

Official

Featured

Exa Search

A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.

Official

Featured

Qdrant Server

This repository is an example of how to create a MCP server for Qdrant, a vector search engine.

Official

Featured