MCP Web Utilities Server

MCP Web Utilities Server

Lightweight MCP server that exposes web search and page fetching tools.

Features

• search_on_web and search_on_website using ddgs (DDGS | Dux Distributed Global Search, a multi-source search engine).
• fetch_webpage that returns simplified Markdown using crawl4ai with stealth settings.

Requirements

• Python 3.13+
• uv installed

Setup

Install uv on Windows (PowerShell):

powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"

uv sync

Then activate the virtual environment and run the crawler setup:

.venv\Scripts\activate
crawl4ai-setup

Run the server

uv run src\main.py

Or when developing:

start_mcp_server.cmd

LM Studio Configuration

To use this server in LM Studio, add the following to your MCP settings (mcp.json):

{
  "mcpServers": {
    "web-utilities": {
      "command": "uv",
      "args": [
        "--directory",
        "D:\\Dev\\McpServer",
        "run",
        "src\\main.py"
      ]
    }
  }
}

Note: Replace D:\\Dev\\McpServer with the actual path to your project.

Tools

search_on_web(query: str, results: int = 10) -> str

• Returns results formatted as:

[title](url)
description

search_on_website(query: str, sites: list[str], results: int = 10) -> str

• Same format, restricted to the provided sites.

fetch_webpage(target_url: str) -> str

• Returns simplified Markdown for the target page.

Tests

python -m unittest src.tests

Notes

• Avoid writing to STDOUT (e.g., print) when the server is running; it will break JSON RPC communication.
• Network-dependent tests may fail if external services are blocked in the current environment.