MCP Web Research Agent

MCP Web Research Agent

Enables a local AI assistant to search the web via DuckDuckGo, fetch and extract readable text from web pages, and save research notes as Markdown files to a chosen directory.

Category
Visit Server

README

MCP Web Research Agent for macOS

A Python Model Context Protocol (MCP) agent/server that gives a local AI assistant tools for:

  • search_web — public web search via DuckDuckGo HTML results
  • fetch_url — fetch a public web page and extract readable text
  • save_note — save research notes as Markdown/text files in a folder you choose

The project also includes agent.py, a small local bridge that connects Ollama to the MCP server. Ollama runs the LLM; this project provides the MCP tools and the tool-calling agent loop.

Note: Ollama itself is a model server, not a native MCP client. To use Ollama with MCP tools, run agent.py here or another MCP bridge/client.

What you need

  • MacBook Pro with macOS
  • Python 3.11 or newer (the mcp package requires Python 3.10+; setup prefers 3.13/3.12/3.11)
  • Ollama installed and running
  • A tool-calling local model. Recommended starting point:
    • qwen2.5:7b for 16 GB RAM Macs
    • qwen2.5:14b if you have enough RAM/performance
    • qwen3:14b if your Ollama version supports it well

1. Install

Open Terminal and run:

cd ~/Projects
git clone <your-repo-url> mcp-web-research-agent  # or copy this folder here
cd ~/Projects/mcp-web-research-agent

python3 -m venv .venv
source .venv/bin/activate
pip install --upgrade pip
pip install -r requirements.txt

If you do not have Python 3.11+:

brew install python

2. Install and start Ollama

Install Ollama from https://ollama.com or with Homebrew:

brew install --cask ollama

Open the Ollama app once, then pull a model:

ollama pull qwen2.5:7b
ollama serve

In another Terminal tab, verify Ollama is running:

curl http://localhost:11434/api/tags

3. Run the local Ollama MCP agent

From the project folder:

cd ~/Projects/mcp-web-research-agent
source .venv/bin/activate
python agent.py

Then ask something like:

Research recent MCP news, open the two best sources, summarize them, and save the summary as mcp-news.md.

One-shot mode:

python agent.py "Research current MCP SDK best practices and save notes."

Use a different model:

python agent.py --model qwen2.5:14b

Choose where notes are saved:

python agent.py --notes-dir ~/Documents/research-notes

4. Use with Claude Desktop

If you want Claude Desktop to connect directly to the MCP server, edit:

~/Library/Application Support/Claude/claude_desktop_config.json

Add:

{
  "mcpServers": {
    "web-research": {
      "command": "/Users/YOUR_USERNAME/Projects/mcp-web-research-agent/.venv/bin/python",
      "args": [
        "/Users/YOUR_USERNAME/Projects/mcp-web-research-agent/server.py"
      ],
      "env": {
        "MCP_NOTES_DIR": "/Users/YOUR_USERNAME/Documents/MCP-research-notes"
      }
    }
  }
}

Replace YOUR_USERNAME with your Mac username. Create the file if it does not exist. Restart Claude Desktop after editing.

5. Use with Cursor

Create or edit .cursor/mcp.json in a workspace:

{
  "mcpServers": {
    "web-research": {
      "command": "/Users/YOUR_USERNAME/Projects/mcp-web-research-agent/.venv/bin/python",
      "args": [
        "/Users/YOUR_USERNAME/Projects/mcp-web-research-agent/server.py"
      ],
      "env": {
        "MCP_NOTES_DIR": "/Users/YOUR_USERNAME/Documents/MCP-research-notes"
      }
    }
  }
}

Then restart Cursor or reload its MCP settings.

Tool reference

search_web(query: str, max_results: int = 5)

Returns search results as JSON:

{
  "query": "Model Context Protocol",
  "results": [
    {
      "title": "Example",
      "url": "https://example.com",
      "snippet": "..."
    }
  ]
}

fetch_url(url: str, max_chars: int = 8000)

Fetches an http/https URL and returns extracted text. It avoids JavaScript rendering, so it works best on normal HTML pages.

save_note(filename: str, content: str)

Saves a note to MCP_NOTES_DIR. The default directory is:

~/MCPWebResearch/notes

The tool sanitizes filenames and blocks path traversal.

Configuration

Environment variables:

  • OLLAMA_MODEL — default model used by agent.py; default is qwen2.5:7b
  • OLLAMA_URL — OpenAI-compatible Ollama chat endpoint; default is http://localhost:11434/v1/chat/completions
  • MCP_NOTES_DIR — directory for saved notes

Example:

export OLLAMA_MODEL=qwen2.5:14b
export MCP_NOTES_DIR=~/Documents/research-notes
python agent.py

Troubleshooting

Connection refused to localhost:11434

Ollama is not running. Start it with:

ollama serve

The agent does not call tools

Use a model with strong tool-calling support. qwen2.5:7b, qwen2.5:14b, and similar Qwen models are good starting points.

A page returns little text

Some websites block non-browser clients or require JavaScript. Try a different source, or use search_web and fetch_url together.

Claude Desktop does not show the server

Double-check that:

  • The Python path points to .venv/bin/python inside this project
  • The server.py path is absolute
  • The JSON file has valid syntax
  • You fully restarted Claude Desktop

Files

  • server.py — MCP server with web research tools
  • agent.py — local Ollama-powered MCP client/agent loop
  • requirements.txt — Python dependencies

Safety notes

  • This server can fetch public URLs and search the public web.
  • It can write files only into MCP_NOTES_DIR.
  • It does not execute shell commands.
  • Review saved notes and citations before relying on them.

Second MCP agent: Local Planner

The repo now includes a second MCP server/agent: local-planner. It stores projects, tasks, and Markdown notes on disk.

What it does

Tools:

  • create_project(name, description)
  • list_projects()
  • create_task(project, title, notes, priority, due_date, status)
  • list_tasks(project, status)
  • update_task(project, task_id, ...)
  • complete_task(project, task_id)
  • delete_task(project, task_id)
  • save_project_note(project, content, append)
  • get_daily_focus(for_date)

Default data directory:

~/MCPPlanner

Override it with:

export MCP_PLANNER_DIR=~/Documents/my-planner

Run the Ollama planner

bash run-planner.sh

One-shot:

bash run-planner.sh "Create a project called Weekend Yard Work with tasks for mowing, trimming bushes, and buying mulch."

Use a different model:

bash run-planner.sh --model qwen2.5:14b

Store planner data elsewhere:

bash run-planner.sh --data-dir ~/Documents/planner-data

Good planner prompts

Create a project called Home Network Upgrade and break it into at least six tasks with priorities.
Look at my daily focus and tell me what I should work on first.
Create a moving checklist project with tasks, due dates, and notes.
Mark the first task in the Weekend Yard Work project complete and tell me what remains.

Claude Desktop config for planner

Use:

claude_desktop_config.planner.example.json

Add it to:

~/Library/Application Support/Claude/claude_desktop_config.json

You can merge both servers under mcpServers so Claude sees web research and planning tools.

Cursor config for planner

Use:

cursor-mcp.planner.example.json

Files

  • planner_server.py — MCP server for projects/tasks/notes
  • planner_agent.py — Ollama bridge/agent for the planner
  • run-planner.sh — launcher

Third MCP agent: Health & Habit Tracker

The repo includes a third MCP server/agent for tracking habits, workouts, meals, and body measurements. All data is stored locally under MCP_HEALTH_DIR (default ~/MCPHealth).

This tool is for personal tracking only and does not provide medical advice.

Tools

  • create_habit(name, description, target_per_week, unit)
  • list_habits(active_only)
  • log_habit(log_date, value, notes, habit_id|habit_name)
  • log_workout(activity, duration_minutes, log_date, intensity, calories, distance_km, notes)
  • log_meal(description, meal_type, log_date, calories, protein_g, carbs_g, fat_g, notes)
  • log_measurement(weight_kg, log_date, body_fat_pct, waist_cm, notes)
  • list_logs(log_type, from_date, to_date, limit)
  • delete_log(log_id)
  • save_health_note(content, append)
  • get_daily_summary(for_date)
  • get_weekly_report(for_date)

Run with Ollama

bash run-health.sh

One-shot:

bash run-health.sh "Create habits for a 30-min walk, drinking water, and stretching, then log today's walk and a lunch salad."

Use a different model or data directory:

bash run-health.sh --model qwen2.5:14b --data-dir ~/Documents/health-data

Good prompts

Create habits for walking 5 days per week, drinking 80 oz of water, and stretching daily.
Log a 45-minute moderate run today that burned 420 calories and covered 6 km.
Log my breakfast: oatmeal with banana and peanut butter, about 520 calories and 22 grams of protein.
Give me today's health summary and list habits I still need to complete.
Give me my weekly report and tell me which habits I'm behind on.

Claude Desktop / Cursor configs

  • claude_desktop_config.health.example.json
  • cursor-mcp.health.example.json

You can run all three MCP servers together (web research, planner, health) by listing each under mcpServers.

Files

  • health_server.py — MCP server
  • health_agent.py — Ollama bridge/agent
  • run-health.sh — launcher

Recommended Servers

playwright-mcp

playwright-mcp

A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.

Official
Featured
TypeScript
Magic Component Platform (MCP)

Magic Component Platform (MCP)

An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.

Official
Featured
Local
TypeScript
Audiense Insights MCP Server

Audiense Insights MCP Server

Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.

Official
Featured
Local
TypeScript
VeyraX MCP

VeyraX MCP

Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.

Official
Featured
Local
graphlit-mcp-server

graphlit-mcp-server

The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.

Official
Featured
TypeScript
Kagi MCP Server

Kagi MCP Server

An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.

Official
Featured
Python
Neon Database

Neon Database

MCP server for interacting with Neon Management API and databases

Official
Featured
E2B

E2B

Using MCP to run code via e2b.

Official
Featured
Exa Search

Exa Search

A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.

Official
Featured
Qdrant Server

Qdrant Server

This repository is an example of how to create a MCP server for Qdrant, a vector search engine.

Official
Featured