metalift-mcp
Enables AI agents to scrape, crawl, and map websites into LLM-ready markdown via the Metalift API
README
@metalift/mcp
Metalift MCP server for AI agents. Exposes scrape, crawl, map, and batch tools over stdio for Cursor, Claude Desktop, and other MCP clients.
What is Metalift?
Metalift Cloud is a hosted web context platform — scrape, crawl, and map sites into LLM-ready markdown for AI agents. This MCP server connects your AI client to the Metalift API.
Get an API key
- Sign up for Metalift Cloud and verify your email.
- Complete onboarding and copy your API key from Dashboard → API keys.
New accounts receive 1,000 free credits/month. Set METALIFT_API_KEY in your MCP config (see below). Do not commit keys to git.
Install
Published on npm as @metalift/mcp. Default config uses npx:
{
"mcpServers": {
"metalift": {
"command": "npx",
"args": ["-y", "@metalift/mcp"],
"env": {
"METALIFT_API_URL": "https://api.metalift.ai",
"METALIFT_API_KEY": "YOUR_API_KEY"
}
}
}
}
Claude Desktop: paste the same JSON into claude_desktop_config.json (Settings → Developer → Edit Config). See MCP setup — Claude Desktop and examples/claude-mcp.json.
Corporate Windows / SSL inspection: if npx fails with UNABLE_TO_VERIFY_LEAF_SIGNATURE, install locally and use node — see examples/claude-mcp-local.json / cursor-mcp-local.json and MCP setup troubleshooting.
Troubleshooting
| Error | Cause | Fix |
|---|---|---|
Failed to acquire MessagePort |
Cursor IDE bug on Windows | Reload window, restart Cursor — details |
UNABLE_TO_VERIFY_LEAF_SIGNATURE |
Corporate SSL inspection blocks npm | Local install + node path — details |
| 401 / 402 at runtime | Auth or billing | Check API key and subscription |
Full guide: packages/platform-web/docs/mcp-setup.md.
Web search vs scrape
Search and scrape are separate tools with separate billing:
metalift_web_search— returns up to 10 search snippets (2 credits, English by default). Review titles and snippets first.metalift_scrape— fetches page content for URLs you choose (1+ credits per URL). Defaultresponse_detail=compact(~16k chars, no link lists). Usestandardfor full articles orfullfor raw JSON with all links.
Do not auto-scrape every search result. See Web search for agent workflow examples.
Environment variables
| Variable | Description |
|---|---|
METALIFT_API_URL |
Metalift scrape API base URL (default: https://api.metalift.ai) |
METALIFT_API_KEY |
Bearer token for authenticated API access |
Tools
| Tool | Description |
|---|---|
metalift_scrape |
Scrape a single URL (default: fast direct static markdown, response_detail=compact; use standard / full for more) |
metalift_batch_scrape |
Scrape multiple URLs (same response_detail; default compact) |
metalift_crawl |
Crawl a website |
metalift_map |
Discover site URLs from page HTML links |
metalift_sitemap |
Fetch XML sitemap URLs (robots.txt / sitemap.xml) |
metalift_web_search |
Web search — top 10 SERP results (title, url, snippet). 2 credits per search. Does not fetch page content; use metalift_scrape separately for URLs you need |
metalift_job_status |
Poll async jobs |
metalift_list_strategies |
List scrape strategies |
metalift_seed_session |
Store browser session cookies for a domain |
metalift_warm_session |
Warm WAF/retail cookies |
metalift_list_sessions |
List stored domain sessions |
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
Neon Database
MCP server for interacting with Neon Management API and databases
E2B
Using MCP to run code via e2b.
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.