skrape
Converts any webpage into clean, LLM-ready Markdown, removing noise and supporting JavaScript rendering.
README
Skrape MCP Server
Convert any webpage into clean, LLM-ready Markdown using skrape.ai. Perfect for feeding web content into LLMs.
This MCP server provides a simple interface to convert web pages to structured, clean Markdown format using the skrape.ai API. It's designed to work seamlessly with Claude Desktop, other LLMs, and MCP-compatible applications.
<a href="https://glama.ai/mcp/servers/7i81qzgkzd"> <img width="380" height="200" src="https://glama.ai/mcp/servers/7i81qzgkzd/badge" /> </a>
Why Use Skrape for LLM Integration?
- Clean, Structured Output: Generates well-formatted Markdown that's ideal for LLM consumption
- Noise Reduction: Automatically removes ads, navigation menus, and other irrelevant content
- Consistent Format: Ensures web content is uniformly structured regardless of the source
- JavaScript Support: Handles dynamic content by rendering JavaScript before conversion
- LLM-Optimized: Perfect for feeding web content into LLMs like Claude, GPT, and other LLM models
Features
Tools
get_markdown- Convert any webpage to LLM-ready Markdown- Takes any input URL and optional parameters
- Returns clean, structured Markdown optimized for LLM consumption
- Supports JavaScript rendering for dynamic content
- Optional JSON response format for advanced integrations
Installation
Installing via Smithery
To install Skrape MCP Server for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install @skrapeai/skrape-mcp --client claude
Manual Installation
-
Get your API key from skrape.ai
-
Install dependencies:
npm install
- Build the server:
npm run build
- Add the server config to Claude Desktop:
On MacOS:
nano ~/Library/Application\ Support/Claude/claude_desktop_config.json
On Windows:
notepad %APPDATA%/Claude/claude_desktop_config.json
Add this configuration (replace paths and API key with your values):
{
"mcpServers": {
"skrape": {
"command": "node",
"args": ["path/to/skrape-mcp/build/index.js"],
"env": {
"SKRAPE_API_KEY": "your-key-here"
},
}
}
}
Using with LLMs
Here's how to use the server with Claude or other LLM models:
- First, ensure the server is properly configured in your LLM application
- Then, you can ask the ALLMI to fetch and process any webpage:
Convert this webpage to markdown: https://example.com
Claude will use the MCP tool like this:
<use_mcp_tool>
<server_name>skrape</server_name>
<tool_name>get_markdown</tool_name>
<arguments>
{
"url": "https://example.com",
"options": {
"renderJs": true
}
}
</arguments>
</use_mcp_tool>
The resulting Markdown will be clean, structured, and ready for LLM processing.
Advanced Options
The get_markdown tool accepts these parameters:
url(required): Any webpage URL to convertreturnJson(optional): Set totrueto get the full JSON response instead of just markdownoptions(optional): Additional scraping optionsrenderJs: Whether to render JavaScript before scraping (default: true)
Example with all options:
<use_mcp_tool>
<server_name>skrape</server_name>
<tool_name>get_markdown</tool_name>
<arguments>
{
"url": "https://example.com",
"returnJson": true,
"options": {
"renderJs": false
}
}
</arguments>
</use_mcp_tool>
Development
For development with auto-rebuild:
npm run watch
Debugging
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector:
npm run inspector
The Inspector will provide a URL to access debugging tools in your browser.
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.