Mcp Server Scraper
omnisilica
README
Purpose
This script was created to scrape configurations for MCP servers found on 'https://github.com/modelcontextprotocol/servers/tree/main/src'. Meant for LiteLLM.
Implementation and Reasoning
The main self executing function navigates to the github page and puts the object together.
Most of the scraping logic is in 'scrapeServerConfiguration'. MCP server configurations come in JSON that are exposed in some pages (server directories), and a user can copy them to the browser's clipboard. On other pages the configuration is hidden under a dropdown, i.e., "Using docker". The scraper primarily looks for docker configurations, followed by npx configurations, and uvx configurations if the preference doesn't exist. For whatever reason, playwright's selector keeps favoring the npx configuration (admittedly, this might be some fault in the code logic), so another 'for loop' was created to specifically get docker configurations if they exist (contact author for further explanation).
Console logs were added for debugging. Delete console logs or comments as preferred.
Usage
- Compile typescript: npm run build
- Run script: npm start
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
MCP Package Docs Server
Facilitates LLMs to efficiently access and fetch structured documentation for packages in Go, Python, and NPM, enhancing software development with multi-language support and performance optimization.
Claude Code MCP
An implementation of Claude Code as a Model Context Protocol server that enables using Claude's software engineering capabilities (code generation, editing, reviewing, and file operations) through the standardized MCP interface.
@kazuph/mcp-taskmanager
Model Context Protocol server for Task Management. This allows Claude Desktop (or any MCP client) to manage and execute tasks in a queue-based system.
Linear MCP Server
Enables interaction with Linear's API for managing issues, teams, and projects programmatically through the Model Context Protocol.
mermaid-mcp-server
A Model Context Protocol (MCP) server that converts Mermaid diagrams to PNG images.
Jira-Context-MCP
MCP server to provide Jira Tickets information to AI coding agents like Cursor
Linear MCP Server
A Model Context Protocol server that integrates with Linear's issue tracking system, allowing LLMs to create, update, search, and comment on Linear issues through natural language interactions.
Sequential Thinking MCP Server
This server facilitates structured problem-solving by breaking down complex issues into sequential steps, supporting revisions, and enabling multiple solution paths through full MCP integration.