url-js-finder

url-js-finder

MCP server that wraps URLFinder and JSFinder to extract URLs, JavaScript files, subdomains, and sensitive information from web pages, with support for batch scanning and deep crawling.

Category
Visit Server

README

url-js-finder MCP Server

封装两个开源 URL/JS 信息提取工具为 MCP server,供 AI 全局调用(Reasonix [[plugins]] 注册)。

授权提醒:两个工具均为主动网络爬取工具,仅可用于自有或已授权目标(渗透测试、CTF、SRC)。

许可证

  • 封装代码(server.py / SKILL.md / test_client.py 等):MIT,见 LICENSE
  • 上游工具:third_party/URLFinderpingc0y/URLFinder,MIT)与 third_party/JSFinderThreezh1/JSFinder),各自 LICENSE 随源码保留。

封装对象

工具 上游 技术栈 能力
URLFinder https://github.com/pingc0y/URLFinder Go(已编译 bin/URLFinder.exe 页面信息提取:URL / JS / 敏感信息 / 子域名;状态码过滤、深入抓取、404 目录 fuzz
JSFinder https://github.com/Threezh1/JSFinder Python(third_party/JSFinder/JSFinder.py 从页面/JS 文件中提取 URL 与子域名;深度爬取

目录结构

url-js-finder/
├── server.py            # MCP server 入口(FastMCP,stdio)
├── requirements.txt     # mcp>=1.26,<2
├── README.md
├── bin/
│   └── URLFinder.exe    # URLFinder 编译产物(Go 1.26,-s -w,Update=dev 禁更新检查)
└── third_party/
    ├── URLFinder/       # 上游源码(git clone --depth 1)
    └── JSFinder/        # 上游源码(单文件 JSFinder.py,依赖 requests+bs4)

MCP 工具

urlfinder_scan — URLFinder 页面信息提取

扫描单个 URL 或批量 URL 文件,返回:域名列表、主域 URL、其他域 URL、JS 链接、敏感信息、fuzz 结果。

关键参数:url / batch_file(二选一)、status_codes(如 200,403all)、 mode(1 正常 / 2 深入 / 3 安全深入)、domain_regexcookieuser_agentproxytimeoutthreadsmax_linksfuzz(1/2/3)、export_dirrun_timeout

jsfinder_scan — JSFinder JS 提取

扫描页面 URL 或 URL/JS 列表文件,返回:URL 列表、子域名列表。

关键参数:url / file(二选一)、is_js_filedeep(深度爬取)、cookierun_timeout

使用注意

  • 授权:两个工具均为主动网络爬取工具,仅可用于自有/已授权目标。
  • 速度status_codes 验证与 deep 深度爬取显著耗时;大目标先试 mode=1
  • 返回:所有工具返回 JSON 字符串(UTF-8,ensure_ascii=False),可直接结构化解析。
  • 超时run_timeout 控制整个扫描进程超时,超时返回明确 error 信息。

自测

python test_client.py

重新编译 URLFinder(可选)

cd third_party/URLFinder
go build -ldflags "-s -w -X github.com/pingc0y/URLFinder/cmd.Update=dev" -o ../../bin/URLFinder.exe .

配置注册(Reasonix config.toml)

[[plugins]]
name    = "url-js-finder"
command = "python"
args    = ["C:\\Users\\36078\\skills\\mcp\\url-js-finder\\server.py"]

Recommended Servers

playwright-mcp

playwright-mcp

A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.

Official
Featured
TypeScript
Magic Component Platform (MCP)

Magic Component Platform (MCP)

An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.

Official
Featured
Local
TypeScript
Audiense Insights MCP Server

Audiense Insights MCP Server

Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.

Official
Featured
Local
TypeScript
VeyraX MCP

VeyraX MCP

Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.

Official
Featured
Local
Kagi MCP Server

Kagi MCP Server

An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.

Official
Featured
Python
graphlit-mcp-server

graphlit-mcp-server

The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.

Official
Featured
TypeScript
Neon Database

Neon Database

MCP server for interacting with Neon Management API and databases

Official
Featured
Exa Search

Exa Search

A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.

Official
Featured
Qdrant Server

Qdrant Server

This repository is an example of how to create a MCP server for Qdrant, a vector search engine.

Official
Featured
E2B

E2B

Using MCP to run code via e2b.

Official
Featured