goldenpipe
Enables orchestrating data quality checks, transformation, and deduplication pipelines via an MCP interface. Offers tools for listing pipeline stages, validating wiring, running the full check-transform-match pipeline, and explaining configurations.
README
Moved. This repo has moved into the
benzsevern/goldenmatchmonorepo atpackages/python/goldenpipe/. This repo is archived; new development happens in the monorepo.
<!-- mcp-name: io.github.benzsevern/goldenpipe -->
GoldenPipe
Golden Suite orchestrator -- Check quality, fix issues, deduplicate records. One command. Built by Ben Severn.
What It Does
Raw Data
| GoldenCheck -- profile & discover quality issues
| GoldenFlow -- fix issues, standardize, reshape
| GoldenMatch -- deduplicate, match, create golden records
v
Golden Records
GoldenPipe orchestrates the full pipeline with adaptive logic:
- Skips transformation if no quality issues found
- Routes to privacy-preserving matching if sensitive fields detected
- Reports reasoning for every decision
Install
pip install goldenpipe
Quick Start
import goldenpipe as gp
result = gp.run("customers.csv")
print(result.status) # "success"
print(result.check) # Quality findings
print(result.transform) # What was fixed
print(result.match) # Deduplicated clusters
print(result.reasoning) # Why each decision was made
CLI
goldenpipe run customers.csv # Full pipeline
goldenpipe run customers.csv --verbose # Show reasoning
goldenpipe run customers.csv --skip-flow # Check + Match only
goldenpipe run customers.csv --strategy pprl # Force privacy mode
goldenpipe run customers.csv -o golden.csv # Save golden records
Remote MCP Server
GoldenPipe is available as a hosted MCP server on Smithery — connect from any MCP client without installing anything.
Claude Desktop / Claude Code:
{
"mcpServers": {
"goldenpipe": {
"url": "https://goldenpipe-mcp-production.up.railway.app/mcp/"
}
}
}
Local server:
pip install goldenpipe[mcp]
goldenpipe mcp-serve
4 tools available: list pipeline stages, validate wiring, run full check-transform-match pipeline, explain configs.
Part of the Golden Suite
| Tool | Purpose | Install |
|---|---|---|
| GoldenCheck | Validate & profile data quality | pip install goldencheck |
| GoldenFlow | Transform & standardize data | pip install goldenflow |
| GoldenMatch | Deduplicate & match records | pip install goldenmatch |
| GoldenPipe | Orchestrate the full pipeline | pip install goldenpipe |
Author
License
MIT
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.