BrowserAgent
MCP server for Puppeteer-based browser automation with a unified observe (a11y snapshot + pixel overlay), diff engine, event layer, and action primitives.
README
<p align="center"> <img alt="BrowserEngine" src="https://raw.githubusercontent.com/PremierStudio/BrowserEngine/master/docs/banner.svg" width="90%"/> </p>
<p align="center"> An agent explores the product. CI replays the path with no AI. A broken step is a named report. Your tools decide ticket or heal. </p>
<p align="center"> <a href="https://github.com/PremierStudio/BrowserEngine/blob/master/LICENSE"><img alt="License" src="https://img.shields.io/badge/license-Apache--2.0-blue.svg"/></a> <a href="https://github.com/PremierStudio/BrowserEngine/actions"><img alt="CI" src="https://img.shields.io/github/actions/workflow/status/PremierStudio/BrowserEngine/ci.yml?branch=master&label=CI&logo=github"/></a> <a href="https://github.com/PremierStudio/BrowserEngine"><img alt="Coverage" src="https://img.shields.io/badge/coverage-100%25-brightgreen.svg"/></a> <a href="https://github.com/PremierStudio/BrowserEngine"><img alt="Mutation score" src="https://img.shields.io/badge/mutation-100%25-success.svg"/></a> <a href="https://github.com/PremierStudio/BrowserEngine"><img alt="TypeScript" src="https://img.shields.io/badge/TypeScript-6.0-blue.svg?logo=typescript&logoColor=white"/></a> <a href="https://pptr.dev"><img alt="Puppeteer" src="https://img.shields.io/badge/Puppeteer-25-green.svg?logo=puppeteer&logoColor=white"/></a> <a href="https://modelcontextprotocol.io"><img alt="MCP" src="https://img.shields.io/badge/MCP-authoring-orange.svg"/></a> <a href="https://nodejs.org"><img alt="Node" src="https://img.shields.io/badge/Node-%3E%3D20.19-339933.svg?logo=nodejs&logoColor=white"/></a> <a href="https://github.com/PremierStudio/BrowserEngine/graphs/contributors"><img alt="PRs welcome" src="https://img.shields.io/badge/PRs-welcome-brightgreen.svg"/></a> </p>
<p align="center"> <a href="#what">What it is</a> · <a href="#start">Start</a> · <a href="#flows">Flows</a> · <a href="docs/usage.md">Usage</a> · <a href="docs/ci.md">CI</a> · <a href="docs/architecture.md">Architecture</a> · <a href="docs/engineering.md">Engineering</a> </p>
<a id="what"></a>
What it is
You can already ask an agent to click through a checkout. That works once. The next morning you want the same path on every commit, without paying for another model call, and without a test that dies the first time a designer changes a CSS id.
Today that usually means one of two dead ends:
- Chat browsers (most MCP tools). The agent looks at the page, clicks, and talks to you. Tomorrow you run the agent again. Every replay spends tokens. The path lives in a transcript, not in CI.
- Recorders (Playwright codegen, Selenium IDE, and friends). You get
#txt_visit_dateand.btn-primary. The next rename breaks the test. The log does not say "Login is gone." It says a selector missed. A person has to debug CSS.
BrowserEngine is the middle path.
The agent drives a real Chrome window and refers to controls the way a person would: "Username", "Login", "the Add to cart near Sauce Labs Backpack." Those visible names are what get saved, as ordinary JSON. CI then opens Chrome and follows the same names. No language model is in that run. No MCP session is required. The bill is the same as any other headless test.
When a step fails, CI gets a named report, not a dead CSS selector: step 2 click Login: two matches. --report writes JSON. --junit writes one testcase. This repo does not open tickets or push a heal. Everyone uses a different tracker and a different branch policy. Your next job (or an agent) reads the file and uses your tools.
That is what this repo is for: author with an agent, keep a file, replay without one, emit a report when it breaks. Headed while you watch, headless in CI. Same engine.
Modes
| Mode | For | How |
|---|---|---|
| Headed (default) | Authoring and demos | Visible Chrome, cursor HUD, paced typing |
| Headless | CI and background | BROWSER_ENGINE_HEADED=0 |
| MCP stdio | A live agent in this process | npm start |
| MCP HTTP | A remote agent | npm start -- --http |
| CLI compile | Check a flow file, no Chrome | node dist/cli.js compile path.json |
| CLI run | Replay a flow | node dist/cli.js run path.json |
| CI report | Machine file for any host | --json · --report out.json · --junit out.xml |
Pace, type delay, expect timeout, and the work-area snap are all env-configurable. See usage.
<a id="start"></a>
Start
Requires Node.js >= 20.19.
git clone https://github.com/PremierStudio/BrowserEngine.git
cd BrowserEngine
npm install
npm run build
Check the checked-in fixture (compile does not open Chrome). The JSON is a schema example. https://example.com/login is not a real form, so do not run this file against the network.
node dist/cli.js compile tests/fixtures/login.flow.json
Replay your flow headless, and write a report:
$env:BROWSER_ENGINE_HEADED='0'
node dist/cli.js run flows/your.flow.json --report reports/flow.json --junit reports/flow.xml
A failure names the step (step 2 click: no target ...) and the same facts land in the report file. Paste-ready GitHub, GitLab, Forgejo, and Bitbucket jobs: CI.
Give an agent the same engine over MCP:
npm start
Point the client at node dist/cli.js. Prefer one run_flow over observe-per-page. Full tool list, desk controls, and env vars: usage.
<a id="flows"></a>
Flows
Click and navigate must declare expectUrl or expectText. Type, hover, scroll, select, and press do not.
{
"version": 1,
"name": "login",
"origin": "https://example.com",
"steps": [
{
"action": "navigate",
"url": "https://example.com/login",
"expectText": "Username"
},
{ "action": "type", "name": "Username", "text": "tomsmith" },
{
"action": "click",
"name": "Login",
"role": "button",
"expectText": "Logout"
}
]
}
Author with run_flow until every bind is unique, write the JSON (no uids), then compile / run in CI. Any host can fail the job on exit code 1. Pass --report / --junit for a machine file your next job (or an agent) can read. Paste-ready GitHub, GitLab, Forgejo, and Bitbucket jobs: CI.
Docs
| Doc | What is in it |
|---|---|
| Usage | MCP, desk/page/intent tools, env, public-site demos |
| CI | compile / run on GitHub, GitLab, Forgejo, Bitbucket |
| Architecture | Engine, clients, page model, what is not in this repo |
| Engineering | npm run ci, 100/100 gates, stack |
| decisions.md | Settled engineering decisions |
Contributing
AGENTS.md and docs/engineering.md. Failing test first. No merge below 100% coverage and 100% mutation. TypeScript only.
License
Apache License 2.0 © Premier Studio. See LICENSE.
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.