DroidPilot
Drive an Android phone over ADB and expose it to AI agents via MCP, enabling natural language-driven interaction for native app testing.
README
DroidPilot
Drive an Android phone over ADB + UIAutomator and expose it to an AI agent over MCP — Playwright-style, for native-app user testing.
The idea: while you build an Android app with Claude Code on your computer, that same Claude can drive your phone to run the user tests — tap, type, read the screen, and assert outcomes — by calling DroidPilot's tools over MCP. DroidPilot is the hands and eyes; Claude is the brain.
Claude Code (your computer, the test agent)
│ MCP (stdio)
▼
DroidPilot MCP server ──► adb / UIAutomator ──► Android phone (USB)
tap · type · swipe · screenshot · dump UI · wait · assert
Requirements
- Python 3.10+
- adb (Android platform-tools) on PATH or under
ANDROID_HOME/the default SDK - A phone with USB debugging enabled and authorized (unavoidable for controlling taps — unlike screen mirroring, driving the device needs adb)
Install
pip install -e . # from a clone
# or: pip install git+https://github.com/LioMatthys/droidpilot
Use it three ways
1. With Claude Code (the point) — MCP
Register the server once:
claude mcp add droidpilot -- droidpilot-mcp
# (equivalently: claude mcp add droidpilot -- python -m droidpilot.mcp_server)
Then just ask Claude Code, e.g.:
Plug-in check: my phone is connected. Test that Beam (
life.overture.beam) shows a 6-digit code after I start sharing. Launch it, start sharing, accept the capture prompt, and confirm a code appears — screenshot the result.
Claude will call screen / screenshot to see the phone, tap_text / type_text to
act, and assert_text to verify — running the test like a human would.
2. As a CLI (manual / smoke testing)
droidpilot devices
droidpilot launch life.overture.beam
droidpilot screen # list on-screen elements
droidpilot tap-text "Start sharing"
droidpilot screenshot out.png
droidpilot assert-text "Code"
3. As a Python library (scripted tests)
from droidpilot import Device
dev = Device(); dev.connect()
dev.launch_app("life.overture.beam")
dev.wait_for_text("Beam", timeout=15)
dev.tap_text("Start sharing")
dev.assert_text("Code")
dev.screenshot("beam.png")
See examples/test_beam_flow.py.
MCP tools
| Tool | What it does |
|---|---|
list_devices |
connected devices + state |
launch_app(package) / stop_app(package) |
start/stop an app |
screen() |
compact text list of on-screen elements (label, tap point, id) |
screenshot() |
PNG of the current screen (visual inspection) |
tap(x,y) / tap_text(text) |
tap by coordinates or by element text |
type_text(text) |
type into the focused field |
press_key(key) |
back / home / enter / … or a raw KEYCODE_* |
swipe(direction) |
up / down / left / right |
wait_for_text(text, timeout) |
wait for an element to appear |
assert_text(text) |
pass/fail check that text is on screen |
screen_size() |
WIDTHxHEIGHT |
screen() (cheap text) + screenshot() (image) give the agent both a structured and a
visual view; it usually picks targets from screen() and uses tap_text.
Limits (v0.1)
- One device at a time (pass a serial to target a specific one).
- System dialogs are localized — "Start now" vs "Démarrer maintenant". The agent reads the screen, so it adapts; scripted tests should match your device locale.
- No video recording yet; screenshots only.
type_textescapes spaces/specials foradb shell input; exotic Unicode may not type.
Why not Appium/Maestro?
Both are great, but heavier (a server + drivers, or YAML flows). DroidPilot is a thin, agent-shaped surface: a handful of tools an LLM can call directly, built on the same ADB/UIAutomator primitives Google ships. Use Appium/Maestro for big scripted suites; use DroidPilot when you want Claude to test the app for you.
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.