rm-brain MCP server
Enables searching and exploring handwritten reMarkable notebooks through a natural conversation with Claude Desktop, with full-text search, classification, and source citations.
README
<div align="center">
๐ง rm-brain
A local-first "second brain" for your handwritten reMarkable notebooks โ searched through a normal Claude Desktop conversation.
Built by Gabriel Anhaia ยท โ Buy me a coffee
</div>
rm-brain quietly syncs the notebooks you drop into a Brain folder on your reMarkable, transcribes and classifies the handwriting with the Claude API, and stores everything in a local SQLite database. You then search and explore your notes as an ordinary conversation in Claude Desktop โ no separate app, no hosted service, using your existing Claude subscription.
You: "What did I decide about the Ordio pricing model?" Claude: Pulls it from your notes and answers with receipts โ notebook name, page number, date, and the scanned page.
It's designed to feel less like a search box and more like a system that quietly organizes itself and surfaces things you forgot about.
Why it's different
- Your handwriting, actually understood. Claude vision transcribes messy handwriting and diagrams far better than built-in OCR, and classifies each page (journal / meeting / idea / decision / โฆ), extracts people & projects, and flags open loops.
- The interface is a conversation, not a dashboard. Search happens inside Claude Desktop via MCP โ you get a world-class chat UI for free.
- Local-first and private by design. The database, page images, and manifest never leave your machine. See Privacy.
- Answers with receipts. Every answer cites the notebook, page number, and date, and can show you the scanned page โ so you verify, not trust blindly.
How it works
flowchart TD
A["โ๏ธ reMarkable Cloud"] -->|"rmapi: list Brain folder ยท stat ยท get"| B["๐ฆ .rmdoc archive<br/>(.rm v6 vector files)"]
B -->|rmc| C["๐ผ๏ธ per-page SVG"]
C -->|rsvg-convert| D["๐๏ธ page PNGs"]
D -->|"Claude vision ยท 1 call/page"| E["โ๏ธ Extraction<br/>text ยท type ยท entities ยท open loops"]
E --> F[("๐๏ธ SQLite + FTS5<br/>~/.rm-brain")]
CLI["โจ๏ธ CLI<br/>sync ยท search ยท backup"] --> F
F <--> G["๐ MCP server"]
G <--> H["๐ฌ Claude Desktop"]
classDef cloud fill:#e8f0fe,stroke:#4285f4,color:#1a1a1a;
classDef local fill:#e9f7ef,stroke:#27ae60,color:#1a1a1a;
classDef ai fill:#f3e8fd,stroke:#8e44ad,color:#1a1a1a;
class A cloud;
class B,C,D,F,CLI local;
class E,G,H ai;
reMarkable notebooks are stored as proprietary .rm v6 vector files (not PDFs), so pages are
rendered with rmc + rsvg-convert. See
ARCHITECTURE.md for the full design.
๐ Privacy & safety
- Local-first, always.
db.sqlite, page images, and the manifest live in one folder (~/.rm-brainby default) and never leave your machine as a whole. - The only things that ever go over the network are (a) individual page images sent to the
Claude API during
sync, and (b) individual queries + retrieved snippets sent through MCP while you search in Claude Desktop. - Opt-in by folder. Nothing is indexed unless you put the notebook in your Brain folder.
- The folder is the source of truth. Remove a notebook from it and the next
syncprunes it from your local index โ pages and images included. - Hard exclusion always wins. A notebook whose name matches
/^\./,/private/i, or/noindex/iis skipped entirely, even inside the Brain folder. - Read-only cloud access. rm-brain only ever reads from reMarkable (
list/stat/get); it never uploads or modifies anything. - No telemetry. rm-brain phones home to nobody. See SECURITY.md.
Prerequisites
โ No jailbreak, rooting, developer mode, or SSH hacks โ ever. rm-brain works entirely through reMarkable's official cloud sync (via
rmapi). Your tablet stays completely stock, stock firmware, and under warranty. Nothing is installed on or modified on the device.
| Tool | Why | Install |
|---|---|---|
| Node.js 20+ | runtime | nodejs.org |
rmapi (ddvk sync15 build) |
reMarkable Cloud CLI | ddvk/rmapi releases โ reMarkable's newer sync protocol returns HTTP 410 with older builds |
| rmc | renders .rm v6 pages |
pipx install rmc |
librsvg (rsvg-convert) |
SVG โ PNG | brew install librsvg |
| Anthropic API key | handwriting extraction (used only during sync) |
console.anthropic.com |
Quickstart
# 1. Install
git clone https://github.com/gabrielanhaia/remarkable-brain.git
cd remarkable-brain
npm install && npm run build
npm link # puts `rm-brain` on your PATH
# 2. Guided setup (pairs rmapi, saves your API key, wires Claude Desktop)
rm-brain setup
# 3. On the tablet: create a "Brain" folder, move a notebook in, let it sync
rm-brain sync
# 4. Fully quit & reopen Claude Desktop, then just ask it about your notes
The setup wizard checks your tools, pairs rmapi, prompts for your API key once and saves
it (to ~/.rm-brain/config.json, chmod 600 โ no re-export needed), helps you pick the
Brain folder, offers to run the first sync, and can write your Claude Desktop config
automatically. Re-run it anytime โ it's idempotent.
Usage
Once a notebook is indexed and Claude Desktop is connected, just talk to Claude:
- "What are my open loops?" / "What did I forget to follow up on?"
- "Search my notes for the Falcon pricing decision."
- "How has my thinking on the onboarding flow evolved?" (entity timeline)
- "Show me the page where I sketched the architecture."
CLI reference
| Command | What it does |
|---|---|
rm-brain setup |
Interactive setup wizard (start here) |
rm-brain sync |
Pull Brain-folder notebooks, render, extract, index |
rm-brain reindex |
Re-extract all indexed pages (after a prompt/model change) |
rm-brain search "<query>" |
Full-text search from the terminal |
rm-brain list |
Show indexed notebooks and page counts |
rm-brain info |
Where the data lives + stats |
rm-brain backup [dest] |
Write a portable .tar.gz of the whole index |
rm-brain exclude "<name>" / include "<name>" |
Exclude (purges) / re-include a notebook |
rm-brain purge |
Delete the entire local index |
rm-brain doctor |
Check dependencies |
rm-brain mcp |
Start the MCP server (Claude Desktop runs this) |
Configuration
All config is via environment variables (env wins) or the saved store (~/.rm-brain/config.json).
| Env var | Default | Purpose |
|---|---|---|
RM_BRAIN_HOME |
~/.rm-brain |
Where all local data lives |
RM_BRAIN_FOLDER |
/Brain |
reMarkable folder whose notebooks get indexed (case-insensitive) |
RMAPI_BIN |
rmapi |
Path/name of the rmapi binary (ddvk sync15 build) |
RMC_BIN |
rmc |
Path/name of the rmc renderer |
RSVG_BIN |
rsvg-convert |
Path/name of rsvg-convert |
ANTHROPIC_API_KEY |
โ | Required only for sync (extraction) |
ANTHROPIC_MODEL |
claude-sonnet-5 |
Vision model for extraction |
Portability & backup
The whole index is one self-contained folder, so:
- Back up:
rm-brain backup [dest.tar.gz], or just copy~/.rm-brain. - Roam / auto-backup: point
RM_BRAIN_HOMEat a Dropbox/iCloud/Syncthing folder. - Restore: extract the archive anywhere and point
RM_BRAIN_HOMEat it.
Troubleshooting
<details> <summary><b>rmapi says "failed to build documents tree โฆ status 410"</b></summary>
Your reMarkable account is on the newer sync protocol. Use the
ddvk sync15 build of rmapi (a release binary is
easiest), not the original juruen/rmapi. Then re-run rm-brain doctor.
</details>
<details> <summary><b>Claude Desktop gives empty results even though the note exists</b></summary>
Claude Desktop launches the MCP server once at startup and keeps it running. After any
rm-brain update, fully quit Claude Desktop (โQ, not just close the window) and reopen it
so it reloads the server.
</details>
<details> <summary><b>Claude answers from the calendar/memory instead of my notes</b></summary>
Add a one-line personal instruction in Claude Desktop โ Settings โ Profile / Custom Instructions: "I keep my handwritten notes in rm-brain. For anything about my tasks, plans, or notes, use the rm-brain tools first." The server also ships proactive instructions, but a personal instruction is the most reliable nudge. </details>
<details> <summary><b>My notebook isn't being indexed</b></summary>
Make sure it's inside the Brain folder (case-insensitive) and that the tablet has synced
to the cloud (Wi-Fi on). Then run rm-brain sync. Notebooks named private/noindex/dotted
are skipped by design.
</details>
<details> <summary><b>I changed the extraction prompt / model โ old pages didn't update</b></summary>
A normal sync skips pages whose image is unchanged. Run rm-brain reindex to re-extract
everything.
</details>
Roadmap / not in v1 (on purpose)
No vector search / embeddings (FTS5 keyword search only), no notifications or daily digests, no summary dashboard, no web UI. This stays a tool you reach for, not one that reaches for you. Ideas and PRs welcome โ see CONTRIBUTING.md.
Contributing
Contributions are very welcome! Please read CONTRIBUTING.md to get set up, and CODE_OF_CONDUCT.md. Security issues: SECURITY.md.
๐ Support
If rm-brain is useful to you, consider supporting development โ it genuinely helps and keeps the project going:
<p align="center"> <a href="https://buymeacoffee.com/anhaia"> <img src="https://img.shields.io/badge/Buy%20Me%20a%20Coffee-โ%20support-FFDD00?style=for-the-badge&logo=buymeacoffee&logoColor=black" alt="Buy Me a Coffee"> </a> ย ย <a href="https://xgabriel.com"> <img src="https://img.shields.io/badge/Visit-xgabriel.com-6E56CF?style=for-the-badge&logo=safari&logoColor=white" alt="xgabriel.com"> </a> </p>
You can also โญ star the repo โ it helps others discover it.
License
<div align="center"> <sub>Built by <a href="https://xgabriel.com">Gabriel Anhaia</a> ยท โ <a href="https://buymeacoffee.com/anhaia">Buy me a coffee</a></sub> </div>
Recommended Servers
playwright-mcp
A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots without requiring vision models or screenshots.
Magic Component Platform (MCP)
An AI-powered tool that generates modern UI components from natural language descriptions, integrating with popular IDEs to streamline UI development workflow.
Audiense Insights MCP Server
Enables interaction with Audiense Insights accounts via the Model Context Protocol, facilitating the extraction and analysis of marketing insights and audience data including demographics, behavior, and influencer engagement.
VeyraX MCP
Single MCP tool to connect all your favorite tools: Gmail, Calendar and 40 more.
graphlit-mcp-server
The Model Context Protocol (MCP) Server enables integration between MCP clients and the Graphlit service. Ingest anything from Slack to Gmail to podcast feeds, in addition to web crawling, into a Graphlit project - and then retrieve relevant contents from the MCP client.
Kagi MCP Server
An MCP server that integrates Kagi search capabilities with Claude AI, enabling Claude to perform real-time web searches when answering questions that require up-to-date information.
E2B
Using MCP to run code via e2b.
Neon Database
MCP server for interacting with Neon Management API and databases
Exa Search
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
Qdrant Server
This repository is an example of how to create a MCP server for Qdrant, a vector search engine.