extentos/mcp-server

**Give your AI coding agent the tools to build smart-glasses apps.**
Extentos is an MCP (Model Context Protocol) server that lets agents like Claude Code, Cursor, and Cline add smart-glasses capabilities — camera capture, voice triggers, live transcription, audio playback — to any Android or iOS app. The tools are deterministic: discovery, scaffolding, validation, and a browser-based simulator for end-to-end testing without hardware.
Works with Meta smart glasses today (Ray-Ban Meta, Oakley Meta, Meta Ray-Ban Display), with a multi-vendor architecture by design.
This repository is the public home of @extentos/mcp-server — releases, changelog, and issue tracking. The package ships on npm.
Install
**Claude Code**
**Cursor** — one click:
**Cline / any MCP client**
Requires Node 20+.
What your agent can do with it
| Tool group | What it does |
|---|---|
| **Discovery** | getPlatformInfo, getCapabilityGuide, getCodeExample — the SDK capability catalog, per-feature call shapes in Kotlin + Swift, and canonical end-to-end patterns (voice Q&A, photo-describe, live transcription UI, …) |
| **Scaffolding** | generateConnectionModule — generates the connection UI + manifest + platform config for your app (Android or iOS) |
| **Guidance** | getVoiceCommandGuidance, getPermissions — implementation guidance the agent queries instead of guessing |
| **Validation** | inspectIntegration, validateIntegration — deterministic checks of the integration in your repo |
| **Simulation** | createSimulatorSession, getEventLog, getSimulatorStatus — a browser simulator running the same SDK code as production with only the transport swapped; the agent drives it and reads the event log to verify behavior |
| **Production** | getProductionChecklist, getCredentialGuide — the path from simulator to real glasses |
| **Docs** | searchDocs — bundled, versioned documentation topics |
The workflow an agent typically runs: discover capabilities → scaffold the connection module → write handler code against the SDK → validate → simulate end-to-end → production checklist.
Tools
- **getPlatformInfo** — SDK capability catalog, version/artifact info, and platform constraints
- **getCapabilityGuide** — per-feature call shapes in Kotlin + Swift with gotchas
- **getCodeExample** — canonical end-to-end patterns (voice Q&A, photo-describe, live transcription UI, …)
- **getMigrationGuide** — mapping table and cutover plan from Meta DAT direct usage to Extentos
- **generateConnectionModule** — scaffold the connection UI, manifest, and platform config into your app
- **getConnectionPageConfig** — read the managed connection-page configuration
- **setConnectionPageConfig** — update the managed connection-page configuration
- **regenerateConnectionPageFile** — regenerate a managed connection-page file after config changes
- **adoptConnectionPageFile** — bring an existing connection-page file under managed configuration
- **getAssistantConfig** — read the managed voice-assistant configuration (model, voice, memory, wake sound)
- **setAssistantConfig** — update the managed voice-assistant configuration
- **listProjectSounds** — list custom sounds uploaded for the project
- **addProjectSound** — upload a custom sound (earcons, wake sounds) to the project
- **shutter** — trigger a camera shutter in the active simulator session