FabianIMV/voice-coach-mcp

Give Claude ears. A local MCP server that listens to you sing, speak and read
aloud, measures what it hears, and lets Claude coach your voice.
Claude cannot process audio. This server records from your microphone, analyzes the audio
on your computer, and returns compact measurements that Claude turns into concrete coaching:
| Mode | What it measures |
| 🎤 Singing | Pitch accuracy per note (cents), flat/sharp tendency, drift, stability and vibrato. Compares against equal temperament, a key, or a MIDI melody, including wrong, missed and late notes. |
| 🗣️ English pronunciation | Phoneme-level comparison of what you said against what you meant to read, with per-word scores and frequent confusions (θ → s, v → b, iː → ɪ…). |
| 🎙️ Public speaking | Words per minute, long pauses, filler words (English and Spanish), pitch monotony and volume variation, with a timestamped transcript. |
A bundled skill turns Claude into a coach: it runs warm-up → exercise → analysis → feedback
sessions, gives one concrete focus per take, and keeps a progress log across sessions. Claude
replies in your language.
Local and private: audio never leaves your computer (unless you opt into the Azure backend).
Free: open-source models (faster-whisper, wav2vec2) and no API keys.
Tools measure, Claude interprets: every response is compact JSON (≤ 2 KB) with confidence
and warnings, so Claude never coaches on bad audio.
## Install
You need uv and, for pronunciation, espeak-ng:
bash
brew install uv espeak-ng ffmpeg # macOS (ffmpeg is optional: m4a/aac input)
On Linux: install uv, then sudo apt install espeak-ng ffmpeg libportaudio2. Pronunciation
analysis on macOS needs Apple Silicon and macOS 14 or later (a PyTorch requirement).
### Claude Code (plugin: server + skill)
bash
claude plugin marketplace add FabianIMV/voice-coach-mcp
claude plugin install voice-coach@voice-coach
Or, inside a session: /plugin install voice-coach --marketplace FabianIMV/voice-coach-mcp.
The first start installs the Python dependencies with uv, which can take a minute or two (the
models download later, on first use). If /mcp shows voice-coach as failed right after
installing, reconnect it from /mcp once the installation finishes.
### Claude Desktop (extension)
Download voice-coach.mcpb from the latest release
and double-click it (or drag it into Claude Desktop). For the coaching skill, also download
voice-coach-skill.zip and upload it in Settings → Capabilities → Skills.
### Any MCP client (manual)
bash
claude mcp add voice-coach --scope user -- uvx --from "voice-coach-mcp[speech,pronunciation]" voice-coach-mcp
For Claude Desktop's claudedesktopconfig.json, use absolute paths (Desktop does not inherit
your shell PATH; which uvx prints it):
json
"mcpServers": {
"voice-coach": {
"command": "/opt/homebrew/bin/uvx",
"args": ["--from", "voice-coach-mcp[speech,pronunciation]", "voice-coach-mcp"]
Optional: run uvx --from "voice-coach-mcp[speech,pronunciation]" voice-coach-mcp download-models
once, so the first call does not wait for the models (~480 MB Whisper, ~1.3 GB phoneme model).
### Microphone permission (macOS)
macOS grants the microphone to the app that launches the server: Claude Desktop, or the