J
jackulau/coding.sh
Local-first observability and evals for AI agents
View on GitHub ↗Link checked 2026-11-12 · HTTP 200 · opens the vendor's own site
Official descriptionLocal-first observability and evals for AI agents. Claude Code, Codex and other coding agents work out of the box. MIT, on SQLite.
Install & config
Install command from the repository
npm install -g coding.sh
Parsed from the README we fetched on 2026-11-07; we have not executed it.
This is the install method the repository states, not an MCP client config, so no JSON is generated.
Key names differ by client: Clients & CLI
- Star count
- 8 ★ · jackulau/coding.sh · read from the GitHub search API · (checked 2026-11-13 20:00:50)
- Source
- read directly from its GitHub page · type: open-source project
- Harvest history
- first seen 2026-11-08 · last seen 2026-11-14 · seen 7× · listed by 1 sources
- Score
- score 103 · 8 ★ · 1 sources · repo
- Install
npm install -g coding.sh
FAQ (answers come from our records)
How do I install it?
The repository provides this install command:
npm install -g coding.sh. It comes from the repository itself; we cannot guarantee it runs as-is in your client.Who is it for?
We filed it under these tags: 开源项目. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
repository
jackulau/coding.sh;first catalogued 2026-11-08;last seen 2026-11-14。There is no official certification or quality rating here — we record sources and dates only.Open-source, local-first observability and evals for any AI agent. Coding agents
以下摘录自该仓库的 README(片段) · 在 GitHub 读完整 README →
Your sessions stay on your machine.
Docs ·
Quickstart ·
Supported agents ·
Changelog ·
Discussions ·
Report a bug
sh
curl -fsSL https://coding.sh/install | sh
One Claude Code session in the local viewer, with the diff it made and the tests it ran. Sample data, generated by sample-sessions.mjs .
coding.sh records what your agents do: prompts, tool calls, file changes, model calls, latency and
tokens. It goes into a SQLite index on your machine. You browse it in a local viewer, query it from
the CLI or from your agents over MCP, turn failures into evals, and compare changes with paired
statistics. It covers the same ground as LangSmith or Braintrust, but capture, storage and the
viewer stay on your machine unless you add a remote sink.
MIT licensed, no runtime dependencies, Node 22.15 or newer.
## Quickstart
The install command above downloads the latest GitHub release, runs coding.sh init, then opens
the viewer. init finds your agents, shows one plan and asks once. It points their hooks at
coding.sh, registers the MCP server where the agent supports it, and backs up every config file it
edits. coding.sh init --dry-run prints the plan without writing anything (--diff adds the edits), and
coding.sh uninstall removes the hooks and MCP entries again.
Then use your agents as usual. Sessions show up on their own, with no ingest step. To pull in
sessions from before you installed:
sh
coding.sh ingest --backfill
coding.sh is not on npm yet, so npm install -g coding.sh doesn't work today. Installing from
source, updates and uninstall: docs/guides/install.md.
## What you get
Record. Hooks and transcripts capture each session, including subagents.
coding.sh run -- wraps any other agent and snapshots the repo before and after.
coding.sh collector takes OpenTelemetry from agent frameworks and apps.
Measure. Every session has its turns, tool calls, model calls, tokens, latency and outcome.
Sessions that edited code and never ran a check get a no-verification flag.
sh
coding.sh sessions # recent sessions
coding.sh show latest # timeline with turns, tools, subagents and latency
coding.sh search "rate limit" # full-text search over prompts, replies and tool calls
coding.sh usage --by model # tokens, turns and cache hits
coding.sh ui # the local viewer
Every command takes --json. coding.sh mcp gives your agents the same data as MCP tools.
More in docs/guides/explore.md.
Compare. Turn a failed session into a replayable eval with coding.sh eval new, and check
that its verifier is fair with coding.sh eval validate. Run experiments over versioned datasets
with code graders or calibrated LLM judges. coding.sh exp compare and coding.sh compare A/B
prompts, harness files and models with paired statistics. Tool evals and multi-agent workflow
runs are covered too. More in docs/guides/evals.md.
Benchmark. coding.sh bench draws new cases every day from a script, your failed sessions,
GitHub issues or a sitemap. Every contender gets the same frozen set in random order, and
bench report writes a static page with the trend, today's head to head and where each one
fails. More in docs/guides/benchmarks.md.
Production. coding.sh serve runs ingest, the viewer and the API on one port, backed by
Docs ·
Quickstart ·
Supported agents ·
Changelog ·
Discussions ·
Report a bug
sh
curl -fsSL https://coding.sh/install | sh
One Claude Code session in the local viewer, with the diff it made and the tests it ran. Sample data, generated by sample-sessions.mjs .
coding.sh records what your agents do: prompts, tool calls, file changes, model calls, latency and
tokens. It goes into a SQLite index on your machine. You browse it in a local viewer, query it from
the CLI or from your agents over MCP, turn failures into evals, and compare changes with paired
statistics. It covers the same ground as LangSmith or Braintrust, but capture, storage and the
viewer stay on your machine unless you add a remote sink.
MIT licensed, no runtime dependencies, Node 22.15 or newer.
## Quickstart
The install command above downloads the latest GitHub release, runs coding.sh init, then opens
the viewer. init finds your agents, shows one plan and asks once. It points their hooks at
coding.sh, registers the MCP server where the agent supports it, and backs up every config file it
edits. coding.sh init --dry-run prints the plan without writing anything (--diff adds the edits), and
coding.sh uninstall removes the hooks and MCP entries again.
Then use your agents as usual. Sessions show up on their own, with no ingest step. To pull in
sessions from before you installed:
sh
coding.sh ingest --backfill
coding.sh is not on npm yet, so npm install -g coding.sh doesn't work today. Installing from
source, updates and uninstall: docs/guides/install.md.
## What you get
Record. Hooks and transcripts capture each session, including subagents.
coding.sh run -- wraps any other agent and snapshots the repo before and after.
coding.sh collector takes OpenTelemetry from agent frameworks and apps.
Measure. Every session has its turns, tool calls, model calls, tokens, latency and outcome.
Sessions that edited code and never ran a check get a no-verification flag.
sh
coding.sh sessions # recent sessions
coding.sh show latest # timeline with turns, tools, subagents and latency
coding.sh search "rate limit" # full-text search over prompts, replies and tool calls
coding.sh usage --by model # tokens, turns and cache hits
coding.sh ui # the local viewer
Every command takes --json. coding.sh mcp gives your agents the same data as MCP tools.
More in docs/guides/explore.md.
Compare. Turn a failed session into a replayable eval with coding.sh eval new, and check
that its verifier is fair with coding.sh eval validate. Run experiments over versioned datasets
with code graders or calibrated LLM judges. coding.sh exp compare and coding.sh compare A/B
prompts, harness files and models with paired statistics. Tool evals and multi-agent workflow
runs are covered too. More in docs/guides/evals.md.
Benchmark. coding.sh bench draws new cases every day from a script, your failed sessions,
GitHub issues or a sitemap. Every contender gets the same frozen set in random order, and
bench report writes a static page with the trend, today's head to head and where each one
fails. More in docs/guides/benchmarks.md.
Production. coding.sh serve runs ingest, the viewer and the API on one port, backed by
Listed badge (optional)
Copy this line into the README if you want the listing mark. Optional, and it does not affect being listed.
[](https://anclum.com/en/s/jackulau-coding-sh/)
- Source
- github · https://github.com/jackulau/coding.sh
- Browse by field
- Open source
- Traction
- 8 ★
- added
- today
More like this
Filed under
Every tag opens the full list for that filter. Counts are the live catalogue figures.