pouriaetab/llmledger

Which AI model should you use, and what will it cost? Paste a prompt and get the best value
model for it, the top rated one and the cheapest rated one, with what each costs and the chance
its price changes in the next 90 days. Behind it: every price change in LiteLLM's model catalogue
since 2023 (4,200+ models), Arena's quality ratings, and a competing risks survival model, rebuilt
every day.
Try it: https://pouriaetab.github.io/llmledger/ (no sign up, the prompt stays in your browser)
## Use it inside Claude
The same answers inside Claude Code, Claude Desktop, Cursor or any app that speaks MCP. Nothing to host, no keys:
bash
claude mcp add llmledger -- uvx llmledger-mcp
Eleven tools: suggest a model and effort level for a project, compare models side by side, estimate a budget, find
models within limits, a model's price history with its outlook, new models not priced yet, how long a job takes (learned
from your own runs), a quote for a whole job from a promptfoo sample, whether buying a computer to run an open model
pays off, and what your own coding agent usage (a ccusage or codeburn export) would have cost on every other model.
Other apps and details: mcp/README.md.
As an Agent Skill, which stays out of the context until it is used (about 150 tokens against well over 1,000 for the
plug-in's tools) and needs only Python:
text
/plugin marketplace add pouriaetab/llmledger
/plugin install llmledger@llmledger
or npx skills add pouriaetab/llmledger, or copy skills/llmledger into your agent's skills folder.
## Watch the models you use
A GitHub Action that fails a check (or just reports) when a model your project uses changes price, gets a retirement
date or leaves the catalogue. On the GitHub Marketplace, or
add it to a workflow that runs on a schedule:
yaml
uses: pouriaetab/llmledger@main
with:
models: gpt-5, claude-sonnet-4-5, deepseek/deepseek-chat
days: 7 # a price change within this many days counts
fail: "true" # "false" only reports; the report is in the step's outputs
Keys are LiteLLM's (gpt-5, not openai/gpt-5; the Action finds the bare key when a prefix is given). The same check
from a shell: python action/watch.py --models "gpt-5,claude-sonnet-4-5".
A badge for a model, for any README, refreshed every day:
markdown
The address is the key with / as -- and : as - (badge/azure--eu--gpt-5.json). It shows the prices per 1M
tokens and the chance of a price change in 90 days (amber from 10%), or the retirement date (orange).
## What you get
Ask. Paste a prompt, see the best value model, the top rated and the cheapest rated for its task (coding, math,
writing, 7 fields, 7 languages, images, documents, websites), with the cost per answer and the chance of a price
change. The task is guessed from the prompt, in the browser.
Compare. Up to five models side by side: Arena rating, prices, cost per task, effort levels, or how fast each uses
a Claude or ChatGPT plan. Cost against quality, with the models no other model beats on both.
Models. Every model in the catalogue, as LiteLLM lists it or grouped by model, with its price history, every
change linked to the LiteLLM commit behind it, and its outlook.
Trends. Two years of Arena leaderboards replayed: the best open model against the best closed one, the top