llmops-radar

Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment
**⭐ Star this repo to bookmark — fresh data every 15 minutes**
English · 中文 · 日本語 · 한국어 · Español · Português
---
💡 What is this?
A continuously-updated tracker that discovers, catalogs, and scores new LLMOps tools as they appear on GitHub and Product Hunt. Unlike static awesome-lists, it runs daily via GitHub Actions to surface tools launched in the past week across categories like observability, prompt management, cost tracking, and gateways.
This list is **auto-updated every 15 minutes** by a GitHub Actions cron.
Each commit reflects a real change in the upstream data source — new items added,
expired items removed — so you can rely on what you see being current.
---
📋 Current Items
> ⏰ Last updated: 2026-10-16 07:45 UTC
>
> Data source: GitHub Search API
>
> The table below is rewritten on every cron tick. Star the repo to bookmark.
| # | Name | ⭐ | Lang | Updated | Description |
|---|------|---|------|---------|-------------|
| 1 | korczis/prismatic-majordomus | 0 | Rust | 2026-10-16 | A lightweight supervisory control layer for AI-assisted work: one policy, generated instructions for every AI tool, dura |
| 2 | vllm-project/vllm-ascend | 2993 | Python | 2026-10-16 | Community maintained hardware plugin for vLLM on Huawei Ascend |
| 3 | BerriAI/litellm | 61360 | Python | 2026-10-16 | The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra |
| 4 | anthony-chaudhary/fak | 41 | Go | 2026-10-16 | Agentic Runtime |
| 5 | kelvran/gateway | 0 | Go | 2026-10-16 | Self-hosted Go LLM gateway with a risk-gated response cache. OpenAI-compatible API in front of AWS Bedrock, Anthropic, O |
| 6 | intel/enterprise-ai-solutions | 8 | Shell | 2026-10-16 | Production-ready platform for deploying OpenAI-compatible LLM inference on Kubernetes. A one-command installer for enter |
| 7 | comet-ml/opik | 22642 | Python | 2026-10-16 | Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, autom |
| 8 | byte5ai/omadia | 31 | TypeScript | 2026-10-16 | Self-hostable agentic OS. Build, run & audit multi-agent AI teams from signed plugins. Bring your own LLM key, own all y |
| 9 | mlflow/mlflow | 28408 | Python | 2026-10-16 | The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, eva |
| 10 | langfuse/langfuse | 35893 | TypeScript | 2026-10-16 | 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. |
| 11 | linny006/llmops-radar | 3 | Python | 2026-10-16 | Live index of the newest LLMOps tooling — track what's shipping in LLM observability and deployment |
| 12 | JehanneDussert/govllm | 31 | Python | 2026-10-16 | Continuous LLM governance monitoring for regulated environments - EU AI Act, GDPR, ANSSI. Self-hosted, profile-driven, n |
| 13 | api7/aisix | 193 | Rust | 2026-10-16 | Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bed |
| 14 | chyinan/AegisRAG | 4 | Python | 2026-10-16 | AegisRAG is a security-first, auditable enterprise RAG backend for teams that care more about access control,traceabilit |
| 15 | cuihuan/awesome-ai-gateway | 131 | HTML | 2026-10-16 | ⚡ Awesome AI Gateway — pick an AI gateway from 160+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by c |
| 16 | optiware-ai/optimux | 1 | Python | 2026-10-16 | Self-hosted coding assistant that routes each request to the cheapest model that can handle it |
| 17 | gabrielk83/AntCV | 1 | JavaScript | 2026-10-16 | Multi-agent job application orchestration platform with provider routing, validation, provenance, and ATS-aware document |