Tokenectomy-Labs/Tokenectomy

Fix Claude Code & Cursor Rate Limits: Zero-Latency Local AI Gateway & Context-Surgery MCP Server in Rust
Stop burning 20,000 tokens on node_modules stack traces. Tokenectomy Razor is a sub-millisecond local AI Gateway reverse proxy (127.0.0.1:8080) & companion MCP server written in safe Rust. Excises 41.7%–99.7% framework noise from terminal error logs, redacts leaked DB credentials/JWTs, and caches prompts for free.
Quick Start (10s) •
Architecture •
The Problem •
Before & After •
Live Interactive Demo •
Benchmarks
bash
Wrap Claude Code CLI
razor wrap -- claude
Wrap Aider with DeepSeek or Ollama (Auto-Transpiled on the fly!)
razor wrap -- aider --model deepseek/deepseek-chat
Wrap test runs to scrub logs and prevent accidental credential leakage
razor wrap npm test
bash
npx -y tokenectomy-razor --proxy
bash
claude mcp add tokenectomy npx -y tokenectomy-razor --mcp
bash
agy mcp add tokenectomy-razor -- npx -y tokenectomy-razor --mcp
json
{
"mcpServers": {
"tokenectomy": {
"command": "npx",
"args": ["-y", "tokenectomy-razor", "--mcp"]
}
}
}
json
{
"mcpServers": {
"tokenectomy": {
"command": "npx",
"args": ["-y", "tokenectomy-razor", "--mcp"]
}
}
}
bash
npm test 2>&1 | npx tokenectomy-razor
Raw Terminal Crash (45,820 tokens + Leaked Secrets)
│
▼ **What Claude does:** Analyzes load-components.js and next-server.js, speculates on Webpack / Next.js internals, and leaks connection credentials to remote inference logs.
✅ With Tokenectomy: Clean Context & Instant Fix
> **What Claude does:** Instantly identifies that line 42 in checkout.ts attempted to access .token on undefined headers. Suggests optional chaining req.headers.authorization?.token immediately. Credentials redacted before transmission.
---
🔬 Verifiable Benchmarks
All performance claims are hardware-grounded and independently reproducible on physical hardware (measured on 10-Core Intel Core i5-1235U @ 15W running Arch Linux, Kernel 6.13):
> **Hardware Dependency Notice:** Performance is hardware-dependent; reported throughput represents measured results on the specified test hardware (10-Core Intel Core i5-1235U @ 15W TDP). Throughput scales with higher TDP desktop/server CPUs and faster memory buses. Developers are encouraged to independently audit performance using the reproduction command below.
📋 Click to expand full raw benchmark terminal log ($ cargo test --release)
| Benchmark Target | Workload Under Test | Verified Measurement | Result |
|---|---|---|:---:|
| **Log Redaction Throughput** | 250,000 lines (24.44 MB) enterprise dump with API keys & connection URIs | **530,735 lines/sec** (471.0 ms, 51.9 MB/s) | **Pass** |
| **ReDoS Resilience** | 50,000-character pathological backtracking regex payload | **1.16 ms** (Deterministic Linear $O(N)$ DFA Evaluation) | **Pass** |
| **Thread Concurrency** | 100 concurrent OS threads executing simultaneous redaction | **17,688 ops/sec** (100/100 completed in 11.31 ms) | **Pass** |
| **Memory Footprint** | Peak Resident Memory during 250k-line continuous stress test | **76.05 MB VmRSS** via /proc/self/status (~3× input buffer size) | **Pass** |
| **Release Test Suite** | Full integration test matrix across extractors, filters, and analyzers | **90 / 90 Verified Green** (Zero panics, zero leaks) | **Pass** |
🛡️ Automated Redaction & Secret Sanitization Benchmark
Evaluated across an internal benchmark test fixture (tests/fixtures/) of **12 polyglot crash traces** (Rust, Python, TypeScript, Go, YAML) containing **22 ground-truth credentials** and clean negative controls. Evaluated head-to-head against **Gitleaks v8.30.1** (default ruleset).
> **Architectural Note:** Gitleaks is designed primarily as a repository commit/diff scanner, not an in-memory runtime trace redactor. Tokenectomy Razor is engineered specifically for runtime stream sanitization and stack trace surgery.
1. Per-Category Precision, Recall & F1-Score
| Secret Category | Ground Truth | Razor Recall | Razor F1 | Gitleaks Recall | Gitleaks F1 | Sanitization Advantage |
|---|:---:|:---:|:---:|:---:|:---:|---|
| **Anthropic Claude API Key (sk-ant-...)** | 1 | **100.0%** | **100.0%** | 0.0% | 0.0% | **+100% Recall** (M2M zero-leak) |