Independent by design · no pay-to-rank placements  · How we evaluate tools →
Anclum Submit
Z

Zihao-Wu06/AutoDSpark

Independent directory — not the official site. Details below come from the project's public repository.

One command trains a small helper model that speeds up your LLM.

2 ★ measured · checked 2026-11-19

Before you install: command ownership unverified - shown for reference only · license Apache-2.0 · link reachable

First step (reference only, ownership unverified): git clone https://github.com/Zihao-Wu06/AutoDSpark.git && cd AutoDSpark

★ 2·updated 2026-11-16
View on GitHub ↗Link checked 2026-11-17 · HTTP 200 · opens the vendor's own site
Official descriptionMake your own LLM generate up to 2.8x faster with one command: train a DSpark speculative-decoding drafter for any local model and serve it with vLLM. Faster inference, same performance.
Star count
2 ★ · Zihao-Wu06/AutoDSpark · read from the GitHub search API · (checked 2026-11-19 20:00:48)
Source
read directly from its GitHub page · type: open-source project
Harvest history
first seen 2026-11-16 · last seen 2026-11-20 · seen 5× · listed by 2 sources
Score
score 203 · 2 ★ · 2 sources · repo
FAQ (answers come from our records)
Who is it for?
We filed it under these tags: Agent skills. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
repository Zihao-Wu06/AutoDSpark;first catalogued 2026-11-16;last seen 2026-11-20。There is no official certification or quality rating here — we record sources and dates only.
README excerpt (English, untranslated) · Read the full README on GitHub →

# AutoDSpark

Excerpted from the repository README (abridged)

### Make your own LLM generate up to 2.8x faster.
One command trains a small helper model that speeds up your LLM. Faster inference, same performance.
Results | How it works | Get started | Full guide
Qwen3-4B on 2× RTX 5090: 165 → 303 tokens/s overall, 165 → 467 tokens/s on math.
## ✨ What you get
Faster answers. In our Qwen3-4B test, replies came 1.5x to 2.8x faster, depending on the
task.
Same performance. Nothing about your model changes: same weights, same answers, same quality.
Made for your model. Works for fine-tuned and less common models that have no ready-made
speed-up available.
One command, a few hours, your own GPUs. No cluster, no machine-learning expertise needed.
## 📊 Results
We trained a helper for Qwen3-4B with AutoDSpark on two RTX 5090 graphics cards. It took
under 3 hours from start to finish. Then we asked the model the same questions with and without
the helper and timed it:
| Task | Before (tokens/s) | After (tokens/s) | Faster by |
| Math | 165 | 467 | 2.83x |
| Information extraction | 165 | 306 | 1.86x |
| Code | 165 | 299 | 1.81x |
| Reasoning | 165 | 288 | 1.73x |
| Writing | 165 | 270 | 1.63x |
| Chat | 165 | 250 | 1.51x |
| Overall | 165 | 303 | 1.83x |
A token is roughly three quarters of an English word. Tasks with predictable output, like math,
code and data extraction, speed up the most. Training on examples from your own use case makes
the helper faster still. Full test setup: guide.
## 💡 How it works
Why LLMs are slow. A language model writes one token at a time, and every single token needs
a full pass through the whole model. A 500-token answer means 500 passes, one after another.
The trick: draft, then check. AutoDSpark trains a small, fast drafter that guesses the
next several tokens at once. Your model then checks the whole guess in one pass, the same
cost as writing a single token. Every correct guess is kept; at the first wrong one, your model
puts in its own token instead. So you get several tokens for the price of one, and the final
answer is exactly what your model would have written alone. This technique is called
speculative decoding; AutoDSpark uses DSpark, a recent
drafter design from DeepSeek-AI and Peking University.
Why you need your own drafter. A drafter is only fast if it guesses well, and it only guesses
well if it knows your model's habits. Ready-made drafters exist for a few popular models; for
anything else, including models you fine-tuned yourself, you have to train one. That used to
mean hand-tuning a dozen settings. AutoDSpark does all of it with one command:
mermaid
flowchart LR
A["1. Plan reads your model and GPUs"] --> B["2. Practice data your model answers thousands of prompts"]
B --> C["3. Train the drafter learns to predict those answers"]
C --> D["4. Speed test with vs without, on your hardware"]
D --> E["5. Serve faster ready-to-run vLLM command"]
Under the hood, training is done by vLLM Speculators
and serving by vLLM. The guide
explains each step in detail.
## ⚡ Get started
You need a Linux machine with an NVIDIA GPU and your model in Hugging Face format.
Listed badge (optional)
Copy this line into the README if you want the listing mark. Optional, and it does not affect being listed.
[![Listed on Anclum](https://anclum.com/badge/listed.svg)](https://anclum.com/en/s/zihao-wu06-autodspark/)
Source
github · https://github.com/Zihao-Wu06/AutoDSpark
Browse by field
Agent skills
Traction
2 ★
Listed by
2 independent sources
added
today

More entries

All 471 →

Filed under

Every tag opens the full list for that filter. Counts are the live catalogue figures.

Browse all fields →

← Back to index