SkillTide Submit
Official description7 sourcesMCP servers8d ago
us/crw

us/crw

Self-hostable web crawler and search API (fastCRW): scraping, crawli
View on GitHub ↗Direct link · no redirect page
Source
collected from the punkpeye/awesome-mcp-servers list · type: MCP server
Harvest history
first seen 2026-10-09 · last seen 2026-10-16 · seen 32× · listed by 7 sources
Score
score 703 · 7 sources · mcp
FAQ (answers come from our records)
How do I install it?
We did not find an install command for this repository (our install coverage is only about 4%). Check its README or releases page.
Who is it for?
We filed it under these tags: MCP 服务. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
first catalogued 2026-10-09;last seen 2026-10-16。There is no official certification or quality rating here — we record sources and dates only.
Third-party quality signals

fastCRW

以下摘录自该仓库的 README(片段) · 在 GitHub 读完整 README →

Turn URLs into clean markdown or structured
JSON with one engine for search, scrape, map, crawl, and extract.
Run it locally as a small Rust binary or use the managed API.
Get 1000 free credits → ·
Install ·
Docs
No credit card. Continue with GitHub.
One-command install
Runs local and free, no account needed. To use the Cloud, paste your key into
the same command and it installs the binary, connects the key, and registers the
MCP server with the AI coding tools you already have:
Claude Code, Cursor, Codex, Gemini CLI, OpenCode and Windsurf are picked up
automatically when they are already set up; nothing else is touched, and your
key stays in ~/.config/crw/config.toml rather than being copied into each
tool. Add CRW_NO_AGENTS=1 to skip that step, or run crw setup on its own to
choose interactively.
**1000 free credits, no credit card.** Managed proxies, JS rendering and search,
with nothing to run or keep up to date.
Get my free key →
macOS and Linux, Intel and ARM.
More install options →
What it does
| Operation | Outcome |
|---|---|
| **Scrape** | One URL to markdown, HTML, links, screenshots, or schema JSON |
| **Crawl** | Follow a bounded site crawl and collect its pages |
| **Map** | Discover URLs without scraping every page |
| **Search** | Search the web and optionally scrape selected results |
| **Extract** | Produce structured fields from one or many URLs |
See the full API →
Why fastCRW
On Firecrawl's own public 1,000-URL dataset, fastCRW recovered more truth than
Crawl4AI and Firecrawl, matched the fastest median latency, and idled at
**~14 MB RAM**.
Methodology, full numbers, and how to reproduce it
On a different benchmark entirely, answer accuracy rather than scrape recall,
fastCRW answers **90.0%** of the 600 AA-Omniscience questions correctly. Every
product listed on the Artificial Analysis Search Index sits below it.
The full 14-product comparison, the control run, and how to reproduce it
Choose how you use it
CLI
Python SDK
Using Cloud? Get an API key, then export it once:
Node.js
Local mode and more SDK examples → ·
REST API →
MCP for AI agents
Installs the CRW skill and MCP server in your detected AI tools. crw setup can
also do this step, so either path is enough.
Manual setup →
Choose where it runs
| | Managed API | Local / self-hosted |
|---|---|---|
| Best for | Zero infrastructure and managed scaling | Data control, private networks, or custom infrastructure |
| Start | Create an API key, then crw setup | Install and run crw |
| Operations | Managed proxies, billing, and hosted capabilities | You choose renderers, search, auth, proxies, and capacity |
Source
awesome · https://github.com/us/crw
Browse by field
MCP servers
added
yesterday

More in MCP servers

All 5,525 in MCP servers →

Filed under

Every tag opens the full list for that filter. Counts are the live catalogue figures.

Browse all fields →

← Back to index