技能潮 SkillTide 提交收录
官方说明7 个来源MCP 服务8 天前
us/crw

us/crw

Self-hostable web crawler and search API (fastCRW): scraping, crawli
在 GitHub 查看 ↗直链 · 无中转页
来源明细
收录自 punkpeye/awesome-mcp-servers 榜单(我们从中收集的条目之一) · 条目类型:MCP 服务
收录与活跃
收录于 2026-10-09 · 最近见到 2026-10-16 · 共见到 32 次 · 被 7 个来源列出
评分构成
综合分 703 · 7 个来源 · mcp
常见问题(答案都来自我们的记录)
怎么安装?
我们【没有】从该仓库取到安装命令(我们的 install 覆盖率只有约 4%)。请看它的 README 或 releases 页。
它适合谁 / 用来做什么?
我们把它归在这些标签下: MCP 服务。标签来自条目自身,不是我们强加的分类。
谁维护它、还在更新吗?
我们收录于 2026-10-09;最近见到 2026-10-16。这里没有"官方认证"或"质量评级"——我们只记录来源与时间。
第三方质量标记

fastCRW

以下摘录自该仓库的 README(片段) · 在 GitHub 读完整 README →

Turn URLs into clean markdown or structured
JSON with one engine for search, scrape, map, crawl, and extract.
Run it locally as a small Rust binary or use the managed API.
Get 1000 free credits → ·
Install ·
Docs
No credit card. Continue with GitHub.
One-command install
Runs local and free, no account needed. To use the Cloud, paste your key into
the same command and it installs the binary, connects the key, and registers the
MCP server with the AI coding tools you already have:
Claude Code, Cursor, Codex, Gemini CLI, OpenCode and Windsurf are picked up
automatically when they are already set up; nothing else is touched, and your
key stays in ~/.config/crw/config.toml rather than being copied into each
tool. Add CRW_NO_AGENTS=1 to skip that step, or run crw setup on its own to
choose interactively.
**1000 free credits, no credit card.** Managed proxies, JS rendering and search,
with nothing to run or keep up to date.
Get my free key →
macOS and Linux, Intel and ARM.
More install options →
What it does
| Operation | Outcome |
|---|---|
| **Scrape** | One URL to markdown, HTML, links, screenshots, or schema JSON |
| **Crawl** | Follow a bounded site crawl and collect its pages |
| **Map** | Discover URLs without scraping every page |
| **Search** | Search the web and optionally scrape selected results |
| **Extract** | Produce structured fields from one or many URLs |
See the full API →
Why fastCRW
On Firecrawl's own public 1,000-URL dataset, fastCRW recovered more truth than
Crawl4AI and Firecrawl, matched the fastest median latency, and idled at
**~14 MB RAM**.
Methodology, full numbers, and how to reproduce it
On a different benchmark entirely, answer accuracy rather than scrape recall,
fastCRW answers **90.0%** of the 600 AA-Omniscience questions correctly. Every
product listed on the Artificial Analysis Search Index sits below it.
The full 14-product comparison, the control run, and how to reproduce it
Choose how you use it
CLI
Python SDK
Using Cloud? Get an API key, then export it once:
Node.js
Local mode and more SDK examples → ·
REST API →
MCP for AI agents
Installs the CRW skill and MCP server in your detected AI tools. crw setup can
also do this step, so either path is enough.
Manual setup →
Choose where it runs
| | Managed API | Local / self-hosted |
|---|---|---|
| Best for | Zero infrastructure and managed scaling | Data control, private networks, or custom infrastructure |
| Start | Create an API key, then crw setup | Install and run crw |
| Operations | Managed proxies, billing, and hosted capabilities | You choose renderers, search, auth, proxies, and capacity |
来源
awesome · https://github.com/us/crw
按领域浏览
MCP 服务
收录于
昨天

更多MCP 服务

查看MCP 服务全部 5,525 条 →

所属领域与标签

每个标签都能点进去看同类的全部条目。数字是当前库里的真实条数。

浏览全部领域 →

← 返回索引