Official description7 sourcesMCP servers8d ago

yubinkim444/ai-first-scraper-mcp

MCP server giving Claude Desktop / Cursor / Cline ad-free web scraping + search via three tools: fetch_page, fetch_pages_batch, search_web.

View on GitHub ↗Direct link · no redirect page

Config template (adjust for your client)

claude mcp add ai-first-scraper-mcp -- npx -y ai-first-scraper-mcp

A pasteable skeleton generated from the repository name. Check the project README for the exact package and arguments.

Star count: 2 ★ · yubinkim444/ai-first-scraper-mcp · read from the GitHub search API · (checked 2026-10-16 20:00:20)
Source: collected from the punkpeye/awesome-mcp-servers list · type: MCP server
Harvest history: first seen 2026-10-09 · last seen 2026-10-16 · seen 32× · listed by 7 sources
Score: score 703 · 2 ★ · 7 sources · mcp

FAQ (answers come from our records)

How do I install it?

We did not find an install command for this repository (our install coverage is only about 4%). Check its README or releases page.

Who is it for?

We filed it under these tags: MCP 服务. The tags come from the entry itself, not a taxonomy we imposed.

Who maintains it?

repository yubinkim444/ai-first-scraper-mcp；first catalogued 2026-10-09；last seen 2026-10-16。There is no official certification or quality rating here — we record sources and dates only.

Third-party quality signals

ai-first-scraper-mcp

以下摘录自该仓库的 README（片段） · 在 GitHub 读完整 README →

> **Plug Claude Desktop, Cursor, or Cline straight into an ad-free web
> scraper + search engine.** Three tools, one line of config.
---
What it does
Adds three tools to any MCP-compatible
agent:
| Tool | What it does |
|------|--------------|
| fetch_page | Fetch one URL → return clean Markdown (HTML or PDF). |
| fetch_pages_batch | Fetch up to 25 URLs in parallel → return Markdown for each. |
| search_web | Run a web search and return the top-k result pages already converted to Markdown. |
No more "the model called curl and then tried to parse 80kB of ad HTML."
Your agent receives clean Markdown ready to reason about.
Backed by the ai-first-scraper
and ai-first-search APIs.
---
Install
Fastest — uvx (no install, runs from PyPI on demand)
Restart your client (Claude Desktop / Cursor / Cline). The three tools above
will appear automatically.
Alternative — pip install
---
Where the config file lives
| Client | Config path |
|--------|-------------|
| **Claude Desktop (macOS)** | ~/Library/Application Support/Claude/claude_desktop_config.json |
| **Claude Desktop (Windows)** | %APPDATA%\Claude\claude_desktop_config.json |
| **Cursor** | ~/.cursor/mcp.json |
| **Cline (VS Code)** | ~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json |
---
Point at your own backend (optional)
By default this server calls the public ai-first-scraper.onrender.com and
ai-first-search.onrender.com instances. If you want to self-host, set env
vars in your MCP config:
---
Verify it works
Open your MCP client and ask the agent:
> "Use the search_web tool to find the top 3 recent articles about MCP and
> summarize them in 5 bullets each."
You should see the agent call search_web, get back Markdown for each result,
and produce the summary without ever touching raw HTML.
---
Companion projects
- **ai-first-scraper** — the
per-URL Markdown cleaner this MCP server fans out to.
- **ai-first-search** —
search → scrape → markdown pipeline.
- **mcp-rec** — record & replay any MCP server's traffic for tests and bug reports.
- **llm-cache-proxy** — local cache for OpenAI/Anthropic API calls.
- **promptlocker** — lockfile for prompts.
- **context-diff** — see what blew up your Claude Code context window.