Scrapeless MCP Server
以下摘录自该仓库的 README(片段) · 在 GitHub 读完整 README →
**Welcome to the official Scrapeless Model Context Protocol (MCP) Server** — a powerful integration layer that empowers LLMs, AI Agents, and AI applications to interact with the web in real time.
Built on the open MCP standard, Scrapeless MCP Server seamlessly connects models like **ChatGPT**, **Claude**, and tools like **Cursor** and **Windsurf** to a wide range of external capabilities, including:
- **Google services integration** (Search, Trends)
- **Browser automation** for page-level navigation and interaction
- **Scrape** dynamic, JS-heavy sites—export as HTML, Markdown, or screenshots
- **Crawl** entire websites by following links and capture each page in multiple formats
- **AI Scraper** Create an AI Scraper task for ChatGPT, Gemini, Perplexity, Copilot, Google AI Mode, Google AI Overview, Grok, or Alexa
Whether you're building an AI research assistant, a coding copilot, or autonomous web agents, this server provides the dynamic context and real-world data your workflows need—**without getting blocked**.
Usage Examples
1. Automated Web Interaction and Data Extraction with Claude
Using Scrapeless MCP Browser, Claude can perform complex tasks such as web navigation, clicking, scrolling, and scraping through conversational commands, with real-time preview of web interaction results via live sessions.
2. Bypassing Cloudflare to Retrieve Target Page Content
Using the Scrapeless MCP Browser service, the Cloudflare page is automatically accessed, and after the process is completed, the page content is extracted and returned in Markdown format.
3. Extracting Dynamically Rendered Page Content and Writing to File
Using the Scrapeless MCP Universal API, the JavaScript-rendered content of the target page above is scraped, exported in Markdown format, and finally written to a local file named **text.md**.
4. Automated SERP Scraping
Using the Scrapeless MCP Server, query the keyword “web scraping” on Google Search, retrieve the first 10 search results (including title, link, and summary), and write the content to the file named serp.text.
Here are some additional examples of how to use these servers:
| Example |
| --------------------------------------------------------------------------------------------------------------------------------- |
| Search scrapeless by Google search. |
| Find the search interest for "AI" over the last year. |
| Use a browser to visit chatgpt.com, search for "What's the weather like today?", and summarize the results. |
| Scrape the HTML content of scrapeless.com page. |
| Scrape the Markdown content of scrapeless.com page. |
| Get screenshots of scrapeless.com. |
Setup Guide
1. Get Scrapeless Key
- Log in to the Scrapeless Dashboard(Free trial available)
- Then click "**Setting**" on the left -> select "**API Key Management**" -> click "**Create API Key**". Finally, click the API Key you created to **copy** it.
2. Configure Your MCP Client
Scrapeless MCP Server supports both **Stdio** and **Streamable HTTP** transport modes.
🖥️ Stdio (Local Execution)
🌐 Streamable HTTP (Hosted API Mode)
Advanced Options
Customize browser session behavior with optional parameters. These can be set via environment variables (for Stdio) or HTTP headers (for Streamable HTTP):
| Stdio (Env Var) | Streamable HTTP (HTTP Header) | Description |
| ----------------------- | ----------------------------- | ---------------------------------------------------------------------------------------------------------------------------- |
| BROWSER_PROFILE_ID | x-browser-profile-id | Specifies a reusable browser profile ID for session continuity. |