S
stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
更新 2026-11-05
在 GitHub 查看 ↗直链 · 无中转页
我们没有可直接复制的安装命令,也没有公开的远端端点,所以不出配置。上面那条命令仅供参考,不是我们能担保的可复制命令——编一条出来比不给更糟。 各客户端的接法 →
- ★ 数取值
- 0 ★ · stand-out-of-my-sun/diogenes-web-scraping-engine-mcp · 取自 GitHub 搜索 API · (2026-11-19 20:00:48 核对)
- 来源明细
- 收录自 punkpeye/awesome-mcp-servers 榜单(我们从中收集的条目之一) · 条目类型:MCP 服务
- 收录与活跃
- 收录于 2026-11-18 · 最近见到 2026-11-20 · 共见到 3 次 · 被 3 个来源列出
- 评分构成
- 综合分 300 · 3 个来源 · mcp
常见问题(答案都来自我们的记录)
它适合谁 / 用来做什么?
我们把它归在这些标签下: MCP 服务。标签来自条目自身,不是我们强加的分类。
谁维护它、还在更新吗?
仓库
stand-out-of-my-sun/diogenes-web-scraping-engine-mcp;我们收录于 2026-11-18;最近见到 2026-11-20。这里没有"官方认证"或"质量评级"——我们只记录来源与时间。README 原文(英文,未翻译) · 在 GitHub 读完整 README →
# Diogenes Web Extraction, Readability & Markdown Engine MCP (diogenes-web-scrap
以下摘录自该仓库的 README(片段)
Diogenes Web Extraction, Readability & Markdown Engine MCP is a focused, zero-bloat Model Context Protocol (streamable-http) package powered by the Diogenes Microservice Gateway.
Instead of loading all 121 gateway endpoints into your LLM's context window, installing this package exposes only the 12 specialized web-scraping-engine tools needed for Web Extraction & Scraping:
12 high-performance web extraction, readability & markdown tools: clean LLM markdown compiler, readable article extractor, OpenGraph & JSON-LD metadata parser, HTML table to JSON/Markdown converter, CSS selector isolator, paywall & overlay bypass auditor, XML sitemap crawler, hyperlink extractor, HTML XSS sanitizer, contact & lead info parser, SEO heading diagnostics, and RSS/Atom feed compiler.
## ⚡ 1-Click Install for Cursor & Claude Desktop
No API keys, user accounts, or local dependencies required. Zero setup — paste directly into your client config:
### 🖱️ Cursor IDE (.cursor/mcp.json)
Add to .cursor/mcp.json in your project root or global Cursor settings:
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
### 🧠 Claude Desktop (claude_desktop_config.json)
Add to claude_desktop_config.json (Mac: ~/Library/Application Support/Claude/claude_desktop_config.json | Windows: %APPDATA%\Claude\claude_desktop_config.json):
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
> Prefer local stdio? Run via npx:
> bash
> npx -y @stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
## Included Tools in web-scraping-engine (12 Tools)
| MCP Tool Name | Underlying REST Route | Settlement | Capability |
| extract_clean_markdown | POST /api/v1/extract/clean-markdown | Free Developer Tier (0 sats) | Converts raw HTML pages into clean, boilerplate-free, LLM-optimized Markdown with preserved hyperlinks and headings. Use when ingesting raw web documents or blog posts into agent context windows; for isolating tabular data into structured datasets, use parse_html_tables instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('conversion_mode' defaults to 'clean_semantic_article'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| scrape_readable_article | POST /api/v1/extract/readable-article | Free Developer Tier (0 sats) | Extracts primary article body, author bylines, publication timestamps, and estimated reading duration from web pages. Use when stripping navigation bars, advertisement containers, and cookie banners to isolate core editorial content; for converting full HTML to markdown, use extract_clean_markdown instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('readability_profile' defaults to 'article_body_strict'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| extract_structured_metadata | POST /api/v1/extract/structured-metadata | 10 sats (L402) | Extracts OpenGraph tags, Twitter Card metadata, canonical URLs, and Schema.org JSON-LD microdata scripts from HTML. Use when indexing social share cards, author identity, breadcrumbs, and rich snippet schemas for AI search agents; for scanning page hyperlinks and outbound references, use extract_page_hyperlinks instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('metadata_targets' defaults to 'all_protocols'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
Instead of loading all 121 gateway endpoints into your LLM's context window, installing this package exposes only the 12 specialized web-scraping-engine tools needed for Web Extraction & Scraping:
12 high-performance web extraction, readability & markdown tools: clean LLM markdown compiler, readable article extractor, OpenGraph & JSON-LD metadata parser, HTML table to JSON/Markdown converter, CSS selector isolator, paywall & overlay bypass auditor, XML sitemap crawler, hyperlink extractor, HTML XSS sanitizer, contact & lead info parser, SEO heading diagnostics, and RSS/Atom feed compiler.
## ⚡ 1-Click Install for Cursor & Claude Desktop
No API keys, user accounts, or local dependencies required. Zero setup — paste directly into your client config:
### 🖱️ Cursor IDE (.cursor/mcp.json)
Add to .cursor/mcp.json in your project root or global Cursor settings:
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
### 🧠 Claude Desktop (claude_desktop_config.json)
Add to claude_desktop_config.json (Mac: ~/Library/Application Support/Claude/claude_desktop_config.json | Windows: %APPDATA%\Claude\claude_desktop_config.json):
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
> Prefer local stdio? Run via npx:
> bash
> npx -y @stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
## Included Tools in web-scraping-engine (12 Tools)
| MCP Tool Name | Underlying REST Route | Settlement | Capability |
| extract_clean_markdown | POST /api/v1/extract/clean-markdown | Free Developer Tier (0 sats) | Converts raw HTML pages into clean, boilerplate-free, LLM-optimized Markdown with preserved hyperlinks and headings. Use when ingesting raw web documents or blog posts into agent context windows; for isolating tabular data into structured datasets, use parse_html_tables instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('conversion_mode' defaults to 'clean_semantic_article'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| scrape_readable_article | POST /api/v1/extract/readable-article | Free Developer Tier (0 sats) | Extracts primary article body, author bylines, publication timestamps, and estimated reading duration from web pages. Use when stripping navigation bars, advertisement containers, and cookie banners to isolate core editorial content; for converting full HTML to markdown, use extract_clean_markdown instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('readability_profile' defaults to 'article_body_strict'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| extract_structured_metadata | POST /api/v1/extract/structured-metadata | 10 sats (L402) | Extracts OpenGraph tags, Twitter Card metadata, canonical URLs, and Schema.org JSON-LD microdata scripts from HTML. Use when indexing social share cards, author identity, breadcrumbs, and rich snippet schemas for AI search agents; for scanning page hyperlinks and outbound references, use extract_page_hyperlinks instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('metadata_targets' defaults to 'all_protocols'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
收录徽章(可选)
想把收录标记放进 README 就复制这行,可选,不影响收录。
[](https://anclum.com/zh/s/stand-out-of-my-sun-diogenes-web-scraping-engine-mcp/)
- 来源
- awesome · https://github.com/stand-out-of-my-sun/diogenes-web-scraping-engine-mc
- 按领域浏览
- MCP 服务
- 收录来源
- 3 个独立来源
- 收录于
- 今天
更多 MCP 服务器
所属领域与标签
每个标签都能点进去看同类的全部条目。数字是当前库里的真实条数。