S
stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
updated 2026-11-05
View on GitHub ↗Direct link · no redirect page
We have no copy-paste install command and no public remote endpoint, so we do not print a config. The step above is reference only, not a command we can vouch for. A made-up one is worse than none. How each client wires MCP up →
- Star count
- 0 ★ · stand-out-of-my-sun/diogenes-web-scraping-engine-mcp · read from the GitHub search API · (checked 2026-11-19 20:00:48)
- Source
- collected from the punkpeye/awesome-mcp-servers list · type: MCP server
- Harvest history
- first seen 2026-11-18 · last seen 2026-11-20 · seen 3× · listed by 3 sources
- Score
- score 300 · 3 sources · mcp
FAQ (answers come from our records)
Who is it for?
We filed it under these tags: MCP servers. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
repository
stand-out-of-my-sun/diogenes-web-scraping-engine-mcp;first catalogued 2026-11-18;last seen 2026-11-20。There is no official certification or quality rating here — we record sources and dates only.README excerpt (English, untranslated) · Read the full README on GitHub →
# Diogenes Web Extraction, Readability & Markdown Engine MCP (diogenes-web-scrap
Excerpted from the repository README (abridged)
Diogenes Web Extraction, Readability & Markdown Engine MCP is a focused, zero-bloat Model Context Protocol (streamable-http) package powered by the Diogenes Microservice Gateway.
Instead of loading all 121 gateway endpoints into your LLM's context window, installing this package exposes only the 12 specialized web-scraping-engine tools needed for Web Extraction & Scraping:
12 high-performance web extraction, readability & markdown tools: clean LLM markdown compiler, readable article extractor, OpenGraph & JSON-LD metadata parser, HTML table to JSON/Markdown converter, CSS selector isolator, paywall & overlay bypass auditor, XML sitemap crawler, hyperlink extractor, HTML XSS sanitizer, contact & lead info parser, SEO heading diagnostics, and RSS/Atom feed compiler.
## ⚡ 1-Click Install for Cursor & Claude Desktop
No API keys, user accounts, or local dependencies required. Zero setup — paste directly into your client config:
### 🖱️ Cursor IDE (.cursor/mcp.json)
Add to .cursor/mcp.json in your project root or global Cursor settings:
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
### 🧠 Claude Desktop (claude_desktop_config.json)
Add to claude_desktop_config.json (Mac: ~/Library/Application Support/Claude/claude_desktop_config.json | Windows: %APPDATA%\Claude\claude_desktop_config.json):
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
> Prefer local stdio? Run via npx:
> bash
> npx -y @stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
## Included Tools in web-scraping-engine (12 Tools)
| MCP Tool Name | Underlying REST Route | Settlement | Capability |
| extract_clean_markdown | POST /api/v1/extract/clean-markdown | Free Developer Tier (0 sats) | Converts raw HTML pages into clean, boilerplate-free, LLM-optimized Markdown with preserved hyperlinks and headings. Use when ingesting raw web documents or blog posts into agent context windows; for isolating tabular data into structured datasets, use parse_html_tables instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('conversion_mode' defaults to 'clean_semantic_article'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| scrape_readable_article | POST /api/v1/extract/readable-article | Free Developer Tier (0 sats) | Extracts primary article body, author bylines, publication timestamps, and estimated reading duration from web pages. Use when stripping navigation bars, advertisement containers, and cookie banners to isolate core editorial content; for converting full HTML to markdown, use extract_clean_markdown instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('readability_profile' defaults to 'article_body_strict'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| extract_structured_metadata | POST /api/v1/extract/structured-metadata | 10 sats (L402) | Extracts OpenGraph tags, Twitter Card metadata, canonical URLs, and Schema.org JSON-LD microdata scripts from HTML. Use when indexing social share cards, author identity, breadcrumbs, and rich snippet schemas for AI search agents; for scanning page hyperlinks and outbound references, use extract_page_hyperlinks instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('metadata_targets' defaults to 'all_protocols'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
Instead of loading all 121 gateway endpoints into your LLM's context window, installing this package exposes only the 12 specialized web-scraping-engine tools needed for Web Extraction & Scraping:
12 high-performance web extraction, readability & markdown tools: clean LLM markdown compiler, readable article extractor, OpenGraph & JSON-LD metadata parser, HTML table to JSON/Markdown converter, CSS selector isolator, paywall & overlay bypass auditor, XML sitemap crawler, hyperlink extractor, HTML XSS sanitizer, contact & lead info parser, SEO heading diagnostics, and RSS/Atom feed compiler.
## ⚡ 1-Click Install for Cursor & Claude Desktop
No API keys, user accounts, or local dependencies required. Zero setup — paste directly into your client config:
### 🖱️ Cursor IDE (.cursor/mcp.json)
Add to .cursor/mcp.json in your project root or global Cursor settings:
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
### 🧠 Claude Desktop (claude_desktop_config.json)
Add to claude_desktop_config.json (Mac: ~/Library/Application Support/Claude/claude_desktop_config.json | Windows: %APPDATA%\Claude\claude_desktop_config.json):
json
"mcpServers": {
"diogenes-web-scraping-engine": {
"transport": "streamable-http",
"url": "https://diogenesgateway.com/mcp/web-scraping-engine"
> Prefer local stdio? Run via npx:
> bash
> npx -y @stand-out-of-my-sun/diogenes-web-scraping-engine-mcp
## Included Tools in web-scraping-engine (12 Tools)
| MCP Tool Name | Underlying REST Route | Settlement | Capability |
| extract_clean_markdown | POST /api/v1/extract/clean-markdown | Free Developer Tier (0 sats) | Converts raw HTML pages into clean, boilerplate-free, LLM-optimized Markdown with preserved hyperlinks and headings. Use when ingesting raw web documents or blog posts into agent context windows; for isolating tabular data into structured datasets, use parse_html_tables instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('conversion_mode' defaults to 'clean_semantic_article'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| scrape_readable_article | POST /api/v1/extract/readable-article | Free Developer Tier (0 sats) | Extracts primary article body, author bylines, publication timestamps, and estimated reading duration from web pages. Use when stripping navigation bars, advertisement containers, and cookie banners to isolate core editorial content; for converting full HTML to markdown, use extract_clean_markdown instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('readability_profile' defaults to 'article_body_strict'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
| extract_structured_metadata | POST /api/v1/extract/structured-metadata | 10 sats (L402) | Extracts OpenGraph tags, Twitter Card metadata, canonical URLs, and Schema.org JSON-LD microdata scripts from HTML. Use when indexing social share cards, author identity, breadcrumbs, and rich snippet schemas for AI search agents; for scanning page hyperlinks and outbound references, use extract_page_hyperlinks instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'html_content' ('metadata_targets' defaults to 'all_protocols'), supports '?demo=true' or L402 (10 sats), and returns HTTP 400 if invalid. |
Listed badge (optional)
Copy this line into the README if you want the listing mark. Optional, and it does not affect being listed.
[](https://anclum.com/en/s/stand-out-of-my-sun-diogenes-web-scraping-engine-mcp/)
- Source
- awesome · https://github.com/stand-out-of-my-sun/diogenes-web-scraping-engine-mc
- Browse by field
- MCP servers
- Listed by
- 3 independent sources
- added
- today
More MCP servers
Filed under
Every tag opens the full list for that filter. Counts are the live catalogue figures.