Official description7 sourcesMCP servers8d ago
kimdonghwi94/Web-Analyzer-MCP
๐ ๐ ๐ ๐ช ๐ง - Extract clean web content for RAG and answer questions about web pages
View on GitHub โDirect link ยท no redirect page
Config template (adjust for your client)
claude mcp add web-analyzer-mcp -- npx -y web-analyzer-mcp
A pasteable skeleton generated from the repository name. Check the project README for the exact package and arguments.
- Star count
- 4 โ ยท kimdonghwi94/web-analyzer-mcp ยท read from the GitHub search API ยท (checked 2026-10-16 20:00:20)
- Source
- collected from the punkpeye/awesome-mcp-servers list ยท type: MCP server
- Harvest history
- first seen 2026-10-09 ยท last seen 2026-10-16 ยท seen 32ร ยท listed by 7 sources
- Score
- score 703 ยท 4 โ ยท 7 sources ยท mcp
FAQ (answers come from our records)
How do I install it?
We did not find an install command for this repository (our install coverage is only about 4%). Check its README or releases page.
Who is it for?
We filed it under these tags: MCP ๆๅก. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
repository
kimdonghwi94/web-analyzer-mcp๏ผfirst catalogued 2026-10-09๏ผlast seen 2026-10-16ใThere is no official certification or quality rating here โ we record sources and dates only.Third-party quality signals
๐ Web Analyzer MCP
ไปฅไธๆๅฝ่ช่ฏฅไปๅบ็ README๏ผ็ๆฎต๏ผ ยท ๅจ GitHub ่ฏปๅฎๆด README โ
A powerful MCP (Model Context Protocol) server for intelligent web content analysis and summarization. Built with FastMCP, this server provides smart web scraping, content extraction, and AI-powered question-answering capabilities.
โจ Features
๐ฏ Core Tools
1. **url_to_markdown** - Extract and summarize key web page content
- Analyzes content importance using custom algorithms
- Removes ads, navigation, and irrelevant content
- Keeps only essential information (tables, images, key text)
- Outputs structured markdown optimized for analysis
2. **web_content_qna** - AI-powered Q&A about web content
- Extracts relevant content sections from web pages
- Uses intelligent chunking and relevance matching
- Answers questions using OpenAI GPT models
๐ Key Features
- **Smart Content Ranking**: Algorithm-based content importance scoring
- **Essential Content Only**: Removes clutter, keeps what matters
- **Multi-IDE Support**: Works with Claude Desktop, Cursor, VS Code, PyCharm
- **Flexible Models**: Choose from GPT-3.5, GPT-4, GPT-4 Turbo, or GPT-5
๐ฆ Installation
Prerequisites
- uv (Python package manager)
- Chrome/Chromium browser (for Selenium)
- OpenAI API key (for Q&A functionality)
๐ Quick Start with uv (Recommended)
Installing via Smithery
To install web-analyzer-mcp for Claude Desktop automatically via Smithery:
IDE/Editor Integration
Install Claude Desktop
Add to your Claude Desktop_config.json file. See Claude Desktop MCP documentation for more details.
Install Claude Code (VS Code Extension)
Add the server using Claude Code CLI:
Install Cursor IDE
Add to your Cursor settings (File > Preferences > Settings > Extensions > MCP):
Install JetBrains AI Assistant
See JetBrains AI Assistant Documentation for more details.
1. In JetBrains IDEs go to **Settings** โ **Tools** โ **AI Assistant** โ **Model Context Protocol (MCP)**
2. Click **+ Add**
3. Click on **Command** in the top-left corner of the dialog and select the **As JSON** option from the list
4. Add this configuration and click **OK**:
๐๏ธ Tool Descriptions
url_to_markdown
Converts web pages to clean markdown format with essential content extraction.
**Parameters:**
- url (string): The web page URL to analyze
**Returns:** Clean markdown content with structured data preservation
web_content_qna
Answers questions about web page content using intelligent content analysis.
**Parameters:**
- url (string): The web page URL to analyze
- question (string): Question about the page content
**Returns:** AI-generated answer based on page content
๐๏ธ Architecture
Content Extraction Pipeline
1. **URL Validation** - Ensures proper URL format
2. **HTML Fetching** - Uses Selenium for dynamic content
3. **Content Parsing** - BeautifulSoup for HTML processing
4. **Element Scoring** - Custom algorithm ranks content importance
5. **Content Filtering** - Removes duplicates and low-value content
6. **Markdown Conversion** - Structured output generation
Q&A Processing Pipeline
โจ Features
๐ฏ Core Tools
1. **url_to_markdown** - Extract and summarize key web page content
- Analyzes content importance using custom algorithms
- Removes ads, navigation, and irrelevant content
- Keeps only essential information (tables, images, key text)
- Outputs structured markdown optimized for analysis
2. **web_content_qna** - AI-powered Q&A about web content
- Extracts relevant content sections from web pages
- Uses intelligent chunking and relevance matching
- Answers questions using OpenAI GPT models
๐ Key Features
- **Smart Content Ranking**: Algorithm-based content importance scoring
- **Essential Content Only**: Removes clutter, keeps what matters
- **Multi-IDE Support**: Works with Claude Desktop, Cursor, VS Code, PyCharm
- **Flexible Models**: Choose from GPT-3.5, GPT-4, GPT-4 Turbo, or GPT-5
๐ฆ Installation
Prerequisites
- uv (Python package manager)
- Chrome/Chromium browser (for Selenium)
- OpenAI API key (for Q&A functionality)
๐ Quick Start with uv (Recommended)
Installing via Smithery
To install web-analyzer-mcp for Claude Desktop automatically via Smithery:
IDE/Editor Integration
Install Claude Desktop
Add to your Claude Desktop_config.json file. See Claude Desktop MCP documentation for more details.
Install Claude Code (VS Code Extension)
Add the server using Claude Code CLI:
Install Cursor IDE
Add to your Cursor settings (File > Preferences > Settings > Extensions > MCP):
Install JetBrains AI Assistant
See JetBrains AI Assistant Documentation for more details.
1. In JetBrains IDEs go to **Settings** โ **Tools** โ **AI Assistant** โ **Model Context Protocol (MCP)**
2. Click **+ Add**
3. Click on **Command** in the top-left corner of the dialog and select the **As JSON** option from the list
4. Add this configuration and click **OK**:
๐๏ธ Tool Descriptions
url_to_markdown
Converts web pages to clean markdown format with essential content extraction.
**Parameters:**
- url (string): The web page URL to analyze
**Returns:** Clean markdown content with structured data preservation
web_content_qna
Answers questions about web page content using intelligent content analysis.
**Parameters:**
- url (string): The web page URL to analyze
- question (string): Question about the page content
**Returns:** AI-generated answer based on page content
๐๏ธ Architecture
Content Extraction Pipeline
1. **URL Validation** - Ensures proper URL format
2. **HTML Fetching** - Uses Selenium for dynamic content
3. **Content Parsing** - BeautifulSoup for HTML processing
4. **Element Scoring** - Custom algorithm ranks content importance
5. **Content Filtering** - Removes duplicates and low-value content
6. **Markdown Conversion** - Structured output generation
Q&A Processing Pipeline
- Source
- awesome ยท https://github.com/kimdonghwi94/web-analyzer-mcp
- Browse by field
- MCP servers
- Traction
- 4 โ
- added
- yesterday
More in MCP servers
Filed under
Every tag opens the full list for that filter. Counts are the live catalogue figures.