olostep/olostep-mcp-server

Docker Hub
npm version
License: ISC
A Model Context Protocol (MCP) server implementation that integrates with Olostep for web scraping, content extraction, and search capabilities.
To set up Olostep MCP Server, you need to have an API key. You can get the API key by signing up on the Olostep website.
Features
- Scrape website content in HTML, Markdown, JSON or Plain Text (with optional parsers)
- Parser-based web search with structured results
- AI Answers with citations and optional JSON-shaped outputs
- Batch scraping of up to 10k URLs
- Autonomous site crawling from a start URL
- Website URL discovery and mapping (with include/exclude filters)
- Country-specific request routing for geo-targeted content
- Configurable wait times for JavaScript-heavy websites
- Comprehensive error handling and reporting
- Simple API key configuration
Installation
There are multiple ways to connect to the Olostep MCP Server. Choose the one that best fits your workflow.
☁️ Remote Endpoint (Recommended)
The simplest way — no local installation required. Connect directly to our hosted MCP server:
Authentication is done via a Bearer token in the Authorization header using your Olostep API key. See the Client Setup section below for configuration examples.
🐳 Docker Hub
Pull and run the official Docker image:
🔧 Local Docker Build
If you prefer to build the image yourself from source:
📦 npx
Run without any installation using npx:
On Windows (PowerShell):
On Windows (CMD):
Or install globally:
Client Setup
Cursor
The easiest way is to use the remote endpoint. Create or edit .cursor/mcp.json in your project root:
**Alternative (local):** Go to Cursor Settings > Features > MCP Servers, click "+ Add New MCP Server":
- **Name:** olostep
- **Type:** command
- **Command:** env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp
Claude Desktop
Add this to your claude_desktop_config.json:
**Alternative (Docker):**
Or install via the Smithery CLI in your device terminal:
Claude Code
Add the remote endpoint to your Claude Code MCP configuration:
**Alternative (local):**
Windsurf
Add this to your ./codeium/windsurf/model_config.json:
**Alternative (local):**
VS Code
Add this to your .vscode/mcp.json:
**Alternative (local):**
Metorial
**Option 1: One-Click Installation (Recommended)**
1. Open Metorial dashboard
2. Navigate to MCP Servers directory
3. Search for "Olostep"
4. Click "Install" and enter your API key
**Option 2: Manual Configuration**
Add this to your Metorial MCP server configuration:
The Olostep tools will then be available in your Metorial AI chats.
Configuration
Environment Variables
- OLOSTEP_API_KEY: Your Olostep API key (required)
- ORBIT_KEY: An optional key for using Orbit to route requests.
Available Tools
1. Scrape Website (scrape_website)
Extract content from a single URL. Supports multiple formats and JavaScript rendering.
Parameters:
- url_to_scrape: The URL of the website you want to scrape (required)
- output_format: Choose format (html, markdown, json, or text) - default: markdown
- country: Optional country code (e.g., US, GB, CA) for location-specific scraping
- wait_before_scraping: Wait time in milliseconds before scraping (0-10000)
- parser: Optional parser ID for specialized extraction
Response (example):
2. Search the Web (search_web)
Search the Web for a given query and get structured results (non-AI, parser-based).
Parameters:
- query: Search query (required)
- country: Optional country code for localized results (default: US)
Response:
- Structured JSON (as text) representing parser-based results
3. Answers (AI) (answers)