Download entire websites using wget, preserving their structure and converting links to work locally
Website Downloader MCP Server
以下摘录自该仓库的 README(片段) · 在 GitHub 读完整 README →
This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
Prerequisites
The server requires wget to be installed on your system.
Installing wget
macOS
Using Homebrew:
Linux (Debian/Ubuntu)
Linux (Red Hat/Fedora)
Windows
1. Using Chocolatey:
2. Or download the binary from: https://eternallybored.org/misc/wget/
- Download the latest wget.exe
- Place it in a directory that's in your PATH (e.g., C:\Windows\System32)
Usage
The server provides a tool called download_website with the following parameters:
- url (required): The URL of the website to download
- outputPath (optional): The directory where the website should be downloaded. Defaults to the current directory.
- depth (optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.
Example
Features
The website downloader:
- Downloads recursively with infinite depth
- Includes all page requisites (CSS, images, etc.)
- Converts links to work locally
- Adds appropriate extensions to files
- Restricts downloads to the same domain
- Preserves the website structure
Installation
1. Build the server:
2. Add to MCP settings:
`json
{
"mcpServers": {
"website-downloader": {
"command": "node",
"args": ["/path/to/website-downloader/build/index.js"]
}
}
}