maximilianfeix/proxy-scraper

Install · Live list · For AI agents · Proxy server · How it works · Recipes · Options · FAQ
---
Most free proxy lists are 95 % dead, and a good part of the rest are honeypots or proxies that inject scripts into your pages. **proxy-scraper** collects public HTTP, SOCKS4 and SOCKS5 proxies from 700+ sources and keeps only the ones that pass every check. It learns with every run which sources are worth it, and it can turn the result into a single rotating proxy.
**In numbers:** in one day it ran 3.6 million checks on free proxies – 1.1 % passed, and more than half of the ones that answered failed a second request. What's actually out there →
**Used by:** the hourly list is a built-in source of monosans/proxy-scraper-checker and gfpcom/free-proxy-list.
**Try it – no install, about five seconds:**
uvx comes with uv; pipx run proxy-scraper-cli --pick 5 does the same.
**Only want proxies?** The lists, rebuilt every hour, best first: all.txt · http.txt · socks4.txt · socks5.txt · proxies.json · by country · more formats
> **Who runs free proxies – and is it safe to use them?** Mostly nobody on purpose: misconfigured servers with an open port, a few deliberately open ones, infected machines, and traps that log or rewrite your traffic. That's why every proxy here has to pass five checks, and why they're for public data and testing – never for logins, payments or anything personal. More on where they come from →
Table of contents
- Install
- Live proxy list
- For AI agents (MCP)
- Features · Why not just download a list?
- Examples
- Recipes
- Rotating proxy server
- Discord and Telegram bot
- How it works
- Output
- Options
- GitHub Actions
- FAQ
- Roadmap · Contributing · Community · Acknowledgements
Install
**With pipx** (recommended – gives you a proxy-scraper command in its own environment):
The package is called proxy-scraper-cli on PyPI (the plain name is taken), the command is proxy-scraper.
**With Homebrew** on macOS and Linux:
The formula follows each release within about a day.
Other ways: Docker, pip, a faster event loop, or straight from the repo
Every release also ships a wheel you can install with pip install .whl, and a multi-arch image (amd64/arm64) on ghcr.io. In the container the wizard never shows up, it runs straight away. For the proxy server use --serve --serve-host 0.0.0.0 --serve-open with -p 127.0.0.1:8899:8899, so the port is only open on your own machine – or set -e PROXY_SCRAPER_SERVE_PASSWORD=… instead of --serve-open.
Tab completion for bash, zsh, fish and PowerShell:
Installed, the learned state lives in your user data folder (~/Library/Application Support/proxy-scraper, %LOCALAPPDATA%\proxy-scraper or ~/.local/share/proxy-scraper; override with PROXY_SCRAPER_HOME) and results go to ./results. Run from a clone, both stay inside the project. After the second run that finds proxies it asks once for a GitHub star; PROXY_SCRAPER_NO_STAR_HINT=1 turns that off (it never shows in CI).
Started without arguments, a wizard asks what you are looking for:
| Preset | What it does |
|---|---|
| **Find everything** | all protocols, maximum yield |
| **Browsing & web** | HTTP + SOCKS5, HTTPS-capable, at least anonymous, under 3 s |
| **Maximum anonymity** | elite SOCKS5 with HTTPS only |
| **Fast & stable** | proxies under 1 s only |
| **A few right now** | stops after 25 hits |
| **Recheck the last hits** | no collecting, takes seconds |
| **Proxy server right away** | recheck the last hits, then serve them on :8899 |
| **Same as last time** | your previous choice |
| **Custom …** | protocols, countries, anonymity, HTTPS, target site, latency, amount, check mode |
Keys: ↑ ↓ select · Space toggle · 1 – 9 jump · Enter next · Esc back · q quit. In scripts and cron jobs the wizard never shows up – pass options or -y.
Live proxy list
Don't want to scan yourself? Every hour **GitHub Actions** runs the tool and publishes the hits to the proxy-list branch – every entry worked in the last run, best first: fast ones that are likely to still be up come on top.
> **Just want the lists?** They also live in a repository of their own, **maximilianfeix/free-proxy-list** – one list per protocol, per country and per site, updated every hour, with the numbers of the last run on the front page. Watch or star it to keep it at hand. Other tools pull it too: monosans/proxy-scraper-checker and gfpcom/free-proxy-list use it as a built-in source.
**→ Browse it on the website** – search, filter by type, country, HTTPS, provider and latency, see how long each proxy has been up and how often it was on the list this week, copy or download exactly the proxies you need.