7.6K ·GitHub
What is this?
A free proxy pool builder. It crawls proxy sources, checks which proxies work, aggregates them, and converts them into formats for clients like Clash, V2Ray and SingBox.
Is it a script I run myself or a hosted service?
It is a Python command-line tool you run yourself. It has two entry points: process.py for full control and collect.py for a quick grab of airport subscriptions.
How do I get it running?
Follow the README quick configuration: write a config.json for process.py, check it with python -m json.tool, set the listed environment variables, then run the script.
What do I need besides Python?
The README names Subconverter as the subscription conversion core and Mihomo as the proxy testing engine. It also mentions a GitHub Token, which matters for GitHub-based storage.
What commonly goes wrong?
If you get no proxies, check your crawl sources and network connection. If you hit timeouts, raise the timeout with -t 15000 or lower the thread count with -n 16.
Which entry point should I use, process.py or collect.py?
process.py is for users who need fine control over crawl rules, multiple output groups, custom storage or scheduled runs. collect.py is for quick personal use with no complex setup.
Can I add my own proxy sources?
Yes. The README describes a plugin system for custom crawl targets and invites contributors to add new crawler plugins.
Which sites does it crawl for proxies?
Telegram, GitHub, Google, Yandex, Twitter and other web pages. Results can be stored in GitHub Gist, PasteGG or Imperial.
How does it check that proxies actually work?
It automatically tests proxy liveness and quality. The README credits Mihomo as the proxy testing engine.
What is planned next?
The roadmap covers turning crawlers and storage backends into plugins, adding core interfaces, Pydantic-based config models, structured logging, and better concurrency and retries.
What are similar projects?
edgetunnel, 3X-UI_KIT, V2rayU, clash, panda-vpn-pro, sing-box-yg, sing-box, BPB-Worker-Panel
Which topics is it in?
pydantic, subscription, web-scraper, sing-box, config, http-proxy, proxy-server, mihomo, vmess, multithreading, scraping, clash