What is this?
A Python tool that scrapes Shodan's public web search for IP addresses matching a dork query, without a Shodan API key. It adds automatic proxy rotation to get past Shodan's free rate limits. It's meant for OSINT and security research.
A Python tool that scrapes Shodan's public web search for IP addresses matching a dork query, without a Shodan API key. It adds automatic proxy rotation to get past Shodan's free rate limits. It's meant for OSINT and security research.Is it a standalone command-line tool or a library I import?It's a command-line script: you run d0rk3r.py with flags such as -q for the dork query. The README describes no import-based library API.
It's a command-line script: you run d0rk3r.py with flags such as -q for the dork query. The README describes no import-based library API.What do I need before running it?You need Python, since the project is written in Python. The README lists no specific version or extra packages, and no Shodan API key is required.
You need Python, since the project is written in Python. The README lists no specific version or extra packages, and no Shodan API key is required.What are the main limitations?Free Shodan gives only about 2 pages per IP, so proxy rotation is needed for volume. The README says IP accuracy is not guaranteed, so you should verify the results yourself.
Free Shodan gives only about 2 pages per IP, so proxy rotation is needed for volume. The README says IP accuracy is not guaranteed, so you should verify the results yourself.Where does my traffic go?The README does not describe any data collection by the tool itself. In auto-proxy mode it routes requests through proxies from public GitHub lists, so your traffic may pass through unknown third-party servers.
The README does not describe any data collection by the tool itself. In auto-proxy mode it routes requests through proxies from public GitHub lists, so your traffic may pass through unknown third-party servers.What files does it create?d0rk3r.py is the main script and proxyfetcher.py handles auto-proxy. It also writes .proxycache.txt, which stores cached proxies for reuse.
d0rk3r.py is the main script and proxyfetcher.py handles auto-proxy. It also writes .proxycache.txt, which stores cached proxies for reuse.How many unique IPs can I expect?The README estimates that 10 proxies with 2 pages each can yield roughly 600 to 3000+ unique IPs. Actual results depend on the query and the proxies.
The README estimates that 10 proxies with 2 pages each can yield roughly 600 to 3000+ unique IPs. Actual results depend on the query and the proxies.Which Shodan filters does it support?The README's syntax table lists port, country, city, org, hostname, os, product, vuln, http.title and ssl. Each example query is a single filter, and filters can be combined.
The README's syntax table lists port, country, city, org, hostname, os, product, vuln, http.title and ssl. Each example query is a single filter, and filters can be combined.What are similar projects?maigret, awesome-osint-arsenal, bbot, social-analyzer, blackbird, OneForAll, awesome-hacker-search-engines, spiderfoot
maigret, awesome-osint-arsenal, bbot, social-analyzer, blackbird, OneForAll, awesome-hacker-search-engines, spiderfootWhich topics is it in?osint-tool, bug-bounty, information-gathering, scraper, reconnaissance, osint, penetration-testing, web-scraping, cybersecurity, proxy, free, security
osint-tool, bug-bounty, information-gathering, scraper, reconnaissance, osint, penetration-testing, web-scraping, cybersecurity, proxy, free, security