What is this?
A personal grab-bag of standalone Python scripts and short tutorials the author wrote alongside blog posts: web scraping, WeChat official account development, Excel automation, SQL practice, and small utility hacks like remote shutdown.
A personal grab-bag of standalone Python scripts and short tutorials the author wrote alongside blog posts: web scraping, WeChat official account development, Excel automation, SQL practice, and small utility hacks like remote shutdown.Is this a single tool or a collection of separate scripts?It is a collection of independent, numbered Python scripts and mini-tutorials, each tied to its own blog post topic (crawlers, WeChat, Excel, SQL, misc utilities) rather than one cohesive application.
It is a collection of independent, numbered Python scripts and mini-tutorials, each tied to its own blog post topic (crawlers, WeChat, Excel, SQL, misc utilities) rather than one cohesive application.How do I run one of these scripts?Clone the repo, pick the script matching the topic you want (listed under sections like 'Python 微信公众号开发' or the numbered misc scripts), and run it directly with python3 — there's no shared entry point or installer.
Clone the repo, pick the script matching the topic you want (listed under sections like 'Python 微信公众号开发' or the numbered misc scripts), and run it directly with python3 — there's no shared entry point or installer.Do I need extra libraries like Selenium for the crawler scripts?Yes for some of them — the Selenium-based example needs that package installed, and other scrapers rely on whatever library its own blog post describes; there is no single requirements.txt covering all scripts.
Yes for some of them — the Selenium-based example needs that package installed, and other scrapers rely on whatever library its own blog post describes; there is no single requirements.txt covering all scripts.Are these scripts ready to run out of the box?Not always — each script accompanies a specific article, so you may need to read the linked tutorial (e.g. for login handling in the Zhihu script or target site structure in the scrapers) to get it working.
Not always — each script accompanies a specific article, so you may need to read the linked tutorial (e.g. for login handling in the Zhihu script or target site structure in the scrapers) to get it working.What crawler examples are included?Scraping Qiushibaike jokes, a 'meizitu' image site, Lagou job postings for analysis, a Selenium-based example, and capturing Douyin app video requests.
Scraping Qiushibaike jokes, a 'meizitu' image site, Lagou job postings for analysis, a Selenium-based example, and capturing Douyin app video requests.What does the 'Python black magic' script do?It demonstrates how to remotely shut down a computer using Python.
It demonstrates how to remotely shut down a computer using Python.Why does a Python repo include SQL tutorials?Because several scraping and Excel scripts need to store data in a database, so the repo also has a quick SQL primer covering hierarchical queries, GROUP BY/ROLLUP/CUBE, and pivoting rows to columns.
Because several scraping and Excel scripts need to store data in a database, so the repo also has a quick SQL primer covering hierarchical queries, GROUP BY/ROLLUP/CUBE, and pivoting rows to columns.Can I use this to build a WeChat official account?Yes — there are beginner-level scripts for WeChat official account development, including a face-scoring (beauty detection) demo.
Yes — there are beginner-level scripts for WeChat official account development, including a face-scoring (beauty detection) demo.What are similar projects?Python-100-Days, learn_python3_spider, examples-of-web-crawlers, botasaurus, get_jobs, interview_python, SeleniumBase, scrapy
Python-100-Days, learn_python3_spider, examples-of-web-crawlers, botasaurus, get_jobs, interview_python, SeleniumBase, scrapyWhich topics is it in?influxdb, selenium, face-detection, tutorials, excel, scraping, job-search, crawler, script, downloader, wechat, web-scraping
influxdb, selenium, face-detection, tutorials, excel, scraping, job-search, crawler, script, downloader, wechat, web-scraping