Topics / #data-mining

Data-mining projects on GitHub

Extracting patterns and knowledge from large datasets with machine learning.

As of October 18, 2026, the most-starred Data-mining projects on GitHub are MediaCrawler (67.1K stars), ML-From-Scratch (33K stars) and awesome-datascience (30.2K stars). GitHub.Locker tracks 16 Data-mining repositories with 330.7K stars combined. The fastest-growing on October 17 was MediaCrawler, with +52 stars in a day.

16Projects

330.7KStars in total

+92Stars in a day

Browse in the catalog →github.com/topics/data-mining ↗

Hot right now

Most stars gained in a day · Oct 17

+52

MediaCrawler

NanmiCoder/MediaCrawler · ★ 67.1K

A multi-platform crawler for Chinese social media: it collects keyword search results, specific posts, and their comments from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.

+12

RD-Agent

microsoft/RD-Agent · ★ 15K

R&D-Agent is a Microsoft multi-agent framework that automates data-driven R&D: one agent proposes new research ideas and another implements them, applied to quant trading, data mining, Kaggle competitions, paper reproduction, and LLM fine-tuning.

Ai-Learn

tangyudi/Ai-Learn · ★ 13.4K

This is a free, structured roadmap of nearly 200 hands-on AI learning projects covering Python, math, machine learning, data analysis, deep learning, computer vision and NLP, created by instructor Tangyudi (唐宇迪) to help beginners become job-ready in AI.

ML-From-Scratch

eriklindernoren/ML-From-Scratch · ★ 33K

A Python library of fundamental machine learning models and algorithms implemented from scratch in NumPy, aiming to cover everything from linear regression to deep learning.

The all-time top

16 projects · by stars

#1 · NanmiCoder/MediaCrawler
MediaCrawler
A multi-platform crawler for Chinese social media: it collects keyword search results, specific posts, and their comments from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
67.1K
#2 · eriklindernoren/ML-From-Scratch
ML-From-Scratch
A Python library of fundamental machine learning models and algorithms implemented from scratch in NumPy, aiming to cover everything from linear regression to deep learning.
33K
#3 · academic/awesome-datascience
awesome-datascience
An open-source, community-maintained Data Science repository — essentially a giant curated list of resources (courses, tutorials, algorithms, tools, books, datasets, communities) for learning and applying data science to real-world problems. Around 30k stars, around since 2014.
30.2K

4
EasyOCR
30.1KJaidedAI/EasyOCR · Python
A ready-to-use, open-source OCR library for Python: it detects and reads text in images across 80+ languages and popular writing scripts — Latin, Chinese, Arabic, Devanagari, Cyrillic and more.
5
colly
25.6Kgocolly/colly · Go
Colly is a scraping and crawling framework for Go: a clean interface for writing any kind of crawler, scraper or spider that extracts structured data from websites, for things like data mining, processing or archiving.
6
awesome-production-machine-learning
21KEthicalML/awesome-production-machine-learning
A curated, community-maintained directory of open source libraries for production machine learning: tools to deploy, monitor, version, scale, and secure ML systems, grouped into 25+ annotated sections.
7
LightGBM
18.9Klightgbm-org/LightGBM · C++
LightGBM is a gradient boosting framework that uses tree-based learning algorithms, used for ranking, classification and many other machine learning tasks.
8
pyspider
16.8Kbinux/pyspider · Python
pyspider is a powerful web spider (crawler) system written in Python: you write crawling scripts in Python and manage your scraping projects through a built-in web interface.
9
gensim
16.5Kpiskvorky/gensim · Python
Gensim is a Python library for topic modelling, document indexing and similarity retrieval with large corpora, aimed at the natural language processing (NLP) and information retrieval (IR) community.
10
RD-Agent
15Kmicrosoft/RD-Agent · Python
R&D-Agent is a Microsoft multi-agent framework that automates data-driven R&D: one agent proposes new research ideas and another implements them, applied to quant trading, data mining, Kaggle competitions, paper reproduction, and LLM fine-tuning.
11
Ai-Learn
13.4Ktangyudi/Ai-Learn
This is a free, structured roadmap of nearly 200 hands-on AI learning projects covering Python, math, machine learning, data analysis, deep learning, computer vision and NLP, created by instructor Tangyudi (唐宇迪) to help beginners become job-ready in AI.
12
python-machine-learning-book
12.7Krasbt/python-machine-learning-book · Jupyter Notebook
This is the official code repository for the 1st edition of the 'Python Machine Learning' book by Sebastian Raschka, published by Packt in 2015. It holds the Jupyter notebooks with all the code examples from the book's 13 chapters, from basic classifiers to neural networks.
13
sktime
10.1Ksktime/sktime · Python
sktime is a Python library for machine learning with time series: one unified interface for forecasting, classification, clustering, and anomaly or changepoint detection.
14
tpot
10.1KEpistasisLab/tpot · Jupyter Notebook
TPOT, the Tree-based Pipeline Optimization Tool, is a Python AutoML library that uses genetic programming to automatically optimize machine learning pipelines for your data; the README calls it your Data Science Assistant.
15
pyod
10Kyzhao062/pyod · Python
PyOD is a Python library for anomaly detection that bundles over 60 detection algorithms into one consistent API, covering tabular, time series, graph, text, image, and audio data.
16
Instagram-Downloader
441hoaianle/Instagram-Downloader · JavaScript
A Chrome extension that downloads photos and videos from Instagram posts, TV, reels, stories, and highlights directly from the page you're viewing.