Topics / #bert
Bert projects on GitHub
The BERT transformer model and NLP fine-tuning built on it.
As of , the most-starred Bert projects on GitHub are funNLP (83K stars), BettaFish (42.4K stars) and Ciphey (21.7K stars). GitHub.Locker tracks 15 Bert repositories with 293.8K stars combined. The fastest-growing on October 16 was MemoryBear, with +121 stars in a day.
Hot right now
Most stars gained in a day · Oct 16
MemoryBear
SuanmoSuanyangTechnology/MemoryBear · ★ 7.8KMemoryBear is an AI memory system that gives AI agents human-like memory: instead of just storing knowledge statically, it perceives, extracts, associates and forgets information over time.
+34funNLP
fighting41love/funNLP · ★ 83KA huge curated collection of Chinese NLP resources: corpora, lexicons, tools, datasets and courses. The README calls it 'The Most Powerful NLP-Weapon Arsenal' — nearly the most complete Chinese NLP resource library.
+21BettaFish
666ghj/BettaFish · ★ 42.4KBettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.
+6tokenizers
huggingface/tokenizers · ★ 11.2KTokenizers is a library implementing today's most-used tokenizers (BPE, WordPiece, Unigram) for NLP, built in Rust for speed and exposed to other languages via bindings. It's made by Hugging Face and powers tokenization for transformer models.
The all-time top
15 projects · by stars
- 83K
#1 · fighting41love/funNLPfunNLP
A huge curated collection of Chinese NLP resources: corpora, lexicons, tools, datasets and courses. The README calls it 'The Most Powerful NLP-Weapon Arsenal' — nearly the most complete Chinese NLP resource library.
- 42.4K
#2 · 666ghj/BettaFishBettaFish
BettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.
- 21.7K
#3 · bee-san/Ciphey
Ciphey
ciphey automatically decrypts ciphertext without knowing the key or cipher, decodes encodings and cracks hashes. It is the Rust-built next generation of Ciphey — roughly 7x faster per decode — and the same team intends it to fully replace the original.
- 4

ML-NLP
17.8KNLP-LOVE/ML-NLP · Jupyter NotebookA curated, structured collection of machine learning, deep learning, and NLP interview knowledge points with accompanying code implementations, organized chapter by chapter (linear regression through BERT and XLNet).
- 5

leedl-tutorial
16.8Kdatawhalechina/leedl-tutorial · Jupyter NotebookA free Chinese-language deep learning tutorial (nicknamed the 'Apple Book') based on Prof. Li Hongyi's (Hung-yi Lee) 'Machine Learning' course, covering most major deep learning topics in detail.
- 6

nlp-tutorial
14.9Kgraykode/nlp-tutorial · Jupyter NotebookA collection of short PyTorch implementations covering core NLP and deep learning models, from word embeddings to Transformers and BERT, meant as a study resource.
- 7

DeepLearningExamples
14.9KNVIDIA/DeepLearningExamples · Jupyter NotebookA collection of NVIDIA-maintained, state-of-the-art deep learning reference implementations across computer vision, NLP, recommenders, speech, and more, tuned for reproducible accuracy and performance on NVIDIA Tensor Core GPUs.
- 8

Ai-Learn
13.4Ktangyudi/Ai-LearnThis is a free, structured roadmap of nearly 200 hands-on AI learning projects covering Python, math, machine learning, data analysis, deep learning, computer vision and NLP, created by instructor Tangyudi (唐宇迪) to help beginners become job-ready in AI.
- 9

PaddleNLP
13KPaddlePaddle/PaddleNLP · PythonPaddleNLP is a large language model (LLM) and small language model (SLM) development toolkit built on the PaddlePaddle deep learning framework, offering efficient training, lossless compression, and high-performance inference for large models.
- 10
clip-as-service
12.8Kjina-ai/clip-as-service · PythonCLIP-as-service is a low-latency, high-scalability service for embedding images and text with CLIP models, so you can plug it into neural search or cross-modal retrieval apps as a microservice.
- 11

Transformers-Tutorials
11.8KNielsRogge/Transformers-Tutorials · Jupyter NotebookA collection of Jupyter notebook demos showing how to use HuggingFace's Transformers library in PyTorch, covering models like BERT, GPT-2, LayoutLM, DETR, Donut and many more.
- 12

tokenizers
11.2Khuggingface/tokenizers · RustTokenizers is a library implementing today's most-used tokenizers (BPE, WordPiece, Unigram) for NLP, built in Rust for speed and exposed to other languages via bindings. It's made by Hugging Face and powers tokenization for transformer models.
- 13

Chinese-BERT-wwm
10.2Kymcui/Chinese-BERT-wwm · PythonThis project releases a family of pre-trained Chinese BERT models trained with Whole Word Masking (WWM), including BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RoBERTa-wwm-ext-large, and smaller RBT3/RBT4/RBT6/RBTL3 variants, published alongside a paper in IEEE/ACM TASLP.
- 14
MemoryBear
7.8KSuanmoSuanyangTechnology/MemoryBear · PythonMemoryBear is an AI memory system that gives AI agents human-like memory: instead of just storing knowledge statically, it perceives, extracts, associates and forgets information over time.
- 15

deepopen
2Kdeepopen-com/deepopen · PythonDeepOpen is an open-source, non-autoregressive 'System 1' decision engine: instead of generating text token-by-token like an LLM, it makes typed decisions (choice, score, or boolean) over text, email, tickets or JSON in a single forward pass, across 100+ languages, in as little as 33ms.
Related topics
Often tagged together
- deep-learning737
- nlp214
- python2,383
- machine-learning916
- chinese1,159
- research764
- natural-language-processing96
- open-source5,666
- pytorch419
- transformer212
- ai1,955
- education933
- huggingface362
- jupyter notebook176
- transformers97
- tutorial626
- apache-2.01,434
- china414
- computer-vision384
- docker1,660
- embeddings135
- fine-tuning185
- gpu789
- llm1,483