Topics / #bert

Bert projects on GitHub

The BERT transformer model and NLP fine-tuning built on it.

As of , the most-starred Bert projects on GitHub are funNLP (83K stars), BettaFish (42.4K stars) and Ciphey (21.7K stars). GitHub.Locker tracks 15 Bert repositories with 293.8K stars combined. The fastest-growing on October 16 was MemoryBear, with +121 stars in a day.

15Projects
293.8KStars in total
+199Stars in a day

Hot right now

Most stars gained in a day · Oct 16

The all-time top

15 projects · by stars

  1. #1 · fighting41love/funNLP

    funNLP

    A huge curated collection of Chinese NLP resources: corpora, lexicons, tools, datasets and courses. The README calls it 'The Most Powerful NLP-Weapon Arsenal' — nearly the most complete Chinese NLP resource library.

    83K
  2. #2 · 666ghj/BettaFish

    BettaFish

    BettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.

    42.4K
  3. #3 · bee-san/Ciphey

    Ciphey

    ciphey automatically decrypts ciphertext without knowing the key or cipher, decodes encodings and cracks hashes. It is the Rust-built next generation of Ciphey — roughly 7x faster per decode — and the same team intends it to fully replace the original.

    21.7K
  1. 4

    ML-NLP

    17.8KNLP-LOVE/ML-NLP · Jupyter Notebook

    A curated, structured collection of machine learning, deep learning, and NLP interview knowledge points with accompanying code implementations, organized chapter by chapter (linear regression through BERT and XLNet).

  2. 5

    leedl-tutorial

    16.8Kdatawhalechina/leedl-tutorial · Jupyter Notebook

    A free Chinese-language deep learning tutorial (nicknamed the 'Apple Book') based on Prof. Li Hongyi's (Hung-yi Lee) 'Machine Learning' course, covering most major deep learning topics in detail.

  3. 6

    nlp-tutorial

    14.9Kgraykode/nlp-tutorial · Jupyter Notebook

    A collection of short PyTorch implementations covering core NLP and deep learning models, from word embeddings to Transformers and BERT, meant as a study resource.

  4. 7

    DeepLearningExamples

    14.9KNVIDIA/DeepLearningExamples · Jupyter Notebook

    A collection of NVIDIA-maintained, state-of-the-art deep learning reference implementations across computer vision, NLP, recommenders, speech, and more, tuned for reproducible accuracy and performance on NVIDIA Tensor Core GPUs.

  5. 8

    Ai-Learn

    13.4Ktangyudi/Ai-Learn

    This is a free, structured roadmap of nearly 200 hands-on AI learning projects covering Python, math, machine learning, data analysis, deep learning, computer vision and NLP, created by instructor Tangyudi (唐宇迪) to help beginners become job-ready in AI.

  6. 9

    PaddleNLP

    13KPaddlePaddle/PaddleNLP · Python

    PaddleNLP is a large language model (LLM) and small language model (SLM) development toolkit built on the PaddlePaddle deep learning framework, offering efficient training, lossless compression, and high-performance inference for large models.

  7. 10

    clip-as-service

    12.8Kjina-ai/clip-as-service · Python

    CLIP-as-service is a low-latency, high-scalability service for embedding images and text with CLIP models, so you can plug it into neural search or cross-modal retrieval apps as a microservice.

  8. 11

    Transformers-Tutorials

    11.8KNielsRogge/Transformers-Tutorials · Jupyter Notebook

    A collection of Jupyter notebook demos showing how to use HuggingFace's Transformers library in PyTorch, covering models like BERT, GPT-2, LayoutLM, DETR, Donut and many more.

  9. 12

    tokenizers

    11.2Khuggingface/tokenizers · Rust

    Tokenizers is a library implementing today's most-used tokenizers (BPE, WordPiece, Unigram) for NLP, built in Rust for speed and exposed to other languages via bindings. It's made by Hugging Face and powers tokenization for transformer models.

  10. 13

    Chinese-BERT-wwm

    10.2Kymcui/Chinese-BERT-wwm · Python

    This project releases a family of pre-trained Chinese BERT models trained with Whole Word Masking (WWM), including BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RoBERTa-wwm-ext-large, and smaller RBT3/RBT4/RBT6/RBTL3 variants, published alongside a paper in IEEE/ACM TASLP.

  11. 14

    MemoryBear

    7.8KSuanmoSuanyangTechnology/MemoryBear · Python

    MemoryBear is an AI memory system that gives AI agents human-like memory: instead of just storing knowledge statically, it perceives, extracts, associates and forgets information over time.

  12. 15

    deepopen

    2Kdeepopen-com/deepopen · Python

    DeepOpen is an open-source, non-autoregressive 'System 1' decision engine: instead of generating text token-by-token like an LLM, it makes typed decisions (choice, score, or boolean) over text, email, tickets or JSON in a single forward pass, across 100+ languages, in as little as 33ms.

Often tagged together