Topics / #chinese-nlp

Chinese NLP projects on GitHub

Natural language processing tools and datasets for Chinese text.

As of , the most-starred Chinese NLP projects on GitHub are funNLP (83K stars), chinese-poetry (53.8K stars) and airllm (39.1K stars). GitHub.Locker tracks 9 Chinese NLP repositories with 254K stars combined. The fastest-growing on October 16 was airllm, with +159 stars in a day.

9Projects
254KStars in total
+237Stars in a day

Hot right now

Most stars gained in a day · Oct 16

The all-time top

9 projects · by stars

  1. #1 · fighting41love/funNLP

    funNLP

    A huge curated collection of Chinese NLP resources: corpora, lexicons, tools, datasets and courses. The README calls it 'The Most Powerful NLP-Weapon Arsenal' — nearly the most complete Chinese NLP resource library.

    83K
  2. #2 · chinese-poetry/chinese-poetry

    chinese-poetry

    This is a massive open database of classical Chinese poetry, containing about 55,000 Tang poems, 260,000 Song poems, and 21,050 Song ci (lyric poems), along with other classical texts like the Analects and Book of Songs.

    53.8K
  3. #3 · lyogavin/airllm

    airllm

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

    39.1K
  1. 4

    HanLP

    36.5Khankcs/HanLP · Python

    HanLP is a production-oriented, multilingual NLP toolkit built on dual PyTorch/TensorFlow 2.x engines, supporting 130 languages with ten joint tasks such as tokenization, POS tagging, NER, dependency and constituency parsing, semantic role labeling, and text classification.

  2. 5

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

  3. 6

    Chinese-Word-Vectors

    12.2KEmbedding/Chinese-Word-Vectors · Python

    A collection of 100+ pre-trained Chinese word vectors (embeddings) trained with different representations, context features and corpora, plus the CA8 analogy dataset and an evaluation toolkit.

  4. 7

    chinese-xinhua

    11.7Kpwxcoo/chinese-xinhua · Python

    A Chinese Xinhua Dictionary database (中华新华字典数据库): four JSON datasets with 31,648 idioms, 264,434 words, 16,142 characters and 14,032 xiehouyu (two-part allegorical sayings), collected from the web.

  5. 8

    lieflat-less-ai-tone

    2.8Klarashero3-dotcom/lieflat-less-ai-tone · Python

    A research-backed skill that detects and removes 'AI tone' from Chinese writing, based on a statistical study of a 2.83-million-character corpus comparing AI-generated and human-written text.

  6. 9

    roster-match

    104charlenemercury/roster-match · JavaScript

    A zero-dependency JavaScript library that matches a Chinese name heard through speech recognition (or any garbled transcript) to the correct entry in a roster, comparing by pinyin syllables and surfacing candidates with reasons instead of forcing a decision when it is unsure.

Often tagged together