AI API aggregation platform with an OpenAI-compatible LLM endpoint for NLP tasks such as translation, summarization, multilingual generation, and structured extraction.
A curated list of resources dedicated to Natural Language Processing
This list covers natural language processing — linguistic analysis, multilingual tooling, classical and neural methods, datasets, and evaluation. Large language models are included only where they advance or evaluate a core NLP task or capability (tokenization, multilinguality, MT, summarization, NER, QA, factuality, probing, distillation). General-purpose chatbots, agent frameworks, prompt-template repositories, code-generation tools, and RAG application starter kits live in other lists — see See Also.
The Berkeley NLP Group - Notable contributions include a tool to reconstruct long dead languages, referenced here and by taking corpora from 637 languages currently spoken in Asia and the Pacific and recreating their descendant.
NLP research group, Columbia University - Responsible for creating BOLT ( interactive error handling for speech translation systems) and an un-named project to characterize laughter in dialogue.
Advanced NLP with spaCy - Free online course covering text processing, large-scale data analysis, processing pipelines, and training neural network models for custom NLP tasks.
Kaggle NLP Learning Guide - Beginner-friendly tutorials including getting started guides, deep learning for NLP, and visual explanations of techniques like BERT, GloVe, and TF-IDF.
Deep NLP Course by Yandex Data School, covering important ideas from text embedding to machine translation including sequence modeling, language models and so on.
fast.ai Code-First Intro to Natural Language Processing - This covers a blend of traditional NLP topics (including regex, SVD, naive bayes, tokenization) and recent neural network approaches (including RNNs, seq2seq, GRUs, and the Transformer), as well as addressing urgent ethical issues, such as bias and disinformation. Find the Jupyter Notebooks here
Applied Natural Language Processing- Lecture series from IIT Madras taking from the basics all the way to autoencoders and everything. The github notebooks for this course are also available here
DeepLearning.AI Natural Language Processing Specialization - 4-course program covering sentiment analysis, word embeddings, RNNs, LSTMs, attention mechanisms, and Transformer models like BERT and T5 for tasks including machine translation and summarization.
The Math Behind Artificial Intelligence - bt Tiago MOnteiro | A free FreeCodeCamp book teaching the math behind AI in plain English from an engineering point of view. It covers linear algebra, calculus, probability & statistics, and optimization theory with analogies, real-life applications, and Python code examples.
TextAttack - Adversarial attacks, adversarial training, and data augmentation in NLP
TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of Natural Language Toolkit (NLTK) and Pattern, and plays nicely with both :+1:
spaCy - Industrial strength NLP with Python and Cython :+1:
gensim - Python library to conduct unsupervised semantic modelling from plain text :+1:
scattertext - Python library to produce d3 visualizations of how language differs between corpora
GluonNLP(archived) - A deep learning toolkit for NLP, built on MXNet/Gluon.
AllenNLP(archived) - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
PyTorch-NLP - NLP research toolkit designed to support rapid prototyping with better data loaders, word vector loaders, neural network layer representations, common NLP metrics such as BLEU
Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python, handles some specific formats like ARPA language models, Moses phrasetables, GIZA++ alignments.
foliapy - Python library for working with FoLiA, an XML format for linguistic annotation.
PySS3 - Python package implementing the SS3 white-box text classifier; ships with interactive visualization tools that explain predictions.
jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides
awesome-nlp (keon/awesome-nlp)
Choose a tag and it will appear here. With no tags selected, all catalog projects are shown.
Searching Database…
Choose a tag and it will appear here. With no tags selected, all catalog projects are shown.
Tasks and Methods(任务与方法)部分涵盖哪些 NLP 任务?文本嵌入;分词与切分;词性标注和依存句法分析;命名实体识别;指代消解;文本分类和情感分析;主题建模;摘要生成;机器翻译;问答系统;以及命名实体识别之外的信息抽取。
里面的书或课程有免费的吗?有——Dan Jurafsky 的 Speech and Language Processing 和 Jacob Eisenstein 的 NLP 笔记都是免费的,像 Advanced NLP with spaCy 和 Cohere LLM University 这样的课程也是免费的。