AI API aggregation platform with an OpenAI-compatible LLM endpoint for NLP tasks such as translation, summarization, multilingual generation, and structured extraction.
A curated list of resources dedicated to Natural Language Processing
This list covers natural language processing — linguistic analysis, multilingual tooling, classical and neural methods, datasets, and evaluation. Large language models are included only where they advance or evaluate a core NLP task or capability (tokenization, multilinguality, MT, summarization, NER, QA, factuality, probing, distillation). General-purpose chatbots, agent frameworks, prompt-template repositories, code-generation tools, and RAG application starter kits live in other lists — see See Also.
The Berkeley NLP Group - Notable contributions include a tool to reconstruct long dead languages, referenced here and by taking corpora from 637 languages currently spoken in Asia and the Pacific and recreating their descendant.
NLP research group, Columbia University - Responsible for creating BOLT ( interactive error handling for speech translation systems) and an un-named project to characterize laughter in dialogue.
Advanced NLP with spaCy - Free online course covering text processing, large-scale data analysis, processing pipelines, and training neural network models for custom NLP tasks.
Kaggle NLP Learning Guide - Beginner-friendly tutorials including getting started guides, deep learning for NLP, and visual explanations of techniques like BERT, GloVe, and TF-IDF.
Deep NLP Course by Yandex Data School, covering important ideas from text embedding to machine translation including sequence modeling, language models and so on.
fast.ai Code-First Intro to Natural Language Processing - This covers a blend of traditional NLP topics (including regex, SVD, naive bayes, tokenization) and recent neural network approaches (including RNNs, seq2seq, GRUs, and the Transformer), as well as addressing urgent ethical issues, such as bias and disinformation. Find the Jupyter Notebooks here
Applied Natural Language Processing- Lecture series from IIT Madras taking from the basics all the way to autoencoders and everything. The github notebooks for this course are also available here
DeepLearning.AI Natural Language Processing Specialization - 4-course program covering sentiment analysis, word embeddings, RNNs, LSTMs, attention mechanisms, and Transformer models like BERT and T5 for tasks including machine translation and summarization.
The Math Behind Artificial Intelligence - bt Tiago MOnteiro | A free FreeCodeCamp book teaching the math behind AI in plain English from an engineering point of view. It covers linear algebra, calculus, probability & statistics, and optimization theory with analogies, real-life applications, and Python code examples.
TextAttack - Adversarial attacks, adversarial training, and data augmentation in NLP
TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of Natural Language Toolkit (NLTK) and Pattern, and plays nicely with both :+1:
spaCy - Industrial strength NLP with Python and Cython :+1:
gensim - Python library to conduct unsupervised semantic modelling from plain text :+1:
scattertext - Python library to produce d3 visualizations of how language differs between corpora
GluonNLP(archived) - A deep learning toolkit for NLP, built on MXNet/Gluon.
AllenNLP(archived) - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
PyTorch-NLP - NLP research toolkit designed to support rapid prototyping with better data loaders, word vector loaders, neural network layer representations, common NLP metrics such as BLEU
Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python, handles some specific formats like ARPA language models, Moses phrasetables, GIZA++ alignments.
foliapy - Python library for working with FoLiA, an XML format for linguistic annotation.
PySS3 - Python package implementing the SS3 white-box text classifier; ships with interactive visualization tools that explain predictions.
jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides
awesome-nlp (keon/awesome-nlp)
Choose a tag and it will appear here. With no tags selected, all catalog projects are shown.
Searching Database…
Choose a tag and it will appear here. With no tags selected, all catalog projects are shown.
Что это такое?Тщательно отобранный список ресурсов по обработке естественного языка (NLP) — исследовательские подборки, туториалы, курсы, книги, библиотеки, датасеты и методы для разных задач, собранные в виде ссылок с краткими описаниями в одну строку.
Это инструмент, который я устанавливаю, или просто страница со ссылками?Ни то, ни другое — это каталог в стиле awesome, который читают на GitHub. Каждая запись ведёт на внешний ресурс (курс, книгу, библиотеку, датасет или подборку статей) с коротким описанием.
Какие задачи NLP охватывает раздел Tasks and Methods?Текстовые эмбеддинги; токенизация и сегментация; разметка частей речи и синтаксический разбор зависимостей; распознавание именованных сущностей; разрешение кореференции; классификация текстов и анализ тональности; тематическое моделирование; суммаризация; машинный перевод; вопросно-ответные системы; а также извлечение информации за пределами NER.
Есть ли среди книг и курсов бесплатные?Да — книга Дэна Юрафски Speech and Language Processing и конспекты Джейкоба Эйзенштейна по NLP бесплатны, как и курсы вроде Advanced NLP with spaCy и Cohere LLM University.
Выходит ли каталог за рамки классического NLP — например, в исследования языковых моделей?Да — там есть разделы про предобучение и адаптацию моделей, instruction tuning и оптимизацию по предпочтениям, эффективные и компактные модели, рассуждения и вычисления на этапе теста, длинный контекст, фактическую точность и галлюцинации, а также предвзятость, справедливость и безопасность в NLP.