awesome-nlp README

The project's README from github.com/keon/awesome-nlp. As one markdown file: README.md.

awesome-nlp

Sponsored by Atlas Cloud

AI API aggregation platform with an OpenAI-compatible LLM endpoint for NLP tasks such as translation, summarization, multilingual generation, and structured extraction.

A curated list of resources dedicated to Natural Language Processing

Please read the contribution guidelines before contributing. Please add your favourite NLP resource by raising a pull request

Scope

This list covers natural language processing — linguistic analysis, multilingual tooling, classical and neural methods, datasets, and evaluation. Large language models are included only where they advance or evaluate a core NLP task or capability (tokenization, multilinguality, MT, summarization, NER, QA, factuality, probing, distillation). General-purpose chatbots, agent frameworks, prompt-template repositories, code-generation tools, and RAG application starter kits live in other lists — see See Also.

Contents

Research Summaries and Trends
Prominent NLP Research Labs
Tutorials
Libraries
- Node.js
- Python
- C++
- Java
- Kotlin
- Scala
- R
- Clojure
- Go
- Ruby
- Rust
- NLP++
- Julia
Services
Annotation Tools
Tasks and Methods
Datasets
Multilingual NLP Frameworks
Language Models for NLP
NLP per Language
See Also
Citation

Research Summaries and Trends

Where to follow current NLP research:

ACL Anthology - canonical archive of papers from ACL, EMNLP, NAACL, EACL, COLING, and related venues.
NLP-Progress - tracks state-of-the-art results across common NLP tasks and datasets.
Papers With Code: NLP - papers, benchmarks, and leaderboards for NLP tasks.
Sebastian Ruder's newsletter - regular roundups of NLP research and trends.
ACL Rolling Review - the rolling review process feeding ACL-affiliated venues.
The Gradient - long-form essays on ML and NLP research.
Visual NLP Paper Summaries - illustrated summaries of recent papers.

Historical highlights

NLP's ImageNet moment has arrived - 2018 essay on the rise of pretrained language models.
Survey of the State of the Art in Natural Language Generation - 2017 NLG survey.
The Illustrated Transformer and The Illustrated BERT, ELMo, and co. - canonical visual explanations.

Prominent NLP Research Labs

The Berkeley NLP Group - Notable contributions include a tool to reconstruct long dead languages, referenced here and by taking corpora from 637 languages currently spoken in Asia and the Pacific and recreating their descendant.
Language Technologies Institute, Carnegie Mellon University - Notable projects include Avenue Project, a syntax driven machine translation system for endangered languages like Quechua and Aymara and previously, Noah's Ark which created AQMAR to improve NLP tools for Arabic.
NLP research group, Columbia University - Responsible for creating BOLT ( interactive error handling for speech translation systems) and an un-named project to characterize laughter in dialogue.
The Center or Language and Speech Processing, John Hopkins University - Recently in the news for developing speech recognition software to create a diagnostic test or Parkinson's Disease, here.
Computational Linguistics and Information Processing Group, University of Maryland - Notable contributions include Human-Computer Cooperation or Word-by-Word Question Answering and modeling development of phonetic representations.
Penn Natural Language Processing, University of Pennsylvania - famous for creating the Penn Treebank and the Penn Discourse Treebank.
The Stanford Nautral Language Processing Group- One of the top NLP research labs in the world, notable for creating Stanford CoreNLP and their coreference resolution system

Tutorials

Reading Content

General Machine Learning

Machine Learning 101 from Google's Senior Creative Engineer explains Machine Learning for engineer's and executives alike
AI Playbook - a16z AI playbook is a great link to forward to your managers or content for your presentations
Sebastian Ruder's Newsletter for commentary on the best of NLP research.
How To Label Data guide to managing larger linguistic annotation projects
Depends on the Definition collection of blog posts covering a wide array of NLP topics with detailed implementation

Introductions and Guides to NLP

Understand & Implement Natural Language Processing
NLP in Python - Collection of Github notebooks
Natural Language Processing: An Introduction - Oxford
NLP from Scratch with PyTorch
Hands-On NLTK Tutorial - NLTK Tutorials, Jupyter notebooks
Natural Language Processing with Python – Analyzing Text with the Natural Language Toolkit - An online and print book introducing NLP concepts using NLTK. The book's authors also wrote the NLTK library.
Train a new language model from scratch - Hugging Face 🤗
Advanced NLP with spaCy - Free online course covering text processing, large-scale data analysis, processing pipelines, and training neural network models for custom NLP tasks.
Kaggle NLP Learning Guide - Beginner-friendly tutorials including getting started guides, deep learning for NLP, and visual explanations of techniques like BERT, GloVe, and TF-IDF.

Blogs and Newsletters

Videos and Online Courses

Advanced Natural Language Processing - CS 685, UMass Amherst CS
Deep Natural Language Processing - Lectures series from Oxford
Deep Learning for Natural Language Processing (cs224-n) - Richard Socher and Christopher Manning's Stanford Course
Neural Networks for NLP - Carnegie Mellon Language Technology Institute there
Deep NLP Course by Yandex Data School, covering important ideas from text embedding to machine translation including sequence modeling, language models and so on.
fast.ai Code-First Intro to Natural Language Processing - This covers a blend of traditional NLP topics (including regex, SVD, naive bayes, tokenization) and recent neural network approaches (including RNNs, seq2seq, GRUs, and the Transformer), as well as addressing urgent ethical issues, such as bias and disinformation. Find the Jupyter Notebooks here
Machine Learning University - Accelerated Natural Language Processing - Lectures go from introduction to NLP and text processing to Recurrent Neural Networks and Transformers. Material can be found here.
Applied Natural Language Processing- Lecture series from IIT Madras taking from the basics all the way to autoencoders and everything. The github notebooks for this course are also available here
DeepLearning.AI Natural Language Processing Specialization - 4-course program covering sentiment analysis, word embeddings, RNNs, LSTMs, attention mechanisms, and Transformer models like BERT and T5 for tasks including machine translation and summarization.
Stanford CS336: Language Modeling from Scratch - end-to-end course on building language models, including data, tokenization, training, and evaluation.
Stanford CS25: Transformers United - seminar series with guest lectures from authors of recent transformer and NLP research.
Cohere LLM University - free course on LLMs, embeddings, semantic search, and NLP applications.
Hugging Face NLP Course - hands-on NLP with Transformers, Datasets, and Tokenizers libraries.
NLP Demystified - Free beginner-friendly course covering NLP fundamentals through transformers, with Python/Jupyter notebooks.

Books

Speech and Language Processing - free, by Prof. Dan Jurafsy
Natural Language Processing - free, NLP notes by Dr. Jacob Eisenstein at GeorgiaTech
NLP with PyTorch - Brian & Delip Rao
Text Mining in R
Natural Language Processing with Python
Practical Natural Language Processing
Natural Language Processing with Spark NLP
Deep Learning for Natural Language Processing by Stephan Raaijmakers
Real-World Natural Language Processing - by Masato Hagiwara
Natural Language Processing in Action, Second Edition - by Hobson Lane and Maria Dyshel
Transformers in Action - by Nicole Koenigstein
The Math Behind Artificial Intelligence - bt Tiago MOnteiro | A free FreeCodeCamp book teaching the math behind AI in plain English from an engineering point of view. It covers linear algebra, calculus, probability & statistics, and optimization theory with analogies, real-life applications, and Python code examples.

Libraries

Node.js and Javascript - Node.js Libaries for NLP | Back to Top
- Twitter-text - A JavaScript implementation of Twitter's text processing library
- Knwl.js - A Natural Language Processor in JS
- Retext - Extensible system for analyzing and manipulating natural language
- NLP Compromise - Natural Language processing in the browser
- Natural - general natural language facilities for node
- Poplar - A web-based annotation tool for natural language processing (NLP)
- NLP.js - An NLP library for building bots
- node-question-answering - Fast and production-ready question answering w/ DistilBERT in Node.js
Python - Python NLP Libraries | Back to Top
- sentimental-onix Sentiment models for spacy using onnx
- TextAttack - Adversarial attacks, adversarial training, and data augmentation in NLP
- TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of Natural Language Toolkit (NLTK) and Pattern, and plays nicely with both :+1:
- spaCy - Industrial strength NLP with Python and Cython :+1:
  - textacy - Higher level NLP built on spaCy
- gensim - Python library to conduct unsupervised semantic modelling from plain text :+1:
- scattertext - Python library to produce d3 visualizations of how language differs between corpora
- GluonNLP (archived) - A deep learning toolkit for NLP, built on MXNet/Gluon.
- AllenNLP (archived) - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
- PyTorch-NLP - NLP research toolkit designed to support rapid prototyping with better data loaders, word vector loaders, neural network layer representations, common NLP metrics such as BLEU
- Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
- PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python, handles some specific formats like ARPA language models, Moses phrasetables, GIZA++ alignments.
- foliapy - Python library for working with FoLiA, an XML format for linguistic annotation.
- PySS3 - Python package implementing the SS3 white-box text classifier; ships with interactive visualization tools that explain predictions.
- jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides

language

Searching Database…

19.1K ·GitHub

What is this?

A curated list of resources dedicated to Natural Language Processing — research hubs, tutorials, courses, books, libraries, datasets, and task methods, collected as links with one-line descriptions.

Is this a tool I install, or just a page of links?

Neither — it's an awesome-style catalog you read on GitHub. Every entry points to an external resource (a course, book, library, dataset, or paper hub) with a short description.

Which NLP tasks does the Tasks and Methods section cover?

Text embeddings; tokenization and segmentation; POS tagging and dependency parsing; named entity recognition; coreference resolution; text classification and sentiment; topic modeling; summarization; machine translation; question answering; and information extraction beyond NER.

Are any of the books or courses free?

Yes — Dan Jurafsky's Speech and Language Processing and Jacob Eisenstein's NLP notes are both free, and courses like Advanced NLP with spaCy and Cohere LLM University are free too.

Does it go beyond classic NLP into language-model research?

Yes — sections cover pretraining and adaptation, instruction tuning and preference optimization, efficient and small models, reasoning and test-time compute, long context, factuality and hallucination, and bias, fairness and safety in NLP.

What are similar projects?

funNLP, NLP-progress, 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code, LLMSearchRecommender, bert, Chinese-Word-Vectors, DeepLearning, doccano

Which topics is it in?

named-entity-recognition, question-answering, sentiment-analysis, datasets, language, books, natural-language-processing, dataset, translation, embeddings, evaluation, multilingual

Creator: keon
Size: 0.7 MB
Stars: 19.1K
Updated: CommitOct 12
Age: 10y
Commits · 90 Days