spaCy README

The project's README from github.com/explosion/spaCy. As one markdown file: README.md.

spaCy: Industrial-strength NLP

spaCy is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products.

spaCy comes with pretrained pipelines and currently supports tokenization and training for 70+ languages. It features state-of-the-art speed and neural network models for tagging, parsing, named entity recognition, text classification and more, multi-task learning with pretrained transformers like BERT, as well as a production-ready training system and easy model packaging, deployment and workflow management. spaCy is commercial open-source software, released under the MIT license.

💫 Version 3.8 out now! Check out the release notes here.

tests Current Release Version pypi Version conda Version Python wheels Code style: black
PyPi downloads Conda downloads

📖 Documentation

Documentation
⭐️ spaCy 101 New to spaCy? Here's everything you need to know!
📚 Usage Guides How to use spaCy and its features.
🚀 New in v3.0 New features, backwards incompatibilities and migration guide.
🪐 Project Templates End-to-end workflows you can clone, modify and run.
🎛 API Reference The detailed reference for spaCy's API.
⏩ GPU Processing Use spaCy with CUDA-compatible GPU processing.
📦 Models Download trained pipelines for spaCy.
🦙 Large Language Models Integrate LLMs into spaCy pipelines.
🌌 Universe Plugins, extensions, demos and books from the spaCy ecosystem.
⚙️ spaCy VS Code Extension Additional tooling and features for working with spaCy's config files.
👩‍🏫 Online Course Learn spaCy in this free and interactive online course.
📰 Blog Read about current spaCy and Prodigy development, releases, talks and more from Explosion.
📺 Videos Our YouTube channel with video tutorials, talks and more.
🔴 Live Stream Join Matt as he works on spaCy and chat about NLP.
🛠 Changelog Changes and version history.
💝 Contribute How to contribute to the spaCy project and code base.
👕 Swag Support us and our work with unique, custom-designed swag!
Tailored Solutions Custom NLP consulting, implementation and strategic advice by spaCy’s core development team. Streamlined, production-ready, predictable and maintainable. Send us an email or take our 5-minute questionnaire, and well'be in touch! Learn more →

💬 Where to ask questions

The spaCy project is maintained by the spaCy team. Please understand that we won't be able to provide individual support via email. We also believe that help is much more valuable if it's shared publicly, so that more people can benefit from it.

Type Platforms
🚨 Bug Reports GitHub Issue Tracker
🎁 Feature Requests & Ideas GitHub Discussions · Live Stream
👩‍💻 Usage Questions GitHub Discussions · Stack Overflow
🗯 General Discussion GitHub Discussions · Live Stream

Features

📖 For more details, see the facts, figures and benchmarks.

⏳ Install spaCy

For detailed installation instructions, see the documentation.

pip

Using pip, spaCy releases are available as source packages and binary wheels. Before you install spaCy and its dependencies, make sure that your pip, setuptools and wheel are up to date.

pip install -U pip setuptools wheel
pip install spacy

To install additional data tables for lemmatization and normalization you can run pip install spacy[lookups] or install spacy-lookups-data separately. The lookups package is needed to create blank models with lemmatization data, and to lemmatize in languages that don't yet come with pretrained models and aren't powered by third-party libraries.

When using pip it is generally recommended to install packages in a virtual environment to avoid modifying system state:

python -m venv .env
source .env/bin/activate
pip install -U pip setuptools wheel
pip install spacy

conda

You can also install spaCy from conda via the conda-forge channel. For the feedstock including the build recipe and configuration, check out this repository.

conda install -c conda-forge spacy

Updating spaCy

Some updates to spaCy may require downloading new statistical models. If you're running spaCy v2.0 or higher, you can use the validate command to check if your installed models are compatible and if not, print details on how to update them:

pip install -U spacy
python -m spacy validate

If you've trained your own models, keep in mind that your training and runtime inputs must match. After updating spaCy, we recommend retraining your models with the new version.

📖 For details on upgrading from spaCy 2.x to spaCy 3.x, see the migration guide.

📦 Download model packages

Trained pipelines for spaCy can be installed as Python packages. This means that they're a component of your application, just like any other module. Models can be installed using spaCy's download command, or manually by pointing pip to a path or URL.

Documentation
Available Pipelines Detailed pipeline descriptions, accuracy figures and benchmarks.
Models Documentation Detailed usage and installation instructions.
Training How to train your own pipelines on your data.
# Download best-matching version of specific model for your spaCy installation
python -m spacy download en_core_web_sm

# pip install .tar.gz archive or .whl from path or URL
pip install /Users/you/en_core_web_sm-3.0.0.tar.gz
pip install /Users/you/en_core_web_sm-3.0.0-py3-none-any.whl
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.0.0/en_core_web_sm-3.0.0.tar.gz

Loading and using models

To loa

spaCy (explosion/spaCy)

Searching Database…

34K ·GitHub
这是什么?spaCy 是一个用于 Python 和 Cython 的高级自然语言处理库,从设计之初就面向真实产品。它自带预训练流水线,支持 70 多种语言的分词和训练。
它是加到我 Python 代码里的库,还是需要运行的服务?它是一个 Python 库:你在自己的代码里 import 它,用它搭建文本处理流水线。没有服务器,也没有界面——一切都在你的 Python 进程里运行。
怎么安装,怎么跑起第一个模型?用 pip 或从 conda-forge 安装,然后用 spaCy 的 download 命令下载一个预训练流水线——模型会像你应用里的其他模块一样,作为 Python 包安装。
我的 Python 环境能运行它吗?你需要 64 位的 Python 3.7 到 3.12,系统可以是 macOS、Linux 或 Windows(Cygwin、MinGW 或 Visual Studio)。
spaCy 更新后会不会把我训练好的模型弄坏?有可能:某些更新需要新的统计模型,而且训练和运行时的输入必须一致。升级后请运行 validate 命令检查已安装的模型,并用新版本重新训练你自己的模型。
我可以免费在商业项目里使用它吗?可以。spaCy 是基于 MIT 许可证的商业开源软件,它的维护方 Explosion 也围绕它提供付费的 NLP 咨询服务。
开箱即用,它能对文本做哪些事?内置组件涵盖命名实体识别、词性标注、依存句法分析、句子切分、文本分类、词形还原、形态分析和实体链接,还自带句法和 NER 的可视化工具。
我必须自己训练模型,还是有现成的预训练模型?不必自己训练:spaCy 为不同语言和任务提供了预训练流水线。如果有定制需求,它还有一套可投入生产的训练系统,支持在 BERT 等预训练 transformer 上做多任务学习。
它支持哪些语言?支持 70 多种语言的分词和训练,每种语言都配有基于语言学原理设计的分词方案。
我能接入自己的 PyTorch 或 TensorFlow 模型吗?可以——spaCy 支持 PyTorch、TensorFlow 及其他框架的自定义模型,流水线也能通过自定义组件和属性轻松扩展。
Creator
explosion
Size
199.7 MB
Stars
34K
Age
12y
Commits · 90 Days