项目的 README,来自 github.com/OpenBMB/MiniCPM-OCR。合并为一个 markdown 文件:README.md。
MiniCPM-OCR 1.0 Guide
MiniCPM-OCR Jev Guide
Demo (CN / Global)
·
Get Started ·
Weights ·
Free API ·
Skill ·
Local Deployment
| 中文
Join the Community via
Feishu / Lark ·
Discord
MiniCPM-OCR is a family of models for efficient document parsing and text recognition. MiniCPM-OCR 1.0 parses Chinese and English documents and PDFs, balancing quality and efficiency across challenging inputs such as scans, photographs, curved pages, and recaptured documents. MiniCPM-OCR Jev evaluates OCR results at the region level, distinguishing problematic regions from reliable ones. It works with different parsing models to help users locate content that needs review.
--split-images makes each standalone image its own document.MiniCPM-OCR 1.0 (1.3B) is the first OCR-specific model in the MiniCPM-V/o family. It focuses on text-centric document understanding, covering text, tables, formulas, charts, seals, and structured information extraction. Its key features include:
Among the open-source OCR models shown below, MiniCPM-OCR 1.0 achieves 1.2 pages/s and the highest overall performance on OmniDocBench v1.6, Real5-OmniDocBench, Wild-OmniDocBench, and olmOCR-Bench.
See the reproduction guide for test settings and reproduction details, and the model guide throughput evaluation for each model's throughput.
See the MiniCPM-OCR 1.0 guide for per-benchmark bar charts and throughput details.
Left to right: original document, detected layout, and rendered Markdown.
MiniCPM-OCR Jev is an OCR correctness decision model for text, formulas, and tables. Given an image and its corresponding OCR result, it returns a quality score from 0 to 1 to help select reliable results and locate content that needs review.
The table below reports overall and per-category AUROC (×100) on JevOCRBench. Higher values indicate better discrimination between correct and incorrect parsing results.
Accuracy at different review-free rates across three document types.
Set the threshold only after checking it on a small batch from the real application.
Jev scores for text, formula, and table recognition.
See the MiniCPM-OCR Jev model guide for more on usage, technical specifications, evaluation results, and efficiency results.
Choose how to integrate MiniCPM-OCR 1.0 and MiniCPM-OCR Jev:
Full-page parsing runs as a two-stage pipeline orchestrated by the minicpm-ocr SDK. The two stages use separate models, run in separate environments, and may run on different machines:
flowchart LR
DOC["PDF / image"] --> S1
subgraph SDKENV ["minicpm-ocr SDK (its own environment)"]
S1["Stage 1 · Layout detection<br>PP-DocLayoutV3 layout model (PaddlePaddle / PaddleX)<br>regions, reading order, cropping"]
ASM["Assemble output<br>Markdown / JSON in reading order"]
end
subgraph SRVENV ["Recognition service (separate environment)"]
S2["Stage 2 · Region recognition<br>MiniCPM-OCR 1.0<br>vLLM / SGLang / llama.cpp / Ollama"]
end
S1 -- "each cropped region, over HTTP,<br>with a prompt for its region type" --> S2
S2 -- "text, tables, formulas, charts, seals" --> ASM
Text Recognition:, Table Recognition:, Formula Recognition:, …). The SDK assembles the recognized content into the final Markdown / JSON in reading order.A full local deployment therefore prepares two environments side by side: the SDK environment (pip package minicpm-ocr, plus PaddlePaddle / PaddleX for the layout model) and the inference-service environment of the chosen backend. The Skill walks through the complete setup — backend choice, environment installation, model downloads, and verification — and the SDK tutorial covers the same steps for manual deployment. For region prompts and per-stage details, see the document parsing workflow.
Ask a coding agent to follow the MiniCPM-OCR 1.0 skill to set up the environment, download models, and parse your first document. Send the following instruction to the agent:
Read and execute https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/SKILL_en.md
Ask a coding agent to follow the MiniCPM-OCR Jev skill to deploy, start, and verify the scoring service locally — either from the Docker image or with the SDK, using vLLM, SGLang, llama.cpp, or Ollama as the inference backend. Send the following instruction to the agent:
Read and execute https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/SKILL_jev_en.md
If you have already cloned this repository, you can use ./docs/SKILL_en.md and ./docs/SKILL_jev_en.md directly.
Deploy MiniCPM-OCR 1.0 with the official Docker image, which bundles model weights, the SDK, vLLM, and the document parsing backend. The Docker Hub page provides startup instructions for both the OCR model API and the end-to-end document parsing API, supporting image and PDF parsing into Markdown / JSON.
Requires Linux x86-64, an NVIDIA GPU, a driver compatible with CUDA 12.9, and Docker configured with NVIDIA Container Toolkit. Follow the image documentation to select and start the service you need.
Use the Free API to access MiniCPM-OCR 1.0 recognition and MiniCPM-OCR Jev quality scoring.
MiniCPM-OCR 1.0 API docs · MiniCPM-OCR Jev API docs
MiniCPM-OCR 1.0 parses documents entirely on your device, even offline. This document recognition feature is currently available on iOS only.
Run the models on your own hardware: MiniCPM-OCR 1.0 parses PDFs and images into Markdown or JSON, while MiniCPM-OCR Jev scores the parsing results.
MiniCPM-OCR 1.0 deployment tutorial · MiniCPM-OCR Jev deployment tutorial · Web demo deployment tutorial
| Model | Fine-tuning tutorial |
|---|---|
| MiniCPM-OCR 1.0 | LLaMA-Factory · Swift |
| MiniCPM-OCR Jev | Swift |
| Model | Description | Main Model Weights | DSpark Heads |
| MiniCPM‑OCR 1.0 | Efficient document parsing and text recognition for Chinese and English documents and PDFs, balancing quality and speed across scans, photographs, curved pages, and recaptured documents. | 🤗 🤗 🤗 🤗 |
🤗 🤗 |
| MiniCPM‑OCR Jev | An OCR correctness decision model for text, formulas, and tables. Given an image and its OCR result, it returns a quality score from 0 to 1. | 🤗 🤗 |
See the FAQ for common questions about installation, model downloads, GPU memory, input formats, and unexpected outputs.
The entire project is released under the Apache License 2.0, including code, documentation, and model weights for MiniCPM-OCR 1.0 and MiniCPM-OCR Jev.