Global

cpu-inference
12 projects tagged “cpu-inference” that gained the most stars yesterday
#113 · +345 · 1d ·GitHub

Ears for coding agents: let AI hear, review and make sound. CPU-only, open source.

Creator
Leonxlnx
Size
4 MB
Stars
1.9K
Age
6d
Commits · 90 Days

The world's first completely free and open-source face recognition SDK for Windows and Linux from Faceplugin

Size
54.6 MB
Stars
2.7K
Updated
CommitOct 02
Age
1y
Commits · 90 Days
#1550 · +20 · 1d ·GitHub

Open-source State-of-the-art TTS model which runs on a CPU 😻

Creator
KittenML
Size
2 MB
Stars
16.2K
Age
1y
Commits · 90 Days
#1630 · +19 · 1d ·GitHub

24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Size
31 MB
Stars
9.1K
Age
2mo
Commits · 90 Days
#2704 · +9 · 1d ·GitHub

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

Creator
feder-cr
Size
17.6 MB
Stars
957
Age
2y
Commits · 90 Days
#2859 · +8 · 1d ·GitHub

9 million parameter language model that generates text on an ESP32-S3 microcontroller. 88 tokens per second on a small screen wired to the chip. It fits because most of the model lives in flash instead of RAM, using Per-Layer Embeddings, an idea from Google's Gemma 3n.

Creator
slvDev
Size
1.4 MB
Stars
4.6K
Updated
CommitSep 23
Age
2mo
Commits · 90 Days
#3350 · +6 · 1d ·GitHub

AI and the OpenMOSS team. 1B parameters, it is designed for realtime speech generation, can run directly on CPU without a GPU, and keeps the deployment stack simple enough for local demos, web serving, and lightweight product integration.

Creator
OpenMOSS
Size
58.2 MB
Stars
4.5K
Updated
CommitSep 06
Age
6mo
Commits · 90 Days
#4120 · +4 · 1d ·GitHub

\janas-chat. 8 times as fast with the dense model (Qwen3-4B 346 tok/s against 193), whose whole blocks go to the GPU, through Intel's own Windows driver there.

Size
5.2 MB
Stars
453
Age
1mo
Commits · 90 Days
#4562 · +3 · 1d ·GitHub

5, designed for one-pass typed decisions with calibrated probabilities.

Creator
Mapika
Size
29.6 MB
Stars
1.2K
Updated
CommitOct 20
Age
1mo
Commits · 90 Days
#5619 · +1 · 1d ·GitHub

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Creator
kvcache-ai
Size
72.8 MB
Stars
19.6K
Age
2y
Commits · 90 Days
#7250 · +0 · 1d ·GitHub

ChatGLM3 开源模型旨在与开源社区一起推动大模型技术发展,恳请开发者和大家遵守 开源协议 ,勿将开源模型和代码及基于开源项目产生的衍生物用于任何可能给国家和社会带来危害的用途以及用于任何未经过安全评估和备案的服务。目前,本项目团队未基于 ChatGLM3 开源模型开发任何应用,包括网页端、安卓、苹果 iOS 及 Windows App 等应用。

Creator
zai-org
Size
17.7 MB
Stars
13.6K
Updated
CommitJan 13
Age
2y
Commits · 90 Days
#8683 · +0 · 1d ·GitHub

A lightweight, polished AI-assisted interactive annotation tool for object detection and instance segmentation.

Creator
Parker-Lyu
Size
7.3 MB
Stars
109
Age
1mo
Commits · 90 Days