Topics / #vllm

Vllm projects on GitHub

High-throughput engine for serving large language models

As of , the most-starred Vllm projects on GitHub are claw-code (194.9K stars), DeepSeek-V3 (104.5K stars) and DeepSeek-R1 (91.9K stars). GitHub.Locker tracks 125 Vllm repositories with 1.8M stars combined. The fastest-growing on October 17 was pentagi, with +180 stars in a day.

125Projects
1.8MStars in total
+1.4KStars in a day
Browse in the catalog →github.com/topics/vllm ↗

Hot right now

Most stars gained in a day · Oct 17

+180

pentagi

vxcontrol/pentagi · ★ 30.9K

PentAGI (Penetration testing Artificial General Intelligence) is a fully autonomous AI agent system that performs complex penetration testing tasks for you.

+143

solo_jev

0814wdwd/solo_jev · ★ 810

SOLO reorders the rows and fields of a dataset so an LLM decision backend with prefix caching can reuse computation across requests, running a natural-language decision over every row while returning results in the original row order.

+86

StartLux-Decision

StartLuxLabs/StartLux-Decision · ★ 727

StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

+84

Unlimited-OCR

baidu/Unlimited-OCR · ★ 27.8K

It's an open-source OCR model from Baidu built for one-shot parsing of long documents — the team positions it as pushing Deepseek-OCR one step further, with an arXiv paper backing the approach.

The all-time top

Top 100 of 125 · by stars

  1. #1 · ultraworkers/claw-code

    claw-code

    Claw Code is the public Rust implementation of 'claw', a CLI coding-agent harness. By its own README it is less a production tool and more an 'agent-managed museum exhibit' maintained entirely by AI agents/harnesses with no human intervention, in the spirit of (but unaffiliated with) Claude Code.

    194.9K
  2. #2 · deepseek-ai/DeepSeek-V3

    DeepSeek-V3

    DeepSeek-V3 is an open-weight Mixture-of-Experts (MoE) language model with 671B total parameters but only 37B activated per token, built for efficient yet high-performing inference and matching leading closed-source models on many benchmarks.

    104.5K
  3. #3 · deepseek-ai/DeepSeek-R1

    DeepSeek-R1

    DeepSeek-R1 is an open-source family of reasoning-focused large language models from DeepSeek, trained with large-scale reinforcement learning to handle math, code, and general reasoning at a level comparable to OpenAI's o1.

    91.9K
  1. 4

    unsloth

    78.2Kunslothai/unsloth · Python

    Unsloth is a local-first app for running and training LLMs, diffusion, TTS and embedding models on your own machine, including models like Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4 and FLUX.

  2. 5

    minimind

    63.9Kjingyaogong/minimind · Python

    MiniMind is an open-source project that lets you train a tiny large language model (around 64M parameters) completely from scratch, in about 2 hours on a single RTX 3090 for roughly the cost of 3 RMB in GPU rental.

  3. 6

    VibeVoice

    54.9Kmicrosoft/VibeVoice · Python

    VibeVoice is Microsoft's family of open-source voice AI models covering text-to-speech and speech recognition: long-form multi-speaker TTS, real-time streaming TTS, and ASR built for hour-long recordings.

  4. 7

    LocalAI

    49.6Kmudler/LocalAI · Go

    LocalAI is an open-source, self-hosted AI engine that lets you run LLMs, vision, voice, image and video models on your own hardware, including CPU-only setups, through an OpenAI/Anthropic/ElevenLabs-compatible API.

  5. 8

    Codewhale

    41.1Kcodewhale-hq/Codewhale · Rust

    Codewhale is an open-source coding agent that runs in your terminal: it reads your project, edits files, runs shell commands, and checks its own work, using whichever hosted or local model you pick.

  6. 9

    marker

    40.5Kdatalab-to/marker · Python

    Marker is a document conversion tool that turns PDFs (and other document types) into markdown, JSON, HTML, or chunked output quickly and accurately, extracting tables, equations, forms, and images along the way.

  7. 10

    ChatTTS

    39.9K2noise/ChatTTS · Python

    ChatTTS is an open-source text-to-speech model built for conversational speech — the natural-sounding voice layer for things like LLM assistants — speaking English and Chinese.

  8. 11

    FastChat

    39.5Klm-sys/FastChat · Python

    FastChat is an open platform for training, serving, and evaluating large language model based chatbots. It is the release repo for Vicuna and powers Chatbot Arena (lmarena.ai), which has served over 10 million chat requests for 70+ LLMs.

  9. 12

    VoxCPM

    39.5KOpenBMB/VoxCPM · Python

    VoxCPM is a tokenizer-free Text-to-Speech system that directly generates continuous speech representations through an end-to-end diffusion autoregressive architecture, skipping discrete tokenization for more natural, expressive speech. VoxCPM2 is the latest 2B-parameter release trained on 2M+ hours of multilingual audio.

  10. 13

    self-llm

    32.5Kdatawhalechina/self-llm · Jupyter Notebook

    Self-llm is a Chinese-language tutorial collection that teaches beginners how to configure environments, deploy, and fine-tune (full-parameter or LoRA) 50+ open-source large language models and multimodal models on Linux.

  11. 14

    pentagi

    30.9Kvxcontrol/pentagi · Go

    PentAGI (Penetration testing Artificial General Intelligence) is a fully autonomous AI agent system that performs complex penetration testing tasks for you.

  12. 15

    sim

    29.8Ksimstudioai/sim · TypeScript

    Sim is a collaborative workspace for building, deploying, and monitoring AI agents and workflows, used by 100,000+ builders. Agents can be built visually, in chat, or with code.

  13. 16

    Unlimited-OCR

    27.8Kbaidu/Unlimited-OCR · Python

    It's an open-source OCR model from Baidu built for one-shot parsing of long documents — the team positions it as pushing Deepseek-OCR one step further, with an arXiv paper backing the approach.

  14. 17

    Qwen3

    27.7KQwenLM/Qwen3 · Python

    Qwen3 is a series of open-weight large language models built by the Qwen team at Alibaba Cloud, released as both dense and Mixture-of-Experts (MoE) models from 0.6B up to 235B-A22B parameters, with switchable 'thinking' and 'non-thinking' reasoning modes.

  15. 18

    MiniCPM-V

    26.9KOpenBMB/MiniCPM-V · Python

    A family of pocket-sized multimodal AI models from OpenBMB (MiniCPM-V and MiniCPM-o) built to run on local devices, even phones — understanding images, video and text, and in the o-series also speech.

  16. 19

    open-r1

    26.5Khuggingface/open-r1 · Python

    Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.

  17. 20

    Open-AutoGLM

    26.4Kzai-org/Open-AutoGLM · Python

    Open-AutoGLM (Phone Agent) is an open phone-use agent framework built on the AutoGLM model that understands your phone screen visually and automates tasks via natural-language commands like 'open Xiaohongshu and search for food'.

  18. 21

    llm-action

    25.2Kliguodongiot/llm-action · HTML

    It is a Chinese-language hub of in-depth tutorials on large language model engineering: training, fine-tuning, distributed training, inference, compression, evaluation, data engineering, LLMOps and AI infrastructure, organized as a big index linking the author's article series, many with companion code.

  19. 22

    DeepSeek-Coder

    24.3Kdeepseek-ai/DeepSeek-Coder · Python

    DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

  20. 23

    CosyVoice

    24KQwenAudio/CosyVoice · Python

    CosyVoice is Alibaba's open-source, LLM-based text-to-speech system. It generates natural speech in 9 languages plus 18+ Chinese dialects, supports zero-shot voice cloning, and ships inference, training and deployment code.

  21. 24

    DeepSeek-OCR

    24Kdeepseek-ai/DeepSeek-OCR · Python

    DeepSeek-OCR is a vision-language model built to explore 'contexts optical compression' -- squeezing text-heavy document images into a small number of vision tokens that an LLM can still read back accurately, as a research probe into how much text a vision encoder can represent visually.

  22. 25

    verl

    23.9Kverl-project/verl · Python

    verl is a flexible, efficient and production-ready reinforcement learning training library for LLMs, initiated by ByteDance's Seed team and maintained by the community. It is the open-source version of the HybridFlow paper (EuroSys 2025).

  23. 26

    pangolin

    23.1Kfosrl/pangolin · TypeScript

    Pangolin is an open-source SASE (Secure Access Service Edge) platform built on WireGuard that unifies a zero-trust VPN, reverse proxy, privileged access management, and an identity-aware AI gateway under one identity and policy model.

  24. 27

    surya

    21.5Kdatalab-to/surya · Python

    Surya is Datalab's open-source document OCR system built around a 650M parameter model. It reads text from images and PDFs, and also does layout analysis, reading order, and table recognition.

  25. 28

    FunASR

    20.7Kmodelscope/FunASR · Python

    FunASR is an open-source industrial speech recognition toolkit covering ASR, VAD, punctuation, speaker diarization, and emotion/audio-event models, deployable offline, in streaming mode, on edge devices, or behind an OpenAI-compatible API.

  26. 29

    gpt-oss

    20.5Kopenai/gpt-oss · Python

    The gpt-oss series: two open-weight language models from OpenAI — gpt-oss-120b and gpt-oss-20b — built for powerful reasoning, agentic tasks, and versatile developer use cases. The repo itself adds reference implementations, tools, and example clients around the models.

  27. 30

    DB-GPT

    20.2Keosphoros-ai/DB-GPT · Python

    An open-source agentic AI data assistant: connect databases, files or knowledge bases, ask questions in plain language, and the AI writes SQL and code, runs the analysis, and produces charts, dashboards and reports.

  28. 31

    olmocr

    19.8Kallenai/olmocr · Python

    olmOCR is a toolkit that converts PDFs, PNGs, and JPEGs into clean Markdown or plain text with natural reading order, preserving equations, tables, and handwriting - built primarily to produce training datasets for LLMs.

  29. 32

    agent-lightning

    18.7Kmicrosoft/agent-lightning · Python

    Agent Lightning is an open-source reinforcement-learning training framework from Microsoft that lets you train any existing AI agent with RL, with almost zero changes to the agent's own code.

  30. 33

    llama-cookbook

    18.6Kmeta-llama/llama-cookbook · Jupyter Notebook

    The Llama Cookbook — Meta's official collection of recipes for building with the Llama model family: inference, fine-tuning, RAG and end-to-end use cases, mostly written as Jupyter notebooks.

  31. 34

    Qwen-Agent

    17.2KQwenLM/Qwen-Agent · Python

    Qwen-Agent is a framework for building LLM applications on top of Qwen models, using their instruction following, tool use, planning and memory capabilities. It ships with example apps such as a Browser Assistant and Code Interpreter, and it is the backend that powers Qwen Chat.

  32. 35

    Qwen3-Coder

    16.8KQwenLM/Qwen3-Coder · Python

    Qwen3-Coder is the code-focused branch of the Qwen3 large language model family from the Qwen team — open-weight models built for coding and agentic tasks, available in several sizes.

  33. 36

    docker-android

    16Kbudtmo/docker-android · Python

    Docker-Android is a Docker image that ships a complete Android emulator in a container, built for Android app development and testing — native, web and hybrid apps.

  34. 37

    nano-vllm

    16KGeeeekExplorer/nano-vllm · Python

    Nano-vLLM is a lightweight, from-scratch reimplementation of the vLLM inference engine for running large language models, built in roughly 1,200 lines of readable Python.

  35. 38

    ms-swift

    15.9Kmodelscope/ms-swift · Python

    ms-swift is the ModelScope community's fine-tuning and deployment framework for LLMs and multimodal models, covering training, inference, evaluation, quantization and deployment in one pipeline.

  36. 39

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

  37. 40

    lm-evaluation-harness

    14.3KEleutherAI/lm-evaluation-harness · Python

    It is a unified framework for few-shot evaluation of language models across a huge number of standard academic benchmarks.

  38. 41

    Qwen3-TTS

    13.8KQwenLM/Qwen3-TTS · Python

    Qwen3-TTS is an open-source text-to-speech model series from Alibaba's Qwen team that generates stable, expressive speech, supports voice design from text descriptions, and can clone voices from a short audio sample.

  39. 42

    AI-Research-SKILLs

    13.6KOrchestra-Research/AI-Research-SKILLs · TeX

    It's an open-source library of 98 AI research and engineering skills that turn a Claude Code, Codex, or Gemini CLI agent into a full AI research agent, covering everything from idea generation to paper writing.

  40. 43

    speech-to-speech

    13.5Khuggingface/speech-to-speech · Python

    It's a low-latency, fully modular voice-agent pipeline (VAD -> STT -> LLM -> TTS) for building voice agents with open-source speech and language models, exposed over WebSocket and WebRTC via the OpenAI Realtime API event set.

  41. 44

    Halfrost-Field

    13.2Khalfrost/Halfrost-Field · Go

    Halfrost-Field is a personal technical blog archive by halfrost containing long-form deep-dive articles on source code analysis, system design, and engineering topics such as Go internals, vLLM/LLM serving, machine learning notes, and network protocols.

  42. 45

    PaddleFormers

    13KPaddlePaddle/PaddleFormers · Python

    PaddleFormers is a Transformers-style library built on Baidu's PaddlePaddle deep learning framework, giving the PaddlePaddle ecosystem the same kind of model interface and training workflow as Hugging Face Transformers, with full training support for 100+ LLMs and vision-language models.

  43. 46

    Agent-S

    12.6Ksimular-ai/Agent-S · Python

    Agent S is an open-source agent framework that controls a real desktop GUI - clicking, typing, and scrolling - to complete natural-language tasks the way a human would, without per-app API integrations.

  44. 47

    chandra

    12.5Kdatalab-to/chandra · Python

    Chandra OCR 2 is a state-of-the-art OCR model that converts images and PDFs into structured HTML, Markdown, or JSON while preserving the original layout. It handles complex tables, forms, handwriting, and math, and supports over 90 languages.

  45. 48

    LMCache

    12.1KLMCache/LMCache · Python

    LMCache is a KV cache management layer for LLM inference that turns the KV cache from a temporary, per-process state into reusable, persistent 'AI-native knowledge' that can be shared across serving engines, reducing time-to-first-token and boosting throughput for long-context, multi-turn, and RAG workloads.

  46. 49

    cosmos

    12.1KNVIDIA/cosmos · Jupyter Notebook

    NVIDIA Cosmos is an open platform of world models, datasets, and tools for building Physical AI — systems that understand and generate the physical world for robots, autonomous vehicles, and smart infrastructure.

  47. 50

    h2ogpt

    11.9Kh2oai/h2ogpt · Python

    h2oGPT is an open-source private chat application that lets you query and summarize your own documents or just chat with local LLMs, with no data leaving your machine.

  48. 51

    G0DM0D3

    11.8Kelder-plinius/G0DM0D3 · TypeScript

    G0DM0D3 is an open-source, privacy-transparent multi-model chat interface built to push past standard AI guardrails for red teaming, cognition research, and jailbreak experimentation.

  49. 52

    MiniCPM

    11.6KOpenBMB/MiniCPM · Jupyter Notebook

    MiniCPM is OpenBMB's family of small, open-source LLMs built for on-device and resource-constrained use. The newest release, MiniCPM5-2B, is a dense 2B-parameter model that reaches open-source state-of-the-art for its size class while staying competitive with much larger 4B-class models.

  50. 53

    WhisperLiveKit

    11.2KQuentinFuxa/WhisperLiveKit · Python

    WhisperLiveKit is a self-hosted pipeline for real-time, local speech-to-text with streaming ASR, speaker diarization, live translation, and OpenAI/Deepgram-compatible APIs.

  51. 54

    mistral-inference

    10.8Kmistralai/mistral-inference · Jupyter Notebook

    The official inference code for Mistral AI's open-weight models: minimal Python and CLI tooling to run models like Mixtral, Codestral, Pixtral and Mistral Large locally.

  52. 55

    ml-intern

    10.8Khuggingface/ml-intern · Python

    ML Intern was a CLI agent that autonomously researched, wrote, and shipped ML code using the Hugging Face ecosystem, with deep access to docs, papers, datasets, and cloud compute. The repo is now archived — Hugging Face folded this functionality into HuggingChat's ML Intern mode.

  53. 56

    ART

    10.8KOpenPipe/ART · Python

    ART (Agent Reinforcement Trainer) is an open-source RL framework from OpenPipe that lets LLM agents learn from experience: you train multi-step agents for real-world tasks with GRPO.

  54. 57

    reef

    7.6KHuman-Agent-Society/reef · Python

    Reef is open-source infrastructure for continually self-improving agents. It wires together agent inference, feedback collection, learning, and versioned delivery so an agent keeps getting better from how you interact with it.

  55. 58

    GLM-OCR

    7.5Kzai-org/GLM-OCR · Python

    GLM-OCR is a multimodal OCR model for complex document understanding, built on a GLM-V encoder-decoder architecture with a lightweight SDK and inference toolchain around it.

  56. 59

    GLM-5

    7.4Kzai-org/GLM-5

    GLM-5 is a family of large open-weight language models from Z.ai built for agentic engineering and complex, long-horizon coding tasks, scaling up to 744B parameters with sparse attention for efficient long-context serving.

  57. 60

    vllm-omni

    7.2Kvllm-project/vllm-omni · Python

    vLLM-Omni is an inference and serving framework that extends vLLM beyond text-only LLMs to omni-modality models, handling text, image, audio, video, and action outputs.

  58. 61

    turboquant_plus

    7KTheTom/turboquant_plus · Python

    TurboQuant+ is the research home for TurboQuant (ICLR 2026), a KV cache compression method for transformer LLMs. It shrinks the KV cache 3.8-6.4x using PolarQuant plus Walsh-Hadamard rotation, and this repo holds the Python reference implementation, validation papers and benchmark data.

  59. 62

    lectures

    6.9Kgpu-mode/lectures · Jupyter Notebook

    This is the supplementary material repository for the GPU MODE lectures YouTube channel — a growing collection of notebooks, slides and code from each numbered lecture on GPU and CUDA programming.

  60. 63

    hermes-workspace

    6.7Koutsourc-e/hermes-workspace · JavaScript

    Hermes Workspace is the web command center for a Hermes Agent: a single interface for chat, files, memory, skills, MCP, terminal, and a live multi-agent dashboard, instead of a bare chat window.

  61. 64

    T3MP3ST

    6.6Kelder-plinius/T3MP3ST · TypeScript

    T3MP3ST is a multi-agent offensive-security framework that turns an AI coding agent you already use into an autonomous red-teaming operator. Point it at an authorized target and it runs the kill chain — recon, exploit, report — from a browser 'War Room' or the CLI.

  62. 65

    fara

    6.2Kmicrosoft/fara · Python

    A family of open computer-use agent models — Fara1.5-4B, 9B and 27B, built on Qwen3.5 — that perform multi-step web tasks for you by controlling the mouse and keyboard like a human would.

  63. 66

    dflash

    6.2Kz-lab/dflash · Python

    DFlash is a lightweight block diffusion model built for speculative decoding, drafting tokens in parallel blocks so a larger target LLM can verify them faster than generating one token at a time.

  64. 67

    rlm

    5.7Kalexzhang13/rlm · Python

    RLM is an inference library implementing Recursive Language Models, a paradigm where an LLM offloads its context into a REPL environment and recursively calls itself (or sub-LLMs) to examine, decompose, and reason over near-infinite-length inputs.

  65. 68

    ai-agents-from-zero

    5.4Kdidilili/ai-agents-from-zero · Python

    This is a comprehensive, long-term-maintained AI Agent / LLM application development tutorial in Chinese, covering everything from basic concepts to enterprise-grade deployment, with runnable projects and an interview question bank.

  66. 69

    Model-Optimizer

    5.4KNVIDIA/Model-Optimizer · Python

    NVIDIA Model Optimizer (ModelOpt) is a Python library that bundles state-of-the-art model-compression techniques - quantization, pruning, neural architecture search, distillation, speculative decoding and sparsity - to shrink and speed up deep learning models before deployment.

  67. 70

    DeepAnalyze

    4.7Kruc-datalab/DeepAnalyze · Python

    DeepAnalyze is an open-source agentic large language model built for fully autonomous data science: it can handle data preparation, analysis, modeling, visualization, and report generation on its own, across structured, semi-structured, and unstructured data sources.

  68. 71

    Qwen3.8

    4.3KQwenLM/Qwen3.8

    Qwen3.8 is the latest open large language model release from Alibaba's Qwen team, part of the Qwen3.5 series that also includes Qwen3.5 and Qwen3.6, aimed at coding, professional work, research, and long-horizon agentic tasks.

  69. 72

    MOSS-TTS

    4.2KOpenMOSS/MOSS-TTS · Python

    MOSS-TTS Family is an open-source speech and sound generation model family from OpenMOSS, covering long-form narration, multi-speaker dialogue, voice design, sound effects, and real-time streaming text-to-speech.

  70. 73

    InfraTech

    4.2KCalvinXKY/InfraTech · Jupyter Notebook

    InfraTech is a collection of Jupyter notebooks and articles sharing AI Infra knowledge: training/inference frameworks (PyTorch, vLLM/SGLang, slime/vime), performance acceleration, deep learning fundamentals and AI hardware/software basics.

  71. 74

    Hyper-Extract

    4.2Kyifanfeng97/Hyper-Extract · Python

    Hyper-Extract is a CLI tool that turns unstructured documents (PDFs, Word, text, etc.) into structured knowledge — chunk corpora, lists, graphs, hypergraphs, and spatio-temporal graphs — using LLMs, all from a single command.

  72. 75

    Qwen3-Omni

    4.1KQwenLM/Qwen3-Omni · Jupyter Notebook

    Qwen3-Omni is a family of open, natively end-to-end omni-modal LLMs from Alibaba's Qwen team: they take text, images, audio and video as input and stream back answers as text or natural speech in real time.

  73. 76

    cascadeflow

    3.9Klemony-ai/cascadeflow · Python

    An open-source in-process intelligence layer (cascading runtime) for AI agents: it sits inside the agent execution loop and optimizes every model call for cost, latency, quality, budget, compliance, and energy.

  74. 77

    Qwen3-ASR

    3.7KQwenLM/Qwen3-ASR · Python

    Qwen3-ASR is Alibaba's open-source family of speech recognition models: two all-in-one models (0.6B and 1.7B) that do language identification and transcription for 52 languages and dialects, plus a separate forced-alignment model that produces word-level timestamps.

  75. 78

    SoulX-Podcast

    3.6KSoul-AILab/SoulX-Podcast · Python

    SoulX-Podcast is an inference codebase that generates realistic, long-form, multi-speaker podcast-style dialogue from text, including paralinguistic effects and several Chinese dialects.

  76. 79

    HyperQwen

    2.1Ksyv-ai/HyperQwen · Python

    HyperQwen is a self-hosted serving setup that runs the Qwen3.8-27B model on a single 24 GB consumer GPU (like an RTX 3090) using vLLM, exposing it through an OpenAI-compatible API.

  77. 80

    WeMM-Embedding

    1.8KTencent/WeMM-Embedding · Python

    WeMM-Embedding is a family of multimodal embedding models (2B, 4B, 9B) built by the WeChat Vision Team at Tencent that produce unified embeddings for text, images, videos, visual documents, and interleaved multimodal inputs for search and retrieval tasks.

  78. 81

    ai-engineering-interview-questions-company-wise

    1.8Kpallavi-shekhar/ai-engineering-interview-questions-company-wise · Markdown

    A free, continuously updated cheat sheet of real interview questions asked in AI Engineering interviews at 35 companies (Anthropic, OpenAI, Google DeepMind, Meta, NVIDIA, Databricks and more), organized company by company with answers linked wherever available.

  79. 82

    NeoHorse

    1.7KTokenRhythm/NeoHorse · Python

    NeoHorse is TokenRhythm's family of open-weight language models built for agent workflows, with the 4B and 9B NeoHorse-1 checkpoints handling tool use, coding, and instruction following, plus a companion decision model called NeoHorse-Jev.

  80. 83

    Index-Translate

    1.7Kbilibili/Index-Translate · Python

    Index-Translate is a family of multilingual translation models built on Qwen3.5, covering text translation across 150 languages plus speech, syllable-controlled, and full-document translation variants.

  81. 84

    turnstone

    1.6Kturnstonelabs/turnstone · Python

    Turnstone is a self-hosted, local-first orchestration framework that gives LLMs real tools — shell, files, search, web, planning — and runs multi-turn agent conversations across your own cluster.

  82. 85

    AnyJev

    1.4Knokia-applied-research/AnyJev · Python

    A Python library that turns any open LLM into a Jev-style decision model: ask a typed question, get back a choice with a probability you can threshold — no generation, no parsing, no fine-tuning.

  83. 86

    Hy-MT2

    1.3KTencent-Hunyuan/Hy-MT2 · Python

    Hy-MT2 is Tencent Hunyuan's family of 'fast-thinking' multilingual translation models, released in three sizes (1.8B, 7B, and 30B-A3B MoE), that translate among 33 languages and follow complex translation instructions.

  84. 87

    openharness

    1.3Kautonomous-ai/openharness · TypeScript

    A command center for AI coding agents: Claude Code, Codex, Cursor, OpenCode and more, side by side across all your machines in one native window. Beyond code it reaches into CAD, circuits, robotics, games and music.

  85. 88

    lift

    1.2Kdatalab-to/lift · Python

    lift is an open-source 9B vision-language model and toolkit that extracts structured JSON data from PDFs and images by matching a schema you provide, using schema-constrained decoding to guarantee valid output.

  86. 89

    decider

    1.2KMapika/decider · Python

    Decider is a family of language models fine-tuned from Qwen3.5 that don't generate text; instead they read a state plus a set of typed questions and return calibrated probability distributions for every question in one forward pass.

  87. 90

    localjev

    827githubnext/localjev · TypeScript

    LocalJev is a local TypeScript/Bun server that implements a Jev-compatible POST /v1/systemone decision API, backed by the DiffusionGemma model through an OpenAI-compatible Chat Completions endpoint. It lets Jev clients run against a local open model instead of OpenJev's hosted service.

  88. 91

    halo

    825whitecircle/halo · Python

    Halo is an open-source framework from White Circle for training large language and multimodal models: pre-training, SFT, preference optimization, and fully asynchronous multi-turn RL in one codebase, from a single GPU up to multi-node clusters.

  89. 92

    Spark-X2.5

    812XHToken/Spark-X2.5

    Spark-X2.5 is a series of two open-source language models (4B and 1.7B parameters) built for everyday conversation, writing, translation, coding, reasoning and agentic tool-use tasks, aiming for strong performance in a compact size.

  90. 93

    solo_jev

    8100814wdwd/solo_jev · Python

    SOLO reorders the rows and fields of a dataset so an LLM decision backend with prefix caching can reuse computation across requests, running a natural-language decision over every row while returning results in the original row order.

  91. 94

    gufo

    794gufo-org/gufo · C++

    Gufo is a local inference engine built specifically for AMD Strix Halo hardware (Ryzen AI MAX+ 395 with Radeon 8060S / gfx1151, up to 128 GiB unified memory), serving text, speech, image and video models through an OpenAI-compatible API.

  92. 95

    GLM-5.3-Flash-EXL3-2x-DGX-Sparks

    735MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks · Python

    A deployment recipe and Docker image that serves the GLM-5.3-Flash model as an OpenAI-compatible vLLM endpoint across 2-4 NVIDIA DGX Spark (GB10) kits, using a custom EXL3/TR3 4-bit quantization of the weights.

  93. 96

    StartLux-Decision

    727StartLuxLabs/StartLux-Decision · Python

    StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

  94. 97

    LightNav-0

    722lightorigins/LightNav-0 · Python

    LightNav-0 is a compact generalist embodied navigation model that gives humanoid, quadruped, wheeled and aerial robots the ability to follow language instructions and navigate autonomously in unseen environments, without any teleoperation.

  95. 98

    verl

    718XiaomiMiMo/verl · Python

    verl is an open-source RL post-training framework for large language models, started by ByteDance Seed as the open-source version of the HybridFlow paper. This XiaomiMiMo fork adds agentic RL training code for MiMo, with reproduction code for five RL environments on top of verl 0.9.0.dev.

  96. 99

    ai-engineer-notebooks

    703calmrocks/ai-engineer-notebooks · Jupyter Notebook

    A collection of framework-free, hands-on Jupyter/Colab notebooks teaching the applied-LLM engineer skill set — model APIs, RAG, evals, agents, fine-tuning, security, and LLMOps — built for engineers moving into AI Engineer / Forward Deployed Engineer (FDE) roles.

  97. 100

    deepseek-harness-studio

    686fufankeji/deepseek-harness-studio · TypeScript

    DeepSeek Harness Studio is a zero-code Electron desktop app that wraps DeepSeek Harness, adding a plugin marketplace, AI-driven plugin recommendations, a Preset marketplace of ready-made agent workflows, and visual/theme enhancements on top of the core Harness engine.

Showing the 100 most-starred of 125. See every one in the catalog.

Often tagged together