Topics / #local-ai

Local AI projects on GitHub

Running AI models and assistants locally on your own hardware.

As of , the most-starred Local AI projects on GitHub are ollama (183.5K stars), stable-diffusion-webui (165.1K stars) and anything-llm (67.2K stars). GitHub.Locker tracks 63 Local AI repositories with 914.8K stars combined. The fastest-growing on October 16 was Strata, with +718 stars in a day.

63Projects
914.8KStars in total
+2.2KStars in a day
Browse in the catalog →github.com/topics/local-ai ↗

Hot right now

Most stars gained in a day · Oct 16

+718

Strata

Niko1221/Strata · ★ 26.4K

Strata runs Qwen3.8-Flash-Next, a 125-billion-parameter AI model, on a normal gaming PC with one NVIDIA GPU (12-24GB VRAM) and 64GB of RAM, with a one-click installer for Windows and Linux.

+169

ollama

ollama/ollama · ★ 183.5K

Ollama is a tool for downloading and running open large language models like DeepSeek, Qwen, Gemma, Llama, Mistral and gpt-oss on your own machine, with a simple CLI and a local REST API.

+150

StartLux-Decision

StartLuxLabs/StartLux-Decision · ★ 552

StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

+135

magnitude

magnitudedev/magnitude · ★ 7K

Magnitude is an open source inference server that profiles your machine, recommends local models that fit it, then downloads, tunes, and runs them for your coding agent.

The all-time top

63 projects · by stars

  1. #1 · ollama/ollama

    ollama

    Ollama is a tool for downloading and running open large language models like DeepSeek, Qwen, Gemma, Llama, Mistral and gpt-oss on your own machine, with a simple CLI and a local REST API.

    183.5K
  2. #2 · AUTOMATIC1111/stable-diffusion-webui

    stable-diffusion-webui

    A browser-based interface for Stable Diffusion, built with the Gradio library, letting you generate and edit AI images (txt2img, img2img, inpainting, outpainting and more) on your own machine.

    165.1K
  3. #3 · Mintplex-Labs/anything-llm

    anything-llm

    AnythingLLM is an all-in-one, self-hosted AI application that lets you chat with your documents, run AI agents, and build a private ChatGPT-like experience using local or cloud LLMs.

    67.2K
  1. 4

    exo

    47.9Kexo-explore/exo · Python

    exo turns a group of your own devices (Macs, Linux boxes) into a single AI cluster so you can run large AI models that would never fit on one machine, pooling their memory and compute together.

  2. 5

    textgen

    47.7Koobabooga/textgen · Python

    TextGen is an open-source desktop app for running local LLMs with text, vision, tool-calling, and an OpenAI/Anthropic-compatible API, built to be 100% private with no telemetry.

  3. 6

    Handy

    34Kcjpais/Handy · Rust

    Handy is a free, open source speech-to-text app: press a keyboard shortcut, speak, and your transcribed words are pasted into whatever app you are typing in. It runs entirely offline on your own computer.

  4. 7

    meetily

    31.8KZackriya-Solutions/meetily · Rust

    A privacy-first AI meeting assistant that captures your meetings, transcribes them in real time, and generates summaries — entirely on your own machine, with no data sent to the cloud.

  5. 8

    Open-Generative-AI

    30.6KAnil-matcha/Open-Generative-AI · JavaScript

    A free, open-source studio for AI image, video, cinema and lip sync generation, positioned as an unrestricted alternative to paid AI video platforms: 400+ models (Flux, Midjourney, Kling, Sora, Veo) across 14 studios, with no content filters.

  6. 9

    InvokeAI

    28.7Kinvoke-ai/InvokeAI · TypeScript

    Invoke is a leading creative engine for Stable Diffusion models: a locally hosted web app for generating and editing images with AI, aimed at professionals, artists, and enthusiasts.

  7. 10

    agenticSeek

    27.5KFosowl/agenticSeek · Python

    AgenticSeek is a fully local, voice-enabled alternative to Manus AI: an autonomous agent that browses the web, writes code and plans tasks while keeping all data on your own hardware.

  8. 11

    Strata

    26.4KNiko1221/Strata · C++

    Strata runs Qwen3.8-Flash-Next, a 125-billion-parameter AI model, on a normal gaming PC with one NVIDIA GPU (12-24GB VRAM) and 64GB of RAM, with a one-click installer for Windows and Linux.

  9. 12

    llamafile

    26.4Kmozilla-ai/llamafile · C++

    llamafile turns open LLMs into single-file executables: one file that runs a chat model locally on most operating systems and CPU architectures, with no installation. It is a Mozilla Builders project, now revamped by Mozilla.ai.

  10. 13

    gallery

    25Kgoogle-ai-edge/gallery · Kotlin

    Google AI Edge Gallery is an app that lets you download and run open-source generative AI models, including the Gemma family, directly on your Android phone, iPhone, or Mac — fully offline.

  11. 14

    omlx

    22.9Kjundot/omlx · Python

    oMLX is a local LLM inference server for Apple Silicon Macs. It serves text LLMs, vision models, OCR, embeddings and rerankers with continuous batching and a tiered KV cache, managed from the macOS menu bar.

  12. 15

    screenpipe

    22Kscreenpipe/screenpipe · Rust

    screenpipe continuously records your screen and audio locally, turning everything you do into a searchable, AI-powered memory that gives agents like Claude or Codex context about your work. It is positioned as a source-available alternative to Rewind, Microsoft Recall and Granola.

  13. 16

    llama-gpt

    10.9Kgetumbrel/llama-gpt · TypeScript

    LlamaGPT is a self-hosted, offline, ChatGPT-like chatbot powered by Llama 2 (and now Code Llama), so you get a familiar chat UI without sending any data to a third-party cloud.

  14. 17

    Whisper

    10.7KConst-me/Whisper · C++

    A Windows port of OpenAI's Whisper speech-recognition model that runs inference on the GPU using DirectCompute instead of CUDA, delivering much faster transcription than the official PyTorch implementation.

  15. 18

    WanGP

    10.6Kdeepbeepmeep/WanGP · Python

    WanGP is a one-stop open source app for running top generative AI models for video, image, and audio/TTS generation, built specifically to work on modest consumer GPUs (the 'GPU Poor').

  16. 19

    Soup

    9.2KMakazhanAlpamys/Soup · Python

    Soup is a command-line tool for fine-tuning and post-training LLMs from a single YAML config file, automating GPU detection, batching and quantization so you just write a config and run one command.

  17. 20

    modly

    8.2Klightningpixel/modly · TypeScript

    Modly is a desktop app that turns a photo (or a text prompt) into a 3D mesh using open source AI models, running entirely on your own GPU with no cloud calls.

  18. 21

    ODS

    7.6KOsmantic/ODS · Python

    ODS (Osmantic Deployment System) turns your PC, Mac, or Linux box into a private AI server by installing and wiring together local LLM inference, a chat UI, agents, voice, RAG, image generation, and privacy tools in one go.

  19. 22

    magnitude

    7Kmagnitudedev/magnitude · Rust

    Magnitude is an open source inference server that profiles your machine, recommends local models that fit it, then downloads, tunes, and runs them for your coding agent.

  20. 23

    laya-mlx

    7Kmizorewww/laya-mlx · Python

    Laya-MLX is a native MLX runtime that runs the open-weight Laya typed decision models locally on Apple Silicon, returning structured answers like a choice, a rubric score, or a probability in milliseconds instead of generating text.

  21. 24

    turbo-fieldfare

    6.9Kdrumih/turbo-fieldfare · Swift

    TurboFieldfare is a custom Swift and Metal runtime that runs the instruction-tuned Gemma 4 26B-A4B model on Apple Silicon Macs using only about 2 GB of RAM, even on 8 GB machines, by streaming only the experts needed for each token from SSD instead of loading the full 14.3 GB model.

  22. 25

    MOSS-TTS-Nano

    4.5KOpenMOSS/MOSS-TTS-Nano · Python

    MOSS-TTS-Nano is an open-source, 100M-parameter multilingual text-to-speech model from MOSI.AI and OpenMOSS that supports voice cloning, 48kHz stereo output, and real-time generation directly on CPU.

  23. 26

    METATRON

    4.2Ksooryathejas/METATRON · Python

    Metatron is a CLI-based AI penetration testing assistant that runs real recon tools against a target and lets a locally-hosted LLM analyze the results, suggest exploits, and recommend fixes, with no cloud or API keys involved.

  24. 27

    DroidDesk

    4.1Korailnoor/DroidDesk · Kotlin

    DroidDesk turns an Android phone into a full Linux desktop using Termux, Termux:X11, TUR, and Proot, letting you run apps like VS Code, Firefox, LibreOffice, Blender, and even Metasploit directly on your phone.

  25. 28

    Rapid-MLX

    4Kraullenchai/Rapid-MLX · Python

    Rapid-MLX is a local LLM inference server for Apple Silicon Macs, built on MLX, that exposes OpenAI- and Anthropic-compatible APIs and focuses on reliable tool calling for coding agents like Claude Code and Codex CLI.

  26. 29

    lap

    3.9Kjulyx10/lap · Vue

    Lap is an open-source, local-first photo manager for macOS, Windows, and Linux that lets you browse family albums, find old photos quickly, and organize large personal media libraries entirely offline.

  27. 30

    atomic-agent

    3.4KAtomicBot-ai/atomic-agent · TypeScript

    Atomic Agent is a local-first AI agent that runs the full control loop and all its state on your own machine, using open-weight models through llama.cpp or cloud models. It can browse the web, edit files, run approved shell commands, inspect documents, and remember context across sessions.

  28. 31

    locally-uncensored

    2.3KPurpleDoubleD/locally-uncensored · TypeScript

    This is an all-in-one local AI studio for your desktop that bundles chat, image and video generation, and a coding agent into a single free, open-source app for Windows and Linux.

  29. 32

    FreeVideo

    2KFlashML-org/FreeVideo · Python

    FreeVideo is a local inference engine that lets you run the MiniMax H3 video generation model on your own consumer GPU instead of a cloud service, adapting its memory and compute strategy to your hardware.

  30. 33

    mlx-serve

    2Kddalcu/mlx-serve · Zig

    mlx-serve is a native local inference server for Apple Silicon Macs that runs MLX and GGUF language models and exposes OpenAI-, Anthropic-, and Ollama-compatible APIs, plus generates images, video, music, speech, and 3D models, all without Python or a cloud connection.

  31. 34

    laya-coreml

    1.6Kmizorewww/laya-coreml · Python

    It's an open-weight Python port of Laya that answers typed questions — pick an option, an ordinal score, or yes/no — locally on Apple Silicon through Core ML and the Neural Engine, generating zero text tokens.

  32. 35

    yovoice

    1.6Kleemysw/yovoice · TypeScript

    yovoice is an open-source desktop app for macOS and Windows that turns text into natural, expressive speech locally, with voice cloning and emotion control, and no cloud API calls or per-character fees.

  33. 36

    jeff

    1.5Kfirelex/jeff · Python

    Jeff is a family of small (0.8B-2B parameter) open-weight models fine-tuned from Qwen3.5 and Gemma 4 that act as fast 'System 1' decision-makers: you describe a situation and a list of options in plain text, and Jeff returns a calibrated probability for each option from a single forward pass, with no generated text to parse.

  34. 37

    starnet

    1.5KandrooAGI/starnet · JavaScript

    StarNet is a local-first desktop harness where you create AI agents, arrange them into a pixel-art space station, and watch them actually perform work with real models and tools — the layout is a live projection of the harness's real runtime state, not decoration.

  35. 38

    jev

    1.3Kfeder-cr/jev · C++

    jevos-1b is a free, open-source yes/no decision engine that runs locally on your laptop's CPU, returning the probability that the answer is 'yes' for a given text plus question in about 50-220 ms, as a self-hosted alternative to the cloud-based Jev service.

  36. 39

    parrot

    1.3Khumanitas-labs/parrot · Swift

    Parrot is on-device dictation for macOS: hold the fn key, speak, release, and your words appear at the cursor as text.

  37. 40

    EchoMuse

    1.3Kwilbowes/EchoMuse · Python

    It turns a second-hand Amazon Echo Dot (2nd gen, 2016) into a local voice satellite for Home Assistant: say the wake word, ask, and hear the answer from the Dot. No Amazon account, no Alexa, no cloud - the microphones, speaker, LED ring and buttons keep working.

  38. 41

    project-maya

    954mw00/project-maya · C++

    Project Maya lets you run GLM-5.3-Flash, a 321-billion-parameter mixture-of-experts AI model, on your own NVIDIA GPU(s) by streaming the model's experts across VRAM, RAM and NVMe SSD as the conversation needs them.

  39. 42

    deltafin

    849gavamedia/deltafin · Rust

    Deltafin is a native Rust binary that runs the full, unpruned 2.8-trillion-parameter Kimi K3 model on a single consumer machine, keeping all 16 experts active, plus an OpenAI-compatible API server for local chat and coding agents.

  40. 43

    souchastnik

    725MShverdiakov/souchastnik · Kotlin

    An Android app (Souchastnik) that tells you what criminal charge you might face in Russia for something you wrote online, and flags mentions of 'foreign agents' or banned social networks.

  41. 44

    nomily-app

    704Nomily-Ai/nomily-app

    Nomily AI is a BYOK (bring-your-own-key) voice recording companion for the V05E BLE recorder, iPhone, and Apple Watch, offering ASR transcription, speaker diarization, and AI-generated summaries where you choose and pay for your own transcription and LLM providers.

  42. 45

    lipflow

    625amywork777/lipflow · Python

    Lipflow is 'Wispr Flow for your lips' — hold a key, silently mouth what you want to say with no sound and no microphone, and the text appears at your cursor in whatever app you're using. It reads your lips via webcam and runs entirely locally on your Mac.

  43. 46

    dsh-image-gen

    619shanliuling/dsh-image-gen · TypeScript

    dsh-image-gen is the native AI image creation plugin for DeepSeek Harness (DSH). It brings chat-based image generation and editing, a batch Studio, multi-model comparison, a library of 500+ prompts, a gallery manager, and local ComfyUI workflows directly into DSH conversations.

  44. 47

    Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install

    587MiaAI-Lab/Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install · Python

    A one-click installer and serving kit for running Qwen3.8-27B locally on a single consumer NVIDIA GPU (12-32+ GB VRAM), on Windows or Linux.

  45. 48

    StartLux-Decision

    552StartLuxLabs/StartLux-Decision · Python

    StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

  46. 49

    SCM

    486allenv0/SCM · TypeScript

    SCM (Screen Memories) is a macOS desktop app that runs deep AI search locally over every photo and every video frame in a chosen folder, letting you search by meaning, on-screen text, or spoken dialogue, all without the cloud.

  47. 50

    slotstream

    474carloslfu/slotstream · Swift

    Slotstream lets you run a 105 GB AI model (Qwen3.8-Flash-Next, a 125B-parameter mixture-of-experts model) on Macs with only 16 to 64 GB of RAM, by streaming most of the model from SSD and caching the busiest experts in memory.

  48. 51

    Qwen3.8-27B-SGLang-DGX-Spark

    474MiaAI-Lab/Qwen3.8-27B-SGLang-DGX-Spark · Shell

    A set of opinionated, ready-to-run Docker scripts that serve the Qwen3.8-27B model through SGLang on an NVIDIA DGX Spark (GB10, aarch64), offering three swap-in speculative-decoding modes — EAGLE/MTP, DSpark, and DFlash2 — each tuned with on-device measurements rather than guesses.

  49. 52

    qiaomu-clipper

    352joeseesun/qiaomu-clipper · TypeScript

    Qiaomu Clipper is a Chrome extension that clips articles and videos into Obsidian, then lets you read, edit, highlight, and chat with AI about the saved content, including a synced player-plus-transcript view for YouTube and Bilibili videos.

  50. 53

    wechat-ai-memory

    346ikevss/wechat-ai-memory

    A local-first Windows app that reads your WeChat 4.x chats directly, lets you filter them by conversation, date range and keyword, and exports the result as PDF, Markdown and structured JSON to build a personal, traceable chat memory archive.

  51. 54

    PocketMen-with-you

    311six-nut/PocketMen-with-you · Python

    PocketMen with You turns 2+ of your photos into a high-fidelity, animated 'Codex companion' pet that runs entirely locally using open-weight image models instead of OpenAI's API.

  52. 55

    WechatVibe

    268tswawa/WechatVibe · Python

    WechatVibe is a Windows desktop app that read-only analyzes your logged-in WeChat chats to tag emotion and intent, and generates personality profiles, group profiles, affinity scores, and MBTI chat inference, using either a local Laya ONNX model or an API-based LLM.

  53. 56

    VideoHighlighter

    212Aseiel/VideoHighlighter · Python

    A free, open-source desktop app that finds and explains the strong moments in your footage, then exports a highlight reel and clips — an offline alternative to Twelve Labs, Runway and Descript.

  54. 57

    phorminx

    207impossibleG/phorminx · Rust

    Phorminx is a local-first Windows desktop app that turns speech into text for dictation and meeting transcription, with searchable notes and optional local AI formatting instead of a paid cloud AI service.

  55. 58

    vomit

    200zachahn/vomit · Go

    Vomit converts Claude Code's token vomit into English by piping it through a local LLM. It hooks into Claude Code and rewrites its output right inside the Claude Code terminal UI.

  56. 59

    lossless-memory

    144aru-labs/lossless-memory · Python

    A lossless long-term memory layer for a personal AI: every conversation line is kept verbatim with a timestamp, and queries like 'what did we decide last Tuesday night' return the actual lines in order instead of a summary.

  57. 60

    taskuary

    139ldbumble/taskuary · Python

    A personal AI assistant for your job: mail, chats, and tickets become tasks, the coding agents you already use do the work, and nothing goes out until you approve it. It runs locally on your machine.

  58. 61

    Janus

    135Vibra-Ingenn/Janus · Go

    Janus is a single Go binary that runs local .gguf language models on your machine (GPU or CPU) and exposes an OpenAI-compatible API, so you can use local models without Python, Docker, or Ollama.

  59. 62

    cardputer-ai

    118therezor/cardputer-ai · C++

    Cardputer AI is a tiny offline chatbot that runs entirely on the M5Stack Cardputer / Cardputer ADV handheld, powered by an 8-million-parameter language model baked directly into the firmware.

  60. 63

    Bud-Decision-Studio

    110BudEcosystem/Bud-Decision-Studio · HTML

    Bud Decision Studio is a cross-platform desktop app and local serving system for 'decision models' (Jev-like 'System One' models): you give it a situation and typed questions, and it returns a calibrated probability for every allowed answer instead of generated text.

Often tagged together