Topics / #whisper

Whisper projects on GitHub

Open speech-to-text model family and ports

As of , the most-starred Whisper projects on GitHub are whisper (110.8K stars), voicebox (57.9K stars) and whisper.cpp (54.5K stars). GitHub.Locker tracks 64 Whisper repositories with 857.2K stars combined. The fastest-growing on October 17 was Concat, with +630 stars in a day.

64Projects
857.2KStars in total
+1.8KStars in a day
Browse in the catalog →github.com/topics/whisper ↗

Hot right now

Most stars gained in a day · Oct 17

+630

Concat

jub0t/Concat · ★ 8.5K

Concat is a free, open-source, cross-platform video editor built as a CapCut alternative, with no watermark, no account and no subscription.

+141

voicebox

jamiepine/voicebox · ★ 57.9K

Voicebox is an open-source, local-first AI voice studio: it clones voices, generates speech in 23 languages, lets you dictate into any app with a global hotkey, and gives MCP-aware AI agents a voice - all running on your own machine as a free alternative to ElevenLabs and WisprFlow combined.

+90

OpenCreator

krillinai/OpenCreator · ★ 13.6K

OpenCreator (formerly KrillinAI) is an open-source AI workspace for creators that turns scripts into video, images, voice, avatars, translations, and edits, with Agents driving the whole creative process from one workspace.

+89

whisper

openai/whisper · ★ 110.8K

Whisper is a general-purpose speech recognition model trained on a large, diverse dataset with weak supervision. It can perform multilingual transcription, translate speech into English, and identify the spoken language.

The all-time top

64 projects · by stars

  1. #1 · openai/whisper

    whisper

    Whisper is a general-purpose speech recognition model trained on a large, diverse dataset with weak supervision. It can perform multilingual transcription, translate speech into English, and identify the spoken language.

    110.8K
  2. #2 · jamiepine/voicebox

    voicebox

    Voicebox is an open-source, local-first AI voice studio: it clones voices, generates speech in 23 languages, lets you dictate into any app with a global hotkey, and gives MCP-aware AI agents a voice - all running on your own machine as a free alternative to ElevenLabs and WisprFlow combined.

    57.9K
  3. #3 · ggml-org/whisper.cpp

    whisper.cpp

    whisper.cpp is a high-performance C/C++ port of OpenAI's Whisper automatic speech recognition (ASR) model, letting you transcribe audio to text without Python or heavy ML frameworks.

    54.5K
  1. 4

    openhuman

    42.1Ktinyhumansai/openhuman · Rust

    OpenHuman is a local-first personal AI system that combines a persistent memory of your data, an orchestrator that runs agent fleets on durable graphs, and a deep researcher that sweeps your files and the web for you. It is written in Rust and ships as a desktop app.

  2. 5

    Handy

    34Kcjpais/Handy · Rust

    Handy is a free, open source speech-to-text app: press a keyboard shortcut, speak, and your transcribed words are pasted into whatever app you are typing in. It runs entirely offline on your own computer.

  3. 6

    paper-reading

    34Kmli/paper-reading

    It's a curated reading list for deep learning: each entry is a recorded lecture that walks through a paper paragraph by paragraph, from classics like CLIP and GPT-3 to recent ones like Llama 3.1 and Sora.

  4. 7

    meetily

    31.9KZackriya-Solutions/meetily · Rust

    A privacy-first AI meeting assistant that captures your meetings, transcribes them in real time, and generates summaries — entirely on your own machine, with no data sent to the cloud.

  5. 8

    llamafile

    26.4Kmozilla-ai/llamafile · C++

    llamafile turns open LLMs into single-file executables: one file that runs a chat model locally on most operating systems and CPU architectures, with no installation. It is a Mozilla Builders project, now revamped by Mozilla.ai.

  6. 9

    faster-whisper

    25.9KSYSTRAN/faster-whisper · Python

    A Python reimplementation of OpenAI's Whisper model on CTranslate2, a fast Transformer inference engine — up to 4x faster than the original at the same accuracy, using less memory, with optional 8-bit quantization on CPU and GPU.

  7. 10

    whisperX

    24.6Km-bain/whisperX · Python

    WhisperX is an open-source speech recognition tool that transcribes audio with accurate word-level timestamps and optional speaker diarization. It builds on OpenAI's Whisper and came out of PhD research at the University of Oxford.

  8. 11

    buzz

    22Kchidiwilliams/buzz · Python

    Buzz is a free, open-source desktop app that transcribes and translates audio offline on your personal computer, powered by OpenAI's Whisper.

  9. 12

    screenpipe

    22Kscreenpipe/screenpipe · Rust

    screenpipe continuously records your screen and audio locally, turning everything you do into a searchable, AI-powered memory that gives agents like Claude or Codex context about your work. It is positioned as a source-available alternative to Rewind, Microsoft Recall and Granola.

  10. 13

    candle

    21.2Khuggingface/candle · Rust

    Candle is a minimalist machine learning framework for Rust, focused on performance (including GPU support) and ease of use. It ships with ready examples for LLMs, speech, vision and text-to-image models.

  11. 14

    pyvideotrans

    19.4Kjianchang512/pyvideotrans · Python

    An open-source video translation and dubbing tool: it converts a video from one language to another through a one-click pipeline of speech recognition, subtitle translation, TTS dubbing, and video synthesis.

  12. 15

    VideoLingo

    18.8KHuanshere/VideoLingo · Python

    VideoLingo is an all-in-one AI tool for video translation, localization, and dubbing. It generates Netflix-quality single-line subtitles and can add high-quality dubbing, fully automated in one click.

  13. 16

    claude-video

    18.7Kbradautomates/claude-video · Python

    Claude Video is an Agent Skill that gives Claude the ability to watch videos: the /watch command downloads a video, extracts frames, transcribes the audio, and hands it all to Claude so it can answer questions grounded in what it actually saw and heard.

  14. 17

    Grounded-Segment-Anything

    17.8KIDEA-Research/Grounded-Segment-Anything · Jupyter Notebook

    Grounded SAM, a research demo project that combines Grounding DINO with Segment Anything to detect and segment any object in an image from a plain text prompt, extended with Stable Diffusion, RAM, Whisper and more.

  15. 18

    memvid

    16.6Kmemvid/memvid · Rust

    Memvid is a single-file memory layer for AI agents: it packs your data, embeddings and search index into one portable .mv2 file, so agents get instant retrieval and long-term memory without a RAG pipeline or a vector database server.

  16. 19

    VideoCaptioner

    16.3KWEIFENG2333/VideoCaptioner · Python

    VideoCaptioner (卡卡字幕助手) is an LLM-powered subtitling assistant for videos: it recognizes speech, polishes and translates subtitles, and burns them back into the video.

  17. 20

    OpenCreator

    13.6Kkrillinai/OpenCreator · TypeScript

    OpenCreator (formerly KrillinAI) is an open-source AI workspace for creators that turns scripts into video, images, voice, avatars, translations, and edits, with Agents driving the whole creative process from one workspace.

  18. 21

    wechat-chatgpt

    13.2Kfuergaosi233/wechat-chatgpt · TypeScript

    A bot that plugs ChatGPT into WeChat: you self-host it, and your WeChat account can then chat with GPT-3.5 in private and group chats. It is built on the wechaty library and talks to the official OpenAI API.

  19. 22

    insanely-fast-whisper

    13.1KVaibhavs10/insanely-fast-whisper · Jupyter Notebook

    An opinionated CLI that transcribes audio files with OpenAI's Whisper model on-device, built for speed using Transformers, Optimum and flash-attn.

  20. 23

    voice-pro

    13Kabus-aikorea/voice-pro · Python

    Voice-Pro is a free, open-source AI web app (built with Gradio) that combines speech recognition, zero-shot voice cloning, text-to-speech, YouTube downloading, vocal isolation, and multilingual translation into one tool for creators and researchers.

  21. 24

    PaddleSpeech

    12.7KPaddlePaddle/PaddleSpeech · Python

    PaddleSpeech is an open-source speech and audio toolkit built on the PaddlePaddle platform, covering tasks like Automatic Speech Recognition (ASR), Text-to-Speech (TTS), Speaker Verification, Speech Translation, Keyword Spotting and Punctuation Restoration. It won the NAACL2022 Best Demo Award.

  22. 25

    h2ogpt

    11.9Kh2oai/h2ogpt · Python

    h2oGPT is an open-source private chat application that lets you query and summarize your own documents or just chat with local LLMs, with no data leaving your machine.

  23. 26

    seamless_communication

    11.9Kfacebookresearch/seamless_communication · Jupyter Notebook

    Seamless Communication is Meta's family of foundational AI models for speech and text translation across roughly 100 languages, covering speech-to-speech, speech-to-text, text-to-speech and text-to-text translation plus automatic speech recognition.

  24. 27

    WhisperLiveKit

    11.1KQuentinFuxa/WhisperLiveKit · Python

    WhisperLiveKit is a self-hosted pipeline for real-time, local speech-to-text with streaming ASR, speaker diarization, live translation, and OpenAI/Deepgram-compatible APIs.

  25. 28

    VidBee

    10.9Knexmoe/VidBee · TypeScript

    A free, open-source desktop app that downloads video and audio from 1000+ sites or imports local files, transcribes them on your machine, and lets you summarize, translate, or ask questions about them with the AI provider you choose.

  26. 29

    RTranslator

    10.5Kniedev/RTranslator · Java

    RTranslator is an open-source Android app that translates conversations in real time. Speech recognition and translation run entirely on your phone — no cloud service behind it.

  27. 30

    runanywhere-sdks

    10.3KRunanywhereAI/runanywhere-sdks · C++

    A toolkit of eight SDKs over one C++ core that runs AI fully on-device — LLM chat, vision, speech, voice agents, RAG, and image generation — on phones, browsers, and desktops. Everything is private by default and works offline.

  28. 31

    RealtimeSTT

    10.2KKoljaB/RealtimeSTT · Python

    A Python speech-to-text library that turns microphone or streamed audio into text with low latency: voice activity detection, optional wake words, live partial text, and final transcripts in a few lines of code.

  29. 32

    AudioGPT

    10.2KAIGC-Audio/AudioGPT · Python

    AudioGPT is an open-source research system for understanding and generating speech, music, sound, and talking heads — pretrained foundation models wrapped behind prompt-driven audio tasks.

  30. 33

    openwhispr

    9.5KOpenWhispr/openwhispr · JavaScript

    OpenWhispr is an open-source, privacy-first voice-to-text dictation app for desktop. Press a hotkey, speak, and the text appears at your cursor, with extra features like an AI voice assistant, meeting transcription, and notes.

  31. 34

    autoclip

    9.5Kzhouxiaoka/autoclip · Python

    An open-source AI desktop app that turns long videos — podcasts, interviews, courses, livestreams — into share-ready short clips, auto-cutting the highlights and generating subtitles, covers and titles.

  32. 35

    LongCat-Video

    9.2Kmeituan-longcat/LongCat-Video · Python

    LongCat-Video is a 13.6B-parameter foundational video generation model that unifies Text-to-Video, Image-to-Video, and Video-Continuation generation in a single architecture, aimed at efficient long-video generation and framed as a first step toward world models.

  33. 36

    Concat

    8.5Kjub0t/Concat · Rust

    Concat is a free, open-source, cross-platform video editor built as a CapCut alternative, with no watermark, no account and no subscription.

  34. 37

    ODS

    7.6KOsmantic/ODS · Python

    ODS (Osmantic Deployment System) turns your PC, Mac, or Linux box into a private AI server by installing and wiring together local LLM inference, a chat UI, agents, voice, RAG, image generation, and privacy tools in one go.

  35. 38

    openshorts

    6.8Kmutonby/openshorts · Python

    OpenShorts is an open source AI video platform that turns long videos into viral 9:16 shorts, generates AI UGC marketing videos with virtual actors, and provides free YouTube publishing tools, available self-hosted (free, MIT) or as a paid cloud service.

  36. 39

    obsidian-second-brain

    4.8Keugeniughelbur/obsidian-second-brain · Python

    It's a skill/plugin that gives Claude Code and other CLI coding agents (Codex, Gemini, Grok Bot, and more) persistent, self-rewriting memory stored as plain markdown notes in your Obsidian vault, so you stop re-explaining your projects, decisions, and people every session.

  37. 40

    CodexMonitor

    4.3KDimillian/CodexMonitor · TypeScript

    CodexMonitor is a Tauri desktop app for orchestrating and monitoring multiple OpenAI Codex agents across local workspaces, with a sidebar for projects, a home dashboard, and a conversation view built on the Codex app-server protocol.

  38. 41

    skill-recorder

    4.2Kmicrosoft/skill-recorder · TypeScript

    Skill Recorder is a desktop app that records you doing a task once on screen, then uses the GitHub Copilot CLI to turn that recording into a reusable Skill or scheduled Automation that an AI agent can run.

  39. 42

    heartlib

    3.8KHeartMuLa/heartlib · Python

    HeartMuLa is a family of open-source music foundation models for generating music from lyrics and tags, shipped together with codec, transcription and audio-text retrieval companion models.

  40. 43

    pdoom-video

    2.9Kmexicat/pdoom-video · TypeScript

    A generative, code-rendered music video for the song 'I'm Upping My P(doom)' with word-synced karaoke-style typography, where every frame is a deterministic function of song time.

  41. 44

    ffmpeg-skill

    2Kkajisho5/ffmpeg-skill · Python

    ffmpeg-skill is an Agent Skill that gives coding agents like Claude Code, Cursor, and Codex a video editor: it teaches them a fixed probe-edit-check-verify workflow and ships 40 Python scripts that actually run ffmpeg/ffprobe to cut, join, caption, fit, grade and export video.

  42. 45

    pt-pc

    1.9KLoreanXavier/pt-pc · C++

    A native PC port of P.T., the 2014 PS4 teaser by Kojima Productions. It is not an emulator: the game logic was rebuilt in C++ and the renderer is written in Vulkan, while every asset (levels, models, textures, sounds, scripts, cutscenes) is read at runtime from your own copy of the PS4 game.

  43. 46

    herk-edit-kit

    1.8Knateherkai/herk-edit-kit · HTML

    HyperFrames Student Kit is Nate Herk's reusable video-editing kit that plugs into Codex and Claude Code, giving them skills to cut dead air, catch mistakes, caption, and build GSAP motion graphics from your own footage.

  44. 47

    open-edit

    1.7Kveedstudio/open-edit · TypeScript

    OpenEdit is an open-source, agent-driven video editing pipeline: you tell your coding agent what you want, and it transcribes, designs, renders and hands you the MP4. There is no GUI and no timeline.

  45. 48

    parrot

    1.3Khumanitas-labs/parrot · Swift

    Parrot is on-device dictation for macOS: hold the fn key, speak, release, and your words appear at the cursor as text.

  46. 49

    autoshorts

    1.3KJayWebtech/autoshorts · Rust

    AutoShorts is a local-first desktop app that turns long-form video or audio recordings into vertical (9:16) short-form clip candidates, ranking the most viral moments with AI.

  47. 50

    chubbyskills

    1.3Kchubbyguan/chubbyskills · Python

    Chubby Skills is a set of 14 Agent Skills plus a CLI that ingest Chinese social content (Douyin, Bilibili, Xiaohongshu, WeChat public accounts, X, podcasts) and local documents into a personal Markdown knowledge base you can search, cite, and hand off to an AI agent.

  48. 51

    EchoMuse

    1.3Kwilbowes/EchoMuse · Python

    It turns a second-hand Amazon Echo Dot (2nd gen, 2016) into a local voice satellite for Home Assistant: say the wake word, ask, and hear the answer from the Dot. No Amazon account, no Alexa, no cloud - the microphones, speaker, LED ring and buttons keep working.

  49. 52

    cs-board

    777ChenShuo2004/cs-board · Python

    cs-board (白板声画工坊, Whiteboard Voice-Animation Workshop) is a local AI tool that turns a reference voice sample and Chinese text into a narrated whiteboard-style animation video, automating voice cloning, scene breakdown, illustration, hand-drawn strokes, subtitles and final MP4 export.

  50. 53

    nomily-app

    706Nomily-Ai/nomily-app

    Nomily AI is a BYOK (bring-your-own-key) voice recording companion for the V05E BLE recorder, iPhone, and Apple Watch, offering ASR transcription, speaker diarization, and AI-generated summaries where you choose and pay for your own transcription and LLM providers.

  51. 54

    short-video-maker

    625mushigaite/short-video-maker · Python

    short-video-maker turns a YouTube link (or a local video file) into a ready-to-post vertical short by automatically detecting the most viral highlight moments, then adding subtitles, translation and AI voiceover — no watermarks or per-clip credits.

  52. 55

    explainroo

    589vincentsch/explainroo · JavaScript

    explainroo lets a coding agent turn a script into a narrated explainer video or product demo. It uses a local voice model for narration, Whisper for word timing, and a canvas renderer to draw synced illustrations, then ffmpeg assembles everything into an MP4.

  53. 56

    no-tipe-releases

    561Darlingfxx02/no-tipe-releases · HTML

    No Type is a free desktop app that turns your speech into text inside whatever app you're using: press a shortcut, talk, and the words appear in the focused text field.

  54. 57

    SCM

    487allenv0/SCM · TypeScript

    SCM (Screen Memories) is a macOS desktop app that runs deep AI search locally over every photo and every video frame in a chosen folder, letting you search by meaning, on-screen text, or spoken dialogue, all without the cloud.

  55. 58

    dsh-voice-ai-girlfriend

    487beiyege-01/dsh-voice-ai-girlfriend · TypeScript

    log、/api/dh/status 附带 duix 容器状态与 stats 计数（submits / segmentsubmits / statuspolls，用于核对「任务到底提交了没有」）。

  56. 59

    omarchy-meeting-recorder

    388jankeesvw/omarchy-meeting-recorder · Rust

    Meeting Recorder is a desktop app for Omarchy that records your microphone and computer audio as two separate tracks, then produces a transcript with speaker labels, chapters and a built-in player.

  57. 60

    solo-skills

    365bam-bam-2/solo-skills · Python

    This is a collection of AI agent 'skills' (SKILL.md procedure files, some with runnable scripts) that a solo entrepreneur built to automate the busywork of running a one-person business — product demo videos, book PDFs, blog posts, meeting minutes, KakaoTalk messaging, Discord bots, and more.

  58. 61

    wechat-ai-memory

    346ikevss/wechat-ai-memory

    A local-first Windows app that reads your WeChat 4.x chats directly, lets you filter them by conversation, date range and keyword, and exports the result as PDF, Markdown and structured JSON to build a personal, traceable chat memory archive.

  59. 62

    flick

    314Creatorberry/flick · TypeScript

    Flick is an open-source AI motion director: give it a video, a public link, or a pasted transcript, and it turns it into original short-form animations, scene by scene.

  60. 63

    VideoHighlighter

    212Aseiel/VideoHighlighter · Python

    A free, open-source desktop app that finds and explains the strong moments in your footage, then exports a highlight reel and clips — an offline alternative to Twelve Labs, Runway and Descript.

  61. 64

    phorminx

    207impossibleG/phorminx · Rust

    Phorminx is a local-first Windows desktop app that turns speech into text for dictation and meeting transcription, with searchable notes and optional local AI formatting instead of a paid cloud AI service.

Often tagged together