Topics / #audio-processing

Audio-processing projects on GitHub

Libraries for audio analysis, source separation, and speech enhancement.

As of , the most-starred Audio-processing projects on GitHub are FFmpeg (65.3K stars), GPT-SoVITS (63.1K stars) and Retrieval-based-Voice-Conversion-WebUI (38.8K stars). GitHub.Locker tracks 64 Audio-processing repositories with 748.4K stars combined. The fastest-growing on October 17 was Filee, with +1.5K stars in a day.

64Projects
748.4KStars in total
+2.7KStars in a day
Browse in the catalog →github.com/topics/audio-processing ↗

Hot right now

Most stars gained in a day · Oct 17

+1.5K

Filee

KnifeLemon/Filee · ★ 2.1K

Filee is a free, open-source file converter for Windows, macOS and Linux that handles 180+ formats — images, PDF, Word, Excel, PowerPoint, HWP/HWPX, video, audio, e-books, CAD and archives — by letting you drag files onto a floating format menu, all processed locally with no upload.

+346

filmcraft

storytold/filmcraft · ★ 14.6K

FilmCraft is an open-source, clean-room reimplementation of Adobe Premiere Pro, rebuilt from scratch in pure Rust with its own codecs, a GPU compositor and a typed command system.

+114

soundcraft

storytold/soundcraft · ★ 3.2K

SoundCraft is an open-source, clean-room reimplementation of Avid Pro Tools built entirely in pure Rust — a full digital audio workstation for recording, editing and mixing audio.

+111

GPT-SoVITS

RVC-Boss/GPT-SoVITS · ★ 63.1K

GPT-SoVITS is a few-shot voice cloning and text-to-speech WebUI: feed it a short voice sample and it can clone that voice to read out any text, including in languages the speaker never recorded.

The all-time top

64 projects · by stars

  1. #1 · FFmpeg/FFmpeg

    FFmpeg

    FFmpeg is a collection of libraries and command-line tools to process multimedia: decode, encode, transcode, mux, demux, stream, filter and play audio and video.

    65.3K
  2. #2 · RVC-Boss/GPT-SoVITS

    GPT-SoVITS

    GPT-SoVITS is a few-shot voice cloning and text-to-speech WebUI: feed it a short voice sample and it can clone that voice to read out any text, including in languages the speaker never recorded.

    63.1K
  3. #3 · RVC-Project/Retrieval-based-Voice-Conversion-WebUI

    Retrieval-based-Voice-Conversion-WebUI

    RVC WebUI is a web-based tool for training and running voice conversion (voice-changing) models, letting you clone a target voice's timbre using as little as about 10 minutes of audio.

    38.8K
  1. 4

    mediapipe

    37.3Kgoogle-ai-edge/mediapipe · C++

    Google's open-source, cross-platform toolkit for on-device machine learning in live and streaming media: ready-made libraries and pre-trained models you plug straight into your own app.

  2. 5

    MockingBird

    36.9Kbabysor/MockingBird · Python

    MockingBird is a PyTorch voice-cloning toolbox: it learns a voice from a short audio clip and generates arbitrary Mandarin speech in real time. The repo is no longer actively updated — the author is building an optimized cloud-hosted version instead.

  3. 6

    video-use

    29.2Kbrowser-use/video-use · Python

    video-use is an open-source Claude Code skill that turns raw footage into a finished MP4 — it cuts filler words and dead space, color-grades clips, burns subtitles, and adds animations through conversation with a coding agent.

  4. 7

    spleeter

    28.5Kdeezer/spleeter · Python

    Spleeter is Deezer's source separation library: pretrained models, written in Python on TensorFlow, that split a song into stems like vocals, drums, bass and piano. It ships 2-, 4- and 5-stem variants, and the 2- and 4-stem models score high on the musdb dataset.

  5. 8

    so-vits-svc

    28.1Ksvc-develop-team/so-vits-svc · Python

    An open-source AI singing voice conversion (SVC) framework: it trains PyTorch models that make one voice sing the lines of another, using SoftVC speech features fed into VITS with an NSF-HiFiGAN vocoder.

  6. 9

    ultimatevocalremovergui

    26.7KAnjok07/ultimatevocalremovergui · Python

    UVR is a free desktop app that removes vocals from audio files using state-of-the-art AI source-separation models — handy for karaoke tracks, instrumentals and sampling.

  7. 10

    faster-whisper

    25.9KSYSTRAN/faster-whisper · Python

    A Python reimplementation of OpenAI's Whisper model on CTranslate2, a fast Transformer inference engine — up to 4x faster than the original at the same accuracy, using less memory, with optional 8-bit quantization on CPU and GPU.

  8. 11

    howler.js

    25.4Kgoldfire/howler.js · JavaScript

    howler.js is a JavaScript audio library for the web that gives you one consistent API for playing and controlling sound, defaulting to the Web Audio API and falling back to HTML5 Audio automatically.

  9. 12

    whisperX

    24.6Km-bain/whisperX · Python

    WhisperX is an open-source speech recognition tool that transcribes audio with accurate word-level timestamps and optional speaker diarization. It builds on OpenAI's Whisper and came out of PhD research at the University of Oxford.

  10. 13

    audiocraft

    23.7Kfacebookresearch/audiocraft · Jupyter Notebook

    AudioCraft is a PyTorch library for deep learning research on audio generation, built around generative models like MusicGen (text-to-music) and AudioGen (text-to-sound), plus the EnCodec neural audio codec.

  11. 14

    voice-changer

    21.2Kw-okada/voice-changer · Python

    It's VCClient, a real-time AI voice changer: it converts your microphone input on the fly so you can speak live with a different voice.

  12. 15

    audacity

    18.8Kaudacity/audacity · C++

    Audacity is an easy-to-use, multi-track audio editor and recorder for the desktop, running on Windows, macOS, GNU/Linux and other operating systems.

  13. 16

    ffmpeg.wasm

    17.9Kffmpegwasm/ffmpeg.wasm · C

    ffmpeg.wasm is a pure WebAssembly/JavaScript port of FFmpeg that runs directly inside the browser, letting you record, convert, and stream audio and video without a server.

  14. 17

    AutoEq

    16.4Kjaakkopasanen/AutoEq · Python

    AutoEq automatically generates headphone equalizer settings based on real frequency response measurements, so you can correct your headphones toward a target sound curve.

  15. 18

    FileConverter

    15.4KTichau/FileConverter · C#

    File Converter is a Windows tool that lets you convert and compress files directly from the right-click context menu in Windows Explorer, without opening a separate app.

  16. 19

    Tone.js

    14.8KTonejs/Tone.js · TypeScript

    Tone.js is a Web Audio framework for creating interactive music in the browser, giving musicians and audio programmers DAW-like features such as a global transport, prebuilt synths and effects, plus low-level building blocks for custom audio processing.

  17. 20

    filmcraft

    14.6Kstorytold/filmcraft · Rust

    FilmCraft is an open-source, clean-room reimplementation of Adobe Premiere Pro, rebuilt from scratch in pure Rust with its own codecs, a GPU compositor and a typed command system.

  18. 21

    PaddleSpeech

    12.7KPaddlePaddle/PaddleSpeech · Python

    PaddleSpeech is an open-source speech and audio toolkit built on the PaddlePaddle platform, covering tasks like Automatic Speech Recognition (ASR), Text-to-Speech (TTS), Speaker Verification, Speech Translation, Keyword Spotting and Punctuation Restoration. It won the NAACL2022 Best Demo Award.

  19. 22

    seamless_communication

    11.9Kfacebookresearch/seamless_communication · Jupyter Notebook

    Seamless Communication is Meta's family of foundational AI models for speech and text translation across roughly 100 languages, covering speech-to-speech, speech-to-text, text-to-speech and text-to-text translation plus automatic speech recognition.

  20. 23

    speechbrain

    11.9Kspeechbrain/speechbrain · Python

    An open-source, PyTorch-based toolkit for Conversational AI — the technology behind speech assistants and chatbots. It bundles training recipes and pretrained models for a wide range of speech and text processing tasks.

  21. 24

    SmarterStreaming

    11.2Kdaniulive/SmarterStreaming · Java

    SmarterStreaming (Daniu Live SDK) is a cross-platform streaming media kernel for Windows, Linux, Android and iOS: native modules for RTMP/RTSP push, playback, recording, relaying and mixing, with latency the vendor puts at 100-200 ms.

  22. 25

    ffmpeg-python

    11Kkkroening/ffmpeg-python · Python

    ffmpeg-python is a pure-Python wrapper around the FFmpeg command-line tool that lets you build FFmpeg pipelines, including complex filter graphs, using readable Python code instead of raw shell arguments.

  23. 26

    Whisper

    10.7KConst-me/Whisper · C++

    A Windows port of OpenAI's Whisper speech-recognition model that runs inference on the GPU using DirectCompute instead of CUDA, delivering much faster transcription than the official PyTorch implementation.

  24. 27

    pyannote-audio

    10.7Kpyannote/pyannote-audio · Jupyter Notebook

    An open-source Python toolkit for speaker diarization - working out who spoke when in an audio recording. It is built on PyTorch and ships state-of-the-art pretrained models and pipelines.

  25. 28

    silero-vad

    10.5Ksnakers4/silero-vad · Python

    Silero VAD is a pre-trained, enterprise-grade Voice Activity Detector: a compact model that tells you which parts of an audio stream contain speech.

  26. 29

    demucs

    10.4Kfacebookresearch/demucs · Python

    Demucs is a state-of-the-art music source separation model from Meta's research lab: give it a song and it splits it into stems — drums, bass, vocals and the rest of the accompaniment.

  27. 30

    easyeffects

    10.4Kwwmm/easyeffects · HTML

    Easy Effects is a Linux audio app that applies studio-style effects — equalizer, compressor, limiter, autogain and 30+ more — to your applications' sound via PipeWire. It was formerly known as PulseEffects.

  28. 31

    FineTune

    9.8Kronitsingh10/FineTune · Swift

    FineTune is a free, open-source macOS menu bar app for sound control: per-app volume with up to 4x boost, audio routing to multiple output devices, and a 10-band EQ with headphone correction — pitched as an alternative to SoundSource.

  29. 32

    flyingmouse-format

    6.7KLaoFeng-mouse/flyingmouse-format · JavaScript

    FlyingMouse Format is a free, offline desktop app for Windows (and macOS) that converts files between image, document, spreadsheet, presentation, PDF, e-book, audio, video, and ZIP formats, with built-in OCR.

  30. 33

    AudioNoise

    4.5Ktorvalds/AudioNoise · C

    AudioNoise is a small, playful collection of digital audio effect simulations (phaser-like all-pass filters, delay-based echoes, etc.) written in C by Linus Torvalds as a side project for learning digital signal processing basics, originally tied to his DIY guitar-pedal hardware.

  31. 34

    MOSS-TTS-Nano

    4.5KOpenMOSS/MOSS-TTS-Nano · Python

    MOSS-TTS-Nano is an open-source, 100M-parameter multilingual text-to-speech model from MOSI.AI and OpenMOSS that supports voice cloning, 48kHz stereo output, and real-time generation directly on CPU.

  32. 35

    stemdeck

    4.2Kstemdeckapp/stemdeck · JavaScript

    StemDeck is a free, open-source stem separation tool: drop in a song and it splits it into isolated stems (vocals, drums, bass, guitar, piano, other) for practice, transcription, remixing, and other audio work — all running on your own machine.

  33. 36

    heartlib

    3.8KHeartMuLa/heartlib · Python

    HeartMuLa is a family of open-source music foundation models for generating music from lyrics and tags, shipped together with codec, transcription and audio-text retrieval companion models.

  34. 37

    soundcraft

    3.2Kstorytold/soundcraft · Rust

    SoundCraft is an open-source, clean-room reimplementation of Avid Pro Tools built entirely in pure Rust — a full digital audio workstation for recording, editing and mixing audio.

  35. 38

    pdoom-video

    2.9Kmexicat/pdoom-video · TypeScript

    A generative, code-rendered music video for the song 'I'm Upping My P(doom)' with word-synced karaoke-style typography, where every frame is a deterministic function of song time.

  36. 39

    sonicloud_opensdk

    2.6KSonicloudTech/sonicloud_opensdk · C++

    This is an open SDK and reference implementation for connecting a Bluetooth recording-card hardware device (声云录音卡) to your own apps, covering the BLE protocol, device control, real-time audio, file transfer, OTA updates and transcription, with examples for Android, iOS, HarmonyOS, Flutter and Windows/macOS desktop.

  37. 40

    Filee

    2.1KKnifeLemon/Filee · C#

    Filee is a free, open-source file converter for Windows, macOS and Linux that handles 180+ formats — images, PDF, Word, Excel, PowerPoint, HWP/HWPX, video, audio, e-books, CAD and archives — by letting you drag files onto a floating format menu, all processed locally with no upload.

  38. 41

    vhs-decode

    2.1Koyvindln/vhs-decode · Jupyter Notebook

    VHS-Decode is software that decodes raw FM RF signals captured directly from videotape heads (VHS, SVHS, U-Matic, Betamax, Video8/Hi8, etc.) into usable video and audio, as part of the FM RF Archival method of media preservation. It is a fork of 'ld-decode', the laserdisc RF decoder.

  39. 42

    ffmpeg-skill

    2Kkajisho5/ffmpeg-skill · Python

    ffmpeg-skill is an Agent Skill that gives coding agents like Claude Code, Cursor, and Codex a video editor: it teaches them a fixed probe-edit-check-verify workflow and ships 40 Python scripts that actually run ffmpeg/ffprobe to cut, join, caption, fit, grade and export video.

  40. 43

    capcut-mate

    2KHommy-master/capcut-mate · Python

    CapCut Mate API is an open-source FastAPI service that automates CapCut/Jianying video editing drafts, letting you create drafts, add materials, and render final videos programmatically or from an LLM.

  41. 44

    VideoAgent

    2KHKUDS/VideoAgent · Python

    VideoAgent is an all-in-one agentic framework that understands, edits, and remakes videos from natural-language requests, handling everything from summarization to meme remixes and cross-lingual comedy adaptations.

  42. 45

    iPhoneMirror

    1.4KRayrenSX/iPhoneMirror · C#

    iPhoneMirror is a local Windows app that mirrors an iPhone or iPad's screen and audio over USB or AirPlay, with native D3D11 rendering, multi-device sessions, OBS-ready windows, and Bluetooth reverse control.

  43. 46

    EchoMuse

    1.3Kwilbowes/EchoMuse · Python

    It turns a second-hand Amazon Echo Dot (2nd gen, 2016) into a local voice satellite for Home Assistant: say the wake word, ask, and hear the answer from the Dot. No Amazon account, no Alexa, no cloud - the microphones, speaker, LED ring and buttons keep working.

  44. 47

    open-claude-ui

    1.1KCaho1/open-claude-ui · TypeScript

    A high-fidelity open-source React UI component library and motion engine that reverse-engineers and recreates Anthropic's official Claude desktop app design system (CDS), down to the exact spring physics, surface colors, and audio pipeline.

  45. 48

    stemkit

    1.1Kdanielravina/stemkit · TypeScript

    StemKit splits any YouTube song into isolated stems — vocals, drums, bass, guitar, piano and more — running entirely on your own machine, with a mini DAW-style player to mix/mute/solo each stem.

  46. 49

    ps2-web-recomp

    1Ksnuri00/ps2-web-recomp · C++

    It is a project that statically recompiles PlayStation 2 game executables into C++ and WebAssembly so the games run in a browser, with the console's hardware emulated by a runtime that draws through WebGPU.

  47. 50

    Genjustsu-Open-Source-Workflow

    986sirioberati/Genjustsu-Open-Source-Workflow · Python

    Genjustsu is an open-source workflow for replacing characters or objects in a video using colored depth maps, SAM 3 segmentation masks and optional face mesh tracking, then generating the replacement with Seedance through the Enhancor API. It runs a local web UI to prepare inputs, review masks, preview drafts, and export the result with the original audio restored.

  48. 51

    MiniMax-Music3

    963MiniMax-AI/MiniMax-Music3

    MiniMax Music 3 is a music generation model that creates complete songs up to five minutes long from lyrics and a music description, producing 32 kHz 16-bit stereo WAV audio with coherent structure and expressive vocals.

  49. 52

    ComfyUI-MiniMaxH3-TimelineDirector

    653Songssx/ComfyUI-MiniMaxH3-TimelineDirector · Python

    It's an editable reference-media timeline UI for ComfyUI's native MiniMax H3 Reference-to-Video workflow, letting you arrange reference videos, images, audio, and Guides on one timeline to drive text-to-video, character replacement, motion transfer, digital humans, and long-form video generation.

  50. 53

    android-airplay-server

    612jqssun/android-airplay-server · Kotlin

    It's an open-source AirPlay receiver app for Android, built on UxPlay, that turns your Android phone or TV into an AirPlay-compatible display and speaker for screen mirroring, video playback, and audio streaming from Apple devices.

  51. 54

    sloop-fm1

    536isod89/sloop-fm1 · C

    SLOOP is a free, open-source custom firmware for the M-VAVE FM-1 hardware groovebox, replacing the stock firmware with a deeper synth engine set, a real drum machine, live sequencing, and an in-browser editor.

  52. 55

    ComfyUI-MiniMaxH3Mod

    457Luisacaotica/ComfyUI-MiniMaxH3Mod · Python

    A ComfyUI custom node pack that adds 'RefMod' reference adapters for the MiniMax H3 model. It compresses reference images, videos or audio into small reusable .safetensors files that can be loaded and applied to influence generation without any training of the H3 model.

  53. 56

    yapsnap

    379kouhxp/yapsnap · Python

    A command-line tool that turns any video URL or local audio/video file into a plaintext transcript, running entirely on your own CPU — no GPU, no cloud, one command.

  54. 57

    The-Darkness-Recomp

    298portingpete/The-Darkness-Recomp · C++

    It is a native Windows port of the Xbox 360 game The Darkness, built by statically translating the original 360 executable into C++ ahead of time and running it with a DirectX 11 renderer, no emulator involved.

  55. 58

    CHOMPI

    289CHOMPI-Club/CHOMPI · C++

    CHOMPI is a quirky chromatic sampler and tape-music instrument, and this repo contains every production file behind it - the firmware (TAPE, TEMPO, WAVE) and the hardware (PCB schematics, BOM, enclosure files).

  56. 59

    Infinite

    283n1m21n/Infinite · C++

    Infinite is a free, open-source node-based audiovisual workstation that combines real-time GPU video/3D compositing with a modular synthesizer rack and native plugin hosting, all wired together in one patch.

  57. 60

    coyopedal

    261dashersw/coyopedal · C++

    CoyoPedal is a standalone guitar amp and effects pedal built on the ESP32-S3 that runs full-size Neural Amp Modeler (NAM) A2 captures in real time, with a touchscreen UI and a browser build compiled to WebAssembly.

  58. 61

    ALH-Pro

    257AlLHHH/ALH-Pro · C#

    ALH Pro is a free Windows desktop app that uses AI to upscale and enhance images, videos, and audio entirely on your local machine, covering image super-resolution, AI background removal, video super-resolution, frame interpolation, duplicate-frame removal, and audio separation/enhancement.

  59. 62

    vlo

    247PxTicks/vlo · TypeScript

    Vlo is a free, open-source, local video editor with built-in AI features like automatic rotoscoping, audio stem separation, and beat detection, plus a live bridge to ComfyUI for running any generative AI workflow directly on the timeline.

  60. 63

    Comfyui-MMH3-UltimateUpscale

    236bbaudio-2025/Comfyui-MMH3-UltimateUpscale · Python

    A ComfyUI custom node that upscales long, high-resolution MiniMax H3 AV video latents on VRAM-limited GPUs, using temporal chunking and spatial tiling inside a single node while keeping the audio track intact.

  61. 64

    dance-video-to-prompt

    143CattleZ/dance-video-to-prompt · Python

    Dance-video-to-prompt takes a short local video (dancing, posing, outfit changes, travel check-ins, walking in an outfit, ideally 10 seconds or less) and reverse-engineers it into a structured prompt you can feed straight into an AI video generator.

Often tagged together