Topics / #text-to-video

Text-to-video projects on GitHub

Generating video from text descriptions with AI

As of , the most-starred Text-to-video projects on GitHub are OpenMontage (68.9K stars), diffusers (34.7K stars) and artcraft (30.6K stars). GitHub.Locker tracks 62 Text-to-video repositories with 570.9K stars combined. The fastest-growing on October 16 was artcraft, with +1.3K stars in a day.

62Projects
570.9KStars in total
+2.4KStars in a day
Browse in the catalog →github.com/topics/text-to-video ↗

Hot right now

Most stars gained in a day · Oct 16

+1.3K

artcraft

storytold/artcraft · ★ 30.6K

ArtCraft is a desktop IDE for interactive AI image and video creation, where you compose scenes in 2D, stage them in 3D, and then pick from dozens of AI models to generate the final result.

+289

OpenMontage

calesthio/OpenMontage · ★ 68.9K

OpenMontage turns your AI coding assistant (Claude Code, Cursor, Copilot, Windsurf, Codex) into a full video production studio: you describe a video in plain language and it handles research, scripting, asset generation, editing, and final composition through 12 production pipelines and 100+ tools.

+256

hypit

hypit-ai/hypit · ★ 23K

Hypit gives AI coding agents (Claude Code, Codex) a language and system to create video: drop in a video and the agent clones it as a full workflow — footage, captions, B-roll and effects — anchored to words instead of timestamps.

+118

Open-Generative-AI

Anil-matcha/Open-Generative-AI · ★ 30.6K

A free, open-source studio for AI image, video, cinema and lip sync generation, positioned as an unrestricted alternative to paid AI video platforms: 400+ models (Flux, Midjourney, Kling, Sora, Veo) across 14 studios, with no content filters.

The all-time top

62 projects · by stars

  1. #1 · calesthio/OpenMontage

    OpenMontage

    OpenMontage turns your AI coding assistant (Claude Code, Cursor, Copilot, Windsurf, Codex) into a full video production studio: you describe a video in plain language and it handles research, scripting, asset generation, editing, and final composition through 12 production pipelines and 100+ tools.

    68.9K
  2. #2 · huggingface/diffusers

    diffusers

    Diffusers is Hugging Face's Python library for state-of-the-art pretrained diffusion models that generate images, audio, and even 3D molecule structures, all in PyTorch.

    34.7K
  3. #3 · storytold/artcraft

    artcraft

    ArtCraft is a desktop IDE for interactive AI image and video creation, where you compose scenes in 2D, stage them in 3D, and then pick from dozens of AI models to generate the final result.

    30.6K
  1. 4

    Open-Generative-AI

    30.6KAnil-matcha/Open-Generative-AI · JavaScript

    A free, open-source studio for AI image, video, cinema and lip sync generation, positioned as an unrestricted alternative to paid AI video platforms: 400+ models (Flux, Midjourney, Kling, Sora, Veo) across 14 studios, with no content filters.

  2. 5

    Open-Sora

    29.9Khpcaitech/Open-Sora · Python

    Open-Sora is an open-source initiative for efficiently producing high-quality video: it releases video generation models together with the tools, checkpoints and all training details.

  3. 6

    Pixelle-Video

    29.1KATH-MaaS/Pixelle-Video · Python

    Pixelle-Video is an open-source AI short-video engine: give it one topic and it automatically writes the script, generates AI images or video clips, synthesizes the voiceover, adds background music and assembles a finished video — no editing experience needed.

  4. 7

    generative-models

    27.3KStability-AI/generative-models · Python

    This is Stability AI's research codebase for a family of generative diffusion models, covering text-to-image (SDXL, SDXL-Turbo), image-to-video (Stable Video Diffusion), image-to-3D-video (SV3D), and video-to-4D (SV4D, SV4D 2.0) synthesis.

  5. 8

    JARVIS

    25.4Kmicrosoft/JARVIS · Python

    JARVIS is an open-source research system that connects an LLM with the ML community: a large language model acts as the controller, picking and invoking expert models from the Hugging Face Hub to solve complex AI tasks.

  6. 9

    hypit

    23Khypit-ai/hypit · TypeScript

    Hypit gives AI coding agents (Claude Code, Codex) a language and system to create video: drop in a video and the agent clones it as a full workflow — footage, captions, B-roll and effects — anchored to words instead of timestamps.

  7. 10

    Toonflow-app

    18KHBAI-Ltd/Toonflow-app · TypeScript

    Toonflow is an open-source AI workbench for producing short dramas and motion comics: scriptwriting, storyboarding, character and scene assets, and image and video generation chained into one pipeline on an infinite canvas.

  8. 11

    Wan2.2

    18KWan-Video/Wan2.2 · Python

    An open-source family of large-scale video generation models: text-to-video, image-to-video, speech-to-video and character animation, with inference code and model weights released under Apache-2.0.

  9. 12

    FramePack

    17.3Klllyasviel/FramePack · Python

    FramePack is a next-frame-section prediction neural network for video diffusion, shipped as the official desktop app that turns an image and a short text prompt into a progressively generated video.

  10. 13

    Wan2.1

    17.2KWan-Video/Wan2.1 · Python

    Wan2.1 is an open suite of large-scale video generative models: it turns text or images into videos, and also covers video editing, text-to-image and video-to-audio tasks.

  11. 14

    huobao-drama

    16.3Kchatfire-AI/huobao-drama · Vue

    Huobao Drama is an AI-powered platform that automates the full production of short dramas: it turns a script or novel into character designs, storyboards, and a finished edited video with almost no manual work.

  12. 15

    DiffSynth-Studio

    13.3Kmodelscope/DiffSynth-Studio · Python

    DiffSynth-Studio is an open-source Diffusion model engine built and maintained by the ModelScope Community, covering image, video, and audio generation plus image quality metrics, with support for both inference and training.

  13. 16

    CogVideo

    13.1Kzai-org/CogVideo · Python

    An open-source family of text-to-video and image-to-video models: CogVideoX (2024) and its CogVideoX1.5 upgrade, following CogVideo (ICLR 2023), the first open-source large Transformer-based text-to-video model.

  14. 17

    ViMax

    12.7KHKUDS/ViMax · Python

    ViMax is an agentic AI framework that acts as an all-in-one director, screenwriter, producer, and video generator: give it a concept, script, or novel, and it autonomously handles scriptwriting, storyboarding, character creation, and final video assembly.

  15. 18

    AnimateDiff

    12.3Kguoyww/AnimateDiff · Python

    AnimateDiff is the official implementation of a research method that turns personalized text-to-image Stable Diffusion models into animation (text-to-video) generators without any extra fine-tuning of those models.

  16. 19

    Open-Sora-Plan

    12.2KPKU-YuanGroup/Open-Sora-Plan · Python

    Open-Sora Plan is an open-source community project that aims to reproduce OpenAI's Sora text-to-video model, led by a PKU-affiliated AIGC lab with contributions from Huawei and Pengcheng Lab.

  17. 20

    LTX-Video

    11.1KLightricks/LTX-Video · Python

    LTX-Video is the official repo for Lightricks' DiT-based video generation model, which generates synchronized audio+video, supports text-to-video and image-to-video, keyframe conditioning, video extension, and video-to-video transformations.

  18. 21

    WanGP

    10.6Kdeepbeepmeep/WanGP · Python

    WanGP is a one-stop open source app for running top generative AI models for video, image, and audio/TTS generation, built specifically to work on modest consumer GPUs (the 'GPU Poor').

  19. 22

    MiniMax-H3

    10.1KMiniMax-AI/MiniMax-H3 · Python

    MiniMax H3 is a general-purpose omni-modal generative system: it reads mixed text, image, video and audio input and generates video with native stereo audio, up to 2K resolution and 15 seconds per clip.

  20. 23

    LTX-2

    9.8KLightricks/LTX-2 · Python

    The official Python package for LTX-2, Lightricks' audio-video foundation model: one DiT-based model that generates video with synchronized audio from text or an image, in several quality/speed modes.

  21. 24

    LongCat-Video

    9.2Kmeituan-longcat/LongCat-Video · Python

    LongCat-Video is a 13.6B-parameter foundational video generation model that unifies Text-to-Video, Image-to-Video, and Video-Continuation generation in a single architecture, aimed at efficient long-video generation and framed as a first step toward world models.

  22. 25

    seedance-2.0

    7.7KEmily2040/seedance-2.0 · Python

    Seedance 2.0 Skill OS is an agent skill that helps you plan video shots, write detailed directed prompts, bind image/video/audio references, and continue from an already-accepted clip — the actual rendering is done by a separate Seedance 2.0 video provider.

  23. 26

    stable-diffusion.cpp

    7.7Kleejet/stable-diffusion.cpp · C++

    A pure C/C++ inference engine for diffusion models like Stable Diffusion, Flux, Wan, Qwen Image, and Z-Image, built the same way as llama.cpp so you can generate images and videos without heavy Python dependencies.

  24. 27

    dramaclaw

    6.3Kdramaclaw/dramaclaw · Python

    DramaClaw is a self-hosted AIGC video production pipeline that turns a script or manuscript into a finished film — handling story structuring, storyboards, voice-over and final cut — plus a node-based canvas for freeform generative work.

  25. 28

    ArcReel

    5.5KArcReel/ArcReel · Python

    ArcReel is an open-source, self-hosted AI video production workspace that turns novels, finished scripts, or product materials into characters, scenes, props, storyboards, video clips and a final cut.

  26. 29

    AgnesAI-Models

    5.2KAgnesAI-Labs/AgnesAI-Models

    Agnes AI is the official gateway and model catalog for Agnes AI, giving developers OpenAI-compatible access to multimodal models for text, image, video, and agent workflows through one unified API.

  27. 30

    printfilm

    5.2Kyi1108/printfilm · Python

    PRINTFILM is a self-hosted platform that turns a topic or script into a finished short video or episodic AI comic/drama, covering the whole pipeline from script to storyboard to image generation to video generation to final cut.

  28. 31

    HunyuanVideo-1.5

    4.6KTencent-Hunyuan/HunyuanVideo-1.5 · Python

    HunyuanVideo-1.5 is a video generation model from Tencent that creates text-to-video and image-to-video clips, achieving top-tier quality with only 8.3B parameters so it runs on consumer-grade GPUs.

  29. 32

    seedance2-skill

    4.3Kdexhunter/seedance2-skill

    This is a set of agent skill files that teach AI coding agents like Claude Code how to write effective prompts for generating videos with ByteDance's Seedance 2.0 model.

  30. 33

    TurboDiffusion

    3.9Kthu-ml/TurboDiffusion · Python

    TurboDiffusion is a video generation acceleration framework that speeds up end-to-end video diffusion generation by 100-200x on a single RTX 5090 while keeping video quality, using SageAttention, Sparse-Linear Attention (SLA), and rCM timestep distillation.

  31. 34

    kimodo

    3.8Knv-tlabs/kimodo · Python

    Kimodo is NVIDIA's kinematic motion diffusion model that generates high-quality 3D human and robot motion from text prompts and kinematic constraints like keyframes, end-effector positions, and 2D paths.

  32. 35

    Stable-Diffusion

    2.8KFurkanGozukara/Stable-Diffusion · Jupyter Notebook

    A huge, continuously updated collection of tutorial videos by Dr. Furkan Gozukara covering Stable Diffusion, SDXL, FLUX, SD3, LoRA training, DreamBooth, ControlNet, deepfakes, TTS, animation and more, with links to full YouTube walkthroughs for each topic.

  33. 36

    awesome-seedance

    2.1KLearnPrompt/awesome-seedance · JavaScript

    An evidence-led prompt library for ByteDance's Seedance 2.5 / 2.0 text-to-video model: 463 cases traced to their original posts, 264 cross-model retests with public verdicts, 25 copy-ready templates and 60 installable Skills, synced daily from GoodCase.ai.

  34. 37

    FreeVideo

    2KFlashML-org/FreeVideo · Python

    FreeVideo is a local inference engine that lets you run the MiniMax H3 video generation model on your own consumer GPU instead of a cloud service, adapting its memory and compute strategy to your hardware.

  35. 38

    Evoke

    861AlayaLab/Evoke · Python

    EVOKE is a research implementation of an interactive 'world model' that generates endless, controllable video: a three-step, CFG-free system that remembers where it has already been, lets you redirect it mid-rollout, and is state-of-the-art on the WBench long-horizon benchmark.

  36. 39

    gufo

    781gufo-org/gufo · C++

    Gufo is a local inference engine built specifically for AMD Strix Halo hardware (Ryzen AI MAX+ 395 with Radeon 8060S / gfx1151, up to 128 GiB unified memory), serving text, speech, image and video models through an OpenAI-compatible API.

  37. 40

    ComfyUI-MiniMaxH3-TimelineDirector

    647Songssx/ComfyUI-MiniMaxH3-TimelineDirector · Python

    It's an editable reference-media timeline UI for ComfyUI's native MiniMax H3 Reference-to-Video workflow, letting you arrange reference videos, images, audio, and Guides on one timeline to drive text-to-video, character replacement, motion transfer, digital humans, and long-form video generation.

  38. 41

    vdn-minimax-h3

    617OpenVDN/vdn-minimax-h3 · Python

    VDN-Minimax-H3 is a hybrid-attention video generation model built on MiniMax H3 that renders video faster than it plays, supporting text-to-video-audio, image-to-video-audio, first/last-frame-to-video and more from one checkpoint.

  39. 42

    CodeVideoModel

    556code-video-model/CodeVideoModel · Python

    CodeVideoModel is a research pipeline that turns a text prompt into an editable Three.js scene codebase, converts that scene into a reference image, and then renders a final video with the MiniMax-H3 model. It also ships CodeVideoBench, a benchmark of 22 evaluation cases for this code-to-video workflow.

  40. 43

    Colab-notebooks

    556TeamAIQ/Colab-notebooks · Jupyter Notebook

    A curated collection of free, ready-to-run Google Colab and Kaggle notebooks, each wrapping a different AI tool for text-to-speech, voice cloning, image generation, video generation, or music generation.

  41. 44

    SparkDiffusion

    511AlibabaResearch/SparkDiffusion · Python

    SparkDiffusion is an acceleration framework for Diffusion Transformer (DiT) video-generation models. It combines sparse low-rank attention (RoLa), few-step distillation (CrossDistill), and custom GPU operators to deliver 200x+ faster inference than a dense multi-step baseline while preserving generation quality.

  42. 45

    h3lite

    459Rimagination/h3lite · Python

    H3 Lite is a Codex/WorkBuddy AI agent skill that drives local MiniMax H3 video generation through ComfyUI, picking a hardware-aware route and producing videos with native audio from a description.

  43. 46

    awesome-minimax-h3-integration

    442MiniMax-AI/awesome-minimax-h3-integration

    A community-maintained index of checkpoints, tools, and workflows for MiniMax H3, a video generation model that produces clips with native stereo audio from text, image, video, and audio inputs.

  44. 47

    ComfyUI-ALLinONE-MinimaxH3

    353LeonQ8/ComfyUI-ALLinONE-MinimaxH3 · JavaScript

    A single custom node for ComfyUI that packs the whole MiniMax H3 video pipeline into one node — pick a mode, drop in your prompt or references, and hit Generate.

  45. 48

    seedance-2.0-api

    329apiframe-ai/seedance-2.0-api

    This repo contains example scripts for calling ByteDance's Seedance 2.0 video generation model through the Apiframe API, covering text-to-video, image-to-video, and reference-to-video generation.

  46. 49

    DreamX-Creator

    312AMAP-ML/DreamX-Creator · Python

    DreamX-Creator is an open-source research framework for native joint audio-video generation: it produces video and a synchronized audio track together, refined up to 2K resolution.

  47. 50

    God-minmax-H3

    302LIUFelix2004/God-minmax-H3 · Shell

    A curated library of video-generation prompts for the MiniMax H3 (Hailuo 3.0) model, packaged as an installable Agent Skill, along with the prompt-writing/API reference docs and ffmpeg stitching scripts needed to turn those prompts into finished clips.

  48. 51

    ComfyUI-MiniMax-H3-LongMedia

    294vizart-vj/ComfyUI-MiniMax-H3-LongMedia · Python

    A set of production-oriented custom nodes for ComfyUI that run MiniMax H3 for long-form video and audio generation: reference editing, MultiClip planning, camera direction, fixed segmentation, lip-sync and redubbing, latent hi-res refinement, and low-VRAM-safe execution.

  49. 52

    interdimensional-game

    250blendi-remade/interdimensional-game · TypeScript

    It's LAST FRAME: a game that plays like a film generated in realtime. A video model renders every shot as you watch, and the model is the dice — if the frame shows your hero dangling from the ledge instead of making the leap, that's what happened.

  50. 53

    kid-papercraft

    243kaomei/kid-papercraft

    Kid Papercraft is an open-source AI Skill that turns a kid's name, age and photo into a 30-second stop-motion papercraft-style birthday video script, built on Google's Gemini Omni Flash model and starring popular cartoon characters like SpongeBob, Peppa Pig, Ultraman, PAW Patrol and Doraemon.

  51. 54

    infinite-livestream

    240reactor-team/infinite-livestream · Python

    An end-to-end, chat-driven, never-ending AI video broadcast: viewers type !prompt in Twitch or YouTube chat, an LLM expands the idea into a styled scene, the FastH3 model renders it as a 768p clip with synced audio, and it goes out continuously over RTMP.

  52. 55

    MiniMax-H3-Cloud

    239Sac-Y/MiniMax-H3-Cloud · JavaScript

    MiniMax H3 Cloud is a Codex plugin that generates MiniMax H3 videos using cloud GPUs (currently via the YunCloud/CompShare platform), handling instance selection, launching, ComfyUI workflow submission, MP4 download, and automatic shutdown.

  53. 56

    storycast

    236ilkerzg/storycast · TypeScript

    Storycast turns a topic you type into a narrated animated short film: pick a character, give it a topic, and it builds a script, keyframes, animated shots, narration, score, end card and subtitles end to end.

  54. 57

    OpenReels

    217tsensei/OpenReels · TypeScript

    OpenReels is an open-source AI pipeline that turns a single topic into a publish-ready vertical short video for YouTube Shorts, Instagram Reels, or TikTok, handling research, script, voiceover, visuals, music, captions, and final assembly in one command.

  55. 58

    h3-storyboard-skill

    178phileiny/h3-storyboard-skill

    It is a Claude Code skill that teaches the agent how to turn a script into MiniMax H3 shot lists, covering shot breakdown, beat counting, and facial/body performance direction so the emotional acting actually renders on screen.

  56. 59

    storyboard-ai

    175yogendra-yatnalkar/storyboard-ai · Python

    Storyboard AI is an agentic pipeline that turns a single text prompt into a fully narrated whiteboard animation video: it researches the topic, writes a script, plans scenes, generates whiteboard-style artwork, animates the drawing, synthesizes voiceover, and burns subtitles.

  57. 60

    unreel

    161blendi-remade/unreel · TypeScript

    UNREEL is a personal AI streaming service where nothing on a channel exists until you press play: a showrunner LLM writes an episode a few shots at a time while a video model renders each shot live, fast enough to stay ahead of playback.

  58. 61

    hyperflow

    146Video-Rebirth/hyperflow · Python

    An 8-step LoRA adapter for MiniMax-H3, a video+audio generation model, trained by data-free flow self-distillation. This repository holds the loader and example scripts that run it on the diffusers Modular Pipeline.

  59. 62

    reference-video-director

    136sgyno09-source/reference-video-director

    Reference Video Director is an Agent Skill that turns character, outfit, and scene reference images plus a rough story idea into a complete, ready-to-execute video-generation prompt, focusing on character consistency, couple POV shots, natural dialogue, micro-expressions, hand interaction, and camera continuity.

Often tagged together