OpenCreator README

The project's README from github.com/krillinai/OpenCreator. As one markdown file: README.md.

OpenCreator
The open-source AI workspace for creators

From scripts to video, images, voice, avatars, translation, and editing, Agents move the whole creative process forward in one workspace.

OpenCreator was formerly known as KrillinAI.

OpenCreator, formerly KrillinAI: #1 Repository of the Day on Trendshift

English | 简体中文 | 日本語 | 한국어 | Bahasa Indonesia | Español | Français | Deutsch | Português | Русский | العربية

GitHub Stars License Bilibili Discord QQ 群

Project Highlights · Creator Tools · Conversation & Workspace · Models Supported · Examples · Quick Start · Desktop · OpenCreator System Architecture · Development · Documentation · Contributors · Star History

OpenCreator Agent workspace

Project Overview

OpenCreator is built for individuals and teams who want to keep creative and development work running locally. Instead of reimplementing an Agent loop, it uses Codex CLI as the execution engine and adds a stable local Runtime, a visual workspace, and a Desktop host around it.

The product brings together two connected workflows:

Web is the single frontend implementation. Desktop loads the same Web build and adds only capabilities that require the operating system, such as directory selection, window lifecycle, tray behavior, and native notifications. With the same data and content viewport, both platforms share the same general UI and Runtime behavior.

Project Highlights

Creator Tools

The current release includes ten creator tools. Available models and services depend on your local Codex environment and AI service settings.

Open the Dashboard to write articles, Xiaohongshu posts, or short-video scripts; create stick figure animations; translate or download videos; generate thumbnails, images, or videos; and create voiceovers with Smart Dubbing.

OpenCreator Creator Dashboard

More creator tools are continuously being added.

Workspace Status Capabilities
Video Translation✅ AvailableImport local or public videos; transcribe with cloud or local Whisper services; use LLM context for subtitle segmentation, alignment, terminology, and translation; configure bilingual subtitles, dubbing or a custom voice sample, subtitle styles, landscape or portrait composition, and export SRT, audio, or video
Video Downloader✅ AvailableParse YouTube, Bilibili, and other supported public links, inspect available quality and format options, and download video or audio for later workflows
Thumbnail Generator✅ AvailableCombine a topic, video link, and optional reference image to generate and compare multiple content-thumbnail variations
Image Generation✅ AvailableGenerate with GPT Image from a prompt and optional reference image, configure the aspect ratio and output count, then preview and download individual images
Article Writer✅ AvailableTurn a topic, links, videos, or source documents into editable topic options, an outline, and a complete article; add generated images and export Markdown, HTML, or PDF
Xiaohongshu Posts✅ AvailableGenerate a complete Xiaohongshu post from a topic or source material, with controls for the target audience, post type, and length, then copy or download the result
Short Video Script✅ AvailableCreate a shoot-ready segmented script from a topic or source material, tailored to the audience, platform, duration, and tone, then edit, copy, or download it
Stick Figure Animation✅ AvailableTurn text or YouTube content into narration, voice, consistent-character storyboard visuals, subtitles, and a downloadable stick figure animation
Auto ClipsIn developmentAnalyze long videos, identify highlights, and turn selected moments into reusable short clips
Smart Dubbing✅ AvailableTurn scripts into voiceovers with selectable voices, pacing, and emotion controls
Video Generation✅ AvailableGenerate videos with Seedance from prompts and reference images, then preview, regenerate, and download each version
Digital AvatarIn developmentCombine scripts, voice, and avatar presentation to produce talking-head videos

Conversation and workspace, moving together

Describe tasks naturally, then step into visual tools whenever you need precise control.

OpenCreator conversation and visual workspace working together

Fine-grained workspace controls

Adjust subtitles, shots, audio, and generation settings precisely.

Flexible conversational edits

Tell the Agent what to change and refine the result in natural language.

Synchronized state

Conversation and workspace share the current task state, so nothing needs repeating.

Independent versions

Each revision creates a separate version without overwriting earlier results or settings.

Models Supported

Language model availability follows the Codex model catalog or your OpenAI-compatible provider. Image, video, voice, and transcription models use the services configured in Settings → AI Services.

Language models

OpenAI
GPT		 DeepSeek
DeepSeek		 Qwen
Qwen		 Kimi
Kimi		 Z.ai
GLM
xAI
Grok		 Doubao
Doubao		 ERNIE
ERNIE		 Tencent Hunyuan
Hunyuan

Image

OpenAI
GPT Image

Video

Seedance
Seedance

Voice and transcription

OpenAI
Whisper		 OpenAI
OpenAI TTS		 MiniMax
MiniMax		 Microsoft
Edge TTS		 Alibaba Cloud
Aliyun Speech

Examples

Video Translation

The public examples below were produced when OpenCreator was still named KrillinAI. They demonstrate the established subtitle alignment, translation, dubbing, and portrait-video workflow that OpenCreator's Video Translation workspace brings into a wider Agent workflow.

The project generated the subtitle file below from a 46-minute local video in one run, without manual subtitle adjustments. The published result shows complete coverage, no overlapping lines, natural segmentation, and high-quality translation.

OpenCreator subtitle alignment example

Subtitle Translation

https://github.com/user-attachments/assets/bba1ac0a-fe6b-4947-b58d-ba99306d0339

Dubbing

https://github.com/user-attachments/assets/0b32fad3-c3ad-4b6a-abf0-0865f0dd2385

Portrait Mode

https://github.com/user-attachments/assets/c2c7b528-0ef8-4ba9-b8ac-f9f92f6d4e71

These video examples and the subtitle alignment image were produced while OpenCreator still used the KrillinAI name.

Video Generation

Generate an AI video from a text prompt or reference image with Seedance. Configure the model, aspect ratio, resolution, and duration, then preview, regenerate, or download each version from the project workspace.

OpenCreator Video Generation with Seedance

Video Downloader

Analyze a public video link, compare the available formats, and download video or audio directly to the project.

OpenCreator Video Downloader format selection

Stick Figure Animation

OpenCreator developed this original character collection in collaboration with artist Harbor Hsia, creator of Stickman on Behance. The built-in cast keeps character identities consistent throughout the animation workflow.

OpenCreator stick figure characters developed with artists

Turn text or YouTube content into a complete animation through a guided workflow for script review, narration, timing, storyboard visuals, subtitles, rendering, and downloadable video output.

OpenCreator stick figure animation example frame

Quick Start

Prerequisites

Check your local environment first:

node --version
pnpm --version
codex --version

Run Web from Source

git clone https://github.com/krillinai/OpenCreator.git
cd OpenCreator
corepack enable
pnpm install
pnpm web:dev

Open http://127.0.0.1:19861/. The development server starts the local daemon on demand and injects a temporary Runtime token through a same-origin proxy, so no connection token needs to be copied manually.

On first launch, the Runtime prepares a default project. The composer is ready as soon as the connection completes. To work on the daemon only:

pnpm daemon:dev

The daemon listens only on a loopback address and prints its connection address and temporary token to stdout once.

Desktop

Desktop and the browser use the same React frontend from apps/web. General project, conversation, task, and settings behavior calls the same Daemon/API. Electron adds only real system paths, window controls, tray behavior, and native notifications.

Development Mode

pnpm desktop:dev

Local Packaging

Command Output
pnpm desktop:package A runnable directory for the current platform, intended for local verification
pnpm desktop:dist An installer for the current platform
pnpm desktop:release The formal release packaging entry point
pnpm --filter @opencreator/desktop verify:package Verification for an existing Desktop package
pnpm krillinai:package Separate KrillinAI Server and CLI archives for the selected platform

Desktop packaging rebuilds Web from the current workspace, records the commit, dirty state, platform, architecture, and Web hash, and compares apps/web/dist with the resources embedded in the application. Packaging fails if they differ. See the Desktop release runbook for signing, notarization, Windows builds, and release requirements.

Core Workflows

Conversations and Runs

  1. Select a project or start a new conversation.
  2. Enter a task and choose the permission level, Profile, model, and reasoning effort.
  3. While a Run is active, queue follow-up tasks or interrupt it and continue immediately.
  4. Use the Timeline to inspect reasoning summaries, tool calls, file changes, approvals, and final results.
  5. Use the task center to track running, completed, failed, and approval-blocked tasks globally.

Skills and MCP

Schedules and Dedicated Task Threads

OpenCreator System Architecture

OpenCreator treats the visual workspace and the Agent conversation as two interfaces to the same creative task, rather than two separate workflows. Each creator workflow is modeled as a state machine: source input, configuration, generation, review, revision, and export become explicit states and events. Workspace actions and conversational commands enter the same state machine, while the current step, configuration, progress, versions, and results are projected back into both interfaces. This keeps the workspace and conversation synchronized without introducing a second source of truth.

Creative work is iterative, so revisions do not overwrite the current result. Each correction or regeneration creates a new version from the existing workflow state, retaining the settings and outputs of earlier versions for review, comparison, and continued refinement.

+-----------------------------+     +------------------------------------+
| Browser Access              |     | Desktop Host                       |
|                             |     | Shared Web build + Electron        |
+--------------+--------------+     +------------------+-----------------+
               |                                       |
               +-------------------+-------------------+
                                   v
+----------------------------------------------------------------------------+
| Creator Experience / apps/web                                              |
| Dashboard / Creator Tools / Agent Conversation / Settings / Files          |

OpenCreator (krillinai/OpenCreator)

Searching Database…

13.6K ·GitHub
OpenCreator
Что это такое?OpenCreator (ранее KrillinAI) — это открытое рабочее пространство с ИИ для авторов, которое превращает сценарии в видео, изображения, озвучку, аватары, переводы и монтаж; агенты управляют всем творческим процессом из одного рабочего пространства.
Это самостоятельный фреймворк для агентов или приложение, построенное на чём-то другом?Это десктопное и веб-приложение, а не новый движок для агентов: в основе лежит Codex CLI, а поверх него добавлены локальный Runtime, визуальное рабочее пространство и десктопная оболочка (Desktop).
Как это запустить?Установите Node.js 22+ и закреплённый pnpm 9.15.0, убедитесь, что исполняемый файл Codex CLI доступен в PATH и вы в нём авторизованы, затем либо запустите веб-приложение из исходников, либо соберите или запустите десктопное приложение (pnpm desktop:package/desktop:dist).
Нужен ли мне аккаунт Codex CLI, чтобы пользоваться этим?Да — для реальных задач с моделями нужны рабочий исполняемый файл Codex CLI в терминале и действующий вход в Codex CLI; доступность языковых моделей зависит от каталога моделей Codex или вашего провайдера, совместимого с OpenAI.
Все ли десять инструментов для авторов готовы к работе?Восемь инструментов (перевод видео, загрузчик видео, генератор миниатюр, генерация изображений, написание статей, посты для Xiaohongshu, сценарии коротких видео, анимация фигурок из палочек, умный дубляж, генерация видео) доступны, а Автоклипы и Цифровой аватар пока в разработке.
Для кого это?Для частных лиц и команд, которые хотят вести творческое производство контента (видео, изображения, озвучка, статьи, посты в соцсетях) и агентные сценарии в стиле разработки локально, а не в облачном SaaS-сервисе.
Можно ли пользоваться этим в браузере или только как десктопным приложением?Веб — единственная реализация интерфейса; десктопное приложение (Electron) загружает ту же веб-сборку и добавляет только функции уровня ОС: выбор каталогов, поведение окна и трея, нативные уведомления.
Мои видео и изображения остаются на моём компьютере?Да — данные, вложения и журналы по умолчанию хранятся локально, есть запросы на подтверждение действий, а диагностический вывод очищен от конфиденциальных данных.
Какое отношение OpenCreator имеет к KrillinAI?OpenCreator — новое название проекта, который раньше назывался KrillinAI; публичные примеры перевода видео и некоторые команды упаковки (например, krillinai:package) по-прежнему используют старое название.
Какие модели ИИ и сервисы можно подключить?Языковые модели работают по каталогу моделей Codex или через любого провайдера, совместимого с OpenAI, включая GPT, DeepSeek, Qwen, Kimi, GLM, Grok, Doubao, ERNIE и Hunyuan; генерация изображений использует GPT Image, видео — Seedance, а озвучка и транскрибация — Whisper, OpenAI TTS, MiniMax, Edge TTS или Aliyun Speech.
Что делает умный дубляж?Превращает сценарий в готовую озвучку: можно выбрать голос, настроить темп и подобрать эмоции перед экспортом.
Какие языки интерфейса поддерживаются?Веб- и десктопные клиенты доступны на упрощённом китайском, английском или шведском языках; язык определяется автоматически по системе или выбирается вручную.
What are similar projects?VideoLingo, herk-edit-kit, Easel, dramaclaw, casbin-gateway, unsloth, pyvideotrans, Minke
Which topics is it in?dubbing, codex-cli, video-editing, whisper, localization, tts, content-creation, translation, gpt, qwen, video-generation, openai-compatible
Creator
krillinai
Size
382.8 MB
Stars
13.6K
Updated
CommitOct 17Releasev3.2.7Oct 16
Age
1y
Commits · 90 Days