OpenCreator README

The project's README from github.com/krillinai/OpenCreator. As one markdown file: README.md.

OpenCreator
The open-source AI workspace for creators

From scripts to video, images, voice, avatars, translation, and editing, Agents move the whole creative process forward in one workspace.

OpenCreator was formerly known as KrillinAI.

OpenCreator, formerly KrillinAI: #1 Repository of the Day on Trendshift

English | 简体中文 | 日本語 | 한국어 | Bahasa Indonesia | Español | Français | Deutsch | Português | Русский | العربية

GitHub Stars License Bilibili Discord QQ 群

Project Highlights · Creator Tools · Conversation & Workspace · Models Supported · Examples · Quick Start · Desktop · OpenCreator System Architecture · Development · Documentation · Contributors · Star History

OpenCreator Agent workspace

Project Overview

OpenCreator is built for individuals and teams who want to keep creative and development work running locally. Instead of reimplementing an Agent loop, it uses Codex CLI as the execution engine and adds a stable local Runtime, a visual workspace, and a Desktop host around it.

The product brings together two connected workflows:

Web is the single frontend implementation. Desktop loads the same Web build and adds only capabilities that require the operating system, such as directory selection, window lifecycle, tray behavior, and native notifications. With the same data and content viewport, both platforms share the same general UI and Runtime behavior.

Project Highlights

Creator Tools

The current release includes ten creator tools. Available models and services depend on your local Codex environment and AI service settings.

Open the Dashboard to write articles, Xiaohongshu posts, or short-video scripts; create stick figure animations; translate or download videos; generate thumbnails, images, or videos; and create voiceovers with Smart Dubbing.

OpenCreator Creator Dashboard

More creator tools are continuously being added.

Workspace Status Capabilities
Video Translation✅ AvailableImport local or public videos; transcribe with cloud or local Whisper services; use LLM context for subtitle segmentation, alignment, terminology, and translation; configure bilingual subtitles, dubbing or a custom voice sample, subtitle styles, landscape or portrait composition, and export SRT, audio, or video
Video Downloader✅ AvailableParse YouTube, Bilibili, and other supported public links, inspect available quality and format options, and download video or audio for later workflows
Thumbnail Generator✅ AvailableCombine a topic, video link, and optional reference image to generate and compare multiple content-thumbnail variations
Image Generation✅ AvailableGenerate with GPT Image from a prompt and optional reference image, configure the aspect ratio and output count, then preview and download individual images
Article Writer✅ AvailableTurn a topic, links, videos, or source documents into editable topic options, an outline, and a complete article; add generated images and export Markdown, HTML, or PDF
Xiaohongshu Posts✅ AvailableGenerate a complete Xiaohongshu post from a topic or source material, with controls for the target audience, post type, and length, then copy or download the result
Short Video Script✅ AvailableCreate a shoot-ready segmented script from a topic or source material, tailored to the audience, platform, duration, and tone, then edit, copy, or download it
Stick Figure Animation✅ AvailableTurn text or YouTube content into narration, voice, consistent-character storyboard visuals, subtitles, and a downloadable stick figure animation
Auto ClipsIn developmentAnalyze long videos, identify highlights, and turn selected moments into reusable short clips
Smart Dubbing✅ AvailableTurn scripts into voiceovers with selectable voices, pacing, and emotion controls
Video Generation✅ AvailableGenerate videos with Seedance from prompts and reference images, then preview, regenerate, and download each version
Digital AvatarIn developmentCombine scripts, voice, and avatar presentation to produce talking-head videos

Conversation and workspace, moving together

Describe tasks naturally, then step into visual tools whenever you need precise control.

OpenCreator conversation and visual workspace working together

Fine-grained workspace controls

Adjust subtitles, shots, audio, and generation settings precisely.

Flexible conversational edits

Tell the Agent what to change and refine the result in natural language.

Synchronized state

Conversation and workspace share the current task state, so nothing needs repeating.

Independent versions

Each revision creates a separate version without overwriting earlier results or settings.

Models Supported

Language model availability follows the Codex model catalog or your OpenAI-compatible provider. Image, video, voice, and transcription models use the services configured in Settings → AI Services.

Language models

OpenAI
GPT
DeepSeek
DeepSeek
Qwen
Qwen
Kimi
Kimi
Z.ai
GLM
xAI
Grok
Doubao
Doubao
ERNIE
ERNIE
Tencent Hunyuan
Hunyuan

Image

OpenAI
GPT Image

Video

Seedance
Seedance

Voice and transcription

OpenAI
Whisper
OpenAI
OpenAI TTS
MiniMax
MiniMax
Microsoft
Edge TTS
Alibaba Cloud
Aliyun Speech

Examples

Video Translation

The public examples below were produced when OpenCreator was still named KrillinAI. They demonstrate the established subtitle alignment, translation, dubbing, and portrait-video workflow that OpenCreator's Video Translation workspace brings into a wider Agent workflow.

The project generated the subtitle file below from a 46-minute local video in one run, without manual subtitle adjustments. The published result shows complete coverage, no overlapping lines, natural segmentation, and high-quality translation.

OpenCreator subtitle alignment example

Subtitle Translation

https://github.com/user-attachments/assets/bba1ac0a-fe6b-4947-b58d-ba99306d0339

Dubbing

https://github.com/user-attachments/assets/0b32fad3-c3ad-4b6a-abf0-0865f0dd2385

Portrait Mode

https://github.com/user-attachments/assets/c2c7b528-0ef8-4ba9-b8ac-f9f92f6d4e71

These video examples and the subtitle alignment image were produced while OpenCreator still used the KrillinAI name.

Video Generation

Generate an AI video from a text prompt or reference image with Seedance. Configure the model, aspect ratio, resolution, and duration, then preview, regenerate, or download each version from the project workspace.

OpenCreator Video Generation with Seedance

Video Downloader

Analyze a public video link, compare the available formats, and download video or audio directly to the project.

OpenCreator Video Downloader format selection

Stick Figure Animation

OpenCreator developed this original character collection in collaboration with artist Harbor Hsia, creator of Stickman on Behance. The built-in cast keeps character identities consistent throughout the animation workflow.

OpenCreator stick figure characters developed with artists

Turn text or YouTube content into a complete animation through a guided workflow for script review, narration, timing, storyboard visuals, subtitles, rendering, and downloadable video output.

OpenCreator stick figure animation example frame

Quick Start

Prerequisites

Check your local environment first:

node --version
pnpm --version
codex --version

Run Web from Source

git clone https://github.com/krillinai/OpenCreator.git
cd OpenCreator
corepack enable
pnpm install
pnpm web:dev

Open http://127.0.0.1:19861/. The development server starts the local daemon on demand and injects a temporary Runtime token through a same-origin proxy, so no connection token needs to be copied manually.

On first launch, the Runtime prepares a default project. The composer is ready as soon as the connection completes. To work on the daemon only:

pnpm daemon:dev

The daemon listens only on a loopback address and prints its connection address and temporary token to stdout once.

Desktop

Desktop and the browser use the same React frontend from apps/web. General project, conversation, task, and settings behavior calls the same Daemon/API. Electron adds only real system paths, window controls, tray behavior, and native notifications.

Development Mode

pnpm desktop:dev

Local Packaging

Command Output
pnpm desktop:package A runnable directory for the current platform, intended for local verification
pnpm desktop:dist An installer for the current platform
pnpm desktop:release The formal release packaging entry point
pnpm --filter @opencreator/desktop verify:package Verification for an existing Desktop package
pnpm krillinai:package Separate KrillinAI Server and CLI archives for the selected platform

Desktop packaging rebuilds Web from the current workspace, records the commit, dirty state, platform, architecture, and Web hash, and compares apps/web/dist with the resources embedded in the application. Packaging fails if they differ. See the Desktop release runbook for signing, notarization, Windows builds, and release requirements.

Core Workflows

Conversations and Runs

  1. Select a project or start a new conversation.
  2. Enter a task and choose the permission level, Profile, model, and reasoning effort.
  3. While a Run is active, queue follow-up tasks or interrupt it and continue immediately.
  4. Use the Timeline to inspect reasoning summaries, tool calls, file changes, approvals, and final results.
  5. Use the task center to track running, completed, failed, and approval-blocked tasks globally.

Skills and MCP

Schedules and Dedicated Task Threads

OpenCreator System Architecture

OpenCreator treats the visual workspace and the Agent conversation as two interfaces to the same creative task, rather than two separate workflows. Each creator workflow is modeled as a state machine: source input, configuration, generation, review, revision, and export become explicit states and events. Workspace actions and conversational commands enter the same state machine, while the current step, configuration, progress, versions, and results are projected back into both interfaces. This keeps the workspace and conversation synchronized without introducing a second source of truth.

Creative work is iterative, so revisions do not overwrite the current result. Each correction or regeneration creates a new version from the existing workflow state, retaining the settings and outputs of earlier versions for review, comparison, and continued refinement.

+-----------------------------+     +------------------------------------+
| Browser Access              |     | Desktop Host                       |
|                             |     | Shared Web build + Electron        |
+--------------+--------------+     +------------------+-----------------+
               |                                       |
               +-------------------+-------------------+
                                   v
+----------------------------------------------------------------------------+
| Creator Experience / apps/web                                              |
| Dashboard / Creator Tools / Agent Conversation / Settings / Files          |

OpenCreator (krillinai/OpenCreator)

Searching Database…

这是什么?OpenCreator(原名 KrillinAI)是一款面向创作者的开源 AI 工作台,可将脚本转化为视频、图片、语音、数字人、翻译和剪辑成品,并由智能体(Agents)在同一个工作区中驱动整个创作流程。
它是独立的智能体框架,还是基于其他东西构建的应用?它是桌面和 Web 应用,而不是新的智能体引擎。它以 Codex CLI 作为执行引擎,并在其之上增加本地 Runtime、可视化工作区和 Desktop 宿主。
我该怎样让它跑起来?安装 Node.js 22+ 和固定版本的 pnpm 9.15.0,确保 Codex CLI 可执行文件已加入 PATH 且登录有效,然后从源码运行 Web 应用,或构建/启动 Desktop 应用(pnpm desktop:package/desktop:dist)。
使用它需要 Codex CLI 账号吗?需要。终端中必须有可用的 Codex CLI 可执行文件,并且有有效的 Codex CLI 登录,才能执行真实的模型任务;可用的语言模型取决于 Codex 模型目录或你所用的 OpenAI 兼容服务商。
十个创作者工具都能直接使用吗?八个工具可以使用(视频翻译、视频下载器、缩略图生成器、图片生成、文章写作、小红书笔记、短视频脚本、火柴人动画、智能配音、视频生成),但自动剪辑和数字人仍在开发中。
这款产品面向哪些人?面向希望在本地运行创作内容生产(视频、图片、语音、文章、社交帖子)以及开发式智能体工作流,而不是使用托管 SaaS 工具的个人和团队。
我可以在浏览器里使用,还是只能用桌面应用?Web 是唯一的前端实现。Desktop 应用(Electron)加载的是同一套 Web 构建,只额外增加目录选择、窗口/托盘行为和原生通知等操作系统级功能。
我的视频和图片数据会留在我的电脑上吗?会。数据、附件和日志默认保存在本地,并带有审批提示和脱敏的诊断输出。
OpenCreator 和 KrillinAI 是什么关系?OpenCreator 是 KrillinAI 项目的新名称。公开的视频翻译示例以及一些打包命令(如 krillinai:package)仍然沿用旧名称。
我可以接入哪些 AI 模型和服务?语言模型遵循 Codex 模型目录,或任何 OpenAI 兼容服务商,包括 GPT、DeepSeek、Qwen、Kimi、GLM、Grok、Doubao、ERNIE 和 Hunyuan;图片生成使用 GPT Image,视频使用 Seedance,语音和转写使用 Whisper、OpenAI TTS、MiniMax、Edge TTS 或 Aliyun Speech。
智能配音是做什么的?它可以把脚本变成完整的配音,你可以在导出前选择声音、调整语速节奏并调节情绪。
支持哪些界面语言?Web 和 Desktop 客户端提供简体中文、英文或瑞典语界面,可自动识别系统语言,也可以手动选择。
Creator
krillinai
Size
392.3 MB
Stars
13.7K
Age
1y
Commits · 90 Days