krita-ai-diffusion README

The project's README from github.com/Acly/krita-ai-diffusion. As one markdown file: README.md.

Generative AI for Krita

✨Features | ⭳ Download | 🛠️Installation | 🎞️ Video | 🖼️Gallery | 📖User Guide | 💬Discussion | 🗣️Discord

This is a plugin to use generative AI in image painting and editing workflows from within Krita. Visit www.interstice.cloud for an introduction. Learn how to install and use it on docs.interstice.cloud.

The main goals of this project are:

Watch video demo

Features

Getting Started

See the Plugin Installation Guide for instructions.

A concise (more technical) version is below:

Operating System

Windows, Linux, MacOS

Hardware support

To run locally a powerful graphics card with at least 6 GB VRAM (NVIDIA) is recommended. Otherwise generating images will take very long or may fail due to insufficient memory!

NVIDIA GPUsupported via CUDA (Windows/Linux)
AMD GPUsupported via ROCm (Windows/Linux)
Intel GPUsupported via XPU (Windows/Linux)
Apple SiliconMPS on macOS 14+
CPUsupported, but very slow

Installation

  1. If you haven't yet, go and install Krita! Required version: 5.2.0 or newer
  2. Download the plugin.
  3. Start Krita and install the plugin via Tools ▸ Scripts ▸ Import Python Plugin from File...
  4. Restart Krita and create a new document or open an existing image.
  5. To show the plugin docker: Settings ‣ Dockers ‣ AI Image Generation.
  6. In the plugin docker, click "Configure" to start local server installation or connect.

[!NOTE] If you encounter problems please check the FAQ / list of common issues for solutions.

Reach out via discussions, our Discord, or report an issue here. Please note that official Krita channels are not the right place to seek help with issues related to this extension!

Optional: Custom ComfyUI Server

The plugin uses ComfyUI as backend. As an alternative to the automatic installation, you can install it manually or use an existing installation. If the server is already running locally before starting Krita, the plugin will automatically try to connect. Using a remote server is also possible this way.

Please check the list of required extensions and models to make sure your installation is compatible.

Optional: Object selection tools (Segmentation)

If you're looking for a way to easily select objects or remove background in the image, there is a separate plugin which adds AI segmentation tools.

Contributing

Contributions are very welcome! Check the contributing guide to get started.

Live painting with regions (Click for video) Watch video demo

Inpainting on a photo using a realistic model

Reworking and adding content to an AI generated image

Adding detail and iteratively refining small parts of the image

Modifying the pose vector layer to control character stances (Click for video) Watch video demo

Control layers: Scribble, Line art, Depth map, Pose Scribble control layer Line art control layer Depth map control layer Pose control layer

Technology

krita-ai-diffusion (Acly/krita-ai-diffusion)

Searching Database…

10.7K ·GitHub
Krita-ai-diffusion
What is this?A free, open-source Krita plugin that brings generative AI into painting and editing workflows: inpaint, outpaint, live-paint and upscale images with an optional text prompt, running on your own hardware.
Is this a standalone app or something inside Krita?It is a Python plugin for Krita, not a standalone app: it adds an 'AI Image Generation' docker panel inside Krita and uses ComfyUI as its generation backend, which it can install and manage for you.
How do I install the plugin?Install Krita 5.2.0 or newer, download the plugin ZIP, then in Krita use Tools ▸ Scripts ▸ Import Python Plugin from File..., restart, enable the AI Image Generation docker and click Configure to install the local server or connect.
What hardware do I need to run it locally?A powerful GPU with at least 6 GB VRAM is recommended: NVIDIA via CUDA, AMD via ROCm or Intel via XPU on Windows/Linux, Apple Silicon via MPS on macOS 14+. CPU-only works but is very slow.
What if my computer is not powerful enough for local generation?Weak hardware means very slow generation or memory failures. Alternatives: point the plugin at an existing local or remote ComfyUI server, or use the optional cloud generation to start without heavy hardware investment.
Does my artwork stay on my machine?It can: the project is committed to open-source models and everything runs locally on your own hardware. Cloud generation is only an optional convenience for getting started quickly.
Why build this instead of using a standalone AI image generator?Most generation tools focus heavily on AI parameters; this project aims to be an unobtrusive tool that integrates with Krita's editing workflows, so you draw, paint, edit and generate seamlessly without worrying about resolution and technical details.
How precise is the control over what the AI generates?Very: you can restrict generation to selections, refine existing content with a variable degree of strength, focus text prompts on image regions, and guide results with reference images, sketches, line art or depth maps.
Can it also select objects or remove backgrounds?Yes, through a separate companion plugin that adds AI segmentation tools for easily selecting objects or removing the background in an image.
What are similar projects?stable-diffusion-webui, ComfyUI, stable-diffusion-webui-forge, stable-diffusion, sd-webui-controlnet, kohya_ss, InvokeAI, stable-diffusion-webui-colab
Which topics is it in?controlnet, ai-art, inpainting, upscaling, diffusion, amd, stable-diffusion, text-to-image, image-generation, apple-silicon, nvidia, customization
Creator
Acly
Size
32.7 MB
Stars
10.7K
Updated
CommitOct 03Releasev1.53.0Aug 22
Age
3y
Commits · 90 Days