What is this?
Karotte is an open-source framework from Preference Model for building robust reinforcement learning (RL) environments used to train aligned AI.
Karotte is an open-source framework from Preference Model for building robust reinforcement learning (RL) environments used to train aligned AI.Is Karotte a framework or a ready-made training app?It is a Python framework with a CLI (karotte run, karotte dashboard) for scaffolding, running, and inspecting RL environments and tasks, not a pre-trained model or standalone app.
It is a Python framework with a CLI (karotte run, karotte dashboard) for scaffolding, running, and inspecting RL environments and tasks, not a pre-trained model or standalone app.How do I create and run my first environment?Create an environment from the default template, then run karotte run to build the image and run the example task; the transcript is written to out/transcript.json and karotte dashboard out/ visualizes it.
Create an environment from the default template, then run karotte run to build the image and run the example task; the transcript is written to out/transcript.json and karotte dashboard out/ visualizes it.What do I need installed before running Karotte?You need Python 3.12+ and uv; each run executes inside a VM, using Apple container on macOS or Firecracker on Linux by default, though docker or podman also work.
You need Python 3.12+ and uv; each run executes inside a VM, using Apple container on macOS or Firecracker on Linux by default, though docker or podman also work.What's the catch if I distribute an image I build with Karotte?Built images are based on Amazon Linux 2023 and can bundle GPL/LGPL third-party software (gcc, GnuCOBOL, GNU Prolog, Free Pascal, Amazon Corretto, Clojure, and optionally Mojo); if you distribute such an image, you must comply with those licenses yourself.
Built images are based on Amazon Linux 2023 and can bundle GPL/LGPL third-party software (gcc, GnuCOBOL, GNU Prolog, Free Pascal, Amazon Corretto, Clojure, and optionally Mojo); if you distribute such an image, you must comply with those licenses yourself.What does karotte dashboard show?It visualizes the transcript file written by a run, letting you inspect how a task played out.
It visualizes the transcript file written by a run, letting you inspect how a task played out.Why does every task run inside a VM instead of directly on the host?Karotte isolates runs by default in a VM (Apple container on macOS or Firecracker on Linux) for robustness, though docker or podman can be used instead.
Karotte isolates runs by default in a VM (Apple container on macOS or Firecracker on Linux) for robustness, though docker or podman can be used instead.What third-party language toolchains can an environment include?The language-toolchains template can install gcc, GnuCOBOL, GNU Prolog, Free Pascal, Julia's bundled libraries, Amazon Corretto, and Clojure, with Mojo available but off by default.
The language-toolchains template can install gcc, GnuCOBOL, GNU Prolog, Free Pascal, Julia's bundled libraries, Amazon Corretto, and Clojure, with Mojo available but off by default.How often is Karotte updated?Every merge to the main branch triggers a new release.
Every merge to the main branch triggers a new release.Which topics is it in?deep-reinforcement-learning, ai-safety, virtualization, simulation, agent-framework, reinforcement-learning, sandbox, command-line-tool, framework, research, machine-learning, docker
deep-reinforcement-learning, ai-safety, virtualization, simulation, agent-framework, reinforcement-learning, sandbox, command-line-tool, framework, research, machine-learning, docker