Skip to content

Karotte

Karotte is an open-source framework for building robust RL environments, made by Preference Model.

You write tasks in Python. Karotte builds them into a sandbox, lets an agent work inside it through tools like bash, scores what it did, and records every message, tool call and score in a transcript. The agent runs as an unprivileged user with resource limits, a firewall and a disk quota, so a task can hand it a real shell without trusting it.

uv tool install karotte
karotte create-env my_env
  • Get started


    Install Karotte, create an environment and run the example task.

    Quick start

  • Write tasks


    Steps, judges, tools, and the data and dependencies a task needs.

    Tasks and steps

  • Run in a sandbox


    VMs and containers, what each one enforces, and the limits on the agent.

    Runtimes

  • Extend Karotte


    Your own templates, plugins, and a backend that collects runs.

    Plugins