Karotte¶
Karotte is an open-source framework for building robust RL environments, made by Preference Model.
You write tasks in Python.
Karotte builds them into a sandbox, lets an agent work inside it through tools like bash, scores what it did, and records every message, tool call and score in a transcript.
The agent runs as an unprivileged user with resource limits, a firewall and a disk quota, so a task can hand it a real shell without trusting it.
-
Get started
Install Karotte, create an environment and run the example task.
-
Write tasks
Steps, judges, tools, and the data and dependencies a task needs.
-
Run in a sandbox
VMs and containers, what each one enforces, and the limits on the agent.
-
Extend Karotte
Your own templates, plugins, and a backend that collects runs.