Simulation RL Environments
Real-world simulation RL environments for AI agents
Simulation RL environments grounded in real-world data: ports and airline operations. Interactive demos, datasets, model evaluations and rollouts.
Real-world simulation RL environments for AI agents
Note Start here: the Simulation RL Environments article. Explore PortSim and AirOpsEnv, watch the launch videos, and inspect the full AirOpsEnv v3 results: six models across 24 storm dates, recorded rollouts, and downloadable evaluation data.
Run an airline's control center through a storm day
Note AirOpsEnv v3: three communicating agents run airline operations, crew and customer desks through storm days. Grounded in JFK + Boston flight records, FAA advisories and NWS weather. Built by Edgar Arakelyan (@earakely) with @agutmanstein, a licensed pilot, in collaboration with Scale AI (@scale_ai) and Hugging Face. Built using AgentEnv Framework: https://agentenvframework.com
Note AirOpsEnv v3: 44 training dates, 24 storm evaluation dates and 2 calm controls. Six-model, three-agent leaderboard plus a one-agent comparison: 168 scored v3 runs with recorded actions and messages. Includes tasks, reference plans and replay data. Crew rosters and passenger itineraries are generated from public records.
Port of Barcelona weeks on AgentEnv, replayed in 3D
Note PortSimEnv v2–v5 on AgentEnv, by Edgar Arakelyan (Scale AI): every run replayed on the 3D quay.
Note PortSimEnv v2–v5, by Edgar Arakelyan (Scale AI): the live, marine, wind and lines weeks, references and every recorded run.
Dock planning on real Port of Barcelona calls
Note PortSimEnv v1: the OpenEnv environment, editor, 3D viewer and eval explorer
Note PortSimEnv v1: tasks, the source port calls, eval rollouts
PortSimEnv v1 eval, every model rollout in 3D
Note PortSimEnv v1 eval: the eval table and every model rollout in 3D