12 days ago
-
Eval cells now record turns/tool_calls/completion+prompt tokens; summary gets efficiency-vs-base ratios
13 days ago
-
Eval robustness: fresh HarborEnv client per rollout (openenv reconnect bug); failed checkpoint evals retried next poll
-
Add per-checkpoint eval worker (eval_watch.py + run_eval_watch.sh); ONLY_MODEL mode in eval_adapter.py
17 days ago
-
eval: pass purpose=eval (server requires it with eval_sampling)
-
Add held-out eval (base vs adapter) + standalone eval job + final eval stage in training job