8 Commits

Author SHA1 Message Date
bench
a263374839 板上会话目录:失败也删,只在守护进程可能还活着时留空目录;进入时清 6 小时没人动的旧目录;磁盘满归瞬态
10-15 S600 的 /userdata 两次写满(01:31–03:25、06:50–06:56),05 的 07-board/08-eval
报 No space left on device,却记成 unknown。
- 原来任何失败都把 eval-* 目录整个留在板上,没人回头看。现在只有清理没确认时才保留目录和回执,
  因为守护进程可能还在写回执和板级隔离标记;其余内容照删(solo.r50 一块输出 12 GB)。
- 容器被杀时 close() 不会运行:每个新会话先删 6 小时没人动过的 eval-* 目录,并把删了什么写进日志。
- No space left on device → disk_full(瞬态)。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 09:41:29 +08:00
bench
8a14b41abf Salty 容器里的板上操作按阶段截止时间收紧时限
本地执行时 board_perf 按执行状态把板上操作的时限收进阶段截止时间之内;Salty 容器里
没有执行状态,固定按 3600 秒,比 07-board 的 1 小时阶段时限还长。板上一卡住,容器就先被
阶段时限结束,清理回执带不回来,stageworker 只能判 BOARD_CLEANUP_UNCONFIRMED 并作废整条轨迹
(10-12 到 10-14 有 12 次,同一模型平时 0.2–2.6 分钟就完成)。现在 salty_remote 把阶段的
截止时刻(墙钟)放进打包的环境变量,board_perf 预留 600 秒把结果和回执交回去,超时就作为普通的 FAIL 结束,agent 可以重试。
VM 与 Salty 时钟偏差约 1 秒。两处都随阶段打包,部署即生效。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 15:49:54 +08:00
80a8e246c0 fix: release board slots whose holder died without a cleanup receipt
When board ssh drops during cleanup, no receipt is written and the board
lease stayed quarantined forever; all 8 boards ended up locked and every
rollout timed out in the board queue (QUEUE_DEADLINE_EXCEEDED).

reconcile_leases now probes the board when the holder is dead, the
execution is terminal and no local process remains. If the board runs
nothing but sshd/ps the slot is released and board-release-<slot>.json
records the evidence; busy or unreachable boards stay quarantined.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-04 08:07:22 +08:00
3a30aac297 fix: persist board dispatch evidence before remote execution 2026-09-29 16:33:16 +08:00
e1e73816af fix: recover stage registration and reclaim completed local leases 2026-09-29 12:55:35 +08:00
Codex
068c56043f Merge managed natural-agent runtime into retained benchmark mainline 2026-09-22 15:35:28 +08:00
bench
d309109f2b pre-grind snapshot 2026-09-19: batches 1-7 adapters/probes/recipes + eval additive changes 2026-09-19 17:52:03 +08:00
bench
4a0e7d521f fix: run S100P board accuracy through the existing pipeline 2026-09-16 02:17:36 +08:00