20 KiB
20 KiB
Codex 验证输出归档
远端 2026-09-15 实测;只收 stdout/stderr 摘要,不包含凭证或完整轨迹。
regression-final.txt
....{"dataset_id": "test", "runs": ["r"], "reward_recipe": "v0.1", "created_at": 1789447159.5777326, "filters": {"min_agent_version": 5, "agent_version": null, "agent_version_mode": "minimum", "annotations_read": true, "dropped_counts_overlap": true, "policy": null, "include_timeout": false, "purpose": "all", "min_reward": null}, "stats": {"scanned": 1, "written": 1, "dropped": {}, "review": 0, "by_terminal": {"FAIL": 1}, "sft_eligible": 0}}
snapshot
......
----------------------------------------------------------------------
Ran 10 tests in 1.229s
OK
ok read job.json → allow
ok read own agent/prompt → allow
ok read own stages log → allow
ok read data → allow
ok read cache onnx → allow
ok read horizon skill → allow
ok read oracle (e2e) → block
ok read oracle (repair) → allow
ok read sibling claim → block
ok read sibling via rollouts/ → block
ok read harness → block
ok read state sqlite → block
ok read ~/.pi → block
ok read toolchain src → block
ok read /usr/lib → allow
ok read job dir itself → block
ok read env.local → block
ok read state realpath → block
ok read own work dir → allow
ok read sibling work dir → block
ok read work_root → block
ok read data realpath($HOME 默认拒:合成路径没有真实软链,落到 HOME 兜底 → block;真机上 bench/data 的 realpath 已进白名单) → block
ok write ws → allow
ok write ws abs → allow
ok write agent dir → block
ok write job.json → block
ok cat ../../oracle → block
ok python open oracle → block
ok cd && cat oracle → block
ok cd;cd;head oracle → block
ok ls ../../../ora* → block
ok find .. -exec cat (own rollout only) → allow
ok find ../.. -exec cat → block
ok cat sibling claim → block
ok ls sibling ws → block
ok cd only → block
ok pushd → block
ok cd in subshell → block
ok cd to own workspace (abs) → allow
ok cd to own workspace (trailing slash) → allow
ok cd . → allow
ok cd to ws subdir → block
ok cd ws then cd .. → block
ok cd ws ; cat oracle → block
ok word containing cd → allow
ok bench stage run → allow
ok bench stage run abs → allow
ok cat job.json → allow
ok tail own stage log → allow
ok ls skills → allow
ok python one-liner no path → allow
ok redirect to /dev/null → allow
ok version-like token → allow
ok url → allow
ok read own rollout.json → allow
ok ls ..(own rollout) → allow
ok ls ../.. (rollouts dir) → block
ok repair reads oracle yaml → allow
all passed
budget hard cap: PASS (59 continues; 60 exits 75; no grace)
(node:1943199) ExperimentalWarning: Type Stripping is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
jail-smoke-final.txt
fixture: /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01
PASS other job oracle hidden
PASS own e2e oracle hidden
PASS sibling hidden
PASS state sqlite hidden
PASS real state sqlite hidden
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/registry/gates.yaml
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/harness/gates.py
PASS write denied /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--resnet18--nash-m--ptq--int8/oracle/result.json
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/state/x
PASS write denied /home/ming01.wang/bench-state/x
PASS write denied /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01/rollout.json
PASS workspace writable
PASS stdlib stage status executes
PASS cannot undo read-only mounts
PASS host processes hidden
result: OK exit_code: 0 error_class: None 0.1s
stdout: /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/stdout.log
stderr: /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/stderr.log
meta: /home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/meta.json
measurements: {"calib": {"calib_dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/data/calib/cls/1x3x224x224", "calib_npy_dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/data/calib/cls/1x3x224x224/npy_f32", "calib_source": "t0", "calib_n": 128, "calib_manifest_sha": "608d4cc667290ebc79571655d1f7a732503a56768837704ce6051427b0fd946e", "compile_yaml": "/home/ming01.wang/bench-state/guard-smoke/queue-1789447203900725689/runs/rSmoke/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/compile.yaml"}}
QUEUE RESULT: OK (real calibrate; isolated fixture DB)
smoke dir: /mnt/data/ming01.wang/model-compile-hbdk/bench/state/guard-smoke/20260915-124028/runs/rS/cls--smoke--nash-e--ptq--int8/rollouts/01
---- pi.stderr (扩展加载失败会在这里)
---- guard.log(每次拒绝一行)
{"ts":1789447236.207,"kind":"init","detail":"{\"mode\":\"e2e\",\"deny_extra\":[\"/home/ming01.wang/bench-state\"],\"allow_extra\":[]}"}
{"ts":1789447302.937,"kind":"deny-bash-read","detail":"cat ../../../oracle/result.json"}
{"ts":1789447302.937,"kind":"deny-bash-read","detail":"cd ../../.. && cat oracle/result.json"}
{"ts":1789447302.937,"kind":"deny-bash-read","detail":"ls ../../../ora*"}
{"ts":1789447308.73,"kind":"deny-bash-read","detail":"find ../../.. -name result.json -exec cat {} +"}
{"ts":1789447308.73,"kind":"deny-bash-read","detail":"cat ../../00/claim.json"}
{"ts":1789447308.73,"kind":"deny-bash-read","detail":"cat ../../00/workspace/compile.yaml"}
{"ts":1789447308.73,"kind":"deny-bash-read","detail":"ls ~/toolchains"}
{"ts":1789447314.807,"kind":"deny-bash-read","detail":"cd /mnt/data/ming01.wang/model-compile-hbdk/bench/state/guard-smoke/20260915-124028/runs/rS/cls--smoke--nash-e--ptq--int8/rollouts/01/workspace && ls"}
{"ts":1789447314.808,"kind":"deny-bash-read","detail":"cd /mnt/data/ming01.wang/model-compile-hbdk/bench/state/guard-smoke/20260915-124028/runs/rS/cls--smoke--nash-e--ptq--int8/rollouts/01/workspace && cat ../../../oracle/result.json"}
{"ts":1789447322.62,"kind":"deny-read","detail":"../../../oracle/result.json"}
{"ts":1789447328.072,"kind":"deny-write","detail":"../../escape.txt"}
---- 泄漏检查(下面两个词不应出现在任何 tool result 里)
tool calls=16 blocked by path-guard=11 leaks={'ORACLE-SHOULD-NOT-LEAK': 0, 'SIBLING-SHOULD-NOT-LEAK': 0}
RESULT: OK
---- 文件侧:escape.txt 不应存在,note.txt/done.txt 应存在
budget.json
claim.json
done.txt
guard.log
note.txt
export.txt
{"dataset_id": "test-codex-20260915-1232", "runs": ["r20260915-03"], "reward_recipe": "v0.1", "created_at": 1789446695.5635073, "filters": {"min_agent_version": 5, "agent_version": null, "agent_version_mode": "minimum", "annotations_read": true, "dropped_counts_overlap": true, "policy": null, "include_timeout": false, "purpose": "all", "min_reward": null}, "stats": {"scanned": 11, "written": 0, "dropped": {"old_version": 11, "contaminated": 7, "stalled_killed": 3}, "review": 0, "by_terminal": {}}}
void-skip.txt
skipped VOID dataset: ds20260915-01
heartbeat.txt
cls--efficientnet.b0--nash-e--ptq--int8 rollout#03: ZOMBIE RUNNING without pi process
heartbeat_exit=1
watch-final.txt
bench watch · run r20260915-03 · 2026-09-15 12:36:39 · P4 batch 1: torchvision cls 48 + ultralytics det 15 × 3 march (ready=63)
jobs: FAIL=86 ORACLE_RUNNING=8 PASS=3 PENDING=92 (registry: ready=63, needs_adapter=257, needs_eval=15, skip=3)
pools: gpu=0/4 cpu=9/10 board=0/1 agent=1/3
ETA: 剩 92 个 job × 平均 1h34m / 并行 9 ≈ 16h09m(已完成 89 个)
RUNNING (9)
job_id stage att elapsed est log idle flag
cls--densenet201--nash-e--ptq--int8 05-compile a00 1h36m 30m00s 19m32s 🔥 看门狗即将介入
cls--densenet161--nash-e--ptq--int8 05-compile a01 58m36s 30m00s 30m33s 🔥 看门狗即将介入
cls--densenet169--nash-m--ptq--int8 05-compile a01 58m06s 29m56s 1s
cls--densenet161--nash-m--ptq--int8 05-compile a01 57m12s 30m00s 27m37s 🔥 看门狗即将介入
cls--densenet201--nash-m--ptq--int8 05-compile a01 35m46s 30m00s 25s
cls--regnet.y.3.2gf--nash-e--ptq--int8 05-compile a00 19m11s 30m00s 12m31s 🔥 看门狗即将介入
cls--regnet.y.3.2gf--nash-m--ptq--int8 05-compile a00 17m28s 30m00s 10m22s 🔥 看门狗即将介入
cls--resnet101--nash-e--ptq--int8 05-compile a00 7m02s 30m00s 21s
cls--efficientnet.b0--nash-e--ptq--int8 05-compile a05r03 3m02s 10m09s 3s
最近完成
cls--efficientnet.b0--nash-e--ptq--int8 04-calibrate OK 3s
cls--efficientnet.b0--nash-e--ptq--int8 08-eval OK 5m37s
cls--resnet101--nash-e--ptq--int8 04-calibrate OK 2s
cls--resnet101--nash-e--ptq--int8 03-export OK 32s
cls--resnet101--nash-e--ptq--int8 02-baseline OK 1m03s
cls--resnet101--nash-e--ptq--int8 01-fetch OK 33s
cls--regnet.y.3.2gf--nash-p--ptq--fp16int8 05-compile FAIL unknown 33s
cls--efficientnet.b0--nash-e--ptq--int8 08-eval OK 3m35s
FAIL by error_class: unknown@05-compile=31 (none)@None=21 stalled@05-compile=11 numeric_mismatch@None=8 accuracy_drop@None=5 accuracy_collapse@None=4 export_fail@03-export=3 unsupported_op@05-compile=2 unknown@01-fetch=1
audit-final.json
[
{
"kk": 0,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 37,
"tool_calls": 50,
"blocked": 0,
"timeout_reason": "max_tokens 200000",
"contaminated": true,
"stalled_killed": true,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×6",
"oracle_content_match×3",
"harness/toolchain_read×8",
"stalled_killed",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--convnext.tiny--nash-e--ptq--int8/rollouts/00",
"job_id": "cls--convnext.tiny--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 1,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 43,
"tool_calls": 55,
"blocked": 1,
"timeout_reason": "max_turns 40",
"contaminated": true,
"stalled_killed": true,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×1",
"oracle_content_match×1",
"harness/toolchain_read×50",
"stalled_killed",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--convnext.tiny--nash-e--ptq--int8/rollouts/01",
"job_id": "cls--convnext.tiny--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 2,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 42,
"tool_calls": 58,
"blocked": 1,
"timeout_reason": "max_turns 40",
"contaminated": true,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×10",
"oracle_content_match×2",
"harness/toolchain_read×9",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--convnext.tiny--nash-e--ptq--int8/rollouts/02",
"job_id": "cls--convnext.tiny--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 3,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 13,
"tool_calls": 20,
"blocked": 0,
"timeout_reason": "max_tokens 200000",
"contaminated": true,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×3",
"oracle_content_match×1",
"harness/toolchain_read×7",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--convnext.tiny--nash-e--ptq--int8/rollouts/03",
"job_id": "cls--convnext.tiny--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 0,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 12,
"tool_calls": 19,
"blocked": 0,
"timeout_reason": "max_tokens 200000",
"contaminated": true,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×1",
"harness/toolchain_read×5",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--efficientnet.b0--nash-e--ptq--int8/rollouts/00",
"job_id": "cls--efficientnet.b0--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 1,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 13,
"tool_calls": 19,
"blocked": 0,
"timeout_reason": "max_tokens 200000",
"contaminated": true,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×4",
"oracle_content_match×1",
"harness/toolchain_read×5",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--efficientnet.b0--nash-e--ptq--int8/rollouts/01",
"job_id": "cls--efficientnet.b0--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 2,
"version": 3,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 62,
"tool_calls": 62,
"blocked": 1,
"timeout_reason": "max_turns 60",
"contaminated": false,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"old_version(v3<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--efficientnet.b0--nash-e--ptq--int8/rollouts/02",
"job_id": "cls--efficientnet.b0--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 3,
"version": 2,
"state": "RUNNING",
"terminal": "RUNNING",
"claim": null,
"claim_consistent": null,
"turns": 49,
"tool_calls": 54,
"blocked": 0,
"timeout_reason": null,
"contaminated": false,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"old_version(v2<5)",
"claim_absent"
],
"running": true,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--efficientnet.b0--nash-e--ptq--int8/rollouts/03",
"job_id": "cls--efficientnet.b0--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 0,
"version": 3,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "FAIL",
"claim_consistent": null,
"turns": 62,
"tool_calls": 63,
"blocked": 3,
"timeout_reason": "max_turns 60",
"contaminated": false,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"old_version(v3<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--efficientnet.b1--nash-e--ptq--int8/rollouts/00",
"job_id": "cls--efficientnet.b1--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 0,
"version": 1,
"state": "TIMEOUT",
"terminal": "TIMEOUT",
"claim": "ABSENT",
"claim_consistent": null,
"turns": 41,
"tool_calls": 48,
"blocked": 8,
"timeout_reason": "max_turns 40 超了(budget-kill 未生效,已修);05-compile 被看门狗误判 STALLED(JuiceFS I/O,已修)",
"contaminated": false,
"stalled_killed": true,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"stalled_killed",
"old_version(v1<5)",
"claim_absent"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--resnet18--nash-e--ptq--int8/rollouts/00",
"job_id": "cls--resnet18--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 1,
"version": 1,
"state": "DONE",
"terminal": "PASS",
"claim": "PASS",
"claim_consistent": true,
"turns": 27,
"tool_calls": 32,
"blocked": 0,
"timeout_reason": null,
"contaminated": true,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"oracle_read×3",
"oracle_content_match×1",
"harness/toolchain_read×9",
"old_version(v1<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--resnet18--nash-e--ptq--int8/rollouts/01",
"job_id": "cls--resnet18--nash-e--ptq--int8",
"mode": "e2e"
},
{
"kk": 2,
"version": 4,
"state": "DONE",
"terminal": "PASS",
"claim": "PASS",
"claim_consistent": true,
"turns": 17,
"tool_calls": 17,
"blocked": 0,
"timeout_reason": null,
"contaminated": false,
"stalled_killed": false,
"rl_ok": false,
"sft_ok": false,
"reasons": [
"old_version(v4<5)"
],
"running": false,
"dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/runs/r20260915-03/cls--resnet18--nash-e--ptq--int8/rollouts/02",
"job_id": "cls--resnet18--nash-e--ptq--int8",
"mode": "e2e"
}
]
增强 work_root / 输入探针及真实 calibrate 闭环
fixture: /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01
PASS other job oracle hidden
PASS own e2e oracle hidden
PASS sibling hidden
PASS job input readable
PASS job data readable
PASS own work readable and read-only
PASS other work hidden
PASS state sqlite hidden
PASS real state sqlite hidden
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/registry/gates.yaml
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/harness/gates.py
PASS write denied /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--resnet18--nash-m--ptq--int8/oracle/result.json
PASS write denied /mnt/data/ming01.wang/model-compile-hbdk/bench/state/x
PASS write denied /home/ming01.wang/bench-state/x
PASS write denied /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01/rollout.json
PASS workspace writable
PASS stdlib stage status executes
PASS cannot undo read-only mounts
PASS host processes hidden
result: OK exit_code: 0 error_class: None 0.0s
stdout: /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/stdout.log
stderr: /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/stderr.log
meta: /home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/a00/meta.json
measurements: {"calib": {"calib_dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/data/calib/cls/1x3x224x224", "calib_npy_dir": "/mnt/data/ming01.wang/model-compile-hbdk/bench/data/calib/cls/1x3x224x224/npy_f32", "calib_source": "t0", "calib_n": 128, "calib_manifest_sha": "608d4cc667290ebc79571655d1f7a732503a56768837704ce6051427b0fd946e", "compile_yaml": "/home/ming01.wang/bench-state/guard-smoke/queue-1789447419642876555/runs/rSmoke1789447439070281769/cls--smoke--nash-e--ptq--int8/rollouts/01/stages/04-calibrate/compile.yaml"}}
QUEUE RESULT: OK (real calibrate; isolated fixture DB)
旧 manifest 哈希复核
PASS unchanged original manifest + VOID ds20260915-01
PASS unchanged original manifest + VOID ds20260915-02
PASS unchanged original manifest + VOID ds20260915-03
PASS unchanged original manifest + VOID ds20260915-04
PASS unchanged original manifest + VOID ds20260915-05
PASS unchanged original manifest + VOID ds20260915-06
PASS unchanged original manifest + VOID ds20260915-07
PASS unchanged original manifest + VOID ds20260915-08
PASS unchanged original manifest + VOID ds20260915-09