101 Commits

Author SHA1 Message Date
amos
078efb55e2 Keep retrying the job's SSH tunnel for about five minutes
36's sshd reset new connections during key exchange for a few minutes; three jobs in
a row gave up after one try per host and paused the batch.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 14:05:21 +08:00
amos
b288c37def Drop the unpacked copy of each Salty result once its files are copied into the attempt
Every attempt kept result.tar, its unpacked tree and the copies in the attempt, so a
third of the hot disk went to a tree nothing reads again. result.tar and its manifest
still record exactly what the job returned.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 06:40:20 +08:00
amos
d83b1d5c9d Let loopback URLs through the Salty contamination check
A downloader task's agent served test files from 127.0.0.1 inside its own job; the rule
the user set is about the outside network. Look-alike hosts such as 127.0.0.1.evil.io
and localhost@evil.io still count.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 18:05:13 +08:00
amos
c64c79b31d Run the Pi agent in Salty jobs over a one-time SSH tunnel and export SFT rows
rollout.salty_run keeps the gateway, grading and evidence on 36 and moves only the
agent step into a Salty job. The gateway listens on 127.0.0.1 with a per-attempt
bearer token; the job reaches it over port 22 with a restricted one-time key that is
removed after each attempt. rollout.batch gains --backend salty and repeatable
--credential-file, and writes pass/fail SFT exports through rollout.sft at the end.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 17:45:28 +08:00
amos
6166b7624f Add the read-only live dashboard for the task catalog and rollout progress
rollout.dashboard serves catalog counts, attempts and complete trajectories, and the public
prompt and template of each task. catalog.controllers()/complete() are split out so the
dashboard can reuse receipts it has already read.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 17:45:28 +08:00
amos
2f32624d3b Batch 18 (20261026-C-hwe-codegen-18): add 100 calibrated HWE code-gen tasks; pause production for rollout
100 tasks from the HWE arm-linux code-gen pool (outside the lk/man/pth
range given to batch 22), each with at least one independent
contract-edge defect and plain public docs. Claude reviewed 100/100
USABLE against current digests; no ID or source overlap with main or
batch 22. Difficulty is unmeasured.

progress.md records the wrap-up: all Codex sessions and Qwen schedulers
stopped for the user's rollout, Qwen results so far (57 HARD of 373),
and what is left on each batch branch.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 17:52:13 +08:00
amos
8b7616bfd8 Batch 22 (20261027-C-hwe-hard-22): add 63 calibrated HWE hard-design tasks
From the 101 lk/man/pth code-gen sources: 63 tasks (C11 36, C++17 27,
11 canonical families), 38 skipped for scope or duplication. Each task
has at least one independent contract-edge defect, boundary types
rotate, and public docs state trap clauses as plain contract prose.
Claude reviewed 63/63 USABLE against current digests. Difficulty is
unmeasured.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 16:14:57 +08:00
amos
1c97ba893b Batch 21 (20261027-A-bos-redo-21): write spec.md for nine tasks that lacked one
Only author-side spec.md files change, so no task digest moves. The specs of
concur-release-capsule and resource-temp-link follow batch 20's family and
version. The 53 rejected Bos environments wait: JuiceFS returns EIO for the
whole source tree.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 07:04:35 +08:00
amos
4f17b2afe5 Batch 20 (20261027-C-family-20): map batch 15's ad-hoc families to canonical ones
210 batch-15 tasks used 119 ad-hoc family names. Each now carries one of the
canonical root-cause families (11 of the 19 are used), with version + 1 and a
spec.md note, and was recalibrated through both gates. Claude checked that only
family, version and spec.md changed, that every family is canonical, and the
new trace6 Docker receipts against current digests (210/210 USABLE).
Squashed from the 36-local branch batch20-family.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 05:58:17 +08:00
amos
9d633e9e67 Batch 15 (20261023-C-hwe-scale-15): 320 HWE-derived repair tasks
One user-space repair task per eligible HWE debug-diag / compile-deploy base
ID: 320 admitted (C 218, C++ 97, build scripts 5), 1 skipped by the content
filter. Each ships a public spec with a check-to-basis table, at least two
defects with single-fix fixtures, a symptom-masking fixture and an alternative
correct implementation. Claude re-checked all 320: structure, the HWE quality
items and trace6 Docker calibration receipts against current digests
(320/320 USABLE). Difficulty is unmeasured. Known follow-up: 212 tasks use 120
ad-hoc family names; the next batch maps them to the canonical list.
The batch's 1,256-line progress log stays in its factory report and the
36-local branch batch15-hwe.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 01:55:56 +08:00
amos
787abc3a86 Batch 19 (20261026-A-bos-rglob2-19): import the remaining 54 rglob-type Bos tasks
After the importer accepted fixture scripts that rewrite a target (dd69720),
54 of the 55 environments batch 16 could not import loaded and were imported
with graders narrowed to the declared files and READMEs stating the delivery
boundary. Claude re-checked all 54 packages and their trace6 Docker
calibration receipts against current digests (54/54 USABLE). Difficulty is
unmeasured. Squashed from the 36-local branch batch19-rglob2.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 00:11:12 +08:00
amos
c4433c6170 Batch 16 (20261026-A-bos-rglob-16): import 135 rglob-type Bos tasks
The 191 Bos environments whose graders rglob the workspace were imported under
the new rule: graders read only the declared candidate files and the READMEs
state that only those files are delivered. After the import-scan fix, 135 were
approved; 55 are still refused because a fixture script writes the same file
twice, and 1 has a target missing from its template. Claude re-checked all 135
packages, the delivery-boundary wording and their trace6 Docker calibration
receipts against current digests (135/135 USABLE). Difficulty is unmeasured.
Squashed from the 36-local branch batch16-rglob.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-26 11:38:30 +08:00
amos
0c9f8c4f55 Batch 13 (20261023-C-qwen-screen-13): Qwen difficulty screen of 72 tasks
The 72 tasks that had no difficulty conclusion were measured with
qwen3.8-27b-nvfp4 on trace6: 68 ROUTINE, 3 MEDIUM, 1 held (S500_n3_100,
insufficient basis), none HARD. 172 raw attempts, 148 valid. Root review also
flagged 14 tasks whose README and grader disagree or whose grader misses a
README requirement; batch 17 fixes and re-measures them. No task changes;
records only. Squashed from the 36-local branch batch13-screen.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-26 03:13:20 +08:00
amos
2a7e79a3e7 Batch 14 (20261023-A-bos-n1a-14): import 14 Bos a-series tasks
192 unused Bos n1/a environments inventoried in the multi-agent mode: 159 are
rglob-type and 6 ROS2-type (not importable under the current contract), 13 were
rejected by the importer or missing targets, 14 imported. Claude re-checked all
14 packages and their trace6 Docker calibration receipts against current
digests (14/14 USABLE). Difficulty is unmeasured. Squashed from the 36-local
branch batch14-n1a.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-26 00:24:09 +08:00
amos
07453439ce Batch 11 (20261022-A-bos-n3-11): import 69 Bos n3 tasks and clarify S500_n2_094/115
119 Bos n3 environments inventoried in the multi-agent mode: 69 imported with
graders rewritten to run candidates in subprocesses, 18 rejected because the
source gold fails its own contract, 32 rglob-type skipped. S500_n2_094 and
S500_n2_115 READMEs now state the oracle's integer, nesting and exception rules,
which lifts their holds. Claude re-checked all 71 packages: structure, isolation
and trace6 Docker calibration receipts against current digests (71/71 USABLE).
Difficulty is unmeasured. Squashed from the 36-local branch batch11-n3.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-24 23:15:14 +08:00
amos
38dee5882e Batch 10 (20261020-C-qwen-screen-10): Qwen difficulty screen of 120 Bos n2 tasks
120 tasks screened with qwen3.8-27b-nvfp4 on trace6 in the multi-agent mode:
29 HARD, 13 MEDIUM, 75 ROUTINE, 3 held for ambiguous prompts (053/094/115).
364 raw attempts, 285 valid measurements. No task changes; records only.
Squashed from the 36-local branch batch10-screen; see docs/progress.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 22:01:43 +08:00
amos
80879387ee Batch 12 (20261022-C-cleanup-12): repair 18 existing tasks
Clarify four ambiguous prompts (S500_n2_053, S500_n2_096, S500_n2_103,
mem-mapping-lease), drop the unused tests.py from eleven rewritten n3 tasks,
add cheat_read_grader to two concurrency tasks and normalise their source
fields. All 18 recalibrated on trace6 (820/820 as expected).
Squashed from the 36-local branch batch12-cleanup; see docs/progress.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 22:01:24 +08:00
amos
b4005d6056 Merge each batch into main as one squash commit
Batches now commit on their own branch and land on main with git merge
--squash, so main gains one commit per batch. Record the four-step push.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 11:20:04 +08:00
amos
4511042cf2 Merge 36 main: batch 7 Qwen screening, batch 9 Bos imports and the Codex subagent workflow
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 11:18:46 +08:00
amos
cdcc4747d3 Document the one-task-per-subagent Codex workflow and the Qwen 300 s idle cut
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 01:15:30 +08:00
amos
ed3e8b1d8d Merge batch 7 Qwen screen records
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	docs/progress.md
2026-10-20 21:25:24 +08:00
Codex
af58f8bb14 docs: complete batch7 cold migration and verified cleanup 2026-10-20 19:32:29 +08:00
Codex
e99758e528 docs: anchor batch7 post-cache completion and absence proof 2026-10-20 18:56:15 +08:00
Codex
37b7129579 docs: anchor reviewed batch7 residual removal recovery 2026-10-20 18:37:13 +08:00
Codex
b6a27c5371 docs: anchor verified batch7 cold payload before hot removal 2026-10-20 18:09:45 +08:00
Codex
92d0a7dd2b docs: record all 47 batch7 Qwen screening results 2026-10-20 16:45:05 +08:00
Codex
435a5349c9 docs: record batch7 first40 Qwen screen checkpoint 2026-10-20 15:05:46 +08:00
Codex
01cd8372c8 Record Bos n2 batch 9 completion and cold evidence 2026-10-20 13:05:19 +08:00
Codex
c893c1e896 docs: record batch7 first30 Qwen screen checkpoint 2026-10-20 12:52:57 +08:00
Codex
8749babe6f Import calibrated Bos n2 batch 9 group 12 2026-10-20 12:16:21 +08:00
Codex
63bc36c53b Import calibrated Bos n2 batch 9 group 11 2026-10-20 12:12:50 +08:00
Codex
dbd84412a2 Import calibrated Bos n2 batch 9 group 10 2026-10-20 12:12:16 +08:00
Codex
702777d37a Import calibrated Bos n2 batch 9 group 9 2026-10-20 12:11:19 +08:00
Codex
2a0d804335 Import calibrated Bos n2 batch 9 group 8 2026-10-20 12:09:02 +08:00
Codex
72656996ae Import calibrated Bos n2 batch 9 group 7 2026-10-20 12:07:52 +08:00
Codex
e19a0675ab Import calibrated Bos n2 batch 9 group 6 2026-10-20 12:07:32 +08:00
Codex
f5e68e9fe9 Import calibrated Bos n2 batch 9 group 5 2026-10-20 12:03:50 +08:00
Codex
1204cd34a7 Import calibrated Bos n2 batch 9 group 4 2026-10-20 12:02:01 +08:00
Codex
5b8a5ad155 Import calibrated Bos n2 batch 9 group 3 2026-10-20 11:56:53 +08:00
Codex
dd0adec375 Import calibrated Bos n2 batch 9 group 2 2026-10-20 11:52:14 +08:00
Codex
b9dab5acd5 Import first 10 calibrated Bos n2 tasks in batch 9 2026-10-20 11:46:32 +08:00
Codex
57b562bfd7 docs: record batch7 first20 Qwen screen checkpoint 2026-10-20 09:03:14 +08:00
Codex
94810e4f07 docs: record batch7 first ten Qwen screening results 2026-10-20 03:13:55 +08:00
Codex
8d635ea6db docs: record batch6 completed measurement and cold migration 2026-10-20 02:26:55 +08:00
amos
38a32fae07 Rebuild the task catalog after merging batch 8
With batch 8's rewritten verifiers and its trace6 calibrations on cold
storage, all 161 tasks are USABLE: the 33 former BLOCKED tasks, the two
ambiguous HOLD tasks and the three replacement concurrency tasks have new
digests and are UNMEASURED. Batch 6 session 2/3 trajectories move seven
tasks to ROUTINE and three to PARTIAL.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 23:22:38 +08:00
amos
6fdc1beb8f Merge 36 main: batch 6 session 3 and batch 8 rewritten tasks
36 main (ca48b33) carries batch 6 session 2/3 measurements and batch 8
(20261019-C-usable-8), which rewrote the 33 isolation-blocked tasks, the two
ambiguous ones and replaced the three held-out concurrency tasks. Mac main adds
the trace6 catalog, the self-heal batch runner and its trial on 36.

docs/progress.md keeps both sides by time: 36's session 2 log, then Mac's
trace6 catalog and self-heal sections, then batch 8 and session 3.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 22:21:29 +08:00
amos
ca48b330d7 Merge main into batch 8 before admission
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 20:56:07 +08:00
Codex
c1ba6d9158 Conclude batch 6 directory task with observed two PASS early stop 2026-10-19 20:55:32 +08:00
Codex
f53818a1bc Close batch 6 capped PC TAR preset and ELF measurements 2026-10-19 20:49:14 +08:00
amos
7f4c560605 Merge main into batch 8 before admission
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

# Conflicts:
#	docs/progress.md
2026-10-19 18:15:14 +08:00