amos ac3d3db9e0 Add 13 more Qwen-measured tasks from batches 26 and 27 (8 HARD, 5 MEDIUM)
Route D (real fixes in embedded open-source projects) keeps producing the
hard tasks: of 64 measured so far, 15 are HARD and 4 MEDIUM, mostly because
Qwen exhausts its context in the larger real workspaces. This adds
CANopen SRDO and ASCII timing, FreeRTOS DHCP, lwIP MQTT fragments, printf
extremal exponents, Zephyr packet buffers and heatshrink (HARD), plus
lwjson, RFM9x, SFUD and nanopb proto3 (MEDIUM).

From batch 27 (spec-dense implementation tasks) come one HARD and one
MEDIUM; that batch is winding down after 30 tasks gave 1 HARD and 3 MEDIUM.

Each task comes from the commit Qwen measured, its digest matches, and it
is still present at the batch branch head. Agent timeouts stay excluded:
a pyserial attempt timed out on Qwen's own blocking read yet graded PASS.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-03 16:29:21 +08:00

34 lines
838 B
JSON

{
"id": "runtime-zephyr-packet-buffer-progress",
"version": "1",
"family": "state-machine-timing",
"language": "C",
"source": "oss/zephyrproject-rtos/zephyr@3e52109590cc",
"template": "template",
"verifier": "verify.py",
"candidate_files": [
"lib/os/mpsc_pbuf.c"
],
"grader_files": [
"check.py",
"harness.c",
"support/include/zephyr/sys/mpsc_pbuf.h",
"support/include/zephyr/sys/mpsc_packet.h",
"support/include/zephyr/kernel.h",
"support/host_port.c"
],
"timeout_seconds": 90,
"fixtures": {
"gold": "PASS",
"template": "FAIL",
"noop": "FAIL",
"cheat": "FAIL",
"cheat_read_grader": "FAIL",
"only_alloc_progress": "FAIL",
"only_claim_wake": "FAIL",
"symptom_mask": "FAIL",
"valid_release_each_skip": "PASS",
"valid_rotated_origin": "PASS"
}
}