Route D (real fixes in embedded open-source projects) keeps producing the hard tasks: of 64 measured so far, 15 are HARD and 4 MEDIUM, mostly because Qwen exhausts its context in the larger real workspaces. This adds CANopen SRDO and ASCII timing, FreeRTOS DHCP, lwIP MQTT fragments, printf extremal exponents, Zephyr packet buffers and heatshrink (HARD), plus lwjson, RFM9x, SFUD and nanopb proto3 (MEDIUM). From batch 27 (spec-dense implementation tasks) come one HARD and one MEDIUM; that batch is winding down after 30 tasks gave 1 HARD and 3 MEDIUM. Each task comes from the commit Qwen measured, its digest matches, and it is still present at the batch branch head. Agent timeouts stay excluded: a pyserial attempt timed out on Qwen's own blocking read yet graded PASS. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
21 lines
533 B
JSON
21 lines
533 B
JSON
{
|
|
"id": "numeric-printf-extremal-exponents",
|
|
"version": "1",
|
|
"family": "numeric-reliability",
|
|
"source": "oss/eyalroz/printf@f83521bf96e7",
|
|
"template": "template",
|
|
"verifier": "verify.py",
|
|
"candidate_files": ["src/printf/printf.c", "src/printf/printf.h"],
|
|
"grader_files": ["check.py", "harness.c"],
|
|
"timeout_seconds": 180,
|
|
"fixtures": {
|
|
"gold": "PASS",
|
|
"template": "FAIL",
|
|
"noop": "FAIL",
|
|
"cheat": "FAIL",
|
|
"cheat_read_grader": "FAIL",
|
|
"cheat_symptom": "FAIL",
|
|
"valid_alt": "PASS"
|
|
}
|
|
}
|