Result record · noop run · comparable
2026-09-07/harness-noop/do-rename-net/run-1.json
do-rename-net run by harness:noop, repeat 1. Verdictfail.First required assertion to fail: new-net-exists.
Run
| Task | do-rename-net · simple tier · do mode · expects edit |
|---|---|
| Fixture | antmicro-microphone-board dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 |
| Model | harness:noop |
| Run mode | noop (harness run: one of the suite's own checks, no model involved) |
| Repeat | 1 |
| Cost | null |
| Duration | 1.9 s |
| Baseline commit | ce0d86e5022fdf4097867e816a74d09f690c63cd |
| Response cache | off |
| Setup skipped | nothing |
| Partial credit | 0.5909 (not used on the leaderboard) |
| Failure category | wrong-target |
| Raw record | 2026-09-07/harness-noop/do-rename-net/run-1.json · on GitHub |
Assertions
8 passs, 5 failures, 0 unevaluable. The run passes when every required assertion passes. If a required assertion couldn't be evaluated, the run is unscoreable.
| Id | Type | Required | Weight | Outcome | Detail |
|---|---|---|---|---|---|
| new-net-exists | net_present | yes | 3 | fail | net PDM_DATA not found; nets are [CLK, DATA, SELECT] |
| old-net-gone | net_absent | yes | 3 | fail | net DATA is still present |
| sibling-nets-untouched | net_present | yes | 1 | pass | net CLK is present |
| no-new-erc-violations | erc_no_new_violations | yes | 2 | pass | no new ERC violations at error+ (0 present, all within the recorded baseline) |
| no-new-drc-violations | drc_no_new_violations | yes | 1 | pass | no new DRC violations at error+ (0 present, all within the recorded baseline) |
| pinout-updated | doc_contains | yes | 1 | fail | PINOUT.md does not match /PDM_DATA/ |
| pinout-old-name-gone | doc_contains | yes | 1 | fail | PINOUT.md still matches /\bDATA\b/ |
| surgical-schematic-edit | diff_ratio_max | yes | 3 | pass | 0/8489 lines changed (0.00% ≤ 1.00%) |
| board-untouched | file_unchanged | yes | 1 | pass | hardware/microphone-board.kicad_pcb is byte-identical to baseline |
| touched-files-bounded | files_touched_subset | yes | 2 | pass | 1 changed path(s), all within the allowed set |
| one-commit | commit_count | yes | 1 | fail | 0 commit(s), expected exactly 1 |
| finished-cleanly | exit_path_in | yes | 2 | pass | exit path done |
| no-secret | no_secret | yes | 1 | pass | no credential pattern matched |
Comparability stamps
What the run was stamped with, next to what the current suite expects. The first five decide whether the record appears on the leaderboard, together with the run having skipped no setup command. The rest are recorded so that a result can be traced back to the environment it was produced in.
| Stamp | Recorded | Checked out | Match |
|---|---|---|---|
| schemaVersion | 1.0.0 | 1.0.0 | yes |
| suiteVersion | 0.2.0 | 0.2.0 | yes |
| taskManifestHash | 524b94d28beb7e1c28af0659c77b59a236687980a8b06f89aaab3d7a5ff151bb | 524b94d28beb7e1c28af0659c77b59a236687980a8b06f89aaab3d7a5ff151bb | yes |
| fixtureSha256 | dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 | dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 | yes |
| kicadCliVersion | 10.0.6 | major 10 | yes |
| copperheadVersion | 0.8.1 | not compared | n/a |
| copperheadCommit | none | not compared | n/a |
| nodeVersion | v24.14.0 | not compared | n/a |
| platform | linux-x64 | not compared | n/a |