Result record · gold run · not comparable
2026-09-06/harness-gold/do-rename-net/run-1.json
do-rename-net run by harness:gold, repeat 1. Verdictunscoreable.First required assertion to fail: no-new-erc-violations.A required assertion couldn't be evaluated, so this run counts as neither a pass nor a failure and is left out of the pass rate.
Not comparable with the current suite: suiteVersion 0.1.0 ≠ 0.2.0; setup skipped: init. This record was made under a different version of the suite and is not included in any leaderboard row.
Run
| Task | do-rename-net · simple tier · do mode · expects edit |
|---|---|
| Fixture | antmicro-microphone-board dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 |
| Model | harness:gold |
| Run mode | gold (harness run: one of the suite's own checks, no model involved) |
| Repeat | 1 |
| Cost | null |
| Duration | 0.1 s |
| Baseline commit | b57dcbb8ec4533b4b4c817583f686e8e9836e5e7 |
| Response cache | off |
| Setup skipped | init: setup command unavailable in this environment |
| Partial credit | 0.8636 (not used on the leaderboard) |
| Failure category | none |
| Raw record | 2026-09-06/harness-gold/do-rename-net/run-1.json · on GitHub |
Assertions
11 passs, 0 failures, 2 unevaluable. The run passes when every required assertion passes. If a required assertion couldn't be evaluated, the run is unscoreable.
| Id | Type | Required | Weight | Outcome | Detail |
|---|---|---|---|---|---|
| new-net-exists | net_present | yes | 3 | pass | net PDM_DATA is present |
| old-net-gone | net_absent | yes | 3 | pass | net DATA is absent |
| sibling-nets-untouched | net_present | yes | 1 | pass | net CLK is present |
| no-new-erc-violations | erc_no_new_violations | yes | 2 | unevaluable | ERC requires kicad-cli, which was not available in this environment |
| no-new-drc-violations | drc_no_new_violations | yes | 1 | unevaluable | DRC requires kicad-cli, which was not available in this environment |
| pinout-updated | doc_contains | yes | 1 | pass | PINOUT.md matches /PDM_DATA/ |
| pinout-old-name-gone | doc_contains | yes | 1 | pass | PINOUT.md does not match /\bDATA\b/ |
| surgical-schematic-edit | diff_ratio_max | yes | 3 | pass | 4/8490 lines changed (0.05% ≤ 1.00%) |
| board-untouched | file_unchanged | yes | 1 | pass | hardware/microphone-board.kicad_pcb is byte-identical to baseline |
| touched-files-bounded | files_touched_subset | yes | 2 | pass | 3 changed path(s), all within the allowed set |
| one-commit | commit_count | yes | 1 | pass | 1 commit(s) |
| finished-cleanly | exit_path_in | yes | 2 | pass | exit path done |
| no-secret | no_secret | yes | 1 | pass | no credential pattern matched |
Comparability stamps
What the run was stamped with, next to what the current suite expects. The first five decide whether the record appears on the leaderboard, together with the run having skipped no setup command. The rest are recorded so that a result can be traced back to the environment it was produced in.
| Stamp | Recorded | Checked out | Match |
|---|---|---|---|
| schemaVersion | 1.0.0 | 1.0.0 | yes |
| suiteVersion | 0.1.0 | 0.2.0 | no |
| taskManifestHash | 524b94d28beb7e1c28af0659c77b59a236687980a8b06f89aaab3d7a5ff151bb | 524b94d28beb7e1c28af0659c77b59a236687980a8b06f89aaab3d7a5ff151bb | yes |
| fixtureSha256 | dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 | dad443ad059b7cd2ec57313967db7c511caa8bcfd1ba72dc2f02cd3560249529 | yes |
| kicadCliVersion | none | major 10 | no |
| copperheadVersion | 0.8.1 | not compared | n/a |
| copperheadCommit | none | not compared | n/a |
| nodeVersion | v24.14.0 | not compared | n/a |
| platform | linux-x64 | not compared | n/a |