Defect
efficiency-scorecard can report a successful run and overall ok verdict when the run's cold-index graph census is explicitly unavailable because the sealed generation census is invalid.
Confirmed artifact:
target/efficiency-scorecard-20260902T093325Z-final-certification/scorecard.json
- source commit:
5749e4fcfe268e17bd19a0e6ef90c646f7b37289
- run 3:
cold_index.graph_statistics = { \"state\": \"unavailable\", \"reason\": \"sealed_generation_census_invalid\" }
- the same run still has
status: \"ok\"
- the top-level scorecard still has
verdict: \"ok\"
Defect location
scripts/efficiency-scorecard.py:1058-1070 derives the overall verdict and exit code only from run[\"status\"] != \"ok\". The cold-index census state never contributes to run status, overall verdict, or process exit status.
Required behavior
A run with cold_index.graph_statistics.state != \"observed\" due to sealed_generation_census_invalid must not report status: \"ok\"; consequently the scorecard verdict must not be ok and the command must exit non-zero. Add a regression fixture covering this exact contradictory shape.
Defect
efficiency-scorecardcan report a successful run and overallokverdict when the run's cold-index graph census is explicitly unavailable because the sealed generation census is invalid.Confirmed artifact:
target/efficiency-scorecard-20260902T093325Z-final-certification/scorecard.json5749e4fcfe268e17bd19a0e6ef90c646f7b37289cold_index.graph_statistics = { \"state\": \"unavailable\", \"reason\": \"sealed_generation_census_invalid\" }status: \"ok\"verdict: \"ok\"Defect location
scripts/efficiency-scorecard.py:1058-1070derives the overall verdict and exit code only fromrun[\"status\"] != \"ok\". The cold-index census state never contributes to run status, overall verdict, or process exit status.Required behavior
A run with
cold_index.graph_statistics.state != \"observed\"due tosealed_generation_census_invalidmust not reportstatus: \"ok\"; consequently the scorecard verdict must not beokand the command must exit non-zero. Add a regression fixture covering this exact contradictory shape.