Skip to content

blog: the scanner scored what it could not see - #870

Merged
gHashTag merged 1 commit into
mainfrom
blog/scanner-could-not-see
Aug 22, 2026
Merged

blog: the scanner scored what it could not see#870
gHashTag merged 1 commit into
mainfrom
blog/scanner-could-not-see

Conversation

@gHashTag

Copy link
Copy Markdown
Owner

Ninth post of the gate-audit campaign, and the third in a row where the defect was in the instrument rather than in what it measured.

A mutation tool reported pack_index_consistency_gate.py as having no failure path to break. The gate has four. All are ternaries — return 0 if not fails else 1 — and the scanner matched only a bare return 1. A path it cannot see is a path it scores as covered.

Across twelve gate scripts: 34 seen, 8 missed.

The post's centre is not the fix. It is that repairing the instrument raised the survivor count from 13 to 20 — the second time in this campaign that mending a measurement made the number look worse and be truer (the first was an elaboration ratchet where removing syntax errors increased the error total, because a syntax error truncates the file and hides what is behind it). Both times the instinct is to distrust the repair.

It also names the asymmetry behind the deliberately conservative digit test: a missed site stays an open question, an invented one gets published as a defect in somebody else's work — which this tool had already done once, in an issue and a post, before anyone checked it.

And it lays the three defects side by side: first flag instead of the set, a 1:1 control map, one syntactic form. All the same class, all in the auditor.

en + ru. build:ci clean from apps/website, tsc clean on the blog data, typecheck ratchet reports no file gained errors.

Refs gHashTag/t27#2468, gHashTag/t27#2470

Ninth post of the gate-audit campaign. A mutation tool reported a gate as
having no failure path to break; the gate has four, all ternaries, and the
scanner matched only a bare return.

Carries the part that matters more than the fix: repairing the instrument
RAISED the survivor count 13 -> 20, the second time in this campaign that
mending a measurement made the number look worse and be truer. And the
asymmetry behind the conservative digit test -- a missed site stays an
open question, an invented one gets published as a defect in somebody
else's work, which this tool had already done once.

en + ru. build:ci clean, tsc clean on the blog data, typecheck ratchet
reports no file gained errors.

Refs gHashTag/t27#2468, gHashTag/t27#2470
@gHashTag
gHashTag merged commit 4fe1dea into main Aug 22, 2026
19 of 23 checks passed
@gHashTag
gHashTag deleted the blog/scanner-could-not-see branch August 22, 2026 22:19
github-actions Bot added a commit that referenced this pull request Aug 22, 2026
blog: the scanner scored what it could not see (#870)

Ninth post of the gate-audit campaign. A mutation tool reported a gate as
having no failure path to break; the gate has four, all ternaries, and the
scanner matched only a bare return.

Carries the part that matters more than the fix: repairing the instrument
RAISED the survivor count 13 -> 20, the second time in this campaign that
mending a measurement made the number look worse and be truer. And the
asymmetry behind the conservative digit test -- a missed site stays an
open question, an invented one gets published as a defect in somebody
else's work, which this tool had already done once.

en + ru. build:ci clean, tsc clean on the blog data, typecheck ratchet
reports no file gained errors.

Refs gHashTag/t27#2468, gHashTag/t27#2470
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant