Skip to content

Proofs is not a gate: paths: proofs/** filter, z3 … || true, Isabelle/Mizar skipped without failing, no assumption check in CI #161

Description

@hyperpolymath

Scope: the Coq/Agda/Z3/Isabelle/Mizar orchestration. The Lean leg (FilesystemCNO/LambdaCNO derive False; never run in CI) is #125; Coq axiom and Idris believe_me debt is #70; the Idris postulates are #27. None of that is duplicated here.

Measured (2026-09-22, main = 74202cb)

Why it matters

A workflow that does not run on the commits that change it, cannot fail on the checks that matter, and never prints its assumptions is a green square with no predicate behind it.

Acceptance criteria

  1. The paths: filter is removed, or widened to include .github/workflows/proofs.yml, Justfile, *.agda-lib, _CoqProject, lakefile*, so the workflow runs on every push to main. Watched-failing → green: it appears in gh run list -b main for the fix commit.
  2. || true removed at :94; the Z3 step asserts the expected unsat/sat lines from verify.sh output, not just exit 0.
  3. verify-all-provers.sh sets fail=1 when a prover is absent unless the caller sets an explicit SKIP_ISABELLE=1 / SKIP_MIZAR=1; CI sets neither. Mutant: with isabelle off PATH and no skip variable, the script exits non-zero.
  4. An assumption step: coqchk plus Print Assumptions <headline theorem>. for each headline theorem, with the output asserted to list only the METAL-BOUNDARY axioms; the CI log shows the lists.
  5. Ordering per owner ruling D-3 (2026-09-22): Lean FilesystemCNO and LambdaCNO each prove False; lake build reports success and CI never runs the Lean leg #125 is fixed first; this issue's items follow it (Phase 4b–4c of the residual-evidence-types family plan).

🤖 Generated with Claude Code

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething is broken or behaves incorrectlyproofsFormal verification: Agda, Coq, Idris, Lean, Z3/SMT, axiom debt

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions