Skip to content

ci: optimize Rust coverage tests - #8065

Closed
Xuanwo wants to merge 2 commits into
mainfrom
xuanwo/ci-rust-test-profile
Closed

ci: optimize Rust coverage tests#8065
Xuanwo wants to merge 2 commits into
mainfrom
xuanwo/ci-rust-test-profile

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

Rust PR CI's Linux coverage job remains a dominant time-to-green path. This draft evaluated an opt-level = 1 coverage profile against the existing ci profile on the same commit.

Benchmark

Measured on 10b4d3133 in Rust run 30464415673:

Cache state ci job ci-test job Candidate delta
Initial run (candidate cache miss) 34:52 40:10 +5:18 (+15.2%)
Same-SHA rerun (both full cache hits) 34:04 32:07 -1:57 (-5.7%)

The same-SHA rerun is a best-case upper bound because real PR runs change source files. The candidate's coverage artifacts also consistently emitted 334,439 instead of 334,651 source-line mappings and 654,704 instead of 655,120 total regions: 212 lines and 416 regions were missing across 30 files. The apparent coverage percentage increased only because the denominator shrank.

The candidate is rejected because its modest best-case warm-cache improvement does not offset the first-population cost or the non-equivalent coverage mapping.

@github-actions github-actions Bot added ci Github Action or Test issues A-ci CI / build workflows and removed ci Github Action or Test issues labels Jul 29, 2026
@github-actions github-actions Bot added the ci Github Action or Test issues label Jul 29, 2026
@codecov

codecov Bot commented Jul 29, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@Xuanwo Xuanwo closed this Jul 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-ci CI / build workflows ci Github Action or Test issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant