Skip to content

Commit 0439fcb

Browse files
committed
exp(ci): record run C — cache OFF is fastest (113s vs 162s cold, 360s warm)
1 parent 5746314 commit 0439fcb

1 file changed

Lines changed: 26 additions & 1 deletion

File tree

EXPERIMENT.md

Lines changed: 26 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ Filled in as runs land.
5757
|---|---|---|---|---|---|
5858
| A — cold, cache on | **4.0K** | **2.7 min** | 5.1G | 3m54s | 30504331243 |
5959
| B — warm, cache on | **5.1G** | **6.0 min** | **12G** | 8m18s | 30504621611 |
60-
| C — cache off | | | | | |
60+
| C — cache off | 5.1G (ignored) | **113s = 1.9 min** | 5.1G | **2m53s** | 30505173423 |
6161

6262
Run A notes: single CI run on the branch, no cancelled sibling, `--force` confirmed in the
6363
log so this was a real build and not a Turbo replay. 4.0K pre-build settles a separate
@@ -72,3 +72,28 @@ progressive degradation seen on older shared disks (up to 11.7 min): the more a
7272
written, the more there is to read and revalidate. Run B's CI run shows `failure`, but Build
7373
App passed - the failing job was `Lint and Test` on a 1ms real-clock flake in
7474
`pi-lifetime.test.ts` (`expected 5399999 to be 5400000`), unrelated to this experiment.
75+
76+
Run C notes: flag manipulation verified in the log — run A prints
77+
`✓ turbopackFileSystemCacheForBuild`, run C omits it entirely. Fastest of the three:
78+
**3.2x faster than warm** (113s vs 360s) and still 1.4x faster than cold-with-cache, because
79+
it neither reads nor writes the 5.1G.
80+
81+
## Conclusion
82+
83+
The Turbopack FS build cache is a net negative for this app at its current size. Ranked:
84+
85+
| config | compile | Build App job |
86+
|---|---|---|
87+
| cache OFF | **113s** | **2m53s** |
88+
| cache ON, cold | 162s | 3m54s |
89+
| cache ON, warm | 360s | 8m18s |
90+
91+
Recommendation: disable `NEXT_TURBOPACK_BUILD_CACHE`. #5869 enabled it on locally-measured
92+
numbers (105s cold -> 22s warm) that never reproduced in CI and are inverted here.
93+
94+
Caveat: n=1 per cell. The effect size (3.2x) and agreement with ~15 prior observations make
95+
it convincing, but this is three runs, not a distribution.
96+
97+
One unexplained anomaly: run B committed 12G, yet run C mounted 5.1G. Does not affect the
98+
conclusion (C ignores the disk either way), but it means sticky-disk commit semantics are not
99+
fully understood — do not build anything on assumptions about them.

0 commit comments

Comments
 (0)