Feature/holdout evaluation - #19

Merged

Ben Constable (BenConstable9) merged 7 commits into

mainfrom

feature/holdout-evaluation

Jul 16, 2026

Commits on Jul 16, 2026

feat(eval): use a proper, deterministic hold-out split for evaluation
Ben Constable (BenConstable9)
committed
8ca289d
feat(eval): group split by customer + stratify by fraud; grouped k-fold in training
Ben Constable (BenConstable9)
committed
13b3fe2
feat(monitoring): use the validation split as the drift baseline
Ben Constable (BenConstable9)
committed
5812e08
fix(training): confusion matrix uses a grouped demo fold, not removed X_test/y_test
Ben Constable (BenConstable9)
committed
e19f732
Apply fix for hash collision

Ben Constable (BenConstable9)
and
Copilot
authored
6c90144
Remove double spark job

Ben Constable (BenConstable9)
and
Copilot
authored
f2a8537
fix(split,training): use deterministic hash bucket split and guard fold balancing
Ben Constable (BenConstable9)
committed
cc06ac1