Deterministic crawl kernel in Rust — same seed, identical crawl, identical replay. Browser capture via CDP, BLAKE3 content-addressed storage, WARC++ output, shadow comparison against Heritrix/wget. Built with Claude Code in one session: 269 tests, 12 crates, zero invariant violations.
rust web-crawler web-scraping crawl replay warc web-archiving deterministic cdp digital-preservation browser-automation headless-chrome web-archive deterministic-simulation simulation-testing blake3 content-addressable ai-native claude-code crawl-kernel
-
Updated
Apr 12, 2026 - Rust