research(nightly): rvf-index-shard — portable subgraph extraction for edge AI and agent memory#544
Draft
ruvnet wants to merge 5 commits into
Draft
research(nightly): rvf-index-shard — portable subgraph extraction for edge AI and agent memory#544ruvnet wants to merge 5 commits into
ruvnet wants to merge 5 commits into
Conversation
Implements three subgraph extraction strategies from k-NN proximity graphs: BFS (graph locality), Coherence (semantic centroid), and Hub (topological hubs). Serializes to 67KB RVSHARD binary. All 17 tests pass. Build: cargo build --release -p ruvector-shard. https://claude.ai/code/session_01Fu5KBvAT3YykFeKdxac1Fi
Research document covers BFS/Coherence/Hub shard extraction, SOTA survey (VLDB 2025, ICML 2025, arXiv 2026), benchmark results, 10-20yr thesis, and ecosystem fit. Gist included for SEO publication. https://claude.ai/code/session_01Fu5KBvAT3YykFeKdxac1Fi
Documents the decision to introduce portable subgraph extraction, three extraction variants, production API shape, alternatives considered, benchmark evidence, and migration path. https://claude.ai/code/session_01Fu5KBvAT3YykFeKdxac1Fi
BFS shard: 8.1x speedup, 79.3% recall@10 for anchor-biased queries. Coherence shard: 8.1x speedup, 49.0% recall. Hub shard: 8.3x speedup, 18.5% recall (routing index). Wire: 67KB per 128-node shard. All 17 acceptance tests PASSED. https://claude.ai/code/session_01Fu5KBvAT3YykFeKdxac1Fi
Adds lock entries for rand, thiserror, and serde resolved for the new ruvector-shard crate. https://claude.ai/code/session_01Fu5KBvAT3YykFeKdxac1Fi
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Nightly RuVector Research: RVF Index Shard
Adds nightly RuVector research for portable subgraph extraction from proximity graphs, enabling edge deployment and agent memory portability.
What this PR includes
crates/ruvector-shard: three extraction strategies, binary wire format, brute-force shard search, recall measurement. Zero external service dependencies.docs/adr/ADR-196-rvf-index-shard.mddocs/research/nightly/2026-06-06-rvf-index-shard/README.mddocs/research/nightly/2026-06-06-rvf-index-shard/gist.mdcargo run --release -p ruvector-shard --bin benchmarkBenchmark headline numbers (x86_64 Linux, n=1024, dim=128, 12.5% shard)
17/17 acceptance tests PASSED.
Key SOTA references
Ecosystem connections
magic + version + typed payloadpattern compatible withrvf-manifestShardExtractortrait wraps any proximity graph; Phase 2 integratesruvector-core::HnswIndexCoherenceSharduses centroid-cosine scoring validated inruvector-coherenceno_std-ready designCapabilityManifestTLV (future)post-taskhook triggers shard extraction when agent domain shifts (future)How to verify
git checkout research/nightly/2026-06-06-rvf-index-shard cargo build --release -p ruvector-shard cargo test -p ruvector-shard cargo run --release -p ruvector-shard --bin benchmarkResearch doc:
docs/research/nightly/2026-06-06-rvf-index-shard/README.mdADR:
docs/adr/ADR-196-rvf-index-shard.mdGenerated by Claude Code