integration/v0.11.0: integrity profiles, P2P smokes, subsystem hardening#646
Draft
bussyjd wants to merge 9 commits into
Draft
integration/v0.11.0: integrity profiles, P2P smokes, subsystem hardening#646bussyjd wants to merge 9 commits into
bussyjd wants to merge 9 commits into
Conversation
…s wiring
P1 of the decentralized fine-tuning plan: make a versioned dataset a
first-class type=dataset ServiceOffer so the existing
controller -> Middleware -> HTTPRoute -> ForwardAuth -> catalog pipeline
publishes and gates it with no new serving code. Declarations + pipeline
wiring + parity tests only; the dataset server/versionlog/download client
are later phases.
- CRD: dataset enum value; ServiceOfferDataset{manifestHash,version,
fileHash,sizeBytes} spec block (mirrors ServiceOfferAgent);
PriceTable.PerMB; IsDataset(); regenerated serviceoffer-crd.yaml + deepcopy.
- x402: RouteRule.Dataset* fields; routeRuleFromOffer dataset branch
(hex digests lowercased); effectivePrice perMB; mergeDatasetExtras()
adds accepts[].extra.dataset{...} to the 402, wired after mergeAgentExtras.
- catalog: schema type enum + perMB priceUnit + additive dataset* properties;
ServiceCatalogEntry.Dataset*; buildServiceCatalogJSON population; perMB in
offerPriceRawAndUnit + describeOfferPrice.
- dataset folds to the http render branch in normalizeOfferType (a download
is not chat-completions): generic 402 copy + bazaarGenericJSON, no bespoke
copy. Version metadata reaches buyers only via extra.dataset.
- parity tests across CRD fields/block, mergeDatasetExtras, route-rule,
catalog surface + omitempty, bazaar, fallbackOfferType, describeOfferPrice
(incl. perMB precedence), and the HTML 402 copy fold.
go build/vet, full go test ./..., and just generate (idempotent) all green.
Squashed integration of every >=605 feature PR for combined-stack testing, rebuilt on top of the clean #640 so the history carries no third-party name. Tree-equivalent to merging: - #640 type=dataset CRD/catalog/x402 wiring - #632 skill marketplace; #634 ServiceBounty eval-market; #635 escrow - #633 sell smoke-test agent; #636 flow-12 portability - #638 BYOK provider registry - #639 decentralized auto-research; #641 dataset subsystem (P2-P6) - #637 obol node multinode - #605/#606/#608 MPP credit-card path (import repointed to x402-foundation) Excludes #617 (codex/) and the obol-router (separate fork lineage). Local rc staging branch. Full build + monetize/x402/dataset/embed test surface green.
…arch, escrow) Squash of the v0.11-rc High/Critical fixes: dataset x402-verifies paid join + verifies the signed log on fetch; bounty reward-capture bound to the accepted fulfiller seat; monetize charges perMB datasets by size + federates datasetFileHash; research authenticates worker identity, caps threshold payouts, GCs device codes; escrow returns 409 on reserve with conflicting settlement terms.
…-secure Direct peer-to-peer inference accepts plaintext by default; 'obol sell inference --secure' sets RequireSecurePayment and the always-behind-TLS cluster verifier enforces the gate. (Squashes the original always-on gate with its reversal to opt-in.)
Adds a host-side x402 signer (SignExactPayment, EIP-3009 TransferWithAuthorization) and dataset.JoinPaid so 'obol buy dataset --join' probes the seller's 402 paid-join challenge, signs the payment locally, and mints a version-scoped member token — fully peer-to-peer, no cluster, sidecar, or remote signer. --max-price caps the price before signing; the buyer wallet auto-creates at <config>/dataset-serve/buyer.key. Note: one cosmetic 'approve' help-string rename rides along here (it shares a print block with the --join output).
Moves the seller-side dataset command group under 'obol sell' as 'data' (with 'dataset' kept as an alias). 'obol buy dataset' is unchanged. Updates help/error strings, the monetize-dataset guide, the dataset-anonymize skill, and the hf-surface smoke flow.
internal/offerkind is the single source of truth for what each ServiceOffer/Request type means — render/discovery shapes, price slots, capability flags, and a declarative IntegrityProfile per type. Routes x402 storefront copy + bazaar, the OpenAPI path shape, and the verifier's 402 integrity-metadata dispatch through it; centralizes price-slot detection in monetizeapi.Price.RawAndSlot(); adds a buy-side owner-pin nudge and a CRD-enum drift guard. Behavior-preserving.
…ine guards Base-Sepolia USDC (FiatTokenV2_2) signs its EIP-712 domain under name "USDC", not the mainnet "USD Coin" — verified: the on-chain DOMAIN_SEPARATOR() equals the domain built with "USDC". chains.go advertised "USD Coin", so the 402 a standalone seller emits made every host-side EIP-3009 signature fail a REAL facilitator (the cluster buyer buy.py and the catalog renderer already hardcoded "USDC", which is why only host-side buyers broke and the stub facilitator masked it). Two offline guards so it cannot recur — the recurring root cause was the name being hand-maintained in several independent places that drifted: TestUSDCDomainSeparatorsMatchOnChain pins each chain to its captured on-chain DOMAIN_SEPARATOR (via the same apitypes path the signer uses); TestCatalogUSDCMatchesVerifierChain pins the catalog renderer and the x402 registry to each other. Surfaced by flows/p2p-surface-smoke.sh against a live x402-rs facilitator.
…oin, research, --secure flows/p2p-surface-smoke.sh covers the host-P2P gaps release-smoke never touches: direct-P2P inference 402 + remote-model proxy, paid dataset /join/paid, research membership->submit->payout, on-chain settlement (1d/2e) via a local facilitator, and the --secure transport gate (named-tunnel 4a, tailnet 4b/4c). Adds 'obol sell data publish --facilitator' and the cloudflared 2026.6.0 bump. 13 PASS / 2 SKIP with facilitator + tunnel up.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Integration branch for v0.11.0, consolidating the decentralized-subsystems work (inference / fine-tuning / research / monetize) into 8 signed, reviewable blocks. Behavior-preserving where noted;
go build/vet/test ./...is green.Blocks
datasetFileHashfederated), research (authenticated worker identity, capped threshold payouts, device-code GC), escrow (409 on conflicting settlement terms).--secure— direct P2P inference accepts plaintext by default;--secure(and the always-behind-TLS cluster verifier) enforce the gate.buy --join— pays the x402 join price host-side to mint a version-scoped member token (peer-to-peer, no cluster).obol dataset→obol sell data(datasetkept as an alias;buy datasetunchanged).IntegrityProfile(payment/content/identity/scope). Routes storefront copy, the bazaar extension, the OpenAPI path shape, and the verifier's 402 metadata dispatch through it; centralizes price-slot detection; adds a CRD-enum drift guard. Behavior-preserving."USDC", not"USD Coin"; two offline regression guards (computed domain separator vs the captured on-chain value; catalog↔registry pin). Bites host-side signers only, so the cluster release-smoke never caught it.--securetransport gate (named-tunnel + tailnet origins). Addssell data publish --facilitatorand the cloudflared 2026.6.0 bump.Testing
go build/vet/test ./...green.flows/p2p-surface-smoke.sh: 13 PASS / 2 SKIP / 0 FAIL with a local facilitator + named tunnel up (the 2 SKIPs need the run host on a tailnet). On-chain settlement and--secure-over-HTTPS were live-validated.Notes
plans/(gitignored): the integrity-profile design and a full smoke-coverage gap analysis.