Skip to content

feat: manage audited experience lifecycle transitions - #10

Merged
fabbrik merged 6 commits into
mainfrom
feat/3-2-lifecycle-transitions
Sep 22, 2026
Merged

fabbrik merged 6 commits into
mainfrom
feat/3-2-lifecycle-transitions

Conversation

@fabbrik

@fabbrik fabbrik commented Sep 22, 2026

Copy link
Copy Markdown
Owner

Summary

Story 3.2. A record can now be contested, made stale, superseded or revoked — and the audit trail that proves it is enforced by the database rather than by convention.

  • The full MVP table: CandidateValidated/Quarantined; ValidatedReinforced; Validated/ReinforcedContested/Stale/Superseded; any non-RevokedRevoked. Same-state events are refused; replays stay no-ops.
  • Supersession records the replacement, and the rules — different record, same exact scope, eligible, no cycle — are re-decided inside the commit transaction under row locks taken in ID order. Two concurrent supersessions naming each other now produce exactly one winner.
  • The null-prior bypass is closed. A first event may only record the status the record is already in, enforced in Core and in the SQL guard. This hole predated the story and let a caller move a record to any status from any status.
  • Enforced append-only. Migration 0006 adds row and statement triggers covering update, delete and truncate on both event logs, ENABLE ALWAYS so replication apply cannot skip them, monotonic revocation and expiry with pinned identity on grants, and forward-only revisions on the record projection. Constraints are NOT VALID with a documented validate step, so upgrading a populated database cannot abort.
  • History is bounded and cursored and carries each event's stored timestamp and applied revision.
  • Leaving eligibility removes the embedding — storage hygiene, not a reachability boundary, since every vector search already filters by status. It never fails the transition.

Limits, stated plainly

The triggers bind any role while they are enabled, including superusers. They do not bind anyone who can ALTER TABLE — superuser or the tables' owner, which the application role is — and they say nothing about backups, a restore without 0006, or filesystem access. The READMEs now carry that table, plus the deletion runbook, since story 4.5 will need a purge path and this script cannot be edited once journaled.

Review

Three reviewers raised 31 findings; all fixed. Three of the story's own guarantees were bypassable as first written: TRUNCATE erased the audit log without firing row triggers, the transition table could be skipped with a null prior status, and the cycle check ran outside the commit transaction. A fourth would have failed an upgrade at startup, and a fifth refused the very retry the docs tell callers to make.

Test plan

  • dotnet build --configuration Release: 0 warnings, 0 errors
  • dotnet test --configuration Release: 824 of 824 pass (Postgres 197, Core 430, Vectors 54, MAF 90)
  • Container tests for every tamper route (update, delete, truncate, replica mode, grant re-pointing, projection rewind), the concurrent-supersession race, an upgrade over a database holding a legacy Superseded event, and de-indexing end to end through pgvector
  • CI green

🤖 Generated with Claude Code

fabbrik and others added 6 commits September 18, 2026 21:17
Add ExperienceFinalizationService: one call that loads a completed captured
run, evaluates its own closed verification round, checks host authorization and
the host's storage decision, reflects, creates the record as Candidate, and
commits its initial lifecycle event to Validated or Quarantined. Record,
reflection and event IDs derive from the run, so a retry re-derives them and
converges instead of duplicating.

Required checks can now name the evaluator kind that may satisfy them, and Core
and Storage.Postgres each expose a service-registration extension. The MAF
adapter finalizes a fully captured run through the host's resolver.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Add IExperienceCandidateSource with a PostgreSQL implementation: scope, status
and confidence filtering plus a full-text match over a generated tsvector
column added by migration 0003. Core's ExperienceRetrievalService applies
expiry and environment eligibility, then ranks candidates on relevance,
confidence, recency, status and environment compatibility with configurable
validated weights, exposing every normalized component and effective weight.

Retrieval is bounded by a timeout that returns an empty result with a timeout
signal rather than throwing, caller cancellation stays distinct, and a capped
candidate pool is reported through Truncated.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Add IExperienceEmbeddingIndex and a domain-typed embedding generator port,
with a new AgentExperience.Storage.Postgres.Vectors package implementing them
over plain Npgsql and Pgvector. Embeddings are derived data: indexing runs
after the canonical commit, embeds only the sanitized retrieval summary of an
eligible record, and writes conditionally on the record's exact revision, so a
stale write is rejected and a deleted record is never recreated.

Retrieval gains a vector channel merged with the text channel under the same
eligibility, timeout and ceiling. A model or dimension mismatch, an
unavailable provider, or a vector-channel failure produces an explicit
flagged text-only result rather than an incompatible comparison.

The vectors package owns and applies its own schema, so a text-only
deployment never runs CREATE EXTENSION vector.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Add ExperienceContextProvider, a simple-tier AIContextProvider the host adds
to ChatClientAgentOptions.AIContextProviders. It retrieves ranked experience
before an invocation, re-checks every candidate against the same eligibility
rules retrieval applies, asks the host's injection decision, and injects a
delimited Historical Reference carrying source, confidence, applicability and
an evidence summary -- never raw payload content, never a cut record.

Limits drop whole records and record every omission. Retrieval that is empty,
times out or fails leaves the agent running normally. Labeling marks the
content untrusted; the authorization boundary is what denies an unauthorized
tool call, and a test proves it does when the model obeys injected text.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Add IExperienceGrantStore and migration 0005: an administrator, with authority
the host supplies explicitly, grants one record to a recipient scope with a
reason and an expiry. The grant row and its audit event commit together, and a
unique partial index allows at most one active grant per recipient, so revoking
the grant an administrator knows about ends that recipient's access.

Reads widen in SQL only: get, text search and vector search match their exact
scope or an active grant, evaluated against the database clock. Writes,
lifecycle commits, history and enumeration stay owner-only. The read that
applied the predicate marks a record as shared, so Core and the injection
provider keep strict scope equality for everything else, the host's risk
policy can deny borrowed experience, and the model is told the lesson came
from another scope.

Deployments without the grants table, or with SELECT only on the record table,
degrade to exact-scope reads rather than failing.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Complete the MVP transition table (reinforce, contest, stale, supersede,
revoke), refuse same-state events, and add supersession with a recorded
replacement whose eligibility and cycle rules are re-decided inside the commit
transaction under row locks, so two concurrent supersessions cannot store the
cycle they would each individually pass.

Close the null-prior bypass: a first event may only record the status the
record is already in, enforced in Core and in the projection guard.

Migration 0006 makes the audit trail enforced rather than conventional:
statement- and row-level triggers, ENABLE ALWAYS so replication cannot skip
them, covering update, delete and truncate on both event logs, monotonic
revocation and expiry plus pinned identity on grants, and forward-only
revisions on the record projection. Constraints are NOT VALID with a
documented validate step, so an upgrade cannot abort on existing rows.

History is bounded and cursored and carries each event's stored timestamp and
applied revision. Leaving eligibility removes the record's embedding, which is
storage hygiene rather than a reachability boundary, and never fails the
transition.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@fabbrik
fabbrik merged commit 6d16e65 into main Sep 22, 2026
1 check passed
@fabbrik
fabbrik deleted the feat/3-2-lifecycle-transitions branch September 22, 2026 21:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant