Implement full data modification history and storage backup

[paustint]

Introduce a comprehensive data history tracking system, allowing users to view and manage all modifications across various records. Enhance storage flexibility by enabling user-selected locations for data history, simplifying retention controls, and improving usability of the data history table. Add a dedicated Data History page with filtering options and export capabilities.

[socket-security]

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	fake-indexeddb@​6.2.5

View full report

[Copilot]

Pull request overview

This PR introduces a device-local “Data History” system that captures inputs/requests/results for data-modifying workflows (loads, mass updates, inline edits, record modal actions), stores searchable metadata in Dexie, and persists large payloads via pluggable storage backends (OPFS / File System Access directory / Electron-native filesystem). It also adds a dedicated Data History page + navigation entry points, plus settings for retention/storage location.

Changes:

• Add core Data History types, Dexie tables, retention sweep logic, and a pluggable file-store layer (OPFS worker, directory-handle backend, native desktop backend, plus test fakes).
• Wire capture into existing flows (query inline edits, load records, multi-object loads, mass updates, record modal/create record) and add opt-out toggles per operation.
• Add UI entry points (route/nav/home/header link), docs page, and supporting shared export/builders to keep downloaded/exported shapes consistent with captured history.

Reviewed changes

Copilot reviewed 118 out of 119 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
tsconfig.base.json	Adds TS path aliases for the new feature and shared UI data-history libs.
pnpm-lock.yaml	Locks dependency updates including fake-indexeddb.
package.json	Adds fake-indexeddb dev dependency for IndexedDB-backed unit tests.
libs/ui/src/lib/data-table/SalesforceRecordDataTable.tsx	Adds save-capture callback to snapshot edited/prior values + results for history before in-place mutation.
libs/ui/src/lib/data-table/PreviewChangesModal.tsx	Refactors export builder logic into a shared module and reuses it.
libs/ui/src/lib/data-table/data-table-history-export.ts	New shared export/result builders for query-grid edits (edited/prior/results).
libs/ui/src/lib/data-table/tests/PreviewChangesModal.spec.ts	Updates tests to import shared export builders from the new module.
libs/ui/src/lib/data-table/tests/data-table-history-export.spec.ts	Adds unit tests for the new query-grid history export builders.
libs/ui/src/index.ts	Exposes the new data-table export builder utilities.
libs/types/src/lib/data-history-types.ts	Adds zod schemas/types for Data History items, settings, backends, and file refs.
libs/types/src/index.ts	Exports Data History types from the shared types package.
libs/shared/ui-router/src/lib/ui-router.ts	Adds the DATA_HISTORY route entry (path/docs/title/description/new-until).
libs/shared/ui-db/src/lib/ui-db.ts	Adds Dexie tables + schema version bump for data_history and data_history_config.
libs/shared/ui-db/src/lib/data-history.db.ts	New DB module for Data History catalog rows + settings/backend config persistence.
libs/shared/ui-db/src/lib/client-data-sync.db.ts	Filters out local-only table changes so they don’t trigger server sync POSTs.
libs/shared/ui-db/src/index.ts	Re-exports the new Data History DB module.
libs/shared/ui-data-history/vite.config.ts	Adds Vitest config for the new shared ui-data-history library.
libs/shared/ui-data-history/tsconfig.spec.json	Adds TS config for ui-data-history tests.
libs/shared/ui-data-history/tsconfig.lib.json	Adds TS config for ui-data-history library build settings.
libs/shared/ui-data-history/tsconfig.json	Adds TS project references for ui-data-history.
libs/shared/ui-data-history/src/test-setup.ts	Sets up fake-indexeddb + Blob realm compatibility for compression streams in tests.
libs/shared/ui-data-history/src/lib/platform.ts	Adds platform detection helpers used to select tier/backends.
libs/shared/ui-data-history/src/lib/file-store/worker-messages.ts	Defines typed RPC protocol for OPFS storage worker requests/responses.
libs/shared/ui-data-history/src/lib/file-store/path-utils.ts	Adds validated relative-path helpers and stable org folder naming.
libs/shared/ui-data-history/src/lib/file-store/opfs-file-store.ts	Implements OPFS backend with worker-based I/O and RPC request handling.
libs/shared/ui-data-history/src/lib/file-store/native-fs-file-store.ts	Implements desktop-native filesystem backend via Electron IPC.
libs/shared/ui-data-history/src/lib/file-store/fsa-types.ts	Adds minimal File System Access API typings + permission error type.
libs/shared/ui-data-history/src/lib/file-store/file-store.types.ts	Defines the pluggable file store interface + capability flags.
libs/shared/ui-data-history/src/lib/file-store/file-store-factory.ts	Resolves active backend from config with fallback behavior and test seams.
libs/shared/ui-data-history/src/lib/file-store/fake-file-store.ts	In-memory backend used for unit/contract tests (with real gzip).
libs/shared/ui-data-history/src/lib/data-history-state.ts	Central module state for tier limits/settings and deletion helper.
libs/shared/ui-data-history/src/lib/data-history-retention.ts	Adds retention + orphan reconciliation sweep with tier enforcement + locks.
libs/shared/ui-data-history/src/lib/data-history-manifest.ts	Adds manifest writer so on-disk folders can be re-indexed.
libs/shared/ui-data-history/src/lib/data-history-limits.ts	Adds tier-based limits and settings clamping defaults.
libs/shared/ui-data-history/src/lib/csv-utils.ts	Adds fixed-format CSV chunk serializer for streaming history writes.
libs/shared/ui-data-history/src/lib/tests/path-utils.spec.ts	Tests path validation/builders and org folder hashing behavior.
libs/shared/ui-data-history/src/lib/tests/fake-fsa-handles.ts	Adds in-memory FSA handles for DirectoryHandle backend tests.
libs/shared/ui-data-history/src/lib/tests/data-history-retention.spec.ts	Adds end-to-end tests for retention sweep behavior and orphan cleanup.
libs/shared/ui-data-history/src/lib/tests/csv-utils.spec.ts	Tests streaming CSV chunk output behavior and invariants.
libs/shared/ui-data-history/src/index.ts	Exports public API surface of the new shared data history library.
libs/shared/ui-data-history/project.json	Adds Nx project config and Vitest target for ui-data-history.
libs/shared/ui-data-history/eslint.config.cjs	Adds eslint config passthrough for the new library.
libs/shared/ui-core/src/record/ViewEditCloneRecord.tsx	Records record modal create/edit/clone actions to Data History (inline payload).
libs/shared/ui-core/src/mass-update-records/useDeployRecords.ts	Wires mass-update flow to create/finalize Data History entries and stream results.
libs/shared/ui-core/src/mass-update-records/MassUpdateRecordsDeploymentRow.tsx	Refactors result-building to shared utils to match captured history/export shape.
libs/shared/ui-core/src/mass-update-records/mass-update-records.utils.tsx	Adds shared builders for mass-update combined result rows + headers.
libs/shared/ui-core/src/mass-update-records/data-history-capture.ts	Adds thin adapters from mass-update deploy flow to history capture APIs.
libs/shared/ui-core/src/mass-update-records/tests/mass-update-history-builders.spec.ts	Adds unit tests for the new mass-update result/header builders.
libs/shared/ui-core/src/mass-update-records/tests/data-history-capture.spec.ts	Adds integration tests for mass-update → Data History wiring using fake backends.
libs/shared/ui-core/src/index.ts	Exports new Data History related UI components/settings from ui-core.
libs/shared/ui-core/src/app/HeaderNavbarItems.tsx	Adds Data History entry to header navigation menu config.
libs/shared/ui-core/src/app/HeaderNavbar.tsx	Adds a header icon button linking to Data History.
libs/shared/ui-core/src/app/DataHistoryLinks.tsx	Adds reusable header button + inline “View Data History” link components.
libs/shared/ui-core/src/app/AppHome/AppHome.tsx	Adds Data History card to the “Load” section on the home page.
libs/shared/ui-app-state/src/lib/ui-app-state.ts	Adds atom to synchronously track whether capture is enabled (seeded on init).
libs/shared/constants/src/lib/shared-constants.ts	Adds analytics keys and page title constant for Data History.
libs/icon-factory/src/lib/icon-factory.tsx	Adds new icons (standard/utility pin/pinned/asset_audit) for UI usage.
libs/features/update-records/src/deployment/MassUpdateRecordsDeployment.tsx	Adds per-run “skip history” option and links to Data History when enabled.
libs/features/query/src/QueryResults/QueryResults.tsx	Wires query inline edit save capture into recordDataHistoryAction.
libs/features/query/src/QueryResults/BulkUpdateFromQuery/BulkUpdateFromQueryModal.tsx	Adds “skip history” toggle in bulk-update-from-query modal when enabled.
libs/features/load-records/src/utils/data-history-capture.ts	Adds helper adapters for Load Records to write/append/finish/fail history entries.
libs/features/load-records/src/utils/tests/data-history-capture.spec.ts	Adds unit tests for load-records history capture wrappers/mappers.
libs/features/load-records/src/components/load-results/LoadRecordsResults.tsx	Threads an optional Data History handle through results components.
libs/features/load-records/src/components/load-results/LoadRecordsBatchApiResults.tsx	Streams batch results to Data History and finalizes entries with counts.
libs/features/load-records/src/components/load-results/load-results-utils.ts	Adds shared result-row/header builders for Load Records exports + history capture.
libs/features/load-records/src/components/load-results/tests/load-results-utils.spec.ts	Adds unit tests for Load Records shared result-row/header builders.
libs/features/load-records/src/components/load-results/tests/data-history-results-capture.spec.ts	Adds integration tests for Load Records → Data History end-to-end capture.
libs/features/load-records-multi-object/src/useDownloadResults.ts	Refactors exports to shared builders used by both downloads and history capture.
libs/features/load-records-multi-object/src/LoadRecordsMultiObject.tsx	Adds multi-object load Data History capture, per-run opt-out, and finalize step.
libs/features/load-records-multi-object/src/load-records-multi-object-results.ts	Adds shared request/result export builders + derived counts helper.
libs/features/load-records-multi-object/src/data-history-capture.ts	Adds adapters for multi-object load to write request/finalize/derive metadata.
libs/features/load-records-multi-object/src/tests/data-history-capture.spec.ts	Adds tests for multi-object capture helpers and history wiring.
libs/features/data-history/vite.config.ts	Adds Vitest config for the new feature/data-history UI library.
libs/features/data-history/tsconfig.spec.json	Adds test TS config for the data-history feature library.
libs/features/data-history/tsconfig.lib.json	Adds library TS config for the data-history feature library.
libs/features/data-history/tsconfig.json	Adds TS project references for the data-history feature library.
libs/features/data-history/src/lib/DataHistoryDetailModal.tsx	Adds detail modal with preview/download of saved payloads for an entry.
libs/features/data-history/src/lib/data-history-page.utils.ts	Adds labels, formatting, sorting, preview truncation, and download naming helpers.
libs/features/data-history/src/lib/data-history-download.ts	Adds shared download helper that reads/decompresses and triggers file save.
libs/features/data-history/src/lib/tests/data-history-page.utils.spec.ts	Adds unit tests for Data History page utility behaviors.
libs/features/data-history/src/index.ts	Exports Data History feature components/utils.
libs/features/data-history/project.json	Adds Nx project config and Vitest target for the new feature library.
libs/features/data-history/eslint.config.cjs	Adds eslint config passthrough for the new feature library.
libs/features/create-records/src/lib/CreateRecords.tsx	Records “create record without file” actions to Data History (inline payload).
libs/desktop-types/src/lib/desktop-app.types.ts	Adds Electron IPC request types + preference for native data history folder.
apps/jetstream/vite.config.ts	Adjusts Vite fs allow list for dev server.
apps/jetstream/src/app/components/settings/Settings.tsx	Adds Data History settings section to app settings page.
apps/jetstream/src/app/components/core/AppInitializer.tsx	Initializes Data History and seeds capture-enabled state atom at startup.
apps/jetstream/src/app/AppRoutes.tsx	Adds route for the new Data History page.
apps/jetstream-web-extension/vite.plugins.ts	Adds placeholder page entry for data-history in extension build.
apps/jetstream-web-extension/vite.config.ts	Adds dev server fs allow list and worker ts-paths plugin for extension.
apps/jetstream-web-extension/src/pages/app/App.tsx	Adds Data History route for the extension app.
apps/jetstream-web-extension/src/pages/additional-settings/AdditionalSettings.tsx	Adds Data History settings section to extension additional settings.
apps/jetstream-web-extension/src/core/AppInitializer.tsx	Initializes Data History and seeds capture-enabled state for extension.
apps/jetstream-desktop/src/services/ipc.service.ts	Adds IPC handlers for native data history file ops and folder configuration.
apps/jetstream-desktop/src/preload.ts	Exposes Data History IPC APIs to the renderer via contextBridge.
apps/jetstream-desktop-client/vite.config.ts	Enables worker ts-paths plugin and adjusts dev server fs allow list.
apps/jetstream-desktop-client/src/app/components/settings/Settings.tsx	Adds Data History settings section to desktop client settings.
apps/jetstream-desktop-client/src/app/components/core/AppInitializer.tsx	Initializes Data History and seeds capture-enabled state for desktop client.
apps/jetstream-desktop-client/src/app/AppRoutes.tsx	Adds Data History route for the desktop client.
apps/jetstream-canvas/vite.config.mts	Enables worker ts-paths plugin and adjusts dev server fs allow list.
apps/jetstream-canvas/src/app/core/AppInitializer.tsx	Initializes Data History and seeds capture-enabled state for canvas app.
apps/jetstream-canvas/src/app/AppRoutes.tsx	Adds Data History route for the canvas app.
apps/docs/sidebars.ts	Adds Data History doc page to docs sidebar.
apps/docs/docs/load/data-history.mdx	Adds end-user documentation for the Data History feature.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

[Copilot]

Pull request overview

Copilot reviewed 120 out of 121 changed files in this pull request and generated 1 comment.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

[Copilot]

Pull request overview

Copilot reviewed 120 out of 121 changed files in this pull request and generated 3 comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

[Copilot]

Pull request overview

Copilot reviewed 120 out of 121 changed files in this pull request and generated 1 comment.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (1)

libs/shared/ui-data-history/src/lib/file-store/path-utils.ts:48

• getParentDirPath() returns an empty string for single-segment paths (e.g. 'manifest.json'). Downstream callers treat this as an entry directory and pass it to deleteEntryDir, which then throws on validation (and can derail migrations / deletes for corrupted rows).

Add an explicit guard so getParentDirPath only accepts paths that actually have a parent directory.

[Copilot]

Pull request overview

Copilot reviewed 120 out of 121 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (3)

libs/shared/ui-data-history/src/lib/data-history.service.ts:444

• Potential race with the retention sweep's orphan-dir cleanup: this branch writes payload files + manifest to the file store before dataHistoryDb.saveEntry(item) runs (line 475). If runDataHistoryRetentionSweep() is running concurrently, step (5) will see a dh_* directory with no Dexie row yet and may delete it as an orphan, leaving the eventual saved row pointing at missing files. Consider either (a) inserting a placeholder Dexie row before any file I/O (then updating it with file refs), or (b) marking the entry key as "active" and having the sweep skip active keys for orphan deletion.
  libs/features/data-history/src/lib/DataHistoryPayloadTab.tsx:161
• buildJsonPreview parses and pretty-prints the entire JSON string before applying buildDataHistoryPreviewText. For large request/result payloads this can freeze the UI (JSON.parse + JSON.stringify on multi‑MB content) even though the preview ultimately truncates to 100k chars / 200 lines. Consider truncating first and skipping JSON.parse when truncation occurred (show raw preview text instead).

function buildJsonPreview(text: string): LoadedDataHistoryPayload {
  let formatted = text;
  try {
    formatted = JSON.stringify(JSON.parse(text), null, 2);
  } catch {

apps/docs/docs/load/data-history.mdx:50

• Docs say Jetstream "automatically asks" for persistent storage, but the implementation intentionally skips auto-requesting on Firefox (browserPromptsForPersist() in @jetstream/ui/data-history), requiring an explicit user gesture instead. Please qualify this sentence (e.g. "In most browsers…" / "Firefox requires clicking the keep-history button") so it matches actual behavior.

Jetstream automatically asks the browser for "persistent storage" to protect your history from
automatic cleanup — no action needed on your part.

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (2)

libs/shared/ui-db/src/lib/data-history.db.ts:96

• getEntries() always scans the createdAt (or [org+createdAt]) index and then filters source in memory, even though the Dexie schema defines a [source+createdAt] compound index. For large histories this makes common queries like getEntries({ source: ... }) and retention sweeps needlessly expensive.
  apps/docs/docs/load/data-history.mdx:50
• The docs say Jetstream automatically requests persistent storage with no user action, but the implementation explicitly skips auto-request on Firefox to avoid a doorhanger prompt (it requires an explicit user gesture via the "keep my history" button). This section should mention the Firefox behavior so users aren’t misled.

Jetstream automatically asks the browser for "persistent storage" to protect your history from
automatic cleanup — no action needed on your part.

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (1)

libs/features/load-records/src/components/load-results/LoadRecordsBatchApiResults.tsx:1

• Avoid disabling react-hooks/refs for the entire module. This rule is intended to catch ref mutations during render that can lead to subtle tearing/stale reads; disabling it file-wide makes it easier for future ref misuse to slip in unnoticed. Prefer ref updates inside a useEffect (or, if the pattern is truly needed, use a narrowly scoped // eslint-disable-next-line react-hooks/refs on the exact line that triggers the rule and immediately re-enable afterward).

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated 1 comment.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated 1 comment.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (2)

libs/features/load-records/src/components/load-results/LoadRecordsBatchApiResults.tsx:1

• The file-level eslint-disable react-hooks/refs disables hook/ref lint checks across the entire component, which can hide real dependency/stale-closure issues elsewhere in the file. If only a specific ref usage needs an exception, prefer a narrowly scoped eslint-disable-next-line react-hooks/refs on that line (or refactor to satisfy the rule) rather than disabling the rule for the whole file.
  apps/docs/docs/load/data-history.mdx:50
• The docs say Jetstream automatically requests persistent storage with no user action, but the implementation intentionally skips auto-request on browsers that prompt (e.g. Firefox) and instead relies on an explicit user gesture. Consider adjusting this line to avoid over-promising persistence behavior across browsers.

Jetstream automatically asks the browser for "persistent storage" to protect your history from
automatic cleanup — no action needed on your part.

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (1)

libs/features/data-history/src/lib/DataHistoryPayloadTab.tsx:161

• buildJsonPreview attempts JSON.parse/JSON.stringify on the full payload before truncation. For large request/result JSON this can be very slow and memory-heavy, even though the UI ultimately only shows a capped preview. Truncate first and only pretty-print when the content is small enough to fully preview.

function buildJsonPreview(text: string): LoadedDataHistoryPayload {
  let formatted = text;
  try {
    formatted = JSON.stringify(JSON.parse(text), null, 2);
  } catch {
    // not valid JSON — show the raw text
  }
  const { text: jsonText, truncated } = buildDataHistoryPreviewText(formatted);
  return { jsonText, jsonTruncated: truncated };

[Copilot]

Pull request overview

Copilot reviewed 121 out of 122 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file

Comments suppressed due to low confidence (1)

apps/jetstream-canvas/src/app/core/AppInitializer.tsx:65

• This effect now uses setDataHistoryCaptureEnabled/setDataHistoryInitialized but still has an empty dependency array. With eslint-plugin-react-hooks (exhaustive-deps) enabled elsewhere in the repo, this is likely to trigger a lint warning/error and is inconsistent with the other AppInitializers that include these setters in deps.

      .then(() => setDataHistoryInitialized(true))
      .catch((ex) => {
        logger.error('[DB] Error initializing db', ex);
      });
  }, []);

[Copilot]

Pull request overview

Copilot reviewed 123 out of 124 changed files in this pull request and generated no new comments.

Files not reviewed (1)

• pnpm-lock.yaml: Generated file