Add file-based transfer APIs to build cache provider interface and all cache plugins#5746

Open

Copilot wants to merge 45 commits intomainfrom

copilot/stream-cache-entry-for-http-plugin

Commits on Apr 8, 2026

feat: add streaming support to build cache provider interface and HTTP plugin

Copilot
and
iclanton
committed
fix lint warnings, add change files and API report update

Copilot
and
iclanton
committed
address code review feedback: improve type annotations and JSDoc

Copilot
and
iclanton
committed
Replace manual change files with rush change --bulk generated change file

Copilot
and
iclanton
committed
Use createReadStream/createWriteStream from FileSystem instead of fs directly

Copilot
and
iclanton
committed
Use ensureFolderExists option in FileSystem.createWriteStream

Copilot
and
iclanton
committed
Add streaming support to Amazon S3 and Azure Storage build cache plugins

Copilot
and
iclanton
committed
Address code review: add documentation for type assertion and no-retry streaming upload

Copilot
and
iclanton
committed
Gate streaming build cache behind useStreamingBuildCache experiment flag

Copilot
and
iclanton
committed
Update changelogs.
iclanton
committed
Expand FileSystem.createWriteStream.
iclanton
committed
Use destructuring on rushConfiguration in PhasedScriptAction.
iclanton
committed
Clean up some duplicated types.
iclanton
committed
Fix CI: add missing useStreamingBuildCache to bridge plugin, fix WebClient private member type mismatch

Copilot
and
iclanton
committed
DRY up duplicated code across WebClient, AmazonS3Client, and HttpBuildCacheProvider

Copilot
and
iclanton
committed
Address code review: use Buffer.isBuffer for clearer body length check

Copilot
and
iclanton
committed
Change streaming cache APIs from Readable to NodeJS.ReadableStream

Copilot
and
iclanton
committed
DRY up Azure/HTTP cache providers, fix bridge plugin experiment config

Copilot
and
iclanton
committed
Clean up FileSystemBuildCacheProvider.
iclanton
committed
fixup! Fix CI: add missing useStreamingBuildCache to bridge plugin, fix WebClient private member type mismatch
iclanton
committed
Clean up WebClient.
iclanton
committed
Handle Content-Encoding decompression in streaming WebClient path

Copilot
and
iclanton
committed
Fix error message to show specific unsupported encoding value

Copilot
and
iclanton
committed
Fix CI: Move WebClient private members to module-level for rush-sdk type compatibility

Copilot
and
iclanton
committed
Address review comments: fix response.resume race, stream retry bug, error logging, stream cleanup, and nits

Copilot
and
iclanton
committed
Add unit tests for streaming cache APIs and fill buffer-based test gaps

Copilot
and
iclanton
committed
Fix buffer path error message to show specific unsupported encoding value

iclanton
and
claude
committed
Extract _getObjectName and _validateWriteAllowed helpers in S3 provider

iclanton
and
claude
committed
Extract _getContentEncodings helper to deduplicate encoding parsing

iclanton
and
claude
committed
Scope cacheEntryBuffer to its branch, use cloudCacheHit flag

iclanton
and
claude
committed
Reuse a single WebClient instance in HttpBuildCacheProvider

iclanton
and
claude
committed
Use property shorthand in HttpBuildCacheProvider

iclanton
and
claude
committed
Fix unit test issues in streaming cache tests

iclanton
and
claude
committed
Rework streaming cache APIs to file-based APIs with S3 payload signing

iclanton
and
claude
committed
Rename file-based cache APIs to tryDownload/tryUpload for clarity

iclanton
and
claude
committed
Replace jest.mock('node:fs') with FileSystem spies in cache tests

iclanton
and
claude
committed
Clean up partial file on failed cache download

iclanton
and
claude
committed
Ensure parent directory exists before Azure downloadToFile

iclanton
and
claude
committed
fixup! Ensure parent directory exists before Azure downloadToFile
iclanton
committed
Update change file descriptions, Azure JSDoc, and test names

iclanton
and
claude
committed
Fix S3 retry delay log unit from seconds to milliseconds

iclanton
and
claude
committed
fixup! Rework streaming cache APIs to file-based APIs with S3 payload signing
iclanton
committed
Add missing test coverage for file-based cache APIs

iclanton
and
claude
committed
Fix "unknown bytes" debug log wording in HttpBuildCacheProvider

iclanton
and
claude
committed
Address dmichon-msft review comments

iclanton
and
claude
committed