test: improve TME E2E pipeline reliability - #9078
Open
djsly wants to merge 3 commits into
Open
Conversation
Increase the TME E2E job timeout to match other hardware-like E2E jobs and emit gotestsum rerun diagnostics so failed-test-only retry behavior is visible in branch validation runs. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 1d7dd070-47e7-44be-b7e0-a7bd3490df97
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 1d7dd070-47e7-44be-b7e0-a7bd3490df97
djsly
requested review from
AbelHu,
Devinwong,
SriHarsha001,
awesomenix,
calvin197,
cameronmeissner,
ganeshkumarashok,
karenychen,
lilypan26,
mxj220,
pdamianov-dev,
phealy,
r2k1,
runzhen,
sulixu,
timmy-wright,
titilambert,
xuexu6666 and
zachary-bailey
as code owners
July 30, 2026 04:08
Contributor
There was a problem hiding this comment.
Pull request overview
This PR improves the reliability of the TME E2E Azure Pipelines workflow by aligning job timeout behavior with other hardware-style E2E pipelines and making the test runner setup more resilient and diagnosable.
Changes:
- Increase the TME E2E job timeout to 120 minutes via the shared E2E template parameter.
- Harden
.pipelines/scripts/e2e_run.shby failing fast on missing required env vars, retrying transientgotestsumdownload failures, and emitting a rerun-fails report artifact when retries are enabled.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| .pipelines/scripts/e2e_run.sh | Adds required-var checks, curl retries for gotestsum download, and improved gotestsum rerun-fails diagnostics/report artifact upload. |
| .pipelines/e2e-tme.yaml | Sets jobTimeoutInMinutes: 120 to prevent premature job termination during slow-start hardware validation runs. |
…ipeline # Conflicts: # .pipelines/e2e-tme.yaml # .pipelines/scripts/e2e_run.sh
Contributor
Windows Unit Test Results 3 files 11 suites 49s ⏱️ Results for commit b60d92e. |
Comment on lines
+24
to
32
| SUBSCRIPTION_ID="${SUBSCRIPTION_ID:-}" | ||
| SUBSCRIPTION_ID_OVERRIDE="${SUBSCRIPTION_ID_OVERRIDE:-}" | ||
| if [ -n "${SUBSCRIPTION_ID_OVERRIDE}" ]; then | ||
| SUBSCRIPTION_ID="${SUBSCRIPTION_ID_OVERRIDE}" | ||
| fi | ||
|
|
||
| SUBSCRIPTION_ID="${SUBSCRIPTION_ID:?SUBSCRIPTION_ID or SUBSCRIPTION_ID_OVERRIDE must be set}" | ||
| az account set -s "${SUBSCRIPTION_ID}" | ||
| echo "Using subscription ${SUBSCRIPTION_ID} for e2e tests" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this PR does / why we need it:
The V7 hardware E2E validation was timing out or failing before tests could start, which made it hard to get reliable official-style results before re-enabling the gate. This PR makes the TME E2E pipeline more resilient by giving the hardware-style job the same 120-minute Azure Pipelines job cap used by GPU E2Es, adding failed-test rerun diagnostics, and retrying transient gotestsum download failures.
The updated branch produced a successful TME validation run against official Linux VHD build
173616201: https://msazure.visualstudio.com/09706533-03bf-4b43-9a9b-b49c75429646/_build/results?buildId=173669587. The run completed without timeout, started gotestsum, and finished withDONE 182 tests, 143 skipped in 266.124s.Which issue(s) this PR fixes:
N/A
🤖 Generated by GitHub Copilot