Skip to content

Add agentic workflow to auto-rerun flaky PR build failures#7610

Draft
Copilot wants to merge 4 commits intomainfrom
copilot/analyze-and-rerun-failed-jobs
Draft

Add agentic workflow to auto-rerun flaky PR build failures#7610
Copilot wants to merge 4 commits intomainfrom
copilot/analyze-and-rerun-failed-jobs

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 9, 2026

  • Research gh-aw (GitHub Agentic Workflows) framework and real-world examples (ci-doctor, workflow-health-manager)
  • Replace the PowerShell composite action + YAML workflow with a single gh-aw Markdown agentic workflow
    • Defined YAML frontmatter with workflow_run trigger, permissions, tools, and safe-outputs
    • Wrote natural language instructions for the Copilot agent with a clear protocol
    • Added pre-processing steps to download failed job logs and prepare context
    • Defined safe-outputs for add-comment, rerun-failed-jobs, and noop with max limits
  • Remove the old composite action (RerunFailedJobs/action.ps1, RerunFailedJobs/action.yaml)
  • Remove the old YAML workflow (RerunFailedPRBuild.yaml)
  • Remove old tests (no longer applicable — the agent is tested through its runtime behavior)
  • Address code review feedback (safe-output limits, regex fix, rerun threshold clarification, test failure classification)
  • Validate with parallel_validation

Copilot AI and others added 2 commits April 9, 2026 07:02
…ailed PR builds

Agent-Logs-Url: https://github.com/microsoft/BCApps/sessions/4b8ccc61-e9ef-47ce-8171-6752e872c723

Co-authored-by: mazhelez <43066499+mazhelez@users.noreply.github.com>
… threshold and test classification

Agent-Logs-Url: https://github.com/microsoft/BCApps/sessions/4b8ccc61-e9ef-47ce-8171-6752e872c723

Co-authored-by: mazhelez <43066499+mazhelez@users.noreply.github.com>
Copilot AI requested a review from mazhelez April 9, 2026 07:05
@aholstrup1
Copy link
Copy Markdown
Contributor

What about a workflow instead? #7408

@mazhelez
Copy link
Copy Markdown
Contributor

mazhelez commented Apr 9, 2026

What about a workflow instead? #7408

Ahh, I haven't seen that PR! I just wanted to try out agentic workflows, and this seemed like a good scenario.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants