[ML] Automate patch version bump in CI pipeline by edsavage · Pull Request #3030 · elastic/ml-cpp

edsavage · 2026-04-30T23:35:10Z

Replace the version-bump pipeline stub with a patch-only flow: Slack notification, Wolfi step running dev-tools/bump_version.sh to bump elasticsearchVersion on BRANCH, then json-watcher polling for staging and snapshot artifact versions.

Supports DRY_RUN=true to skip git push. Minor-branch automation will follow in a separate change.

Made-with: Cursor

Replace the version-bump pipeline stub with a patch-only flow: Slack notification, Wolfi step running dev-tools/bump_version.sh to bump elasticsearchVersion on BRANCH (and .backportrc.json on main), then json-watcher polling for staging and snapshot artifact versions. Supports DRY_RUN=true to skip git push. Minor-branch automation will follow in a separate change. Made-with: Cursor

prodsecmachine · 2026-04-30T23:35:21Z

✅ Snyk checks have passed. No issues have been found so far.

Status	Scan Engine	Critical	High	Medium	Low	Total (0)
✅	Open Source Security	0	0	0	0	0 issues
✅	Licenses	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

- Add send_slack_version_bump_notification.sh (version-bump pipeline only) with ML_CPP_VERSION_BUMP_TEST_MODE banner and optional channel override. - Wire job-version-bump.json.py to use it; support ML_CPP_VERSION_BUMP_SKIP_DRA_WAIT for short smoke runs without json-watcher polling. Made-with: Cursor

Widen ml-cpp-version-bump branch_configuration for PR elastic#3030 smoke tests; revert to main-only after validation. Made-with: Cursor

The temporary ml-cpp-version-bump branch_configuration change is proposed separately so PR elastic#3030 stays focused on the bump automation. Made-with: Cursor

Copilot

Pull request overview

This PR updates the ML CI “version bump” pipeline from a stubbed/manual flow to an automated patch-version bump workflow that (1) notifies Slack, (2) bumps elasticsearchVersion on a target branch, and (3) optionally polls published artifact JSON until the expected versions appear.

Changes:

Add dev-tools/bump_version.sh to bump elasticsearchVersion (and update .backportrc.json when targeting main) with optional DRY_RUN=true.
Add a dedicated Buildkite pipeline YAML generator for Slack notifications in the version-bump pipeline.
Update .buildkite/job-version-bump.json.py to run the bump step and then poll staging/snapshot artifact JSON via elastic/json-watcher.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
`dev-tools/bump_version.sh`	New automation script to bump `elasticsearchVersion`, commit, and push (with `DRY_RUN` support).
`.buildkite/pipelines/send_slack_version_bump_notification.sh`	New pipeline snippet generator to configure Slack notifications specifically for version bump runs.
`.buildkite/job-version-bump.json.py`	Replaces the old stub/block flow with bump + (optional) artifact polling steps.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Patch-only version bumps update gradle.properties only; main/minor backport mapping stays out of this PR. Made-with: Cursor

Remove ML_CPP_VERSION_BUMP_TEST_MODE / TEST banner and ML_CPP_VERSION_BUMP_SKIP_DRA_WAIT (DRA wait steps always run). DRY_RUN remains a normal Buildkite env for bump_version.sh. Optional ML_CPP_VERSION_BUMP_SLACK_CHANNEL retained for routing. Made-with: Cursor

Runs before Slack queue and bump so CI credentials are validated without creating or updating remote refs. Made-with: Cursor

workflow_dispatch with branch/new_version/dry_run; GitHub App token for checkout and git push (addresses Buildkite Vault bot 403 class of issues). Document suggested secrets in workflow header. Made-with: Cursor

Run gh api (or curl fallback) against elastic-vault-github-plugin-prod during ml-cpp-version-bump git push auth probe; non-fatal. Remove before merge. Co-authored-by: Cursor <cursoragent@cursor.com>

Co-authored-by: Cursor <cursoragent@cursor.com>

- Add version_bump_validation.py and wire validate_version_bump_params.sh to git fetch + Python rules (SKIP before env checks). - Add pytest suite under dev-tools/unittest, pytest.ini, test-requirements.txt, run_dev_tools_tests.sh. - Extend ml-cpp-version-bump pipeline with validate-version-bump step; document bump_version.sh. - Add dev_tools_pytest Buildkite step (python:3) to format_and_validation pipeline. - Add test_validate_version_bump_local.sh helper for manual branch testing. Co-authored-by: Cursor <cursoragent@cursor.com>

Pytest plus manual validate_version_bump_params.sh usage is sufficient. Co-authored-by: Cursor <cursoragent@cursor.com>

Run with VERSION_BUMP_GIT_INTEGRATION=1 and VERSION_BUMP_TEST_BRANCH; document markers in pytest.ini. Co-authored-by: Cursor <cursoragent@cursor.com>

Co-authored-by: Cursor <cursoragent@cursor.com>

elasticsearchmachine · 2026-05-04T22:58:37Z

Pinging @elastic/ml-core (Team:ML)

Copilot

Pull request overview

Copilot reviewed 12 out of 12 changed files in this pull request and generated 7 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 12 out of 12 changed files in this pull request and generated 4 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…-bump-patch-only

… DRA skip - Restrict validation to patch bumps; enforce WORKFLOW=patch in shell - Revalidate bump after git pull; safer pipefail parsing for gradle version - Git push probe: dry-run refs/heads/${BRANCH} when BRANCH set (Buildkite) - Skip DRA json-watcher when DRY_RUN=true - Split pip bootstrap to dev_tools_pytest.sh; clearer errors for pytest/git root - Slack notification: drop Workflow line Co-authored-by: Cursor <cursoragent@cursor.com>

- bump_version.sh: topic branch ci/ml-cpp-version-bump-* + push + REST PR create - create_github_pull_request.py: POST pulls using GITHUB_TOKEN/VAULT_GITHUB_TOKEN - job-version-bump: DRA json-watcher only when WAIT_FOR_DRA=true (post-merge run) Co-authored-by: Cursor <cursoragent@cursor.com>

Co-authored-by: Cursor <cursoragent@cursor.com>

elasticsearchmachine added the v9.5.0 label Apr 30, 2026

edsavage added 3 commits May 1, 2026 11:54

[ML] TEMP: allow version-bump pipeline on PR test branch

e18afd3

Widen ml-cpp-version-bump branch_configuration for PR elastic#3030 smoke tests; revert to main-only after validation. Made-with: Cursor

[ML] Remove temp version-bump branch filter from patch bump PR

8260305

The temporary ml-cpp-version-bump branch_configuration change is proposed separately so PR elastic#3030 stays focused on the bump automation. Made-with: Cursor

edsavage requested a review from Copilot May 1, 2026 02:01

Copilot started reviewing on behalf of edsavage May 1, 2026 02:02 View session

Copilot AI reviewed May 1, 2026

View reviewed changes

Comment thread dev-tools/bump_version.sh Outdated

edsavage and others added 12 commits May 1, 2026 14:10

[ML] Trim bump_version.sh: drop .backportrc.json handling

e873f66

Patch-only version bumps update gradle.properties only; main/minor backport mapping stays out of this PR. Made-with: Cursor

[ML] Add git push --dry-run auth probe for version bump pipeline

cf1fc36

Runs before Slack queue and bump so CI credentials are validated without creating or updating remote refs. Made-with: Cursor

[ML] Add skeleton GHA workflow for patch version bump

e50edc6

workflow_dispatch with branch/new_version/dry_run; GitHub App token for checkout and git push (addresses Buildkite Vault bot 403 class of issues). Document suggested secrets in workflow header. Made-with: Cursor

[ML] TEMP: log Vault GitHub app permissions in bump probe

40839f1

Run gh api (or curl fallback) against elastic-vault-github-plugin-prod during ml-cpp-version-bump git push auth probe; non-fatal. Remove before merge. Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Remove temporary GitHub App permissions probe from bump script

319dbbf

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Remove redundant test_validate_version_bump_local.sh

f374889

Pytest plus manual validate_version_bump_params.sh usage is sufficient. Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Add opt-in git-fetch integration tests for version bump validation

d97b2b3

Run with VERSION_BUMP_GIT_INTEGRATION=1 and VERSION_BUMP_TEST_BRANCH; document markers in pytest.ini. Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Add temporary empty-commit probe to version-bump git auth step

8853a37

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Remove temporary commit probe; tidy version bump pipeline PR

6518000

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Drop run-patch-release workflow (no GitHub App secrets)

e41a06c

Co-authored-by: Cursor <cursoragent@cursor.com>

edsavage requested a review from Copilot May 4, 2026 22:56

Copilot started reviewing on behalf of edsavage May 4, 2026 22:57 View session

edsavage marked this pull request as ready for review May 4, 2026 22:57

edsavage added >build >non-issue :ml labels May 4, 2026

Copilot AI reviewed May 4, 2026

View reviewed changes

edsavage requested a review from Copilot May 4, 2026 23:55

Copilot started reviewing on behalf of edsavage May 4, 2026 23:56 View session

Copilot AI reviewed May 5, 2026

View reviewed changes

Comment thread dev-tools/git_push_auth_probe.sh Outdated

Comment thread dev-tools/validate_version_bump_params.sh Outdated

Comment thread .buildkite/job-version-bump.json.py

Comment thread dev-tools/run_dev_tools_tests.sh Outdated

edsavage and others added 8 commits May 5, 2026 13:19

Merge branch 'main' of github.com:elastic/ml-cpp into feature/version…

6d707d6

…-bump-patch-only

[ML] Restore DRA wait step in version bump pipeline (after PR merge)

14a2d82

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Use GitHub CLI for version-bump PRs with gh auto-install

e65958a

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Fix gh pr merge for older Wolfi CLI (no --yes flag)

13345b6

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Default version-bump PR merge to squash (no merge commits on repo)

2d7be23

Co-authored-by: Cursor <cursoragent@cursor.com>

[ML] Opt-in gh pr merge --admin for protected-branch rule bypass

fcd0404

Co-authored-by: Cursor <cursoragent@cursor.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ML] Automate patch version bump in CI pipeline#3030

[ML] Automate patch version bump in CI pipeline#3030
edsavage wants to merge 24 commits intoelastic:mainfrom
edsavage:feature/version-bump-patch-only

edsavage commented Apr 30, 2026

Uh oh!

prodsecmachine commented Apr 30, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

elasticsearchmachine commented May 4, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

edsavage commented Apr 30, 2026

Uh oh!

prodsecmachine commented Apr 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Snyk checks have passed. No issues have been found so far.

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

elasticsearchmachine commented May 4, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

prodsecmachine commented Apr 30, 2026 •

edited

Loading