Skip to content

Fix google gke system dag deprecations#69876

Open
viiccwen wants to merge 1 commit into
apache:mainfrom
viiccwen:fix-google-gke-system-dag-deprecations
Open

Fix google gke system dag deprecations#69876
viiccwen wants to merge 1 commit into
apache:mainfrom
viiccwen:fix-google-gke-system-dag-deprecations

Conversation

@viiccwen

@viiccwen viiccwen commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Title

Fix deprecated node fields in GKE system Dags

This follow-up to #69822 fixes a separate problem exposed after the Vertex AI Feature Store system
Dag no longer blocked the generic import and serialization path.

Five Google Kubernetes Engine system Dags configured initial_node_count at the cluster level,
which the GKE API deprecates in favor of NodePool.initial_node_count. The three Standard cluster
examples now configure the initial node count on an explicit default-pool node pool.

The other two examples create Autopilot clusters. Because GKE manages their nodes and node pools,
they remove the deprecated cluster-level node count without adding a user-managed node pool.
GKECreateClusterOperator validation now permits this valid Autopilot payload while leaving Standard
cluster validation unchanged. This validation change is required in the same PR because it runs when
the operator is constructed during Dag import.

closes #69825


Was generative AI tooling used to co-author this PR?
  • Yes - GPT-5.6 Sol

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@viiccwen viiccwen requested a review from shahar1 as a code owner July 14, 2026 14:59
@boring-cyborg boring-cyborg Bot added area:providers provider:google Google (including GCP) related issues labels Jul 14, 2026
@viiccwen

Copy link
Copy Markdown
Contributor Author

cc @shahar1, @henry3260. 🙌

@viiccwen viiccwen force-pushed the fix-google-gke-system-dag-deprecations branch from 1bf5cc2 to 4847b3e Compare July 14, 2026 15:04

@henry3260 henry3260 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please correct me if I’m wrong.

Cluster-level node settings emit provider deprecation warnings, while Autopilot manages its own nodes and cannot use user-managed node pools.

Signed-off-by: viiccwen <vicwen@apache.org>
@viiccwen viiccwen force-pushed the fix-google-gke-system-dag-deprecations branch from 4847b3e to 88c565e Compare July 15, 2026 12:23
@viiccwen

Copy link
Copy Markdown
Contributor Author

cc @henry3260. 🙌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Google GKE system Dags use deprecated cluster fields

2 participants