Skip to content

Improve bitrise e2e output - prevent hung runs - #699

Open
kieran-osgood-shopify wants to merge 1 commit into
mainfrom
e2e-failed-hang
Open

Improve bitrise e2e output - prevent hung runs#699
kieran-osgood-shopify wants to merge 1 commit into
mainfrom
e2e-failed-hang

Conversation

@kieran-osgood-shopify

@kieran-osgood-shopify kieran-osgood-shopify commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

What changes are you making?

I noticed that on occasion if all tests fail for a given suite eg or Swift or React Native. What will happen is the bitrise Job will hang and during the polling phase which looks like this
image
In this case the Kotlin tests all failed due to a browser stack flake where a retry passed

What happened was all four tests reported completed, but the polling wasn't checking for that state. it was looking for failed or passed. so I've updated things to detect that now to prevent this case

Additionally I improved the formatting of the bitrise output so that going forwards these bitrise runs will output more information currently they are only output in the URL after success or failure or timeout which means you couldn't look into an app of running sweet until it had finished

Before After
image image

How to test

Watch this bitrise run: https://github.com/Shopify/checkout-kit/pull/699/checks?check_run_id=98477125606


Before you merge

Important

  • I've added tests to support my implementation
  • I have read and agree with the Contribution Guidelines
  • I have read and agree with the Code of Conduct
  • I've updated the relevant platform README (platforms/swift/README.md and/or platforms/android/README.md)

Releasing a new Swift version?
  • I have bumped the version in ShopifyCheckoutKit.podspec
  • I have bumped the version in platforms/swift/Sources/ShopifyCheckoutKit/ShopifyCheckoutKit.swift
  • I have updated the SwiftPM/CocoaPods version snippets in platforms/swift/README.md (major version only)
Releasing a new Embedded Checkout Protocol version?
  • I have bumped embeddedCheckoutProtocolAndroid in platforms/android/gradle/libs.versions.toml
  • I have updated protocol/languages/kotlin/embedded-checkout-protocol/api/embedded-checkout-protocol.api if the public API changed
Releasing a new Android version?
  • I have bumped checkoutKitAndroid in platforms/android/gradle/libs.versions.toml
  • I have updated the Gradle/Maven version snippets in platforms/android/README.md

Tip

See the Contributing documentation for the full release process per platform.

@kieran-osgood-shopify
kieran-osgood-shopify requested a review from a team as a code owner August 27, 2026 09:48
@github-actions github-actions Bot added the #gsd:50662 Rebase Checkout Kit on UCP label Aug 27, 2026
@kieran-osgood-shopify kieran-osgood-shopify changed the title feat: better bitrise output - prevent hung runs [WIP DRAFT] feat: better bitrise output - prevent hung runs Aug 27, 2026
@kieran-osgood-shopify kieran-osgood-shopify changed the title [WIP DRAFT] feat: better bitrise output - prevent hung runs [WIP DRAFT] Improve bitrise e2e output - prevent hung runs Aug 27, 2026
@bitrise

bitrise Bot commented Aug 27, 2026

Copy link
Copy Markdown

Install this build

Open Tophat, select your target device, then click Install. Links open on the Mac running Tophat.

SDK Install
React Native Install with Tophat
Swift Install with Tophat
Kotlin Install with Tophat

Checkout Kit E2E results

Status Suite Target Platform OS version tag Device
react-native-ios react-native ios latest iPhone 15
iOS 27 Beta
react-native-android react-native android latest Google Pixel 11
Android 17.0
kotlin-android kotlin android latest Google Pixel 11
Android 17.0
swift-ios swift ios latest iPhone 15
iOS 27 Beta

Failures

Caution

These E2E checks are not yet required, so they do not block merging — but a failure may still indicate a real issue to resolve before merging.
If you believe an assertion is flaky, please raise a ticket in the #checkout-kit-devs channel so it can be addressed.

BrowserStack artifacts require BrowserStack access. Sign in to BrowserStack App Automate before opening artifact links.

Android — react-native-android

Test Status Artifacts
./tests/shared/checkout-present-and-close BrowserStack · Video · Screenshot · Maestro commands · Maestro log

Android — kotlin-android

Test Status Artifacts
./tests/shared/checkout-hardcoded-buyer-identity BrowserStack · Video · Screenshot · Maestro commands · Maestro log
./tests/shared/checkout-present-and-close BrowserStack · Video · Screenshot · Maestro commands · Maestro log

@kieran-osgood-shopify kieran-osgood-shopify changed the title [WIP DRAFT] Improve bitrise e2e output - prevent hung runs Improve bitrise e2e output - prevent hung runs Aug 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

#gsd:50662 Rebase Checkout Kit on UCP

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant