test: Updating older cross-build smoke tests (iOS, Android) by thesuzerain · Pull Request #7487 · mozilla/application-services

thesuzerain · 2026-07-20T15:55:50Z

This is a draft PR bringing in smoke tests scripts for building application-services against various targets (Android and iOS here, HNT to come, see below). It deprecates some older similar tests that are very out of date, and remakes them with up-to-date building methods (and more test flexibility).

I used existing helpers from the existing smoke tests where possible.

See: build instructions for iOS and build instructions for Fenix for context about the steps.

This currently makes no breaking changes. It is also thought that the deprecated smoke tests have long fallen out of use.

Remaining work:

We want to build against HNT if possible as well, but currently, HNT doesn’t have a system for building against a local a-s like the other two do. There are a couple possibilities I've explored (eg: redirecting cargo paths) but none that have been trivial. As it may require non-test-script changes, I would propose we do that in another PR.

There is also a good amount of iOS and Android tests that fail naturally (seemingly even in clean unrelated builds), and most possible regressions in a-s don’t cause a build or test failure, so it may be prudent in the future to make to extend iOS/Android tests to cover a-s behaviour specifically now that we have these scripts.

Pull Request checklist

Breaking changes: This PR follows our breaking change policy
- This PR follows the breaking change policy:
  - This PR has no breaking API changes, or
  - There are corresponding PRs for our consumer applications that resolve the breaking changes and have been approved
Quality: This PR builds and tests run cleanly
- Note:
  - For changes that need extra cross-platform testing, consider adding [ci full] to the PR title.
  - If this pull request includes a breaking change, consider cutting a new release after merging.
Tests: This PR includes thorough tests or an explanation of why it does not
Changelog: This PR includes a changelog entry in CHANGELOG.md or an explanation of why it does not need one
- Any breaking changes to Swift or Kotlin binding APIs are noted explicitly
Dependencies: This PR follows our dependency management guidelines
- Any new dependencies are accompanied by a summary of the due diligence applied in selecting them.

thesuzerain · 2026-07-20T16:44:51Z

+MOZILLA_RUST_COMPONENTS_AS_PATH = "megazords/ios-rust/MozillaRustComponents.xcframework"
+
+
+def replace_swift_package_artifact(ios_repo_path, as_repo_path):


I don't love using regex here but given how often this artifact file is updated (with hashes, etc) it doesn't really seem possible to use a fixture for it.

jonesetc · 2026-07-21T16:35:17Z

+# - xcode + xcodebuild + xcodetools setup and running (a successful build of the firefox-ios repository)
+# Arguments:
+#       --action            => Can be either `run-tests` (default) or `build-without-testing`
+#       --use-local-repo    => Use a local firefox-ios repository instead (at the provided path). Exclusive with `remote-repo-url`.


Looks outdated? There is a --firefox-dir FIREFOX_DIR, but no --use-local-repo or --remote-repo-url

jonesetc · 2026-07-22T16:52:36Z

Was able to force an android regression in testing with this patch:

diff --git a/components/ads-client/src/lib.rs b/components/ads-client/src/lib.rs
index 2088ee16c..1279423e9 100644
--- a/components/ads-client/src/lib.rs
+++ b/components/ads-client/src/lib.rs
@@ -72,10 +72,10 @@ impl MozAdsClient {
     #[uniffi::method(default(options = None))]
     pub fn record_impression(
         &self,
-        impression_url: String,
+        impression_url_foo: String,
         options: Option<MozAdsCallbackOptions>,
     ) -> AdsClientApiResult<()> {
-        let url = AdsClientUrl::parse(&impression_url).map_err(|e| {
+        let url = AdsClientUrl::parse(&impression_url_foo).map_err(|e| {
             ComponentError::RecordImpression(CallbackRequestError::InvalidUrl(e).into())
         })?;
         let ohttp = options.map(|o| o.ohttp).unwrap_or(false);

and running automation/build_against_fenix.py --prefix-ff fenix --prefix-as ads-client --firefox-dir ../firefox produced:

...
> Compiling firefox with mozconfig with `./gradlew fenix:assembleDebug` (mozconfig=`/var/folders/lr/zvwpm2dn5n133j0st4z6n6c00000gn/T/tmphrsr28ca-test-fenix/mozconfig_android`)...
e: file:///.../firefox/mobile/android/android-components/components/service/mars/src/main/java/mozilla/components/service/mars/MozAdsUseCases.kt:50:70 No parameter with name 'impressionUrl' found.
e: file:///.../firefox/mobile/android/android-components/components/service/mars/src/main/java/mozilla/components/service/mars/MozAdsUseCases.kt:50:70 No value passed for parameter 'impressionUrlFoo'.

thesuzerain · 2026-07-30T16:52:09Z

+And if so desired:
+
+```bash
+./mach run


I tried this strategy this morning and it's having a strange new error with link_nss_rustlib from I think recent commits- will update or delete based on trying it out, but wnted to flag this.

I believe this is related to some breaking changes in some of the monorepo patches this morning (things out of sync, etc) and not related to this. Will wait for some patches and I'll ensure that these are all OK before merging.

mhammond

This all seems very elaborate and unlikely to be widely used, but you aren't forcing anyone to use this and if it scratches your itch I've no objection. I think "hnt" is very unclear though.

mhammond · 2026-07-31T01:29:01Z

+# License, v. 2.0. If a copy of the MPL was not distributed with this
+# file, You can obtain one at https://mozilla.org/MPL/2.0/.
+
+# Purpose: Run Firefox fenix tests against this application-services working tree.


I have no idea what HNT stands for and google isn't helping. It looks like it's somehow related to desktop, but this all says Fenix.

mhammond · 2026-07-31T01:29:47Z

@@ -0,0 +1,88 @@
+# How to locally test application-services components on HNT / Desktop


ditto here, no idea what a "hnt desktop" is?

mhammond · 2026-07-31T01:35:46Z

+
+**Current workflow (recommended):**
+
+1. Verify the local build of `A-S` is ready for a desktop build.


You could consider documenting the strategy of having your a-s changes on a branch and vendoring from that, avoiding symlinks etc. For many use-cases, the re-vendor is needed, so it isn't going to be wasted work but instead will be working on what needs to land anyway.

(IOW, using this process when you need to actually re-vendor anyway is a waste of time, might as well just work directly on the vendor)

mhammond · 2026-07-31T01:37:05Z

+2. Move the A-S components folder in M-C/Firefox to a temporary rename.
+3. Create a symlink between the A-S and M-C components folders.
+4. Generate uniffi bindings.
+5. Run and build.


Should probably include "./mach vendor rust" and "./mach cargo vet" - only necessary if there have been dependency changes, but that would block (or at least slow) landing.

thesuzerain added 8 commits July 19, 2026 11:51

test: Adds new python smoke tests for building against iOS; fenix

f6b7579

test: Adds scheme, tests

e0a8b67

fix: Modularization and missing xcframework change

5a50949

fix: linting

0f4649a

fix: Lints, docs

01dc2e3

fix: Adds deprecation notes

54c9391

fix: Adds regex for fenix + docs

a223a2f

fix: Clarifies a todo

de33222

thesuzerain commented Jul 20, 2026

View reviewed changes

fix: missed err_msg change

119a717

thesuzerain commented Jul 20, 2026

View reviewed changes

Comment thread automation/build_against_all.py

thesuzerain requested a review from jonesetc July 20, 2026 19:31

jonesetc reviewed Jul 21, 2026

View reviewed changes

Comment thread automation/build_against_fenix.py

thesuzerain added 8 commits July 22, 2026 13:18

feat: Adds HNT tests, fixes some review issues

b2f472f

fix: Some missing docs

a5a8e20

fix: Small edits

a82029a

fix: adds hnt test

3174384

fix: Build against all

203c371

fix: Small log correction

fd689b0

fix: some doc changes

3825800

fix: some readme linting

29f33ae

thesuzerain marked this pull request as ready for review July 24, 2026 20:37

thesuzerain commented Jul 30, 2026

View reviewed changes

thesuzerain requested a review from mhammond July 30, 2026 21:02

mhammond approved these changes Jul 31, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

test: Updating older cross-build smoke tests (iOS, Android) - #7487

test: Updating older cross-build smoke tests (iOS, Android)#7487
thesuzerain wants to merge 17 commits into
mainfrom
test-updating-older-cross-build-smoke-tests

thesuzerain commented Jul 20, 2026 •

edited

Loading

Uh oh!

thesuzerain Jul 20, 2026

Uh oh!

Uh oh!

jonesetc Jul 21, 2026

Uh oh!

Uh oh!

jonesetc commented Jul 22, 2026

Uh oh!

thesuzerain Jul 30, 2026 •

edited

Loading

Uh oh!

thesuzerain Jul 30, 2026

Uh oh!

mhammond left a comment

Uh oh!

mhammond Jul 31, 2026

Uh oh!

mhammond Jul 31, 2026

Uh oh!

mhammond Jul 31, 2026

Uh oh!

mhammond Jul 31, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

		MOZILLA_RUST_COMPONENTS_AS_PATH = "megazords/ios-rust/MozillaRustComponents.xcframework"


		def replace_swift_package_artifact(ios_repo_path, as_repo_path):

		@@ -0,0 +1,88 @@
		# How to locally test application-services components on HNT / Desktop


		Current workflow (recommended):

		1. Verify the local build of `A-S` is ready for a desktop build.

Uh oh!

Conversation

thesuzerain commented Jul 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Remaining work:

Pull Request checklist

Uh oh!

thesuzerain Jul 20, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jonesetc Jul 21, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jonesetc commented Jul 22, 2026

Uh oh!

thesuzerain Jul 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

thesuzerain Jul 30, 2026

Choose a reason for hiding this comment

Uh oh!

mhammond left a comment

Choose a reason for hiding this comment

Uh oh!

mhammond Jul 31, 2026

Choose a reason for hiding this comment

Uh oh!

mhammond Jul 31, 2026

Choose a reason for hiding this comment

Uh oh!

mhammond Jul 31, 2026

Choose a reason for hiding this comment

Uh oh!

mhammond Jul 31, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

thesuzerain commented Jul 20, 2026 •

edited

Loading

thesuzerain Jul 30, 2026 •

edited

Loading