E2E: cleanup utility

[phyllis-sy-wu]

WHY are these changes introduced?

E2E tests create apps on the Dev Dashboard that can accumulate over time — especially when tests fail mid-run, CI times out, or cleanup is skipped during development. This PR adds:

1. Standalone cleanup utility (scripts/cleanup.ts) — bulk cleanup of leftover apps via browser automation
2. E2E_SKIP_CLEANUP toggle — env var to disable per-test teardown for debugging
3. Improved teardownApp — rewritten with browser login, dashboard search, direct FQDN-based uninstall, and retry logic

WHAT is this pull request doing?

New: scripts/cleanup.ts

Standalone cleanup script that finds E2E test apps on the Dev Dashboard, uninstalls them from all stores, and deletes them.

pnpm test:e2e-cleanup              # Full cleanup: uninstall + delete
pnpm test:e2e-cleanup -- --list    # List matching apps without action
pnpm test:e2e-cleanup -- --delete  # Delete only (skip apps still installed)
pnpm test:e2e-cleanup -- --headed  # Show browser window
pnpm test:e2e-cleanup -- --pattern X   # Match apps containing "X" (default: "E2E-")

Features:

• Browser-based login via shared completeLogin helper
• Dashboard pagination — finds apps across all pages
• Install count from dashboard card text — no extra navigation needed
• Per-app retry with configurable max retries (default: 2)
• Per-app and total timing in output
• All timeouts use shared BROWSER_TIMEOUT constants
• Exports cleanupAllApps() for use as a Playwright globalTeardown in the future

Updated: teardownApp in setup/app.ts

Rewritten with a reliable 4-step flow:

1. Login — authenticates browser via completeLogin (browser isn't authenticated on dev.shopify.com from the test's OAuth flow)
2. Find app — navigates to dashboard with ?search={appName} (fast, no pagination)
3. Uninstall (if installed) — goes directly to admin.shopify.com/store/{slug}/settings/apps via known FQDN
4. Delete — goes to app settings page with retry loop for uninstall propagation delay

All timeouts use shared BROWSER_TIMEOUT constants. Debug logging when DEBUG=1.

E2E_SKIP_CLEANUP toggle

All test finally blocks check this env var. When set, both local file cleanup and remote app teardown are skipped:

E2E_SKIP_CLEANUP=1 DEBUG=1 pnpm --filter e2e exec playwright test
# Apps remain on dashboard for inspection. Clean up later with: pnpm test:e2e-cleanup

Design: two cleanup mechanisms

• teardownApp (per-test, automatic) — knows the app name and store FQDN, uses direct URLs, no discovery. Runs in test finally blocks.
• cleanup.ts (bulk, manual) — discovers all matching apps via dashboard pagination, discovers stores via store switcher. Safety net for orphaned apps.

How to test your changes?

Cleanup script:

1. Create test apps: E2E_SKIP_CLEANUP=1 DEBUG=1 pnpm --filter e2e exec playwright test app-deploy
2. List them: pnpm test:e2e-cleanup -- --list
3. Clean up: pnpm test:e2e-cleanup -- --headed

Per-test teardown:

1. Run: DEBUG=1 pnpm --filter e2e exec playwright test app-deploy
2. Check output for [e2e] teardown: steps (login, find, uninstall, delete)

Measuring impact

• n/a - this doesn't need measurement, e.g. a linting rule or a bug-fix

Checklist

• I've considered possible cross-platform impacts (Mac, Linux, Windows)
• I've considered possible documentation changes

[phyllis-sy-wu]

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

• E2E: QA - app basic flow #7211
• E2E: cleanup utility #7171 👈 (View in Graphite)
• E2E: migrate tests to use new infra #7162
• E2E: infra refactor + app tests update #7147
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[github-actions]

Differences in type declarations

We detected differences in the type declarations generated by Typescript for this branch compared to the baseline ('main' branch). Please, review them to ensure they are backward-compatible. Here are some important things to keep in mind:

• Some seemingly private modules might be re-exported through public modules.
• If the branch is behind main you might see odd diffs, rebase main into this branch.

New type declarations

We found no new type declarations in this PR

Existing type declarations

packages/cli-kit/dist/private/node/ui.d.ts

 import { Logger, LogLevel } from '../../public/node/output.js';
-import React from 'react';
 import { Key, RenderOptions } from 'ink';
 import { EventEmitter } from 'events';
-/**
- * Signal that the current Ink tree is done. Must be called within an
- * InkLifecycleRoot — throws if the provider is missing so lifecycle
- * bugs surface immediately instead of silently hanging.
- */
-export declare function useComplete(): (error?: Error) => void;
-/**
- * Root wrapper for Ink trees. Owns the single `exit()` call site — children
- * signal completion via `useComplete()`, which sets state here. The `useEffect`
- * fires post-render, guaranteeing all batched state updates have been flushed
- * before the tree is torn down.
- */
-export declare function InkLifecycleRoot({ children }: {
-    children: React.ReactNode;
-}): React.JSX.Element;
 interface RenderOnceOptions {
     logLevel?: LogLevel;
     logger?: Logger;
     renderOptions?: RenderOptions;
 }
 export declare function renderOnce(element: JSX.Element, { logLevel, renderOptions }: RenderOnceOptions): string | undefined;
-export declare function render(element: JSX.Element, options?: RenderOptions): Promise<void>;
+export declare function render(element: JSX.Element, options?: RenderOptions): Promise<unknown>;
 export declare class Stdout extends EventEmitter {
     columns: number;
     rows: number;
     readonly frames: string[];
     private _lastFrame?;
     constructor(options: {
         columns?: number;
         rows?: number;
     });
     write: (frame: string) => void;
     lastFrame: () => string | undefined;
 }
 export declare function handleCtrlC(input: string, key: Key, exit?: () => void): void;
 export {};

packages/cli-kit/dist/public/node/ui.d.ts

@@ -34,7 +34,7 @@ export interface RenderConcurrentOptions extends PartialBy<ConcurrentOutputProps
  * 00:00:00 │ frontend │ third frontend message
  *
  */
-export declare function renderConcurrent({ renderOptions, ...props }: RenderConcurrentOptions): Promise<void>;
+export declare function renderConcurrent({ renderOptions, ...props }: RenderConcurrentOptions): Promise<unknown>;
 export type AlertCustomSection = CustomSection;
 export type RenderAlertOptions = Omit<AlertOptions, 'type'>;
 /**