Skip to content

E2E: trial for shards#7349

Draft
phyllis-sy-wu wants to merge 1 commit intopsyw-0414-E2E-parallel-workersfrom
psyw-0420-E2E-try-add-shards
Draft

E2E: trial for shards#7349
phyllis-sy-wu wants to merge 1 commit intopsyw-0414-E2E-parallel-workersfrom
psyw-0420-E2E-try-add-shards

Conversation

@phyllis-sy-wu
Copy link
Copy Markdown
Contributor

@phyllis-sy-wu phyllis-sy-wu commented Apr 20, 2026

WHY are these changes introduced?

Evaluate whether sharding E2E tests across 2 CI machines (as suggested by @gonzaloriestra in #7309) improves wall-clock time compared to running all tests on a single machine.

Currently E2E tests run on a single ubuntu-latest runner (4 vCPUs, 16 GB RAM — GitHub docs). With 2 shards, each machine runs ~half the test files with 5 workers each.

WHAT is this pull request doing?

Adds a matrix strategy with shard: ['1/2', '2/2'] to the E2E CI job, passing --shard to Playwright. Each shard uploads artifacts with unique names to avoid collisions.

Benchmark Results:
(under stable conditions, very few teardown failures or flaky retries)

#7309 #7343 #7349
Workers 5 10 5
Shards 1 1 2
CI runtime 11m 43s 8m 49s 8m 59s (shard 1/2)
7m 41s (shard 2/2)

How to test your changes?

Compare CI run times between this PR, #7309 (5 workers baseline), and #7343 (10 workers).

Post-release steps

N/A — trial branch, not intended to merge.

Checklist

  • I've considered possible cross-platform impacts (Mac, Linux, Windows)
  • I've considered possible documentation changes
  • I've considered analytics changes to measure impact
  • The change is user-facing, so I've added a changelog entry with pnpm changeset add

Copy link
Copy Markdown
Contributor Author

phyllis-sy-wu commented Apr 20, 2026

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

@phyllis-sy-wu phyllis-sy-wu mentioned this pull request Apr 20, 2026
4 tasks
@github-actions
Copy link
Copy Markdown
Contributor

Differences in type declarations

We detected differences in the type declarations generated by Typescript for this branch compared to the baseline ('main' branch). Please, review them to ensure they are backward-compatible. Here are some important things to keep in mind:

  • Some seemingly private modules might be re-exported through public modules.
  • If the branch is behind main you might see odd diffs, rebase main into this branch.

New type declarations

We found no new type declarations in this PR

Existing type declarations

packages/cli-kit/dist/public/node/upgrade.d.ts
@@ -1,5 +1,3 @@
-import { getAutoUpgradeEnabled, setAutoUpgradeEnabled } from '../../private/node/conf-store.js';
-export { getAutoUpgradeEnabled, setAutoUpgradeEnabled };
 /**
  * Utility function for generating an install command for the user to run
  * to install an updated version of Shopify CLI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant