Skip to content

ci(e2e): separate Workbench tests into dedicated job#3516

Draft
zackverham wants to merge 3 commits intomainfrom
ci/e2e-separate-workbench-tests
Draft

ci(e2e): separate Workbench tests into dedicated job#3516
zackverham wants to merge 3 commits intomainfrom
ci/e2e-separate-workbench-tests

Conversation

@zackverham
Copy link
Collaborator

Split E2E tests into two jobs to improve CI runtime:

  1. cypress job (main tests):

    • Runs code-server based tests only
    • Skips Workbench container setup (~30-60s saved per job)
    • Uses --spec "tests/*.cy.js" to exclude workbench directory
    • Runs against all 4 Connect versions
  2. cypress-workbench job (new):

    • Runs only Workbench/Positron tests
    • Sets up Workbench container
    • Runs against "release" version only (sufficient coverage)
    • Has dedicated artifact uploads and log extraction

This saves ~30-60 seconds per main test job by not pulling/starting the Workbench container when it's not needed.

Intent

Type of Change

    • Bug Fix
    • New Feature
    • Breaking Change
    • Documentation
    • Refactor
    • Tooling

Approach

User Impact

Automated Tests

Directions for Reviewers

Checklist

  • I have updated the root CHANGELOG.md to cover notable changes.

zackverham and others added 3 commits February 13, 2026 13:18
Split E2E tests into two jobs to improve CI runtime:

1. `cypress` job (main tests):
   - Runs code-server based tests only
   - Skips Workbench container setup (~30-60s saved per job)
   - Uses --spec "tests/*.cy.js" to exclude workbench directory
   - Runs against all 4 Connect versions

2. `cypress-workbench` job (new):
   - Runs only Workbench/Positron tests
   - Sets up Workbench container
   - Runs against "release" version only (sufficient coverage)
   - Has dedicated artifact uploads and log extraction

This saves ~30-60 seconds per main test job by not pulling/starting
the Workbench container when it's not needed.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant