GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — TestCafe: rerun quarantined tests in their themes by EugeniyKiyashko · Pull Request #36172 · DevExpress/DevExtreme

Conversation

@EugeniyKiyashko

@EugeniyKiyashko EugeniyKiyashko commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

No description provided.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@EugeniyKiyashko
TestCafe: rerun quarantined tests in their themes
67c8fc3
- quarantine.json entries take an optional "themes" list. Regular jobs skip such a test only in those themes and keep running it in the others.
- The quarantine job reruns quarantined tests once per theme: entries without "themes" and unstable tests in fluent and fluent-next, entries with "themes" in the listed ones. Before, every quarantined test reran only in fluent, so a test that flaked in fluent-next lost its fluent-next coverage.
- With --onlyQuarantined, runner.ts no longer keeps only theme-bound tests when a theme is passed without a component folder; the entry's themes decide.
@EugeniyKiyashko
EugeniyKiyashko requested a review from a team as a code owner November 5, 2026 18:34
@EugeniyKiyashko EugeniyKiyashko added the 26_2 label Nov 5, 2026
Copilot AI balanced review requested due to automatic review settings November 5, 2026 18:34
@EugeniyKiyashko EugeniyKiyashko self-assigned this Nov 5, 2026
Copilot started reviewing on behalf of EugeniyKiyashko November 5, 2026 18:35
View session
Copilot AI reviewed Nov 5, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

There are no active review issues for the theme-aware quarantine rerun changes.

No open issues 🎉

What changed in this PR

This PR makes TestCafe quarantine reruns theme-aware so quarantined tests run in their configured themes rather than a single default environment.

Changes:

  • Adds optional theme lists to quarantine entries, with Fluent and Fluent Next defaults for entries without themes.
  • Bypasses the regular theme filter during quarantine-only runs.
  • Updates CI to rerun each quarantine theme and aggregate failure counts with theme-labeled test names.
File Description
e2e/​testcafe-devextreme/​runner.ts Adds theme-aware quarantine matching and adjusts quarantine-only filtering.
.github/​workflows/​testcafe_tests.yml Runs quarantined tests across configured and default themes, collecting combined failures.

Review effort: Balanced

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

At least 1 approving review is required to merge this pull request.

Uh oh!

There was an error while loading. Please reload this page.

Assignees

@EugeniyKiyashko EugeniyKiyashko

Labels

26_2

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

2 participants

@EugeniyKiyashko
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402520 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.