Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: fix flaky CT test by relying on query #25706

Merged
merged 2 commits into from
Feb 6, 2023

Conversation

ZachJW34
Copy link
Contributor

@ZachJW34 ZachJW34 commented Feb 3, 2023

Additional details

Steps to test

Flaky CT test: https://app.circleci.com/pipelines/github/cypress-io/cypress/49140/workflows/282c3bcc-d3d6-4b1f-b6a8-93fc588b7935/jobs/2043536/parallel-runs/1?filterBy=FAILED

Doing what the comment in CI says and converting to query

How has the user experience changed?

na

PR Tasks

  • Have tests been added/updated?
  • [na] Has the original issue (or this PR, if no issue exists) been tagged with a release in ZenHub? (user-facing changes only)
  • [na] Has a PR for user-facing changes been opened in cypress-documentation?
  • [na] Have API changes been updated in the type definitions?

Copy link
Contributor

@mike-plummer mike-plummer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good and works locally, thanks for tackling flake! 💯

Only comment (which isn't related to your change) is that the test you're touching looks to have a bad name. Doesn't seem to do anything related to the UTM param, so either that's missing from the test or it needs a new name. If you feel like messing with it while you're in there, cool, if not that's cool too

Copy link
Contributor

@lmiller1990 lmiller1990 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

Agreed with Mike... data-cy="button" is probably not a great name for a test element. I'd really like to see this merged, though, and don't think it's a blocker.

@lmiller1990 lmiller1990 merged commit 0fb06a4 into develop Feb 6, 2023
@lmiller1990 lmiller1990 deleted the zachw/fix-flaky-ct-test branch February 6, 2023 00:52
@ZachJW34
Copy link
Contributor Author

ZachJW34 commented Feb 6, 2023

@lmiller1990 @mike-plummer the test is related to UTM parameter as it's testing that the slot generated by this component gets the UTM parameter passed to it (JSX props in the test). The data-cy="button" isn't great but it's only added to the JSX test slot, not code that's in production

tgriesser added a commit that referenced this pull request Feb 8, 2023
* develop: (28 commits)
  chore: update changelog validation example (#25742)
  fix: Improve error handling around calls to `this.next` in middleware (#25702)
  chore: debug page tooltip distance and artifact border (#25727)
  fix: update newProject ref when switching between organizations in SelectCloudProjectModal (#25730)
  misc: Add max widths to debug page message states (#25725)
  chore: export types (#25714)
  chore: release @cypress/webpack-preprocessor-v5.16.3
  chore: release @cypress/vue-v5.0.4
  chore: release @cypress/grep-v3.1.4
  chore: Fix flaky test (#25726)
  dependency(deps): update dependency debug to ^4.3.4 🌟 (#25699)
  feat: openInIDE for failed debug spec (#25691)
  test: fix flaky CT test by relying on query (#25706)
  test: fix flaky migration test (#25672)
  misc: style change for responsiveness (#25687)
  misc: set min widths for icons (#25684)
  chore(deps): update dependency markdown-it to v11.0.1 🌟 (#25698)
  chore: Fix flaky origin .wait() test (#25693)
  chore: unskip tests (#25676)
  chore: release @cypress/webpack-preprocessor-v5.16.2
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants