Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change error checks in K6 tests #6390

Merged
merged 31 commits into from
Jan 24, 2025
Merged

Conversation

Piotrk39
Copy link
Contributor

@Piotrk39 Piotrk39 commented Jan 16, 2025

AB#32606

Describe your changes

Due to the bug that caused the message from K6 runs to be always "passed" the tests additionally need better error handling where more checks are displayed and validated through the run of load/ performance tests.

Checklist before requesting a review

  • I have performed a self-review of my code
  • I have added tests wherever relevant
  • I have made sure that all automated checks pass before requesting a review
  • I do not need any deviation from our PR guidelines

Portalicious preview deployment

This PR does not have any preview deployments yet.

@Piotrk39 Piotrk39 added the bugfix Something that affects our end users is fixed label Jan 16, 2025
@Piotrk39 Piotrk39 force-pushed the fix.correct-errors-in-k6-branch branch from 330fe27 to 46ecc30 Compare January 16, 2025 09:32
@Piotrk39 Piotrk39 changed the base branch from main to fix.k6-error-message January 16, 2025 09:34
@RubenGeo RubenGeo force-pushed the fix.k6-error-message branch from 66855af to dd5222d Compare January 16, 2025 10:22
@Piotrk39 Piotrk39 force-pushed the fix.correct-errors-in-k6-branch branch from b4efb8b to 0da8aed Compare January 16, 2025 10:29
Base automatically changed from fix.k6-error-message to main January 17, 2025 08:52
@Piotrk39 Piotrk39 force-pushed the fix.correct-errors-in-k6-branch branch from 7d0811d to f8d2585 Compare January 17, 2025 10:09
@Piotrk39 Piotrk39 marked this pull request as ready for review January 17, 2025 10:10
@Piotrk39 Piotrk39 requested a review from RubenGeo January 23, 2025 19:53
@Piotrk39 Piotrk39 force-pushed the fix.correct-errors-in-k6-branch branch from 3e36c52 to 7b96678 Compare January 23, 2025 19:57
@Piotrk39
Copy link
Contributor Author

@RubenGeo All tests should be passing now as expected. There is one more issue connected with the K6 tests and it is that they do not fail after threshold of requests is breached e.g if we have threshold for failed_requests set to 30 percent after this is breached then we still can see pass in the outcome of the test. For now we should only rely on the failed checks.

RubenGeo
RubenGeo previously approved these changes Jan 24, 2025
@Piotrk39 Piotrk39 force-pushed the fix.correct-errors-in-k6-branch branch from 02ba084 to db2cdad Compare January 24, 2025 08:54
@RubenGeo RubenGeo merged commit 97eae2c into main Jan 24, 2025
2 checks passed
@RubenGeo RubenGeo deleted the fix.correct-errors-in-k6-branch branch January 24, 2025 09:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix Something that affects our end users is fixed
Development

Successfully merging this pull request may close these issues.

2 participants