Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move instrumentation tests to GitHub actions #1472

Merged
merged 5 commits into from
Nov 2, 2021

Conversation

twometresteve
Copy link
Contributor

Goal

TODO: Resolve failures in API levels 21/24. It's not clear to me why these are failing, although I suspect they won't be hard to resolve.

Move the instrumentation tests to simulator-based GitHub Actions.

Design

We've have various issues running Espresso tests on real devices and the time taken to deal with those has started to outweigh the benefits of running on real devices (given that we run e2e tests on them).

Changeset

Remove Buildkite steps and add new GHA workflow.

Testing

Covered by CI.

Copy link
Contributor

@fractalwrench fractalwrench left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks nice. I think the API 21/24 failure is down to the benchmark tests not really being meant to run on an emulator - so we could either remove that step from CI or keep running it on browserstack.

Left a few other comments inline. The jobs also seem to be cancelled - have these passed originally?

@twometresteve twometresteve force-pushed the tms/github-actions-tests branch 2 times, most recently from 9b0b49f to 4e6ccc8 Compare November 2, 2021 16:22
@twometresteve twometresteve marked this pull request as ready for review November 2, 2021 16:39
Copy link
Contributor

@fractalwrench fractalwrench left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@twometresteve twometresteve merged commit c85e03d into next Nov 2, 2021
@twometresteve twometresteve deleted the tms/github-actions-tests branch November 2, 2021 17:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants