Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix test using a non-specific selector #2475

Merged
merged 5 commits into from
May 23, 2024

Conversation

krassowski
Copy link
Member

Reference Issues or PRs

Fixes #2473

What does this implement/fix?

Put a x in the boxes that apply

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds a feature)
  • Breaking change (fix or feature that would cause existing features not to work as expected)
  • Documentation Update
  • Code style update (formatting, renaming)
  • Refactoring (no functional changes, no API changes)
  • Build related changes
  • Other (please describe):

Testing

  • Did you test the pull request locally?
  • Did you add new tests?

Any other comments?

Let's hope the CI passes!

@krassowski krassowski added type: bug 🐛 Something isn't working area: testing ✅ Testing labels May 21, 2024
@krassowski
Copy link
Member Author

Cypress tests are now passing but playwright tests are failing due to the new popup dialog layout:

image

@krassowski
Copy link
Member Author

I believe that the cypress/playwright tests are fine, but the deployments tests are failing:

_____________________ ERROR at setup of test_dask_gateway ______________________
Traceback (most recent call last):
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/connectionpool.py", line [46](/~https://github.com/nebari-dev/nebari/actions/runs/9177179471/job/25234168892?pr=2475#step:20:47)7, in _make_request
    self._validate_conn(conn)
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
    conn.connect()
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/connection.py", line 653, in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/connection.py", line 806, in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
               ^^^^^^^^^^^^^^^^
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/util/ssl_.py", line 465, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/site-packages/urllib3/util/ssl_.py", line [50](/~https://github.com/nebari-dev/nebari/actions/runs/9177179471/job/25234168892?pr=2475#step:20:51)9, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/ssl.py", line [51](/~https://github.com/nebari-dev/nebari/actions/runs/9177179471/job/25234168892?pr=2475#step:20:52)7, in wrap_socket
    return self.sslsocket_class._create(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/ssl.py", line 1104, in _create
    self.do_handshake()
  File "/home/runnerx/miniconda3/envs/test/lib/python3.11/ssl.py", line 1382, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)
ERROR tests/tests_deployment/test_dask_gateway.py::test_dask_gateway - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))
ERROR tests/tests_deployment/test_dask_gateway.py::test_dask_gateway_cluster_options - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))
ERROR tests/tests_deployment/test_jupyterhub_ssh.py::test_simple_jupyterhub_ssh - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))
ERROR tests/tests_deployment/test_jupyterhub_ssh.py::test_print_jupyterhub_ssh - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))
ERROR tests/tests_deployment/test_jupyterhub_ssh.py::test_exact_jupyterhub_ssh - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))
ERROR tests/tests_deployment/test_jupyterhub_ssh.py::test_contains_jupyterhub_ssh - requests.exceptions.SSLError: HTTPSConnectionPool(host='github-actions.nebari.dev', port=443): Max retries exceeded with url: /hub/api/users/test-user/tokens (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)')))

I am also seeing this error in nebari-dev/argo-jupyter-scheduler#10 (comment). Any ideas on what might be the issue?

Otherwise I think this PR is ready for review.

@krassowski krassowski marked this pull request as ready for review May 21, 2024 16:46
@viniciusdc
Copy link
Contributor

I wonder why this only showed up now... thanks for raising the issue @krassowski

@Adam-D-Lewis
Copy link
Member

Adam-D-Lewis commented May 23, 2024

I was able to track this down to our version of requests changed from 2.31.0 to 2.32.2 recently which contains a fix for a bug. The bug was making our tests pass previously (/~https://github.com/psf/requests/blob/main/HISTORY.md#2320-2024-05-20).

I opened a PR #2481, but it's github actions should fail with the playwright errors until this PR (2475) is merged too.

@krassowski krassowski merged commit e59a90f into nebari-dev:develop May 23, 2024
7 of 8 checks passed
@viniciusdc
Copy link
Contributor

viniciusdc commented May 23, 2024

The bug was making our tests pass previously

Ha, that's funny! Nice catch @Adam-D-Lewis, great work @krassowski

aktech pushed a commit that referenced this pull request May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: testing ✅ Testing type: bug 🐛 Something isn't working
Projects
Development

Successfully merging this pull request may close these issues.

[BUG] - Playwright tests are currently failing due to change in jupyter
3 participants