Releases: nebari-dev/nebari
2023.11.1rc1
Release Candidate 1 for 2023.11.1
2023.10.1
Release 2023.10.1 - October 20, 2023
This release includes a major refactor which introduces a Pluggy-based extension mechanism which allow developers to build new stages. This is the initial implementation of the extension mechanism and we expect the interface to be refined overtime. If you're interested in developing your own stage plugin, please refer to our documentation. When you're ready to upgrade, please download this version from either PyPI or Conda-Forge and run the nebari upgrade -c nebari-config.yaml
command and follow the instructions
WARNING: CDS Dashboards was removed in this release and upgrading to this version will result in CDS Dashboards being uninstalled. A replacement dashboarding solution is currently in the works
and will be integrated soon.
WARNING: Given the scope of changes in this release, we highly recommend backing up your system before upgrading. Please refer to our Manual Backup documentation for more details.
Feature changes and enhancements
- Extension Mechanism Implementation in PR 1833
- This also includes much stricter schema validation.
- JupyterHub upgraded to 3.1 in PR 1856'
Breaking Changes
- While we have tried our best to avoid breaking changes when introducing the extension mechanism, the scope of the changes is too large for us to confidently say there won't be breaking changes.
WARNING: CDS Dashboards was removed in this release and upgrading to this version will result in CDS Dashboards being uninstalled. A replacement dashboarding solution is currently in the work and will be integrated soon.
WARNING: We will be removing and ending support for ClearML, Prefect and kbatch in the next release. The kbatch has been functionally replaced by Argo-Jupyter-Scheduler. We have seen little interest in ClearML and Prefect in recent years, and removing makes sense at this point. However if you wish to continue using them with Nebari we encourage you to write your own Nebari extension.
What's Changed
- Spinup spot instance for CI with cirun by @aktech in #1882
- Fix argo-viewer service account reference by @iameskild in #1881
- Framework for Nebari deployment via pytest for extensive testing by @aktech in #1867
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1878
- Test GCP/AWS Deployment with Pytest by @aktech in #1871
- Bump DigitalOcean provider to latest by @aktech in #1891
- Ensure path is Path object by @iameskild in #1888
- enabling viewing hidden files in jupyterlab file explorer by @kalpanachinnappan in #1893
- Extension Mechanism Implementation by @costrouc in #1833
- Fix import path in deployment tests & misc by @aktech in #1908
- pytest:ensure failure on warnings by @costrouc in #1907
- workaround for mixed string/posixpath error by @sblair-metrostar in #1915
- ENH: Remove aws cli, use boto3 by @fangchenli in #1920
- paginator for boto3 ec2 instance types by @sblair-metrostar in #1923
- Update README.md -- fix typo. by @teoliphant in #1925
- Add more unit tests, add cleanup step for Digital Ocean integration test by @iameskild in #1910
- Add cleanup step for AWS integration test, ensure diable_prompt is passed through by @iameskild in #1921
- K8s 1.25 + More Improvements by @Adam-D-Lewis in #1856
- adding lifecycle ignore to eks node group by @sblair-metrostar in #1905
- nebari init unit tests by @sblair-metrostar in #1931
- Bug fix - JH singleuser environment getting overwritten by @kenafoster in #1933
- Allow users to specify the Azure RG to deploy into by @iameskild in #1927
- nebari validate unit tests by @sblair-metrostar in #1938
- adding openid connect provider to enable irsa feature by @sblair-metrostar in #1903
- nebari upgrade CLI tests by @sblair-metrostar in #1963
- CI: Add test coverage by @fangchenli in #1959
- nebari cli environment variable handling, support, keycloak, dev tests by @sblair-metrostar in #1968
- CI: remove empty notebook to fix pre-commit json check by @fangchenli in #1976
- TYP: fix typing error in plugins by @fangchenli in #1973
- TYP: fix return class type in hookimpl by @fangchenli in #1975
- Allow users to specify Azure tags by @iameskild in #1967
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1979
- Do not try and add argo envs when disabled by @iameskild in #1926
- Handle region with care, updates to test suite by @iameskild in #1930
- remove custom auth from config schema by @sblair-metrostar in #1994
- CLI: handle removed dns options in deploy command by @fangchenli in #1992
- Add API docs by @kcpevey in #1634
- Upgrade images for jupyterhub-ssh, kbatch by @iameskild in #1997
- Add permissions to generate_cli_docs workflow by @iameskild in #2005
- standardize regex and messaging for names by @kenafoster in #2003
- ENH: specify required fields when retrieving available gcp projects by @fangchenli in #2008
- Modify JupyterHub networkPolicy to match existing policy by @iameskild in #1991
- Update package dependencies by @iameskild in #1986
- CI: Add AWS integration test workflow, clean up by @iameskild in #1977
- BUG: fix unboundlocalerror in integration test by @fangchenli in #1999
- Auth0/Github auth-provider config validation fix by @sblair-metrostar in #2009
- terraform upgrade to 1.5.7 by @sblair-metrostar in #1998
- cli init repo auto provision fix by @sblair-metrostar in #2012
- Add gcp_cleanup, minor changes by @iameskild in #2010
- Fix #2024 by @dcmcand in #2025
- Upgrade conda-store to 2023.9.2 by @iameskild in #2028
- Add upgrade steps, instructions for 2023.9.1 by @iameskild in #2029
- CI: add gcp integration test by @fangchenli in #2049
- CLN: remove flake8 from dependencies by @fangchenli in #2044
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #2047
- fix typo in guided init for Digital Ocean by @dcmcand in #2059
- CI: add do integration by @fangchenli in #2060
- TYP: make all subfolders under kubernetes_services/template non-module by @fangchenli in #2043
- TYP: fix most typing errors in provider by @fangchenli in #2038
- Fix link to documentation on Nebari Deployment home page by @aktech in #2063
- TST: enable timeout config in playwright notebook test by @fangchenli in #1996
- DEPS: sync supported python version by @fangchenli in #2065
- Test support for Python 3.12 by @aktech in #2046
- BUG: fix validation error related to
provider
#2054 by @fangchenli in #2056 - CI: improve unit test workflow in CI, revert #2046 by @fangchenli in #2071
- TST: enable exact_match config in playwright notebook test by @fangchenli in #2027
- CI: move conda build test to separate job by @fangchenli in #2073
- Revert conda-store to v0.4.14, #2028 by @iameskild in #2074
- ENH/CI: add mypy config, and CI workflow by @fangchenli in #2066
- Update upgrade for 20...
2023.10.1rc1
Release candidate 1 for 2023.10.1.
2023.9.1rc1
Release candidate 1 for 2023.9.1
.
2023.7.2
Release 2023.7.2 - August 4, 2023
This is a hot-fix release that resolves an issue whereby users in the analyst
group are unable to launch their JupyterLab server because the name of the viewer-specific ARGO_TOKEN
was mislabeled; see PR 1881 for more details.
What's Changed
- Fix argo-viewer service account reference by @iameskild in #1881
- Add release notes for 2023.7.2, update release notes for 2023.7.1 by @iameskild in #1886
- Update upgrade command for 2023.7.2 by @iameskild in #1887
- Ensure path is Path object by @iameskild in #1888
Full Changelog: 2023.7.1...2023.7.2
2023.7.2rc1
Release candidate 1 for 2023.7.2
2023.7.1
Release 2023.7.1 - July 21, 2023
WARNING: CDS Dashboards will be deprecated soon. Nebari
2023.7.1
will be the last release with support for CDS Dashboards integration. A new dashboard sharing mechanism added in the near future, but some releases in the interim will not have dashboard sharing capabilities..
WARNING: For those running on AWS, upgrading from previous versions to
2023.7.1
requires a backup. Due to changes made to the VPC (See issue 1884 for details), Terraform thinks it needs to destroy and reprovision a new VPC which causes the entire cluster to be destroyed and rebuilt.
Feature changes and enhancements
- Addition of Nebari-Workflow-Controller in PR 1741
- Addition of Argo-Jupyter-Scheduler in PR 1832
- Make most of the API private
Breaking Changes
- As mentioned in the above WARNING, clusters running on AWS should perform a manual backup before running the upgrade to the latest version as changes to the AWS VPC will cause the cluster to be destroyed and redeployed.
What's Changed
- use conda forge explicitly in conda build test by @pmeier in #1771
- document that the upgrade command is for all nebari upgrades by @Adam-D-Lewis in #1794
- don't fail CI matrices fast by @pmeier in #1804
- unvendor keycloak_metrics_spi by @Adam-D-Lewis in #1810
- Dedent fail-fast by @iameskild in #1815
- support deploying on existing vpc on aws by @Adam-D-Lewis in #1807
- purge most danlging qhub references by @pmeier in #1802
- Add Argo Workflow Admission controller by @Adam-D-Lewis in #1741
- purge infracost CLI command / CI jobs by @pmeier in #1820
- remove unused function parameters and CLI flags by @pmeier in #1725
- purge docs and nox by @pmeier in #1801
- Add Helm chart lint tool by @viniciusdc in #1679
- don't set /etc/hosts in CI by @pmeier in #1729
- remove execute permissions on templates by @pmeier in #1798
- fix deprecated file deletion by @pmeier in #1799
- make nebari API private by @pmeier in #1778
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1831
- Simplify CI by @iameskild in #1819
- Fix edge-case where k8s_version is equal to HIGHEST_SUPPORTED_K8S_VER… by @iameskild in #1842
- add more configuration to enable private clusters on AWS by @Adam-D-Lewis in #1841
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1851
- AWS gov cloud support by @sblair-metrostar in #1857
- Pathlib everywhere by @pmeier in #1773
- Initial playwright setup by @kcpevey in #1665
- Changes required for Jupyter-Scheduler integration by @iameskild in #1832
- Update upgrade command in preparation for release by @iameskild in #1868
- Add release notes by @iameskild in #1870
New Contributors
- @sblair-metrostar made their first contribution in #1857
Full Changelog: 2023.5.1...2023.7.1
2023.7.1rc1
Release candidate 1 for 2023.7.1
2023.5.1
Release 2023.5.1 - May 5, 2023
Feature changes and enhancements
- Upgrade Argo-Workflows to version 3.4.4
Breaking Changes
- The Argo-Workflows version upgrade will result in a breaking change if the existing Kubernetes CRDs are not deleted (see the NOTE below for more details).
- There is a minor breaking change for the Nebari CLI version shorthand, previously it
nebari -v
and now to align with Python convention, it will benebari -V
.
NOTE: After installing the Nebari version
2023.5.1
, please runnebari upgrade -c nebari-config.yaml
to upgrade
thenebari-config.yaml
. This command will also prompt you to delete a few Kubernetes resources (specifically
the Argo-Workflows CRDS and service accounts) before you can upgrade.
What's Changed
- Use --quiet flag for conda install in CI by @pmeier in #1699
- improve CLI tests by @pmeier in #1710
- Fix Existing dashboards by @Adam-D-Lewis in #1723
- Fix dashboards by @Adam-D-Lewis in #1727
- Typo in the conda-store <-> conda_store key by @costrouc in #1740
- use -V (upper case) for --version short form by @pmeier in #1720
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1692
- improve pytest configuration by @pmeier in #1700
- fix upgrade command to look for nebari_version instead of qhub_version by @Adam-D-Lewis in #1693
- remove lazy import by @pmeier in #1721
- fix nebari invocation through python by @pmeier in #1711
- Update Argo Workflows to latest version by @Adam-D-Lewis in #1639
- Update secret token in release-notes-sync action by @pavithraes in #1753
- Typo fix in release-notes-sync action by @pavithraes in #1756
- 🔄 Synced file(s) with nebari-dev/.github by @nebari-sensei in #1758
- Update path in release-notes-sync action by @pavithraes in #1757
- Updating heading format in release notes by @pavithraes in #1761
- Update vault url by @costrouc in #1752
- Fix? contributor test trigger by @pmeier in #1734
- Consistent user Experience with y/N. by @AM-O7 in #1747
- Fix contributor trigger by @pmeier in #1765
- add more debug output to contributor test trigger by @pmeier in #1766
- fix copy-paste error by @pmeier in #1767
- add instructions insufficient permissions of contributor trigger by @pmeier in #1772
- fix invalid escape sequence by @pmeier in #1770
- Update AMI in
.cirun.yml
for nebari-dev-ci AWS account by @aktech in #1776 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1768
- turn warnings into errors with pytest by @pmeier in #1774
- purge setup.cfg by @pmeier in #1781
- improve pre-commit run on GHA by @pmeier in #1782
- Upgrade to k8s 1.24 by @iameskild in #1760
- Overloaded dask gateway fix by @Adam-D-Lewis in #1777
- Add option to specify GKE release channel by @iameskild in #1648
- Update upgrade command, add RELEASE notes by @iameskild in #1789
New Contributors
Full Changelog: 2023.4.1...2023.5.1
2023.5.1rc1
Release candidate 1 for 2023.5.1