Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensuring that ZarrToZarr metadata is inlined #403

Merged
merged 7 commits into from
Dec 14, 2023

Conversation

zcobell
Copy link
Contributor

@zcobell zcobell commented Dec 8, 2023

Fix for ZarrToZarr Metadata Inlining

Previously (#402), using ZarrToZarr before MultiZarrtoZarr would cause an issue since the metadata files weren't inlined in the references as they are in the other scanners. This forces the metadata files to be inlined so that it the assumptions within MultiZarrtoZarr hold.

The do_inline function in utils.py will now inline when a user has generated references from ZarrToZarr which is now consistent with the other scanners

Resolves #402

zcobell and others added 7 commits December 8, 2023 14:35
The do_inline function in utils.py will now inline when
a user has generated references from ZarrToZarr which
is now consistent with the other scanners

Resolves fsspec#402
@martindurant martindurant merged commit bceace1 into fsspec:main Dec 14, 2023
5 checks passed
@zcobell zcobell deleted the zcobell-inline-zarr-metadata branch December 14, 2023 19:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Parquet reference generation failing at translate step
2 participants