Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running simple Vacuum after INSERT in a columnar table makes it give random errors #66

Closed
muntdan opened this issue Apr 3, 2023 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@muntdan
Copy link

muntdan commented Apr 3, 2023

I have run a migration of 143mil rows into 1 table and 50mil rows into a second one.
After advice given on Discord about running Vacuum after each 5min batch insert for read query to work after,
I run the migration like first time with 2 parallel inserts on the 2 tables fallowed by vacuum after each insert for their respective table.
I now encounter random errors from time to time which I did not on the first migration (I am using same docker and same tool to migrate):
Exception data: Severity: ERROR SqlState: XX000 MessageText: insufficient data for reading boolean array File: columnar_reader.c Line: 1728 Routine: DeserializeBoolArray
or
Exception data: Severity: ERROR SqlState: XX000 MessageText: attempted to modify an unexpected stripe, columnar storage with id=10000000021 does not have stripe with id=1117 File: columnar_metadata.c Line: 1692 Routine: UpdateStripeMetadataRow

Hydra docker is now only using 230MB RAM (it has 60GB available).

@wuputah wuputah added the bug Something isn't working label Apr 10, 2023
@mkaruza
Copy link
Contributor

mkaruza commented May 2, 2023

Fixed with #74

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants