-
Notifications
You must be signed in to change notification settings - Fork 89
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JLD2 writes zeros to first 3440 bytes in file #533
Comments
Hi @tiagopereira , Can you please test if this is b) just a loading problem, so c) do
to see if the length of the first array controls how may floats are still zero in the second array. |
Thank you for the quick answer. Doing I am sure it is not a loading problem. I checked the file with I did the last check you suggested, and the first array written ( |
I should add that the filesystem I am writing into is a networked file system (StorNext SAN via Infiniband). Are there known issues with |
There have been issues with Mmap and network files systems in the past. You can avoid the issue by using IOStream. On network file systems this should not be a big performance hit. If you want to dig a little deeper, you can test the size dependence: Have a look at |
Closing for lack of a reproducible example |
When writing arrays or other structures to a JLD2 file, it writes zeros to the first 3440 bytes in the file. Here is a sample code:
Then the read array
aa
will be zeros until element 431 (first 3440 bytes). If I instead write a Float32 array, then it is zero until element 861 (still first 3440 bytes).This error persists if I write different structures with arrays. The array parts of the structure have also the first elements filled with zeros. There is no difference whether using the
FileIO
interface orjldsave
.Using Julia 1.10.0, JLD2 0.4.43 on Linux. The error only happens in Linux. Tested with a M1 Mac with Julia ARMv8 for and it worked fine.
The text was updated successfully, but these errors were encountered: