HDF5 read error when reading huge file

[kat]

Hi Gerd,

Thanks for your insights.

Also, we were able to reproduce the abnormal termination of the writing application (which resulted in the corrupt HDF5 file). It is due to an assertion in HDF5 library:

H5C.c:6732: H5C_load_entry: Assertion `entry->size < ((size_t)(32 * 1024 * 1024))’ failed.

The (32 * 1024 * 1024) expression is defined as H5C_MAX_ENTRY_SIZE.

The assertion occurs during the H5File::createDataSet call.

It looks like a similar discussion had happened regarding this assertion on this thread:

Assertion fail on write

Hi, On certain datasets, I receive following error on write call: Assertion failed: entry_ptr->size < ((size_t)(10*1024*1024)), file H5C.c, line 10619 Looking at the header file where H5C_MAX_ENTRY_SIZE is defined, I see a comment that user can increase or decrease it as appropriate. This error happens on a dataset which attempts to write 240 elements of 8 bytes each at a given time. Assertion error occurs on 1035th write. So the size of the dataset on the disk should be around ~2MB . C…

But I don’t see any conclusions on that thread.

Could you please let me know what this assertion means and how to overcome it?

Thanks
-Kat.