H5 Viewer Large Data set and Very Large Data file-Error Loading

HDF5 Library
1

Hi All,

We are fairly new to HDF5, loading up finite element simulation results for a complex job. We have managed to load some 1GB files quite happily and view them as expected. But we have one Dog of a file…Its a 12 Gb file from which we want to display millions of values in a data set-array. We get the error message…

“error occurred while initiating table view class”.

We seem to be exceeding some kind of buffer space. It does not always happen.

Can anybody help us to understand now we go about increasing capacity so we dont get this error.

Many Thanks
Melvin

2

It is a limitation of the current implementation in that the viewer program attempts to load all objects into memory, making very slow and exhaust memory on large files or with a large number of objects.
It is a long-standing issue lacking resources to create a paging-type object referencing for display interaction.

3

Hi, @ocarrollmel !

Can you try ViTables as shown in HDFView 3.3.2 Compound Type Table View Error · Issue #286 · HDFGroup/hdfview (github.com) and let me know if it works?