Though here the HDFView have been discussed i will ask question about similar HDF tool - H5DUMP. When you extract data using this nice tool like h5dump (which to me looks infinitely superior than HDFView) you will notice one its unfortunate drawback: it is very slow extracting data. It is actually slowest program ever built. For example extracting data array called “particles” out of HDF file data.h5 into text file textFile like this
h5dump.exe -d /particles -o textFile data.h5
goes with the terrible speed around 2 MB/s. Extraction into binaryFile like this
h5dump.exe -d /particles -o binaryFile -b MEMORY data.h5
goes faster but the speed is still awful - 8 megabytes per second. In comparison any Fortran compiler extracts or saves files with the speed 20-50 times faster in ASCII text format and 100 times faster in binary (Silvefrost Fortran compiler saves binary data even 500x faster – 4 Gigabytes per second)
- What compiler was used for I/O for creation of output? Was it C/Fortran or others?
- Is there an option for h5dump to extract data in parallel? 7Zip or PIGZ compress and decompress much faster when multicore processors are allowed to do that in parallel.