Multithreaded read-only access to hdf5 file

Hdf-forum archives
1

Hi,

I tried to figure it out from documentation - but failed and try it the
forum way:

I need to read data from datasets in parallel from one hdf5 file.
Ideally it would be possible to read from different threads in one
process in parallel the "same way" (datatype) from same dataset in same
hdf5 file.

Is this - or what is - possible?

Thanks,
Johannes Stamminger

2

Hey Johannes,

I had a similar question before and had it answered in an earlier thread in July. Look for emails titled:
     "read-only multi-threaded access with forced object closing"

The "forced object closing" part you can ignore, but there were a few interesting things mentioned regarding multithreaded read-only access to HDF5 files.
In summary, it is possible (but not on Windows) as long as thread safety was built into the library you've compiled. The current multithreading scheme wraps critical operations in a mutex so that the shared internal data structures don't get messed up. I think more integrated theading support will be in the next release (1.10.x).

I hope that helps,

Richard.

Stamminger, Johannes wrote:

···

Hi,

I tried to figure it out from documentation - but failed and try it the
forum way:

I need to read data from datasets in parallel from one hdf5 file.
Ideally it would be possible to read from different threads in one
process in parallel the "same way" (datatype) from same dataset in same
hdf5 file.

Is this - or what is - possible?

Thanks,
Johannes Stamminger
  
--
Richard Khoury
R&D
T: +61 2 9383 4602