# Error running HDF5 parallel in more than one host

**URL:** <https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336>\
**Category:** HDF5 Library\
**Created:** [April 27, 2018, 1:54pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336 "2018-04-27T13:54:24Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![tiago](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/t/f0a364/32.png) [@tiago](https://forum.hdfgroup.org/u/tiago)\
**Post date:** [April 27, 2018, 1:54pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/1 "2018-04-27T13:54:24Z")

</div>

I am having problems running HDF5 parallel across more than computer in a small cluster. I compiled HDF5 with the Intel compilers and Intel MPI. The compilation went fine, HDF5 passes all the tests (including parallel tests), and my code runs normally when I start an MPI job that only uses processes from one machine.

When I try to run across more than one host, the HDF5 files are corrupted. This seems to happen regardless of the file contents (even seems like writing simple attributes causes the same problem). For example, I run the binary testpar/testphdf5 under the HDF5 tree, and if I do:

mpiexec -n 4 ./testphdf5

It passes all tests. But if I force it to use more than one host (e.g. via --hostfile), it fails, e.g.:

(…)  
Testing – dataset independent read (idsetr)  
Dataset Verify failed at [0][0](row 64, col 0): expect 6401, got 0  
(…)

I have run other MPI jobs (non-HDF5) across several hosts with no problems. I have also tried both Intel MPI and OpenMPI, and get the same error. This happens with HDF5 from both the 1.8.x branch and 1.10.x branch.

Any ideas on how to fix this problem?

---

<div class="post-metadata">

**Author:** ![steven.varga](https://forum.hdfgroup.org/user_avatar/forum.hdfgroup.org/steven.varga/32/1614_2.png) [@steven.varga](https://forum.hdfgroup.org/u/steven.varga)\
**Post date:** [April 27, 2018, 2:08pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/2 "2018-04-27T14:08:56Z")

</div>

Can you post what parellel file system you have deployed? Orange FS,…?

---

<div class="post-metadata">

**Author:** ![tiago](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/t/f0a364/32.png) [@tiago](https://forum.hdfgroup.org/u/tiago)\
**Post date:** [April 27, 2018, 5:14pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/3 "2018-04-27T17:14:26Z")

</div>

This is a small cluster and right now we have only a SAN with StorNext, no distributed file system. I’ve also tried on a different directory that was a simple NFS share, and got the same problem.

---

<div class="post-metadata">

**Author:** ![steven.varga](https://forum.hdfgroup.org/user_avatar/forum.hdfgroup.org/steven.varga/32/1614_2.png) [@steven.varga](https://forum.hdfgroup.org/u/steven.varga)\
**Post date:** [April 27, 2018, 5:50pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/4 "2018-04-27T17:50:59Z")

</div>

I am still confused what you’re trying to do. Is it running pHDF5 on a cluster? --if so please note the requirements, I copied and pasted here:

```auto
1.1. Requirements
```

---

<div class="post-metadata">

**Author:** ![tiago](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/t/f0a364/32.png) [@tiago](https://forum.hdfgroup.org/u/tiago)\
**Post date:** [April 27, 2018, 5:57pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/5 "2018-04-27T17:57:35Z")

</div>

The later part of your answer seems it got truncated. Are you saying that it is not possible to run pHDF5 on SAN?

---

<div class="post-metadata">

**Author:** ![steven.varga](https://forum.hdfgroup.org/user_avatar/forum.hdfgroup.org/steven.varga/32/1614_2.png) [@steven.varga](https://forum.hdfgroup.org/u/steven.varga)\
**Post date:** [April 27, 2018, 7:01pm UTC](https://forum.hdfgroup.org/t/error-running-hdf5-parallel-in-more-than-one-host/4336/6 "2018-04-27T19:01:08Z")

</div>

I am saying that parallel file system is a requirement for pHDF5, [which can be found in this document.](https://support.hdfgroup.org/ftp/HDF5/current/src/unpacked/release_docs/INSTALL_parallel) The collective calls are built on top of some parallel IO implementation like [ROMIO](http://www.mcs.anl.gov/projects/romio/). [OrangeFS](http://www.orangefs.org/) is a free implementation of a parallel FS. NFS and similar may not be POSIX compliant, see flock for NFS.

steve
