Is compiling parallel hdf5 for GPFS, PVFS, Lustre binary compatible?

Hi,

If the hardware and OS is the same, would a single compiled binary run on all parallel file systems?

yes!

OK, the answer is a little more complicated. All these file systems
export a portable POSIX interface. You can use HDF5 and its MPI-POSIX
VFD.

The MPI-IO library, however, can have file system specific
optimizations. for PVFS, for example, ROMIO has a "list I/O"
interface to efficiently describe noncontiguous accesses.

I don't know of too many (any?) systems that have all those file
systems available, so you'll probably end up re-compiling for the
different MPI libraries anyway.

==rob

···

On Wed, Jun 02, 2010 at 11:33:03AM -0400, Roger Martin wrote:

Hi,

If the hardware and OS is the same, would a single compiled binary
run on all parallel file systems?

--
Rob Latham
Mathematics and Computer Science Division
Argonne National Lab, IL USA

Very interesting, Rob. It lets us readily build a reference build and then offer higher performance builds (after we know more about we're doing). Thank you

Rob Latham wrote:

···

On Wed, Jun 02, 2010 at 11:33:03AM -0400, Roger Martin wrote:
  

Hi,

If the hardware and OS is the same, would a single compiled binary
run on all parallel file systems?
    
yes!

OK, the answer is a little more complicated. All these file systems
export a portable POSIX interface. You can use HDF5 and its MPI-POSIX
VFD.

The MPI-IO library, however, can have file system specific
optimizations. for PVFS, for example, ROMIO has a "list I/O"
interface to efficiently describe noncontiguous accesses.

I don't know of too many (any?) systems that have all those file
systems available, so you'll probably end up re-compiling for the
different MPI libraries anyway.

==rob