problem with h5pset_fapl_mpio_f

Hi Elena,

The problem is solved. Instead of using the shared libraries,
my colleague suggested to link with the static libraries.

I also compiled the code with h5pfc as you suggested.
If I set -shlib, then the code fails with the same error
message as well.

Any clue why shared libraries don't work here?

Thank you very much.

Annop

···

Message: 2
Date: Fri, 15 Feb 2013 06:43:47 -0600
From: Elena Pourmal <epourmal@hdfgroup.org>
To: HDF Users Discussion List <hdf-forum@hdfgroup.org>
Subject: Re: [Hdf-forum] problem with h5pset_fapl_mpio_f
Message-ID: <73AD441A-D196-4A19-BF05-84B98273D5D3@hdfgroup.org>
Content-Type: text/plain; charset="iso-8859-1"

Summary looks good. Could you please try to compile your program with the
h5pfc script that should be the "bin" directory of the HDF5 installation
directory?

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Hi Annop,

I am glad that the problem was resolved. Sorry, I forgot about shared libraries!!! (should know that!)

Hi Elena,

The problem is solved. Instead of using the shared libraries,
my colleague suggested to link with the static libraries.

I also compiled the code with h5pfc as you suggested.
If I set -shlib, then the code fails with the same error
message as well.

Any clue why shared libraries don't work here?

Sorry. We do not support shared libraries for parallel HDF5.

Elena

···

On Feb 15, 2013, at 1:40 PM, annop@MPA-Garching.MPG.DE wrote:

Thank you very much.

Annop

Message: 2
Date: Fri, 15 Feb 2013 06:43:47 -0600
From: Elena Pourmal <epourmal@hdfgroup.org>
To: HDF Users Discussion List <hdf-forum@hdfgroup.org>
Subject: Re: [Hdf-forum] problem with h5pset_fapl_mpio_f
Message-ID: <73AD441A-D196-4A19-BF05-84B98273D5D3@hdfgroup.org>
Content-Type: text/plain; charset="iso-8859-1"

Summary looks good. Could you please try to compile your program with the
h5pfc script that should be the "bin" directory of the HDF5 installation
directory?

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

Hi Annop,

One major benefits of using shared library is:
Different processes, even of different users, can co-use the shared library code--resulting
in fewer paging faults in a multiple processes system.

But this benefit is not available in MPI environment since it is a distributed memory and
is often a single process per processor system. Also, in order to make the shared library available during
run time, either each processor has a copy of the shared library in its local file system (that
incurs consistency problem across all processors and imagine thousands of local disks for thousands of
processors cluster);
Or the shared library is on a shared file system to ALL processors (that incurs run time network traffic and
imagine thousands of processors "pounding" on that single file server).
Therefore, many distributed memory systems choose not to support shared library.
The front end just "broadcasts" the executable file to all back end compute nodes before
starting the MPI execution, then the compute nodes just compute on their own until they
are done and then report to the frontend that they are available for another job.

That is one reason HDF5 configure disables shared library by default when building
parallel HDF5 (--enable-parallel). The resultant executable file is larger but it eliminates
shared library problem like the one you encountered.

Hope this help explaining the issue.

-Albert

···

On 2/15/13 3:00 PM, Elena Pourmal wrote:

Hi Annop,

I am glad that the problem was resolved. Sorry, I forgot about shared libraries!!! (should know that!)

On Feb 15, 2013, at 1:40 PM, annop@MPA-Garching.MPG.DE wrote:

Hi Elena,

The problem is solved. Instead of using the shared libraries,
my colleague suggested to link with the static libraries.

I also compiled the code with h5pfc as you suggested.
If I set -shlib, then the code fails with the same error
message as well.

Any clue why shared libraries don't work here?

Sorry. We do not support shared libraries for parallel HDF5.

Elena

Thank you very much.

Annop

Message: 2
Date: Fri, 15 Feb 2013 06:43:47 -0600
From: Elena Pourmal <epourmal@hdfgroup.org>
To: HDF Users Discussion List <hdf-forum@hdfgroup.org>
Subject: Re: [Hdf-forum] problem with h5pset_fapl_mpio_f
Message-ID: <73AD441A-D196-4A19-BF05-84B98273D5D3@hdfgroup.org>
Content-Type: text/plain; charset="iso-8859-1"

Summary looks good. Could you please try to compile your program with the
h5pfc script that should be the "bin" directory of the HDF5 installation
directory?

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org