HDF5 1.8.13 release candidate (pre1) is available for testing

Dear HDF5 users,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available for testing and can be downloaded from the following location:

ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/

We will greatly appreciate if you test this pre-release on the platform(s) of your choice and report any problems found to this list as soon as possible. We have about three weeks to address the issues.

Notice to the autoconf Unix users: The default configuration for this release candidate is "development". The next release candidate will be available in the "production" mode as the release itself.

The list of the features, bug fixes, and platforms tested by The HDF Group can be found in the
ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/hdf5-1.8.13-pre1-RELEASE.txt file.

Highlights:

  - Simplified configuration for building thread-safe library (use --enable-threadsafe configure flag)
  - New H5free_memory function to ensure that the same CRT handles both allocation and free
  - Support for collective I/O on point selections for parallel applications
  - New C++ wrappers to get object's name and type
  - Improved handling of NULL pointers in H5Dread/H5Dwrite calls: H5Dwrite/read doesn't fail anymore
    when a NULL pointer was passed for a data buffer and 0 elements were selected.
  - Support for user-defined (both registered or dynamically loaded) filters in h5repack (yes, you can remove UD filter now!)
  - MPI POSIX driver has been removed

Please don't be discouraged if you don't see your patch in this release. Some patches came too late or need rework.

Happy testing and we look forward to hearing from you!

Thank you!

Elena

···

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Hi,

The candidate I got compiles and runs fine on Centos 6.4, however, I am
unable to compile netcdf with it, due to the missing MPI POSIX driver.

Any hints?

Thanks,

Jason

···

On 04/22/2014 05:57 AM, Elena Pourmal wrote:

Dear HDF5 users,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available for testing and can be downloaded from the following location:

ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/

We will greatly appreciate if you test this pre-release on the platform(s) of your choice and report any problems found to this list as soon as possible. We have about three weeks to address the issues.

Notice to the autoconf Unix users: The default configuration for this release candidate is "development". The next release candidate will be available in the "production" mode as the release itself.

The list of the features, bug fixes, and platforms tested by The HDF Group can be found in the
ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/hdf5-1.8.13-pre1-RELEASE.txt file.

Highlights:

  - Simplified configuration for building thread-safe library (use --enable-threadsafe configure flag)
  - New H5free_memory function to ensure that the same CRT handles both allocation and free
  - Support for collective I/O on point selections for parallel applications
  - New C++ wrappers to get object's name and type
  - Improved handling of NULL pointers in H5Dread/H5Dwrite calls: H5Dwrite/read doesn't fail anymore
    when a NULL pointer was passed for a data buffer and 0 elements were selected.
  - Support for user-defined (both registered or dynamically loaded) filters in h5repack (yes, you can remove UD filter now!)
  - MPI POSIX driver has been removed

Please don't be discouraged if you don't see your patch in this release. Some patches came too late or need rework.

Happy testing and we look forward to hearing from you!

Thank you!

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

Hi Elena,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available for testing and can be downloaded from the following location:

I didn't see HDFFV-1063 (vlen issues in conversion callbacks) in the
changelog... has this been pushed back to 1.8.14?

Thanks!
Andrew

Has anyone else noticed that the hdf5 high-level libraries don¹t seem to
have dependencies on the low level libraries:

1.8.13 (pre1):
readelf -d libhdf5hl_fortran.so

Dynamic section at offset 0x18d70 contains 31 entries:
  Tag Type Name/Value
0x0000000000000001 (NEEDED) Shared library: [libz.so.1]
0x0000000000000001 (NEEDED) Shared library: [librt.so.1]
0x0000000000000001 (NEEDED) Shared library: [libdl.so.2]
0x0000000000000001 (NEEDED) Shared library: [libgfortran.so.3]
0x0000000000000001 (NEEDED) Shared library: [libquadmath.so.0]
0x0000000000000001 (NEEDED) Shared library: [libm.so.6]
0x0000000000000001 (NEEDED) Shared library: [libc.so.6]
0x0000000000000001 (NEEDED) Shared library: [libgcc_s.so.1]
0x000000000000000e (SONAME) Library soname:
[libhdf5hl_fortran.so.8]
0x000000000000000f (RPATH) Library rpath:
[/opt/gcc/4.8.0/snos/lib/../lib64]
0x000000000000001d (RUNPATH) Library runpath:
[/opt/gcc/4.8.0/snos/lib/../lib64]

1.8.12:
readelf -d libhdf5hl_fortran.so

Dynamic section at offset 0x17d40 contains 34 entries:
  Tag Type Name/Value
0x0000000000000001 (NEEDED) Shared library: [libhdf5_hl.so.8]
0x0000000000000001 (NEEDED) Shared library:
[libhdf5_fortran.so.8]
0x0000000000000001 (NEEDED) Shared library: [libhdf5.so.8]
0x0000000000000001 (NEEDED) Shared library: [libz.so.1]
0x0000000000000001 (NEEDED) Shared library: [librt.so.1]
0x0000000000000001 (NEEDED) Shared library: [libdl.so.2]
0x0000000000000001 (NEEDED) Shared library: [libgfortran.so.3]
0x0000000000000001 (NEEDED) Shared library: [libm.so.6]
0x0000000000000001 (NEEDED) Shared library: [libquadmath.so.0]
0x0000000000000001 (NEEDED) Shared library: [libc.so.6]
0x0000000000000001 (NEEDED) Shared library: [libgcc_s.so.1]
0x000000000000000e (SONAME) Library soname:
[libhdf5hl_fortran.so.8]
0x000000000000000f (RPATH) Library rpath:
[/var/tmp/cray-hdf5-1.8.12-2-root/opt/cray/hdf5/1.8.12/GNU/48/lib:/opt/gcc/
4.8.0/snos/lib/../lib64]
0x000000000000001d (RUNPATH) Library runpath:
[/var/tmp/cray-hdf5-1.8.12-2-root/opt/cray/hdf5/1.8.12/GNU/48/lib:/opt/gcc/
4.8.0/snos/lib/../lib64]

Did I mess something up or is this an HDF5 bug ? Thanks.

Sean B.

···

On 4/21/14 10:57 PM, "Elena Pourmal" <epourmal@hdfgroup.org> wrote:

Dear HDF5 users,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available
for testing and can be downloaded from the following location:

ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/

We will greatly appreciate if you test this pre-release on the
platform(s) of your choice and report any problems found to this list as
soon as possible. We have about three weeks to address the issues.

Notice to the autoconf Unix users: The default configuration for this
release candidate is "development". The next release candidate will be
available in the "production" mode as the release itself.

The list of the features, bug fixes, and platforms tested by The HDF
Group can be found in the
ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/hdf5-1.8.13
-pre1-RELEASE.txt file.

Highlights:

- Simplified configuration for building thread-safe library (use
--enable-threadsafe configure flag)
- New H5free_memory function to ensure that the same CRT handles both
allocation and free
- Support for collective I/O on point selections for parallel
applications
- New C++ wrappers to get object's name and type
- Improved handling of NULL pointers in H5Dread/H5Dwrite calls:
H5Dwrite/read doesn't fail anymore
   when a NULL pointer was passed for a data buffer and 0 elements were
selected.
- Support for user-defined (both registered or dynamically loaded)
filters in h5repack (yes, you can remove UD filter now!)
- MPI POSIX driver has been removed

Please don't be discouraged if you don't see your patch in this release.
Some patches came too late or need rework.

Happy testing and we look forward to hearing from you!

Thank you!

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.o
rg

Hi Jason,

NetCDF-4 code has 2 calls to H5Pset_fapl_mpiposix() in libsrc4/nc4file.c which cause link errors because the function no longer exists. They are in else blocks where the if is using MPI/IO.

There are also some posix tests in nc_test4/tst_nc4perf.c and nc_test4/tst_parallel3.c which may be enabled by the --enable-parallel-tests option and will fail in make check after the link error is corrected.

The attached patch turns off these calls and tests for the HDF5 1.8.13 version. It will be submitted to Unidata for possible incorporation into the netCDF4 code. It allows make and make check to complete successfully for me. If you're interested in trying it, please let us know if it is effective for you.

Thanks,
Larry

netcdf4_20140422.patch (584 Bytes)

···

-----Original Message-----
From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Jason Temple
Sent: Tuesday, April 22, 2014 8:22 AM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] HDF5 1.8.13 release candidate (pre1) is available for testing

Hi,

The candidate I got compiles and runs fine on Centos 6.4, however, I am unable to compile netcdf with it, due to the missing MPI POSIX driver.

Any hints?

Thanks,

Jason

On 04/22/2014 05:57 AM, Elena Pourmal wrote:

Dear HDF5 users,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available for testing and can be downloaded from the following location:

ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/

We will greatly appreciate if you test this pre-release on the platform(s) of your choice and report any problems found to this list as soon as possible. We have about three weeks to address the issues.

Notice to the autoconf Unix users: The default configuration for this release candidate is "development". The next release candidate will be available in the "production" mode as the release itself.

The list of the features, bug fixes, and platforms tested by The HDF
Group can be found in the ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/hdf5-1.8.13-pre1-RELEASE.txt file.

Highlights:

  - Simplified configuration for building thread-safe library (use --enable-threadsafe configure flag)
  - New H5free_memory function to ensure that the same CRT handles both allocation and free
  - Support for collective I/O on point selections for parallel applications
  - New C++ wrappers to get object's name and type
  - Improved handling of NULL pointers in H5Dread/H5Dwrite calls: H5Dwrite/read doesn't fail anymore
    when a NULL pointer was passed for a data buffer and 0 elements were selected.
  - Support for user-defined (both registered or dynamically loaded) filters in h5repack (yes, you can remove UD filter now!)
  - MPI POSIX driver has been removed

Please don't be discouraged if you don't see your patch in this release. Some patches came too late or need rework.

Happy testing and we look forward to hearing from you!

Thank you!

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgro
up.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

Hi Andrew,

Hi Elena,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available for testing and can be downloaded from the following location:

I didn't see HDFFV-1063 (vlen issues in conversion callbacks) in the
changelog... has this been pushed back to 1.8.14?

Sorry! Yes, we had to push it to 1.8.14.

Elena

···

On Apr 23, 2014, at 2:02 PM, Andrew Collette <andrew.collette@gmail.com> wrote:

Thanks!
Andrew

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

Sean,

Thank you for finding the issue! The dependency was unintentionally removed when we attempted to fix a configuration problem.

We will fix it for the HDF5 1.8.13-pre2 tar ball.

Elena

···

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

On Apr 24, 2014, at 10:56 AM, Sean Byland <seanb@cray.com> wrote:

Has anyone else noticed that the hdf5 high-level libraries don¹t seem to
have dependencies on the low level libraries:

1.8.13 (pre1):
readelf -d libhdf5hl_fortran.so

Dynamic section at offset 0x18d70 contains 31 entries:
Tag Type Name/Value
0x0000000000000001 (NEEDED) Shared library: [libz.so.1]
0x0000000000000001 (NEEDED) Shared library: [librt.so.1]
0x0000000000000001 (NEEDED) Shared library: [libdl.so.2]
0x0000000000000001 (NEEDED) Shared library: [libgfortran.so.3]
0x0000000000000001 (NEEDED) Shared library: [libquadmath.so.0]
0x0000000000000001 (NEEDED) Shared library: [libm.so.6]
0x0000000000000001 (NEEDED) Shared library: [libc.so.6]
0x0000000000000001 (NEEDED) Shared library: [libgcc_s.so.1]
0x000000000000000e (SONAME) Library soname:
[libhdf5hl_fortran.so.8]
0x000000000000000f (RPATH) Library rpath:
[/opt/gcc/4.8.0/snos/lib/../lib64]
0x000000000000001d (RUNPATH) Library runpath:
[/opt/gcc/4.8.0/snos/lib/../lib64]

1.8.12:
readelf -d libhdf5hl_fortran.so

Dynamic section at offset 0x17d40 contains 34 entries:
Tag Type Name/Value
0x0000000000000001 (NEEDED) Shared library: [libhdf5_hl.so.8]
0x0000000000000001 (NEEDED) Shared library:
[libhdf5_fortran.so.8]
0x0000000000000001 (NEEDED) Shared library: [libhdf5.so.8]
0x0000000000000001 (NEEDED) Shared library: [libz.so.1]
0x0000000000000001 (NEEDED) Shared library: [librt.so.1]
0x0000000000000001 (NEEDED) Shared library: [libdl.so.2]
0x0000000000000001 (NEEDED) Shared library: [libgfortran.so.3]
0x0000000000000001 (NEEDED) Shared library: [libm.so.6]
0x0000000000000001 (NEEDED) Shared library: [libquadmath.so.0]
0x0000000000000001 (NEEDED) Shared library: [libc.so.6]
0x0000000000000001 (NEEDED) Shared library: [libgcc_s.so.1]
0x000000000000000e (SONAME) Library soname:
[libhdf5hl_fortran.so.8]
0x000000000000000f (RPATH) Library rpath:
[/var/tmp/cray-hdf5-1.8.12-2-root/opt/cray/hdf5/1.8.12/GNU/48/lib:/opt/gcc/
4.8.0/snos/lib/../lib64]
0x000000000000001d (RUNPATH) Library runpath:
[/var/tmp/cray-hdf5-1.8.12-2-root/opt/cray/hdf5/1.8.12/GNU/48/lib:/opt/gcc/
4.8.0/snos/lib/../lib64]

Did I mess something up or is this an HDF5 bug ? Thanks.

Sean B.

On 4/21/14 10:57 PM, "Elena Pourmal" <epourmal@hdfgroup.org> wrote:

Dear HDF5 users,

A pre-release candidate of HDF5 1.8.13 for UNIX and Windows is available
for testing and can be downloaded from the following location:

ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/

We will greatly appreciate if you test this pre-release on the
platform(s) of your choice and report any problems found to this list as
soon as possible. We have about three weeks to address the issues.

Notice to the autoconf Unix users: The default configuration for this
release candidate is "development". The next release candidate will be
available in the "production" mode as the release itself.

The list of the features, bug fixes, and platforms tested by The HDF
Group can be found in the
ftp://ftp.hdfgroup.uiuc.edu/pub/outgoing/hdf5/hdf5-1.8.13/pre1/hdf5-1.8.13
-pre1-RELEASE.txt file.

Highlights:

- Simplified configuration for building thread-safe library (use
--enable-threadsafe configure flag)
- New H5free_memory function to ensure that the same CRT handles both
allocation and free
- Support for collective I/O on point selections for parallel
applications
- New C++ wrappers to get object's name and type
- Improved handling of NULL pointers in H5Dread/H5Dwrite calls:
H5Dwrite/read doesn't fail anymore
  when a NULL pointer was passed for a data buffer and 0 elements were
selected.
- Support for user-defined (both registered or dynamically loaded)
filters in h5repack (yes, you can remove UD filter now!)
- MPI POSIX driver has been removed

Please don't be discouraged if you don't see your patch in this release.
Some patches came too late or need rework.

Happy testing and we look forward to hearing from you!

Thank you!

Elena
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.o
rg

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org