HDF5 1.10.5-pre1 available for testing

HDF5 Library
1

Hello everyone,

A pre-release version of HDF5 1.10.5 source is available for testing and can be downloaded at the following link:
https://gamma.hdfgroup.org/ftp/pub/outgoing/hdf5

A brief summary of new features introduced in HDF5 1.10.5:

- CMake improvements to support testing and cross compiling on HPC machines with batch scripts using sbatch or bsub schedulers.

- Upgrades  to sec2, log and core VFDs to allow use of pread/pwrite.

- Ability to minimize dataset object headers, including Fortran wrappers.

- New chunk query functions.

- Changed default behavior to improve performance when reading a contiguous dataset in its entirety by all processes collectively.

- Replaced all MPI-1 API calls with MPI-2 equivalents to better support OpenMPI.

- Several bugs were fixed, including CVE vulnerability issues brought to our attention, as well as hanging with collective metadata reads during chunked dataset I/O found in netCDF-4.

For details about these and other changes and more information about the release see https://gamma.hdfgroup.org/ftp/pub/outgoing/hdf5/hdf5-1.10.5-pre1-RELEASE.txt or https://portal.hdfgroup.org/display/HDF5/Software+Changes+from+Release+to+Release+for+HDF5-1.10.

If you have time to test this release candidate, we would greatly appreciate it. We test HDF5 on a variety of platforms and with multiple compilers, but there is always a system that we couldn’t test on. Your feedback is critical.

For those who use autoconf to build HDF5, please notice that the default configuration mode for this distribution is “–enable-build-mode=production". Use the “–enable-build-mode=debug” configure flag if you want to build HDF5 in the debug mode. Testing in both modes is recommended when possible.

The shared library version numbers for lib.so.* files in HDF5-1.10.5-pre1 have been updated according to libtool’s versioning system and the changes in symbols from HDF5-1.10.4. The API compatibility report is at this link: https://gamma.hdfgroup.org/ftp/pub/outgoing/hdf5/hdf5-1.10.5-vs.1.10.4-preliminary-interface_compatibility_report.html.

Your prompt reports of any issues found will be invaluable and very much appreciated. Thank you and happy testing!

Larry
Larry Knox
The HDF Group

2

Larry et al,

This is a good opportunity to clean up API and ABI compatibility between minor releases. For starters:

  • The API compatibility report for 1.10.5-pre1 shows six removed symbols. Please reinstate these symbols so that in the ABI (binary) interface, these map internally to the correct values or targets. You can tag the reinstatements as temporary, to be deleted at the next major ABI change. This change is important to allow programs compiled with 1.10.4 to be ABI (binary) compatible with library 1.10.5, without recompiling.

  • In the new release notes, the section “Revert H5Oget_info* and H5Ovisit* functions” implies API compatibility back to at least 1.10.2. To check this, please run the API compatibility check independently for at least three retrospective cases:

    • 1.10.5-pre1 vs. 1.10.2
    • 1.10.5-pre1 vs. 1.10.3
    • 1.10.5-pre1 vs. 1.10.4 (already done)

  • Also please run the ABI Laboratory binary compatibility report (https://abi-laboratory.pro/index.php?view=timeline&l=hdf5) for the same three retrospective cases.

Also please recall this recent topic on ABI stability and binary compatibility.

Minor attention to these details now will save much effort for users and repositories. Thanks for your help.

3

Hello,

Builds and runs fine so far on Windows x86 and x86-64!

Thank you for your great work,
Andrey Paramonov