# HDFView 3.0 Pre-release - Newsletter #163 - The HDF Group

**URL:** <https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686>\
**Category:** News and Announcements\
**Created:** [July 31, 2018, 11:14pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686 "2018-07-31T23:14:46Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![info1](https://forum.hdfgroup.org/user_avatar/forum.hdfgroup.org/info1/32/1036_2.png) [@info1](https://forum.hdfgroup.org/u/info1)\
**Post date:** [July 31, 2018, 11:14pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/1 "2018-07-31T23:14:46Z")

</div>

Pre-release versions of both HDFView 3.0 and HDF5-1.10.3 are now available. We encourage users to try them and let us know if you encounter any issues or have any suggestions.

# HDFView 3.0 Pre-release

The pre-release version of HDFView 3.0 is available from the HDFView home page:

[https://www.hdfgroup.org/downloads/hdfview/](https://www.hdfgroup.org/downloads/hdfview/)

It is built with the pre-release version of HDF5-1.10.3 and with HDF 4.2.14. A final release of HDFView 3.0 will be available once HDF5-1.10.3 has been released. Many fixes and improvements have been added since the beta was introduced.

HDFView 3.0 is a major release that includes the following new features and changes:

- It supports 64-bit object identifiers, and uses the HDF-Java wrappers that were added to HDF5 and HDF4.
- The GUI framework that HDFView uses was migrated from Swing to SWT, which provides a more native application look and feel and advanced support for tables.
- The data views have been separated from the main HDFView window. The main HDFView window still displays open files and their structures on the left side of the window, and it now displays any metadata on the right side.
- This release includes improved support for various datatypes (compound, array of compound, and opaque).

For a complete list of the new features and changes in this release, please see the Release Notes.

# HDF5-1.10.3 Pre-release

The HDF5-1.10.3 pre-release source code is available from the HDF Support Portal:

[https://portal.hdfgroup.org/display/support/HDF5+1.10.3-pre1](https://portal.hdfgroup.org/display/support/HDF5+1.10.3-pre1)

New features and changes in this release include:

- Several bugs were fixed in parallel compression in which:
  - Partial parallel reads of filtered datasets were returning incorrect data.
  - Partial parallel writes of filtered datasets triggered an assertion failure in the file free space manager.
  - The H5D\_\_mpio\_array\_gatherv() function allocated too much memory.

- The following CVEs have been addressed in this release:
  - CVE-2018-11202: A NULL pointer dereference was discovered in H5S\_hyper\_make\_spans in H5Shyper.c.
  - CVE-2018-11203: A division by zero was discovered in H5D\_\_btree\_decode\_key in H5Dbtree.c.
  - CVE-2018-11204: A NULL pointer dereference was discovered in H5O\_\_chunk\_deserialize in H5Ocache.c.
  - CVE-2018-11206: An out of bounds read was discovered in H5O\_fill\_new\_decode and H5O\_fill\_old\_decode in H5Ofill.c.
  - CVE-2018-11207: A division by zero was discovered in H5D\_\_chunk\_init in H5Dchunk.c.

- The H5DreadVL and H5AreadVL Java APIs were refactored to correct dataset and attribute reads.
- New APIs were added for accessing chunks: H5Dread\_chunk and H5Dwrite\_chunk
- New versions of the following HDF5 Object (H5O) APIs were added to include additional parameters: H5Oget\_info, H5Oget\_info\_by\_idx, H5Oget\_info\_by\_name, H5Ovisit, and H5Ovisit\_by\_name.
- Several C++ wrappers were added or modified to provide additional support.
- Code changes were made to improve performance.
- The gcc attribute (no\_sanitize) was moved before the function name to eliminate build issues with gcc 8.

For a complete list of the new features and changes in this release, please see the Release Notes.

> **[HDFView 3.0 Pre-release - Newsletter #163 - The HDF Group](https://www.hdfgroup.org/2018/07/hdfview-3-0-pre-release-newsletter-163/)**
>
> CONTENTS: HDFView 3.0 Pre-release HDF5-1.10.3 Pre-release Pre-release versions of both HDFView 3.0 and HDF5-1.10.3 are now available.  We encourage users to try them and let us know if you encounter any issues or have any suggestions. HDFView 3.0...

---

<div class="post-metadata">

**Author:** ![paramon](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/p/8491ac/32.png) [@paramon](https://forum.hdfgroup.org/u/paramon)\
**Post date:** [December 21, 2018, 12:13pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/2 "2018-12-21T12:13:18Z")

</div>

Hello!

Just tried to update from HDF5 10.1 to HDF5 10.4 in my codebase, and apparently HDF5 release 10.3 did break library API compatibility. Specifically, functions `H5Oget_info`, `H5Oget_info_by_idx`, `H5Oget_info_by_name`, `H5Ovisit`, `H5Ovisit_by_name` are now available either with new definition (suffixed with `2`) or with original definition (suffixed with `1`), but never by original name (without suffix).

Older client code relying on original names _will_ break, as confirmed by e.g. [https://github.com/JuliaIO/HDF5.jl/issues/508](https://github.com/JuliaIO/HDF5.jl/issues/508). It is proposed to export the original symbols using original names (without suffix) so older client code can still access them from the newer HDF5 libraries.

Previously, HDF5 used to publish very detailed and comprehensive compatibility reports, like this:  
[https://support.hdfgroup.org/HDF5/doc/ADGuide/Compatibility\_Report/CR\_1.10.1.html](https://support.hdfgroup.org/HDF5/doc/ADGuide/Compatibility_Report/CR_1.10.1.html)  
However, lately this practice ceased, unfortunately. Is it possible that compatibility report robot is re-vived, to avoid the risk of breakage in the future?

Best wishes,  
Andrey Paramonov

---

<div class="post-metadata">

**Author:** ![epourmal](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/e/c67d28/32.png) [@epourmal](https://forum.hdfgroup.org/u/epourmal)\
**Post date:** [December 21, 2018, 1:30pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/3 "2018-12-21T13:30:13Z")

</div>

Andrey,

Thank you for reporting!

I don’t know how that happened, but we did discuss internally that in 1.10 releases the original signature should default to version 1. Somehow the change did not make it into the release.

We will fix it in 1.10.5 coming in January.

Thank you!

Elena

---

<div class="post-metadata">

**Author:** ![bljones](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/b/e5b9ba/32.png) [@bljones](https://forum.hdfgroup.org/u/bljones)\
**Post date:** [December 21, 2018, 2:14pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/4 "2018-12-21T14:14:16Z")

</div>

Hi Andrey,

We do still provide compatibility reports. They are located in the HDF5 Application Developer’s Guide:

HDF5 Application Developer’s Guide -\>Release Specific Information-\>Software Changes from Release to Release for HDF5-1.10 -\> API Compatibility Reports

The direct link to these reports is: [https://portal.hdfgroup.org/display/HDF5/API+Compatibility+Reports](https://portal.hdfgroup.org/display/HDF5/API+Compatibility+Reports)

We will try to make them more visible.  
Sorry for the inconvenience!

-Barbara

---

<div class="post-metadata">

**Author:** ![bljones](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/b/e5b9ba/32.png) [@bljones](https://forum.hdfgroup.org/u/bljones)\
**Post date:** [December 21, 2018, 3:19pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/5 "2018-12-21T15:19:10Z")

</div>

Hi Andrey,

Just a follow-up regarding the H5Oget\_info APIs and the suffix issue…

The new H5Oget\_info\* APIs were added in HDF5-1.10.3, but unfortunately HDF5-1.10.3 did not configure the default APIs properly, so with that release the defaults were the versions ending in 2. We realized the mistake and fixed the issue in HDF5-1.10.4. However, this change did not make it into the release notes. It is now documented on the Software Changes From Release to Release page, here:

> **[Software Changes from Release to Release for HDF5-1.10](https://portal.hdfgroup.org/display/HDF5/Software+Changes+from+Release+to+Release+for+HDF5-1.10)**
>
> This document is designed to help developers maintain HDF5-based applications as they are used with successive releases of HDF5. To that end, this document lists the changes at each release that a maintenance developer needs to be aware of:

-Barbara

---

<div class="post-metadata">

**Author:** ![paramon](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/p/8491ac/32.png) [@paramon](https://forum.hdfgroup.org/u/paramon)\
**Post date:** [December 21, 2018, 3:52pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/6 "2018-12-21T15:52:37Z")

</div>

Thank you Elena, Barbara!

Indeed, the new link works, and does notify of compatibility breakage in 1.10.3:  
[https://bitbucket.hdfgroup.org/pages/HDFFV/hdf5doc/master/browse/html/ADGuide/Compatibility\_Report/CR\_1.10.3.html](https://bitbucket.hdfgroup.org/pages/HDFFV/hdf5doc/master/browse/html/ADGuide/Compatibility_Report/CR_1.10.3.html)

Please note that I did check against **1.10.4** , and original symbols (without suffix) are missing from version 1.10.4 library as well. I think that the safest/proper solution for 1.10.5 would now be to have both original names (without suffix) and 1.10.3 names (with suffix “1”) for the old functions. We shall respect both pre-1.10.3 and 1.10.3…1.10.4-aware clients. If deemed to choose, I’m pretty sure there are more of the former than the latter, so having non-suffixed names again in 1.10.5 feels more important.

Thank you for you quick reply and support!

Best wishes,  
Andrey Paramonov

---

<div class="post-metadata">

**Author:** ![bljones](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/b/e5b9ba/32.png) [@bljones](https://forum.hdfgroup.org/u/bljones)\
**Post date:** [December 21, 2018, 5:40pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/7 "2018-12-21T17:40:57Z")

</div>

Hi Andrey,

With the new versions of the H5Oget\_info APIs, the version **without** the suffix is a macro that points to either the API ending in 1 or 2.

We went back and looked at the tagged versions of HDF5-1.10.3 and HDF5-1.10.4 and we actually _did_ correctly set the macro.

I can compile the attached h5ex\_g\_iterate.c example with 1.10.1, 1.10.3, and 1.10.4. This example calls H5Oget\_info\_by\_name, one of the APIs that changed.

-Barbara  
[h5ex\_g\_iterate.c](https://hdf-discourse-1.s3.amazonaws.com/original/2X/1/1f6d4b4068e92b9a93146e69bc9f844b493529a8.c) (1.9 KB)

---

<div class="post-metadata">

**Author:** ![paramon](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/p/8491ac/32.png) [@paramon](https://forum.hdfgroup.org/u/paramon)\
**Post date:** [December 21, 2018, 6:04pm UTC](https://forum.hdfgroup.org/t/hdfview-3-0-pre-release-newsletter-163-the-hdf-group/4686/8 "2018-12-21T18:04:28Z")

</div>

Hi Barbara,  
And thank you for your input!

Unfortunately, a piece of software compiled against HDF5 1.10.2 knows nothing about macros introduced later, and simply fails to locate expected symbol `H5Oget_info_by_name` when running against HDF5 1.10.3+. The API compatibility [verdict](https://bitbucket.hdfgroup.org/pages/HDFFV/hdf5doc/master/browse/html/ADGuide/Compatibility_Report/CR_1.10.3.html) is correct: backward compatibility is broken ☹

Best wishes,  
Andrey Paramonov
