Webinar Announcement: New HDF5 Features Coming in 2020-2021

Learn about three upcoming HDF5 features in different stages of development that we are planning to add to HDF5 library in the next two years. This webinar is scheduled for Friday, October 25, at 11:00 a.m. CDT.

First, we will start with two demos on enhancements to Single Writer/Multiple Reader (SWMR) VFD and new “Splitter” and “Mirror” Virtual File Drivers (VFD). Current SWMR doesn’t allow modifications of the file structure while adding new data. Only raw data can be added to the HDF5 file under construction. We redesigned our approach to SWMR and will demonstrate new implementation that allows to add and delete HDF5 objects such as groups, datasets and attributes while writing the to the HDF5 file. Also, the HDF5 library can guarantee for the maximum time from write to availability of data for read.

“Splitter” VFD and “Mirror” VFDs allow simultaneous creation of HDF5 files on local and remote systems. Created files can be accessed in SWMR mode. The features are in a well-developed prototype stage and we are looking for very friendly users to try these VFDs and give us feedback.

We will conclude the Webinar with discussion of the third upcoming development, a new HDF5 storage method for sparse storage that we have been designing and prototyping.

Please register to attend this webinar. It will also be recorded and shared with the community.

Just a reminder, please register for Friday’s webinar on New HDF5 Features Coming in 2020-2021. We’ll be giving a quick talk on what to expect, plus three demos of the new features:

  • John Mainzer will show us the splitter and mirror VFD, which makes HDF5 data available on a remote system for reading, while still creating the file on a local system.
  • David Young will demonstrate the VFD SWMR (virtual file driver single writer/multiple reader) which would remove the limits of the current SWMR implementation.
  • Gerd Heber will give a talk on sparse data management in HDF5 covering an overview of this problem and the design options for handling it in the future.

We would also love to hear from you if you’d like a more in-depth webinar on any of these new developments, or if you can be a tester of our prototypes of these new features. There will be a poll during the webinar, but you can also reach out by email to epourmal -at- hdfgroup.org.

The webinar is scheduled for Friday, 10/25 at 11:00 CDT. Please register to get this event on your calendar and ensure you get an email when the recording is available. We’ll also post this recording here, on the forum.

We also had a question about accessing the webinar from a browser on a Linux machine and verified access with our webinar provider’s tech support. Here are some additional instructions in case you have any difficulties. (We’ve used this provider for awhile and have not had issues that we are aware of.) While you should be able to access the webinar from a browser, here are the additional instructions they provided in case you have an issue:

  1. Locate the confirmation email
  2. Right click on the join webinar webinar button and copy the hyperlink
  3. Add the parameter ?clientType=html5 to the end of the join URL from Step 2.
  4. Copy the entire new URL with the newly added parameter
  5. Paste the new join URL in Chrome to join through the web browser

Thanks, and we look forward to seeing you online tomorrow!