# Future Development and Product Ideas

**URL:** https://forum.hdfgroup.org/c/future-development-and-product-ideas/10.md

[Latest](https://forum.hdfgroup.org/latest.md) · [Categories](https://forum.hdfgroup.org/categories.md)

---

## [About the Future Development and Product Ideas category](https://forum.hdfgroup.org/t/about-the-future-development-and-product-ideas-category/23)

<div class="topic-metadata">

**Author:** [@su-loric](https://forum.hdfgroup.org/u/su-loric)\
**Replies:** 0\
**Last updated:** [February 7, 2018, 11:13pm UTC](https://forum.hdfgroup.org/t/about-the-future-development-and-product-ideas-category/23 "2018-02-07T23:13:20Z")

</div>

Let us know what you’re thinking about!

---

## [Markitdown for HDF5](https://forum.hdfgroup.org/t/markitdown-for-hdf5/13054)

<div class="topic-metadata">

**Author:** [@hyoklee](https://forum.hdfgroup.org/u/hyoklee)\
**Replies:** 3\
**Last updated:** [May 11, 2026, 4:04am UTC](https://forum.hdfgroup.org/t/markitdown-for-hdf5/13054 "2026-05-11T04:04:53Z")

</div>

Happy V-day & Friday! Any volunteer for HDF5 plugin? markitdown/packages/markitdown-sample-plugin at main · microsoft/markitdown Example: markitdown path-to-file.h5 \> document.md This idea is inspired by Back to Tex…

---

## [Pure Fortran H5](https://forum.hdfgroup.org/t/pure-fortran-h5/13416)

<div class="topic-metadata">

**Author:** [@hyoklee](https://forum.hdfgroup.org/u/hyoklee)\
**Replies:** 0\
**Last updated:** [August 6, 2025, 4:18pm UTC](https://forum.hdfgroup.org/t/pure-fortran-h5/13416 "2025-08-06T16:18:55Z")

</div>

This idea is from How to switch off \`HDF5\_THREADS\_ENABLED\`? - #5 by furutaka.kazuyoshi. Follow jhdf and PureHDF.

---

## [HDF - port to Rust](https://forum.hdfgroup.org/t/hdf-port-to-rust/8639)

<div class="topic-metadata">

**Author:** [@george.w.eckertiii](https://forum.hdfgroup.org/u/george.w.eckertiii)\
**Replies:** 4\
**Last updated:** [March 22, 2023, 1:32am UTC](https://forum.hdfgroup.org/t/hdf-port-to-rust/8639 "2023-03-22T01:32:15Z")

</div>

Since Rust is memory-safe and thread-safe out of the box, doesn’t it just make sense to port HDF from C to Rust?

---

## [March Madness - Big Da-ta-nce Bracket](https://forum.hdfgroup.org/t/march-madness-big-da-ta-nce-bracket/12115)

<div class="topic-metadata">

**Author:** [@hyoklee](https://forum.hdfgroup.org/u/hyoklee)\
**Replies:** 0\
**Last updated:** [March 27, 2024, 3:25pm UTC](https://forum.hdfgroup.org/t/march-madness-big-da-ta-nce-bracket/12115 "2024-03-27T15:25:20Z")

</div>

How’s your :basketball: bracket holding up? Did any upsets wreck your bracket? Just for fun, check out this data challenge bracket! C/Fortran HPC Region poll Java Bigdata Region poll Node.js Cloud Region poll Python AI…

---

## [Google PaLM: Write a story about hierarchical data format](https://forum.hdfgroup.org/t/google-palm-write-a-story-about-hierarchical-data-format/11114)

<div class="topic-metadata">

**Author:** [@hyoklee](https://forum.hdfgroup.org/u/hyoklee)\
**Replies:** 2\
**Last updated:** [May 18, 2023, 3:56pm UTC](https://forum.hdfgroup.org/t/google-palm-write-a-story-about-hierarchical-data-format/11114 "2023-05-18T15:56:19Z")

</div>

Once upon a time, there was a hierarchical data format named JSON. JSON was a very popular format, and it was used for many things, such as storing data in a database, sending data over the internet, and displaying da…

---

## [Variable-Length Data in HDF5 Sketch RFC Status?](https://forum.hdfgroup.org/t/variable-length-data-in-hdf5-sketch-rfc-status/10284)

<div class="topic-metadata">

**Author:** [@ivirshup](https://forum.hdfgroup.org/u/ivirshup)\
**Replies:** 4\
**Last updated:** [October 5, 2022, 3:09pm UTC](https://forum.hdfgroup.org/t/variable-length-data-in-hdf5-sketch-rfc-status/10284 "2022-10-05T15:09:13Z")

</div>

Some of the storage issues around variable length data in hdf5 have recently reared their head for our project. From the RFC 2019-07-15 “Variable-Length Data in HDF5 Sketch Design”, it seems like this is a known problem,…

---

## [Memory mapping / Paging via HDF5 & VFD?](https://forum.hdfgroup.org/t/memory-mapping-paging-via-hdf5-vfd/9052)

<div class="topic-metadata">

**Author:** [@werner](https://forum.hdfgroup.org/u/werner)\
**Replies:** 2\
**Last updated:** [July 15, 2022, 4:18pm UTC](https://forum.hdfgroup.org/t/memory-mapping-paging-via-hdf5-vfd/9052 "2022-07-15T16:18:11Z")

</div>

Per discussion in today’s HUG21 meeting, it was mentioned that the VFD is currently under revision and reworked, including changes to the HDF5 API. So maybe this could be an opportunity to consider and also build in memo…

---

## [Changes to include directory structure](https://forum.hdfgroup.org/t/changes-to-include-directory-structure/7668)

<div class="topic-metadata">

**Author:** [@mike.jackson](https://forum.hdfgroup.org/u/mike.jackson)\
**Replies:** 4\
**Last updated:** [October 28, 2020, 2:59pm UTC](https://forum.hdfgroup.org/t/changes-to-include-directory-structure/7668 "2020-10-28T14:59:33Z")

</div>

Was/Is there any discussion around the idea of installing the HDF5 headers into a “sandboxed” include directory such as “hdf5”? If we look at projects like LLVM when they install their headers they go into clang, clang-c…

---

## [Publishing HDF5 data to public repositories](https://forum.hdfgroup.org/t/publishing-hdf5-data-to-public-repositories/6801)

<div class="topic-metadata">

**Author:** [@rhs](https://forum.hdfgroup.org/u/rhs)\
**Replies:** 0\
**Last updated:** [March 13, 2020, 7:41pm UTC](https://forum.hdfgroup.org/t/publishing-hdf5-data-to-public-repositories/6801 "2020-03-13T19:41:30Z")

</div>

The research community is rapidly moving toward facilitating access of raw “open data” as an integral part of publishing research papers with minimal data overhead to the researcher. Two excellent examples of these rep…

---

## [The H5IM API supporting 16b pixel format ?](https://forum.hdfgroup.org/t/the-h5im-api-supporting-16b-pixel-format/5639)

<div class="topic-metadata">

**Author:** [@francois](https://forum.hdfgroup.org/u/francois)\
**Replies:** 0\
**Last updated:** [April 8, 2019, 3:19pm UTC](https://forum.hdfgroup.org/t/the-h5im-api-supporting-16b-pixel-format/5639 "2019-04-08T15:19:36Z")

</div>

Hi all, Do you know if there is a plan to upgrade H5IM API with 16b pixel format support ? There is a need to store pixel coded on 16b such as: herr\_t H5IMmake\_image\_48bit ( hid\_t loc\_id, const char \*dset\_name, hsiz…

---

## [Simplified geospatial data representation?](https://forum.hdfgroup.org/t/simplified-geospatial-data-representation/4858)

<div class="topic-metadata">

**Author:** [@piyush.agram](https://forum.hdfgroup.org/u/piyush.agram)\
**Replies:** 1\
**Last updated:** [December 6, 2018, 4:54pm UTC](https://forum.hdfgroup.org/t/simplified-geospatial-data-representation/4858 "2018-12-06T16:54:34Z")

</div>

Hi, I’m looking for recommendations / suggestions to use HDF5 format better for large geospatial datasets related to SAR imagery. Realize that this may not be the most relevant forum but probably a good idea to bring it…

---

## [Environment variable for chunk cache size?](https://forum.hdfgroup.org/t/environment-variable-for-chunk-cache-size/4581)

<div class="topic-metadata">

**Author:** [@thomas1](https://forum.hdfgroup.org/u/thomas1)\
**Replies:** 5\
**Last updated:** [August 2, 2018, 1:09pm UTC](https://forum.hdfgroup.org/t/environment-variable-for-chunk-cache-size/4581 "2018-08-02T13:09:57Z")

</div>

I’ve come across performance problems in a case where chunks are much bigger than the default chunk cache size. The default of 1 MB cache per dataset seems extremely small now that even laptops have multiple GB of RAM, a…

---

## [Image API(H5IM) is not present in HDF.PInvoke](https://forum.hdfgroup.org/t/image-api-h5im-is-not-present-in-hdf-pinvoke/4494)

<div class="topic-metadata">

**Author:** [@jpsinfotech](https://forum.hdfgroup.org/u/jpsinfotech)\
**Replies:** 2\
**Last updated:** [June 4, 2018, 8:39pm UTC](https://forum.hdfgroup.org/t/image-api-h5im-is-not-present-in-hdf-pinvoke/4494 "2018-06-04T20:39:34Z")

</div>

Can you please let me know the Read/Write Image is possible through HDF.PInvoke.dll. I couldn’t find any interface for Writing the images into the HDF5 files.

---

## [Data corruption detection and/or correction](https://forum.hdfgroup.org/t/data-corruption-detection-and-or-correction/4361)

<div class="topic-metadata">

**Author:** [@miller86](https://forum.hdfgroup.org/u/miller86)\
**Replies:** 3\
**Last updated:** [May 4, 2018, 3:11am UTC](https://forum.hdfgroup.org/t/data-corruption-detection-and-or-correction/4361 "2018-05-04T03:11:44Z")

</div>

So, HDF5 lib has ability to do checksuming on any data passing from client to file via H5Dwrite/H5Dread, correct? This can be used to detect data corruption. Just curious, but has there ever been any discussion of extend…
