HDF5 applications with frequent metadata updates

Hello,

I am working in an approach of supporting snapshots in the metadata of HDF5
and I was wondering what kind of application would make sense for frequent
metadata updates, and no updates on data. For example, such an application
could load a huge dataset from one day's data, and then perform operations
which will make only metadata to change. Is there any sample
applications/benchmarks that you know of this behavior?

Many thanks,

Dimos

Hi Dimos,

Are you talking about users’ metadata, i.e., HDF5 attributes?

Here at The HDF Group we are not aware of any benchmarks and such applications, but the scenario you described is very reasonable (not sure about “frequent" though).
For example, data is used as input to different algorithms that produce small amount of data that is stored in the same HDF5 file.

Elena

···

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

On Sep 25, 2015, at 12:59 PM, Dimos Stamatakis <dimstamat@gmail.com<mailto:dimstamat@gmail.com>> wrote:

Hello,

I am working in an approach of supporting snapshots in the metadata of HDF5 and I was wondering what kind of application would make sense for frequent metadata updates, and no updates on data. For example, such an application could load a huge dataset from one day's data, and then perform operations which will make only metadata to change. Is there any sample applications/benchmarks that you know of this behavior?

Many thanks,

Dimos
_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5