Ive created a project using HDF5DOTNET and rely heavily on attributes for
storing meta data about data sets. When I load an HDF5 file, I want to
read all the data set attributes for all the data sets. Unfortunately this
is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in place
of attributes, but Im trying to avoid that as I like my current H5 file
structure.
I want to switch to dense storage of attributes to speed up this process.
However, Im struggling to understand how to do this, specifically with
HDF5DOTNET.
*HDF5 Questions (not related to HDF5DOTNET):*
1. I understand that H5Pset_attr_phase_change property can be used with
creation of H5Files. Is this the general method for using dense attribute
storage or is there a more explicit method to use when creating attributes
(or datasets/groups)?
*HDF5DOTNET Questions:*
1. I could not find any any wrapper functions for H5Pset_attr_phase_change
in HDF5DOTNET. Is there an equivalent function or some method for ensure
dense attribute storage which is currently supported.
Ive created a project using HDF5DOTNET and rely heavily on attributes for
storing meta data about data sets. When I load an HDF5 file, I want to
read all the data set attributes for all the data sets. Unfortunately this
is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in
place of attributes, but Im trying to avoid that as I like my current H5
file structure.
I want to switch to dense storage of attributes to speed up this process.
However, Im struggling to understand how to do this, specifically with
HDF5DOTNET.
*HDF5 Questions (not related to HDF5DOTNET):*
1. I understand that H5Pset_attr_phase_change property can be used
with creation of H5Files. Is this the general method for using dense
attribute storage or is there a more explicit method to use when creating
attributes (or datasets/groups)?
*HDF5DOTNET Questions:*
1. I could not find any any wrapper functions for H5Pset_attr_phase_change
in HDF5DOTNET. Is there an equivalent function or some method for ensure
dense attribute storage which is currently supported.
Nick, how are you? In order to take advantage of dense attribute storage you must
use the latest version of the file format when creating objects. Use H5Pset_libver_bounds
with a libver_low of H5F_LIBVER_18 (or H5F_LIBVER_LATEST).
Neither method (H5Pset_libver_bounds, H5Pset_attr_phase_change) was included in
HDF5DotNet. However, it will be included in the forthcoming HDF.PInvoke set of bindings.
Ive created a project using HDF5DOTNET and rely heavily on attributes for storing meta data about data sets. When I load an HDF5 file, I want to read all the data set attributes for all the data sets. Unfortunately this is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in place of attributes, but Im trying to avoid that as I like my current H5 file structure.
I want to switch to dense storage of attributes to speed up this process. However, Im struggling to understand how to do this, specifically with HDF5DOTNET.
HDF5 Questions (not related to HDF5DOTNET):
1. I understand that H5Pset_attr_phase_change property can be used with creation of H5Files. Is this the general method for using dense attribute storage or is there a more explicit method to use when creating attributes (or datasets/groups)?
HDF5DOTNET Questions:
1. I could not find any any wrapper functions for H5Pset_attr_phase_change in HDF5DOTNET. Is there an equivalent function or some method for ensure dense attribute storage which is currently supported.
The HDF5.NET library is far from complete. But if a function you need is not there, you can add it and recompile. The existing functions are templates to whatever functionality you need to add.
Ive created a project using HDF5DOTNET and rely heavily on attributes for storing meta data about data sets. When I load an HDF5 file, I want to read all the data set attributes for all the data sets. Unfortunately this is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in place of attributes, but Im trying to avoid that as I like my current H5 file structure.
I want to switch to dense storage of attributes to speed up this process. However, Im struggling to understand how to do this, specifically with HDF5DOTNET.
HDF5 Questions (not related to HDF5DOTNET):
1. I understand that H5Pset_attr_phase_change property can be used with creation of H5Files. Is this the general method for using dense attribute storage or is there a more explicit method to use when creating attributes (or datasets/groups)?
HDF5DOTNET Questions:
1. I could not find any any wrapper functions for H5Pset_attr_phase_change in HDF5DOTNET. Is there an equivalent function or some method for ensure dense attribute storage which is currently supported.
There is a link at the bottom of every e-mail from the list via which you
can remove yourself. You probably have to request a password reset first
and then log in and delete your subscription.
Ive created a project using HDF5DOTNET and rely heavily on attributes for
storing meta data about data sets. When I load an HDF5 file, I want to
read all the data set attributes for all the data sets. Unfortunately this
is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in
place of attributes, but Im trying to avoid that as I like my current H5
file structure.
I want to switch to dense storage of attributes to speed up this
process. However, Im struggling to understand how to do this, specifically
with HDF5DOTNET.
*HDF5 Questions (not related to HDF5DOTNET):*
1. I understand that H5Pset_attr_phase_change property can be used
with creation of H5Files. Is this the general method for using dense
attribute storage or is there a more explicit method to use when creating
attributes (or datasets/groups)?
*HDF5DOTNET Questions:*
1. I could not find any any wrapper functions for H5Pset_attr_phase_change
in HDF5DOTNET. Is there an equivalent function or some method for ensure
dense attribute storage which is currently supported.
Thanks so much for getting back with me. Looks like Ill be re-writing some
of my code to avoid using attributes for the portion of the code which is
running slow.
Ive created a project using HDF5DOTNET and rely heavily on attributes for
storing meta data about data sets. When I load an HDF5 file, I want to
read all the data set attributes for all the data sets. Unfortunately this
is very slow when I have a large number of data sets.
Firstly, I understand that I could re-write my code using datasets in
place of attributes, but Im trying to avoid that as I like my current H5
file structure.
I want to switch to dense storage of attributes to speed up this process.
However, Im struggling to understand how to do this, specifically with
HDF5DOTNET.
*HDF5 Questions (not related to HDF5DOTNET):*
1. I understand that H5Pset_attr_phase_change property can be used
with creation of H5Files. Is this the general method for using dense
attribute storage or is there a more explicit method to use when creating
attributes (or datasets/groups)?
*HDF5DOTNET Questions:*
1. I could not find any any wrapper functions
for H5Pset_attr_phase_change in HDF5DOTNET. Is there an equivalent
function or some method for ensure dense attribute storage which is
currently supported.
