I'm trying to use hdf5 to save a tree based object. Each node in the tree is saved as a group, each leaf is saved as a dataset and some metadata are saved as attributes appended to the group.
The saving time was a little bit unexpected to me. For example, I saved an object to hdf5 which created 46074 groups in 3.484 seconds, 28751 dataset in 9.298 seconds and 132195 attributes in 2.75 seconds. The datasets were all empty. Besides, the generated .h5 file took almost 60MB spaces.
I'm just wondering whether this performance is normal for hdf5.
Just out of curiosity: did you try to do the same in the file system as well,
i.e. creating 46074 directories? I would expect it would take longer than 3.5secs,
as HDF5 should be of higher performance, but it might be comparable since HDF5 is
basically a file system within a file (with much more features of course).
Werner
···
On Tue, 10 Nov 2009 09:17:51 -0600, Yuqing Zhang <yz@anybodytech.com> wrote:
Hi all,
I'm trying to use hdf5 to save a tree based object. Each node in the tree is saved as a group, each leaf is saved as a dataset and some metadata are saved as attributes appended to the group.
The saving time was a little bit unexpected to me. For example, I saved an object to hdf5 which created 46074 groups in 3.484 seconds, 28751 dataset in 9.298 seconds and 132195 attributes in 2.75 seconds. The datasets were all empty. Besides, the generated .h5 file took almost 60MB spaces.
I'm just wondering whether this performance is normal for hdf5.
--
___________________________________________________________________________
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
