HDF5 filesize

Hdf-forum archives
1

We have recently switchws our data format from HDF4 to HDF5 (via NETCDF4).

The filesize has increased by nearly a factor of 5:

HDF4: 170873864 S20070012007004.L3b_4D_ST93.main
HDF5: 905223847 S20070012007004.L3b_4D_ST97.main

Using compressions helps somewhat, the factor goes to 2, however is there
a simple explanation why HDF5 files are significantly larger than HDF4 files when essentially storing the same information?

···

=========================
Joel Gales
Futuretech Corp.

OBPG Code 616.0
Phone: (301) 286-1403
FAX: (301) 286-0268

Bin Globally Map Locally

2

Hi Joel,

Could you provide sample files for us? I will send you a separate email on how to upload your files. Out of my head I think it is probably due to the chunking size and the compression settings. I can tell you more when I can see the real files.

Thanks,

Kent

···

-----Original Message-----
From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Joel Gales
Sent: Wednesday, April 02, 2014 8:55 AM
To: hdf-forum@lists.hdfgroup.org
Cc: Bryan Franz; sean bailey
Subject: [Hdf-forum] HDF5 filesize

We have recently switchws our data format from HDF4 to HDF5 (via NETCDF4).

The filesize has increased by nearly a factor of 5:

HDF4: 170873864 S20070012007004.L3b_4D_ST93.main
HDF5: 905223847 S20070012007004.L3b_4D_ST97.main

Using compressions helps somewhat, the factor goes to 2, however is there a simple explanation why HDF5 files are significantly larger than HDF4 files when essentially storing the same information?

=========================
Joel Gales
Futuretech Corp.

OBPG Code 616.0
Phone: (301) 286-1403
FAX: (301) 286-0268

Bin Globally Map Locally

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org