Table vs DataSet vs PacketTable

Hdf-forum archives
1

Hello All,

I'm new to HDF5 file format and I didn't see the difference between Table,
DataSet and PacketTable? what's the difference between all those structure?
And what every one stand for?

Thank you in advance.
Regards,
Ayoub

<https://mailtrack.io/install?source=signature&lang=en&referral=ayb.serti@gmail.com&idSignature=22>

···

Sent with Mailtrack

2

Datasets are the lowest level.

Tables build on datasets and have an API to work with them. Still just a
dataset as an implementation.

PacketTables are an optimized Table api designed for frequent appending
such as in a real time application. The implementation trick they use is
they simply keep the table api opened underneath so each append only
changes the dataset size and then writes. I like 'em for most applications
as you're no worse off than any of the other other APIs at worse, but that
you can easily write more data to your dataset is quite nice.

-Jason

···

On Sun, Feb 12, 2017 at 1:23 PM, Serti Ayoub <ayb.serti@gmail.com> wrote:

Hello All,

I'm new to HDF5 file format and I didn't see the difference between Table,
DataSet and PacketTable? what's the difference between all those structure?
And what every one stand for?

Thank you in advance.
Regards,
Ayoub

Sent with Mailtrack
<https://mailtrack.io/install?source=signature&lang=en&referral=ayb.serti@gmail.com&idSignature=22>

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

3

Thank you Jason,

It's more clear now. So, I can save data using dataset API and read it with
Table or PacketTable API?

-Ayb

···

2017-02-13 14:39 GMT+00:00 Jason Newton <nevion@gmail.com>:

Datasets are the lowest level.

Tables build on datasets and have an API to work with them. Still just a
dataset as an implementation.

PacketTables are an optimized Table api designed for frequent appending
such as in a real time application. The implementation trick they use is
they simply keep the table api opened underneath so each append only
changes the dataset size and then writes. I like 'em for most applications
as you're no worse off than any of the other other APIs at worse, but that
you can easily write more data to your dataset is quite nice.

-Jason

On Sun, Feb 12, 2017 at 1:23 PM, Serti Ayoub <ayb.serti@gmail.com> wrote:

Hello All,

I'm new to HDF5 file format and I didn't see the difference between
Table, DataSet and PacketTable? what's the difference between all those
structure? And what every one stand for?

Thank you in advance.
Regards,
Ayoub

Sent with Mailtrack
<https://mailtrack.io/install?source=signature&lang=en&referral=ayb.serti@gmail.com&idSignature=22>

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

4

I wouldn’t bet on it. You can do it the other way around though, write as a Table or PacketTable and read as a Dataset.

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Serti Ayoub
Sent: Tuesday, February 14, 2017 9:41 AM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] Table vs DataSet vs PacketTable

Thank you Jason,

It's more clear now. So, I can save data using dataset API and read it with Table or PacketTable API?

-Ayb

2017-02-13 14:39 GMT+00:00 Jason Newton <nevion@gmail.com<mailto:nevion@gmail.com>>:
Datasets are the lowest level.

Tables build on datasets and have an API to work with them. Still just a dataset as an implementation.

PacketTables are an optimized Table api designed for frequent appending such as in a real time application. The implementation trick they use is they simply keep the table api opened underneath so each append only changes the dataset size and then writes. I like 'em for most applications as you're no worse off than any of the other other APIs at worse, but that you can easily write more data to your dataset is quite nice.

-Jason

On Sun, Feb 12, 2017 at 1:23 PM, Serti Ayoub <ayb.serti@gmail.com<mailto:ayb.serti@gmail.com>> wrote:
Hello All,

I'm new to HDF5 file format and I didn't see the difference between Table, DataSet and PacketTable? what's the difference between all those structure? And what every one stand for?

Thank you in advance.
Regards,
Ayoub

[https://s3-eu-west-1.amazonaws.com/mailtrack-crx/icon-signature.png] Sent with Mailtrack<https://mailtrack.io/install?source=signature&lang=en&referral=ayb.serti@gmail.com&idSignature=22>
[https://mailtrack.io/trace/mail/5e02a9bc8d36347bf827d9f0dceb2a00e57d6b1a.png?u=1251302]

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

5

Also, the PT/TB APIs are high-level HDF5 calls, meaning they use a series of low-level HDF5 APIs to create the PT/TB. If you are curious to see what low-level HDF5 APIs are needed, for example, to create a PT, then you can look in the HDF5 source, hl/src/H5PT.c —> H5PTcreate.

Scot

···

On Feb 14, 2017, at 1:36 PM, Mitchell, Scott <SMITCH12@harris.com<mailto:SMITCH12@harris.com>> wrote:

I wouldn’t bet on it. You can do it the other way around though, write as a Table or PacketTable and read as a Dataset.

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Serti Ayoub
Sent: Tuesday, February 14, 2017 9:41 AM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] Table vs DataSet vs PacketTable

Thank you Jason,

It's more clear now. So, I can save data using dataset API and read it with Table or PacketTable API?

-Ayb

2017-02-13 14:39 GMT+00:00 Jason Newton <nevion@gmail.com<mailto:nevion@gmail.com>>:
Datasets are the lowest level.

Tables build on datasets and have an API to work with them. Still just a dataset as an implementation.

PacketTables are an optimized Table api designed for frequent appending such as in a real time application. The implementation trick they use is they simply keep the table api opened underneath so each append only changes the dataset size and then writes. I like 'em for most applications as you're no worse off than any of the other other APIs at worse, but that you can easily write more data to your dataset is quite nice.

-Jason

On Sun, Feb 12, 2017 at 1:23 PM, Serti Ayoub <ayb.serti@gmail.com<mailto:ayb.serti@gmail.com>> wrote:
Hello All,

I'm new to HDF5 file format and I didn't see the difference between Table, DataSet and PacketTable? what's the difference between all those structure? And what every one stand for?

Thank you in advance.
Regards,
Ayoub

[https://s3-eu-west-1.amazonaws.com/mailtrack-crx/icon-signature.png] Sent with Mailtrack<https://mailtrack.io/install?source=signature&lang=en&referral=ayb.serti@gmail.com&idSignature=22>
[https://mailtrack.io/trace/mail/5e02a9bc8d36347bf827d9f0dceb2a00e57d6b1a.png?u=1251302]

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5