indexing HDF5 files

Hi there,

Apologies for this rather open-ended question:

Does the group have any advice on indexing strategies for HDF5 files?

I realize hdf5 groups provide some indexing capability (as a recent post
addressed), but

was hoping for something more along the lines of the ideas listed here:

http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/

http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html

I get the sense that these projects are not yet mature.

Do folks know of any other resources?

Thanks - any thoughts would be greatly appreciated.

Michael Kamal

917-779-7076

Chicago Trading Company

This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.

pytables - http://www.pytables.org/moin - for the fastest indexing look at the commercial version.

-Roy M.

···

On Jun 24, 2009, at 2:19 PM, Michael Kamal wrote:

Hi there,

Apologies for this rather open-ended question:
Does the group have any advice on indexing strategies for HDF5 files?

I realize hdf5 groups provide some indexing capability (as a recent post addressed), but
was hoping for something more along the lines of the ideas listed here:

http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/

http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html

I get the sense that these projects are not yet mature.

Do folks know of any other resources?

Thanks – any thoughts would be greatly appreciated.

Michael Kamal
917-779-7076
Chicago Trading Company

This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.

**********************
"The contents of this message do not reflect any position of the U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: Roy.Mendelssohn@noaa.gov (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

Thanks -- was not aware of this.

Will check out.

···

-----Original Message-----
From: Roy Mendelssohn [mailto:Roy.Mendelssohn@noaa.gov]
Sent: Wednesday, June 24, 2009 5:23 PM
To: Michael Kamal
Cc: hdf-forum@hdfgroup.org
Subject: Re: [hdf-forum] indexing HDF5 files

pytables - http://www.pytables.org/moin - for the fastest indexing
look at the commercial version.

-Roy M.
On Jun 24, 2009, at 2:19 PM, Michael Kamal wrote:

Hi there,

Apologies for this rather open-ended question:
Does the group have any advice on indexing strategies for HDF5 files?

I realize hdf5 groups provide some indexing capability (as a recent
post addressed), but
was hoping for something more along the lines of the ideas listed
here:

http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/

http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html

I get the sense that these projects are not yet mature.

Do folks know of any other resources?

Thanks - any thoughts would be greatly appreciated.

Michael Kamal
917-779-7076
Chicago Trading Company

This message is intended only for the personal and confidential use
of the recipients named above. If the reader of this email is not
the intended recipient, you have received this email in error and
any review, dissemination, distribution or copying is strictly
prohibited. If you have received this email in error, please notify
the sender immediately by return email and permanently delete the
copy you received. This message is provided for informational
purposes and should not be construed as a solicitation or offer to
buy or sell any securities or related financial instruments. Neither
CTC Holdings nor any affiliates (CTC) are responsible for any
recommendation, solicitation, offer or agreement or any information
about any transaction, customer account or account activity that may
be attached to or contained in this communication. CTC accepts no
liability for any content contained in the email, or any errors or
omissions arising as a result of e-mail transmission. Any opinions
contained in this email constitute the sender's best judgment at
this time and are subject to change without notice. CTC London
Limited is authorized and regulated by the Financial Services
Authority.

**********************
"The contents of this message do not reflect any position of the U.S.
Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: Roy.Mendelssohn@noaa.gov (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"

This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.