# indexing HDF5 files

**URL:** <https://forum.hdfgroup.org/t/indexing-hdf5-files/1324>\
**Category:** Hdf-forum archives\
**Created:** [June 24, 2009, 9:19pm UTC](https://forum.hdfgroup.org/t/indexing-hdf5-files/1324 "2009-06-24T21:19:04Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Michael\_Kamal](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/m/a9adbd/32.png) [@Michael\_Kamal](https://forum.hdfgroup.org/u/Michael_Kamal)\
**Post date:** [June 24, 2009, 9:19pm UTC](https://forum.hdfgroup.org/t/indexing-hdf5-files/1324/1 "2009-06-24T21:19:04Z")

</div>

Hi there,

Apologies for this rather open-ended question:

Does the group have any advice on indexing strategies for HDF5 files?

I realize hdf5 groups provide some indexing capability (as a recent post  
addressed), but

was hoping for something more along the lines of the ideas listed here:

[http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/](http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/)

[http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html](http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html)

I get the sense that these projects are not yet mature.

Do folks know of any other resources?

Thanks - any thoughts would be greatly appreciated.

Michael Kamal

917-779-7076

Chicago Trading Company

This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.

---

<div class="post-metadata">

**Author:** ![roy.mendelssohn](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/r/57b2e6/32.png) [@roy.mendelssohn](https://forum.hdfgroup.org/u/roy.mendelssohn)\
**Post date:** [June 24, 2009, 9:23pm UTC](https://forum.hdfgroup.org/t/indexing-hdf5-files/1324/2 "2009-06-24T21:23:21Z")

</div>

pytables - [http://www.pytables.org/moin](http://www.pytables.org/moin) - for the fastest indexing look at the commercial version.

-Roy M.

> **···**
>
> On Jun 24, 2009, at 2:19 PM, Michael Kamal wrote:
> 
> > Hi there,
> > 
> > Apologies for this rather open-ended question:  
> > Does the group have any advice on indexing strategies for HDF5 files?
> > 
> > I realize hdf5 groups provide some indexing capability (as a recent post addressed), but  
> > was hoping for something more along the lines of the ideas listed here:
> > 
> > [http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/](http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/)
> > 
> > [http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html](http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html)
> > 
> > I get the sense that these projects are not yet mature.
> > 
> > Do folks know of any other resources?
> > 
> > Thanks – any thoughts would be greatly appreciated.
> > 
> > Michael Kamal  
> > 917-779-7076  
> > Chicago Trading Company
> > 
> > This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.
> 
> \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
> "The contents of this message do not reflect any position of the U.S. Government or NOAA."  
> \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
> Roy Mendelssohn  
> Supervisory Operations Research Analyst  
> NOAA/NMFS  
> Environmental Research Division  
> Southwest Fisheries Science Center  
> 1352 Lighthouse Avenue  
> Pacific Grove, CA 93950-2097
> 
> e-mail: Roy.Mendelssohn@noaa.gov (Note new e-mail address)  
> voice: (831)-648-9029  
> fax: (831)-648-8440  
> www: [http://www.pfeg.noaa.gov/](http://www.pfeg.noaa.gov/)
> 
> "Old age and treachery will overcome youth and skill."  
> "From those who have been given much, much will be expected"
> 
> ----------------------------------------------------------------------  
> This mailing list is for HDF software users discussion.  
> To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.  
> To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

---

<div class="post-metadata">

**Author:** ![Michael\_Kamal](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/m/a9adbd/32.png) [@Michael\_Kamal](https://forum.hdfgroup.org/u/Michael_Kamal)\
**Post date:** [June 24, 2009, 9:26pm UTC](https://forum.hdfgroup.org/t/indexing-hdf5-files/1324/3 "2009-06-24T21:26:47Z")

</div>

Thanks -- was not aware of this.

Will check out.

> **···**
>
> -----Original Message-----  
> From: Roy Mendelssohn [mailto:Roy.Mendelssohn@noaa.gov]  
> Sent: Wednesday, June 24, 2009 5:23 PM  
> To: Michael Kamal  
> Cc: hdf-forum@hdfgroup.org  
> Subject: Re: [hdf-forum] indexing HDF5 files
> 
> pytables - [http://www.pytables.org/moin](http://www.pytables.org/moin) - for the fastest indexing  
> look at the commercial version.
> 
> -Roy M.  
> On Jun 24, 2009, at 2:19 PM, Michael Kamal wrote:
> 
> > Hi there,
> > 
> > Apologies for this rather open-ended question:  
> > Does the group have any advice on indexing strategies for HDF5 files?
> > 
> > I realize hdf5 groups provide some indexing capability (as a recent  
> > post addressed), but  
> > was hoping for something more along the lines of the ideas listed  
> > here:
> > 
> > [http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/](http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/)
> > 
> > [http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html](http://www-vis.lbl.gov/Events/SC05/HDF5FastQuery/index.html)
> > 
> > I get the sense that these projects are not yet mature.
> > 
> > Do folks know of any other resources?
> > 
> > Thanks - any thoughts would be greatly appreciated.
> > 
> > Michael Kamal  
> > 917-779-7076  
> > Chicago Trading Company
> > 
> > This message is intended only for the personal and confidential use  
> > of the recipients named above. If the reader of this email is not  
> > the intended recipient, you have received this email in error and  
> > any review, dissemination, distribution or copying is strictly  
> > prohibited. If you have received this email in error, please notify  
> > the sender immediately by return email and permanently delete the  
> > copy you received. This message is provided for informational  
> > purposes and should not be construed as a solicitation or offer to  
> > buy or sell any securities or related financial instruments. Neither  
> > CTC Holdings nor any affiliates (CTC) are responsible for any  
> > recommendation, solicitation, offer or agreement or any information  
> > about any transaction, customer account or account activity that may  
> > be attached to or contained in this communication. CTC accepts no  
> > liability for any content contained in the email, or any errors or  
> > omissions arising as a result of e-mail transmission. Any opinions  
> > contained in this email constitute the sender's best judgment at  
> > this time and are subject to change without notice. CTC London  
> > Limited is authorized and regulated by the Financial Services  
> > Authority.
> 
> \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
> "The contents of this message do not reflect any position of the U.S.  
> Government or NOAA."  
> \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
> Roy Mendelssohn  
> Supervisory Operations Research Analyst  
> NOAA/NMFS  
> Environmental Research Division  
> Southwest Fisheries Science Center  
> 1352 Lighthouse Avenue  
> Pacific Grove, CA 93950-2097
> 
> e-mail: Roy.Mendelssohn@noaa.gov (Note new e-mail address)  
> voice: (831)-648-9029  
> fax: (831)-648-8440  
> www: [http://www.pfeg.noaa.gov/](http://www.pfeg.noaa.gov/)
> 
> "Old age and treachery will overcome youth and skill."  
> "From those who have been given much, much will be expected"
> 
> This message is intended only for the personal and confidential use of the recipients named above. If the reader of this email is not the intended recipient, you have received this email in error and any review, dissemination, distribution or copying is strictly prohibited. If you have received this email in error, please notify the sender immediately by return email and permanently delete the copy you received. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. Neither CTC Holdings nor any affiliates (CTC) are responsible for any recommendation, solicitation, offer or agreement or any information about any transaction, customer account or account activity that may be attached to or contained in this communication. CTC accepts no liability for any content contained in the email, or any errors or omissions arising as a result of e-mail transmission. Any opinions contained in this email constitute the sender's best judgment at this time and are subject to change without notice. CTC London Limited is authorized and regulated by the Financial Services Authority.
> 
> ----------------------------------------------------------------------  
> This mailing list is for HDF software users discussion.  
> To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.  
> To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.
