# Indexing and Fast-Query API? **URL:** \ **Category:** Hdf-forum archives\ **Created:** [April 7, 2008, 2:27pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981 "2008-04-07T14:27:19Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Roland\_Schwarz](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/r/bc8723/32.png) [@Roland\_Schwarz](https://forum.hdfgroup.org/u/Roland_Schwarz)\ **Post date:** [April 7, 2008, 2:27pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/1 "2008-04-07T14:27:19Z")
What happened to Fast-Query API? Is there anyone on the list who knows more? Are there alternatives to Fast-Query available? Regards Roland > **···** > > ---------------------------------------------------------------------- > This mailing list is for HDF software users discussion. > To subscribe to this list, send a message to [hdf-forum-subscribe@hdfgroup.org](mailto:hdf-forum-subscribe@hdfgroup.org). > To unsubscribe, send a message to [hdf-forum-unsubscribe@hdfgroup.org](mailto:hdf-forum-unsubscribe@hdfgroup.org). ---
**Author:** ![Dominik\_Szczerba](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/d/91b2a8/32.png) [@Dominik\_Szczerba](https://forum.hdfgroup.org/u/Dominik_Szczerba)\ **Post date:** [April 7, 2008, 2:30pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/2 "2008-04-07T14:30:09Z")
Hi, Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is. regards- Dominik > **···** > > -- > Dominik Szczerba, PhD > Computer Vision Lab CH-8092 Zurich > [http://www.vision.ee.ethz.ch/~domi](http://www.vision.ee.ethz.ch/~domi) > > ---------------------------------------------------------------------- > This mailing list is for HDF software users discussion. > To subscribe to this list, send a message to [hdf-forum-subscribe@hdfgroup.org](mailto:hdf-forum-subscribe@hdfgroup.org). > To unsubscribe, send a message to [hdf-forum-unsubscribe@hdfgroup.org](mailto:hdf-forum-unsubscribe@hdfgroup.org). ---
**Author:** ![Francesc\_Altet](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/f/7feea3/32.png) [@Francesc\_Altet](https://forum.hdfgroup.org/u/Francesc_Altet)\ **Post date:** [April 7, 2008, 3:15pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/3 "2008-04-07T15:15:49Z")
A Monday 07 April 2008, Roland Schwarz escrigué: > What happened to Fast-Query API? > > Is there anyone on the list who knows more? As fas as I know, FastQuery was an implementation of FastBit algorithms (based on bitmaps) on top of HDF5. Unfortunately, it seems that they never released something publicly in a formal way. Right now, it seems to me that FastBit is using a pretty simple format to keep indexes that doesn't need HDF5 (nor any other standard format). > Are there alternatives to Fast-Query available? It depends on what kind of indexing are you after. In [1]\_ you can see another bitmap implementation, but I've never tried it (\>300 MB of tar file looks somewhat scary to my eyes). This seems a prototype anyway. ..[1] [http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html](http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html) In [2]\_ there is our own implementation on top of HDF5 that is based on OPSI (Optimized Partially Sorted Indexes) technology. This one is for the Python language only, though. ..[2] [http://www.carabos.com/products/pytables-pro](http://www.carabos.com/products/pytables-pro) Also, Quincey said in this very same list that The HDF Group does have some funding to implement "production level" indexing features within the HDF5 distribution. Perhaps he can provide more details about this. Hope it helps, > **···** > > -- > > > 0,0\< Francesc Altet [http://www.carabos.com/](http://www.carabos.com/) > > V V Cárabos Coop. V. Enjoy Data > "-" > > ---------------------------------------------------------------------- > This mailing list is for HDF software users discussion. > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. ---
**Author:** ![Allen\_Sanderson](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/a/b5ac83/32.png) [@Allen\_Sanderson](https://forum.hdfgroup.org/u/Allen_Sanderson)\ **Post date:** [April 7, 2008, 8:05pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/4 "2008-04-07T20:05:32Z")
The easiest thing to do is to add a rule into your mail reader to look for hdf-forum@hdgroup.org and have it automatically move emails with that address to another folder. Then you can look at the hdf emails at your leisure in it own folder. I do this for many different emails which keeps my main box from getting too cluttered. Cheers, Allen Allen Sanderson SCI Institute University of Utah www.sci.utah.edu > **···** > > On Apr 7, 2008, at 8:30 AM, Dominik Szczerba wrote: > > > Hi, > > Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is. > > regards- Dominik > > -- > > Dominik Szczerba, PhD > > Computer Vision Lab CH-8092 Zurich > > [http://www.vision.ee.ethz.ch/~domi](http://www.vision.ee.ethz.ch/~domi) > > > > ---------------------------------------------------------------------- > > This mailing list is for HDF software users discussion. > > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. ---
**Author:** ![Dominik\_Szczerba](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/d/91b2a8/32.png) [@Dominik\_Szczerba](https://forum.hdfgroup.org/u/Dominik_Szczerba)\ **Post date:** [April 7, 2008, 8:08pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/5 "2008-04-07T20:08:42Z")
Yes I know this, however if I redirect some mails to folders based on rules then I often never read them at the end. In any case, I think tagging ML messages is pretty much a very common practice, is it not? bye Dominik Allen Sanderson wrote: > **···** > > > The easiest thing to do is to add a rule into your mail reader to look for hdf-forum@hdgroup.org and have it automatically move emails with that address to another folder. Then you can look at the hdf emails at your leisure in it own folder. I do this for many different emails which keeps my main box from getting too cluttered. > > > > Cheers, > > > > Allen > > > > Allen Sanderson > > SCI Institute > > University of Utah > > www.sci.utah.edu > > > > On Apr 7, 2008, at 8:30 AM, Dominik Szczerba wrote: > > > > > Hi, > > > Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is. > > > regards- Dominik > > > --Dominik Szczerba, PhD > > > Computer Vision Lab CH-8092 Zurich > > > [http://www.vision.ee.ethz.ch/~domi](http://www.vision.ee.ethz.ch/~domi) > > > > > > ---------------------------------------------------------------------- > > > This mailing list is for HDF software users discussion. > > > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > > > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. > > -- > Dominik Szczerba, PhD > Computer Vision Lab CH-8092 Zurich > [http://www.vision.ee.ethz.ch/~domi](http://www.vision.ee.ethz.ch/~domi) > > ---------------------------------------------------------------------- > This mailing list is for HDF software users discussion. > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. ---
**Author:** ![Dimitris\_Servis](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/d/839c29/32.png) [@Dimitris\_Servis](https://forum.hdfgroup.org/u/Dimitris_Servis)\ **Post date:** [April 7, 2008, 7:23pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/6 "2008-04-07T19:23:36Z")
YES > **···** > > 2008/4/7, Dominik Szczerba \: > > > Hi, > > Would it not make sense to tag the emails from this ML as [hdf5] or > > something? I find it sometimes quite confusing at a first look what the > > message is. > > regards- Dominik > > -- > > Dominik Szczerba, PhD > > Computer Vision Lab CH-8092 Zurich > > [http://www.vision.ee.ethz.ch/~domi](http://www.vision.ee.ethz.ch/~domi) \<[http://www.vision.ee.ethz.ch/~domi>](http://www.vision.ee.ethz.ch/%7Edomi>); > > > > ---------------------------------------------------------------------- > > This mailing list is for HDF software users discussion. > > To subscribe to this list, send a message to > > hdf-forum-subscribe@hdfgroup.org. > > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. ---
**Author:** ![Quincey\_Koziol](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/q/dbc845/32.png) [@Quincey\_Koziol](https://forum.hdfgroup.org/u/Quincey_Koziol)\ **Post date:** [April 8, 2008, 12:34pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/7 "2008-04-08T12:34:26Z")
> A Monday 07 April 2008, Roland Schwarz escrigué: > > > What happened to Fast-Query API? > > > > Is there anyone on the list who knows more? > > As fas as I know, FastQuery was an implementation of FastBit algorithms > (based on bitmaps) on top of HDF5. Unfortunately, it seems that they > never released something publicly in a formal way. Right now, it seems > to me that FastBit is using a pretty simple format to keep indexes that > doesn't need HDF5 (nor any other standard format).   Here's the URL for FastBit: [FastBit: An Efficient Compressed Bitmap Index Technology](http://sdm.lbl.gov/fastbit/) > > Are there alternatives to Fast-Query available? > > It depends on what kind of indexing are you after. In [1]\_ you can see > another bitmap implementation, but I've never tried it (\>300 MB of tar > file looks somewhat scary to my eyes). This seems a prototype anyway. > > ..[1] [http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html](http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html) > > In [2]\_ there is our own implementation on top of HDF5 that is based on > OPSI (Optimized Partially Sorted Indexes) technology. This one is for > the Python language only, though. > > ..[2] [http://www.carabos.com/products/pytables-pro](http://www.carabos.com/products/pytables-pro) > > Also, Quincey said in this very same list that The HDF Group does have > some funding to implement "production level" indexing features within > the HDF5 distribution. Perhaps he can provide more details about this.   We do have some funding to work on some indexing support within the HDF5 distribution. We're pretty early on this right now though, so I'll send more information as we get further along.   Quincey > **···** > > On Apr 7, 2008, at 10:15 AM, Francesc Altet wrote: > > > Hope it helps, > > > > -- > > > > > 0,0\< Francesc Altet [http://www.carabos.com/](http://www.carabos.com/) > > > > V V Cárabos Coop. V. Enjoy Data > > "-" > > > > ---------------------------------------------------------------------- > > This mailing list is for HDF software users discussion. > > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. > > ---------------------------------------------------------------------- > This mailing list is for HDF software users discussion. > To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org. > To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org. ---
**Author:** ![Roland\_Schwarz](https://forum.hdfgroup.org/letter_avatar_proxy/v4/letter/r/bc8723/32.png) [@Roland\_Schwarz](https://forum.hdfgroup.org/u/Roland_Schwarz)\ **Post date:** [April 9, 2008, 5:55pm UTC](https://forum.hdfgroup.org/t/indexing-and-fast-query-api/981/8 "2008-04-09T17:55:10Z")
Quincey Koziol wrote: >     We do have some funding to work on some indexing support within the > HDF5 distribution. Good to hear! > We're pretty early on this right now though, so I'll > send more information as we get further along. We are currently in evaluation stage, so I will eagerly wait until such information becomes available. Thank you. > **···** > > -- > \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ >   \_ \_ | Roland Schwarz > \>\_)(\_ | aka. speedsnail > \> \_\_) | mailto:roland.schwarz@chello.at > \_\_\_\_\_\_\_\_| [http://www.blackspace.at](http://www.blackspace.at)