Indexing and Fast-Query API?

What happened to Fast-Query API?

Is there anyone on the list who knows more?

Are there alternatives to Fast-Query available?

Regards
Roland

···

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

Hi,
Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is.
regards- Dominik

···

--
Dominik Szczerba, PhD
Computer Vision Lab CH-8092 Zurich
http://www.vision.ee.ethz.ch/~domi

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

A Monday 07 April 2008, Roland Schwarz escrigué:

What happened to Fast-Query API?

Is there anyone on the list who knows more?

As fas as I know, FastQuery was an implementation of FastBit algorithms
(based on bitmaps) on top of HDF5. Unfortunately, it seems that they
never released something publicly in a formal way. Right now, it seems
to me that FastBit is using a pretty simple format to keep indexes that
doesn't need HDF5 (nor any other standard format).

Are there alternatives to Fast-Query available?

It depends on what kind of indexing are you after. In [1]_ you can see
another bitmap implementation, but I've never tried it (>300 MB of tar
file looks somewhat scary to my eyes). This seems a prototype anyway.

..[1] http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html

In [2]_ there is our own implementation on top of HDF5 that is based on
OPSI (Optimized Partially Sorted Indexes) technology. This one is for
the Python language only, though.

..[2] http://www.carabos.com/products/pytables-pro

Also, Quincey said in this very same list that The HDF Group does have
some funding to implement "production level" indexing features within
the HDF5 distribution. Perhaps he can provide more details about this.

Hope it helps,

···

--

0,0< Francesc Altet http://www.carabos.com/

V V Cárabos Coop. V. Enjoy Data
"-"

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

The easiest thing to do is to add a rule into your mail reader to look for hdf-forum@hdgroup.org and have it automatically move emails with that address to another folder. Then you can look at the hdf emails at your leisure in it own folder. I do this for many different emails which keeps my main box from getting too cluttered.

Cheers,

Allen

Allen Sanderson
SCI Institute
University of Utah
www.sci.utah.edu

···

On Apr 7, 2008, at 8:30 AM, Dominik Szczerba wrote:

Hi,
Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is.
regards- Dominik
--
Dominik Szczerba, PhD
Computer Vision Lab CH-8092 Zurich
http://www.vision.ee.ethz.ch/~domi

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

Yes I know this, however if I redirect some mails to folders based on rules then I often never read them at the end. In any case, I think tagging ML messages is pretty much a very common practice, is it not?
bye
Dominik

Allen Sanderson wrote:

···

The easiest thing to do is to add a rule into your mail reader to look for hdf-forum@hdgroup.org and have it automatically move emails with that address to another folder. Then you can look at the hdf emails at your leisure in it own folder. I do this for many different emails which keeps my main box from getting too cluttered.

Cheers,

Allen

Allen Sanderson
SCI Institute
University of Utah
www.sci.utah.edu

On Apr 7, 2008, at 8:30 AM, Dominik Szczerba wrote:

Hi,
Would it not make sense to tag the emails from this ML as [hdf5] or something? I find it sometimes quite confusing at a first look what the message is.
regards- Dominik
--Dominik Szczerba, PhD
Computer Vision Lab CH-8092 Zurich
http://www.vision.ee.ethz.ch/~domi

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

--
Dominik Szczerba, PhD
Computer Vision Lab CH-8092 Zurich
http://www.vision.ee.ethz.ch/~domi

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

YES

···

2008/4/7, Dominik Szczerba <domi@vision.ee.ethz.ch>:

Hi,
Would it not make sense to tag the emails from this ML as [hdf5] or
something? I find it sometimes quite confusing at a first look what the
message is.
regards- Dominik
--
Dominik Szczerba, PhD
Computer Vision Lab CH-8092 Zurich
http://www.vision.ee.ethz.ch/~domi <http://www.vision.ee.ethz.ch/~domi>

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to
hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

A Monday 07 April 2008, Roland Schwarz escrigué:

What happened to Fast-Query API?

Is there anyone on the list who knows more?

As fas as I know, FastQuery was an implementation of FastBit algorithms
(based on bitmaps) on top of HDF5. Unfortunately, it seems that they
never released something publicly in a formal way. Right now, it seems
to me that FastBit is using a pretty simple format to keep indexes that
doesn't need HDF5 (nor any other standard format).

  Here's the URL for FastBit: http://sdm.lbl.gov/fastbit/

Are there alternatives to Fast-Query available?

It depends on what kind of indexing are you after. In [1]_ you can see
another bitmap implementation, but I've never tried it (>300 MB of tar
file looks somewhat scary to my eyes). This seems a prototype anyway.

..[1] http://www.hdfgroup.uiuc.edu/RFC/HDF5/hdf5Indexing/bitmaps.html

In [2]_ there is our own implementation on top of HDF5 that is based on
OPSI (Optimized Partially Sorted Indexes) technology. This one is for
the Python language only, though.

..[2] http://www.carabos.com/products/pytables-pro

Also, Quincey said in this very same list that The HDF Group does have
some funding to implement "production level" indexing features within
the HDF5 distribution. Perhaps he can provide more details about this.

  We do have some funding to work on some indexing support within the HDF5 distribution. We're pretty early on this right now though, so I'll send more information as we get further along.

  Quincey

···

On Apr 7, 2008, at 10:15 AM, Francesc Altet wrote:

Hope it helps,

--

0,0< Francesc Altet http://www.carabos.com/

V V Cárabos Coop. V. Enjoy Data
"-"

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

Quincey Koziol wrote:

    We do have some funding to work on some indexing support within the
HDF5 distribution.

Good to hear!

We're pretty early on this right now though, so I'll
send more information as we get further along.

We are currently in evaluation stage, so I will eagerly wait
until such information becomes available.

Thank you.

···

--
_________________________________________
  _ _ | Roland Schwarz
>_)(_ | aka. speedsnail
> \__) | mailto:roland.schwarz@chello.at
________| http://www.blackspace.at