In this document, we specify a REST interface for HDF5 data stores.
We describe HDF5 resources, URIs, and resource representations, and show
a simple example of how to use this interface to populate an HDF5 store.
We invite you to share your comments/thoughts via the forum or reply
directly
to gheber@hdfgroup.org . Please let us know, if you'd consider participating
in a trial and how you'd use an HDF5/REST interface with your data.
Bear in mind that this is version 0.1. Resource granularity and
representations
are based on our own experiments and a limited understanding of "real"
applications.
Your input is crucial to get this right!
Best regards,
G.
Gerd Heber | The HDF Group
Email: gheber@hdfgroup.org | 1800 South Oak Street
Work: (217) 531-6109 | Suite 203
Skype: gerd.heber | Champaign, IL 61820
The transplantation of a self-contained, natively formatted file
from a POSIX-compliant file system into an environment that favors
contiguous I/O on large blocks and penalizes or lacks small-scale
random I/O is a daunting task.
Sure sounds like you are talking about a parallel file system there!
==rob
···
On Tue, Jan 22, 2013 at 08:39:34AM -0600, Gerd Heber wrote:
In this document, we specify a REST interface for HDF5 data stores.
We describe HDF5 resources, URIs, and resource representations, and show
a simple example of how to use this interface to populate an HDF5 store.
--
Rob Latham
Mathematics and Computer Science Division
Argonne National Lab, IL USA
Rob, thanks for reading it and I can see your point.
I'll try to be more precise in the next revision.
My misery scale was modeled after Dante's circles of hell and
I'd place parallel file systems somewhere among the first
three (Limbo, Lust, Gluttony). That's still pretty comfy compared to
the poor souls caught on levels seven to nine (Violence, Fraud, Treachery).
Just picture yourself dropping an HDF5 file into something like HDFS
and hope to do anything useful (other than copy or delete) with it.
Best, G.
···
-----Original Message-----
From: Hdf-forum [mailto:hdf-forum-bounces@hdfgroup.org] On Behalf Of Rob
Latham
Sent: Thursday, January 24, 2013 2:52 PM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] RESTful HDF5
On Tue, Jan 22, 2013 at 08:39:34AM -0600, Gerd Heber wrote:
In this document, we specify a REST interface for HDF5 data stores.
We describe HDF5 resources, URIs, and resource representations, and
show a simple example of how to use this interface to populate an HDF5
store.
I was struck by this line in your introduction:
The transplantation of a self-contained, natively formatted file
from a POSIX-compliant file system into an environment that favors
contiguous I/O on large blocks and penalizes or lacks small-scale
random I/O is a daunting task.
Sure sounds like you are talking about a parallel file system there!
==rob
--
Rob Latham
Mathematics and Computer Science Division Argonne National Lab, IL USA
