Encryption of Data within HDF5?

Hdf-forum archives
1

Hi,

I am interested in encrypting using private/public keys within HDF5
controlling access to certain portions of the data. Any thoughts or
directions to consider for this type of requirement?

Sincerely,

Jim Robertson

2

Hi James,

that's a tough one... I implemented something similar by encrypting the
metadata using a special driver, but all the metadata, not parts of them and
still it's pretty difficult to make it work...

HTH

-- dimitris

···

2009/6/23 James Robertson <jrobertson@clearhaven.com>

Hi,

I am interested in encrypting using private/public keys within HDF5
controlling access to certain portions of the data. Any thoughts or
directions to consider for this type of requirement?

Sincerely,

Jim Robertson

3

hm, it would sound simple to add a filter to the filtering pipeline
that does the encryption/decryption,

That were applicable to selected data sets only, leaving the metadata in cleartext.

We had been thinking about doing such here, but not really implemented it so far.

  Werner

···

On Tue, 23 Jun 2009 14:10:58 -0500, Dimitris Servis <servisster@gmail.com> wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the
metadata using a special driver, but all the metadata, not parts of them and
still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>

Hi,

I am interested in encrypting using private/public keys within HDF5
controlling access to certain portions of the data. Any thoughts or
directions to consider for this type of requirement?

Sincerely,

Jim Robertson

--
___________________________________________________________________________
Dr. Werner Benger <werner@cct.lsu.edu> Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
239 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

4

Wouldn't that be a matter of copying what the zip/szip filters are doing and then implementing with your choice of encryption code?

Or am I off in la-la land.. ?

···

_________________________________________________________
Mike Jackson mike.jackson@bluequartz.net
BlueQuartz Software www.bluequartz.net
Principal Software Engineer Dayton, Ohio

On Jun 23, 2009, at 3:10 PM, Dimitris Servis wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the metadata using a special driver, but all the metadata, not parts of them and still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>
Hi,

I am interested in encrypting using private/public keys within HDF5 controlling access to certain portions of the data. Any thoughts or directions to consider for this type of requirement?

Sincerely,

Jim Robertson

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

5

Hi Michael

It really depends what you want to do. The filters are applied on the
datasets, which means that in effect, you have to process all data, that is
a performance killer. At the VFL level, you know which data is which and you
can filter some metadata but then you do that for all metadata...

HTH

-- dimitris

···

2009/6/23 Michael Jackson <mike.jackson@bluequartz.net>

Wouldn't that be a matter of copying what the zip/szip filters are doing
and then implementing with your choice of encryption code?

Or am I off in la-la land.. ?
_________________________________________________________
Mike Jackson mike.jackson@bluequartz.net
BlueQuartz Software www.bluequartz.net
Principal Software Engineer Dayton, Ohio

On Jun 23, 2009, at 3:10 PM, Dimitris Servis wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the
metadata using a special driver, but all the metadata, not parts of them and
still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>
Hi,

I am interested in encrypting using private/public keys within HDF5
controlling access to certain portions of the data. Any thoughts or
directions to consider for this type of requirement?

Sincerely,

Jim Robertson

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to
hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

6

Hi Dimitris,

Hi Michael

It really depends what you want to do. The filters are applied on the datasets, which means that in effect, you have to process all data, that is a performance killer. At the VFL level, you know which data is which and you can filter some metadata but then you do that for all metadata...

  In the next major HDF5 release, we are planning on allowing filters to be applied to the heaps that store the links for groups. This should mitigate some of the perform concerns for an encryption filter, while allowing some of the metadata in a file to be concealed.

  Quincey

···

On Jun 23, 2009, at 2:44 PM, Dimitris Servis wrote:

HTH

-- dimitris

2009/6/23 Michael Jackson <mike.jackson@bluequartz.net>
Wouldn't that be a matter of copying what the zip/szip filters are doing and then implementing with your choice of encryption code?

Or am I off in la-la land.. ?
_________________________________________________________
Mike Jackson mike.jackson@bluequartz.net
BlueQuartz Software www.bluequartz.net
Principal Software Engineer Dayton, Ohio

On Jun 23, 2009, at 3:10 PM, Dimitris Servis wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the metadata using a special driver, but all the metadata, not parts of them and still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>
Hi,

I am interested in encrypting using private/public keys within HDF5 controlling access to certain portions of the data. Any thoughts or directions to consider for this type of requirement?

Sincerely,

Jim Robertson

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

7

Hi Dimitris,

Hi Michael

It really depends what you want to do. The filters are applied on the datasets, which means that in effect, you have to process all data, that is a performance killer. At the VFL level, you know which data is which and you can filter some metadata but then you do that for all metadata...

  In the next major HDF5 release, we are planning on allowing filters to be applied to the heaps that store the links for groups. This should mitigate some of the perform concerns for an encryption filter, while allowing some of the metadata in a file to be concealed.

  Quincey

···

On Jun 23, 2009, at 2:44 PM, Dimitris Servis wrote:

HTH

-- dimitris

2009/6/23 Michael Jackson <mike.jackson@bluequartz.net>
Wouldn't that be a matter of copying what the zip/szip filters are doing and then implementing with your choice of encryption code?

Or am I off in la-la land.. ?
_________________________________________________________
Mike Jackson mike.jackson@bluequartz.net
BlueQuartz Software www.bluequartz.net
Principal Software Engineer Dayton, Ohio

On Jun 23, 2009, at 3:10 PM, Dimitris Servis wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the metadata using a special driver, but all the metadata, not parts of them and still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>
Hi,

I am interested in encrypting using private/public keys within HDF5 controlling access to certain portions of the data. Any thoughts or directions to consider for this type of requirement?

Sincerely,

Jim Robertson

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.

8

Hi Quincey,

the more I read about the upcoming release, the more impatient I get :slight_smile: I
think this along with the journalling address 2 major issues of HDF5.

Thanks a lot!

-- ds

···

2009/6/25 Quincey Koziol <koziol@hdfgroup.org>

Hi Dimitris,
On Jun 23, 2009, at 2:44 PM, Dimitris Servis wrote:

Hi Michael

It really depends what you want to do. The filters are applied on the
datasets, which means that in effect, you have to process all data, that is
a performance killer. At the VFL level, you know which data is which and you
can filter some metadata but then you do that for all metadata...

In the next major HDF5 release, we are planning on allowing filters to be
applied to the heaps that store the links for groups. This should mitigate
some of the perform concerns for an encryption filter, while allowing some
of the metadata in a file to be concealed.

Quincey

HTH

-- dimitris

2009/6/23 Michael Jackson <mike.jackson@bluequartz.net>

Wouldn't that be a matter of copying what the zip/szip filters are doing
and then implementing with your choice of encryption code?

Or am I off in la-la land.. ?
_________________________________________________________
Mike Jackson mike.jackson@bluequartz.net
BlueQuartz Software www.bluequartz.net
Principal Software Engineer Dayton, Ohio

On Jun 23, 2009, at 3:10 PM, Dimitris Servis wrote:

Hi James,

that's a tough one... I implemented something similar by encrypting the
metadata using a special driver, but all the metadata, not parts of them and
still it's pretty difficult to make it work...

HTH

-- dimitris

2009/6/23 James Robertson <jrobertson@clearhaven.com>
Hi,

I am interested in encrypting using private/public keys within HDF5
controlling access to certain portions of the data. Any thoughts or
directions to consider for this type of requirement?

Sincerely,

Jim Robertson

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to
hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.