C# API Wrapper - Supported Features

Hello,

I'm using the C# API wrapper currently hosted in NuGet.org and have a couple of queries regarding feature support:

* Will support for H5P.Shuffle be added in the near future? We would like to use this alongside compression.

* Will support for H5P.Filter be added in the near future? We are interested in using the LZO compression library, specifically.

* Could an 'AnyCPU' version of the wrapper be released? We have 32 and 64bit processes and it'd be nice not to have to conditionally switch project references and third party assemblies depending on which build configuration is being used

One other issue of note, when using any form of compression (levels 0-9) we experience AccessViolationExceptions when writing multiple datasets to a single file. We have discovered that when writing to data sets the C# code path returns and continues even when data is being written/flushed to disk. You can prove that this is not an OS operating by killing the writing process after the code path has returned, resulting in a corrupt HDF5 file. Even closing the datasets (and all associated identifiers) results in AccessViolationExceptions if the calling code continues and subsequently tries to write another data set, or append to any existing one. It looks like something is missing that prevents the code path returning before the flush/close has fully completed. Any ideas?

Cheers

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

Oh and before I forget, Barbara mentioned that the source code might be in the public domain, perhaps in GitHub? I'm hoping that's the case, as the library is a bit of a black box right now.

Cheers

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Headdon, Jimmy
Sent: 10 November 2015 12:08
To: hdf-forum@lists.hdfgroup.org
Subject: [Hdf-forum] C# API Wrapper - Supported Features

Hello,

I'm using the C# API wrapper currently hosted in NuGet.org and have a couple of queries regarding feature support:

* Will support for H5P.Shuffle be added in the near future? We would like to use this alongside compression.

* Will support for H5P.Filter be added in the near future? We are interested in using the LZO compression library, specifically.

* Could an 'AnyCPU' version of the wrapper be released? We have 32 and 64bit processes and it'd be nice not to have to conditionally switch project references and third party assemblies depending on which build configuration is being used

One other issue of note, when using any form of compression (levels 0-9) we experience AccessViolationExceptions when writing multiple datasets to a single file. We have discovered that when writing to data sets the C# code path returns and continues even when data is being written/flushed to disk. You can prove that this is not an OS operating by killing the writing process after the code path has returned, resulting in a corrupt HDF5 file. Even closing the datasets (and all associated identifiers) results in AccessViolationExceptions if the calling code continues and subsequently tries to write another data set, or append to any existing one. It looks like something is missing that prevents the code path returning before the flush/close has fully completed. Any ideas?

Cheers

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

Hi Jimmy,

Sorry if I gave the wrong impression. The HDF5DotNet software is not in the public domain. There is a license for it.
The hdf5.net page points to the HDF5 license here:
     https://www.hdfgroup.org/HDF5/doc/Copyright.html

-Barbara

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Headdon, Jimmy
Sent: Tuesday, November 10, 2015 7:56 AM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] C# API Wrapper - Supported Features

Oh and before I forget, Barbara mentioned that the source code might be in the public domain, perhaps in GitHub? I'm hoping that's the case, as the library is a bit of a black box right now.

Cheers

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Headdon, Jimmy
Sent: 10 November 2015 12:08
To: hdf-forum@lists.hdfgroup.org<mailto:hdf-forum@lists.hdfgroup.org>
Subject: [Hdf-forum] C# API Wrapper - Supported Features

Hello,

I'm using the C# API wrapper currently hosted in NuGet.org and have a couple of queries regarding feature support:

* Will support for H5P.Shuffle be added in the near future? We would like to use this alongside compression.

* Will support for H5P.Filter be added in the near future? We are interested in using the LZO compression library, specifically.

* Could an 'AnyCPU' version of the wrapper be released? We have 32 and 64bit processes and it'd be nice not to have to conditionally switch project references and third party assemblies depending on which build configuration is being used

One other issue of note, when using any form of compression (levels 0-9) we experience AccessViolationExceptions when writing multiple datasets to a single file. We have discovered that when writing to data sets the C# code path returns and continues even when data is being written/flushed to disk. You can prove that this is not an OS operating by killing the writing process after the code path has returned, resulting in a corrupt HDF5 file. Even closing the datasets (and all associated identifiers) results in AccessViolationExceptions if the calling code continues and subsequently tries to write another data set, or append to any existing one. It looks like something is missing that prevents the code path returning before the flush/close has fully completed. Any ideas?

Cheers

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

Dear Jimmy, thank you for your interest in HDF5 and your description of some of the issues you are facing.

There is currently no .NET library or API for HDF5 that is supported by The HDF Group. There are (partial) solutions available from third parties and in the public domain, but we recognize that the general support for developing HDF5 solutions on the .NET platform is poor.

At present, we are engaged in discussions with a few partners to fill this gap. Our goal is to offer a comprehensive and modern .NET interface. If you would like to join the discussion, please send me an email (gheber@hdfgroup.org<mailto:gheber@hdfgroup.org>).

Best regards,

Gerd

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Headdon, Jimmy
Sent: Tuesday, November 10, 2015 7:56 AM
To: HDF Users Discussion List
Subject: Re: [Hdf-forum] C# API Wrapper - Supported Features

Oh and before I forget, Barbara mentioned that the source code might be in the public domain, perhaps in GitHub? I'm hoping that's the case, as the library is a bit of a black box right now.

Cheers

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Headdon, Jimmy
Sent: 10 November 2015 12:08
To: hdf-forum@lists.hdfgroup.org<mailto:hdf-forum@lists.hdfgroup.org>
Subject: [Hdf-forum] C# API Wrapper - Supported Features

Hello,

I'm using the C# API wrapper currently hosted in NuGet.org and have a couple of queries regarding feature support:

* Will support for H5P.Shuffle be added in the near future? We would like to use this alongside compression.

* Will support for H5P.Filter be added in the near future? We are interested in using the LZO compression library, specifically.

* Could an 'AnyCPU' version of the wrapper be released? We have 32 and 64bit processes and it'd be nice not to have to conditionally switch project references and third party assemblies depending on which build configuration is being used

One other issue of note, when using any form of compression (levels 0-9) we experience AccessViolationExceptions when writing multiple datasets to a single file. We have discovered that when writing to data sets the C# code path returns and continues even when data is being written/flushed to disk. You can prove that this is not an OS operating by killing the writing process after the code path has returned, resulting in a corrupt HDF5 file. Even closing the datasets (and all associated identifiers) results in AccessViolationExceptions if the calling code continues and subsequently tries to write another data set, or append to any existing one. It looks like something is missing that prevents the code path returning before the flush/close has fully completed. Any ideas?

Cheers

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478

The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you are not the intended recipient you should not read, copy, retransmit or disclose its contents. If you have received this email in error please delete it from your system immediately and notify us either by email or telephone. The views expressed in this communication may not necessarily be the views held by McLaren Racing Limited.
McLaren Racing Limited | McLaren Technology Centre | Chertsey Road | Woking | Surrey | GU21 4YH | UK | Company Number: 01517478