HDF5 repair tool

Hi folks
  though I never experienced problems with corrupted HDF5 files I just
wonder if there is a tool available to repair damaged HDF5 files?

regards
  Eugen

···

--
---------------------------------------
DI. Dr. Eugen Wintersberger
                             
FS-EC
DESY
Notkestr. 85
D-22607 Hamburg
Germany

E-Mail: eugen.wintersberger@desy.de
Telefon: +49-40-8998-1917
---------------------------------------

Not sure if it will 'repair' a file but 'h5debug' might help diagnose what
is wrong with the file?
For that matter, 'h5dump' and 'h5ls' also migth provide some information

I think maybe The HDF Group could use an h5fck (like fsck for a
file-system).

Mark

···

On 10/7/13 3:37 AM, "Wintersberger, Eugen" <eugen.wintersberger@desy.de> wrote:

Hi folks
though I never experienced problems with corrupted HDF5 files I just
wonder if there is a tool available to repair damaged HDF5 files?

regards
Eugen
--
---------------------------------------
DI. Dr. Eugen Wintersberger
                 
FS-EC
DESY
Notkestr. 85
D-22607 Hamburg
Germany

E-Mail: eugen.wintersberger@desy.de
Telefon: +49-40-8998-1917
---------------------------------------

Eugen,

There is no such tool. There is a diagnostic tool h5check (http://www.hdfgroup.org/products/hdf5_tools/h5check.html) that validates HDF5 metadata, but it doesn't repair the file if corrupted piece of metadata found.

Elena

···

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

On Oct 7, 2013, at 5:37 AM, "Wintersberger, Eugen" <eugen.wintersberger@desy.de> wrote:

Hi folks
though I never experienced problems with corrupted HDF5 files I just
wonder if there is a tool available to repair damaged HDF5 files?

regards
Eugen
--
---------------------------------------
DI. Dr. Eugen Wintersberger

FS-EC
DESY
Notkestr. 85
D-22607 Hamburg
Germany

E-Mail: eugen.wintersberger@desy.de
Telefon: +49-40-8998-1917
---------------------------------------

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

I agree, something like h5fck would be an interesting tool.
Maybe one can even do more. What I was thinking about was something like
an HDF5 carving tool (like scalpel for file systems) which tries to
rescue as much data as possible from a corrupted file.
I do not know if this is possible. I just had a look at the binary data
layout of HDF5 files and was wondering if something like this already
exists :wink:

regards
  Eugen

···

On Mon, 2013-10-07 at 17:05 +0000, Miller, Mark C. wrote:

Not sure if it will 'repair' a file but 'h5debug' might help diagnose what
is wrong with the file?
For that matter, 'h5dump' and 'h5ls' also migth provide some information

I think maybe The HDF Group could use an h5fck (like fsck for a
file-system).

Mark

On 10/7/13 3:37 AM, "Wintersberger, Eugen" <eugen.wintersberger@desy.de> > wrote:

>Hi folks
> though I never experienced problems with corrupted HDF5 files I just
>wonder if there is a tool available to repair damaged HDF5 files?
>
>regards
> Eugen
>--
>---------------------------------------
>DI. Dr. Eugen Wintersberger
>
>FS-EC
>DESY
>Notkestr. 85
>D-22607 Hamburg
>Germany
>
>E-Mail: eugen.wintersberger@desy.de
>Telefon: +49-40-8998-1917
>---------------------------------------
>

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

This tool is possible and it is on our wish list.

My usual appeal:

If someone is interested to sponsor tool's development we can come up with cost estimate.
If someone is interested and willing to develop and maintain this tool, The HDF Group developers will be more than happy to guide the development!

Elena

···

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

On Oct 8, 2013, at 1:48 AM, "Wintersberger, Eugen" <eugen.wintersberger@desy.de> wrote:

I agree, something like h5fck would be an interesting tool.
Maybe one can even do more. What I was thinking about was something like
an HDF5 carving tool (like scalpel for file systems) which tries to
rescue as much data as possible from a corrupted file.
I do not know if this is possible. I just had a look at the binary data
layout of HDF5 files and was wondering if something like this already
exists :wink:

regards
Eugen

On Mon, 2013-10-07 at 17:05 +0000, Miller, Mark C. wrote:

Not sure if it will 'repair' a file but 'h5debug' might help diagnose what
is wrong with the file?
For that matter, 'h5dump' and 'h5ls' also migth provide some information

I think maybe The HDF Group could use an h5fck (like fsck for a
file-system).

Mark

On 10/7/13 3:37 AM, "Wintersberger, Eugen" <eugen.wintersberger@desy.de> >> wrote:

Hi folks
though I never experienced problems with corrupted HDF5 files I just
wonder if there is a tool available to repair damaged HDF5 files?

regards
Eugen
--
---------------------------------------
DI. Dr. Eugen Wintersberger

FS-EC
DESY
Notkestr. 85
D-22607 Hamburg
Germany

E-Mail: eugen.wintersberger@desy.de
Telefon: +49-40-8998-1917
---------------------------------------

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org