LZ4 Filter Filter ID: 32004

Hdf-forum archives
1

Hi,

I am wondering if this compression filter has been implemented for the
public? I tried to contact author on website, and follow up link provided
with no success finding an implementation.

If this filter is not implemented and would like to implement one in the
public domain should I re-register the filter with different number or can
use the same registration number?

thanks,
steve

2

Hello Steve, I have this implemented and would be willing to share; no strings attached. I don’t have the time to do whatever is necessary to get it in the public domain.

I implemented it using a blend of probably the same resource you reference, but updated with the latest code from Google/Yann Collet. I implemented lz4 and the lz4hc version based on a “compression level” parameter.

It has been working great in our production code for 6 mos. or so now.

Please email me at jim.rowe*at*gmail.com if interested.

Warm Regards,
Jim

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Steven Varga
Sent: Wednesday, November 19, 2014 5:31 AM
To: HDF Users Discussion List
Subject: [Hdf-forum] LZ4 Filter Filter ID: 32004

Hi,
I am wondering if this compression filter has been implemented for the public? I tried to contact author on website, and follow up link provided with no success finding an implementation.
If this filter is not implemented and would like to implement one in the public domain should I re-register the filter with different number or can use the same registration number?
thanks,
steve

3

19.11.2014 15:31, Steven Varga пишет:

Hi,

I am wondering if this compression filter has been implemented for the
public? I tried to contact author on website, and follow up link
provided with no success finding an implementation.

If this filter is not implemented and would like to implement one in the
public domain should I re-register the filter with different number or
can use the same registration number?

Your filter should use ID=32004 as long as it is binary compatible with

I found it fairly easy to implement LZ4 plugin based on specification above and code below:

In attachment you can find some code along with Windows x86 binary. It has been in production for some time as well.

Best wishes,
Andrey Paramonov

lz4_h5plugin.c (5.24 KB)

hdf5plugin-lz4.dll (18.5 KB)

···

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

4

Thank you for the link,

that was I looking for, for some reasons it is not published on the HDF5
filters page, it worked.

steve

···

On Thu, Nov 20, 2014 at 3:37 AM, Андрей Парамонов <paramon@acdlabs.ru> wrote:

19.11.2014 15:31, Steven Varga пишет:

Hi,

I am wondering if this compression filter has been implemented for the
public? I tried to contact author on website, and follow up link
provided with no success finding an implementation.

If this filter is not implemented and would like to implement one in the
public domain should I re-register the filter with different number or
can use the same registration number?

Your filter should use ID=32004 as long as it is binary compatible with
http://www.hdfgroup.org/services/filters/HDF5_LZ4.pdf

I found it fairly easy to implement LZ4 plugin based on specification
above and code below:
https://github.com/michaelrissi/HDF5Plugin

In attachment you can find some code along with Windows x86 binary. It has
been in production for some time as well.

Best wishes,
Andrey Paramonov

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org

http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5