New JPEG filter and plugin available

Folks,

I’ve written a new HDF5 compression filter and plugin for standard JPEG compression. It is available here:

https://github.com/CARS-UChicago/jpegHDF5

We are using it to stream 8-bit monochromatic and RGB video to compressed HDF5 files. JPEG is a lossy compression. The filter supports the JPEG “quality factor” (1-100) to define the trade-off between compression factor and accuracy.

When doing the compression in this filter it can stream about 100 [1024x1024] frames/s to a single HDF5 file. When doing the JPEG compression in an external function with 5 threads and using HDF5 direct chunk write it can do about 500 frames/s. Both types of files can be decompressed using the plugin provided in this package.

Please create a Github issue if you find a problem or have a suggestion.

Mark