Hi forum,
Does anyone know a general reason why disabling chunk caching would improve
performance? I found this to be the case in my application but can't
explain why.
In a tutorial from Elena Pourmal,
:
"Chunk cache size (rdcc_nbytes) should be large enough to hold all the
chunks in a selection • If this is not possible, it may be best to disable
chunk caching altogether (set rdcc_nbytes to 0)"
Note that even though it is possible in my application, I still gain
performance by disabling it.
Cheers,
Brock
Hi Brock,
Less memory is used when chunk cache is disabled (default setting is 1MB per each opened dataset), but it is hard to say without profiling the application.
Elena
···
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Elena Pourmal The HDF Group http://hdfgroup.org
1800 So. Oak St., Suite 203, Champaign IL 61820
217.531.6112
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
On Sep 11, 2015, at 11:34 AM, Brock Hargreaves <brock.hargreaves@gmail.com<mailto:brock.hargreaves@gmail.com>> wrote:
Hi forum,
Does anyone know a general reason why disabling chunk caching would improve performance? I found this to be the case in my application but can't explain why.
In a tutorial from Elena Pourmal, https://www.hdfgroup.org/HDF5/doc/Advanced/Chunking/Chunking_Tutorial_EOS13_2009.pdf :
"Chunk cache size (rdcc_nbytes) should be large enough to hold all the chunks in a selection • If this is not possible, it may be best to disable chunk caching altogether (set rdcc_nbytes to 0)"
Note that even though it is possible in my application, I still gain performance by disabling it.
Cheers,
Brock
_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org<mailto:Hdf-forum@lists.hdfgroup.org>
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5
