Here is an RFC describing a new feature we’re developing that will accelerate chunked I/O by internally splitting the operation into multiple threads, with each thread handling one chunk (or more than one if there are more chunks than threads available). This will particularly benefit datasets with data filters (i.e. compression). We’re eager to hear your feedback on this!
RFC_HDFG_2026_002.v3.pdf (133.5 KB)