Hi All,
We also encountered really bad performance on Lustre. Although read speeds are
really good but parallel writes do not really work well because of write locks.
I am now considering using a 1-processor serial write instead of parallel write
and use parallel IO only for the reads, since we have experienced very poor
performance with multiple processors as compared to 1-processor raw binary
format(write operation).
Does anybody have any results for how serial HDF5 compares with raw binary
format in terms of write bandwidth?
Regards,
Nikhil
···
On Tue, Nov 25, 2008 at 9:22 AM, Steve Heistand <steve.heistand@nasa.gov> wrote:
Hi folks,
has anyone gotten good performance with parallel HDF operations
on a lustre filesystem? When our client count grows large we are seeing
really really bad IO rates and sometimes even failures when doing
parallel IO operations.
Thought I would ask the group to see if anyone is seeing good
lustre performance.
thanks.
s
--
************************************************************************
Steve Heistand NASA Ames Research Center
SciCon Group Mail Stop 258-6
steve.heistand@nasa.gov (650) 604-4369 Moffett Field, CA 94035-1000
************************************************************************
"Any opinions expressed are those of our alien overloads, not my own."
Regards,
Nikhil
----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe@hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe@hdfgroup.org.