I want to store a 5D sparse dataset; only the nonzero values.
Chunking appears to save the whole matrix; I don't want this.
I came upon H5's Vdata interface but don't see how this helps.
Anyone have an example of storing/retrieving highly-dimensional sparse data?
···
________________________________
The information contained in this email message is intended only for the use of the individual(s) to whom it is addressed and may contain information that is privileged and sensitive. If you are not the intended recipient, or otherwise have received this communication in error, please notify the sender immediately by email at the above referenced address and note that any further dissemination, distribution or copying of this communication is strictly prohibited.
The U.S. Export Control Laws regulate the export and re-export of technology originating in the United States. This includes the electronic transmission of information and software to foreign countries and to certain foreign nationals. Recipient agrees to abide by these laws and their regulations -- including the U.S. Department of Commerce Export Administration Regulations and the U.S. Department of State International Traffic in Arms Regulations -- and not to transfer, by electronic transmission or otherwise, any content derived from this email to either a foreign national or a foreign destination in violation of such laws.
Hello
I store sparse data using chunked dataset, and zeros values are only virtually stored, as non existent data. And in case of reading, these are not read. However, avoiding to read these data may take some time to hdf5, i suggest you to select only nonzeros data through an explicit hyperslabs.
Mathieu
···
On 06/24/2012 04:28 PM, Corelli.Eileen wrote:
I want to store a 5D sparse dataset; only the nonzero values.
Chunking appears to save the whole matrix; I don't want this.
I came upon H5's Vdata interface but don't see how this helps.
Anyone have an example of storing/retrieving highly-dimensional sparse data?
------------------------------------------------------------------------
The information contained in this email message is intended only for the use of the individual(s) to whom it is addressed and may contain information that is privileged and sensitive. If you are not the intended recipient, or otherwise have received this communication in error, please notify the sender immediately by email at the above referenced address and note that any further dissemination, distribution or copying of this communication is strictly prohibited.
The U.S. Export Control Laws regulate the export and re-export of technology originating in the United States. This includes the electronic transmission of information and software to foreign countries and to certain foreign nationals. Recipient agrees to abide by these laws and their regulations -- including the U.S. Department of Commerce Export Administration Regulations and the U.S. Department of State International Traffic in Arms Regulations -- and not to transfer, by electronic transmission or otherwise, any content derived from this email to either a foreign national or a foreign destination in violation of such laws.
_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
