Limitation of number of usages of H5TBappend_records()?

Hello,

I have reported this in the previous thread:
http://hdf-forum.184993.n3.nabble.com/H5SL-insert-common-can-t-insert-duplicate-key-with-HDF5-1-8-13-td4027464.html

Here I modified the example code provided on the official website to show
this limitation. (ex_table_02.c in
http://www.hdfgroup.org/HDF5/Tutor/h5table.html\)

I ran into the following error when appending table for the 599169th
iteration.

HDF5-DIAG: Error detected in HDF5 (1.8.13) thread 140557357188896:
  #000: H5Tnative.c line 122 in H5Tget_native_type(): unable to register
data type
    major: Datatype
    minor: Unable to register new atom
  #001: H5I.c line 895 in H5I_register(): can't insert ID node into skip
list
    major: Object atom
    minor: Unable to insert object
  #002: H5SL.c line 995 in H5SL_insert(): can't create new skip list node
    major: Skip Lists
    minor: Unable to insert object
  #003: H5SL.c line 687 in H5SL_insert_common(): can't insert duplicate key
    major: Skip Lists
    minor: Unable to insert object
iteration: 599169

Best,

Ching-Chia Wang

ex_table_02_test.c (4.58 KB)

I think you might be hitting the limit with the number of identifiers created in the library (which in the 1.8 series is a 32 bit signed integer).
We already switched to using 64 bit integers in the trunk (for the future 1.10 release), which should take care of this problem.

For verification, you can try out the trunk to see if it helps:
http://svn.hdfgroup.uiuc.edu/hdf5/trunk

Thanks,
Mohamad

···

From: Hdf-forum [mailto:hdf-forum-bounces@lists.hdfgroup.org] On Behalf Of Ching-Chia Wang
Sent: Wednesday, October 01, 2014 10:48 AM
To: hdf-forum@lists.hdfgroup.org
Subject: [Hdf-forum] Limitation of number of usages of H5TBappend_records()?

Hello,
I have reported this in the previous thread: http://hdf-forum.184993.n3.nabble.com/H5SL-insert-common-can-t-insert-duplicate-key-with-HDF5-1-8-13-td4027464.html
Here I modified the example code provided on the official website to show this limitation. (ex_table_02.c in http://www.hdfgroup.org/HDF5/Tutor/h5table.html)

I ran into the following error when appending table for the 599169th iteration.

HDF5-DIAG: Error detected in HDF5 (1.8.13) thread 140557357188896:
  #000: H5Tnative.c line 122 in H5Tget_native_type(): unable to register data type
    major: Datatype
    minor: Unable to register new atom
  #001: H5I.c line 895 in H5I_register(): can't insert ID node into skip list
    major: Object atom
    minor: Unable to insert object
  #002: H5SL.c line 995 in H5SL_insert(): can't create new skip list node
    major: Skip Lists
    minor: Unable to insert object
  #003: H5SL.c line 687 in H5SL_insert_common(): can't insert duplicate key
    major: Skip Lists
    minor: Unable to insert object
iteration: 599169

Best,
Ching-Chia Wang