Major Description
I try to automate the data recovery test using cbtransfer. For example, I create 16 items and then update 8 of them, delete 4 of them and then do cbtransfer. I do cbtransfer after all the mutations are done and see ep_queue_size 0 == 0 expected on '10.5.2.22' ep_flusher_todo 0 == 0 expected on '10.5.2.22'
The test code looks like this:
gen_load = BlobGenerator('nosql', 'nosql-', self.value_size, end=self.num_items)
gen_update = BlobGenerator('nosql', 'nosql-', self.value_size, end=(self.num_items/2-1))
gen_delete = BlobGenerator('nosql', 'nosql-', self.value_size, start=self.num_items*3/4, end=self.num_items)
self._load_all_buckets(self.server_origin, gen_load, "create", 0)
if(self.doc_ops is not None):
if("update" in self.doc_ops):
self._load_all_buckets(self.server_origin, gen_update, "update", 0)
if("delete" in self.doc_ops):
self._load_all_buckets(self.server_origin, gen_delete, "delete", 0)
So the cbtransfer throw the same error 4 times due to those 4 deleted items:
[2012-08-10 23:15:49,696] - [remote_util:1107] INFO - running command.raw sudo /opt/couchbase/bin/cbtransfer couchstore-files:///opt/couchbase/var/lib/couchbase/data/ http://Administrator:password@10.5.2.23:8091 -b default -B default -x try_xwm=0
[2012-08-10 23:15:49,835] - [transport:1368] INFO - Secsh channel 7 opened.
[2012-08-10 23:15:50,332] - [remote_util:1136] INFO - command executed successfully
[2012-08-10 23:15:50,333] - [remote_util:1088] INFO - Traceback (most recent call last):
[2012-08-10 23:15:50,333] - [remote_util:1088] INFO - File "_ctypes/callbacks.c", line 295, in 'calling callback function'
[2012-08-10 23:15:50,334] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 345, in callback
[2012-08-10 23:15:50,334] - [remote_util:1088] INFO - fn(DocumentInfo._fromStruct(docInfoPtr.contents, self))
[2012-08-10 23:15:50,334] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/pump_sfd.py", line 213, in change_callback
[2012-08-10 23:15:50,335] - [remote_util:1088] INFO - val = doc_info.getContents()
[2012-08-10 23:15:50,335] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 159, in getContents
[2012-08-10 23:15:50,335] - [remote_util:1088] INFO - contents = str(docptr.contents.data)
[2012-08-10 23:15:50,336] - [remote_util:1088] INFO - ValueError: NULL pointer access
[2012-08-10 23:15:50,336] - [remote_util:1088] INFO - Traceback (most recent call last):
[2012-08-10 23:15:50,336] - [remote_util:1088] INFO - File "_ctypes/callbacks.c", line 295, in 'calling callback function'
[2012-08-10 23:15:50,336] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 345, in callback
[2012-08-10 23:15:50,337] - [remote_util:1088] INFO - fn(DocumentInfo._fromStruct(docInfoPtr.contents, self))
[2012-08-10 23:15:50,337] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/pump_sfd.py", line 213, in change_callback
[2012-08-10 23:15:50,337] - [remote_util:1088] INFO - val = doc_info.getContents()
[2012-08-10 23:15:50,337] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 159, in getContents
[2012-08-10 23:15:50,338] - [remote_util:1088] INFO - contents = str(docptr.contents.data)
[2012-08-10 23:15:50,338] - [remote_util:1088] INFO - ValueError: NULL pointer access
[2012-08-10 23:15:50,338] - [remote_util:1088] INFO - Traceback (most recent call last):
[2012-08-10 23:15:50,338] - [remote_util:1088] INFO - File "_ctypes/callbacks.c", line 295, in 'calling callback function'
[2012-08-10 23:15:50,339] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 345, in callback
[2012-08-10 23:15:50,339] - [remote_util:1088] INFO - fn(DocumentInfo._fromStruct(docInfoPtr.contents, self))
[2012-08-10 23:15:50,339] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/pump_sfd.py", line 213, in change_callback
[2012-08-10 23:15:50,339] - [remote_util:1088] INFO - val = doc_info.getContents()
[2012-08-10 23:15:50,340] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 159, in getContents
[2012-08-10 23:15:50,340] - [remote_util:1088] INFO - contents = str(docptr.contents.data)
[2012-08-10 23:15:50,340] - [remote_util:1088] INFO - ValueError: NULL pointer access
[2012-08-10 23:15:50,340] - [remote_util:1088] INFO - Traceback (most recent call last):
[2012-08-10 23:15:50,341] - [remote_util:1088] INFO - File "_ctypes/callbacks.c", line 295, in 'calling callback function'
[2012-08-10 23:15:50,341] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 345, in callback
[2012-08-10 23:15:50,341] - [remote_util:1088] INFO - fn(DocumentInfo._fromStruct(docInfoPtr.contents, self))
[2012-08-10 23:15:50,341] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/pump_sfd.py", line 213, in change_callback
[2012-08-10 23:15:50,341] - [remote_util:1088] INFO - val = doc_info.getContents()
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - File "/opt/couchbase/lib/python/couchstore.py", line 159, in getContents
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - contents = str(docptr.contents.data)
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - ValueError: NULL pointer access
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - .
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - bucket: default, msgs transferred...
[2012-08-10 23:15:50,342] - [remote_util:1088] INFO - : total | last | per sec
[2012-08-10 23:15:50,343] - [remote_util:1088] INFO - batch : 1 | 1 | 16.6
[2012-08-10 23:15:50,343] - [remote_util:1088] INFO - byte : 3072 | 3072 | 51019.8
[2012-08-10 23:15:50,343] - [remote_util:1088] INFO - msg : 12 | 12 | 199.3