Description
I create 10 items with size 40 Bytes each and set 1 item with expire time 60 seconds in default bucket. Then I use cbtransfer to transfer the data to a backup directory and use cbrestore to restore all the items. After those 10 items are on the new cluster, 1 of them should be expired after 60 sec. But it doesn't.
In the previous tests, we have backup and restore expired items and use cbtransfer to transfer expired items (from couchstore files) to 2.0 online server. They all work.
2012-09-07 19:53:11,416 - root - INFO - running command.raw sudo /opt/couchbase/bin/cbtransfer -v -v -v couchstore-files:///opt/couchbase/var/lib/couchbase/data/ /tmp/backup
2012-09-07 19:53:11,425 - paramiko.transport - INFO - Secsh channel 9 opened.
2012-09-07 19:53:11,734 - root - INFO - command executed successfully
2012-09-07 19:53:11,735 - root - INFO - 2012-09-07 19:50:53,976: mt cbtransfer...
2012-09-07 19:53:11,735 - root - INFO - 2012-09-07 19:50:53,977: mt source : couchstore-files:///opt/couchbase/var/lib/couchbase/data/
2012-09-07 19:53:11,736 - root - INFO - 2012-09-07 19:50:53,977: mt sink : /tmp/backup
2012-09-07 19:53:11,736 - root - INFO - 2012-09-07 19:50:53,977: mt opts : {'username': None, 'source_vbucket_state': 'active', 'destination_vbucket_state': 'active', 'verbose': 3, 'dry_run': False, 'extra':
, 'single_node': False, 'bucket_destination': None, 'destination_operation': None, 'threads': 4, 'key': None, 'password': None, 'id': None, 'bucket_source': None}
2012-09-07 19:53:11,737 - root - INFO - 2012-09-07 19:50:53,978: mt source_class: <class 'pump_sfd.SFDSource'>
2012-09-07 19:53:11,737 - root - INFO - 2012-09-07 19:50:54,010: mt sink_class: <class 'pump_bfd.BFDSink'>
2012-09-07 19:53:11,737 - root - INFO - 2012-09-07 19:50:54,010: mt source_buckets: default
2012-09-07 19:53:11,738 - root - INFO - 2012-09-07 19:50:54,010: mt bucket: default
2012-09-07 19:53:11,738 - root - INFO - 2012-09-07 19:50:54,010: mt source_nodes: N/A
2012-09-07 19:53:11,738 - root - INFO - 2012-09-07 19:50:54,012: mt enqueueing node: N/A
2012-09-07 19:53:11,739 - root - INFO - 2012-09-07 19:50:54,012: w0 node: N/A
2012-09-07 19:53:11,739 - root - INFO - 2012-09-07 19:50:54,027: s0 create_db: /tmp/backup/bucket-default/node-N%2FA/data-0000.cbb
2012-09-07 19:53:11,739 - root - INFO - 2012-09-07 19:50:54,027: s0 connect_db: /tmp/backup/bucket-default/node-N%2FA/data-0000.cbb
2012-09-07 19:53:11,740 - root - INFO - 2012-09-07 19:50:54,078: w0 pump (couchstore-files:///opt/couchbase/var/lib/couchbase/data/(default@N/A)->/tmp/backup(default@N/A)) done.
2012-09-07 19:53:11,740 - root - INFO - 2012-09-07 19:50:54,078: w0 source : couchstore-files:///opt/couchbase/var/lib/couchbase/data/(default@N/A)
2012-09-07 19:53:11,740 - root - INFO - 2012-09-07 19:50:54,078: w0 sink : /tmp/backup(default@N/A)
2012-09-07 19:53:11,741 - root - INFO - 2012-09-07 19:50:54,079: w0 : total | last | per sec
2012-09-07 19:53:11,741 - root - INFO - 2012-09-07 19:50:54,079: w0 batch : 1 | 1 | 15.1
2012-09-07 19:53:11,741 - root - INFO - 2012-09-07 19:50:54,079: w0 byte : 400 | 400 | 6054.0
2012-09-07 19:53:11,741 - root - INFO - 2012-09-07 19:50:54,079: w0 msg : 10 | 10 | 151.4
2012-09-07 19:53:11,742 - root - INFO - 2012-09-07 19:50:54,080: w0 node: N/A, done; rv: 0
2012-09-07 19:53:11,742 - root - INFO - .
2012-09-07 19:53:11,742 - root - INFO - bucket: default, msgs transferred...
2012-09-07 19:53:11,742 - root - INFO - : total | last | per sec
2012-09-07 19:53:11,743 - root - INFO - batch : 1 | 1 | 8.3
2012-09-07 19:53:11,743 - root - INFO - byte : 400 | 400 | 3321.2
2012-09-07 19:53:11,743 - root - INFO - msg : 10 | 10 | 83.0
2012-09-07 19:53:11,743 - root - INFO - done
2012-09-07 19:53:13,070 - root - INFO - waiting for bucket deletion to complete....
2012-09-07 19:53:13,083 - root - INFO - existing buckets : []
2012-09-07 19:53:14,097 - root - INFO - http://10.5.2.23:8091/pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&replicaIndex=1&name=default&saslPassword=None&replicaNumber=0&ramQuotaMB=714
2012-09-07 19:53:14,125 - root - INFO - 0.0278480052948 seconds to create bucket default
2012-09-07 19:53:14,125 - root - INFO - waiting for memcached bucket : default in 10.5.2.23 to accept set ops
2012-09-07 19:53:15,352 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:53:15,501 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:53:16,118 - root - INFO - bucket 'default' was created with per node RAM quota: 714
2012-09-07 19:53:16,118 - root - INFO - running command.raw sudo /opt/couchbase/bin/cbrestore /tmp/backup http://Administrator:password@10.5.2.23:8091 -b default
2012-09-07 19:53:16,122 - paramiko.transport - INFO - Secsh channel 10 opened.
2012-09-07 19:53:16,327 - root - INFO - command executed successfully
2012-09-07 19:53:16,328 - root - INFO - ################### 100.0% (10/10 msgs)
2012-09-07 19:53:16,328 - root - INFO - bucket: default, msgs transferred...
2012-09-07 19:53:16,329 - root - INFO - : total | last | per sec
2012-09-07 19:53:16,329 - root - INFO - batch : 1 | 1 | 13.3
2012-09-07 19:53:16,329 - root - INFO - byte : 400 | 400 | 5309.4
2012-09-07 19:53:16,329 - root - INFO - msg : 10 | 10 | 132.7
2012-09-07 19:53:16,330 - root - INFO - done
2012-09-07 19:54:18,199 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:18,249 - root - INFO - Saw ep_queue_size 0 == 0 expected on '10.5.2.23'
2012-09-07 19:54:18,264 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:18,305 - root - INFO - Saw ep_flusher_todo 0 == 0 expected on '10.5.2.23'
2012-09-07 19:54:18,353 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:18,392 - root - INFO - 10 items will be verified on default bucket
2012-09-07 19:54:20,332 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:20,391 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:20,411 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:20,460 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:20,482 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:20,543 - root - INFO - Saw vb_replica_curr_items 0 == 0 expected on '10.5.2.23'
2012-09-07 19:54:20,564 - root - INFO - creating direct client 10.5.2.23:11210 default
2012-09-07 19:54:20,619 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:25,640 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:25,649 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:25,661 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:30,684 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:30,695 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:30,705 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:35,794 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:35,803 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:35,812 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:40,833 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:40,843 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:40,858 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:45,879 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:45,892 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:45,901 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:50,921 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:50,934 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:50,946 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:55,960 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:55,969 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:54:55,978 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:00,999 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:01,009 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:01,025 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:06,047 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:06,057 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:06,065 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:11,087 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:11,096 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:11,105 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:16,127 - root - INFO - Not Ready: curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:16,136 - root - INFO - Not Ready: vb_active_curr_items 10 == 9 expected on '10.5.2.23'
2012-09-07 19:55:16,144 - root - INFO - Not Ready: curr_items_tot 10 == 9 expected on '10.5.2.23'
Attachments
For Gerrit Dashboard: MB-6575 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
20718,3 | MB-6575 use set flush_param exp_pager_stime 5 for data-recovery test | master | testrunner | Status: MERGED | +2 | +1 |