Details
Description
1. Test failed before upgrade only.
2. Installed Source and Destination nodes 2.0.0-1976-rel
3. Changed global xdcr settings xdcrFailureRestartInterval=1 and xdcrCheckpointInterval=60 on each cluster.
3. Created remote clusters cluster0 and cluster1 for bi-directional XDCR.
4. Node 10.3.3.239 (Destination master) node become un-responsive.
[Notes]
1. Test worked fine for CentOS.
2. 3 tests are failed because of this issue, all are related to 2.0.0-1976-rel upgrade to 3.0.
[Jenkins]
http://qa.hq.northscale.net/job/ubuntu_x64--36_01--XDCR_upgrade-P1/24/consoleFull
[Test]
./testrunner i ubuntu_x6436_01-XDCR_upgrade-P1.ini get-cbcollect-info=True,get-logs=False,stop-on-failure=False,get-coredumps=True,upgrade_version=3.0.0-973-rel,initial_vbuckets=1024 -t xdcr.upgradeXDCR.UpgradeTests.offline_cluster_upgrade,initial_version=2.0.0-1976-rel,sdata=False,bucket_topology=default:1>2;bucket0:1><2,upgrade_nodes=dest;src,use_encryption_after_upgrade=src;dest
[Failure]
2014-07-19 07:50:28,182] - [basetestcase:264] INFO - sleep for 30 secs. ...
[2014-07-19 07:50:58,191] - [xdcrbasetests:1089] INFO - Setting xdcrFailureRestartInterval to 1 ..
[2014-07-19 07:50:58,204] - [rest_client:1726] INFO - Update internal setting xdcrFailureRestartInterval=1
[2014-07-19 07:50:58,262] - [rest_client:1726] INFO - Update internal setting xdcrFailureRestartInterval=1
[2014-07-19 07:50:58,263] - [xdcrbasetests:1089] INFO - Setting xdcrCheckpointInterval to 60 ..
[2014-07-19 07:50:58,278] - [rest_client:1726] INFO - Update internal setting xdcrCheckpointInterval=60
[2014-07-19 07:50:58,382] - [rest_client:1726] INFO - Update internal setting xdcrCheckpointInterval=60
[2014-07-19 07:50:58,392] - [rest_client:828] INFO - adding remote cluster hostname:10.3.3.239:8091 with username:password Administrator:password name:cluster1 to source node: 10.3.3.240:8091
[2014-07-19 07:50:58,780] - [rest_client:828] INFO - adding remote cluster hostname:10.3.3.240:8091 with username:password Administrator:password name:cluster0 to source node: 10.3.3.239:8091
[2014-07-19 07:50:59,048] - [rest_client:874] INFO - starting continuous replication type:capi from default to default in the remote cluster cluster1
[2014-07-19 07:50:59,250] - [basetestcase:264] INFO - sleep for 5 secs. ...
[2014-07-19 07:51:04,256] - [rest_client:874] INFO - starting continuous replication type:capi from bucket0 to bucket0 in the remote cluster cluster1
[2014-07-19 07:51:04,559] - [basetestcase:264] INFO - sleep for 5 secs. ...
[2014-07-19 07:51:15,538] - [rest_client:747] ERROR - http://10.3.3.239:8091/nodes/self error 500 reason: unknown ["Unexpected server error, request logged."]
http://10.3.3.239:8091/nodes/self with status False: [u'Unexpected server error, request logged.']
[2014-07-19 07:51:15,538] - [xdcrbasetests:139] ERROR - list indices must be integers, not str
[2014-07-19 07:51:15,539] - [xdcrbasetests:140] ERROR - Error while setting up clusters: (<type 'exceptions.TypeError'>, TypeError('list indices must be integers, not str',), <traceback object at 0x31dd7a0>)
[2014-07-19 07:51:15,540] - [xdcrbasetests:179] INFO - ============== XDCRbasetests cleanup is started for test #11 offline_cluster_upgrade ==============