Details
-
Bug
-
Resolution: Duplicate
-
Blocker
-
4.0.0
-
Security Level: Public
-
Untriaged
-
Centos 64-bit
-
Yes
Description
Build
4.0.0-3321
Testcase
--------
./testrunner -i INI_FILE.ini demand_encryption=1 -t xdcr.uniXDCR.unidirectional.load_with_async_ops_with_warmup_master,items=100000,rdirection=unidirection,sasl_buckets=2,update=C1,delete=C1,warm=C2
Steps
1. C1[.45,.46] --> C2 [.47,.48]
2. Load 100K keys on C1.default, C1.sasl_bucket_1 and C1.sasl_bucket_2
3. Restart Couchbase on .47
4. Do updates and deletes on C1 on all buckets
5. verify keys on both clusters
Note: This test passed in all previous runs(at least 5). Is probably a regression.
|
|
[2015-06-30 05:14:23,146] - [xdcrnewbasetests:2160] INFO - Waiting for dcp queue to drain on cluster node: 172.23.106.45
|
[2015-06-30 05:14:23,230] - [xdcrnewbasetests:2170] INFO - Current dcp queue size on C1 for default is 8551
|
[2015-06-30 05:14:28,290] - [xdcrnewbasetests:2170] INFO - Current dcp queue size on C1 for sasl_bucket_1 is 0
|
[2015-06-30 05:14:28,290] - [xdcrnewbasetests:2160] INFO - Waiting for dcp queue to drain on cluster node: 172.23.106.47
|
[2015-06-30 05:14:28,354] - [xdcrnewbasetests:2170] INFO - Current dcp queue size on C2 for default is 0
|
[2015-06-30 05:14:28,414] - [xdcrnewbasetests:2170] INFO - Current dcp queue size on C2 for sasl_bucket_2 is 0
|
[2015-06-30 05:14:28,414] - [xdcrnewbasetests:2190] INFO - Waiting for Outbound mutation to be zero on cluster node: 172.23.106.45
|
[2015-06-30 05:14:28,448] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:28,473] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:28,514] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:33,547] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:33,580] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:33,605] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:38,645] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:38,675] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:38,711] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:43,742] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:43,764] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:43,788] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:48,816] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:48,836] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:48,864] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:53,901] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:53,930] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:53,957] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:14:58,984] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:14:59,006] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:14:59,031] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:04,060] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:04,087] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:04,115] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:09,149] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:09,176] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:09,209] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:14,240] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:14,265] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:14,285] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:19,311] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:19,336] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:19,368] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:24,399] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:24,423] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:24,446] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:29,475] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:29,500] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:29,522] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:34,553] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:34,586] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:34,608] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:39,636] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:39,660] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:39,696] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:44,742] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:44,769] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:44,796] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:49,827] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:49,861] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:49,891] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:15:54,920] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:15:54,941] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:15:54,967] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:00,003] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:00,029] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:00,056] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:05,089] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:05,115] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:05,139] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:10,177] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:10,207] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:10,241] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:15,277] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:15,303] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:15,327] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:20,356] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:20,382] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:20,404] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:25,440] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:25,463] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:25,488] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:30,513] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:30,539] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:30,563] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:35,599] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:35,625] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:35,650] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:40,688] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:40,714] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:40,738] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:45,777] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:45,803] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:45,828] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:50,857] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:50,886] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:50,910] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:16:55,949] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:16:55,977] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:16:56,010] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:01,041] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:01,070] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:01,094] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:06,131] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:06,159] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:06,188] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:11,217] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:11,243] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:11,271] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:16,306] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:16,334] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:16,364] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:21,395] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:21,418] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:21,441] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:26,471] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket default is 15001
|
[2015-06-30 05:17:26,497] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_1 is 0
|
[2015-06-30 05:17:26,523] - [xdcrnewbasetests:2204] INFO - Current Outbound mutations on cluster node: C1 for bucket sasl_bucket_2 is 0
|
[2015-06-30 05:17:31,528] - [xdcrnewbasetests:2216] ERROR - Timeout occurs while waiting for mutations to be replicated
|
[2015-06-30 05:17:31,529] - [xdcrnewbasetests:2190] INFO - Waiting for Outbound mutation to be zero on cluster node: 172.23.106.47
|
[2015-06-30 05:17:31,549] - [xdcrnewbasetests:2200] ERROR - Stat "replication_changes_left" not found
|
[2015-06-30 05:17:31,723] - [xdcrnewbasetests:2064] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, default bucket
|
[2015-06-30 05:17:31,880] - [xdcrnewbasetests:2064] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, sasl_bucket_1 bucket
|
[2015-06-30 05:17:32,056] - [xdcrnewbasetests:2064] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, sasl_bucket_2 bucket
|
[2015-06-30 05:17:32,214] - [xdcrnewbasetests:2098] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, default bucket
|
[2015-06-30 05:17:32,356] - [xdcrnewbasetests:2098] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, sasl_bucket_1 bucket
|
[2015-06-30 05:17:32,495] - [xdcrnewbasetests:2098] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, sasl_bucket_2 bucket
|
[2015-06-30 05:17:32,647] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:17:37,722] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:17:42,779] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:17:47,859] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:17:52,918] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:17:58,007] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:03,074] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:08,145] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:13,214] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:18,282] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:23,344] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:28,408] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:33,478] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:38,546] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:43,606] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:48,661] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:53,717] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:18:58,771] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:03,838] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:08,903] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:13,972] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:19,044] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:24,115] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:29,183] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:34,256] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:39,325] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:44,401] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:49,477] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:54,546] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:19:59,614] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:04,673] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:09,744] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:14,821] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:19,999] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:25,067] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:30,142] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:35,212] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:40,273] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:45,332] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:50,405] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:20:55,606] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:00,666] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:05,731] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:10,795] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:15,886] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:20,975] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:26,043] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:31,107] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:36,179] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:41,236] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:46,299] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:51,359] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:21:56,424] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:01,484] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:06,553] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:11,614] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:16,678] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:21,757] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:26,815] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:31,889] - [xdcrnewbasetests:2053] WARNING - Not Ready: vb_active_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:36,891] - [xdcrnewbasetests:2057] ERROR - ERROR: Timed-out waiting for active item count to match
|
[2015-06-30 05:22:37,026] - [xdcrnewbasetests:2064] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C2, sasl_bucket_1 bucket
|
[2015-06-30 05:22:37,190] - [xdcrnewbasetests:2064] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C2, sasl_bucket_2 bucket
|
[2015-06-30 05:22:37,334] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:40,416] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:43,476] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:46,539] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:49,602] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:52,668] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:55,816] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:22:58,869] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:01,931] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:04,988] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:08,048] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:11,130] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:14,186] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:17,261] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:20,324] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:23,376] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:26,446] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:29,516] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:32,580] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:35,661] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:38,721] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:41,784] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:44,847] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:47,915] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:50,978] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:54,041] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:23:57,120] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:00,187] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:03,249] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:06,307] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:09,367] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:12,432] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:15,507] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:18,574] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:21,664] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:24,740] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:27,811] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:30,876] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:33,940] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:36,996] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:40,074] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:43,126] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:46,186] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:49,246] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:52,308] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:55,612] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:24:58,665] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:01,718] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:04,779] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:07,840] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:10,894] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:13,967] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:17,047] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:20,114] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:23,180] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:26,240] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:29,299] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:32,362] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:35,442] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:38,505] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:41,558] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:44,622] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:47,689] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:50,745] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:53,819] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:56,876] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:25:59,923] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:02,980] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:06,044] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:09,097] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:12,166] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:15,225] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:18,286] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:21,352] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:24,416] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:27,469] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:30,532] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:33,596] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:36,658] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:39,727] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:42,802] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:45,867] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:48,938] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:51,996] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:55,203] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:26:58,255] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:01,310] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:04,363] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:07,422] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:10,495] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:13,546] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:16,596] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:19,667] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:22,727] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:25,783] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:28,840] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:31,897] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:34,954] - [xdcrnewbasetests:2086] WARNING - Not Ready: vb_replica_curr_items 77500 == 70000 expected on C2, default bucket
|
[2015-06-30 05:27:37,958] - [xdcrnewbasetests:2090] ERROR - ERROR: Timed-out waiting for replica item count to match
|
For ~28 mins, we could not replicate to the warmed-up node. See logs from .45. No errors reported.
StatisticsManager 2015-06-30T05:13:12.201-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:13:13.216-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:13:14.220-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
:
|
:
|
|
|
StatisticsManager 2015-06-30T05:40:04.199-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:05.201-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:06.205-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:07.210-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:08.209-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:09.208-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
StatisticsManager 2015-06-30T05:40:10.200-07:00 [INFO] 9bf49599e2038e6c5ae731e0239cfb2f/default/default total_docs=80000, docs_processed=64999, changes_left=15001
|
|
|
StatisticsManager 2015-06-30T05:40:01.222-07:00 [INFO] Stats for pipeline 9bf49599e2038e6c5ae731e0239cfb2f/default/default-213570209 {"CkptMgr": {"num_checkpoints": 34, "num_failedckpts": 0, "time_committing": {"count": 34, "max": 34000, "mean": 7529.411764705882, "min": 4000}}, "Errors": "[]", "Overview": {"bandwidth_usage": 0, "changes_left": 15001, "data_replicated": 33331099, "dcp_datach_length": 1000, "dcp_dispatch_time": 30, "deletion_docs_written": 7500, "deletion_failed_cr_source": 0, "deletion_filtered": 0, "deletion_received_from_dcp": 7500, "docs_checked": 64862, "docs_failed_cr_source": 0, "docs_filtered": 0, "docs_opt_repd": 7500, "docs_processed": 64999, "docs_received_from_dcp": 70051, "docs_rep_queue": 5000, "docs_written": 64999, "expiry_docs_written": 0, "expiry_failed_cr_source": 0, "expiry_filtered": 0, "expiry_received_from_dcp": 0, "num_checkpoints": 34, "num_failedckpts": 0, "rate_doc_checks": 0, "rate_doc_opt_repd": 0, "rate_received_from_dcp": 0, "rate_replicated": 0, "set_docs_written": 57499, "set_failed_cr_source": 0, "set_filtered": 0, "set_received_from_dcp": 62551, "size_rep_queue": 2857328, "time_committing": 7529, "wtavg_docs_latency": 0, "wtavg_meta_latency": 25}, "Progress": "Pipeline is running", "Router_dcp_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.45:11210_0": {"deletion_filtered": 0, "docs_filtered": 0, "expiry_filtered": 0, "set_filtered": 0}, "Router_dcp_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.45:11210_1": {"deletion_filtered": 0, "docs_filtered": 0, "expiry_filtered": 0, "set_filtered": 0}, "Status": "Replicating", "dcp_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.45:11210_0": {"dcp_datach_length": 0, "dcp_dispatch_time": {"count": 39998, "max": 2086, "mean": 37.253, "min": 11}, "deletion_received_from_dcp": 7500, "docs_received_from_dcp": 39998, "expiry_received_from_dcp": 0, "set_received_from_dcp": 32498}, "dcp_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.45:11210_1": {"dcp_datach_length": 1000, "dcp_dispatch_time": {"count": 30052, "max": 292, "mean": 22.053, "min": 9}, "deletion_received_from_dcp": 0, "docs_received_from_dcp": 30053, "expiry_received_from_dcp": 0, "set_received_from_dcp": 30053}, "xmem_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.47:11210_0": {"data_replicated": 19033308, "deletion_docs_written": 7500, "deletion_failed_cr_source": 0, "docs_failed_cr_source": 0, "docs_opt_repd": 7500, "docs_rep_queue": 0, "docs_written": 39998, "expiry_docs_written": 0, "expiry_failed_cr_source": 0, "set_docs_written": 32498, "set_failed_cr_source": 0, "size_rep_queue": 0, "wtavg_docs_latency": {"count": 39998, "max": 0, "mean": 0, "min": 0}, "wtavg_meta_latency": {"count": 31998, "max": 68, "mean": 26.076, "min": 1}}, "xmem_9bf49599e2038e6c5ae731e0239cfb2f/default/default_172.23.106.47:11210_1": {"data_replicated": 14297791, "deletion_docs_written": 0, "deletion_failed_cr_source": 0, "docs_failed_cr_source": 0, "docs_opt_repd": 0, "docs_rep_queue": 5000, "docs_written": 25001, "expiry_docs_written": 0, "expiry_failed_cr_source": 0, "set_docs_written": 25001, "set_failed_cr_source": 0, "size_rep_queue": 2857328, "wtavg_docs_latency": {"count": 25001, "max": 0, "mean": 0, "min": 0}, "wtavg_meta_latency": {"count": 25001, "max": 395, "mean": 24.976, "min": 1}}}
|
Attachments
Issue Links
- duplicates
-
-
- Closed
-