Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-15688

[Windows] GoXDCR: Some keys not replicated

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 4.0.0
    • 4.0.0
    • XDCR
    • Security Level: Public

    Description

      Build
      ------
      4.0.0-3402

      Testcase
      --------
      ./testrunner i win_2012_x64105_02-XDCR_SSL-P0.ini get-cbcollect-info=True,get-logs=False,stop-on-failure=False,fail_on_errors=1 -t xdcr.biXDCR.bidirectional.replication_with_disabled_ddoc_compaction,items=20000,sasl_buckets=1,update=C1-C2,delete=C1-C2,disable_src_comp=False,rdirection=bidirection

      [2015-07-13 18:20:52,415] - [xdcrnewbasetests:2063] INFO - Saw: vb_active_curr_items 40000 == 40000 expected on C1, default bucket
      [2015-07-13 18:20:52,535] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:20:57,624] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:02,712] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:08,022] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:13,109] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:18,192] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:23,265] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:28,354] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:33,442] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:38,514] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:43,602] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:48,686] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:53,755] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:21:58,835] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:03,927] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:09,001] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:14,073] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:19,159] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:24,251] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:29,327] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:34,416] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:39,504] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:44,590] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:49,672] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:54,753] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:22:59,851] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:04,937] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:10,022] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:15,116] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:20,218] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:25,304] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:30,391] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:35,490] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:40,587] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:45,675] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:50,766] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:23:55,856] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:00,942] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:06,029] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:11,116] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:16,204] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:21,282] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:26,369] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:31,465] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:36,554] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:41,660] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:46,742] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:51,821] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:24:56,906] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:01,998] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:07,088] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:12,404] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:17,491] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:22,585] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:27,678] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:32,760] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:37,840] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:42,937] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:48,023] - [xdcrnewbasetests:2052] WARNING - Not Ready: vb_active_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:53,029] - [xdcrnewbasetests:2056] ERROR - ERROR: Timed-out waiting for active item count to match
      [2015-07-13 18:25:53,165] - [xdcrnewbasetests:2097] INFO - Saw: vb_replica_curr_items 40000 == 40000 expected on C1, default bucket
      [2015-07-13 18:25:53,288] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:56,356] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:25:59,426] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:02,518] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:05,598] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:08,696] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:11,773] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:14,843] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:17,921] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:21,013] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:24,087] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:27,167] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:30,252] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:33,324] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:36,422] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:39,493] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:42,594] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:45,680] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:48,763] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:51,851] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:54,928] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:26:58,029] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:01,100] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:04,180] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:07,330] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:10,424] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:13,519] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:16,605] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:19,687] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:22,766] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:25,846] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:28,940] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:32,027] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:35,122] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:38,213] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:41,281] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:44,371] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:47,456] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:50,545] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:53,613] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:56,707] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:27:59,796] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:02,880] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:05,966] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:09,044] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:12,123] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:15,205] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:18,290] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:21,364] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:24,458] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:27,546] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:30,627] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:33,702] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:36,777] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:39,868] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:42,942] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:46,029] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:49,116] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:52,208] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:55,299] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:28:58,390] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:01,483] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:04,569] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:07,735] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:10,816] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:13,889] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:16,975] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:20,069] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:23,144] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:26,237] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:29,315] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:32,397] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:35,478] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:38,549] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:41,621] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:44,706] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:47,791] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:50,877] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:53,956] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:29:57,046] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:00,138] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:03,217] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:06,302] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:09,386] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:12,470] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:15,556] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:18,626] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:21,701] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:24,777] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:27,855] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:30,952] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:34,025] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:37,114] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:40,204] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:43,288] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:46,366] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:49,436] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:52,519] - [xdcrnewbasetests:2085] WARNING - Not Ready: vb_replica_curr_items 30000 == 40000 expected on C1, sasl_bucket_1 bucket
      [2015-07-13 18:30:55,522] - [xdcrnewbasetests:2089] ERROR - ERROR: Timed-out waiting for replica item count to match
      [2015-07-13 18:30:55,523] - [remote_util:158] INFO - connecting to 172.23.107.67 with username : Administrator password : Membase123 ssh_key: 
      [2015-07-13 18:31:00,447] - [remote_util:191] INFO - Connected to 172.23.107.67
      [2015-07-13 18:31:00,448] - [xdcrnewbasetests:2117] INFO - Executing cbvdiff for bucket default
      [2015-07-13 18:31:00,984] - [remote_util:754] INFO - File /cygdrive/c/Windows/win.ini was found
      [2015-07-13 18:31:00,984] - [remote_util:2108] INFO - This is windows server!
      [2015-07-13 18:31:01,115] - [remote_util:754] INFO - File /cygdrive/c/tmp/windows_info.txt was found
      [2015-07-13 18:31:01,213] - [remote_util:795] INFO - get windows information
      [2015-07-13 18:31:01,225] - [remote_util:1919] INFO - running command.raw on 172.23.107.67: hostname
      [2015-07-13 18:31:01,423] - [remote_util:1956] INFO - command executed successfully
      [2015-07-13 18:31:01,424] - [remote_util:1919] INFO - running command.raw on 172.23.107.67: echo "ipconfig" > /tmp/cmd.bat; /tmp/cmd.bat
      [2015-07-13 18:31:01,746] - [remote_util:1956] INFO - command executed successfully
      [2015-07-13 18:31:01,748] - [remote_util:1919] INFO - running command.raw on 172.23.107.67: /cygdrive/c/Program\ Files/Couchbase/Server/bin/cbvdiff.exe -b default 172.23.107.67:11210,172.23.107.68:11210 
      [2015-07-13 18:31:03,964] - [remote_util:1956] INFO - command executed successfully
      [2015-07-13 18:31:03,965] - [remote_util:1858] INFO - Active item count = 40000
      [2015-07-13 18:31:03,966] - [remote_util:1858] INFO - 
      [2015-07-13 18:31:03,966] - [xdcrnewbasetests:2117] INFO - Executing cbvdiff for bucket sasl_bucket_1
      [2015-07-13 18:31:03,966] - [remote_util:1919] INFO - running command.raw on 172.23.107.67: /cygdrive/c/Program\ Files/Couchbase/Server/bin/cbvdiff.exe -b sasl_bucket_1 -p password 172.23.107.67:11210,172.23.107.68:11210 
      [2015-07-13 18:31:06,323] - [remote_util:1956] INFO - command executed successfully
      [2015-07-13 18:31:06,324] - [remote_util:1858] INFO - Active item count = 30000
      [2015-07-13 18:31:06,324] - [remote_util:1858] INFO - 
      [2015-07-13 18:31:06,565] - [xdcrnewbasetests:2063] INFO - Saw: vb_active_curr_items 40000 == 40000 expected on C2, default bucket
      [2015-07-13 18:31:06,692] - [xdcrnewbasetests:2063] INFO - Saw: vb_active_curr_items 40000 == 40000 expected on C2, sasl_bucket_1 bucket
      [2015-07-13 18:31:06,807] - [xdcrnewbasetests:2097] INFO - Saw: vb_replica_curr_items 40000 == 40000 expected on C2, default bucket
      [2015-07-13 18:31:06,939] - [xdcrnewbasetests:2097] INFO - Saw: vb_replica_curr_items 40000 == 40000 expected on C2, sasl_bucket_1 bucket
      [2015-07-13 18:31:07,057] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 default
      [2015-07-13 18:31:07,332] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 default
      [2015-07-13 18:31:07,494] - [task:1358] INFO - 40000 items will be verified on default bucket
      [2015-07-13 18:31:08,271] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 sasl_bucket_1
      [2015-07-13 18:31:08,415] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 sasl_bucket_1
      [2015-07-13 18:31:08,476] - [task:1367] INFO - 0 items were verified
      [2015-07-13 18:31:08,918] - [task:1358] INFO - 40000 items will be verified on sasl_bucket_1 bucket
      [2015-07-13 18:31:09,478] - [task:1367] INFO - 0 items were verified
      [('/usr/lib64/python2.7/threading.py', 784, '__bootstrap', 'self.__bootstrap_inner()'), ('/usr/lib64/python2.7/threading.py', 811, '__bootstrap_inner', 'self.run()'), ('lib/tasks/task.py', 624, 'run', 'self.next()'), ('lib/tasks/task.py', 1378, 'next', 'self._check_valid_keys(keys_batch)'), ('lib/tasks/task.py', 1390, '_check_valid_keys', 'self.set_exception(error)'), ('lib/tasks/future.py', 264, 'set_exception', 'print traceback.extract_stack()')]
      Mon Jul 13 18:31:09 2015
      [2015-07-13 18:31:14,239] - [task:1367] INFO - 10000 items were verified
      [2015-07-13 18:31:19,400] - [task:1367] INFO - 20000 items were verified
      [2015-07-13 18:31:24,457] - [task:1367] INFO - 30000 items were verified
      [2015-07-13 18:31:29,598] - [task:1367] INFO - 40000 items were verified
      [2015-07-13 18:31:29,598] - [task:1371] INFO - 40000 items were verified in 22.1039791107 sec.the average number of ops                - 1809.62869275 per second
      [('/usr/lib64/python2.7/threading.py', 784, '__bootstrap', 'self.__bootstrap_inner()'), ('/usr/lib64/python2.7/threading.py', 811, '__bootstrap_inner', 'self.run()'), ('./testrunner.py', 262, 'run', '**self._Thread__kwargs)'), ('/usr/lib64/python2.7/unittest/runner.py', 151, 'run', 'test(result)'), ('/usr/lib64/python2.7/unittest/case.py', 433, '__call__', 'return self.run(*args, **kwds)'), ('/usr/lib64/python2.7/unittest/case.py', 369, 'run', 'testMethod()'), ('pytests/xdcr/biXDCR.py', 343, 'replication_with_disabled_ddoc_compaction', 'self.verify_results()'), ('pytests/xdcr/xdcrnewbasetests.py', 3039, 'verify_results', 'src_cluster.verify_data(max_verify=self._max_verify)'), ('pytests/xdcr/xdcrnewbasetests.py', 2149, 'verify_data', 'task.result(timeout)'), ('lib/tasks/future.py', 153, 'result', 'return self.__get_result()'), ('lib/tasks/future.py', 111, '__get_result', 'print traceback.extract_stack()')]
      [2015-07-13 18:31:29,599] - [xdcrnewbasetests:3042] ERROR - Not able to get values for following keys - set(['C2-key-8101', 'C2-key-4270', 'C2-key-12204', 'C2-key-5674', 'C2-key-1921', 'C2-key-4884', 'C2-key-14072', 'C2-key-16792', 'C2-key-711', 'C2-key-18286', 'C2-key-17515', 'C2-key-2737', 'C2-key-16572', 'C2-key-13504', 'C2-key-4613', 'C2-key-7445', 'C2-key-1633', 'C2-key-9601', 'C2-key-19779', 'C2-key-3842', 'C2-key-17176', 'C2-key-16489', 'C2-key-3365', 'C2-key-10187', 'C2-key-8630', 'C2-key-6008', 'C2-key-14818', 'C2-key-3731', 'C2-key-12631', 'C2-key-862', 'C2-key-2019', 'C2-key-15724', 'C2-key-11349', 'C2-key-12381', 'C2-key-7039', 'C2-key-11583', 'C2-key-17224', 'C2-key-6711', 'C2-key-443', 'C2-key-3028', 'C2-key-5882', 'C2-key-19001', 'C2-key-8253', 'C2-key-747', 'C2-key-1968', 'C2-key-16608', 'C2-key-11763', 'C2-key-10367', 'C2-key-2465', 'C2-key-694', 'C2-key-12149', 'C2-key-13944', 'C2-key-16111', 'C2-key-9553', 'C2-key-14196', 'C2-key-3683', 'C2-key-4247', 'C2-key-5622', 'C2-key-12891', 'C2-key-19822', 'C2-key-13387', 'C2-key-6345', 'C2-key-17886', 'C2-key-8555', 'C2-key-14447', 'C2-key-2761', 'C2-key-10704', 'C2-key-13167', 'C2-key-2050', 'C2-key-22', 'C2-key-2298', 'C2-key-4394', 'C2-key-986', 'C2-key-1154', 'C2-key-8782', 'C2-key-17120', 'C2-key-5241', 'C2-key-16880', 'C2-key-15860', 'C2-key-6758', 'C2-key-8915', 'C2-key-8607', 'C2-key-15984', 'C2-key-3706', 'C2-key-12667', 'C2-key-6192', 'C2-key-9179', 'C2-key-2183', 'C2-key-18748', 'C2-key-19280', 'C2-key-15469', 'C2-key-15713', 'C2-key-2988', 'C2-key-15', 'C2-key-11838', 'C2-key-1500', 'C2-key-13888', 'C2-key-4569', 'C2-key-16905', 'C2-key-9203', 'C2-key-2873', 'C2-key-13083', 'C2-key-14715', 'C2-key-2728', 'C2-key-13533', 'C2-key-7472', 'C2-key-18355', 'C2-key-9636', 'C2-key-18362', 'C2-key-17169', 'C2-key-7805', 'C2-key-8136', 'C2-key-10198', 'C2-key-15829', 'C2-key-14807', 'C2-key-10752', 'C2-key-6017', 'C2-key-3587', 'C2-key-18701', 'C2-key-14320', 'C2-key-10283', 'C2-key-7026', 'C2-key-3056', 'C2-key-8943', 'C2-key-18018', 'C2-key-6999', 'C2-key-9386', 'C2-key-1977', 'C2-key-2844', 'C2-key-8380', 'C2-key-739', 'C2-key-12085', 'C2-key-10378', 'C2-key-1383', 'C2-key-18405', 'C2-key-1549', 'C2-key-16126', 'C2-key-13973', 'C2-key-9564', 'C2-key-12156', 'C2-key-4258', 'C2-key-17794', 'C2-key-17658', 'C2-key-9896', 'C2-key-4090', 'C2-key-4901', 'C2-key-14292', 'C2-key-1098', 'C2-key-6372', 'C2-key-17899', 'C2-key-4672', 'C2-key-2067', 'C2-key-7589', 'C2-key-13119', 'C2-key-12975', 'C2-key-19599', 'C2-key-7343', 'C2-key-3823', 'C2-key-1163', 'C2-key-15370', 'C2-key-17092', 'C2-key-12923', 'C2-key-11431', 'C2-key-5276', 'C2-key-10821', 'C2-key-15015', 'C2-key-17272', 'C2-key-8618', 'C2-key-10002', 'C2-key-5930', 'C2-key-6747', 'C2-key-12619', 'C2-key-7692', 'C2-key-6069', 'C2-key-3719', 'C2-key-17389', 'C2-key-15476', 'C2-key-18757', 'C2-key-14470', 'C2-key-11285', 'C2-key-12128', 'C2-key-11995', 'C2-key-7769', 'C2-key-13628', 'C2-key-7011', 'C2-key-3000', 'C2-key-11846', 'C2-key-3435', 'C2-key-1940', 'C2-key-422', 'C2-key-1219', 'C2-key-14013', 'C2-key-4517', 'C2-key-9234', 'C2-key-16170', 'C2-key-14722', 'C2-key-8157', 'C2-key-19718', 'C2-key-289', 'C2-key-74', 'C2-key-11065', 'C2-key-9629', 'C2-key-1893', 'C2-key-7720', 'C2-key-6020', 'C2-key-10765', 'C2-key-2031', 'C2-key-12942', 'C2-key-3814', 'C2-key-9082', 'C2-key-11810', 'C2-key-17245', 'C2-key-8974', 'C2-key-6739', 'C2-key-9151', 'C2-key-9130', 'C2-key-726', 'C2-key-5392', 'C2-key-11702', 'C2-key-18432', 'C2-key-1556', 'C2-key-345', 'C2-key-9972', 'C2-key-5643', 'C2-key-1087', 'C2-key-14045', 'C2-key-9889', 'C2-key-18299', 'C2-key-2700', 'C2-key-19586', 'C2-key-18182', 'C2-key-7864', 'C2-key-15801', 'C2-key-14866', 'C2-key-4115', 'C2-key-12606', 'C2-key-1102', 'C2-key-18760', 'C2-key-18989', 'C2-key-3037', 'C2-key-19364', 'C2-key-15022', 'C2-key-16617', 'C2-key-17396', 'C2-key-12554', 'C2-key-6289', 'C2-key-2452', 'C2-key-4508', 'C2-key-12137', 'C2-key-13552', 'C2-key-13398', 'C2-key-3454', 'C2-key-19815', 'C2-key-18303', 'C2-key-13178', 'C2-key-2287', 'C2-key-18334', 'C2-key-17522', 'C2-key-15074', 'C2-key-11827', 'C2-key-17647', 'C2-key-9166', 'C2-key-1561', 'C2-key-13600', 'C2-key-9505', 'C2-key-7741', 'C2-key-5096'])
      [2015-07-13 18:31:29,600] - [xdcrnewbasetests:2823] INFO - Verifying RevIds for Couchbase Cluster: C1, Master Ip: 172.23.107.67 -> Couchbase Cluster: C2, Master Ip: 172.23.107.69, bucket default
      [2015-07-13 18:31:29,684] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 default
      [2015-07-13 18:31:29,798] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 default
      [2015-07-13 18:31:30,054] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 default
      [2015-07-13 18:31:30,164] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 default
      [2015-07-13 18:31:30,316] - [data_helper:295] INFO - creating direct client 172.23.107.69:11210 default
      [2015-07-13 18:31:30,424] - [data_helper:295] INFO - creating direct client 172.23.107.70:11210 default
      [2015-07-13 18:31:30,653] - [task:1471] INFO - RevID verification: in progress for default ...
      [2015-07-13 18:31:30,653] - [xdcrnewbasetests:2823] INFO - Verifying RevIds for Couchbase Cluster: C1, Master Ip: 172.23.107.67 -> Couchbase Cluster: C2, Master Ip: 172.23.107.69, bucket sasl_bucket_1
      [2015-07-13 18:31:30,750] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 sasl_bucket_1
      [2015-07-13 18:31:30,873] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 sasl_bucket_1
      [2015-07-13 18:31:31,061] - [data_helper:295] INFO - creating direct client 172.23.107.67:11210 sasl_bucket_1
      [2015-07-13 18:31:31,248] - [data_helper:295] INFO - creating direct client 172.23.107.68:11210 sasl_bucket_1
      [2015-07-13 18:31:31,444] - [data_helper:295] INFO - creating direct client 172.23.107.69:11210 sasl_bucket_1
      [2015-07-13 18:31:31,563] - [data_helper:295] INFO - creating direct client 172.23.107.70:11210 sasl_bucket_1
      [2015-07-13 18:31:31,933] - [task:1471] INFO - RevID verification: in progress for sasl_bucket_1 ...
      [2015-07-13 18:33:03,970] - [task:1479] INFO - RevId Verification : 40000 existing items have been verified
      [2015-07-13 18:33:03,971] - [task:1481] INFO - RevId Verification : 0 deleted items have been verified
      [2015-07-13 18:33:03,971] - [task:1484] INFO - RevId Verification : 0 keys were apparently filtered out and not found in target bucket
      [2015-07-13 18:33:25,595] - [task:1479] INFO - RevId Verification : 40000 existing items have been verified
      [2015-07-13 18:33:25,596] - [task:1481] INFO - RevId Verification : 0 deleted items have been verified
      [2015-07-13 18:33:25,596] - [task:1484] INFO - RevId Verification : 0 keys were apparently filtered out and not found in target bucket
      [2015-07-13 18:33:25,741] - [xdcrnewbasetests:2843] ERROR - 10000 keys not found on 172.23.107.67, printing first 100 keys: [('key: C2-key-1921', 'vbucket: 357'), ('key: C2-key-4884', 'vbucket: 508'), ('key: C2-key-16792', 'vbucket: 4'), ('key: C2-key-12204', 'vbucket: 268'), ('key: C2-key-17515', 'vbucket: 385'), ('key: C2-key-16572', 'vbucket: 259'), ('key: C2-key-7445', 'vbucket: 481'), ('key: C2-key-9601', 'vbucket: 443'), ('key: C2-key-17176', 'vbucket: 475'), ('key: C2-key-16489', 'vbucket: 139'), ('key: C2-key-3365', 'vbucket: 506'), ('key: C2-key-10187', 'vbucket: 147'), ('key: C2-key-6008', 'vbucket: 137'), ('key: C2-key-2019', 'vbucket: 503'), ('key: C2-key-11349', 'vbucket: 166'), ('key: C2-key-5674', 'vbucket: 70'), ('key: C2-key-11583', 'vbucket: 75'), ('key: C2-key-15829', 'vbucket: 459'), ('key: C2-key-17224', 'vbucket: 228'), ('key: C2-key-6711', 'vbucket: 257'), ('key: C2-key-726', 'vbucket: 79'), ('key: C2-key-11763', 'vbucket: 332'), ('key: C2-key-10367', 'vbucket: 404'), ('key: C2-key-694', 'vbucket: 119'), ('key: C2-key-14196', 'vbucket: 493'), ('key: C2-key-4247', 'vbucket: 471'), ('key: C2-key-5392', 'vbucket: 365'), ('key: C2-key-8555', 'vbucket: 347'), ('key: C2-key-14447', 'vbucket: 399'), ('key: C2-key-2761', 'vbucket: 290'), ('key: C2-key-19779', 'vbucket: 310'), ('key: C2-key-22', 'vbucket: 112'), ('key: C2-key-986', 'vbucket: 62'), ('key: C2-key-1154', 'vbucket: 93'), ('key: C2-key-15860', 'vbucket: 123'), ('key: C2-key-8607', 'vbucket: 100'), ('key: C2-key-3706', 'vbucket: 416'), ('key: C2-key-12667', 'vbucket: 342'), ('key: C2-key-13504', 'vbucket: 255'), ('key: C2-key-18748', 'vbucket: 416'), ('key: C2-key-14320', 'vbucket: 254'), ('key: C2-key-15713', 'vbucket: 367'), ('key: C2-key-1633', 'vbucket: 300'), ('key: C2-key-3454', 'vbucket: 159'), ('key: C2-key-13888', 'vbucket: 328'), ('key: C2-key-16905', 'vbucket: 316'), ('key: C2-key-13083', 'vbucket: 137'), ('key: C2-key-13533', 'vbucket: 438'), ('key: C2-key-7472', 'vbucket: 168'), ('key: C2-key-3842', 'vbucket: 509'), ('key: C2-key-9636', 'vbucket: 242'), ('key: C2-key-17169', 'vbucket: 127'), ('key: C2-key-10198', 'vbucket: 311'), ('key: C2-key-10752', 'vbucket: 474'), ('key: C2-key-6017', 'vbucket: 301'), ('key: C2-key-10283', 'vbucket: 440'), ('key: C2-key-8943', 'vbucket: 57'), ('key: C2-key-9386', 'vbucket: 461'), ('key: C2-key-2844', 'vbucket: 34'), ('key: C2-key-8380', 'vbucket: 18'), ('key: C2-key-739', 'vbucket: 491'), ('key: C2-key-10378', 'vbucket: 48'), ('key: C2-key-1383', 'vbucket: 19'), ('key: C2-key-18405', 'vbucket: 315'), ('key: C2-key-1549', 'vbucket: 254'), ('key: C2-key-422', 'vbucket: 356'), ('key: C2-key-9564', 'vbucket: 461'), ('key: C2-key-7720', 'vbucket: 407'), ('key: C2-key-4258', 'vbucket: 115'), ('key: C2-key-4508', 'vbucket: 75'), ('key: C2-key-4090', 'vbucket: 409'), ('key: C2-key-14292', 'vbucket: 198'), ('key: C2-key-1098', 'vbucket: 156'), ('key: C2-key-4672', 'vbucket: 409'), ('key: C2-key-19599', 'vbucket: 49'), ('key: C2-key-18334', 'vbucket: 94'), ('key: C2-key-1163', 'vbucket: 276'), ('key: C2-key-15015', 'vbucket: 323'), ('key: C2-key-8618', 'vbucket: 448'), ('key: C2-key-5930', 'vbucket: 27'), ('key: C2-key-12619', 'vbucket: 431'), ('key: C2-key-3719', 'vbucket: 4'), ('key: C2-key-15476', 'vbucket: 281'), ('key: C2-key-18757', 'vbucket: 4'), ('key: C2-key-14470', 'vbucket: 198'), ('key: C2-key-12128', 'vbucket: 202'), ('key: C2-key-7011', 'vbucket: 242'), ('key: C2-key-3000', 'vbucket: 396'), ('key: C2-key-1940', 'vbucket: 56'), ('key: C2-key-16170', 'vbucket: 4'), ('key: C2-key-9629', 'vbucket: 342'), ('key: C2-key-1893', 'vbucket: 349'), ('key: C2-key-17120', 'vbucket: 463'), ('key: C2-key-6020', 'vbucket: 100'), ('key: C2-key-10765', 'vbucket: 147'), ('key: C2-key-2031', 'vbucket: 282'), ('key: C2-key-12942', 'vbucket: 86'), ('key: C2-key-3814', 'vbucket: 489'), ('key: C2-key-17794', 'vbucket: 475'), ('key: C2-key-9082', 'vbucket: 230')]
      

      I do not see any outbound mutations pending for sasl_bucket on both .69 and .70 from logs, no errors either.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty