Description
Build
4.5.0-2016
Testcase
./testrunner -i INI_FILE.ini -p get-cbcollect-info=True,get-logs=False,stop-on-failure=False,index_retry=10,GROUP=P0 -t fts.moving_topology_fts.MovingTopFTS.rebalance_out_during_index_building,items=30000,cluster=D,F,F,index_replicas=1,standard_buckets=2,sasl_buckets=2,GROUP=P0
An offshoot of MB-19037 where after the rebalance hang, in the tear down phase, we
1. delete the indexes by means of rest calls
2. then delete the buckets
3. and then rebalance out the nodes.
It looks like a particular index is still undeleted while the buckets are all gone. This causes the cluster to end up in a weird state that causes step3 to never succeed.
Given a live cluster, Steve pointed out the following from logs-
Arunas-MacBook-Pro:testrunner apiravi$ curl http://Administrator:password@172.23.106.66:8094/api/pindex |python -m json.tool
|
% Total % Received % Xferd Average Speed Time Time Time Current
|
Dload Upload Total Spent Left Speed
|
100 26983 0 26983 0 0 310k 0 --:--:-- --:--:-- --:--:-- 310k
|
{
|
"pindexes": {
|
"sasl_bucket_2_index_1_179454a22e7cd308_0a44bddb": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_0a44bddb",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,701,702,703",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "1d2dc585d10f13a1"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_0ffd4517": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_0ffd4517",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "352,353,354,355,356,357,358,359,360,361,362,363,364,365,366,367,368,369,370,371,372,373,374,375,376,377,378,379,380,381,382,383",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "fe4cdc02cb2f7be4"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_24e7ea2d": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_24e7ea2d",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,794,795,796,797,798,799",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "50cb872588416a3b"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_27184a97": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_27184a97",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "288,289,290,291,292,293,294,295,296,297,298,299,300,301,302,303,304,305,306,307,308,309,310,311,312,313,314,315,316,317,318,319",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "2a54d8e1072a636b"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_321cbb28": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_321cbb28",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "480,481,482,483,484,485,486,487,488,489,490,491,492,493,494,495,496,497,498,499,500,501,502,503,504,505,506,507,508,509,510,511",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "50dcb11cc5b70b45"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_348f5c3c": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_348f5c3c",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "928,929,930,931,932,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "b3c92f0d6ff411d6"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_37fdcf3c": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_37fdcf3c",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "704,705,706,707,708,709,710,711,712,713,714,715,716,717,718,719,720,721,722,723,724,725,726,727,728,729,730,731,732,733,734,735",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "3c4e217b2dbdbd00"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_3cf74ad7": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_3cf74ad7",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "800,801,802,803,804,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,821,822,823,824,825,826,827,828,829,830,831",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "5a490924cb24ee2d"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_4728ab89": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_4728ab89",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "576,577,578,579,580,581,582,583,584,585,586,587,588,589,590,591,592,593,594,595,596,597,598,599,600,601,602,603,604,605,606,607",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "5986391b9e1c9ef7"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_4a7ce4ca": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_4a7ce4ca",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "832,833,834,835,836,837,838,839,840,841,842,843,844,845,846,847,848,849,850,851,852,853,854,855,856,857,858,859,860,861,862,863",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "1522eff28217ed07"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_4cdba0cf": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_4cdba0cf",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "192,193,194,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,215,216,217,218,219,220,221,222,223",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "2d4a8df95bd6569a"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_54127e67": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_54127e67",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "736,737,738,739,740,741,742,743,744,745,746,747,748,749,750,751,752,753,754,755,756,757,758,759,760,761,762,763,764,765,766,767",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "6e13048466489b21"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_577e9974": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_577e9974",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "960,961,962,963,964,965,966,967,968,969,970,971,972,973,974,975,976,977,978,979,980,981,982,983,984,985,986,987,988,989,990,991",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "2b569d90d581185a"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_596cc6a1": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_596cc6a1",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "864,865,866,867,868,869,870,871,872,873,874,875,876,877,878,879,880,881,882,883,884,885,886,887,888,889,890,891,892,893,894,895",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "16a4a06e016acf80"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_5b1351c0": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_5b1351c0",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,407,408,409,410,411,412,413,414,415",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "6bc120aef90d9a3a"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_5c5f941e": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_5c5f941e",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "512,513,514,515,516,517,518,519,520,521,522,523,524,525,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "26b038d14d73d9bb"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_63ef8109": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_63ef8109",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "992,993,994,995,996,997,998,999,1000,1001,1002,1003,1004,1005,1006,1007,1008,1009,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "41c26aee3d290c71"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_76ac2a42": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_76ac2a42",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "256,257,258,259,260,261,262,263,264,265,266,267,268,269,270,271,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "12a69b8a7f0a0ac7"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_77082885": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_77082885",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "608,609,610,611,612,613,614,615,616,617,618,619,620,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "22d70e78554cc9de"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_8b80958a": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_8b80958a",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "5435de7728c449c5"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_9284f0ad": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_9284f0ad",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "e021e38109c1f642"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_9e13fa43": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_9e13fa43",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "448,449,450,451,452,453,454,455,456,457,458,459,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "5cb16cd3e2948551"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_a4a23588": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_a4a23588",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,246,247,248,249,250,251,252,253,254,255",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "3aa620e60aa2365b"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_b7ff6b68": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_b7ff6b68",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "2335c664c18ec657"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_cd5a61e8": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_cd5a61e8",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "640,641,642,643,644,645,646,647,648,649,650,651,652,653,654,655,656,657,658,659,660,661,662,663,664,665,666,667,668,669,670,671",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "3266e9b3717c28a6"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_d6109bff": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_d6109bff",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "320,321,322,323,324,325,326,327,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,346,347,348,349,350,351",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "744612071c71bad9"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_d8c75a95": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_d8c75a95",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "896,897,898,899,900,901,902,903,904,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "540e22908dd18c38"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_d90ca3e7": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_d90ca3e7",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "64ebd8894c96dff1"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_dee61dfa": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_dee61dfa",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "544,545,546,547,548,549,550,551,552,553,554,555,556,557,558,559,560,561,562,563,564,565,566,567,568,569,570,571,572,573,574,575",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "7792bf8fb25345ca"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_e64340fa": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_e64340fa",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "416,417,418,419,420,421,422,423,424,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,440,441,442,443,444,445,446,447",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "324ad0dfae9a0d8c"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_ee590b16": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_ee590b16",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "2878e5efee451534"
|
},
|
"sasl_bucket_2_index_1_179454a22e7cd308_f17535e5": {
|
"indexName": "sasl_bucket_2_index_1",
|
"indexParams": "{}",
|
"indexType": "fulltext-index",
|
"indexUUID": "179454a22e7cd308",
|
"name": "sasl_bucket_2_index_1_179454a22e7cd308_f17535e5",
|
"sourceName": "sasl_bucket_2",
|
"sourceParams": "{\"authPassword\":\"password\",\"authSaslPassword\":\"\",\"authSaslUser\":\"\",\"authUser\":\"sasl_bucket_2\",\"clusterManagerBackoffFactor\":0,\"clusterManagerSleepInitMS\":0,\"clusterManagerSleepMaxMS\":20000,\"dataManagerBackoffFactor\":0,\"dataManagerSleepInitMS\":0,\"dataManagerSleepMaxMS\":20000,\"feedBufferAckThreshold\":0,\"feedBufferSizeBytes\":0}",
|
"sourcePartitions": "160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191",
|
"sourceType": "couchbase",
|
"sourceUUID": "",
|
"uuid": "62c3ddbb525c896e"
|
}
|
},
|
"status": "ok"
|
}
|
and
"2016-04-07T13:21:12.821-07:00 [INFO] feed_dcp: OnError, name: sasl_bucket_2_index_1_179454a22e7cd308: bucketName: sasl_bucket_2, bucketUUID: , err: No bucket named sasl_bucket_2\n",
|
"2016-04-07T13:21:12.821-07:00 [INFO] feed_dcp: OnError, name: sasl_bucket_2_index_1_179454a22e7cd308: bucketName: sasl_bucket_2, bucketUUID: , err: could not connect to any serverURL: []string{\"http://127.0.0.1:8091\"}\n",
|
"2016-04-07T13:21:12.821-07:00 [INFO] main: meh.OnFeedError, srcType: couchbase, err: could not connect to any serverURL: []string{\"http://127.0.0.1:8091\"}\n",
|
"2016-04-07T13:21:12.821-07:00 [INFO] main: meh.OnFeedError, srcType: couchbase, err: No bucket named sasl_bucket_2\n",
|
"2016-04-07T13:21:12.826-07:00 [INFO] main: meh.OnFeedError, VerifyBucketNotExists, srcType: couchbase, gone: true, err: No bucket named sasl_bucket_2\n",
|
"2016-04-07T13:21:12.826-07:00 [INFO] main: meh.OnFeedError, DeleteAllIndexFromSource, srcType: couchbase, bucketName: sasl_bucket_2, bucketUUID: \n"
|
Attaching cbcollect from all nodes.
Attachments
Issue Links
- relates to
-
MB-19037 [FTS] MCP: Rebalance of fts nodes repeatedly fails after metakv conflict
-
- Closed
-
| For Gerrit Dashboard: MB-19117 | ||||||
|---|---|---|---|---|---|---|
| # | Subject | Branch | Project | Status | CR | V |
| 62592,2 | MB-19117 - DeleteAllIndexFromSource renames bucket verbiage | master | cbgt | Status: MERGED | +2 | +1 |
| 62593,2 | MB-19117 - DeleteAllIndexFromSource finishes loop, even on err | master | cbgt | Status: MERGED | +2 | +1 |
| 62594,2 | MB-19117 - DeleteIndexEx API provides index UUID matching | master | cbgt | Status: MERGED | +2 | +1 |
| 62595,2 | MB-19117 - DeleteAllIndexFromSource invokes new BumpIndexDefs | master | cbgt | Status: MERGED | +2 | +1 |