Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
4.5.0
-
Untriaged
-
No
Description
Build
4.5.0-2383
Testcase
./testrunner -i INI_FILE.ini -p GROUP=P1 -t fts.moving_topology_fts.MovingTopFTS.rebalance_out_during_querying,items=10000,cluster=D,D+F,F,num_queries=100,num_queries=100,GROUP=P1
Steps
1. Cluster: D,D+F,F
2. Create default index, load 10K docs.
3. Once indexing is complete, start rebalancing out an fts node.
4. Issue 100 queries in parallel
5. Rebalance fails with the below error.
May not be consistently reproducible.
[2016-04-26 12:44:07,738] - [rest_client:2523] ERROR - {u'node': u'ns_1@172.23.105.96', u'code': 2, u'text': u'Rebalance exited with reason {service_rebalance_failed,fts,\n {rebalance_failed,\n {service_error,\n <<"assignPIndex: update plan, perhaps a concurrent planner won, err: updatePlanPIndexes: planPIndex missing, indexDef.Name: default_index, pindex: default_index_2c9348abcb9d466b_9e13fa43, node: a6441e7e6afc112de4d0ecff28cdf0fb, state: \\"primary\\", op: promote, planPIndex: &cbgt.PlanPIndex{Name:\\"default_index_2c9348abcb9d466b_9e13fa43\\", UUID:\\"1ef78b9ab95bd726\\", IndexType:\\"fulltext-index\\", IndexName:\\"default_index\\", IndexUUID:\\"2c9348abcb9d466b\\", IndexParams:\\"{}\\", SourceType:\\"couchbase\\", SourceName:\\"default\\", SourceUUID:\\"\\", SourceParams:\\"{\\\\\\"authPassword\\\\\\":\\\\\\"\\\\\\",\\\\\\"authSaslPassword\\\\\\":\\\\\\"\\\\\\",\\\\\\"authSaslUser\\\\\\":\\\\\\"\\\\\\",\\\\\\"authUser\\\\\\":\\\\\\"default\\\\\\",\\\\\\"clusterManagerBackoffFactor\\\\\\":0,\\\\\\"clusterManagerSleepInitMS\\\\\\":0,\\\\\\"clusterManagerSleepMaxMS\\\\\\":20000,\\\\\\"dataManagerBackoffFactor\\\\\\":0,\\\\\\"dataManagerSleepInitMS\\\\\\":0,\\\\\\"dataManagerSleepMaxMS\\\\\\":20000,\\\\\\"feedBufferAckThreshold\\\\\\":0,\\\\\\"feedBufferSizeBytes\\\\\\":0}\\", SourcePartitions:\\"448,449,450,451,452,453,454,455,456,457,458,459,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479\\", Nodes:map[string]*cbgt.PlanPIndexNode{\\"3d019705c199b60a30ad999d17bdca53\\":(*cbgt.PlanPIndexNode)(0xc820c0f930)}}">>}}}\n', u'shortText': u'message', u'serverTime': u'2016-04-26T12:43:46.511Z', u'module': u'ns_orchestrator', u'tstamp': 1461699826511, u'type': u'info'}
|
[2016-04-26 12:44:07,738] - [rest_client:2523]
|
ERROR - {u'node': u'ns_1@172.23.105.96', u'code': 3, u'text': u'Conflicting configuration changes to field {metakv,\n <<"/fts/cbgt/cfg/planPIndexes">>}:\n[{\'_vclock\',[{<<"1206d914c57b247bbe2bd3229cb5fc65">>,{2,63628918880}},\n {<<"3d019705c199b60a30ad999d17bdca53">>,{5,63628919010}},\n {<<"8bdcd0983835ccfa0f0791ea20442b7a">>,{3,63628917979}},\n
|
:
|
:
|
Test log : https://gist.github.com/arunapiravi/70928a312071083ef9120828a18f9c05