Loading...

XML

Word

Printable

Details

Type: Bug
Resolution: Fixed
Priority: Test Blocker
Fix Version/s: 4.0.0
Affects Version/s: 4.0.0
Component/s: ns_server
Security Level: Public
Labels:
- dp
Environment:
build 1707 and latest dev build

Triage:
Untriaged
Is this a Regression?:
Yes

Description

./testrunner -i b/resources/dev-6-nodes-xdcr_n1ql_2i.ini -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple,dataset=default,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc-per-day=40,skip_cleanup=True,nodes_init=4,services_init=kv:n1ql-kv-index-index

1. Create 1 node cluster with 1 node with kv, n1ql services
2. Rebalance in 3 nodes with services 2: kv 3: index 4: index

2015-03-31 11:40:57 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance operation started
2015-03-31 11:40:57 | INFO | MainProcess | Cluster_Thread | [rest_client._rebalance_progress] rebalance percentage : 0.00 %
2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client._rebalance_progress]

{u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try rebalance again.'}

- rebalance failed
2015-03-31 11:41:07 | INFO | MainProcess | Cluster_Thread | [rest_client.print_UI_logs] Latest logs from UI on 127.0.0.1:
2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_3@127.0.0.1', u'code': 1, u'text': u'Couchbase Server has started on web port 9003 on node \'n_3@127.0.0.1\'. Version: "4.0.0r-171-gb4f58a0-community".', u'shortText': u'web start ok', u'serverTime': u'2015-03-31T11:41:00.444Z', u'module': u'menelaus_sup', u'tstamp': 1427827260444, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_0@10.17.2.127', u'code': 0, u'text': u"I'm the only node, so I'm the master. (repeated 1 times)", u'shortText': u'message', u'serverTime': u'2015-03-31T11:40:57.826Z', u'module': u'mb_master', u'tstamp': 1427827257826, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_2@127.0.0.1', u'code': 1, u'text': u'Couchbase Server has started on web port 9002 on node \'n_2@127.0.0.1\'. Version: "4.0.0r-171-gb4f58a0-community".', u'shortText': u'web start ok', u'serverTime': u'2015-03-31T11:40:57.390Z', u'module': u'menelaus_sup', u'tstamp': 1427827257390, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs] {u'node': u'n_0@10.17.2.127', u'code': 2, u'text': u"Rebalance exited with reason {pre_rebalance_config_synchronization_failed,\n [

{'n_2@127.0.0.1',down}

]}\n", u'shortText': u'message', u'serverTime': u'2015-03-31T11:40:57.308Z', u'module': u'ns_orchestrator', u'tstamp': 1427827257308, u'type': u'info'}
2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_0@10.17.2.127', u'code': 4, u'text': u"Starting rebalance, KeepNodes = ['n_2@127.0.0.1','n_3@127.0.0.1',\n 'n_1@127.0.0.1','n_0@10.17.2.127'], EjectNodes = [], Failed over and being ejected nodes = []; no delta recovery nodes\n", u'shortText': u'message', u'serverTime': u'2015-03-31T11:40:57.298Z', u'module': u'ns_orchestrator', u'tstamp': 1427827257298, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_3@127.0.0.1', u'code': 3, u'text': u'Node n_3@127.0.0.1 joined cluster', u'shortText': u'message', u'serverTime': u'2015-03-31T11:40:57.284Z', u'module': u'ns_cluster', u'tstamp': 1427827257284, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_3@127.0.0.1', u'code': 1, u'text': u'Couchbase Server has started on web port 9003 on node \'n_3@127.0.0.1\'. Version: "4.0.0r-171-gb4f58a0-community".', u'shortText': u'web start ok', u'serverTime': u'2015-03-31T11:40:57.244Z', u'module': u'menelaus_sup', u'tstamp': 1427827257244, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_1@127.0.0.1', u'code': 1, u'text': u'Couchbase Server has started on web port 9001 on node \'n_1@127.0.0.1\'. Version: "4.0.0r-171-gb4f58a0-community".', u'shortText': u'web start ok', u'serverTime': u'2015-03-31T11:40:55.403Z', u'module': u'menelaus_sup', u'tstamp': 1427827255403, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_1@127.0.0.1', u'code': 4, u'text': u"Node 'n_1@127.0.0.1' saw that node 'n_3@127.0.0.1' came up. Tags: []", u'shortText': u'node up', u'serverTime': u'2015-03-31T11:40:55.383Z', u'module': u'ns_node_disco', u'tstamp': 1427827255383, u'type': u'info'}

2015-03-31 11:41:07 | ERROR | MainProcess | Cluster_Thread | [rest_client.print_UI_logs]

{u'node': u'n_0@10.17.2.127', u'code': 4, u'text': u"Node 'n_0@10.17.2.127' saw that node 'n_3@127.0.0.1' came up. Tags: []", u'shortText': u'node up', u'serverTime': u'2015-03-31T11:40:55.265Z', u'module': u'ns_node_disco', u'tstamp': 1427827255265, u'type': u'info'}

[('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py', 783, '__bootstrap', 'self.__bootstrap_inner()'), ('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py', 810, '__bootstrap_inner', 'self.run()'), ('lib/tasks/taskmanager.py', 31, 'run', 'task.step(self)'), ('lib/tasks/task.py', 71, 'step', 'self.check(task_manager)'), ('lib/tasks/task.py', 415, 'check', 'self.set_exception(ex)'), ('lib/tasks/future.py', 264, 'set_exception', 'print traceback.extract_stack()')]
Tue Mar 31 11:41:07 2015
[('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py', 783, '_bootstrap', 'self.bootstrap_inner()'), ('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py', 810, 'bootstrap_inner', 'self.run()'), ('./testrunner.py', 262, 'run', '**self._Threadkwargs)'), ('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/runner.py', 151, 'run', 'test(result)'), ('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py', 395, 'call', 'return self.run(*args, **kwds)'), ('/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py', 322, 'run', 'self.setUp()'), ('pytests/2i/indexscans_2i.py', 11, 'setUp', 'super(SecondaryIndexingScanTests, self).setUp()'), ('pytests/2i/base_2i.py', 9, 'setUp', 'super(BaseSecondaryIndexingTests, self).setUp()'), ('pytests/2i/newtuq.py', 24, 'setUp', 'super(QueryTests, self).setUp()'), ('pytests/basetestcase.py', 185, 'setUp', '[], services = self.services)'), ('lib/couchbase_helper/cluster.py', 340, 'rebalance', 'return _task.result(timeout)'), ('lib/tasks/future.py', 160, 'result', 'return self.get_result()'), ('lib/tasks/future.py', 111, '_get_result', 'print traceback.extract_stack()')]

SANITY IS ALSO BROKEN

http://qa.sc.couchbase.com/job/cen006-p0-sanit-vset01-00/lastCompletedBuild/consoleFull

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

data.tar.gz
805 kB
31/Mar/15 11:46 AM
logs.tar.gz
5.84 MB
31/Mar/15 11:46 AM

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

People

Assignee:: Artem Stemkovski

Reporter:: Parag Agarwal (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 31/Mar/15 11:46 AM

Updated:: 24/Jun/15 1:09 PM

Resolved:: 31/Mar/15 6:36 PM

Gerrit Reviews

There are no open Gerrit changes

Show There is 1 closed Gerrit change

Hide There is 1 closed Gerrit change

MB-14223 is_system_provisioned should not crash on inconsistent config: Gerrit Review:

PagerDuty