Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7043

Rebalance exited with reason not_all_nodes_are_ready_yet for stop_start rebalance test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Major
    • 2.0
    • None
    • None
    • Security Level: Public
    • None

    Description

      -t viewquerytests.ViewQueryTests.test_employee_dataset_alldocs_queries_start_stop_rebalance_in_incremental,limit=10000,skip_rebalance=true,docs-per-day=1000

      Nodes are rebalanced incrementally with strats and stops on 30 and 60 % of progress

      2012-10-27 14:04:40.996 ns_orchestrator:1:info:message(ns_1@10.3.3.58) - Rebalance completed successfully.
      (repeated 1 times)
      2012-10-27 14:16:56.849 ns_cluster:0:info:message(ns_1@10.3.3.58) - Started node add transaction by adding node 'ns_1@10.3.3.68' to nodes_wanted

      2012-10-27 14:16:57.811 ns_node_disco:4:info:node up(ns_1@10.3.3.58) - Node 'ns_1@10.3.3.58' saw that node 'ns_1@10.3.3.68' came up.
      2012-10-27 14:16:57.959 menelaus_sup:1:info:web start ok(ns_1@10.3.3.68) - Couchbase Server has started on web port 8091 on node 'ns_1@10.3.3.68'.
      2012-10-27 14:16:57.998 ns_cluster:3:info:message(ns_1@10.3.3.68) - Node ns_1@10.3.3.68 joined cluster
      2012-10-27 14:16:58.060 ns_orchestrator:4:info:message(ns_1@10.3.3.58) - Starting rebalance, KeepNodes = ['ns_1@10.3.3.68','ns_1@10.3.3.58'], EjectNodes = []

      2012-10-27 14:16:58.259 ns_rebalancer:0:info:message(ns_1@10.3.3.58) - Started rebalancing bucket default
      2012-10-27 14:16:59.078 ns_memcached:1:info:message(ns_1@10.3.3.68) - Bucket "default" loaded on node 'ns_1@10.3.3.68' in 0 seconds.
      2012-10-27 14:17:00.612 ns_vbucket_mover:0:info:message(ns_1@10.3.3.58) - Bucket "default" rebalance does not seem to be swap rebalance
      2012-10-27 14:33:52.456 ns_orchestrator:7:info:message(ns_1@10.3.3.58) - Rebalance stopped by user.

      2012-10-27 14:36:13.951 mb_master:0:info:message(ns_1@10.3.3.68) - Haven't heard from a higher priority node or a master, so I'm taking over.
      2012-10-27 14:36:33.815 ns_memcached:2:info:message(ns_1@10.3.3.58) - Shutting down bucket "default" on 'ns_1@10.3.3.58' for server shutdown
      2012-10-27 14:36:52.650 menelaus_sup:1:info:web start ok(ns_1@10.3.3.58) - Couchbase Server has started on web port 8091 on node 'ns_1@10.3.3.58'.
      2012-10-27 14:38:14.820 ns_orchestrator:4:info:message(ns_1@10.3.3.68) - Starting rebalance, KeepNodes = ['ns_1@10.3.3.68','ns_1@10.3.3.58'], EjectNodes = []

      2012-10-27 14:38:15.124 ns_rebalancer:0:info:message(ns_1@10.3.3.68) - Started rebalancing bucket default
      2012-10-27 14:39:15.232 ns_orchestrator:2:info:message(ns_1@10.3.3.68) - Rebalance exited with reason

      {not_all_nodes_are_ready_yet,['ns_1@10.3.3.58']}

      logs are located:
      http://qa.hq.northscale.net/job/centos-64-2.0-views-regression/33/artifact/logs/testrunner-12-Oct-26_05-53-33/914c6fe6-8510-4d0b-a4bd-2f58db50ab0a-10.3.3.58-diag.txt.gz
      http://qa.hq.northscale.net/job/centos-64-2.0-views-regression/33/artifact/logs/testrunner-12-Oct-26_05-53-33/914c6fe6-8510-4d0b-a4bd-2f58db50ab0a-10.3.3.68-diag.txt.gz

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            chiyoung Chiyoung Seo (Inactive)
            iryna iryna
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty