Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4773

Rebalance failing on latest 2.0 build due to wait_for_memcached failures (ns_rebalancer:wait_for_memcached)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 2.0-developer-preview-4
    • 2.0
    • couchbase-bucket
    • Security Level: Public
    • None
    • Centos 64 bit. 6 node cluster

      2.0.0r-651-g02c3154

    Description

      The latest test run, failed with rebalance failures. This is a regression from the previous test runs. No cores files generated.

      http://qa.hq.northscale.net/job/centos-64-view-tests/317/

      From the logs
      [rebalance:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:<0.4598.3>:ns_rebalancer:wait_for_memcached:296] Waiting for ['ns_1@10.1.2.30']
      [user:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:<0.317.0>:ns_orchestrator:handle_info:234] Rebalance exited with reason

      {wait_for_memcached_failed, "default", ['ns_1@10.1.2.30']}

      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_log:ns_log:handle_cast:115] suppressing duplicate log ns_orchestrator:2("Rebalance exited with reason

      {wait_for_memcached_failed,\"default\",\n ['ns_1@10.1.2.30']}

      \n") because it's been seen 1 times in the past 254.737081 secs (last seen 254.737081 secs ago
      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_config_events:ns_config_log:handle_event:60] config change:
      counters ->
      [

      {rebalance_fail,2}

      ,

      {rebalance_start,11}

      ,

      {rebalance_success,9}

      ]
      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_config_events:ns_node_disco_conf_events:handle_event:56] ns_node_disco_conf_events config all
      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_config_rep:ns_config_rep:handle_info:181] Pushing config
      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_config_rep:ns_config_rep:handle_info:183] Pushing config done
      [ns_server:info] [2012-02-07 2:01:50] [ns_1@10.1.2.30:ns_config_events:ns_config_log:handle_event:60] config change:
      rebalance_status ->

      {none,<<"Rebalance failed. See logs for detailed reason. You can try rebalance again.">>}

      Attachments

        1. 10.1.2.30-8091-diag.txt.zip
          1020 kB
        2. 10.1.2.31-8091-diag.txt.zip
          325 kB
        3. 10.1.2.32-8091-diag.txt.zip
          319 kB
        4. 10.1.2.33-8091-diag.txt.zip
          324 kB
        5. 10.1.2.34-8091-diag.txt.zip
          324 kB
        6. 10.1.2.35-8091-diag.txt.zip
          324 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            FilipeManana Filipe Manana (Inactive)
            karan Karan Kumar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty