Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-34846

rebalance failure in centos longevity with failed_to_update_vbucket_map error

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • 6.5.0
    • 6.5.0
    • test-execution
    • None
    • Untriaged
    • Unknown

    Description

      6.5.0-3633 - centos longevity - following rebalance error observed twice - latest occurrence:

      2019-07-01T19:12:44.503-07:00, ns_orchestrator:0:critical:message(ns_1@172.23.97.74) - Rebalance exited with reason {mover_crashed,
      {unexpected_exit,
      {'EXIT',<0.18825.179>,
      {failed_to_update_vbucket_map,"HISTORY",685,
      {error,
      [{'ns_1@172.23.96.219',
      {exit,
      {{nodedown,'ns_1@172.23.96.219'},
      {gen_server,call,
      [

      {ns_config_rep,'ns_1@172.23.96.219'}

      ,
      synchronize_everything,
      infinity]}}}}]}}}}}.
      Rebalance Operation Id = 0bffe4a5a8c1da5801868807f2a46387

      logs collected within the hour:

      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.104.113.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.104.114.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.104.148.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.104.68.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.104.78.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.122.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.14.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.18.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.183.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.190.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.191.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.207.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.209.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.210.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.212.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.214.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.215.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.216.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.219.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.220.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.221.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.223.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.254.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.96.48.zip
      https://s3.amazonaws.com/bugdb/jira/systestmon-1562035042/collectinfo-2019-07-02T023723-ns_1%40172.23.97.74.zip

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-35578 Disallow node additions while rebalance is in progress

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              arunkumar Arunkumar Senthilnathan (Inactive)
              arunkumar Arunkumar Senthilnathan (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty