Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60504

[System Test] Rebalance failed while upgrading indexer node

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      In the system test while upgrading(via swap rebalance) one of the index nodes from 7.2.3-6017 to 7.6.0-2024 the rebalance failed with the below error message

      Rebalance exited with reason {service_rebalance_failed,index,
      {worker_died,
      {'EXIT',<0.8226.1245>,
      {task_failed,rebalance,
      {service_error,
      <<"Found overlapping partition when rebalancing. Instance 6878983849591167551 partition 1.">>}}}}}.
      Rebalance Operation Id = 32230c4621bbe28ec522cec557d809e9 

      Cluster configuration initially was kv-5, index-5, query-2 The KV nodes were upgraded, then one query node was upgraded and three index nodes were upgraded via swap rebalance ( removing the old node and adding the upgraded node and triggering a rebalance). While upgrading the fourth index node the rebalance has failed. Note - All upgraded nodes are installed in provisioned modeĀ 

      Logs

      iteration 106

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.106.171.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.106.176.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.97.109.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706011334/collectinfo-2024-01-23T121149-ns_1%40172.23.97.67.zip

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sai.teja Sai Krishna Teja
              yash.dodderi Yash Dodderi
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty