Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60534

[System Test] Rebalance failure - ServiceAPI.PrepareTopologyChange

    XMLWordPrintable

Details

    • Triaged
    • 0
    • Unknown

    Description

      There was a rebalance failure in the system test run with shard affinity flag enabled -

      user:error,2024-01-24T13:01:02.834-08:00,ns_1@172.23.97.67:<0.22737.0>:ns_orchestrator:log_rebalance_completion:1661]Rebalance exited with reason {service_rebalance_failed,index,
                                    {agent_died,<35008.29692.95>,
                                     {linked_process_died,<35008.4690.100>,
                                      {'ns_1@172.23.97.108',
                                       {timeout,
                                        {gen_server,call,
                                         [<35008.29767.95>,
                                          {call,"ServiceAPI.PrepareTopologyChange",
                                           #Fun<json_rpc_connection.0.36915653>,
                                           #{timeout => 60000}},
                                          60000]}}}}}}.
      Rebalance Operation Id = 5fec1b65228ba591704c0e39feb17874
      

      There was a test-induced rebalance failure about 30 minutes ago( rebalance ID - 2fddbfae31dddaa5d3751a34cfb5fa15) that can be ignored. The test does wait for the cleanup to be done and then proceed to the next step.

      Logs ->

      Cbcollect logs:

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.106.171.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.106.176.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1706132281/collectinfo-2024-01-24T214511-ns_1%40172.23.97.67.zip

      cc Varun Velamuri

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pavan.pb Pavan PB
              pavan.pb Pavan PB
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty