Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-36134

[System test]: index rebalance failed with linked_process_died

    XMLWordPrintable

Details

    • Untriaged
    • Unknown

    Description

      Build: 6.0.3-2880

      Test: Alice longevity 

      Day: 4th 

      Cycle: 6th

      Test Step:

      [2019-09-24T00:47:57-07:00, sequoiatools/couchbase-cli:be46b2] server-add -c 172.23.97.74:8091 --server-add 172.23.96.191:8091 -u Administrator -p password --server-add-username Administrator --server-add-password password --services index
      [2019-09-24T00:48:21-07:00, sequoiatools/couchbase-cli:8de34d] rebalance -c 172.23.97.74:8091 -u Administrator -p password
       
      Error occurred on container - 0fb68ec:[rebalance -c 172.23.97.74:8091 -u Administrator -p password]
       
      docker logs 8de34d
      docker start 8de34d
       
      *Unable to display progress bar on this os
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.
      [2019-09-24T00:50:01-07:00, sequoiatools/cmd:10124c] 60 

      [ns_server:error,2019-09-24T00:49:41.750-07:00,ns_1@172.23.104.113:service_rebalancer-index<0.25914.2843>:service_rebalancer:run_rebalance:82]Agent terminated during the rebalance: {'DOWN',#Ref<0.0.1396.137106>,process,
                                              <20973.8261.1559>,
                                              {linked_process_died,
                                               <20973.29116.1595>,
                                               {timeout,
                                                {gen_server,call,
                                                 [<20973.8659.1559>,
                                                  {call,"ServiceAPI.GetTaskList",
                                                   #Fun<json_rpc_connection.0.125340786>},
                                                  60000]}}}}
      [ns_server:error,2019-09-24T00:49:41.762-07:00,ns_1@172.23.104.113:service_rebalancer-index<0.25914.2843>:service_agent:process_bad_results:810]Service call unset_rebalancer (service index) failed on some nodes:
      [{'ns_1@172.23.96.207',nack}]
      [user:error,2019-09-24T00:49:41.762-07:00,ns_1@172.23.104.113:<0.32218.115>:ns_orchestrator:do_log_rebalance_completion:1117]Rebalance exited with reason {service_rebalance_failed,index,
                                    {linked_process_died,<20973.29116.1595>,
                                     {timeout,
                                      {gen_server,call,
                                       [<20973.8659.1559>,
                                        {call,"ServiceAPI.GetTaskList",
                                         #Fun<json_rpc_connection.0.125340786>},
                                        60000]}}}} 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            varun.velamuri Varun Velamuri
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty