Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37105

[System test]: index rebalance failed with linked_process_died

    XMLWordPrintable

Details

    Description

      Build: 6.5.0-4908 not seen on 4890

      Test: MH longevity with durability

      Cycle: 1st

      Day: 1st

      Test Step:

      Adding 1 kv node , failing over 2 kv nodes

      [2019-11-29T05:39:11-08:00, sequoiatools/couchbase-cli:6.5:6f3223] server-add -c 172.23.108.103:8091 --server-add https://172.23.106.100 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data
      		 
      [2019-11-29T05:44:34-08:00, sequoiatools/couchbase-cli:6.5:9bd07d] failover -c 172.23.108.103:8091 --server-failover 172.23.96.148:8091 -u Administrator -p password
      		 
      [2019-11-29T05:54:36-08:00, sequoiatools/couchbase-cli:6.5:49a079] failover -c 172.23.108.103:8091 --server-failover 172.23.97.239:8091 -u Administrator -p password --force
      		 
      [2019-11-29T05:55:12-08:00, sequoiatools/couchbase-cli:6.5:a64cf0] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      		 
      → 
      		 
       
      		 
       
      		 
      Error occurred on container - sequoiatools/couchbase-cli:6.5:[rebalance -c 172.23.108.103:8091 -u Administrator -p password]
      		 
       
      		 
       
      		 
      docker logs a64cf0
      		 
      docker start a64cf0
      		 
       
      		 
       
      		 
      *Unable to display progress bar on this os
      		 
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.
      		 
      [2019-11-29T06:07:29-08:00, sequoiatools/cmd:1b4508] 60

      Rebalance failed

      [user:error,2019-11-29T06:07:13.393-08:00,ns_1@172.23.108.103:<0.12064.0>:ns_orchestrator:log_rebalance_completion:1445]Rebalance exited with reason {service_rebalance_failed,index,
      		 
                                    {agent_died,<25872.13651.49>,
      		 
                                     {linked_process_died,<25872.27917.65>,
      		 
                                      {timeout,
      		 
                                       {gen_server,call,
      		 
                                        [<25872.14398.49>,
      		 
                                         {call,"ServiceAPI.GetTaskList",
      		 
                                          #Fun<json_rpc_connection.0.102434519>},
      		 
                                         60000]}}}}}.
      		 
      Rebalance Operation Id = d95b685622ed7bc5b24e520d79354c33

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MB-37132 Improve storage manager to handle concurrent rollback requests from different buckets concurrently

          • Major - Major loss of function.
          • Open
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              varun.velamuri Varun Velamuri
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty