Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37105

[System test]: index rebalance failed with linked_process_died

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Won't Do
    • 6.5.0
    • 6.5.0
    • secondary-index

    Description

      Build: 6.5.0-4908 not seen on 4890

      Test: MH longevity with durability

      Cycle: 1st

      Day: 1st

      Test Step:

      Adding 1 kv node , failing over 2 kv nodes

      [2019-11-29T05:39:11-08:00, sequoiatools/couchbase-cli:6.5:6f3223] server-add -c 172.23.108.103:8091 --server-add https://172.23.106.100 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data
      [2019-11-29T05:44:34-08:00, sequoiatools/couchbase-cli:6.5:9bd07d] failover -c 172.23.108.103:8091 --server-failover 172.23.96.148:8091 -u Administrator -p password
      [2019-11-29T05:54:36-08:00, sequoiatools/couchbase-cli:6.5:49a079] failover -c 172.23.108.103:8091 --server-failover 172.23.97.239:8091 -u Administrator -p password --force
      [2019-11-29T05:55:12-08:00, sequoiatools/couchbase-cli:6.5:a64cf0] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      → 
       
       
      Error occurred on container - sequoiatools/couchbase-cli:6.5:[rebalance -c 172.23.108.103:8091 -u Administrator -p password]
       
       
      docker logs a64cf0
      docker start a64cf0
       
       
      *Unable to display progress bar on this os
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.
      [2019-11-29T06:07:29-08:00, sequoiatools/cmd:1b4508] 60 

      Rebalance failed

      [user:error,2019-11-29T06:07:13.393-08:00,ns_1@172.23.108.103:<0.12064.0>:ns_orchestrator:log_rebalance_completion:1445]Rebalance exited with reason {service_rebalance_failed,index,
                                    {agent_died,<25872.13651.49>,
                                     {linked_process_died,<25872.27917.65>,
                                      {timeout,
                                       {gen_server,call,
                                        [<25872.14398.49>,
                                         {call,"ServiceAPI.GetTaskList",
                                          #Fun<json_rpc_connection.0.102434519>},
                                         60000]}}}}}.
      Rebalance Operation Id = d95b685622ed7bc5b24e520d79354c33 

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              varun.velamuri Varun Velamuri
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty