Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-51417

[System Test] Rebalance exited with reason "eventing rebalance hasn't made progress for past 1200 secs"

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.1.0
    • 7.1.0
    • eventing
    • Enterprise Edition 7.1.0 build 2469

    Description

      TEST

      -test tests/eventing/neo/test_eventing_rebalance_rbac.yml -scope tests/eventing/neo/scope_eventing_rebalance.yml
      

      Day - 1
      Cycle - 4
      Scale - 3

      TEST STEP
      Rebalance in 1 kv + 2 eventing nodes.

      [2022-03-11T12:50:25-08:00, sequoiatools/couchbase-cli:7.1:779405] server-add -c 172.23.104.16:8091 --server-add https://172.23.104.17 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data
      [2022-03-11T12:54:01-08:00, sequoiatools/couchbase-cli:7.1:ff7005] server-add -c 172.23.104.16:8091 --server-add https://172.23.121.165 -u Administrator -p password --server-add-username Administrator --server-add-password password --services eventing
      [2022-03-11T12:54:22-08:00, sequoiatools/couchbase-cli:7.1:338fd0] server-add -c 172.23.104.16:8091 --server-add https://172.23.96.30 -u Administrator -p password --server-add-username Administrator --server-add-password password --services eventing
      [2022-03-11T12:54:33-08:00, sequoiatools/couchbase-cli:7.1:5aee7f] rebalance -c 172.23.104.16:8091 -u Administrator -p password
       
      Error occurred on container - sequoiatools/couchbase-cli:7.1:[rebalance -c 172.23.104.16:8091 -u Administrator -p password]
       
      docker logs 5aee7f
      docker start 5aee7f
       
      *Unable to display progress bar on this os
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.
      

      REBALANCE FAILURE

      2022-03-11T13:46:14.919-08:00, ns_orchestrator:0:critical:message(ns_1@172.23.104.16) - Rebalance exited with reason {service_rebalance_failed,eventing,
                                    {worker_died,
                                     {'EXIT',<0.31571.310>,
                                      {rebalance_failed,
                                       {service_error,
                                        <<"eventing rebalance hasn't made progress for past 1200 secs">>}}}}}.
      Rebalance Operation Id = eec51917d3081e11b52322d79099c7a4
      

      List of eventing nodes

      • 172.23.104.21
      • 172.23.104.23
      • 172.23.96.31

      Attachments

        For Gerrit Dashboard: MB-51417
        # Subject Branch Project Status CR V

        Activity

          People

            sujay.gad Sujay Gad
            sujay.gad Sujay Gad
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty