Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59868

[System Test] :- Analytics rebalance out fails with ""Rebalance exited with reason {service_rebalance_failed,eventing,\n {agent_died,<34772.15302.3>,noconnection}}"

    XMLWordPrintable

Details

    • Untriaged
    • Linux x86_64
    • 0
    • Yes

    Description

      Script to Repro

      ./sequoia -client 172.23.104.27:2375 -provider file:debian_pine.yml -test tests/integration/7.6/test_7.6.yml -scope tests/integration/7.6/scope_7.6_magma.yml -scale 2 -repeat 0 -log_level 0 -version 7.6.0-1845 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=1209600 -show_topology=true

      Step where it fails. Basically we are doing analytics node rebalance out and rebalance failed in eventing service.

      [2023-11-28T02:37:42-08:00, sequoiatools/couchbase-cli:7.6:b4482d] rebalance -c 172.23.106.109:8091 --server-remove 172.23.121.72 -u Administrator -p password
      		 
      →  
       
      		 
      Error occurred on container - sequoiatools/couchbase-cli:7.6:[rebalance -c 172.23.106.109:8091 --server-remove 172.23.121.72 -u Administrator -p password]
      		 
       
      		 
      docker logs b4482d
      		 
      docker start b4482d
      		 
       
      		 
      ������*Unable to display progress bar on this os
      		 
      ������8ERROR: Internal server error, please retry your request

      cbcollect_info attached. It was stuck at eventing rebalance for over 12 hours.
      Could be a dup of MB-59823. Afaik, even in that failure rebalance was stuck at eventing for over 12 hours.

      Attachments

        Issue Links

          backports to

          Bug - A problem which impairs or prevents the functions of the product. MB-60453 [BP of 59868] Ignore rollback due to eventing falling behind purge seq number

          • Major - Major loss of function.
          • Closed
          is caused by

          Improvement - An improvement or enhancement to an existing feature or task. MB-54695 Add ability to perform Analytics query from eventing function

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-60533 [System Test] :- Eventing rebalance out fails with "eventing rebalance hasn't made progress for past 1200 secs"

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Balakumaran.Gopal Balakumaran Gopal
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty