Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56436

[System Test] Analytics rebalance operation failed with Analytics collections in different partitions have different DCP states error

    XMLWordPrintable

Details

    Description

      QE TEST

      ./sequoia -client 172.23.104.254:2375 -provider file:centos_third_cluster.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.0-5298 -skip_setup=true -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=true -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true

      Day - 1
      Cycle - 1
      Scale - 3

      TEST STEP
      Rebalance out single CBAS node.

      [2023-04-12T15:46:22-07:00, sequoiatools/couchbase-cli:7.1:163e77] rebalance -c 172.23.108.139:8091 --server-remove 172.23.108.132 -u Administrator -p password

      REBALANCE FAILURE

      2023-04-12T18:19:19.918-07:00, ns_orchestrator:0:critical:message(ns_1@172.23.108.139) - Rebalance exited with reason {service_rebalance_failed,cbas,
      		 
                                    {worker_died,
      		 
                                     {'EXIT',<0.8646.1236>,
      		 
                                      {rebalance_failed,
      		 
                                       {service_error,
      		 
                                        <<"Rebalance 9874e997e34a6b295b5fce0c106e55d8 failed: CBAS0001: Analytics collections in different partitions have different DCP states. Mutations needed to catch up = 2616974. User action: Try again later">>}}}}}.
      		 
      Rebalance Operation Id = 8d1265b36407a9a85560597b2abd2945

      NOTE
      Similar issue MB-56178 was seen recently, fix for which went in 7.2.0-5282 build.
      Retry of rebalance also failed due to same error.

      Attachments

        Issue Links

          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. MB-56532 [System Test] Analytics rebalance operation failed with Analytics collections in different partitions have different DCP states error

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MB-56474 Improve handling of "Analytics collections in different partitions have different DCP states"

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sujay.gad Sujay Gad
              sujay.gad Sujay Gad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty