Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58191

FTS rebalance hung during ScaleIn

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 7.6.0
    • 7.2.1
    • fts

    Description

      Build: Enterprise Edition 7.2.1 build 17478

      Test Steps:

      1. 15 scopes and 60 collections across 3 buckets
        • Each bucket -> 10M data 1 index on each collection -> 60 indexes (each index ~400k docs)
      2. Sleep - 15 mins
      3. Run FTS Queries FTS Flex Queries Random fashion for 2 hrs
      4. Kill CBFT
      5. sleep for 15 mins
      6. Scale out to 5 nodes
      7. Create 10 more fts indexes with following config on default scope and default index (500k docs per index) :
        • 1 Index | 1 Replica | 5 Partitions
        •  3 Indexes | 2 Replicas | 6 Partitions
        • 6 Indexes | 0 Replicas | 4 Partitions
      8. Sleep for 15 mins
      9. Run FTS Queries FTS Flex Queries Random fashion for 30 mins again
      10.  Kill CBFT
      11. Sleep for 15 mins
      12. Rebalance/Scale in to 4 nodes

      http://qe-jenkins1.sc.couchbase.com/job/cp-cli-runner/2905/console

      Seeing search rebalance hung for ~20Hrs while scaling In.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-57607 SystemTest - Provisioned - Search rebalance taking long time

          • Critical - Crashes, loss of data, severe memory leak.
          • In Progress

          Bug - A problem which impairs or prevents the functions of the product. MB-58195 [CAPELLA] Scaling failed due to FTS rebalance being stuck on 7.2.1-5904

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mohd.shaadkhan Shaad Khan
              sarthak.dua Sarthak Dua
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty