Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61195

GSI rebalancing is hung for many hours.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Critical
    • Morpheus
    • 7.6.0
    • secondary-index
    • 7.6.0

    Description

      1. Create a magma bucket, 10 collections. Load 10M items in each collection
      2. Create 2 GSI indexes on each collection.
      3. Rebalance in a GSI node and rebalancing couldn't proceed further than 59.47 %

      Queries are doing extremely well as expected:

      N1QL Query Statistics
      +-----------------+----------------+----------------+-----------------+------------------+-------------------+-----------------+-----------------+
      | Bucket          | Total Queries  | Failed Queries | Success Queries | Rejected Queries | Cancelled Queries | Timeout Queries | Errored Queries |
      +-----------------+----------------+----------------+-----------------+------------------+-------------------+-----------------+-----------------+
      | GleamBookUsers0 | count(4378030) | count(0)       | count(4374700)  | count(0)         | count(0)          | count(0)        | count(0)        |
      +-----------------+----------------+----------------+-----------------+------------------+-------------------+-----------------+-----------------+
       
      2024-03-17 06:32:40,986 | test  | INFO    | Thread-2   | [table_view:display:72] N1QL Query Execution Stats
      +-----------------+-------+--------+------------------------+
      | Bucket          | Query | Count  | Avg Execution Time(ms) |
      +-----------------+-------+--------+------------------------+
      | GleamBookUsers0 | Q9    | 439025 | 30.4103340451          |
      | GleamBookUsers0 | Q7    | 438015 | 24.933722632           |
      | GleamBookUsers0 | Q8    | 437553 | 25.0559333402          |
      | GleamBookUsers0 | Q5    | 437885 | 76.2012308632          |
      | GleamBookUsers0 | Q4    | 436964 | 68.5001501134          |
      | GleamBookUsers0 | Q6    | 437964 | 9.59310743641          |
      | GleamBookUsers0 | Q3    | 438099 | 31.3115576286          |
      | GleamBookUsers0 | Q2    | 438217 | 9.46624991972          |
      | GleamBookUsers0 | Q0    | 437438 | 15.088359424           |
      | GleamBookUsers0 | Q1    | 437984 | 8.08586767773          |
      +-----------------+-------+--------+------------------------+
      

      cc: Varun Velamuri, Deepkaran Salooja

      Attachments

        Activity

          People

            varun.velamuri Varun Velamuri
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:

              PagerDuty