Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55019

[Serverless]: Index build is hung since hours.

    XMLWordPrintable

Details

    Description

      1. Create 19 databases to avoid kv/gsi auto-scaling due to num_tenants.
      2. Create 2 collections(VolumeCollection0, VolumeCollection1) in each database
      3. Create 100 indexes on each database i.e. 50 on each collection. This results in total 1900 indexes.
      4. Build 10 indexes per database at a time. Example: 

        Bucket0:VolumeCollection0 - 10 indexes under build
        		 
        Bucket1:VolumeCollection0 - 10 indexes under build
        		 
        Bucket2:VolumeCollection0 - 10 indexes under build
        		 
        .
        		 
        .
        		 
        .
        		 
        Bucket20:VolumeCollection0 - 10 indexes under build

      5. Repeat the above step
      6. All the VolumeCollection0 indexes are build. Now comes the VolumeCollection1 indexes 

        Bucket0:VolumeCollection1 - 10 indexes under build
        		 
        Bucket1:VolumeCollection1 - 10 indexes under build
        		 
        Bucket2:VolumeCollection1 - 10 indexes under build
        		 
        .
        		 
        .
        		 
        .
        		 
        Bucket20:VolumeCollection1 - 10 indexes under build

      7. Observe that the index building is stuck forever.

      John Liang, Deepkaran Salooja

      Attachments

        1. cpu_3593.svg
          157 kB
        2. cpu_3610_1.svg
          140 kB
        3. cpu.svg
          159 kB
        4. HighCPU_CreateIndexDeferMode.png
          HighCPU_CreateIndexDeferMode.png
          179 kB
        5. hung at 100%.png
          hung at 100%.png
          683 kB
        6. image-2023-01-25-15-43-22-249.png
          image-2023-01-25-15-43-22-249.png
          210 kB
        7. IndexHang-3610.png
          IndexHang-3610.png
          707 kB
        8. screenshot-1.png
          screenshot-1.png
          143 kB
        9. screenshot-2.png
          screenshot-2.png
          143 kB
        10. Screenshot 2023-01-23 at 14.44.03.png
          Screenshot 2023-01-23 at 14.44.03.png
          319 kB
        11. Screenshot 2023-01-30 at 12.37.33.png
          Screenshot 2023-01-30 at 12.37.33.png
          307 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty