Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62393

[Windows][Vector Search] : Memory/CPU utilization does not reduce even after dropping all indexes

    XMLWordPrintable

Details

    Description

      Steps taken to hit the issue

      1. Created a 3 node kv cluster
      2. Created a magma bucket with 3 collections 
      3. Added 10M docs to each collection - dims 4096 vector
      4. Added 5 fts nodes
      5. Created 1 index for each collection
      6. Failed over one of the fts nodes
      7. Added it back to the cluster after a while during indexing
      8. The CPU utilization was 100% during this time and the rebalance was stuck at 5.9%.
      9. The rebalance was hung for 30+ minutes.
      10. Stopped the rebalance since there was no progress. The indexing was also very slow.
      11. Post this the cpu percentage never came down. The indexing rate was still very slow.
      12. Dropped all the indexes.
      13. Memory used by FTS stays at 89GB even after 120-150 minutes. The memory does not reduce at all.
      14. The cpu utilization is 100% even after 120-150 minutes post index drop. The cpu utilization does not decrease at all.
      15. The above memory and cpu issues are observed despite there being no indexes and FTS nodes being in idle state.

      The CPU utilization issue is logged separately and can be tracked under MB-62392

      Attachments

        Issue Links

          is caused by

          Bug - A problem which impairs or prevents the functions of the product. MB-62404 [Windows][Vector Search] : Data ingestion to index hung for 15+ hours

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-62392 [Windows][VectorSearch] : CPU utilization stuck at 100% even after dropping all indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-62494 [Windows][Vector Search] : Unable to create and use multiple indexes

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Activity

            People

              raghav.sk Raghav S K
              raghav.sk Raghav S K
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty