Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61957

[System Test] Memory doesn't come down for FTS nodes with a LARGE number of indexes

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • bug-backlog
    • 7.6.0
    • fts
    • None
    • Untriaged
    • 0
    • Unknown

    Description

      While the system test is in progress, the memory usage is increasing and doesn't come down once the indexes are created. Attaching the images from promtimer. Please refer them.

      Steps:

      1. Created an on-prem cluster with 12 nodes. Out of which 5 are fts nodes.
      2. Each node has atleast 12gb of memory.
      3. Created one scope and four collections under that scope
        • coll_0: Normal Vector Data (5m documents)
        • coll_1: Vector data with xattr (1m documents)
        • coll_2: Vector data with base_64 (1m documents)
        • coll_3: Vector data (1m documents)
      4. Creating four indexes with 12 partitions across 5 fts nodes.
        • index_0: Indexing Normal Vector Data (5m documents)
        • index_1: Indexing Vector data with xattr (1m documents)
        • index_2: Indexing Vector data with base_64 (1m documents)
        • index_3: Indexing Vector data (1m documents)
      5. Run knn queries on all the indexes created
      6. Mutated the documents and then again run the knn query on all the indexes
      7. Add an FTS node
      8. Perform mutations and then again run the knn queries on all the indexes
      9. Remove an FTS node

      The above steps are performed in a loop.

      Logs:

      Attachments

        1. image (1).png
          image (1).png
          2.57 MB
        2. image (2).png
          image (2).png
          3.23 MB
        3. image-2024-05-20-16-14-11-050.png
          image-2024-05-20-16-14-11-050.png
          209 kB
        4. image-2024-05-20-16-19-22-118.png
          image-2024-05-20-16-19-22-118.png
          241 kB
        5. memprof.mprof
          670 kB
        6. Screenshot 2024-05-20 at 11.33.21 AM.png
          Screenshot 2024-05-20 at 11.33.21 AM.png
          60 kB
        7. Screenshot 2024-05-20 at 12.00.24 PM.png
          Screenshot 2024-05-20 at 12.00.24 PM.png
          58 kB
        8. Screenshot 2024-05-20 at 12.00.44 PM.png
          Screenshot 2024-05-20 at 12.00.44 PM.png
          83 kB
        9. Screenshot 2024-05-20 at 12.04.52 PM.png
          Screenshot 2024-05-20 at 12.04.52 PM.png
          58 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            abhinav Abhi Dangeti
            koushal.sharma Koushal Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty