Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61302

Memory usage grows during concurrent query workloads resulting in a process OOM

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.6.2
    • 7.6.0
    • fts
    • Untriaged
    • 0
    • No

    Description

      Filing this issue to track higher memory usage issue on the node even after je_malloc is used. Let us keep this bug open even if there is an InProgress dev activity to address this issue.

      • Total vectors 1Million in collection
      • 1536 Dimension
      • Total size of the FTS on the disk 2GB or so
      • Started running k=100 and 10 parallel queries 
      • Even with je_malloc I seen memory usage going up 5 to 6GiB. Please check the screenshot attached.
      • If we start 100 Parallel queries, OOM will happen.

       

      Logs are as follows:

      CC Abhi Dangeti 

      Attachments

        1. image-2024-03-26-19-12-58-843.png
          image-2024-03-26-19-12-58-843.png
          388 kB
        2. vindex.json
          1 kB
        3. vindex_query_120sec_ctl.json
          34 kB
        4. cb_fts_bench
          19.17 MB
        5. excessive_memory_for_every_concurrent_client.txt
          8 kB
        6. image-2024-05-09-10-39-39-906.png
          image-2024-05-09-10-39-39-906.png
          1.31 MB
        7. image-2024-05-09-10-40-15-455.png
          image-2024-05-09-10-40-15-455.png
          165 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ashokkumar.alluri Ashok Alluri
            ashokkumar.alluri Ashok Alluri
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty