Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61302

Memory usage grows during concurrent query workloads resulting in a process OOM

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.6.2
    • 7.6.0
    • fts
    • Untriaged
    • 0
    • No

    Description

      Filing this issue to track higher memory usage issue on the node even after je_malloc is used. Let us keep this bug open even if there is an InProgress dev activity to address this issue.

      • Total vectors 1Million in collection
      • 1536 Dimension
      • Total size of the FTS on the disk 2GB or so
      • Started running k=100 and 10 parallel queries 
      • Even with je_malloc I seen memory usage going up 5 to 6GiB. Please check the screenshot attached.
      • If we start 100 Parallel queries, OOM will happen.

       

      Logs are as follows:

      CC Abhi Dangeti 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ashokkumar.alluri Ashok Alluri
            ashokkumar.alluri Ashok Alluri
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty