Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62616

[Windows][Vector Search] : Memory fragmentation since RSS is not matching the memory used by FTS

    XMLWordPrintable

Details

    Description

      Created a 2 node cluster, 1 kv node and 1 fts node with windows machines.

      Loaded 10M docs(of 4096 dims) onto a bucket and created a vector index(1 partition)

      Observing many anomalies with memory consumption in the FTS node

      Listing a few of them below

       


       

      Between Timestamp "2024-07-05 23:01:14" and "2024-07-06 01:26:01"

      The memory used by fts is reported to be around 14GB at an average between this time.

      But the RSS looks to be around 27GB.

       


       

      From timestamp 2024-07-06 06:24:22 to 2024-07-06 07:19:39

      The search memory used is seen to oscillate around 12GB and once it goes as low as 600MB.

      The RSS during this period looks to be around 26GB and it only goes down to 14GB when fts reports its using just 600MB. 

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            rahul.rampure Rahul Rampure
            raghav.sk Raghav S K
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty