Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59612

MOI may use >50% CPU for disk snapshotting

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • No
    • Plasma-April-22-2024, Plasma-April-29-2024, Plasma-May-6-2024, Plasma-May-13-2024, Plasma-May-27-2024

    Description

      There is an indexer config - indexer.settings.moi.persistence_threads - that is expected to limit the CPU consumed by disk snapshotting. By default it is set to half of GOMAXPROCS(0). This config limits the CPU consumption in 2 ways by controlling:

      1) The number of threads allotted to each index for disk snapshotting: This is proportional to the fraction of total node items in that index. Each index should get at least 1 thread. For example, if an index has half the items of the node, it will get half the number of threads, and for an extreme example, if there is an index with 1 item in a node with 1M items, this index gets 1 thread. 
      2) The number of indexes for which disk snapshotting can happen in parallel - moiWriterSemaphoreCh. 

      So, if there is a mix of large and small indexes, due to the minimum 1 thread, there may be more than intended threads running disk snapshotting. 

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-59612
          # Subject Branch Project Status CR V

          Activity

            People

              akhil.mundroy Akhil Mundroy
              akhil.mundroy Akhil Mundroy
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty