Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-32104

Speed up in-memory snapshot interval

    XMLWordPrintable

Details

    Attachments

      Issue Links

        relates to

        Task - A task that needs to be done. MB-33552 Investigate high cpu usage with less than 10ms in-memory snapshot

        • Major - Major loss of function.
        • Open
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Ascending order - Click to sort in descending order
          View 9 older comments
          mahesh.mandhare Mahesh Mandhare (Inactive) added a comment -

          Build 6.5.0-2433

          Below are jobs are results with set4 settings("indexer.settings.inmemory_snapshot.moi.interval": 3, "indexer.stream_reader.moi.syncBatchInterval":1)

          Test Storage Build 2433 Build 2433 with setting changes Job
          Scan latency 90p stale =false MOI 21.38ms 9.16ms http://perf.jenkins.couchbase.com/job/secondary-moi/4485 
          Scan latency 95p stale =false MOI 21.96ms 9.73ms http://perf.jenkins.couchbase.com/job/secondary-moi/4485 
          Scan latency 90p stale =false Plasma 40.87ms 11.85ms http://perf.jenkins.couchbase.com/job/secondary-plasma/3330 
          Scan latency 95p stale =false Plasma 41.82ms 16.29ms http://perf.jenkins.couchbase.com/job/secondary-plasma/3330 
          Scan Throughput stale=ok MOI 225,675 215,459 http://perf.jenkins.couchbase.com/job/secondary-moi/4486 
          Scan Throughput stale=false MOI 6,810 17,634 http://perf.jenkins.couchbase.com/job/secondary-moi/4487 
          Scan Throughput stale=ok Plasma 167,584 156,491 http://perf.jenkins.couchbase.com/job/secondary-plasma/3332 
          Scan Throughput stale=false Plasma 6,660  13,507 http://perf.jenkins.couchbase.com/job/secondary-plasma/3331 
          mahesh.mandhare Mahesh Mandhare (Inactive) added a comment - Build 6.5.0-2433 Below are jobs are results with set4 settings("indexer.settings.inmemory_snapshot.moi.interval": 3, "indexer.stream_reader.moi.syncBatchInterval":1) Test Storage Build 2433 Build 2433 with setting changes Job Scan latency 90p stale =false MOI 21.38ms 9.16ms http://perf.jenkins.couchbase.com/job/secondary-moi/4485   Scan latency 95p stale =false MOI 21.96ms 9.73ms http://perf.jenkins.couchbase.com/job/secondary-moi/4485   Scan latency 90p stale =false Plasma 40.87ms 11.85ms http://perf.jenkins.couchbase.com/job/secondary-plasma/3330   Scan latency 95p stale =false Plasma 41.82ms 16.29ms http://perf.jenkins.couchbase.com/job/secondary-plasma/3330   Scan Throughput stale=ok MOI 225,675 215,459 http://perf.jenkins.couchbase.com/job/secondary-moi/4486   Scan Throughput stale=false MOI 6,810 17,634 http://perf.jenkins.couchbase.com/job/secondary-moi/4487   Scan Throughput stale=ok Plasma 167,584 156,491 http://perf.jenkins.couchbase.com/job/secondary-plasma/3332   Scan Throughput stale=false Plasma 6,660  13,507 http://perf.jenkins.couchbase.com/job/secondary-plasma/3331  
          deepkaran.salooja Deepkaran Salooja added a comment -

          Thanks Mahesh Mandhare. The tests with both 5ms and 3ms show higher indexer cpu usage. I think we need to investigate and address it properly before we can go below 10ms. Let's keep it at 10ms for Mad-Hatter and I'll file another ticket for further investigation.

          deepkaran.salooja Deepkaran Salooja added a comment - Thanks Mahesh Mandhare . The tests with both 5ms and 3ms show higher indexer cpu usage. I think we need to investigate and address it properly before we can go below 10ms. Let's keep it at 10ms for Mad-Hatter and I'll file another ticket for further investigation.
          deepkaran.salooja Deepkaran Salooja added a comment -

          Filed MB-33552 for follow up.

          deepkaran.salooja Deepkaran Salooja added a comment - Filed MB-33552 for follow up.
          wayne Wayne Siu added a comment -

          Mahesh Mandhare

          Can you confirm the setting in MH and close the ticket?  Thanks.

          wayne Wayne Siu added a comment - Mahesh Mandhare Can you confirm the setting in MH and close the ticket?  Thanks.
          mahesh.mandhare Mahesh Mandhare (Inactive) added a comment -

          Verified that in MH,  indexer.settings.inmemory_snapshot.moi.interval is 10.

          mahesh.mandhare Mahesh Mandhare (Inactive) added a comment - Verified that in MH,  indexer.settings.inmemory_snapshot.moi.interval is 10.

          People

            mahesh.mandhare Mahesh Mandhare (Inactive)
            jeelan.poola Jeelan Poola
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty