Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-21944

[FTS] perf: date facets query doesn't scale due to extensive garbage collection (top CPU load is 35%)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 5.0.0
    • 5.0.0
    • fts
    • Untriaged
    • Unknown

    Description

      The average latency of the query is about 3.6 sec.
      Single hit takes 25% CPU to process

      The maximum throughput is expected to be at least 1.1 queries/sec:
      100% / 25% = 4 clients to saturate the CPU
      4 clients / 3.6 sec waiting = 1.1 queries/sec

      Actual throughput is 0.5 queries/sec and the CPU maximum is 35% for 4+ clients
      The bottleneck is garbage collection. The are more than 300 gc events per second when processing the single query. Which totals it to 1000+ events for entire query.
      The garbage collection takes about 15% of the query time.

      With nearly disabled GC (GOGC=10000) the CPU can be saturated and throughput is up 1.5 queries/sec

      This issue isn't related to MB-21452 (high latency of the date facets query). With limited GC impact the latency of the single query is still very high

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              oleksandr.gyryk Alex Gyryk (Inactive)
              oleksandr.gyryk Alex Gyryk (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty