Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-28017

Latency of aggregation queries is higher than expected

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 5.5.0
    • 5.5.0
    • secondary-index
    • CentOS 7.4
      E5-2680 v3 (48 vCPU)
    • Untriaged
    • Centos 64-bit
    • No

    Description

      As discussed, I am creating a ticket for further investigation of why some aggregation queries are slower than expected.

      Setup:

      • 4 KV nodes, 1 query node, 1 index node
      • 1 bucket
      • 100M documents (denormalized store_sales from TPC-DS)
      • MOI indexes
      • Single client thread (no concurrency)

      Queries and indexes:
      https://docs.google.com/document/d/1C0mOKGn-d9HKV6SCaHGlSm1FkfoJQ23Stmr5lmBAA3M/edit#heading=h.czsz4i2s2rvl

      Results for build 5.5.0-1863:

      query w/o pushdown w/ pushdown
      AG1              12s                10s
      AG2  index scan timed out   index scan timed out
      AG3          150-200 ms          200-250 ms
      AG4          
      AG5                3 s               3 s
      AG6              30 s             200 ms
      AG7             < 50ms            < 50ms
      AG8             500 ms             500 ms
      AG9               18 s              18 s
      AG10            < 50ms            < 50ms

      Attachments

        1. mprofa_before_ag4.svg
          106 kB
          Deepkaran Salooja
        2. mprofa_after2run_ag4.svg
          105 kB
          Deepkaran Salooja
        3. mprofa_after1run_ag4.svg
          111 kB
          Deepkaran Salooja
        4. cpu_profQ1.svg
          136 kB
          Deepkaran Salooja
        5. cpu_prof_count_single_field.svg
          132 kB
          Deepkaran Salooja
        6. cpu_prof_count_multiple_field.svg
          134 kB
          Deepkaran Salooja
        7. cpu_AG4_lat_5.5.0-1979.svg
          246 kB
          Pavel Paulau
        8. cpu_AG3_thr_5.5.0-1897.svg
          246 kB
          Pavel Paulau
        9. ag2_partioned_cpu_5.5.0-2326.svg
          234 kB
          Pavel Paulau
        10. ag2_cpu_5.5.0-2326.svg
          234 kB
          Pavel Paulau

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-28698 improve scan stat gathering

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MB-28915 optimize collatejson DecodeFloat

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MB-28598 Perf Improvement: Optimize decode occurring across source and decode stages in scan pipeline

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-29010 Consider optimizing expression Evaluate/annotatedValue SetCover

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-28599 Optimize ExplodeArray further to avoid garbage allocation

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              deepkaran.salooja Deepkaran Salooja
              pavelpaulau Pavel Paulau (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty