Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-52658

[CBM] Import Lines throughput dropped 15-30% in 7.1.1

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • Morpheus
    • 7.1.1
    • qe
    • None
    • Untriaged
    • 1
    • Unknown

    Description

      We have noticed some fairly significant throughput drops in Import Lines tests, of between 15-30%.

      Two tests specifically are impacted: 

      1. http://showfast.sc.couchbase.com/#/timeline/Linux/tools/import/all#tools_import_60M_json_lines_1s_1c_leto
      2. http://showfast.sc.couchbase.com/#/timeline/Linux/tools/import/all#tools_import_60M_json_lines_leto

       

      We do see a history of throughput fluctuations in these tests, so more investigation is required from our end too to confirm what is going on, but with needing to sign off on RC1 of 7.1.1 I wanted to raise this just in case.

       

      Examples of good/bad tests from test 2:

      Cbmonitor comparison: http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=leto_711-3135_import_data_84d0&snapshot=leto_711-3166_import_data_b2df

       

      I am rerunning the "good" test above to confirm whether the performance differences are environmental or product-related. The "bad" result is reproducable: http://showfast.sc.couchbase.com/#/runs/tools_import_60M_json_lines_leto/7.1.1-3166

       

      Sorry for the quick-and-dirty initial report, I will be updating this tomorrow.

      Attachments

        1. cbimport-benchmarks.txt
          3 kB
        2. cheshire-cat.pprof
          158 kB
        3. image-2022-06-22-18-06-09-923.png
          image-2022-06-22-18-06-09-923.png
          38 kB
        4. image-2022-06-23-17-37-40-037.png
          image-2022-06-23-17-37-40-037.png
          46 kB
        5. image-2022-06-23-17-59-08-731.png
          image-2022-06-23-17-59-08-731.png
          299 kB
        6. image-2022-06-23-17-59-32-722.png
          image-2022-06-23-17-59-32-722.png
          236 kB
        7. image-2022-06-23-18-03-13-613.png
          image-2022-06-23-18-03-13-613.png
          227 kB
        8. image-2022-06-23-18-06-00-971.png
          image-2022-06-23-18-06-00-971.png
          247 kB
        9. image-2022-06-23-18-20-10-678.png
          image-2022-06-23-18-20-10-678.png
          245 kB
        10. image-2022-06-23-18-22-33-599.png
          image-2022-06-23-18-22-33-599.png
          254 kB
        11. image-2022-06-23-18-29-58-748.png
          image-2022-06-23-18-29-58-748.png
          273 kB
        12. image-2022-06-23-18-31-27-522.png
          image-2022-06-23-18-31-27-522.png
          272 kB
        13. image-2022-06-23-18-34-42-559.png
          image-2022-06-23-18-34-42-559.png
          326 kB
        14. neo.pprof
          191 kB
        15. Screenshot from 2022-06-27 10-18-48.png
          Screenshot from 2022-06-27 10-18-48.png
          5 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Daniel.nagy Daniel Nagy
            Daniel.nagy Daniel Nagy
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty