Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48834

Improve setWithMeta performance with Magma

    XMLWordPrintable

Details

    Description

      I re-run two existing XDCR tests with Magma. Compared to Couchstore, Magma performance is about 50% lower. I open this ticket to track XDCR+Magma performance improvement. All runs were running on build 7.1.0-1401.

       

      Avg. initial XDCR rate (items/sec), 1 -> 1 (2 source nozzles, 4 target nozzles), 1 bucket x 100M x 1KB

       

      Storage XDCR rate Job
      Couchstore 141381 http://perf.jenkins.couchbase.com/job/titan/12218/
      Magma 79794 http://perf.jenkins.couchbase.com/job/titan/12214/

       

      Avg. initial XDCR rate (items/sec), 5 -> 5 (2 source nozzles, 4 target nozzles), 1 bucket x 250M x 1KB

      Storage Heading 2 Job
      Couchstore 619398 http://perf.jenkins.couchbase.com/job/titan/12217/
      Magma 343931 http://perf.jenkins.couchbase.com/job/titan/12215/

       

      Attachments

        1. couchstore-105-backfills.png
          46 kB
          Daniel Owen
        2. couchstore-105-sentitems.png
          46 kB
          Daniel Owen
        3. magma-105.png
          43 kB
          Daniel Owen
        4. magma-105-backfills.png
          47 kB
          Daniel Owen
        5. magma-105-sentitems.png
          50 kB
          Daniel Owen
        6. Screen Shot 2021-10-27 at 2.00.57 PM.png
          199 kB
          Bo-Chun Wang
        7. Screen Shot 2021-10-27 at 2.05.55 PM.png
          184 kB
          Bo-Chun Wang
        8. Screen Shot 2021-10-27 at 2.08.14 PM.png
          178 kB
          Bo-Chun Wang
        9. Screen Shot 2021-10-27 at 2.09.06 PM.png
          175 kB
          Bo-Chun Wang
        10. Screen Shot 2021-10-27 at 2.15.50 PM.png
          125 kB
          Bo-Chun Wang
        11. Screen Shot 2022-01-12 at 4.42.26 PM.png
          111 kB
          Bo-Chun Wang
        12. Screenshot 2022-01-13 at 11.13.12 AM.png
          63 kB
          Sarath Lakshman
        13. Screenshot 2022-01-13 at 11.16.39 AM.png
          96 kB
          Sarath Lakshman
        14. Screenshot 2022-01-14 at 8.18.17 AM.png
          56 kB
          Sarath Lakshman

        Issue Links

          causes

          Task - A task that needs to be done. MB-59098 Test the performance of cbdatarecovery on magma buckets

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-48569 [Magma, 30TB, 1% DGM]: Indexer drain rate is extremely slow

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          For Gerrit Dashboard: MB-48834
          # Subject Branch Project Status CR V
          168943,2 MB-48834 util/file: Add support for sync_file_range master magma Status: NEW 0 +1

          Activity

            People

              owend Daniel Owen
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There is 1 open Gerrit change

                  PagerDuty