Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48834

Improve XDCR performance with Magma

    XMLWordPrintable

Details

    Description

      I re-run two existing XDCR tests with Magma. Compared to Couchstore, Magma performance is about 50% lower. I open this ticket to track XDCR+Magma performance improvement. All runs were running on build 7.1.0-1401.

       

      Avg. initial XDCR rate (items/sec), 1 -> 1 (2 source nozzles, 4 target nozzles), 1 bucket x 100M x 1KB

       

       

      Avg. initial XDCR rate (items/sec), 5 -> 5 (2 source nozzles, 4 target nozzles), 1 bucket x 250M x 1KB

       

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-48834
          # Subject Branch Project Status CR V

          Activity

            bo-chun.wang Bo-Chun Wang created issue -
            jliang John Liang made changes -
            Field Original Value New Value
            Assignee John Liang [ jliang ] Neil Huang [ neil.huang ]
            srinath.duvuru Srinath Duvuru made changes -
            Issue Type Improvement [ 4 ] Bug [ 1 ]
            jliang John Liang made changes -
            Assignee Neil Huang [ neil.huang ] Lilei Chen [ lilei.chen ]
            wayne Wayne Siu made changes -
            Assignee Lilei Chen [ lilei.chen ] Bo-Chun Wang [ bo-chun.wang ]
            bo-chun.wang Bo-Chun Wang made changes -
            bo-chun.wang Bo-Chun Wang made changes -
            bo-chun.wang Bo-Chun Wang made changes -
            bo-chun.wang Bo-Chun Wang made changes -
            bo-chun.wang Bo-Chun Wang made changes -
            bo-chun.wang Bo-Chun Wang made changes -
            Assignee Bo-Chun Wang [ bo-chun.wang ] Daniel Owen [ owend ]
            wayne Wayne Siu made changes -
            Labels magma xdcr magma performance xdcr
            jliang John Liang made changes -
            Component/s couchbase-bucket [ 10173 ]
            owend Daniel Owen made changes -
            Rank Ranked higher
            owend Daniel Owen made changes -
            Component/s XDCR [ 10136 ]
            owend Daniel Owen made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            owend Daniel Owen made changes -
            Sprint KV 2021-Dec [ 1906 ]
            owend Daniel Owen made changes -
            Rank Ranked lower
            owend Daniel Owen made changes -
            Attachment magma-105.png [ 171480 ]
            owend Daniel Owen made changes -
            Epic Link MB-30659 [ 88207 ]
            Is this a Regression? Yes [ 10450 ]
            owend Daniel Owen made changes -
            Attachment magma-105-sentitems.png [ 171828 ]
            owend Daniel Owen made changes -
            Attachment couchstore-105-sentitems.png [ 171834 ]
            owend Daniel Owen made changes -
            Attachment magma-105-backfills.png [ 171835 ]
            owend Daniel Owen made changes -
            Attachment couchstore-105-backfills.png [ 171836 ]
            owend Daniel Owen made changes -
            Status In Progress [ 3 ] Open [ 1 ]
            owend Daniel Owen made changes -
            Triage Triaged [ 10350 ]
            owend Daniel Owen made changes -
            Sprint KV 2021-Dec [ 1906 ]
            owend Daniel Owen made changes -
            Rank Ranked higher
            owend Daniel Owen made changes -
            Component/s couchbase-bucket [ 10173 ]
            Component/s storage-engine [ 10175 ]
            owend Daniel Owen made changes -
            Assignee Daniel Owen [ owend ] Srinath Duvuru [ srinath.duvuru ]
            srinath.duvuru Srinath Duvuru made changes -
            Assignee Srinath Duvuru [ srinath.duvuru ] Sarath Lakshman [ sarath ]
            james.harrison James Harrison made changes -
            Link This issue is duplicated by MB-48569 [ MB-48569 ]
            bo-chun.wang Bo-Chun Wang made changes -
            sarath Sarath Lakshman made changes -
            sarath Sarath Lakshman made changes -
            srinath.duvuru Srinath Duvuru made changes -
            Issue Type Bug [ 1 ] Task [ 3 ]
            sarath Sarath Lakshman made changes -
            owend Daniel Owen made changes -
            Component/s storage-engine [ 10175 ]
            Component/s couchbase-bucket [ 10173 ]
            sarath Sarath Lakshman made changes -
            Component/s storage-engine [ 10175 ]
            bo-chun.wang Bo-Chun Wang made changes -
            Issue Type Task [ 3 ] Improvement [ 4 ]
            srinath.duvuru Srinath Duvuru made changes -
            Fix Version/s Neo [ 17615 ]
            Fix Version/s Morpheus [ 17651 ]
            drigby Dave Rigby made changes -
            Epic Link MB-30659 [ 88207 ] MB-51282 [ 184825 ]

            People

              sarath Sarath Lakshman
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There is 1 open Gerrit change

                  PagerDuty