Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49170

Replica item count lagging active in Magma insert test

    XMLWordPrintable

Details

    Description

      Note: Initially opened on performance variation between, that has been addressed, but now tracking the issue where replica item count does not reach active

      In Magma insert only tests, we see high performance variation. 

      http://172.23.123.237/#/timeline/Linux/hidd/S0/all

      In the latest runs with build 7.1.0-1558, the throughput changed from 122K to 226K.

      http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=rhea_710-1558_access_key_prefix_e3f5&&label=high_insert_rate&snapshot=rhea_710-1558_access_key_prefix_3994&label=low_insert_rate

      In the run having higher throughput, replica sync rate can't catch up.

        There are more sync write flushes after a certain point.

        Sarath Lakshman

      Please take a look. Is there a way we can change checkpoint settings? It looks like the runs can go to different modes (or code paths), even with the same build.

      Attachments

        1. 2c9be7495d498bf4ae151733781c8069.png
          34 kB
          Dave Rigby
        2. fc98c640dcf022cd0036bb64ca36e284.png
          36 kB
          Dave Rigby
        3. MB-49170_build-1729.png
          485 kB
          Paolo Cocchi
        4. Screen Shot 2021-10-26 at 11.17.30 AM.png
          126 kB
          Bo-Chun Wang
        5. Screen Shot 2021-10-26 at 11.40.04 AM.png
          194 kB
          Bo-Chun Wang
        6. Screen Shot 2021-10-26 at 11.40.28 AM.png
          192 kB
          Bo-Chun Wang
        7. Screen Shot 2021-10-26 at 11.46.41 AM.png
          190 kB
          Bo-Chun Wang
        8. Screen Shot 2021-10-28 at 6.14.34 PM.png
          125 kB
          Bo-Chun Wang
        9. Screen Shot 2021-11-09 at 1.57.13 PM.png
          63 kB
          Bo-Chun Wang
        10. Screen Shot 2021-11-09 at 2.05.11 PM.png
          118 kB
          Bo-Chun Wang
        11. Screenshot 2021-11-09 at 2.32.41 PM.png
          12 kB
          Sarath Lakshman
        12. Screenshot 2021-11-09 at 2.35.58 PM.png
          131 kB
          Sarath Lakshman
        13. Screenshot 2021-11-10 at 15.30.33.png
          90 kB
          Dave Rigby
        14. Screenshot 2021-11-10 at 15.41.23.png
          57 kB
          Dave Rigby
        15. Screenshot 2021-11-10 at 15.46.40.png
          378 kB
          Dave Rigby

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              bo-chun.wang Bo-Chun Wang
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty