Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50361

15% drop in AG6 throughput

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • Unknown

    Attachments

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

      Activity

        saptarshi.sen Saptarshi Sen added a comment - - edited

        I reverted all the commits related to holeCleaner and ran the test with a toy build (7.1.0-14332)

        a) https://review.couchbase.org/c/plasma/+/169280 [plasma]
        b) https://review.couchbase.org/c/plasma/+/169281 [plasma]
        c https://review.couchbase.org/c/plasma/+/169293 [plasma]
        d) https://review.couchbase.org/c/indexing/+/169269 [indexer config]

        Toy Build
        Parameters: http://server.jenkins.couchbase.com/view/Toys/job/toy-unix-simple/4332/parameters/

        Perf Test : http://perf.jenkins.couchbase.com/job/arke/9862/console
        I still observed a similar query/sec number (1637) in the test as to what was reported for the build 2007 (1647).

        So it does not seem to be related to the holeCleaner changes.

        Reference Notes:

        build 2007 (indexer stats)

        "bucket-1:ag6:timings/n1ql_expr_eval":"988095 0 0","bucket-1:ag6:num_requests_range":0,"bucket-1:ag6:num_completed_requests_range":0,"bucket-1:ag6:num_rows_returned_range":0,"bucket-1:ag6:num_rows_scanned_range":0,"bucket-1:ag6:scan_cache_hit_range":0,"bucket-1:ag6:num_requests_aggr":988095,"bucket-1:ag6:num_completed_requests_aggr":988095,"bucket-1:ag6:num_rows_returned_aggr":98809500,"bucket-1:ag6:num_rows_scanned_aggr":1388228644,"bucket-1:ag6:scan_cache_hit_aggr":0,"10857409829870475256:completion_progress":4636737291354636288,
         

        build 2006 (indexer stats)

        "bucket-1:ag6:timings/n1ql_expr_eval":"1236532 0 0","bucket-1:ag6:num_requests_range":0,"bucket-1:ag6:num_completed_requests_range":0,"bucket-1:ag6:num_rows_returned_range":0,"bucket-1:ag6:num_rows_scanned_range":0,"bucket-1:ag6:scan_cache_hit_range":0,"bucket-1:ag6:num_requests_aggr":1236532,"bucket-1:ag6:num_completed_requests_aggr":1236532,"bucket-1:ag6:num_rows_returned_aggr":123653200,"bucket-1:ag6:num_rows_scanned_aggr":1737315043,"bucket-1:ag6:scan_cache_hit_aggr":0,"86388607918421446:completion_progress":4636737291354636288,
        

        saptarshi.sen Saptarshi Sen added a comment - - edited I reverted all the commits related to holeCleaner and ran the test with a toy build (7.1.0-14332) a) https://review.couchbase.org/c/plasma/+/169280 [plasma] b) https://review.couchbase.org/c/plasma/+/169281 [plasma] c https://review.couchbase.org/c/plasma/+/169293 [plasma] d) https://review.couchbase.org/c/indexing/+/169269 [indexer config] Toy Build Parameters: http://server.jenkins.couchbase.com/view/Toys/job/toy-unix-simple/4332/parameters/ Perf Test : http://perf.jenkins.couchbase.com/job/arke/9862/console I still observed a similar query/sec number (1637) in the test as to what was reported for the build 2007 (1647). So it does not seem to be related to the holeCleaner changes. Reference Notes: build 2007 (indexer stats) "bucket-1:ag6:timings/n1ql_expr_eval":"988095 0 0","bucket-1:ag6:num_requests_range":0,"bucket-1:ag6:num_completed_requests_range":0,"bucket-1:ag6:num_rows_returned_range":0,"bucket-1:ag6:num_rows_scanned_range":0,"bucket-1:ag6:scan_cache_hit_range":0,"bucket-1:ag6:num_requests_aggr":988095,"bucket-1:ag6:num_completed_requests_aggr":988095,"bucket-1:ag6:num_rows_returned_aggr":98809500,"bucket-1:ag6:num_rows_scanned_aggr":1388228644,"bucket-1:ag6:scan_cache_hit_aggr":0,"10857409829870475256:completion_progress":4636737291354636288, build 2006 (indexer stats) "bucket-1:ag6:timings/n1ql_expr_eval":"1236532 0 0","bucket-1:ag6:num_requests_range":0,"bucket-1:ag6:num_completed_requests_range":0,"bucket-1:ag6:num_rows_returned_range":0,"bucket-1:ag6:num_rows_scanned_range":0,"bucket-1:ag6:scan_cache_hit_range":0,"bucket-1:ag6:num_requests_aggr":1236532,"bucket-1:ag6:num_completed_requests_aggr":1236532,"bucket-1:ag6:num_rows_returned_aggr":123653200,"bucket-1:ag6:num_rows_scanned_aggr":1737315043,"bucket-1:ag6:scan_cache_hit_aggr":0,"86388607918421446:completion_progress":4636737291354636288,
        jliang John Liang added a comment -

        Jeelan PoolaAssign back to you for now since the same regression happens even after we comment out the hole cleaning code.

        jliang John Liang added a comment - Jeelan Poola Assign back to you for now since the same regression happens even after we comment out the hole cleaning code.
        jliang John Liang added a comment - - edited

        Btw, the latest AG6 throughput is back to 2562 in build 7.1.0-2123.

        Korrigan Clark It may be a good idea to do a couple of runs with build 2123 to confirm the result.

        jliang John Liang added a comment - - edited Btw, the latest AG6 throughput is back to 2562 in build 7.1.0-2123. Korrigan Clark It may be a good idea to do a couple of runs with build 2123 to confirm the result.

        Ive kicked off two confirmation runs

        korrigan.clark Korrigan Clark (Inactive) added a comment - Ive kicked off two confirmation runs

        runs look good... closing

        korrigan.clark Korrigan Clark (Inactive) added a comment - runs look good... closing

        People

          varun.velamuri Varun Velamuri
          korrigan.clark Korrigan Clark (Inactive)
          Votes:
          0 Vote for this issue
          Watchers:
          8 Start watching this issue

          Dates

            Created:
            Updated:
            Resolved:

            Gerrit Reviews

              There are 2 open Gerrit changes

              PagerDuty