Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46030

Initial and Incremental build regression in 4 GSI Index Test with 128 byte keysize bloom filter tests

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      We are seeing a regression in both initial and incremental build times for the tests 

      Initial index (min), 1 bucket x 100M, 4 2i Indexes, 100K KV ops/sec, 128 byte keysize, Update/Create Workload, PLASMA With Bloom filter

      Initial index (min), 1 bucket x 100M, 7 2i Indexes, 100K KV ops/sec, 128 byte keysize, Update Create Workload, PLASMA With Bloom filter

      Initial Index values

      http://perf.jenkins.couchbase.com/job/hemera/1633/ - 4668 - 49.7mins

      http://perf.jenkins.couchbase.com/job/hemera/1634/ - 4701  - 60.5mins

      http://perf.jenkins.couchbase.com/job/hemera/1631/ - 4735 - 71.9mins

      http://perf.jenkins.couchbase.com/job/hemera/1626/ - 5017 - 69.5mins

      Stats comparison : http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=hemera_700-4668_build_secondaryindex_caac&snapshot=hemera_700-4701_build_secondaryindex_9ee9  - 4668 vs 4701

      Single index DGM tests for initial and incremental have not regressed

      Single index 1024 byte keysize initial and incremental has not regressed in this time

      100 Index bucket level test (all 100 index on default collection) has not regressed

      The corresponding test with bloom filter disabled has also regressed so it probably does not have anything to with bloom filter setting.

      backstore cachemisses are higher

      Mainstore cache misses are higher

       

      timings_storage_set is higher

       

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            jliang John Liang added a comment - - edited

            Between 4668 and 4701, we comment out some memory optimization because we were trying to isolate memory courruption at that time (4678). We are not going to enable the optimization in 7.0. Possibly 7.0.1.
            MB-44749: Comment out compact on split and compact on full marshal

            jliang John Liang added a comment - - edited Between 4668 and 4701, we comment out some memory optimization because we were trying to isolate memory courruption at that time (4678). We are not going to enable the optimization in 7.0. Possibly 7.0.1. MB-44749 : Comment out compact on split and compact on full marshal
            jliang John Liang added a comment -

            Looking at 7 indexes test, it still performs better than 6.6. Defer it to CC.Next. Too late to fix this now.

            jliang John Liang added a comment - Looking at 7 indexes test, it still performs better than 6.6. Defer it to CC.Next. Too late to fix this now.
            jliang John Liang added a comment -

            For build 7.1.0-1061, build time is 60 min.

            With frag auto tuner turned on, build time is 44 min
            http://perf.jenkins.couchbase.com/job/hemera/2273/console

            I don't plan to turn on frag auto tuner in 7.0.1, so defer this to Neo or later.

            jliang John Liang added a comment - For build 7.1.0-1061, build time is 60 min. With frag auto tuner turned on, build time is 44 min http://perf.jenkins.couchbase.com/job/hemera/2273/console I don't plan to turn on frag auto tuner in 7.0.1, so defer this to Neo or later.
            jliang John Liang added a comment -

            For build 7.1.0-1085, 7 index build time is 39 min. For 4 index, it is 24 min.

            jliang John Liang added a comment - For build 7.1.0-1085, 7 index build time is 39 min. For 4 index, it is 24 min.

            build: 7.1.0-2021

            4 2i index initial time : 38.5  , incremental time: 36.8 

            7 2i index initial time : 71.1 , incremental time: 57

            vikas.chaudhary Vikas Chaudhary added a comment - build: 7.1.0-2021 4 2i index initial time : 38.5  , incremental time: 36.8  7 2i index initial time : 71.1 , incremental time: 57

            People

              vikas.chaudhary Vikas Chaudhary
              prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty