Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44614

Investigate ns_server/collection differences in compaction tests

    XMLWordPrintable

Details

    • 1
    • Yes

    Description

      Cloned from MB-44539 so that analysis for beam.smp isn't lost in my myriad of updates regarding the memcached analysis.

      The following text is the orginal summary from Korrigan and i've highlighted the beam.smp questions.


      For our compaction time tests there are some differences seen when comparing default collection (bucket) to 1 scope 1 collection, 1 scope 1000 collections, and 1000 scopes 1000 collections.

      Showfast page for all the tests: 

      http://showfast.sc.couchbase.com/#/timeline/Linux/kv/compact/all

      Note: default collection (bucket) test uses python sdk2 and the rest of the tests use python sdk3. There is a higher in the number of connection made per client in sdk3.

       

      default vs. 1 scope 1 collection:

      graph comparison - http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=athena_700-4502_compact_e699&label=default&snapshot=athena_700-4502_compact_cd05&label=1s1c

      1 - mem_used and ep_meta_data_memory in 1 collection case is higher than for default and trends lower, whereas default trends higher throughout the test

      2 - vb_active_resident_items_ratio is 25% higher in 1 collection case

      3 - vb_replica_resident_items_ratio starts higher and trends lower in 1 collection case, whereas default trends higher

      4 - avg_disk_commit_time, avg_disk_update_time, vb_avg_total_queue_age are higher for all percentiles in 1 collection case

      5 - couch_docs_actual_disk_size and couch_docs_fragmentation starts 25% higher in 1 collection case

      6 - memcached_rss 15% higher in 1 collection case

      7 - Cached (memory in pagecache) is 5% lower in 1 collection case

       

      default vs 1 scope 1000 collections:

      graph comparison - http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=athena_700-4502_compact_e699&label=default&snapshot=athena_700-4502_compact_a7b7&label=1s1000c

      1 - vb_active_resident_items_ratio is 100% higher in 1 scope 1000 collection case

      2 - vb_replica_resident_items_ratio is less than 1% (near 0%)  in 1 scope 1000 collection case, whereas default is around 5%

      3 - couch_docs_actual_disk_size is 40% higher in 1 scope 1000 collection case

      4 - couch_docs_fragmentation is 50% higher in 1 scope 1000 collection case

      5 - beam.smp_rss is 250% higher in 1 scope 1000 collection case

      6 - beam.smp_cpu is 600% higher in 1 scope 1000 collection case

      7 - memcached_cpu is 25% higher in 1 scope 1000 collection case

       

      default vs 1000 scopes 1000 collections:

      graph comparison - http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=athena_700-4502_compact_e699&label=default&snapshot=athena_700-4502_compact_0315&label=1000s1000c

       

      1 scope 1000 collections vs. 1000 scopes 1000 collections:

      graph comparison - http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=athena_700-4502_compact_a7b7&label=1s1000c&snapshot=athena_700-4502_compact_0315&label=1000s1000c

      1 - avg_disk_update_time is higher for all percentiles in 1000 scope 1000 collection case.

      2 - beam.smp_rss is 10% higher in 1000 scope 1000 collection case

      3 - beam.smp_cpu is 70% higher in 1000 scope 1000 collection case

       

       

       

      Attachments

        1. image-2021-03-05-13-25-26-371.png
          image-2021-03-05-13-25-26-371.png
          169 kB
        2. screenshot-1.png
          screenshot-1.png
          68 kB
        3. screenshot-2.png
          screenshot-2.png
          59 kB
        4. screenshot-3.png
          screenshot-3.png
          81 kB
        5. screenshot-4.png
          screenshot-4.png
          86 kB
        6. screenshot-5.png
          screenshot-5.png
          92 kB
        7. screenshot-6.png
          screenshot-6.png
          95 kB
        8. screenshot-7.png
          screenshot-7.png
          114 kB
        9. screenshot-8.png
          screenshot-8.png
          59 kB
        10. screenshot-9.png
          screenshot-9.png
          40 kB

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              steve.watanabe Steve Watanabe
              jwalker Jim Walker
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty