Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56538

[System Test] High indexer CPU usage over a period of 3+ hours with CDC enabled

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      System test run params

      -provider file:centos_component_third.yml -test tests/2i/neo/test_neo_idx_clusterops_recovery.yml -scope tests/2i/neo/scope_neo_plasma_idx_magma_cdc_enabled.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.0-5312 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=259200 -show_topology=true -aws_access_key=AKIAQB2Z2UCIUMQB6JF3 -aws_secret_key=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

      The system test is into its 2nd day. About 1 day and 15 hours into the run, there's been an increase in the CPU usage on a couple indexer nodes. It has stayed at or around 90% for the last 3 hours or so.

      cbcollect ->

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.106.176.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.97.109.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1681960154/collectinfo-2023-04-20T030917-ns_1%40172.23.97.67.zip

      Attachments

        1. 97_108.svg
          137 kB
          Dhruvil Shah
        2. 97_108-1.svg
          127 kB
          Dhruvil Shah
        3. 97_109.svg
          140 kB
          Dhruvil Shah
        4. Screenshot 2023-04-20 at 9.48.42 AM.png
          535 kB
          Pavan PB
        5. Screenshot 2023-04-20 at 9.49.12 AM.png
          392 kB
          Pavan PB
        6. Screenshot 2023-04-24 at 1.34.35 PM.png
          222 kB
          Dhruvil Shah
        7. Screenshot 2023-04-24 at 1.34.52 PM.png
          146 kB
          Dhruvil Shah
        8. Screenshot 2023-04-24 at 12.57.29 PM.png
          252 kB
          Dhruvil Shah
        9. Screenshot 2023-04-24 at 7.03.00 PM.png
          202 kB
          Dhruvil Shah
        10. Screenshot 2023-04-24 at 7.22.05 PM.png
          785 kB
          Pavan PB
        11. Screenshot 2023-04-25 at 9.43.17 PM.png
          437 kB
          Dhruvil Shah
        12. Screenshot 2023-04-25 at 9.43.17 PM-1.png
          437 kB
          Dhruvil Shah

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MB-56954 Reduce memory overhead from TsVbuuid

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-57777 [7.2.1 BP] - Reduce memory overhead from TsVbuuid

          • Major - Major loss of function.
          • Closed
          split to

          Improvement - An improvement or enhancement to an existing feature or task. MB-56649 Improve queue control when indexer is under memory pressure

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pavan.pb Pavan PB
              pavan.pb Pavan PB
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty