Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50710

DGM scenarios hit auto-failover on build 7.1.0-2179

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Magma heavy-write throughput test hits auto-failover consistently on build 7.1.0-2179.

      Node ('ns_1@172.23.97.29') was automatically failed over. Reason: The data service did not respond for the duration of the auto-failover threshold. Either none of the buckets have warmed up or there is an issue with the data service.

      Disk usage worker is stuck on node "ns_1@172.23.97.26". Please ensure all mounts are accessible via "df" and consider killing any existing "df" processes.

      Build: 7.1.0-2179

      Job: http://perf.jenkins.couchbase.com/job/rhea-5node2/1872/ 

      Logs:

      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2022-02-01T010418-ns_1%40172.23.97.26.zip
      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2022-02-01T003901-ns_1%40172.23.97.27.zip
      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2022-02-01T003901-ns_1%40172.23.97.28.zip
      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2022-02-01T003901-ns_1%40172.23.97.29.zip

      Attachments

        1. Screen Shot 2022-01-31 at 9.47.27 PM.png
          24 kB
          Girish Benakappa
        2. Screen Shot 2022-01-31 at 9.48.18 PM.png
          125 kB
          Girish Benakappa
        3. Screenshot 2022-02-01 at 17.42.52.png
          162 kB
          Ben Huddleston
        4. Screenshot 2022-02-01 at 17.52.10.png
          47 kB
          Ben Huddleston
        5. Screenshot 2022-02-01 at 18.13.50.png
          37 kB
          Ben Huddleston
        6. Screenshot 2022-02-01 at 18.13.56.png
          42 kB
          Ben Huddleston

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              bo-chun.wang Bo-Chun Wang
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty