Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-28710

Rebalance exited with reason {badmatch, {leader_activities_error, {default,rebalance}, quorum_lost}}

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 5.5.0
    • 5.5.0
    • ns_server, query
    • Enterprise Edition 5.5.0 build 2181

    Description

      Rebalance is failing for Centos longevity test with 

      Rebalance exited with reason {badmatch, {leader_activities_error, {default,rebalance}, quorum_lost}}

      Similar issuer was observed in MB-28253

      Cluster is still running for debugging

      Attachments

        1. mem resident on query nodes.png
          180 kB
          Dave Finlay
        2. query errors.png
          175 kB
          Dave Finlay
        3. query request time.png
          251 kB
          Dave Finlay
        4. query requests.png
          198 kB
          Dave Finlay
        5. query cpu.png
          242 kB
          Dave Finlay
        6. memNoIndexerErr.pprof
          14.70 MB
          John Liang
        7. profileNoIndexerErr.pprof
          86 kB
          John Liang
        8. mar19secondrun
          89 kB
          Arunkumar Senthilnathan
        9. mar19firstrun
          46 kB
          Arunkumar Senthilnathan
        10. cpu001.svg
          254 kB
          Marco Greco
        11. heap002.svg
          204 kB
          Marco Greco
        12. cbq.mprof
          5.02 MB
          Arunkumar Senthilnathan
        13. secondtrun
          1 kB
          Arunkumar Senthilnathan
        14. firstrun
          85 kB
          Arunkumar Senthilnathan
        27. cbq-engine memory.png
          212 kB
          Dave Finlay
        28. cpu usage.png
          661 kB
          Dave Finlay
        29. node_99.25_swap_usage.png
          221 kB
          Ajit Yagaty [X]
        30. node_99.25_ns_server_CPU_util.png
          289 kB
          Ajit Yagaty [X]
        31. node_99.25_cbq-engine_CPU_util.png
          354 kB
          Ajit Yagaty [X]

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-28306 Service 'query' exited with status 134 - centos longevity

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-28842 Thousands of sockets in TIME_WAIT state during system test

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          For Gerrit Dashboard: MB-28710
          # Subject Branch Project Status CR V
          91151,3 MB-28710 zap items before pooling value exchange master query Status: MERGED +2 +1
          91440,3 MB-28710 Require only majority quorums. master ns_server Status: MERGED +2 +1

          Activity

            People

              Aliaksey Artamonau Aliaksey Artamonau (Inactive)
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty