Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-52170

queuedSeqnoAck: invariant failed

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • Yes
    • KV June 2022

    Description

       

      Build:  7.1.1-3056

      Scenario:

      • 3 kv node cluster
      • Couchbase bucket with replicas=2
      • Delta failover (172.23.108.97) and rebalance out the node

      CB failure log:

      Rebalance exited with reason {{badmatch, {error, failed_nodes,[\'ns_1@172.23.108.98\']}}},
      [{ns_janitor,cleanup_apply_config_body,4,[{file,"src/ns_janitor.erl"},{line,295}]},
      {ns_janitor,\'-cleanup_apply_config/4-fun-0-\',4,[{file,"src/ns_janitor.erl"},{line,215}]},
      {async,\'-async_init/4-fun-1-\',3, [{file,"src/async.erl"},{line,191}]}]}.
      Rebalance Operation Id = 4d82719bd30c809e7ebc3b32e1f55882'}

      TAF test:

       

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.77890.ini GROUP=P0;durability,upgrade_version=7.1.1-3056 -t failover.failovertests.FailoverTests.test_failover_then_add_back_and_rebalance_in,nodes_init=3,replicas=2,num_failed_nodes=1,num_items=300000,recoveryType=delta:full,graceful=True,durability=MAJORITY,GROUP=P0;durability;windows;luks'

       

       

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            ashwin.govindarajulu Ashwin Govindarajulu created issue -
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Field Original Value New Value
            Summary Failover: Rebalance out of failed node failed with during "cleanup_apply_config_body" Failover: Rebalance out of failed node failed during "cleanup_apply_config_body"
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Assignee Abhijeeth Nuthan [ abhijeeth.nuthan ] Navdeep Boparai [ JIRAUSER26109 ]
            navdeep.boparai Navdeep Boparai made changes -
            Assignee Navdeep Boparai [ JIRAUSER26109 ] Daniel Owen [ owend ]
            Balakumaran.Gopal Balakumaran Gopal made changes -
            Priority Major [ 3 ] Critical [ 2 ]
            owend Daniel Owen made changes -
            Component/s ns_server [ 10019 ]
            Component/s couchbase-bucket [ 10173 ]
            owend Daniel Owen made changes -
            Summary Failover: Rebalance out of failed node failed during "cleanup_apply_config_body" queuedSeqnoAck: invariant failed
            owend Daniel Owen made changes -
            Assignee Daniel Owen [ owend ] Ashwin Govindarajulu [ ashwin.govindarajulu ]
            owend Daniel Owen made changes -
            Link This issue is duplicated by MB-52171 [ MB-52171 ]
            owend Daniel Owen made changes -
            Link This issue is duplicated by MB-52171 [ MB-52171 ]
            owend Daniel Owen made changes -
            Link This issue relates to MB-52171 [ MB-52171 ]
            owend Daniel Owen made changes -
            Link This issue relates to MB-52171 [ MB-52171 ]
            owend Daniel Owen made changes -
            Link This issue is duplicated by MB-52171 [ MB-52171 ]
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Assignee Ashwin Govindarajulu [ ashwin.govindarajulu ] Daniel Owen [ owend ]
            owend Daniel Owen made changes -
            Link This issue relates to MB-51606 [ MB-51606 ]
            owend Daniel Owen made changes -
            Link This issue relates to MB-52169 [ MB-52169 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.1.1 [ 18320 ]
            Fix Version/s 7.1.2 [ 18414 ]
            owend Daniel Owen made changes -
            Assignee Daniel Owen [ owend ] Ashwin Govindarajulu [ ashwin.govindarajulu ]
            drigby Dave Rigby made changes -
            Sprint KV June 2022 [ 2203 ]
            drigby Dave Rigby made changes -
            Rank Ranked lower
            owend Daniel Owen made changes -
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              ashwin.govindarajulu Ashwin Govindarajulu
              ashwin.govindarajulu Ashwin Govindarajulu
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty