Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42115

Graceful failover failed with reason "wait_seqno_persisted_failed"

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • None
    • 6.5.1
    • couchbase-bucket
    • Enterprise Edition 6.5.1 build 6299

    Description

      Build: 6.5.1-6299

      Scenario:

      • 4 node cluster
      • Create default bucket with replica=2, TTL=300seconds
      • Started data loading using cbc-pillowfight 

        ./cbc-pillowfight -U couchbase://localhost/default -u Administrator -P password -I 1000000 --random-body -t 8

      • Initiated graceful failover of node (172.23.105.206)

      Observation:

      172.23.105.159 crashed during the failover with logs

      Graceful failover exited with reason {mover_crashed,
      		 
      {unexpected_exit, {'EXIT',<0.905.6>,
      		 
      {{wait_seqno_persisted_failed, "default",510,1099,
      		 
      [{'ns_1@172.23.105.206',
      		 
      {'EXIT', {socket_closed,
      		 
      {gen_server,call,
      		 
      [{'janitor_agent-default', 'ns_1@172.23.105.206'},
      		 
      {if_rebalance,<0.628.6>,
      		 
      {wait_seqno_persisted,510, 1099}}, infinity]}}}}]},
      		 
      [{ns_single_vbucket_mover, '-wait_seqno_persisted_many/5-fun-2-', 5,
      		 
      [{file, "src/ns_single_vbucket_mover.erl"}, {line,488}]},
      		 
      {proc_lib,init_p,3, [{file,"proc_lib.erl"}, {line,232}]}]}}}}.
      		 
      Rebalance Operation Id = e33011c1125dafcbd315aaffbb7a0a68

       

      Attachments

        Issue Links

          duplicates

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MB-38441 HiDD: 1% Residency Ratio

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-48079 STREAM_REQUEST "lost" by DcpProducer during replication stream setup

          • Major - Major loss of function.
          • Resolved
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ashwin.govindarajulu Ashwin Govindarajulu
              ashwin.govindarajulu Ashwin Govindarajulu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty