Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-16096

rebalance failed due to wait_seqno_persisted_failed,"default",828, 926025,

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 4.1.0
    • 3.1.0
    • couchbase-bucket
    • Security Level: Public
    • None
    •   centos 6.5 64-bit, 8 core cpu, 30 GB RAM, 80 GB SSD, 10 Git network

    Description

      Install cb server 3.1.0-1776 on 7 nodes
      Create cluster of 7 nodes
      Create defautl bucket with 2 replica
      Load 119 million items with size 100 bytes to default bucket (no view and 100% set) Front load is 250K/second

      Install cb server 3.1.0-1776 on other 5 nodes
      Add new 5 nodes to cluster and remove 5 nodes (swap rebalance)
      Rebalance failed with error memcached disconnect
      Filed ticket MB-16093
      Lower the front load to 110K with 100% set
      Try to rebalance again. Rebalance failed in ~25 minutes with error

      Rebalance exited with reason {unexpected_exit,
      {'EXIT',<0.26826.227>,
      {wait_seqno_persisted_failed,"default",828,
      926025,
      [{'ns_1@10.156.27.78',
      {'EXIT',
      {badmatch,{error,timeout,
      {gen_server,call,
      ['ns_memcached-default',

      {get_dcp_docs_estimate,522, "replication:ns_1@10.156.27.78->ns_1@10.154.33.77:default"}

      ,
      180000]}},
      {gen_server,call,
      [

      {'janitor_agent-default', 'ns_1@10.156.27.78'}

      ,
      {if_rebalance,<0.21031.227>,
      {wait_seqno_persisted,828,926025}},
      infinity]}}}}]}}}

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-16093 rebalance failed due to dcp_wait_for_data_move_failed,"default",137,

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-16093 rebalance failed due to dcp_wait_for_data_move_failed,"default",137,

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              manu Manu Dhundi (Inactive)
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty