Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11827

{UPR} :: Rebalance stuck with rebalance-out due to indexing stuck

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 3.0
    • 3.0
    • Security Level: Public
    • None
    • 10.6.2.144-10.6.2.147
    • Untriaged
    • Yes
    • June 30 - July 18

    Description

      1033, centos 6x

      1. Create 4 node cluster
      2. Create default bucket
      3. Add 1 K items
      4. Create 3 views and start querying
      5. Rebalance-out 1 node

      Step 4 and Step 5 act in parallel

      Rebalance is stuck

      looked at couchdb log, found the following error across different machines in cluster

      [couchdb:error,2014-07-26T18:47:27.450,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16158.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      [couchdb:error,2014-07-26T18:47:27.557,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16199.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      [couchdb:error,2014-07-26T18:47:27.745,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16230.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      [couchdb:error,2014-07-26T18:47:27.783,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16240.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      [couchdb:error,2014-07-26T18:47:27.831,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16250.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      [couchdb:error,2014-07-26T18:47:27.877,ns_1@10.6.2.146:<0.15845.1>:couch_log:error:44]Cleanup process <0.16260.1> for set view `default`, replica (prod) group `_design/default_view`, died with reason: stopped

      TEST CASE ::
      ./testrunner -i ../palm.ini get-cbcollect-info=False,get-logs=False,stop-on-failure=False,get-coredumps=False,force_kill_memached=False,verify_unacked_bytes=True -t rebalance.rebalance_progress.RebalanceProgressTests.test_progress_rebalance_out,nodes_init=4,nodes_out=1,GROUP=P0,skip_cleanup=True,blob_generator=false

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            mikew Mike Wiederhold [X] (Inactive)
            parag Parag Agarwal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty