Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-14305

ns_server fails to detect lost replica building stream (was: rebalance is extremely slow when adding 3 nodes to the cluster.)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 3.1.0
    • 3.0.2, 3.0.3
    • ns_server
    • Security Level: Public
    • None
    • centos 6.5 64-bit in EC2
      (instant 8 core cpu, 15 GB RAM and 80 GB SSD)

    Description

      Create a 3 nodes cluster on AWS (instant 8 core cpu, 15 GB RAM and 80 GB SSD)
      Load 15 million keys (each key size 1K) to cluster.
      Load 4 million keys more to cluster and add 3 more nodes to cluster.
      Rebalance. Rebalance runs about 30 percent and hang there.
      Live cluster available for debug at

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MB-14772 3.1.0 Minor Release

          • Major - Major loss of function.
          • Resolved
          For Gerrit Dashboard: MB-14305
          # Subject Branch Project Status CR V
          49999,2 MB-14305 take into account does_not_exist status while waiting for dcp move master ns_server Status: MERGED +2 +1
          50311,2 MB-14305 link wait_for_seqno process to the appropriate replicator master ns_server Status: MERGED +2 +1
          50618,3 Revert "MB-14305 link wait_for_seqno process to the appropriate replicator" master ns_server Status: MERGED +2 +1
          51062,5 MB-14305 link wait_for_seqno process to the appropriate replicator master ns_server Status: MERGED +2 +1
          51249,2 MB-14305 take into account does_not_exist status while waiting for dcp move rel-3.0.0++ ns_server Status: MERGED +2 +1
          51781,1 Merge remote-tracking branch 'couchbase/rel-3.0.0++' master ns_server Status: MERGED +2 +1
          54283,2 [bp] MB-14305 link wait_for_seqno process to the appropriate replicator rel-3.0.0++ ns_server Status: MERGED +2 +1
          54285,1 Merge remote-tracking branch 'couchbase/rel-3.0.0++' master ns_server Status: MERGED +2 +1
          54333,1 Merge remote-tracking branch 'couchbase/master' into sherlock sherlock ns_server Status: MERGED +2 +1

          Activity

            People

              artem Artem Stemkovski
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty