Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50117

(Mixed Versions) Rebalance fails when adding Neo node to MH node

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Critical
    • 7.1.0
    • 7.1.0
    • analytics
    • Untriaged
    • 1
    • Unknown
    • CX Sprint 276

    Description

      I have a single node mad-hatter cluster and add a Neo node. When I try to rebalance in the Neo node the rebalance fails.

      Analytics Service unable to successfully rebalance 08871bef77e84876e98c8ae03da26b47 due to 'java.lang.IllegalStateException: timed out waiting for all nodes to join & cluster active (missing nodes: [691378ff4a1ef73e2b74c799d7364d26], state: ACTIVE)'; see analytics_info.log for details

      and from the debug.log

      [user:warn,2021-12-15T15:02:31.535-08:00,n_0@127.0.0.1:<0.4948.0>:analytics:unknown:-1]Analytics Service unable to successfully rebalance 08871bef77e84876e98c8ae03da26b47 due to 'java.lang.IllegalStateException: timed out waiting for all nodes to join & cluster active (missing nodes: [691378ff4a1ef73e2b74c799d7364d26], state: ACTIVE)'; see analytics_info.log for details

      and from the analytics_info.log

      2021-12-15T15:02:31.537-08:00 ERRO CBAS.rebalance.Rebalance [Executor-4:ClusterController] Rebalance 08871bef77e84876e98c8ae03da26b47 failed
      		 
      java.lang.IllegalStateException: timed out waiting for all nodes to join & cluster active (missing nodes: [691378ff4a1ef73e2b74c799d7364d26], state: ACTIVE)
      		 
          at com.couchbase.analytics.control.rebalance.Rebalance.ensureNodesClusterActive(Rebalance.java:485) ~[cbas-server.jar:6.6.4-0000]
      		 
          at com.couchbase.analytics.control.rebalance.Rebalance.adjustClusterBeforeRebalance(Rebalance.java:614) ~[cbas-server.jar:6.6.4-0000]
      		 
          at com.couchbase.analytics.control.rebalance.Rebalance.doRebalance(Rebalance.java:191) ~[cbas-server.jar:6.6.4-0000]
      		 
          at com.couchbase.analytics.control.rebalance.Rebalance.doCall(Rebalance.java:153) [cbas-server.jar:6.6.4-0000]
      		 
          at com.couchbase.analytics.control.rebalance.Rebalance.doCall(Rebalance.java:80) [cbas-server.jar:6.6.4-0000]
      		 
          at com.couchbase.analytics.runtime.WriteLockCallable.call(WriteLockCallable.java:27) [cbas-connector.jar:6.6.4-0000]
      		 
          at java.util.concurrent.FutureTask.run(Unknown Source) [?:?]
      		 
          at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?]
      		 
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?]
      		 
          at java.lang.Thread.run(Unknown Source) [?:?]
      		 
      2021-12-15T15:02:31.545-08:00 WARN CBAS.rebalance.Rebalance [Executor-4:ClusterController] exit Rebalance 08871bef77e84876e98c8ae03da26b47

      Attachments

        Issue Links

          is caused by

          Bug - A problem which impairs or prevents the functions of the product. MB-50154 macOS Monterey is not compatible with netty-tcnative

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MB-50155 Support incremental build w/ back-compat version changes

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              steve.watanabe Steve Watanabe
              steve.watanabe Steve Watanabe
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty