Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60688

FTS rebalance failed during rebalance out operation

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 7.6.0
    • 7.6.0
    • fts
    • Couchbase server
      Enterprise Edition 7.6.0 build 2097

      I've also seen this on build: 7.6.0 - 2090

    Description

      1. Created a 6 node cluster. ['kv', 'kv,fts', 'kv,fts', 'kv', 'fts', 'fts'].

      2. Created bucket 'standard_bucket_1' and loaded 30k items(non vector data) into the bucket.

      3. Then created bucket 'vector-bucket-0' and loaded 1M sift dataset to the bucket.

      4. Created one index on 'standard_bucket_1'.

      3. Created 2 indexes on 'vector-bucket-0' on 'vector_data' field.

      4. While the indexing was in progress, started a rebalance out operation. The node that was rebalanced out had just FTS service running.

      {'knownNodes': 'ns_1@172.23.105.167,ns_1@172.23.105.212,ns_1@172.23.106.177,ns_1@172.23.107.146,ns_1@172.23.107.164,ns_1@172.23.123.208', 'ejectedNodes': 'ns_1@172.23.105.212', 'user': 'Administrator', 'password': 'password'}

      5. Rebalance failed with the following error

      Rebalance exited with reason {service_rebalance_failed,fts, {agent_died,<35233.9538.23>, {linked_process_died,<35233.9773.23>, {'ns_1@172.23.123.208', {{badmatch, {false, {topology,[], [<<"947cf6650ecc8b2a9d173ba9caff5c81">>, <<"9bfc749f7ed0ff234bb3a8580bd2228a">>, <<"b1429731aa31f863289320b472f4613c">>, <<"b47d34b3b5de04034b8fddb53f40e4d5">>], true,[]}, {topology,[], [<<"947cf6650ecc8b2a9d173ba9caff5c81">>, <<"9bfc749f7ed0ff234bb3a8580bd2228a">>, <<"b1429731aa31f863289320b472f4613c">>, <<"b47d34b3b5de04034b8fddb53f40e4d5">>], false,[]}}}, [{service_agent,long_poll_worker_loop,5, [{file,"src/service_agent.erl"}, {line,750}]}, {proc_lib,init_p,3, [{file,"proc_lib.erl"},{line,225}]}]}}}}}. Rebalance Operation Id = 0d14fb01973fbbcc36fea10c05d39687

       

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-60720 TLS: Rebalance 2 nodes during index build: service_rebalance_failed,fts agent_died, badmatch

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mohsin.ahmed Mohsin Ahmed
              mohsin.ahmed Mohsin Ahmed
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty