Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59783

Rebalance-in of an index-query node fails with the reason '{service_rebalance_failed,index, {worker_died, {\'EXIT\',<0.4209.8>, {task_failed,rebalance, {service_error, <<"Index bucket-0.bucket-0__default__default_index already exists"'

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 7.6.0
    • 7.6.0
    • secondary-index
    • Initial Couchbase Server version - 7.2.0-5325
      Upgrade version - 7.6.0-1813

    Description

      Steps:

      1. Initialise a 4 node cluster running version 7.2.0-5325
            Node 1 - kv, Node 2 - kv, Node 3 - index-n1ql, Node 4 - index-n1ql
      2. Create a magma bucket with 20 collections in it and load 1 million docs into it.
      3. Create a primary index for all collections, also create primary partitioned indexes for all collections with num_partitions=8.
      4. Create secondary indexes for all collections on a document field 'name'.
      5. Create partitioned indexes for one collection in each scope with each index having 8 partitions.
      6. Start upgrade of the cluster to 7.6.0-1813.
      7. Swap rebalance each node with a spare node iteratively to upgrade every node. Run queries concurrently and perform updates on the data while rebalance is going on.
      8. Post upgrade, enable CDC on the magma bucket and create new collections.
      9. After the upgrade of the whole cluster to 7.6.0, set 'redistributeIndexes' and 'enableShardAffinity' to true.
      10. Rebalance-in a node (172.23.216.47) configured with services index and n1ql. Rebalance fails with the error,

      'Rebalance exited with reason {service_rebalance_failed,index,\n                              {worker_died,\n                               {\'EXIT\',<0.4209.8>,\n                                {task_failed,rebalance,\n                                 {service_error,\n                                  <<"Index bucket-0.bucket-0__default__default_index already exists">>}}}}}.\nRebalance Operation Id = 7271e78c3f11a23da1d6ea1530f6c590'

      # Cb-collect logs have been attached.

      1. Also, these are the names of all the indexes that were created in the cluster before the upgrade, no indexes were created after that,

      [{"name":"bucket-0__default__default_index"}, {"name":"primary_part_index_1"}, {"name":"default1"}, {"name":"bucket-0_scope-0_collection-7_index"}, {"name":"default18"}, {"name":"bucket-0_scope-0_collection-6_index"}, {"name":"default17"}, {"name":"bucket-0_scope-0_collection-5_index"}, {"name":"default16"}, {"name":"bucket-0_scope-0_collection-4_index"}, {"name":"bucket-0_scope-0_collection-4_part_index"}, {"name":"default15"}, {"name":"bucket-0_scope-0_collection-8_index"}, {"name":"default19"}, {"name":"bucket-0__default_collection-2_index"}, {"name":"primary_part_index_4"}, {"name":"default4"}, {"name":"bucket-0__default_collection-1_index"}, {"name":"primary_part_index_3"}, {"name":"default3"}, {"name":"bucket-0__default_collection-0_index"}, {"name":"primary_part_index_2"}, {"name":"default2"}, {"name":"bucket-0__default_collection-3_index"}, {"name":"bucket-0__default_collection-3_part_index"}, {"name":"default0"}, {"name":"primary_part_index_0"}, {"name":"bucket-0_scope-1_collection-13_index"}, {"name":"default9"}, {"name":"bucket-0_scope-1_collection-12_index"}, {"name":"default8"}, {"name":"bucket-0_scope-1_collection-9_index"}, {"name":"default7"}, {"name":"bucket-0_scope-1_collection-11_index"}, {"name":"default6"}, {"name":"bucket-0_scope-1_collection-10_part_index"}, {"name":"bucket-0_scope-1_collection-10_index"}, {"name":"default5"}, {"name":"bucket-0_scope-2_collection-18_index"}, {"name":"default12"}, {"name":"bucket-0_scope-2_collection-17_index"}, {"name":"default11"}, {"name":"bucket-0_scope-2_collection-16_index"}, {"name":"bucket-0_scope-2_collection-16_part_index"}, {"name":"default10"}, {"name":"bucket-0_scope-2_collection-15_index"}, {"name":"default14"}, {"name":"bucket-0_scope-2_collection-14_index"}, {"name":"default13"}] 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            varun.velamuri Varun Velamuri
            vibhav.sp Vibhav S P
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty