Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-54500

Indexer rebalance is hung from many hours.

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Elixir
    • Elixir
    • secondary-index
    • 7.5.0-3170

    Description

      Just ensuring that we are hitting the same issue(MB-54328) which is already fixed or something new.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Looking at couchbase.log, we are generating a replica repair token as the transfer mode is "1" (which means replica repair). This feature is supported only from 3184 build. The test is running 3170 build. Please re-run with latest build

          {"rebalancetoken":\{"MasterId":"aad010922dbdc0bdee1644b70f8324b8","RebalId":"2c4077532dd80468f616c5738ff33f21","Source":0,"Error":"","MasterIP":"2hrzyadz1oejwpqf.iv6bggk1cdvoocl.nonprod-project-avengers.com"},"transfertokens":\{"TransferToken89:9e:c5:c1:f2:80:4b:b9":{"MasterId":"aad010922dbdc0bdee1644b70f8324b8","SourceId":"","DestId":"b9110aa805cc11f9730fa47c71d21d53","RebalId":"2c4077532dd80468f616c5738ff33f21","State":0,"InstId":0,"RealInstId":0,"IndexInst":{"InstId":0,"Defn":{"NumReplica2":{"HasValue":false,"Base":0,"Incr":0,"Decr":0}},"State":0,"RState":0,"Stream":0,"Pc":null,"Error":"","BuildTs":null,"Version":0,"ReplicaId":0,"Scheduled":false,"StorageMode":"","OldStorageMode":"","RealInstId":0},"Error":"","BuildSource":0,"TransferMode":1,"SourceHost":"","DestHost":"svkpj3ev4zd0whi8.iv6bggk1cdvoocl.nonprod-project-avengers.com:18091","Version":1,"ShardTransferTokenState":10000,"InstIds":[12424185616307106676],"RealInstIds":[0],"IndexInsts":[\{"InstId":12424185616307106676,"Defn":{"defnId":8319990801489299124,"name":"#primary","using":"plasma","bucket":"jenkins-better-grandfather-gl8jsm","isPrimary":true,"exprType":"N1QL","partitionScheme":"SINGLE","numReplica":1,"NumReplica2":{"HasValue":true,"Base":1,"Incr":0,"Decr":0},"Scope":"_system","Collection":"_query","residentRatio":100,"instanceVersion":1,"replicaId":1,"instanceId":12424185616307106676,"partitions":[0,0],"versions":[0,1],"numPartitions":1,"instStateAtRebal":1},"State":1,"RState":0,"Stream":0,"Pc":null,"Error":"","BuildTs":null,"Version":0,"ReplicaId":1,"Scheduled":false,"StorageMode":"","OldStorageMode":"","RealInstId":0}],"ShardIds":null,"Destination":"
          [s3://cbc-storage-11dd40/indexing]
          ","SourceTokenId":"","SiblingTokenId":"","ShardPaths":null}}}
          

          varun.velamuri Varun Velamuri added a comment - Looking at couchbase.log, we are generating a replica repair token as the transfer mode is "1" (which means replica repair). This feature is supported only from 3184 build. The test is running 3170 build. Please re-run with latest build {"rebalancetoken":\{"MasterId":"aad010922dbdc0bdee1644b70f8324b8","RebalId":"2c4077532dd80468f616c5738ff33f21","Source":0,"Error":"","MasterIP":"2hrzyadz1oejwpqf.iv6bggk1cdvoocl.nonprod-project-avengers.com"},"transfertokens":\{"TransferToken89:9e:c5:c1:f2:80:4b:b9":{"MasterId":"aad010922dbdc0bdee1644b70f8324b8","SourceId":"","DestId":"b9110aa805cc11f9730fa47c71d21d53","RebalId":"2c4077532dd80468f616c5738ff33f21","State":0,"InstId":0,"RealInstId":0,"IndexInst":{"InstId":0,"Defn":{"NumReplica2":{"HasValue":false,"Base":0,"Incr":0,"Decr":0}},"State":0,"RState":0,"Stream":0,"Pc":null,"Error":"","BuildTs":null,"Version":0,"ReplicaId":0,"Scheduled":false,"StorageMode":"","OldStorageMode":"","RealInstId":0},"Error":"","BuildSource":0,"TransferMode":1,"SourceHost":"","DestHost":"svkpj3ev4zd0whi8.iv6bggk1cdvoocl.nonprod-project-avengers.com:18091","Version":1,"ShardTransferTokenState":10000,"InstIds":[12424185616307106676],"RealInstIds":[0],"IndexInsts":[\{"InstId":12424185616307106676,"Defn":{"defnId":8319990801489299124,"name":"#primary","using":"plasma","bucket":"jenkins-better-grandfather-gl8jsm","isPrimary":true,"exprType":"N1QL","partitionScheme":"SINGLE","numReplica":1,"NumReplica2":{"HasValue":true,"Base":1,"Incr":0,"Decr":0},"Scope":"_system","Collection":"_query","residentRatio":100,"instanceVersion":1,"replicaId":1,"instanceId":12424185616307106676,"partitions":[0,0],"versions":[0,1],"numPartitions":1,"instStateAtRebal":1},"State":1,"RState":0,"Stream":0,"Pc":null,"Error":"","BuildTs":null,"Version":0,"ReplicaId":1,"Scheduled":false,"StorageMode":"","OldStorageMode":"","RealInstId":0}],"ShardIds":null,"Destination":" [s3://cbc-storage-11dd40/indexing] ","SourceTokenId":"","SiblingTokenId":"","ShardPaths":null}}}

          Fixed in 3184 as a part of MB-53754. Re-run with latest build

          varun.velamuri Varun Velamuri added a comment - Fixed in 3184 as a part of MB-53754. Re-run with latest build

          People

            amit.kulkarni Amit Kulkarni
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty