Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59622

[System Test] [File based rebalance] :- panic: Cannot find an available shard, all candidate shards (num: 1) are under transfer or restore, retry later panic: Unable to initialize

    XMLWordPrintable

Details

    • Untriaged
    • Linux x86_64
    • 0
    • No

    Description

      Script to Repro

      ./sequoia -client 172.23.104.27:2375 -provider file:debian_pine.yml -test tests/integration/7.6/test_7.6.yml -scope tests/integration/7.6/scope_7.6_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.6.0-1784 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=1209600 -show_topology=true
      

      Full stack trace from logs

      172.23.96.251

      2023-11-13T18:35:27.902-08:00 [Fatal] Indexer::handleStorageRollbackDone Error during Rollback Unable to initialize /data/couchbase/@2i/bucket7_idx6_dPvzTRW7_7304990907571119949_3.index/mainIndex, err = Cannot find an available shard, all candidate shards (num: 1) are under transfer or restore, retry later
      panic: Unable to initialize /data/couchbase/@2i/bucket7_idx6_dPvzTRW7_7304990907571119949_3.index/mainIndex, err = Cannot find an available shard, all candidate shards (num: 1) are under transfer or restore, retry later
          
      goroutine 1 [running]:
      github.com/couchbase/indexing/secondary/common.CrashOnError(...)     
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/util.go:509
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleStorageRollbackDone(0xc000481400, {0x1f587e0?, 0xc0527bfbc0?})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4469 +0x5b9
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleWorkerMsgs(0xc000481400, {0x1f587e0, 0xc0527bfbc0})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1593 +0xda5
      github.com/couchbase/indexing/secondary/indexer.(*indexer).run(0xc000481400)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1176 +0x348
      github.com/couchbase/indexing/secondary/indexer.NewIndexer(0x2e51e90?)  
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:599 +0x2b8a
      main.main()     
              goproj/src/github.com/couchbase/indexing/secondary/cmd/indexer/main.go:207 +0x1232
      

      cbcollect_info attached.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Balakumaran.Gopal Balakumaran Gopal
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty