Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55077

Plasma : Detected storage corruption

    XMLWordPrintable

Details

    Description

      Build: 7.5.0-3512

      Test : Rebalance test, 20 buckets, 64 vBuckets/bucket, 200 indexes, 256 byte keysize,10% RR

      Seeing indexer restarted 

      Service 'index' exited with status 2. Restarting. Messages:
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:2308 +0x10c
      github.com/couchbase/indexing/secondary/indexer.(*storageMgr).handleUpdateIndexSnapMapForIndex(0x40007683c0, {0x1a8e198?, 0x4008554000})
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:2322 +0x200
      github.com/couchbase/indexing/secondary/indexer.(*storageMgr).handleSupvervisorCommands(0x40007683c0, {0x1a8e198, 0x4008554000})
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:246 +0x1bc
      github.com/couchbase/indexing/secondary/indexer.(*storageMgr).run(0x40007683c0)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:198 +0x34
      created by github.com/couchbase/indexing/secondary/indexer.NewStorageManager
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:170 +0x5e0 

      Plasma corruption error 

       Detected storage corruption for index b7_myindex2-2, partition id 0. Starting cleanup.
       
      2023-01-12T07:57:51.848+00:00 [Fatal] Indexer::handleStorageRollbackDone Error during Rollback Unable to initialize /data/@2i/bucket-7_b7_myindex2-1_9385286946670408294_0.index/mainIndex, err = Cannot create instance on unlocked shardId 2429518199109390352
      panic: Unable to initialize /data/@2i/bucket-7_b7_myindex2-1_9385286946670408294_0.index/mainIndex, err = Cannot create instance on unlocked shardId 2429518199109390352
       
       
      goroutine 1 [running]:
      github.com/couchbase/indexing/secondary/common.CrashOnError(...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/util.go:489
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleStorageRollbackDone(0x40000d8000, {0x1a8ddf8?, 0x402fdac300?})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4096 +0x4a8
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleWorkerMsgs(0x40000d8000, {0x1a8ddf8, 0x402fdac300})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1538 +0x41c
      github.com/couchbase/indexing/secondary/indexer.(*indexer).run(0x40000d8000)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1128 +0x274
      github.com/couchbase/indexing/secondary/indexer.NewIndexer(0x27ed430?)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:554 +0x1fe0
      main.main()
              goproj/src/github.com/couchbase/indexing/secondary/cmd/indexer/main.go:206 +0xf90
      Initializing write barrier = 8000

      Run: 

      http://perf.jenkins.couchbase.com/job/Cloud-Tester-Dev/951/console

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            vikas.chaudhary Vikas Chaudhary
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty