Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43234

[System Test] : Indexer crashed several times on 1 node with error - panic: KV Rollback Received For Initial Build Request

    XMLWordPrintable

Details

    Description

      Build : 7.0.0-3977
      Test : -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale : 3
      Iteration : 1st

      The stack trace here is similar to MB-41786 and MB-42890. But in this case, there was no OOM kill for memcached. In the other 2 defects, it was a memcached OOM kill that triggered a rollback for indexer.

      On 172.23.96.254, seeing indexer crash 5 times with the following error and stack trace :

      2020-12-10T21:09:16.040-08:00 [Error] Indexer::sendStreamUpdateForBuildIndex Unexpected Rollback from Projector during Initial Stream Request &{3 bucket9 0xc044704320 0 0}
      panic: KV Rollback Received For Initial Build Request
       
      goroutine 157078696 [running]:
      github.com/couchbase/indexing/secondary/common.CrashOnError(...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/util.go:413
      github.com/couchbase/indexing/secondary/indexer.(*indexer).sendStreamUpdateForBuildIndex.func1(0xc000077180, 0x3, 0xc131e832d6, 0x7, 0xc1d9d38880, 0x8, 0x8, 0x6, 0x143ec40, 0xc07bb18cf0, ...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4187 +0xf1e
      created by github.com/couchbase/indexing/secondary/indexer.(*indexer).sendStreamUpdateForBuildIndex
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4135 +0xf63
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            varun.velamuri Varun Velamuri
            mihir.kamdar Mihir Kamdar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty