Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37227

Indexer panics in CI test TestIndexNodeRebalanceOut

    XMLWordPrintable

Details

    • Untriaged
    • Unknown

    Description

      Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html

      2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
      panic: runtime error: index out of range
       
      goroutine 125393 [running]:
      panic(0xf8a3e0, 0xc420018150)
              /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
      github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
              goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
      github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
              goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
      created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
              goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
      

      This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          varun.velamuri Varun Velamuri created issue -
          varun.velamuri Varun Velamuri made changes -
          Field Original Value New Value
          Description Indexer crashes with the following stack trace:
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html:
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          varun.velamuri Varun Velamuri made changes -
          Description Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html:
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run [http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html|http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html:]
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          varun.velamuri Varun Velamuri made changes -
          Description Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run [http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html|http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html:]
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          Indexer crashes with the following stack trace at the TestIndexNodeRebalanceOut test during the run http://ci2i-unstable.northscale.in/gsi-10.12.2019-20.06.fail.html
          {code:java}2019-12-10T22:48:42.710+05:30 [Info] clustMgrAgent::OnIndexDelete Success for Drop IndexId 14723988844231693918
          panic: runtime error: index out of range

          goroutine 125393 [running]:
          panic(0xf8a3e0, 0xc420018150)
                  /home/buildbot/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
          github.com/couchbase/indexing/secondary/indexer.(*StreamState).updateRepairState(0xc4202ba000, 0xc4237e0001, 0xc424e75618, 0x7, 0xc4238a8000, 0x1af, 0x200, 0x0, 0x0, 0x0)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_state.go:541 +0x3a5
          github.com/couchbase/indexing/secondary/indexer.(*timekeeper).sendRestartMsg(0xc420136080, 0x1a9cde0, 0xc427d5a150)
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3103 +0x22ca
          created by github.com/couchbase/indexing/secondary/indexer.(*timekeeper).repairStream
                  goproj/src/github.com/couchbase/indexing/secondary/indexer/timekeeper.go:3016 +0xf27
          {code}
          This issue seems to have been fixed under MB-36341 but the panic is still been seen with 6.5.0-4928 build. 

           
          varun.velamuri Varun Velamuri made changes -
          Attachment logs-functional-ns_server.tar.gz [ 79037 ]
          varun.velamuri Varun Velamuri made changes -
          Attachment logs-functional-ns_server.tar.gz [ 79037 ]
          varun.velamuri Varun Velamuri made changes -
          Attachment gsi-10.12.2019-20.06.fail.html [ 79041 ]
          varun.velamuri Varun Velamuri made changes -
          Attachment logs-functional-ns_server.tar.gz [ 79042 ]
          jeelan.poola Jeelan Poola made changes -
          Fix Version/s 6.5.1 [ 16622 ]
          jeelan.poola Jeelan Poola made changes -
          Labels 6.5.1-candidate
          jeelan.poola Jeelan Poola made changes -
          Fix Version/s Mad-Hatter [ 15037 ]
          Fix Version/s Cheshire-Cat [ 15915 ]
          Fix Version/s 6.5.1 [ 16622 ]
          jeelan.poola Jeelan Poola made changes -
          Labels 6.5.1-candidate
          raju Raju Suravarjjala made changes -
          Priority Major [ 3 ] Critical [ 2 ]
          dfinlay Dave Finlay made changes -
          Labels approved-for-mad-hatter
          varun.velamuri Varun Velamuri made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          mihir.kamdar Mihir Kamdar made changes -
          Labels approved-for-mad-hatter approved-for-mad-hatter request-dev-verify
          varun.velamuri Varun Velamuri made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

          People

            varun.velamuri Varun Velamuri
            varun.velamuri Varun Velamuri
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty