Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-40999

Panic in scan pipeline collatejson decode

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      In QE test for reproduction of issue in MOI CBSE-8684, observed panic 2 index nodes:

       

      2020-08-12T20:40:36.228-07:00 [Fatal] IndexScanSource - panic detected while processing defnId:14409788690666248389, instId:6608737921057813942, index:default/snapshot_state_gtins_endDateTime_country_advertiseDateTime_class_PR_CL, type:scan, partitions:[1], scans: <ud>([{["clearancesnapshot"] ["clearancesnapshot"] 3 range [{[{"clearancesnapshot" "clearancesnapshot" 3}] ["clearancesnapshot"] ["clearancesnapshot"] 3 }] <nil>} {["promotionsnapshot"] ["promotionsnapshot"] 3 range [{[{"promotionsnapshot" "promotionsnapshot" 3}] ["promotionsnapshot"] ["promotionsnapshot"] 3 }] <nil>}])</ud>, limit:9223372036854775807, consistency:any_consistency, requestId:3eba4294-4ddc-4c5a-91fa-c847c65d6137
      2020-08-12T20:40:36.229-07:00 [Fatal] 	goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:304 +0x22
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine.func1(0xc425e024d0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:133 +0xbc
      panic(0xe49a00, 0xc4200160c0)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:458 +0x243
      github.com/couchbase/indexing/secondary/collatejson.(*Codec).ExplodeArray3(0xc420136780, 0xc42445c000, 0x6c, 0x3800, 0xc424166000, 0x0, 0x3800, 0xc426668870, 0x6, 0x6, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/collatejson/array.go:115 +0x51b
      github.com/couchbase/indexing/secondary/indexer.projectKeys(0x0, 0x0, 0x0, 0xc42445c000, 0x6c, 0x3800, 0xc424166000, 0x0, 0x3800, 0xc42444e000, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:693 +0x59e
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine.func3(0x7f8440333d0c, 0x6c, 0x3800, 0x6c, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:283 +0x6e4
      github.com/couchbase/indexing/secondary/indexer.scanSingleSlice.func2(0x7f8440333d0c, 0x6c, 0x6c, 0xc424630180, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:196 +0x16e
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).iterEqualKeys(0xc428f38bc0, 0x1844620, 0xc4201ba920, 0xc428c69290, 0x10777d0, 0xc428c69230, 0x416f0e, 0xc428c69230)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1655 +0x1ae
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).Iterate(0xc428f38bc0, 0x1840580, 0xc4257c30e8, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0x10777d0, 0xc428c69230, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1621 +0x3d9
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).Range(0xc428f38bc0, 0x1840580, 0xc4257c30e8, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xc428c69230, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1571 +0xb2
      github.com/couchbase/indexing/secondary/indexer.scanSingleSlice(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:206 +0x41b
      github.com/couchbase/indexing/secondary/indexer.scanOne(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:148 +0x11e
      github.com/couchbase/indexing/secondary/indexer.scatter(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:55 +0xc6
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine(0xc425e024d0, 0x0, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:337 +0x810
      github.com/couchbase/indexing/secondary/pipeline.(*Pipeline).runIt.func1(0xc4201ba9a0, 0xc4201b8d20)
      	goproj/src/github.com/couchbase/indexing/secondary/pipeline/pipeline.go:75 +0x45
      created by github.com/couchbase/indexing/secondary/pipeline.(*Pipeline).runIt
      	goproj/src/github.com/couchbase/indexing/secondary/pipeline/pipeline.go:80 +0x66panic: runtime error: index out of range [recovered]
      	panic: runtime error: index out of rangegoroutine 4231053 [running]:
      panic(0xe49a00, 0xc4200160c0)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine.func1(0xc425e024d0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:134 +0x165
      panic(0xe49a00, 0xc4200160c0)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:458 +0x243
      github.com/couchbase/indexing/secondary/collatejson.(*Codec).ExplodeArray3(0xc420136780, 0xc42445c000, 0x6c, 0x3800, 0xc424166000, 0x0, 0x3800, 0xc426668870, 0x6, 0x6, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/collatejson/array.go:115 +0x51b
      github.com/couchbase/indexing/secondary/indexer.projectKeys(0x0, 0x0, 0x0, 0xc42445c000, 0x6c, 0x3800, 0xc424166000, 0x0, 0x3800, 0xc42444e000, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:693 +0x59e
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine.func3(0x7f8440333d0c, 0x6c, 0x3800, 0x6c, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:283 +0x6e4
      github.com/couchbase/indexing/secondary/indexer.scanSingleSlice.func2(0x7f8440333d0c, 0x6c, 0x6c, 0xc424630180, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:196 +0x16e
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).iterEqualKeys(0xc428f38bc0, 0x1844620, 0xc4201ba920, 0xc428c69290, 0x10777d0, 0xc428c69230, 0x416f0e, 0xc428c69230)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1655 +0x1ae
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).Iterate(0xc428f38bc0, 0x1840580, 0xc4257c30e8, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0x10777d0, 0xc428c69230, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1621 +0x3d9
      github.com/couchbase/indexing/secondary/indexer.(*memdbSnapshot).Range(0xc428f38bc0, 0x1840580, 0xc4257c30e8, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xc428c69230, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/memdb_slice_impl.go:1571 +0xb2
      github.com/couchbase/indexing/secondary/indexer.scanSingleSlice(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:206 +0x41b
      github.com/couchbase/indexing/secondary/indexer.scanOne(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:148 +0x11e
      github.com/couchbase/indexing/secondary/indexer.scatter(0xc42444e000, 0x1844620, 0xc4201ba8e0, 0x1844620, 0xc4201ba920, 0x3, 0xf97237, 0x5, 0xc426f9d680, 0x1, ...)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_scatter.go:55 +0xc6
      github.com/couchbase/indexing/secondary/indexer.(*IndexScanSource).Routine(0xc425e024d0, 0x0, 0x0)
      	goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_pipeline.go:337 +0x810
      github.com/couchbase/indexing/secondary/pipeline.(*Pipeline).runIt.func1(0xc4201ba9a0, 0xc4201b8d20)
      	goproj/src/github.com/couchbase/indexing/secondary/pipeline/pipeline.go:75 +0x45
      created by github.com/couchbase/indexing/secondary/pipeline.(*Pipeline).runIt
      	goproj/src/github.com/couchbase/indexing/secondary/pipeline/pipeline.go:80 +0x66
      [goport(/opt/couchbase/bin/indexer)] 2020/08/12 20:40:36 child process exited with status 2
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              deepkaran.salooja Deepkaran Salooja
              akhil.mundroy Akhil Mundroy
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty