[System Test]Panic seen : plasmaSlice::handleCommandsWorker: panic detected while processing mutation for operation 1 key

2019-09-14T09:17:09.716-07:00 [Fatal] plasmaSlice::handleCommandsWorker: panic detected while processing mutation for operation 1 key = <ud>(>>379304-SUCCESS0AC53B089852D1B168B5BC193230AF2CDE40DFB2DC03743F18354580A82EAB26A66EE0FB331D8D60)</ud> docid = <ud>(6192E1FA-73_1715428)</ud> Index default_result_ratings_claims_pindex, Bucket default, IndexInstId 53371844933047670, PartitionId 2

2019-09-14T09:17:09.737-07:00 [Fatal] goroutine 575 [running]:

github.com/couchbase/indexing/secondary/logging.(*destination).StackTraceAll(0x1b9a870, 0x7, 0x7)

	goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:175 +0x74

github.com/couchbase/indexing/secondary/logging.StackTraceAll(0x1169d83, 0xa4)

	goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:317 +0x2d

github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).handleCommandsWorker.func1(0xc544bd1d78, 0xc4277a0000)

	goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:507 +0x2ff

panic(0xf717e0, 0xc4bc59cc10)

	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:458 +0x243

github.com/couchbase/plasma.(*Plasma).fatalPanic(0xc424a66c00, 0xc495c14d80, 0x226)

	goproj/src/github.com/couchbase/plasma/plasma.go:1937 +0x310

github.com/couchbase/plasma.(*Plasma).trySMOs2(0xc424a66c00, 0x7fa66e310fe0, 0x1b3b560, 0xc4cab3c440, 0xc424b897c0, 0xc544bd1901, 0x190, 0x19, 0xc8, 0x4, ...)

	goproj/src/github.com/couchbase/plasma/plasma.go:1704 +0x4f3

github.com/couchbase/plasma.(*Plasma).trySMOs(0xc424a66c00, 0x7fa66e310fe0, 0x1b3b560, 0xc4cab3c440, 0xc424b897c0, 0xc4cab3c401, 0x0)

	goproj/src/github.com/couchbase/plasma/plasma.go:1658 +0x96

github.com/couchbase/plasma.(*Writer).Insert(0xc425193f60, 0x7fa451a96340, 0x7f, 0x3702)

	goproj/src/github.com/couchbase/plasma/plasma.go:1805 +0xf5

github.com/couchbase/plasma.(*Writer).InsertKV(0xc425193f60, 0xc426a4e000, 0x7f, 0x3702, 0x0, 0x0, 0x0, 0x1, 0xc42395a8a8)

	goproj/src/github.com/couchbase/plasma/mvcc.go:344 +0x142

github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).insertSecIndex(0xc4277a0000, 0xc4457cd030, 0x6a, 0x70, 0xc455699e40, 0x13, 0x20, 0x0, 0xc544bd1c00, 0xc4fb49cac0, ...)

	goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:712 +0x450

github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).insert(0xc4277a0000, 0xc4457cd030, 0x6a, 0x70, 0xc455699e40, 0x13, 0x20, 0x0, 0x0, 0xc4fb49cac0, ...)

	goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:651 +0x168

github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).handleCommandsWorker(0xc4277a0000, 0x0)

	goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:521 +0x2b4

created by github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).initWriters

	goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:2516 +0x3d8

goroutine 5126889 [runnable]:

github.com/couchbase/indexing/secon

panic: default/default_result_ratings_claims_pindex/Mainstore#53371844933047670:2 : fatal: Incorrect page split detected - splitKey:item key:>>379262-SUCCESSD71F213A1AAD1252E4A97CAE1C0889C9BB51B8DB3B781C6F3FC9FE5FD7D51801C84C1A3C8FB66CA55CAA5198-22_1575700 val:(nil) sn:1 insert: false pageRange:(item key:>>379262-SUCCESSD71F213A1AAD1252E4A97CAE1C0889C9BB51B8DB3B781C6F3FC9FE5FD7D51801C84C1A3C8FB66CA55CAA5198-22_1575700 val:(nil) sn:1 insert: false,item key:>>379322-SUCCESSEEB508B3817EBFC8632441D52693277A8A2164F8B800148B3B8AB55CA566397CD99BCADD601DEDCBFBECBCBF-40_1076024 val:(nil) sn:1 insert: false) [recovered]

	panic: default/default_result_ratings_claims_pindex/Mainstore#53371844933047670:2 : fatal: Incorrect page split detected - splitKey:item key:>>379262-SUCCESSD71F213A1AAD1252E4A97CAE1C0889C9BB51B8DB3B781C6F3FC9FE5FD7D51801C84C1A3C8FB66CA55CAA5198-22_1575700 val:(nil) sn:1 insert: false pageRange:(item key:>>379262-SUCCESSD71F213A1AAD1252E4A97CAE1C0889C9BB51B8DB3B781C6F3FC9FE5FD7D51801C84C1A3C8FB66CA55CAA5198-22_1575700 val:(nil) sn:1 insert: false,item key:>>379322-SUCCESSEEB508B3817EBFC8632441D52693277A8A2164F8B800148B3B8AB55CA566397CD99BCADD601DEDCBFBECBCBF-40_1076024 val:(nil) sn:1 insert: false)