[System Test] Panic observed on indexer during data load with Magma run

022-05-24T16:09:30.953-07:00 [Info] memstats

2022-05-24T16:09:31.065-07:00 [Info] DDLServiceMgr: processing delete index token /indexing/ddl/commandToken/delete/4420478844173295151
2022-05-24T16:09:31.304-07:00 [Info] DDLServiceMgr: processing delete index token /indexing/ddl/commandToken/delete/4424396985350439303
2022-05-24T16:09:31.656-07:00 [Info] DDLServiceMgr: processing delete index token /indexing/ddl/commandToken/delete/4469690193819455730
2022-05-24T16:09:31.940-07:00 [Info] DDLServiceMgr: processing delete index token /indexing/ddl/commandToken/delete/448200362792379594
2022-05-24T16:09:32.306-07:00 [Info] DDLServiceMgr: processing delete index token /indexing/ddl/commandToken/delete/4500832613763243657
2022-05-24T16:09:32.343-07:00 [Info] [Queryport ":9101"] connection "172.23.108.146:57784" doAuth() ...
2022-05-24T16:09:32.353-07:00 [Info] [Queryport ":9101"] connection "172.23.108.146:57784" doReceive() ...
2022-05-24T16:09:32.353-07:00 [Error] receiving packet: read tcp4 172.23.107.236:9101->172.23.108.146:57784: use of closed network connection
2022-05-24T16:09:32.353-07:00 [Error] [Queryport ":9101"] connection "172.23.108.146:57784" exited read tcp4 172.23.107.236:9101->172.23.108.146:57784: use of closed network connection
2022-05-24T16:09:32.361-07:00 [Info] [Queryport ":9101"] connection 172.23.108.146:57784 closed
panic: runtime error: index out of range [4] with length 4

goroutine 355661575 [running]:
github.com/couchbase/indexing/secondary/indexer.(*ScanRequest).setExplodePositions(0xc00273cb00)
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_request.go:1124 +0x335
github.com/couchbase/indexing/secondary/indexer.NewScanRequest(0x13403c0, 0xc10033e0c0, 0x1247600, 0xc1015eee70, 0xc0f8081680, 0xc0040f88c0, 0x41493b, 0xc1015eecf0, 0x15b0dc0)
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_request.go:422 +0x11ac
github.com/couchbase/indexing/secondary/indexer.(*scanCoordinator).serverCallback(0xc0040f88c0, 0x13403c0, 0xc10033e0c0, 0x1247600, 0xc1015eee70, 0x15cc9a8, 0xc0121bfff8, 0xc0f8081680)
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_coordinator.go:259 +0x125
github.com/couchbase/indexing/secondary/queryport.(*Server).handleConnection(0xc000194f00, 0x15cc9a8, 0xc0121bfff8)
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/queryport/server.go:385 +0x3c6
created by github.com/couchbase/indexing/secondary/queryport.(*Server).listener
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/queryport/server.go:227 +0x394
Initializing write barrier = 8000
2022-05-24T16:09:37.671-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 --httpsPort=19102 --certFile=/opt/couchbase/var/lib/couchbase/config/certs/chain.pem --keyFile=/opt/couchbase/var/lib/couchbase/config/certs/pkey.pem --caFile=/opt/couchbase/var/lib/couchbase/config/certs/ca.pem -ipv4=required -ipv6=off -vbuckets=1024 -cluster=127.0.0.1:8091 -storageDir=/data/couchbase/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash -logDir=/opt/couchbase/var/lib/couchbase/logs -nodeUUID=0974c813baaf21025599de927abff35c -isEnterprise=true]
2022-05-24T16:09:37.671-07:00 [Info] Setting ipv6=false
2022-05-24T16:09:37.687-07:00 [Info] Indexer::NewIndexer Status Warmup
2022-05-24T16:09:37.706-07:00 [Info] Setting buffer block size to 16384 bytes
2022-05-24T16:09:37.706-07:00 [Info] settingsManager::setGlobalSettings: Indexer # CPU cores: 8, memory quota: 20065550336 bytes (19595264.000 KB, 19136.000 MB, 18.688 GB)
2022-05-24T16:09:37.706-07:00 [Info] Setting log level to Info
2022-05-24T16:09:37.706-07:00 [Warn] SetCICLMgrTimeDiffToForceFetch: Singleton Manager in ClusterInfoCacheLite is not set

url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.105.38.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.107.236.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.107.25.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.136.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.138.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.139.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.141.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.142.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.143.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.144.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.145.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.146.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1653465828/collectinfo-2022-05-25T080349-ns_1%40172.23.108.148.zip

[2022-05-24T06:53:47-07:00, sequoiatools/pillowfight:7.0:ad20de] -U couchbase://172.23.108.139/default?select_bucket=true -I 3000 -B 300 -t 4 -c 100 -P password