[PANIC] panic: runtime error: invalid memory address or nil pointer dereference

2022-03-07T22:39:35.981-08:00 [Error] Invalid Service indexAdmin for node {map[mgmt:8091 mgmtSSL:18091] 172.23.106.18 false}. Nodes [{458753 active http://172.23.104.128:8092/ 172.23.104.128:8091 map[cmd_get:0 couch_docs_actual_disk_size:3.1096186e+07 

couch_docs_data_size:6.929871e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:10000 curr_items_tot:10000 ep_bg_fetched:0 get_hits:0 index_data_size:2.310718e+06 index_disk_size:2

.6632594e+07 mem_used:7.0373704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 3011 3011 2.420359168e+09 3.947372544e+09 x86_64-pc-linux-gnu map[direct:11210 distTCP:21100 distTLS:21150 httpsCAPI:18092 httpsMgmt:18091] healthy 2365 7.1

.0-2434-enterprise true [index kv n1ql] 170b846eb13cd475f41923433ee8fd1a inet 53422560 Group 1} {458753 active http://172.23.106.18:8092/ 172.23.106.18:8091 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 co

uch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.875431e+06 index_disk_size:1.546566e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_c

urr_items:0] 3205 3205 3.365748736e+09 4.20184064e+09 x86_64-pc-linux-gnu map[direct:11210 distTCP:21100 distTLS:21150 httpsCAPI:18092 httpsMgmt:18091] healthy 948 7.1.0-2434-enterprise false [index] 1e607e19c50753df521b9f817245c42c inet 124930222 Grou

p 1} {458753 active http://172.23.123.150:8092/ 172.23.123.150:8091 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items

:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:2.270169e+06 index_disk_size:1.788873e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 3205 3205 3.329089536e+09 4.201672704e+09 x86_64-pc-linux-gnu map[direct:112

10 distTCP:21100 distTLS:21150 httpsCAPI:18092 httpsMgmt:18091] healthy 2442 7.1.0-2434-enterprise false [index] 7523efc8c6cd1974d8f06301f2d548da inet 88340141 Group 1}] 

 NodeServices [{map[capi:8092 capiSSL:18092 indexAdmin:9100 indexHttp:9102 indexHttps:19102 indexScan:9101 indexStreamCatchup:9104 indexStreamInit:9103 indexStreamMaint:9105 kv:11210 kvSSL:11207 mgmt:8091 mgmtSSL:18091 n1ql:8093 n1qlSSL:18093 projector

:9999] 172.23.104.128 true} {map[mgmt:8091 mgmtSSL:18091] 172.23.106.18 false} {map[indexAdmin:9100 indexHttp:9102 indexHttps:19102 indexScan:9101 indexStreamCatchup:9104 indexStreamInit:9103 indexStreamMaint:9105 mgmt:8091 mgmtSSL:18091] 172.23.123.15

0 false}]

2022-03-07T22:39:35.981-08:00 [Error] watcher:setAuthHost error in TranslatePort Invalid service: indexAdmin for 172.23.123.150:9100

2022-03-07T22:39:35.982-08:00 [Error] WatcherServer.runOnce() : error in authfn Invalid service: indexAdmin for connection 172.23.104.128:36187:172.23.123.150:9100

2022-03-07T22:39:35.984-08:00 [Info] memstats {"Alloc":129541408, "TotalAlloc":11844270784, "Sys":428728408, "Lookups":0, "Mallocs":52519093,"Frees":52269677, "HeapAlloc":129541408, "HeapSys":398622720, "HeapIdle":253370368, "HeapInuse":145252352,"Heap

Released":190357504, "HeapObjects":249416,"MSpanInuse":638792, "MSpanSys": 3702784, "StackInuse": 4030464,"GCSys":19446840, "LastGC":1646721432018739072,"PauseTotalNs":582657322, "PauseNs":[], "NumGC":105}

2022-03-07T22:39:36.687-08:00 [Warn] verifySchedTransfer: Nil token is observed for 3513599885188924264. Index may have got dropped.

panic: runtime error: invalid memory address or nil pointer dereference

[signal SIGSEGV: segmentation violation code=0x1 addr=0x220 pc=0xeff6d4]

goroutine 207546 [running]:

github.com/couchbase/indexing/secondary/indexer.verifySchedTransfer(0xc004f7e8d0, 0x7ffc0a26a8d5, 0xe)

        /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/ddl_service_manager.go:2238 +0x154

github.com/couchbase/indexing/secondary/indexer.transferScheduleTokens(0xc00af3fa40, 0x7ffc0a26a8d5, 0xe, 0xb, 0xc005ce00f8)

        /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/ddl_service_manager.go:2129 +0x3f7

github.com/couchbase/indexing/secondary/indexer.(*Rebalancer).finishRebalance(0xc00e036000, 0x0, 0x0)

        /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/rebalancer.go:442 +0x248

github.com/couchbase/indexing/secondary/indexer.(*Rebalancer).initRebalAsync(0xc00e036000)

        /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/rebalancer.go:336 +0xe3d

created by github.com/couchbase/indexing/secondary/indexer.NewRebalancer

        /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/rebalancer.go:166 +0x51e

Initializing write barrier = 8000

2022-03-07T22:39:37.201-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 --httpsPort=19102 --certFile=/opt/couchbase/var/lib/couchbase/config/certs/chain.pem --keyFile=/opt/couchbase/var/lib/couchbase/config/certs/pkey.pem --caFile=/opt/couchbase/var/lib/couchbase/config/certs/ca.pem -ipv4=required -ipv6=optional -vbuckets=1024 -cluster=127.0.0.1:8091 -storageDir=/opt/couchbase/var/lib/couchbase/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash -logDir=/opt/couchbase/var/lib/couchbase/logs -nodeUUID=170b846eb13cd475f41923433ee8fd1a -isEnterprise=true]