Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59655

[System Test] :- panic: runtime error: invalid memory address or nil pointer dereference

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 0
    • Yes

    Description

      Script to Repro

      ./sequoia -client 172.23.104.168:2375 -provider file:centos_second_cluster.yml -test tests/integration/7.6/test_7.6.yml -scope tests/integration/7.6/scope_7.6_magma.yml -scale 1 -repeat 0 -log_level 0 -version 7.6.0-1793 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=1209600 -show_topology=true
      

      Stack trace on 172.23.120.81

      panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x11d1ed4]
       
      goroutine 27137046 [running]:
      github.com/couchbase/nitro/skiplist.(*Skiplist).GetStats(...) 
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/nitro/skiplist/stats.go:139
      github.com/couchbase/plasma.(*Plasma).GetNumPages(...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/plasma/plasma.go:1162
      github.com/couchbase/plasma.(*Plasma).getStats(_, _)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/plasma/plasma.go:1175 +0xf4
      github.com/couchbase/plasma.(*Plasma).GetPreparedStats(...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/plasma/plasma.go:1157
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).Statistics(0xc006d78c00, 0x0)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:2784 +0xbe
      github.com/couchbase/indexing/secondary/indexer.(*storageMgr).getIndexStorageStats(0xc006da01a0, 0x0)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:1831 +0xbde
      github.com/couchbase/indexing/secondary/indexer.(*storageMgr).handleStats.func1()
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:1584 +0x105
      created by github.com/couchbase/indexing/secondary/indexer.(*storageMgr).handleStats in goroutine 401
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/storage_manager.go:1578 +0xb6
      2023-11-14T23:57:47.804-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 --httpsPort=19102 --certFile=/opt/couchbase/var/lib/couchbase/config/certs/chain.pem --keyFile=/opt/couchbase/var/lib/couchbase/config/certs/pkey.pem --caFile=/opt/couchbase/var/lib/couchbase/config/certs/ca.pem --clientCertFile=/opt/couchbase/var/lib/couchbase/config/certs/client_chain.pem --clientKeyFile=/opt/couchbase/var/lib/couchbase/config/certs/client_pkey.pem -ipv4=required -ipv6=off -cluster=127.0.0.1:8091 -storageDir=/data/couchbase/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash -logDir=/opt/couchbase/var/lib/couchbase/logs -nodeUUID=0f9fdd486506cee0ddb74363c65e8904 -isEnterprise=true --deploymentModel=default]
      

      172.23.120.81: index

      2023-11-14T23:57:50.410-08:00 [Error] plasmaSlice:NewplasmaSlice Id 0x16219c0 IndexInstId 17807152962640006517 fatal error occured: Unable to initialize /data/couchbase/@2i/ITEM_#primary_17807152962640006517_0.index/mainIndex, err = fatal: Fail to find shard for shared instance /data/couchbase/@2i/ITEM_#primary_17807152962640006517_0.index/mainIndex due to instance (shared) not present on disk and no failed/corrupted shards
      2023-11-14T23:57:50.410-08:00 [Error] plasmaSlice:NewplasmaSlice Id 0 IndexInstId 17807152962640006517 PartitionId 0 isNew falsefatal error occured: Storage path not found for recovery
      2023-11-14T23:58:38.875-08:00 [Error] plasmaSlice:NewplasmaSlice Id 0x16219c0 IndexInstId 17981195885697327732 fatal error occured: Unable to initialize /data/couchbase/@2i/bucket7_idx12_bggpMs_17981195885697327732_5.index/mainIndex, err = fatal: Fail to find shard for shared instance /data/couchbase/@2i/bucket7_idx12_bggpMs_17981195885697327732_5.index/mainIndex due to instance (shared) not present on disk and no failed/corrupted shards
      2023-11-14T23:58:38.875-08:00 [Error] plasmaSlice:NewplasmaSlice Id 0 IndexInstId 17981195885697327732 PartitionId 5 isNew falsefatal error occured: Storage path not found for recovery
      

      cbcollect_info attached. Haven't seen this on the run we had on 7.6.0-1784. Our system test is notoriously unreliable for consistent repros. So, please take last good build with a pinch of salt.

      Attachments

        For Gerrit Dashboard: MB-59655
        # Subject Branch Project Status CR V

        Activity

          People

            Balakumaran.Gopal Balakumaran Gopal
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty