Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-57396

[System Test] : panic: runtime error: invalid memory address or nil pointer dereference

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 0
    • Unknown

    Description

      Steps to Repro
      Started 7.2 Longevity on latest 7.2.1 build

      ./sequoia -client 172.23.104.27:2375 -provider file:centos_pine.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.1-5788 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
      

      We were trying to validate MB-56272 when we hit into this panic.

      172.23.105.111

      2023-06-14T09:23:15.663-07:00 [WARN] janitor: partiallyRollbackPIndex, OpenPIndex error, cleaning up the path, err: pindex: could not open indexType: fulltext-index, path: /data/couchbase/@fts/good_state_5208109c66f294fd_6ddbfb54.pindex, err: timeout -- cbgt.(*Manager).partiallyRollbackPIndex() at manager_janitor.go:121
      panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0xb0 pc=0xacaefa]
       
      goroutine 119 [running]:
      github.com/couchbase/cbgt.(*Manager).partiallyRollbackPIndex(0xc1730eaf40?, 0xc1591b4000)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/cbgt/manager_janitor.go:123 +0x17a
      github.com/couchbase/cbgt.(*Manager).rollbackPIndex(0x11180b2?, 0xc1591b4000)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/cbgt/manager_janitor.go:71 +0x10e
      github.com/couchbase/cbgt.(*Manager).JanitorLoop(0xc000422c00)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/cbgt/manager_janitor.go:186 +0x437
      created by github.com/couchbase/cbgt.(*Manager).Start
              /home/couchbase/jenkins/workspace/couchbase-server-unix/cbgt/manager.go:297 +0x20a
      

      There are bunch of other ERRO messages too. Not sure if its related to the same bug or not.

      172.23.105.107 : fts

      2023-06-14T08:47:57.846-07:00 [ERRO] janitor: startPIndex, OpenPIndex error, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/good_state_5208109c66f294fd_18572d87.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/couchbase/@fts/good_state_5208109c66f294fd_18572d87.pindex, err: open /data/couchbase/@fts/good_state_5208109c66f294fd_18572d87.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1076
      

      172.23.105.111 : fts

      2023-06-14T08:38:46.666-07:00 [ERRO] janitor: startPIndex, OpenPIndex error, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/good_state_5208109c66f294fd_13aa53f3.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/couchbase/@fts/good_state_5208109c66f294fd_13aa53f3.pindex, err: open /data/couchbase/@fts/good_state_5208109c66f294fd_13aa53f3.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1076
      2023-06-14T09:19:43.633-07:00 [ERRO] janitor: startPIndex, OpenPIndex error, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_18572d87.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_18572d87.pindex, err: open /data/couchbase/@fts/social_f1f2610b6d5b5013_18572d87.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1076
      2023-06-14T09:23:17.144-07:00 [ERRO] janitor: startPIndex, pindex does not match plan, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/good_state_5208109c66f294fd_6ddbfb54.pindex, err: <nil> -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1082
      

      172.23.105.168 : fts

      2023-06-14T09:17:08.264-07:00 [ERRO] janitor: startPIndex, OpenPIndex error, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_13aa53f3.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_13aa53f3.pindex, err: open /data/couchbase/@fts/social_f1f2610b6d5b5013_13aa53f3.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1076
      2023-06-14T09:23:40.351-07:00 [ERRO] janitor: startPIndex, OpenPIndex error, cleaning up and trying NewPIndex, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_6ddbfb54.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/couchbase/@fts/social_f1f2610b6d5b5013_6ddbfb54.pindex, err: open /data/couchbase/@fts/social_f1f2610b6d5b5013_6ddbfb54.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).startPIndex() at manager_janitor.go:1076
      

      cbcollect_info attached.

      Attachments

        For Gerrit Dashboard: MB-57396
        # Subject Branch Project Status CR V

        Activity

          People

            Balakumaran.Gopal Balakumaran Gopal
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty