Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-52998

[Backport MB-52925 to 7.1.2] - panic : concurrent map read and map write

    XMLWordPrintable

Details

    Description

      Panic in 7.1.2-3358 was not observed with 7.1.2-3345

      fatal error: concurrent map read and map writegoroutine 9111981 [running]:
      runtime.throw({0x1245d0f?, 0xc26472be68?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/runtime/panic.go:992 +0x71 fp=0xc26472be30 sp=0xc26472be00 pc=0x43cb11
      runtime.mapaccess1_faststr(0x1077400?, 0xc00053a000?, {0xc22e9d1f00, 0x1f})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/runtime/map_faststr.go:22 +0x3a5 fp=0xc26472be98 sp=0xc26472be30 pc=0x419965
      github.com/couchbase/indexing/secondary/indexer.(*indexer).computeKeyspaceBuildTsAsync(0xc000228000, {0x7fff377518f5, 0xe}, {0xc22e9d1f00, 0x1f}, {0xc1c957e926, 0x3}, 0x62?, 0x3)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:9219 +0xc5 fp=0xc26472bf88 sp=0xc26472be98 pc=0xe42b25
      github.com/couchbase/indexing/secondary/indexer.(*indexer).sendStreamUpdateForBuildIndex.func1.2()
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4769 +0x47 fp=0xc26472bfe0 sp=0xc26472bf88 pc=0xe22807
      runtime.goexit()
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc26472bfe8 sp=0xc26472bfe0 pc=0x46f141
      created by github.com/couchbase/indexing/secondary/indexer.(*indexer).sendStreamUpdateForBuildIndex.func1
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4769 +0xac5goroutine 1 [chan receive]:
      github.com/couchbase/indexing/secondary/indexer.(*indexer).sendMsgToClustMgr(0xc000228000, {0x1422780?, 0xcb96afc930?})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:4885 +0xea
      github.com/couchbase/indexing/secondary/indexer.(*indexer).sendMsgToClustMgrAndProcessResponse(0x10a49c0?, {0x1422780?, 0xcb96afc930?})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:8501 +0x3b
      github.com/couchbase/indexing/secondary/indexer.(*indexer).updateMetaInfoForIndexList(0xc000228000, {0xc70c079e00, 0xa, 0xc000228000?}, 0x1, 0x1, 0x0, 0x1, 0x1, 0x0, ...)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:8474 +0x2dc
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleBuildIndex(0xc000228000, {0x1422620?, 0xc87d846080})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:3109 +0x1770
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleAdminMsgs(0xc602b8d658?, {0x1422620, 0xc87d846080})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1695 +0x165
      github.com/couchbase/indexing/secondary/indexer.(*indexer).run(0xc000228000)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:1088 +0x28a
      github.com/couchbase/indexing/secondary/indexer.NewIndexer(0x1ffc560?)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:511 +0x262c
      main.main()
              goproj/src/github.com/couchbase/indexing/secondary/cmd/indexer/main.go:182 +0xfaegoroutine 7 [select, 66 minutes]:
      github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc00000e768)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:389 +0x67
      created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:550 +0x37agoroutine 8 [select, 66 minutes]:
      github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc00000e780)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:309 +0x85
      created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:551 +0x3cagoroutine 9 [IO wait, 66 minutes]:
      internal/poll.runtime_pollWait(0x7fe50843efc0, 0x72)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/runtime/netpoll.go:302 +0x89
      internal/poll.(*pollDesc).wait(0xc0001a2080?, 0xc0002ab000?, 0x0)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/internal/poll/fd_poll_runtime.go:83 +0x32
      internal/poll.(*pollDesc).waitRead(...)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.1/go/src/internal/poll/fd_poll_runtime.go:88
      internal/poll.(*FD).Read(0xc0001a2080, {0xc0002ab000, 0x1000, 0x1000}) 

      Test Job: http://perf.jenkins.couchbase.com/job/hemera/5374/console 

      Attachments

        Activity

          People

            vikas.chaudhary Vikas Chaudhary
            dhruvil.ketanshah Dhruvil Shah
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty