Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50693

[System Test] "panic: runtime error: invalid memory address or nil pointer dereference" in query logs

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.1.0
    • 7.1.0
    • query
    • Enterprise Edition 7.1.0 build 2179

    Description

      Test

      -test tests/eventing/neo/test_eventing_volume_rbac.yml -scope tests/eventing/neo/scope_eventing_volume.yml
      

      Day - 1
      Cycle - 1
      Scale - 3

      FAILURE
      On 172.23.97.83
      ns_server.query.log

      2022-01-31T00:38:27.051-08:00 [SEVERE] panic: runtime error: invalid memory address or nil pointer dereference
      2022-01-31T00:38:27.051-08:00 [SEVERE] request text: <ud>select raw count(*) from curl_op.scope_1.coll1</ud>
      2022-01-31T00:38:27.051-08:00 [SEVERE] query context: <ud></ud>
      2022-01-31T00:38:27.051-08:00 [SEVERE] stack: goroutine 34918962 [running]:
      github.com/couchbase/query/server.(*Server).serviceRequest.func1(0x28ee0d8, 0xc002508600, 0xc0005aa000)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:958 +0xc6
      panic(0x2306ee0, 0x37ef990)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.6/go/src/runtime/panic.go:965 +0x1b9
      github.com/couchbase/query/datastore/couchbase.(*collection).Name(...)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/datastore/couchbase/collections.go:178
      github.com/couchbase/query/datastore/couchbase.(*scope).KeyspaceByName(0xc0028fe200, 0xc00356ae80, 0x5, 0x2895148, 0xc0028fe200, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/datastore/couchbase/collections.go:108 +0xc2
      github.com/couchbase/query/datastore.GetKeyspace(0xc002d03ac0, 0x4, 0x4, 0x7, 0x24f8f20, 0x1, 0xc00271e530)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/datastore/datastore.go:328 +0x149
      github.com/couchbase/query/planner.(*builder).getTermKeyspace(0xc0014cbb00, 0xc001c53600, 0x22f5f01, 0x3aa0090, 0xc0015c23a8, 0x16aea5e)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build.go:301 +0xeb
      github.com/couchbase/query/planner.(*builder).fastCount(0xc0014cbb00, 0xc00144cc60, 0x1, 0x1, 0xc00271e540)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build_select_from.go:773 +0x15c
      github.com/couchbase/query/planner.(*builder).visitFrom(0xc0014cbb00, 0xc00144cc60, 0xc002d03c40, 0xc00030d920, 0xc0015c2c60, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build_select_from.go:27 +0x5b
      github.com/couchbase/query/planner.(*builder).VisitSubselect(0xc0014cbb00, 0xc00144cc60, 0x0, 0x0, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build_select_sub.go:236 +0xaca
      github.com/couchbase/query/algebra.(*Subselect).Accept(0xc00144cc60, 0x28a01f0, 0xc0014cbb00, 0x0, 0x0, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/algebra/select_sub.go:60 +0x3e
      github.com/couchbase/query/planner.(*builder).VisitSelect(0xc0014cbb00, 0xc0032c6ba0, 0x0, 0x0, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build_select.go:71 +0x344
      github.com/couchbase/query/algebra.(*Select).Accept(0xc0032c6ba0, 0x28a8030, 0xc0014cbb00, 0xc003a564e0, 0x8, 0x0, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/algebra/select.go:58 +0x3e
      github.com/couchbase/query/planner.Build(0x2894218, 0xc0032c6ba0, 0x28a7448, 0xc0004e41c0, 0x28a7778, 0xc00000e4f8, 0x260a99e, 0x7, 0x2550100, 0xc001c53680, ...)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build.go:31 +0x1a3
      github.com/couchbase/query/planner.BuildPrepared(0x2894218, 0xc0032c6ba0, 0x28a7448, 0xc0004e41c0, 0x28a7778, 0xc00000e4f8, 0x260a99e, 0x7, 0x100, 0xc001c53680, ...)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/planner/build_prepared.go:19 +0xc5
      github.com/couchbase/query/server.(*Server).getPrepared(0xc0005aa000, 0x28ee0d8, 0xc002508600, 0xc0014fc280, 0xc002d039c0, 0x260e4f3, 0x9)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:1213 +0x11fe
      github.com/couchbase/query/server.(*Server).serviceRequest(0xc0005aa000, 0x28ee0d8, 0xc002508600)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:1013 +0x225
      github.com/couchbase/query/server.(*Server).handleRequest(0xc0005aa000, 0x28ee0d8, 0xc002508600, 0xc0005aa030, 0x7)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:664 +0x6e
      github.com/couchbase/query/server.(*Server).ServiceRequest(0xc0005aa000, 0x28ee0d8, 0xc002508600, 0x0)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:593 +0x79
      github.com/couchbase/query/server/http.(*HttpEndpoint).ServeHTTP(0xc0006bf6c0, 0x2873a70, 0xc0004e4620, 0xc0014d4b00)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/http/service_endpoint.go:440 +0x393
      github.com/gorilla/mux.(*Router).ServeHTTP(0xc00057a180, 0x2873a70, 0xc0004e4620, 0xc0014d4900)
      	/home/couchbase/.cbdepscache/gomodcache/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0xd3
      net/http.serverHandler.ServeHTTP(0xc000be0000, 0x2873a70, 0xc0004e4620, 0xc0014d4900)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.6/go/src/net/http/server.go:2867 +0xa3
      net/http.(*conn).serve(0xc00077e000, 0x287f800, 0xc002d03880)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.6/go/src/net/http/server.go:1932 +0x8cd
      created by net/http.(*Server).Serve
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.6/go/src/net/http/server.go:2993 +0x39b
      

      NOTE
      Data service had terminated on node 172.23.104.16 few seconds earlier which might have caused this panic.

      [user:info,2022-01-31T00:38:11.058-08:00,ns_1@172.23.104.16:<0.11060.0>:ns_log:consume_log:76]Service 'memcached' exited with status 137. Restarting. Messages:
      WARNING: Logging before InitGoogleLogging() is written to STDERR
      W0130 22:58:37.866647  6200 HazptrDomain.h:670] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object
      [user:info,2022-01-31T00:38:11.058-08:00,ns_1@172.23.104.16:ns_memcached-bucket_op<0.16204.0>:ns_memcached:do_terminate:862]Control connection to memcached on 'ns_1@172.23.104.16' disconnected. Check logs for details.
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sujay.gad Sujay Gad
            sujay.gad Sujay Gad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty