Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55954

[System test] runtime error: invalid memory address or nil pointer dereference in query.log

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 0
    • No

    Description

      Script to Repro

      ./sequoia -client 172.23.104.27:2375 -provider file:centos_pine.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.0-5241 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
      

      Ran the above script. Its when we ran into MB-55919. However let the data load running and queries running. After couple of days noticed panics in query log.

      172.23.104.157 : query

      /opt/couchbase/var/lib/couchbase/logs/query.log:2023/03/13 14:52:04 http: panic serving 172.23.104.155:47796: runtime error: invalid memory address or nil pointer dereference
      /opt/couchbase/var/lib/couchbase/logs/query.log:panic({0x241f3e0, 0x4013b70})
      /opt/couchbase/var/lib/couchbase/logs/query.log:        /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:890 +0x262
      /opt/couchbase/var/lib/couchbase/logs/query.log:panic({0x241f3e0, 0x4013b70})
      /opt/couchbase/var/lib/couchbase/logs/query.log:        /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:884 +0x212
      /opt/couchbase/var/lib/couchbase/logs/query.log:2023/03/13 19:33:11 http: panic serving 172.23.104.155:47914: runtime error: invalid memory address or nil pointer dereference
      /opt/couchbase/var/lib/couchbase/logs/query.log:panic({0x241f3e0, 0x4013b70})
      /opt/couchbase/var/lib/couchbase/logs/query.log:        /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:890 +0x262
      /opt/couchbase/var/lib/couchbase/logs/query.log:panic({0x241f3e0, 0x4013b70})
      /opt/couchbase/var/lib/couchbase/logs/query.log:        /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:884 +0x212
      

      Full stack trace.

      2023/03/13 14:52:04 http: panic serving 172.23.104.155:47796: runtime error: invalid memory address or nil pointer dereference
      goroutine 92365417 [running]: 
      net/http.(*conn).serve.func1()
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/net/http/server.go:1850 +0xbf
      panic({0x241f3e0, 0x4013b70}) 
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:890 +0x262
      encoding/json.(*encodeState).marshal.func1()
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:327 +0x6e
      panic({0x241f3e0, 0x4013b70}) 
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/runtime/panic.go:884 +0x212
      github.com/couchbase/query/value.(*parsedValue).MarshalJSON(0x2658b40?)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/value/parsed.go:138 +0x19
      encoding/json.marshalerEncoder(0xc00e0a9400, {0x2658b40?, 0xc00cf2c680?, 0xe?}, {0x0?, 0x0?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:478 +0xbe
      encoding/json.(*encodeState).reflectValue(0x23cae40?, {0x2658b40?, 0xc00cf2c680?, 0xc006209560?}, {0x18?, 0x1b?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:359 +0x78
      encoding/json.interfaceEncoder(0xc00e0a9400, {0x23cae40?, 0xc00d0bfe70?, 0x7f3e845e7401?}, {0x8?, 0x1?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:715 +0xc8
      encoding/json.mapEncoder.encode({0xc000b73610?}, 0xc00e0a9400, {0x24079c0?, 0xc006209530?, 0x24079c0?}, {0x24?, 0x0?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:813 +0x5f5
      encoding/json.(*encodeState).reflectValue(0xc000b73668?, {0x24079c0?, 0xc006209530?, 0xc000b73688?}, {0xe0?, 0x82?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:359 +0x78
      encoding/json.(*encodeState).marshal(0x21a1de7?, {0x24079c0?, 0xc006209530?}, {0x19?, 0x0?})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:331 +0xfa
      encoding/json.Marshal({0x24079c0, 0xc006209530})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/encoding/json/encode.go:160 +0x45
      github.com/couchbase/query/server/http.(*HttpEndpoint).wrapAPI(0x162fd30?, {0x2d30870, 0xc00c8ad5e0}, 0xc00b9e3600, 0x2b27228)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/http/admin_endpoint.go:62 +0x31f
      github.com/couchbase/query/server/http.(*HttpEndpoint).registerAccountingHandlers.func10({0x2d30870?, 0xc00c8ad5e0?}, 0xc0062093e0?)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/http/admin_accounting_endpoint.go:94 +0x3a
      net/http.HandlerFunc.ServeHTTP(0xc00b9e3500?, {0x2d30870?, 0xc00c8ad5e0?}, 0xc000b739e0?)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/net/http/server.go:2109 +0x2f
      github.com/gorilla/mux.(*Router).ServeHTTP(0xc000041140, {0x2d30870, 0xc00c8ad5e0}, 0xc00b9e3400)
              /home/couchbase/.cbdepscache/gomodcache/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
      net/http.serverHandler.ServeHTTP({0xc00335a870?}, {0x2d30870, 0xc00c8ad5e0}, 0xc00b9e3400)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/net/http/server.go:2947 +0x30c
      net/http.(*conn).serve(0xc00ed7bd60, {0x2d36c48, 0xc0005bd0e0})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/net/http/server.go:1991 +0x607
      created by net/http.(*Server).Serve
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.19.5/go/src/net/http/server.go:3102 +0x4db
      

      cbcollect_info attached.

      Attachments

        For Gerrit Dashboard: MB-55954
        # Subject Branch Project Status CR V

        Activity

          People

            Balakumaran.Gopal Balakumaran Gopal
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty