Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55454

Panic during create index with fail node

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Test Blocker
    • 7.1.4
    • 7.1.4
    • secondary-index
    • None
    • 7.1.4-3586
    • Untriaged
    • 0
    • Yes

    Description

      In regression we are seeing panic with following test

      2023-02-04 21:52:29 | INFO | MainProcess | test_thread | [gsi_replica_indexes.test_move_index_failed_node] CREATE INDEX random_index_839691 ON default(age) USING GSI  WITH {'nodes': ['172.23.97.224:8091', '172.23.121.243:8091']};
      2023-02-04 21:52:29 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY CREATE INDEX random_index_839691 ON default(age) USING GSI  WITH {'nodes': ['172.23.97.224:8091', '172.23.121.243:8091']};
      2023-02-04 21:52:29 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=CREATE+INDEX+random_index_839691+ON+default%28age%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27172.23.97.224%3A8091%27%2C+%27172.23.121.243%3A8091%27%5D%7D%3B
      2023-02-04 21:52:29 | ERROR | MainProcess | test_thread | [rest_client._http_request] POST http://172.23.97.224:8093/query?statement=CREATE+INDEX+random_index_839691+ON+default%28age%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27172.23.97.224%3A8091%27%2C+%27172.23.121.243%3A8091%27%5D%7D%3B body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 500 reason: unknown b'{\n"requestID": "706c7632-4c1b-4fa5-a4c7-99894004dcdd",\n"errors": [{"code":5001,"msg":"Panic: runtime error: invalid memory address or nil pointer dereference"}],\n"status": "fatal",\n"metrics": {"elapsedTime": "37.989371ms","executionTime": "37.89595ms","resultCount": 0,"resultSize": 0,"serviceLoad": 6,"errorCount": 1}\n}\n' auth: Administrator:password
       

       

      Panic  in query.log

      2023-02-04T21:52:29.741-08:00 [SEVERE] panic: runtime error: invalid memory address or nil pointer dereference
      2023-02-04T21:52:29.741-08:00 [SEVERE] request text: <ud>CREATE INDEX random_index_839691 ON default(age) USING GSI  WITH {'nodes': ['172.23.97.224:8091', '172.23.121.243:8091']};</ud>
      2023-02-04T21:52:29.741-08:00 [SEVERE] query context: <ud></ud>
      2023-02-04T21:52:29.741-08:00 [SEVERE] stack: goroutine 425 [running]:
      github.com/couchbase/query/server.(*Server).serviceRequest.func1()
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/server/server.go:958 +0xa5
      panic({0x23f17c0, 0x3f8bb10})
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/panic.go:838 +0x207
      github.com/couchbase/indexing/secondary/common.(*internalVersionCache).Get(0x1?, {0xc000c34000?, 0xc000725f18?})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:266 +0x39
      github.com/couchbase/indexing/secondary/common.(*internalVersionChecker).getVerFailNodes(0xc000313100, 0xc000afec00)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:490 +0x134
      github.com/couchbase/indexing/secondary/common.(*internalVersionChecker).getVersion(0xc000313100)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:435 +0x3a5
      github.com/couchbase/indexing/secondary/common.GetInternalClusterVersion({0x2d0e548?, 0xc0009c4500}, 0x1)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:765 +0x377
      github.com/couchbase/indexing/secondary/manager/client.NewMetadataProvider({0xc0003151ef, 0xe}, {0xc0000491b8, 0x17}, 0xc0005223f0, 0xc000b27380, {0x2d02b90?, 0xc000512900})
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:246 +0x3e5
       

      see attached log.

      For reference regression job: http://qa.sc.couchbase.com/job/test_suite_executor/541837/consoleText

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pierre.regazzoni Pierre Regazzoni
              pierre.regazzoni Pierre Regazzoni
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty