Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46528

[BP MB-45165 to 6.6.3] Panic in indexer - Error open /data/@2i/cache/meta/172_23_97_10_9102: no such file or directory

    XMLWordPrintable

Details

    • Triaged
    • 1
    • Unknown

    Description

      Indexer is hitting a panic during initial phase of the test from which it recovers. As the test runs smoothly after panic recovery, this might not be a priority bug, but logging it nevertheless. 

      The panic from the logs : 

      andleIndexStatusRequest:: Recovered from panic 1. Stacktrace goroutine 315 [running]:andleIndexStatusRequest:: Recovered from panic 1. Stacktrace goroutine 315 [running]:runtime/debug.Stack(0xc004ed7fa8, 0x10c90c0, 0x20a6780) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/runtime/debug/stack.go:24 +0x9dgithub.com/couchbase/indexing/secondary/manager.(*requestHandlerContext).handleIndexStatusRequest.func1(0x2122ac0) /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/manager/request_handler.go:492 +0xa0panic(0x10c90c0, 0x20a6780) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/runtime/panic.go:679 +0x1b2github.com/couchbase/indexing/secondary/manager.(*requestHandlerContext).setETagGetIndexStatus(0x2122ac0, 0xc004da5020, 0xc004da5050, 0x0, 0x21496f0, 0x0) /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/manager/request_handler.go:1025 +0x14cgithub.com/couchbase/indexing/secondary/manager.(*requestHandlerContext).getIndexStatus(0x2122ac0, 0x14b2d20, 0xc00452b080, 0xc0045ac780, 0x0, 0x21496f0, 0x0, 0x0, 0xc0001719b0, 0x1, ...) /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/manager/request_handler.go:977 +0x31cbgithub.com/couchbase/indexing/secondary/manager.(*requestHandlerContext).handleIndexStatusRequest(0x2122ac0, 0x14b4820, 0xc002560540, 0xc004557c00) /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/manager/request_handler.go:521 +0x462net/http.HandlerFunc.ServeHTTP(0xc0001671c0, 0x14b4820, 0xc002560540, 0xc004557c00) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/net/http/server.go:2007 +0x44net/http.(*ServeMux).ServeHTTP(0xc00017d8c0, 0x14b4820, 0xc002560540, 0xc004557c00) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/net/http/server.go:2387 +0x1bdnet/http.serverHandler.ServeHTTP(0xc004980460, 0x14b4820, 0xc002560540, 0xc004557c00) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/net/http/server.go:2802 +0xa4net/http.(*conn).serve(0xc004590aa0, 0x14bff20, 0xc00452af00) /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/net/http/server.go:1890 +0x875created by net/http.(*Server).Serve

       

      We see this in multiple weekly runs on 7.0.0-4735 this week with the error log 

      [Error] getLocalIndexMetadataFromCache: fail to read metadata from file /data/@2i/cache/meta/172_23_97_10_9102.  Error open /data/@2i/cache/meta/172_23_97_10_9102: no such file or directory
      2021-03-22T11:46:28.858-07:00 [Error] getLocalIndexMetadataFromCache: fail to read metadata from file /data/@2i/cache/meta/172_23_97_10_9102.  Error open /data/@2i/cache/meta/172_23_97_10_9102: no such file or directory

      Runs : http://perf.jenkins.couchbase.com/job/secondary-plasma/6315/console 

      Logs : 

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-secondary-plasma-6315/172.23.97.10.zip - Indexer logs

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              kevin.cherkauer Kevin Cherkauer (Inactive)
              kevin.cherkauer Kevin Cherkauer (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty