Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-18925

[Perf daily] Indexer crash during Q2 querying .. Assertion `rsize && rsize <= trie->chunksize' failed.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 4.5.0
    • 4.5.0
    • forestdb
    • 450-1943
    • Untriaged
    • Yes
    • ForestDB: Oct 17 - Nov 4

    Description

      Seeing errors on indexer crashing with below stack on
      Q2 stale-false ( possibly with stale ok) querying phase

      1. create bucket
      2. load data
      3. create index
      4. Q2 query, stale false

      • Indexer crashes

        Assertion in (nil) != 0x7f14bd04d020 in /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:84
        indexer: /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:84: int _hbtrie_reform_key(hbtrie*, void*, int, void*): Assertion `rsize && rsize <= trie->chunksize' failed.
        SIGABRT: abort
        PC=0x3936032925 m=14
        signal arrived during cgo execution
         
        goroutine 245 [syscall, locked to thread]:
        runtime.cgocall(0xc684c1, 0xc828089a38, 0x0)
                /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/cgocall.go:123 +0x11b fp=0xc8280899e8 sp=0xc8280899b8
        github.com/couchbase/indexing/secondary/fdb._Cfunc_fdb_set_kv(0x7f14bd418500, 0xc826f3de90, 0x2b, 0x0, 0x0, 0x0)
                ??:0 +0x41 fp=0xc828089a38 sp=0xc8280899e8
        github.com/couchbase/indexing/secondary/fdb.(*KVStore).SetKV(0xc8243b4db0, 0xc826f3de90, 0x2b, 0x30, 0x0, 0x0, 0x0, 0x0, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/fdb/kv.go:65 +0x208 fp=0xc828089ac8 sp=0xc828089a38
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insertSecIndex(0xc82212c000, 0xc826f3de90, 0x2b, 0x30, 0xc826a3b1e0, 0x13, 0x13, 0x0, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:464 +0x171a fp=0xc828089cd0 sp=0xc828089ac8
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insert(0xc82212c000, 0xc826f3de90, 0x2b, 0x30, 0xc826a3b200, 0x16, 0x16, 0xc826a3b1e0, 0x13, 0x13, ...)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:353 +0xeb fp=0xc828089d40 sp=0xc828089cd0
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).handleCommandsWorker(0xc82212c000, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:314 +0x4c6 fp=0xc828089f90 sp=0xc828089d40
        runtime.goexit()
                /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc828089f98 sp=0xc828089f90
        created by github.com/couchbase/indexing/secondary/indexer.NewForestDBSlice
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:158 +0x190d
         
        goroutine 1 [select]:
        ..
        
        

        Attached are logs from the indexer node

      Attaching the data files for forestdb

      Attachments

        1. indexer.tar.gz
          9.32 MB
          Ketaki Gangal
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ketaki Ketaki Gangal (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty