Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-18925

[Perf daily] Indexer crash during Q2 querying .. Assertion `rsize && rsize <= trie->chunksize' failed.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 4.5.0
    • 4.5.0
    • forestdb
    • 450-1943
    • Untriaged
    • Yes
    • ForestDB: Oct 17 - Nov 4

    Description

      Seeing errors on indexer crashing with below stack on
      Q2 stale-false ( possibly with stale ok) querying phase

      1. create bucket
      2. load data
      3. create index
      4. Q2 query, stale false

      • Indexer crashes

        Assertion in (nil) != 0x7f14bd04d020 in /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:84
        indexer: /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:84: int _hbtrie_reform_key(hbtrie*, void*, int, void*): Assertion `rsize && rsize <= trie->chunksize' failed.
        SIGABRT: abort
        PC=0x3936032925 m=14
        signal arrived during cgo execution
         
        goroutine 245 [syscall, locked to thread]:
        runtime.cgocall(0xc684c1, 0xc828089a38, 0x0)
                /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/cgocall.go:123 +0x11b fp=0xc8280899e8 sp=0xc8280899b8
        github.com/couchbase/indexing/secondary/fdb._Cfunc_fdb_set_kv(0x7f14bd418500, 0xc826f3de90, 0x2b, 0x0, 0x0, 0x0)
                ??:0 +0x41 fp=0xc828089a38 sp=0xc8280899e8
        github.com/couchbase/indexing/secondary/fdb.(*KVStore).SetKV(0xc8243b4db0, 0xc826f3de90, 0x2b, 0x30, 0x0, 0x0, 0x0, 0x0, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/fdb/kv.go:65 +0x208 fp=0xc828089ac8 sp=0xc828089a38
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insertSecIndex(0xc82212c000, 0xc826f3de90, 0x2b, 0x30, 0xc826a3b1e0, 0x13, 0x13, 0x0, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:464 +0x171a fp=0xc828089cd0 sp=0xc828089ac8
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insert(0xc82212c000, 0xc826f3de90, 0x2b, 0x30, 0xc826a3b200, 0x16, 0x16, 0xc826a3b1e0, 0x13, 0x13, ...)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:353 +0xeb fp=0xc828089d40 sp=0xc828089cd0
        github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).handleCommandsWorker(0xc82212c000, 0x0)
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:314 +0x4c6 fp=0xc828089f90 sp=0xc828089d40
        runtime.goexit()
                /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc828089f98 sp=0xc828089f90
        created by github.com/couchbase/indexing/secondary/indexer.NewForestDBSlice
                /home/couchbase/jenkins/workspace/watson-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:158 +0x190d
         
        goroutine 1 [select]:
        ..
        
        

        Attached are logs from the indexer node

      Attaching the data files for forestdb

      Attachments

        For Gerrit Dashboard: MB-18925
        # Subject Branch Project Status CR V

        Activity

          People

            ketaki Ketaki Gangal (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty