Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-15824

[system test] Indexer crashes on multiple places after a cluster restart

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 4.0.0
    • 4.0.0
    • secondary-index
    • Security Level: Public
    • 400-3502
    • Untriaged
    • Unknown

    Description

      1. load data + indexes
      2. Keep incoming queries ( mainly select, updates,deletes and some inserts)
      3. On all nodes on the cluster, do a /etc/init.d/couchbase-server stop, start

      Seeing a number of indexer cores on the index nodes and failure messages like below

      Service 'indexer' exited with status 1. Restarting. Messages: runtime.goexit()
      /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc20b3dafd0 sp=0xc20b3dafc8
      created by github.com/couchbase/indexing/secondary/dcp/transport/client.NewDcpFeed
      /home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/dcp/transport/client/dcp_feed.go:68 +0x4bf
      [goport] 2015/07/23 16:25:03 /opt/couchbase/bin/indexer terminated: signal: aborted (core dumped)
       
      Service 'indexer' exited with status 1. Restarting. Messages: runtime.goexit()
      /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc20c498fe0 sp=0xc20c498fd8
      created by github.com/couchbase/indexing/secondary/common.newVbSeqnosReader
      /home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/common/dcp_seqno.go:54 +0xb2
      [goport] 2015/07/23 16:24:55 /opt/couchbase/bin/indexer terminated: signal: aborted (core dumped)
       
      Service 'indexer' exited with status 1. Restarting. Messages: runtime.goexit()
      /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc20b6acfe0 sp=0xc20b6acfd8
      created by net/http.(*Transport).dialConn
      /usr/local/go/src/net/http/transport.go:661 +0xcbc
      [goport] 2015/07/23 16:24:49 /opt/couchbase/bin/indexer terminated: signal: aborted (core dumped)
       
      Service 'indexer' exited with status 1. Restarting. Messages: runtime.goexit()
      /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc20aee97e0 sp=0xc20aee97d8
      created by github.com/couchbase/indexing/secondary/common.newVbSeqnosReader
      /home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/common/dcp_seqno.go:54 +0xb2
      [goport] 2015/07/23 16:24:46 /opt/couchbase/bin/indexer terminated: signal: aborted (core dumped)
       
      Service 'indexer' exited with status 1. Restarting. Messages: runtime.goexit()
      /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc20c438fe0 sp=0xc20c438fd8
      created by github.com/couchbase/gometa/common.NewPeerPipe
      /home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:60 +0x14b
      [goport] 2015/07/23 16:24:41 /opt/couchbase/bin/indexer terminated: signal: aborted (core dumped)
      

      adding logs and core stack.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            siri Sriram Melkote (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty