Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-35699

[System Test] Service 'projector' exited with status 1

    XMLWordPrintable

Details

    Description

      Build: 6.5.0-4106

      Test: centos longevity 

      Cycle: 2nd

      Test step:

      [2019-08-26T02:32:51-07:00, sequoiatools/couchbase-cli:6.5:e4ab68] server-add -c 172.23.108.103:8091 --server-add https://172.23.106.100 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data
      		 
      [2019-08-26T02:33:30-07:00, sequoiatools/couchbase-cli:6.5:cd067c] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      		 
      [2019-08-26T02:48:41-07:00, sequoiatools/cmd:f3e4c0] 60

      Error in 172.23.104.61:
      2019-08-26T02:44:54.092-07:00, ns_log:0:info:message(ns_1@172.23.104.88) - Service 'projector' exited with status 1. Restarting. Messages:
      2019-08-26T02:44:53.580-07:00 [Info] DCPT[secidx:getfailoverlog-default-1566812693577538510] ##490 stats:

      {"bytes":0,"bufferacks":0,"toAckBytes":0,"streamreqs":0,"snapshots":0,"mutations":0,"streamends":0,"closestreams":0,"lastAckTime":0s,"lastNoopSend":0s,"lastNoopRecv":0s,"lastMsgSend":195.902µs,"lastMsgRecv":85.983µs,"rcvchLen":0,"incomingMsg":5}

      2019-08-26T02:44:53.580-07:00 [Info] DCPT[secidx:getfailoverlog-default-1566812693577538510] ##1ea ... stopped
      2019-08-26T02:44:53.580-07:00 [Info] FEED[<=>MAINT_STREAM_TOPIC_ed35616c2db57cd03d9d2c854bdddd3e(127.0.0.1:8091)] ##1ea start-timestamp bucket: default, vbuckets: 1 -

      {vbno, vbuuid, seqno, snapshot-start, snapshot-end} { 1019 486efd602724 34311 34311 34311}

      2019-08-26T02:44:53.661-07:00 [Info] FEED[<=>MAINT_STREAM_TOPIC_ed35616c2db57cd03d9d2c854bdddd3e(127.0.0.1:8091)] ##1ea backch *projector.controlStreamRequest

      {controlStreamRequest, SUCCESS, default, 1019, 486efd602724, 23483, ##1ea, 15961501825651038056}

      2019-08-26T02:44:53.661-07:00 [Error] WRKR59<-default<-127.0.0.1:8091 #MAINT_STREAM_TOPIC_ed35616c2db57cd03d9d2c854bdddd3e ##1ea duplicate OpStreamRequest: <ud>(DCP_STREAMREQ)</ud>
      2019-08-26T02:44:53.661-07:00 [Fatal] WRKR59<-default<-127.0.0.1:8091 #MAINT_STREAM_TOPIC_ed35616c2db57cd03d9d2c854bdddd3e ##1ea mismatch with vbucket.##1e5 DCP_STREAMREQ

      Similar errors have seen in other nodes

      Attachments

        For Gerrit Dashboard: MB-35699
        # Subject Branch Project Status CR V
        114223,2 MB-35699 Use hexadecimal opaque when logging projector stats unstable indexing Status: MERGED +2 +1
        114333,5 MB-35699 Cleanup book-keeping in upr.go on STREAMEND unstable indexing Status: MERGED +2 +1
        117644,1 MB-35699 Check for duplicate stream request before adding 'vb' to dcp_feed unstable indexing Status: ABANDONED 0 0
        117686,4 MB-35699 do not clear feed bookkeeping for shutdownVb in async mode unstable indexing Status: MERGED +2 +1

        Activity

          People

            girish.benakappa Girish Benakappa
            girish.benakappa Girish Benakappa
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                PagerDuty