Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-60238

Log Projector FeedStats when MutationTopic request in progress

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Morpheus
    • 7.6.0, 7.2.1
    • secondary-index
    • None
    • 0

    Description

       

      When ever doMutationTopic completion takes time

       

      2023-07-07T04:53:48.263-07:00 [Info] PROJ[:9999] ##c doMutationTopic() "MAINT_STREAM_TOPIC_6533090188f1f485b8de7897bbf1c540"
      ...
      2023-07-07T05:22:31.012-07:00 [Info] PROJ[:9999] ##c doMutationTopic() returns  

       

      DCPT/KVDT/WRKR stats are logged after completion of request.

      recvChLen/mutChLen/dataChLen

       

      2023-07-07T05:23:09.662-07:00 [Info] DCPT[secidx:proj-bucket2-MAINT_STREAM_TOPIC_6533090188f1f485b8de7897bbf1c540-10880579292025902560/2] ##c stats: {"bytes":86014994,"bufferacks":41,"toAckBytes":1276631,"streamreqs":64,"snapshots":82,"mutations":68812,"collectionCreate":0,"collectionDrop":0,"collectionFlush":0,"scopeCreate":0,"scopeDrop":0,"collectionChanged":0,"seqnoAdvanced":0,"osoSnapshotStart":0,"osoSnapshotEnd":0,"streamends":0,"closestreams":0,"lastAckTime":99.580725ms,"lastNoopSend":62.173271ms,"lastNoopRecv":62.199231ms,"lastMsgSend":62.173271ms,"lastMsgRecv":29.981094ms,"rcvchLen":1000,"incomingMsg":70599,"queuedItems":635,"queueSize":819282,"totalEnq":70599,"totalDeq":69964}
       
      2023-07-07T05:23:09.664-07:00 [Info] KVDT[<-bucket2<-127.0.0.1:8091 #MAINT_STREAM_TOPIC_6533090188f1f485b8de7897bbf1c540] ##c stats: {"eventCount":241094,"reqCount":256,"endCount":0,"snapStat.samples":291,"snapStat.min":1,"snapStat.max":12386,"snapStat.avg":1964,"upsertCount":238176,"deleteCount":2370,"exprCount":0,"ainstCount":1,"dinstCount":0,"tsCount":0,"mutChLen":1000,"collectionCreate":0,"collectionDrop":0,"collectionFlush":0,"scopeCreate":0,"scopeDrop":0,"collectionChanged":0,"seqnoAdvanced":0,"osoSnapshotStart":0,"osoSnapshotEnd":0,"numDocsProcessed":17602037,"numDocsPending":2575410}
       
      2023-07-07T05:23:09.664-07:00 [Info] WRKR[<-bucket2<-127.0.0.1:8091 #MAINT_STREAM_TOPIC_6533090188f1f485b8de7897bbf1c540] ##c stats: {"datachLen":349,"outgoingMut":240744,"updateSeqno":110523,"txnSystemMut":0}
       

       

       

      This makes difficult to debug where was most of the time spent.

       

       

      func (p *Projector) doMutationTopic(
       request *protobuf.MutationTopicRequest,
       opaque uint16) apcommon.MessageMarshaller {
       topic := request.GetTopic()
       
       var err error
       feed, _ := p.acquireFeed(topic)
       defer p.releaseFeed(topic)
       
       if feed == nil {
        feed, err = NewFeed(p.pooln, topic, p, config, opaque, request.GetAsync())
       }
       response, err := feed.MutationTopic(request, opaque)
       
       p.UpdateStats(topic, feed)  ------> stats updated after MutationTopic
       p.AddFeed(topic, feed)
       
       
      } 

       

      Check if stats can be made available while processing request.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              amit.kulkarni Amit Kulkarni
              dhananjay.kshirsagar Dhananjay Kshirsagar
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty