Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-31073

"Stream request failed" messages from Analytics filing memcached log

    XMLWordPrintable

Details

    • Untriaged
    • Unknown
    • CX Sprint 117, CX Sprint 118

    Description

      As seen while investigating MB-31053, Analytics is repeated attempting invalid DCP streams, which have filled the memcached.log - over 2.3M such messages are seen in the logs for 172.23.99.20:

      $ grep -c "Stream request failed because the start seqno" memcached.log 
      2338902
      

      The net effect of this is that memcached.log has less than 1 minutes' worth of log history (!!) - well below the minimum required of 24H (and desired 7 days) - first and last lines in log:

      2018-08-26T04:10:37.503635Z INFO ---------- Opening logfile: /opt/couchbase/var/lib/couchbase/logs/memcached.log.085878.txt
      ...
      2018-08-26T04:11:28.561381Z INFO ---------- Closing logfile
      

      Example of the log messages printed from analytics:

      2018-08-26T04:10:37.495611Z WARNING (DISTRICT) DCP (Producer) eq_dcpq:cbas:DISTRICT:5937fb923a3f293fb55dd7efc22fd3d4:11 - (vb 907) Stream request failed because the start seqno (78844) is larger than the end seqno (72278); Incorrect params passed by the DCP client
      2018-08-26T04:10:37.495615Z WARNING (DISTRICT) DCP (Producer) eq_dcpq:cbas:DISTRICT:5937fb923a3f293fb55dd7efc22fd3d4:8 - (vb 840) Stream request failed because the start seqno (64201) is larger than the end seqno (53999); Incorrect params passed by the DCP client
      

      See MB-31053 for links to logs.

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-31073
          # Subject Branch Project Status CR V

          Activity

            People

              vikas.chaudhary Vikas Chaudhary
              drigby Dave Rigby (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty