Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42588

[System Test] Mismatch between DCP buffer acks for FTS DCP consumer

    XMLWordPrintable

Details

    Description

      Build : 7.0.0-3653
      Test : -test tests/integration/test_allFeatures_madhatter_durability.yml -scope tests/integration/scope_Xattrs_Madhatter.yml
      Scale : 3
      Day : 1st

      Seeing the following warnings in the memcached logs of various data nodes during the rebalance operation to add a new data node to the cluster.

      2020-11-07T05:07:03.232781-08:00 WARNING (default) DCP (Producer) eq_dcpq:fts:default:47becb8c390731c21178465ea5937ae1-249b6a5 - Attempting to release 10485772 bytes which is greater than bytesOutstanding:10485744
      		 
      2020-11-07T05:07:03.232912-08:00 WARNING 585: exception occurred in runloop during packet execution. Closing connection: ThrowExceptionUnderflowPolicy current:10485744 arg:10485772. Cookies: [{"aiostat":"success","connection":"[ {\"ip\":\"172.23.97.150\",\"port\":47224} - {\"ip\":\"172.23.120.58\",\"port\":11210} (<ud>@fts</ud>) ]","engine_storage":"0x00007fc7d010b1c0","ewouldblock":false,"packet":{"bodylen":4,"cas":0,"datatype":"raw","extlen":4,"key":"<ud></ud>","keylen":0,"magic":"ClientRequest","opaque":0,"opcode":"DCP_BUFFER_ACKNOWLEDGEMENT","vbucket":0},"refcount":1}]

      This is similar to MB-42506, which was filed for analytics. (cc Dave Rigby)

      The warnings happened between 04:55 and 05:09 across the following KV nodes :
      172.23.120.58, 172.23.120.73, 172.23.120.77, 172.23.120.86, 172.23.123.24, 172.23.123.25, 172.23.123.26, 172.23.123.31, 172.23.123.33, 172.23.97.74

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-42506 [System Test] Mismatch between DCP buffer acks for Analytics DCP consumer

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-42506 [System Test] Mismatch between DCP buffer acks for Analytics DCP consumer

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mihir.kamdar Mihir Kamdar (Inactive)
              mihir.kamdar Mihir Kamdar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty