Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-35481

[System Test] DCP_BUFFER_ACKNOWLEDGEMENT from projector exceeds expected size by 24 bytes

    XMLWordPrintable

Details

    Description

      Build : 6.5.0-3939
      Test : -test tests/2i/test_idx_rebalance_replica_mad_hatter.yml -scope tests/2i/scope_idx_rebalance_replica_12nodes.yml
      Scale : 2

      On nodes 172.23.104.16, 172.23.104.17 and 172.23.104.18, the following type of errors are seen in the memcached logs.

      2019-08-06T01:23:35.121220-07:00 INFO (default) Compaction of vb:108, purge_before_ts:1564819535, purge_before_seq:0, drop_deletes:0 scheduled (awaiting completion).
      2019-08-06T01:23:36.271680-07:00 INFO 271: (default) DCP (Producer) eq_dcpq:replication:ns_1@172.23.104.16->ns_1@172.23.104.17:default - (vb:289) Backfill complete, 106937 items read from disk, 1104 from memory, last seqno read: 215800, pendingBackfill : False
      2019-08-06T01:23:36.356220-07:00 INFO (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - Attempting to release 4195224 bytes which is greater than bytesOutstanding:4195200
      2019-08-06T01:23:36.356496-07:00 ERROR 114: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 172.23.104.16:43276 - 172.23.104.16:11210 (<ud>@projector</ud>) ]","engine_storage":"0x00007f5eceaa8010","ewouldblock":false,"packet":{"bodylen":4,"cas":0,"datatype":"raw","extlen":4,"key":"<ud></ud>","keylen":0,"magic":"ClientRequest","opaque":0,"opcode":"DCP_BUFFER_ACKNOWLEDGEMENT","vbucket":0},"refcount":1}] - closing connection ([ 172.23.104.16:43276 - 172.23.104.16:11210 (<ud>@projector</ud>) ]): ThrowExceptionUnderflowPolicy current:4195200 arg:4195224
      2019-08-06T01:23:36.356556-07:00 INFO 114: (No Engine) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - Removing connection [ 172.23.104.16:43276 - 172.23.104.16:11210 (<ud>@projector</ud>) ]
      2019-08-06T01:23:36.356582-07:00 WARNING 114: (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - (vb:3) Stream closing, sent until seqno 218201 remaining items 0, reason: The stream closed early because the conn was disconnected
      2019-08-06T01:23:36.356594-07:00 WARNING 114: (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - (vb:7) Stream closing, sent until seqno 218061 remaining items 0, reason: The stream closed early because the conn was disconnected
      2019-08-06T01:23:36.356604-07:00 WARNING 114: (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - (vb:11) Stream closing, sent until seqno 218172 remaining items 0, reason: The stream closed early because the conn was disconnected
      2019-08-06T01:23:36.356614-07:00 WARNING 114: (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - (vb:15) Stream closing, sent until seqno 218063 remaining items 0, reason: The stream closed early because the conn was disconnected
      2019-08-06T01:23:36.356624-07:00 WARNING 114: (default) DCP (Producer) eq_dcpq:secidx:proj-default-MAINT_STREAM_TOPIC_7a973a796e97781f4b3dcd078a6fd523-14994328570622841968/3 - (vb:19) Stream closing, sent until seqno 217934 remaining items 0, reason: The stream closed early because the conn was disconnected
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              varun.velamuri Varun Velamuri
              mihir.kamdar Mihir Kamdar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty