Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48584

[System Test] Connection::isPacketAvailable(): Invalid packet header detected. Cookies: [] observed in memcached.log during kv rebalance

    XMLWordPrintable

Details

    • Bug
    • Resolution: Not a Bug
    • Major
    • None
    • 7.0.2, 7.1.0
    • test-execution
    • Enterprise Edition 7.0.2 build 6683 (RC1)

    Description

      Test -

      -test tests/eventing/CC/test_eventing_rebalance.yml -scope tests/eventing/CC/scope_eventing_rebalance.yml

      Day - 1
      Cycle - 2
      Scale - 3

      Test step -
      Rebalance out kv node.

      [2021-09-23T15:54:47-07:00, sequoiatools/couchbase-cli:7.0:67c21c] rebalance -c 172.23.104.16:8091 --server-remove 172.23.104.17 -u Administrator -p password
      		 
      [2021-09-23T16:10:33-07:00, sequoiatools/cmd:50a439] 60

      On 172.23.97.77
      memcached.log

      2021-09-23T16:09:11.119451-07:00 INFO 310: Client {"ip":"172.23.97.101","port":46016} authenticated as <ud>timer_op</ud>
      		 
      2021-09-23T16:09:11.179693-07:00 ERROR 310: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      		 
      2021-09-23T16:09:11.187573-07:00 WARNING 316: User [<ud>unknown</ud>] not found. Mechanism:[PLAIN], UUID:[d1e6e7b5-f13c-441d-2ae1-673969996ab2]
      		 
      2021-09-23T16:09:11.194472-07:00 INFO 309: HELO [{"a":"libcouchbase/3.0.6 (Linux-4.19.121-linuxkit; x86_64; GNU 8.3.0) PYCBC/3.0.10","i":"ee6e29fa3177d5d8/22cf3873486b5a07"}] TCP nodelay, Mutation seqno, XATTR, XERROR, Select bucket, Snappy, JSON, Unordered execution, Tracing, AltRequestSupport, SyncReplication, Collections, SubdocCreateAsDeleted [ {"ip":"172.23.97.101","port":46018} - {"ip":"172.23.97.77","port":11210} (not authenticated) ]
      		 
      2021-09-23T16:09:11.224255-07:00 INFO 309: Client {"ip":"172.23.97.101","port":46018} authenticated as <ud>timer_op</ud>
      		 
      2021-09-23T16:09:11.283309-07:00 ERROR 309: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      		 
      2021-09-23T16:09:11.290131-07:00 INFO 309: HELO [{"a":"libcouchbase/3.0.6 (Linux-4.19.121-linuxkit; x86_64; GNU 8.3.0) PYCBC/3.0.10","i":"ee6e29fa3177d5d8/90d681a84434c9fd"}] TCP nodelay, Mutation seqno, XATTR, XERROR, Select bucket, Snappy, JSON, Unordered execution, Tracing, AltRequestSupport, SyncReplication, Collections, SubdocCreateAsDeleted [ {"ip":"172.23.97.101","port":46020} - {"ip":"172.23.97.77","port":11210} (not authenticated) ]
      		 
      2021-09-23T16:09:11.307264-07:00 INFO 309: Client {"ip":"172.23.97.101","port":46020} authenticated as <ud>timer_op</ud>
      		 
      2021-09-23T16:09:11.399425-07:00 ERROR 309: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      		 
      2021-09-23T16:09:11.402407-07:00 INFO 309: HELO [{"a":"libcouchbase/3.0.6 (Linux-4.19.121-linuxkit; x86_64; GNU 8.3.0) PYCBC/3.0.10","i":"ee6e29fa3177d5d8/91706c3e93a2fd39"}] TCP nodelay, Mutation seqno, XATTR, XERROR, Select bucket, Snappy, JSON, Unordered execution, Tracing, AltRequestSupport, SyncReplication, Collections, SubdocCreateAsDeleted [ {"ip":"172.23.97.101","port":46022} - {"ip":"172.23.97.77","port":11210} (not authenticated) ]
      		 
      2021-09-23T16:09:11.420148-07:00 INFO 309: Client {"ip":"172.23.97.101","port":46022} authenticated as <ud>timer_op</ud>
      		 
      2021-09-23T16:09:11.522829-07:00 ERROR 309: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      		 
      2021-09-23T16:09:11.531551-07:00 INFO 310: HELO [{"a":"libcouchbase/3.0.6 (Linux-4.19.121-linuxkit; x86_64; GNU 8.3.0) PYCBC/3.0.10","i":"ee6e29fa3177d5d8/33f826e02d71c387"}] TCP nodelay, Mutation seqno, XATTR, XERROR, Select bucket, Snappy, JSON, Unordered execution, Tracing, AltRequestSupport, SyncReplication, Collections, SubdocCreateAsDeleted [ {"ip":"172.23.97.101","port":46024} - {"ip":"172.23.97.77","port":11210} (not authenticated) ]
      		 
      2021-09-23T16:09:11.557191-07:00 INFO 310: Client {"ip":"172.23.97.101","port":46024} authenticated as <ud>timer_op</ud>
      		 
      2021-09-23T16:09:11.662854-07:00 ERROR 310: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      		 
      2021-09-23T16:09:11.671868-07:00 INFO 310: HELO [{"a":"libcouchbase/3.0.6 (Linux-4.19.121-linuxkit; x86_64; GNU 8.3.0) PYCBC/3.0.10","i":"ee6e29fa3177d5d8/8b50c7618d76ff42"}] TCP nodelay, Mutation seqno, XATTR, XERROR, Select bucket, Snappy, JSON, Unordered execution, Tracing, AltRequestSupport, SyncReplication, Collections, SubdocCreateAsDeleted [ {"ip":"172.23.97.101","port":46026} - {"ip":"172.23.97.77","port":11210} (not authenticated) ]

      Assigning to eventing team first to take a look since errors are seen only for timer handler dcp streams (timer_op is the src bucket).

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sujay.gad Sujay Gad
            sujay.gad Sujay Gad
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty