Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48962

Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. errors in memcached.log when allow_interbucket_recursion is set to true

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Major
    • 7.1.0
    • 7.1.0
    • clients
    • Enterprise Edition 7.1.0 build 1499

    Description

      QE TEST

      ./testrunner -i /tmp/win10-bucket-ops.ini -p get-cbcollect-info=True -t eventing.eventing_source_mutation.EventingSourceMutation.cycle_check_bypass,nodes_init=4,services_init=kv-eventing-index-n1ql,dataset=default,groups=simple,reset_services=True,skip_cleanup=True,source_bucket_mutation=true
      

      Test passed on 7.1.0 - 1498, failed 7.1.0 - 1499 onwards.

      Changelog - http://changelog.build.couchbase.com/?product=couchbase-server&fromVersion=7.1.0&fromBuild=1498&toVersion=7.1.0&toBuild=1499&f_asterixdb=off&f_backup=off&f_cbas-core=off&f_cbgt=off&f_eventing=on&f_eventing-ee=off&f_goxdcr=off&f_indexing=off&f_ns_server=off&f_product-metadata=off&f_query=off&f_testrunner=off&f_couchbase-cli=off&f_couchdb=off&f_kv_engine=off&f_libcouchbase=off&f_build=on&f_cbbs=on&f_chronicle=on&f_magma=on&f_n1fty=on&f_tlm=on&f_voltron=on

      On 172.23.106.64
      memcached.log

      2021-10-18T02:11:50.241448-07:00 ERROR 4: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      2021-10-18T02:11:50.247838-07:00 ERROR 101: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      2021-10-18T02:11:50.252384-07:00 ERROR 4: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      2021-10-18T02:11:50.259116-07:00 ERROR 101: Exception occurred during packet execution. Closing connection: Connection::isPacketAvailable(): Invalid packet header detected. Cookies: []
      

      grep "Invalid packet header detected" memcached.log | wc -l
          6916
      

      Packet validation failed due to 4 different type of errors.

      2021-10-18T02:11:24.761545-07:00 WARNING 100: Packet validation failed for "SUBDOC_MULTI_MUTATION" - Status: "Invalid arguments" - Packet:[{"bodylen":776,"cas":0,"datatype":"raw","extlen":1,"keylen":255,"magic":"AltClientRequest","opaque":4629,"opcode":"SUBDOC_MULTI_MUTATION","vbucket":82}] - Returned payload:[{"error":{"context":"Key length exceeds 251"}}]
       
      2021-10-18T02:11:25.817978-07:00 WARNING 113: Packet validation failed for "SUBDOC_MULTI_MUTATION" - Status: "Invalid arguments" - Packet:[{"bodylen":528,"cas":0,"datatype":"raw","extlen":1,"keylen":9,"magic":"AltClientRequest","opaque":5884,"opcode":"SUBDOC_MULTI_MUTATION","vbucket":720}] - Returned payload:[{"error":{"context":"Multi mutation path and value truncated"}}]
       
      2021-10-18T02:11:25.823499-07:00 WARNING 115: Packet validation failed for "SUBDOC_MULTI_MUTATION" - Status: "Invalid arguments" - Packet:[{"bodylen":521,"cas":0,"datatype":"raw","extlen":1,"keylen":0,"magic":"AltClientRequest","opaque":4805,"opcode":"SUBDOC_MULTI_MUTATION","vbucket":408}] - Returned payload:[{"error":{"context":"Request must include key"}}]
       
      2021-10-18T02:11:25.837371-07:00 WARNING 113: Packet validation failed for "SUBDOC_MULTI_MUTATION" - Status: "Invalid arguments" - Packet:[{"bodylen":522,"cas":0,"datatype":"raw","extlen":1,"keylen":1,"magic":"AltClientRequest","opaque":4807,"opcode":"SUBDOC_MULTI_MUTATION","vbucket":66}] - Returned payload:[{"error":{"context":"Key length must be >= 2"}}]
      

      Regression most likely due to https://github.com/couchbase/eventing/commit/4301375c1b48b052e057eed1a35349f9b3fcf34f.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sujay.gad Sujay Gad
            sujay.gad Sujay Gad
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty