Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43122

[Magma] DCP_PREPARE rejected on replica due to existing prepare in HT

    XMLWordPrintable

Details

    Description

      Steps to repro:*

      1. Created a 4 node cluster (replicas =1)
      2. Loaded 5 million items(doc size = 1024)
      3. Started New doc ops (update:delete:expiry).
      4. During doc ops restart couchbase server
      5. During recovery gracefully restart couchbase server
      6. Observed message "Exception occurred in runloop during packet execution( GSL: Precondition failure "

      Memcached Logs:*

      172.23.122.231 : Found exceptionRunLoop message in /opt/couchbase/var/lib/couchbase/logs/memcached.log.000084.txt
      2020-12-06T03:09:20.025739-08:00 WARNING 1512: exception occurred in runloop during packet execution. Closing connection: GSL: Precondition failure at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/vbucket.cc:3262. Cookies: [{"aiostat":"success","connection":"[ {\"ip\":\"127.0.0.1\",\"port\":58980} - {\"ip\":\"127.0.0.1\",\"port\":11209} (<ud>@ns_server</ud>) ]","engine_storage":"0x0000000000000000","ewouldblock":false,"packet":{"bodylen":278,"cas":1607252462680014848,"datatype":["JSON"],"extlen":31,"key":"<ud>.test_docs-772338</ud>","keylen":17,"magic":"ClientRequest","opaque":9,"opcode":"DCP_PREPARE","vbucket":859},"refcount":1}]
      

      QE TEST:*

      ./testrunner -i /tmp/testexec.72274.ini bucket_storage=magma,rerun=false,GROUP=P0;graceful_durability,randomize_value=true,doc_size=256,bucket_eviction_policy=fullEviction,nodes_init=4,graceful=True,get-cbcollect-info=True,infra_log_level=critical,log_level=error,upgrade_version=7.0.0-3938 -t magma.magma_crash_recovery.MagmaCrashTests.test_crash_during_recovery,doc_size=256,upgrade_version=7.0.0-3938,graceful=True,rerun=false,GROUP=P0;graceful_durability,doc_ops=update:delete:expiry,sdk_timeout=60,get-cbcollect-info=True,replicas=1,durability=PERSIST_TO_MAJORITY,bucket_storage=magma,log_level=error,bucket_eviction_policy=fullEviction,nodes_init=4,num_items=5000000,randomize_value=true,infra_log_level=critical
      

      JOB:*
      http://qa.sc.couchbase.com/job/test_suite_executor-TAF/76965/consoleFull

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              owend Daniel Owen
              ankush.sharma Ankush Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty