Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
None
-
master, 6.5.0
-
Untriaged
-
No
-
KV-Engine Mad-Hatter Beta
Description
During the Jepsen nightly 179 run for build 6.5.0-3770-1. This error message was observed on node 172.28.128.112 in memcached.log while trying to perform a rollback.
2019-07-15T23:41:43.687910-07:00 INFO 65: (default) DCP (Consumer) eq_dcpq:replication:ns_1@172.28.128.191->ns_1@172.28.128.112:default - (vb:36) Received rollback request. Rolling back to seqno:49
|
.....
|
2019-07-15T23:41:43.878463-07:00 ERROR 65: exception occurred in runloop during packet execution. Cookie info: [{"aiostat":"success","connection":"[ 127.0.0.1:44965 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]","engine_storage":"0x00007fb8f2097410","ewouldblock":false,"packet":{"bodylen":33,"cas":0,"datatype":"raw","extlen":16,"key":"<ud>.jepsen0000002064</ud>","keylen":17,"magic":"ClientRequest","opaque":7,"opcode":"DCP_COMMIT","vbucket":36},"refcount":1}] - closing connection ([ 127.0.0.1:44965 - 127.0.0.1:11209 (<ud>@ns_server</ud>) ]): Monotonic<15SnapshotEndInfo> (unlabelled) invariant failed: new value (49{Disk}) breaks invariant on current value (51{Memory})
|
The jepsen test being performed, tries to kill nodes and fail them over performing Persit to majority with slow disks for each node.
To run this test use this command:
lein trampoline run test --nodes-file ./nodes --username vagrant --ssh-private-key ./resources/vagrantkey --workload=set-kill --scenario=kill-memcached-on-slow-disk --replicas=2 --no-autofailover --durability=0:0:0:100 --eviction-policy=full --manipulate-disks
Attachments
Issue Links
- duplicates
-
-
- Closed
-