ERROR 248: Exception occurred during packet execution. Monotonic<m> (PassiveStream(vb:317 eq_dcpq:replication:ns_1@172.23.217.74->ns_1@172.23.217.73:default)::cur_snapshot_start) invariant failed: new value (517) breaks invariant on current value (526)

memcached.log:241070:2024-01-20T22:04:41.476123-08:00 ERROR 248: Exception occurred during packet execution.

  Closing connection [ {"ip":"127.0.0.1","port":33288} - {"ip":"127.0.0.1","port":11209}

  (System, @ns_server) ]: Monotonic<m> (PassiveStream(vb:317 eq_dcpq:replication:ns_1@172.23.217.74->ns_1@172.23.217.73:default)::cur_snapshot_start) invariant failed: new value (517) breaks invariant on current value (526).Cookies: [{"aiostat":"success","ewouldblock":false,"packet":{"bodylen":37,"cas":0,"datatype":"raw","extlen":1,

           "extras":{"version":0},"keylen":0,"magic":"ClientRequest","opaque":546,"opcode":"DCP_SNAPSHOT_MARKER",

           "value":{"end_seqno":"529","flags":["raw: 0x00000005","Memory","Checkpoint"],"high_completed_seqno":"0","max_visible_seqno":"529","start_seqno":"517"},

           "vbucket":317},"refcount":1,"started":"4611732081964486 (7135 us ago)","throttled":false}]Exception thrown from: [

  "#0  /opt/couchbase/bin/memcached() [0x400000+0x144574]",

  "#1  /opt/couchbase/bin/memcached() [0x400000+0x5e9435]",

  "#2  /opt/couchbase/bin/memcached() [0x400000+0x5ea829]",

  "#3  /opt/couchbase/bin/memcached() [0x400000+0x5ed3b8]",

  "#4  /opt/couchbase/bin/memcached() [0x400000+0x5edb29]",

  "#5  /opt/couchbase/bin/memcached() [0x400000+0x5f0099]",

  "#6  /opt/couchbase/bin/memcached() [0x400000+0x5dd69c]",

  "#7  /opt/couchbase/bin/memcached() [0x400000+0x5dd7dd]",

  "#8  /opt/couchbase/bin/memcached() [0x400000+0x342bb0]",

  "#9  /opt/couchbase/bin/memcached() [0x400000+0x1d4843]",

  "#10 /opt/couchbase/bin/memcached() [0x400000+0x2a8529]",

  "#11 /opt/couchbase/bin/memcached() [0x400000+0x22243b]",

  "#12 /opt/couchbase/bin/memcached() [0x400000+0x208b98]",

  "#13 /opt/couchbase/bin/memcached() [0x400000+0x20d9f5]",

  "#14 /opt/couchbase/bin/memcached() [0x400000+0x217f27]",

  "#15 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fb9d7182000+0xf84e]",

  "#16 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fb9d7182000+0x18b99]",

  "#17 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7(event_base_loop+0x357) [0x7fb9d7182000+0x19287]",

  "#18 /opt/couchbase/bin/memcached() [0x400000+0x981a96]",

  "#19 /opt/couchbase/bin/memcached() [0x400000+0x981f9e]",

  "#20 /opt/couchbase/bin/memcached() [0x400000+0x984468]",

  "#21 /opt/couchbase/bin/memcached() [0x400000+0x231a29]",

  "#22 /opt/couchbase/bin/memcached() [0x400000+0x8d156c]",

  "#23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fb9d63cd000+0xe4aa3]",

  "#24 /lib/x86_64-linux-gnu/libpthread.so.0() [0x7fb9d6b2a000+0x7ea7]",

  "#25 /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7fb9d608e000+0xfba2f]"]

rebalance_new.rebalance_in.RebalanceInTests:

  rebalance_in_with_failover_full_addback_recovery,nodes_init=3,replicas=2,num_items=10000,doc_ops=create:update:delete,process_concurrency=2,sdk_timeout=60,num_items=100000,durability=MAJORITY,active_resident_threshold=70