[System Test]Rebalance failed: (sid:77) nextSnapStart) invariant failed: new value (28306) breaks invariant on current value (28341

2022-02-23T11:44:44.230-08:00, ns_orchestrator:0:critical:message(ns_1@172.23.106.253) - Rebalance exited with reason {mover_crashed,

                              {unexpected_exit,

                               {'EXIT',<0.1804.48>,

                                {{{{badmatch,{error,closed}},

                                   [{mc_client_binary,cmd_vocal_recv,5,

                                     [{file,"src/mc_client_binary.erl"},

                                      {line,151}]},

                                    {mc_client_binary,set_cluster_config,5,

                                     [{file,"src/mc_client_binary.erl"},

                                      {line,803}]},

                                    {ns_memcached,do_handle_call,3,

                                     [{file,"src/ns_memcached.erl"},

                                      {line,624}]},

                                    {ns_memcached,worker_loop,3,

                                     [{file,"src/ns_memcached.erl"},

                                      {line,227}]},

                                    {proc_lib,init_p_do_apply,3,

                                     [{file,"proc_lib.erl"},{line,226}]}]},

                                  {gen_server,call,

                                   ['ns_memcached-bucket3',

                                    {get_dcp_docs_estimate,99,

                                     "replication:ns_1@172.23.106.253->ns_1@172.23.106.242:bucket3"},

                                    300000]}},

[2022-02-23T11:42:36-08:00, sequoiatools/couchbase-cli:7.1:b0ddb6] server-add -c 172.23.106.253:8091 --server-add https://172.23.106.242 -u Administrator -p password --server-add-username Administrator --server-add-password password --services data

[pull] sequoiatools/couchbase-cli:7.1

[2022-02-23T11:42:48-08:00, sequoiatools/couchbase-cli:7.1:6176c6] rebalance -c 172.23.106.253:8091 -u Administrator -p password

→  

Error occurred on container - sequoiatools/couchbase-cli:7.1:[rebalance -c 172.23.106.253:8091 -u Administrator -p password]

docker logs 6176c6

docker start 6176c6

*Unable to display progress bar on this os

JERROR: Rebalance failed. See logs for detailed reason. You can try again.

[pull] sequoiatools/cmd

[2022-02-23T11:44:53-08:00, sequoiatools/cmd:dceeb0] 60

2022-02-23T11:44:42.600269-08:00 INFO Pushing new cluster config for bucket:[bucket3] revision:{"epoch":1,"revno":23374}

2022-02-23T11:44:42.601397-08:00 CRITICAL *** Fatal error encountered during exception handling ***

2022-02-23T11:44:42.601471-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (ActiveStream eq_dcpq:fts:bucket3:0087bdba8f471fc18538ded9791a15e8-65d9907sid:77 (vb:102) (sid:77) nextSnapStart) invariant failed: new value (28306) breaks invariant on current value (28341)

2022-02-23T11:44:42.601484-08:00 CRITICAL Exception thrown from:

2022-02-23T11:44:42.601600-08:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x13d1fc]

2022-02-23T11:44:42.601628-08:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0x4c05fc]

2022-02-23T11:44:42.601654-08:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x4ca0bf]

2022-02-23T11:44:42.601681-08:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4ca4ac]

2022-02-23T11:44:42.601706-08:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x4ca5c4]

2022-02-23T11:44:42.601728-08:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x4d0c89]

2022-02-23T11:44:42.601762-08:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x6b9e89]

2022-02-23T11:44:42.601791-08:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x6b3afa]

2022-02-23T11:44:42.601815-08:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x6bb23e]

2022-02-23T11:44:42.601850-08:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x80fae0]

2022-02-23T11:44:42.601879-08:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x7fa57a]

2022-02-23T11:44:42.601906-08:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x812a99]

2022-02-23T11:44:42.601935-08:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x6b37f4]

2022-02-23T11:44:42.602031-08:00 CRITICAL     #13 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7faec86ba000+0xcdd40]

2022-02-23T11:44:42.602043-08:00 CRITICAL     #14 /lib64/libpthread.so.0() [0x7faeca588000+0x7ea5]

2022-02-23T11:44:42.602083-08:00 CRITICAL     #15 /lib64/libc.so.6(clone+0x6d) [0x7faec7dd2000+0xfe9fd]