[System Test] Rebalance failure - shard copy aborted: shard metadata mismatch with snapshot metadata

[ns_server:error,2024-02-20T09:20:38.736-08:00,ns_1@172.23.97.67:service_manager-index<0.28419.201>:service_manager:run_op_worker:219]Worker terminated abnormally: {'EXIT',<0.28815.201>,

                               {task_failed,rebalance,

                                {service_error,

                                 <<"shard copy aborted: shard metadata mismatch with snapshot metadata, shardId :15790437419045023451">>}}}

[ns_server:info,2024-02-20T09:20:38.738-08:00,ns_1@172.23.97.67:rebalance_agent<0.21767.0>:rebalance_agent:handle_down:290]Rebalancer process <0.27312.201> died (reason {service_rebalance_failed,

                                               index,

                                               {worker_died,

                                                {'EXIT',<0.28815.201>,

                                                 {task_failed,rebalance,

                                                  {service_error,

                                                   <<"shard copy aborted: shard metadata mismatch with snapshot metadata, shardId :15790437419045023451">>}}}}}).

[pull] vijayviji/sshpass

[2024-02-20T09:20:55-08:00, vijayviji/sshpass:793fa7] sshpass -p couchbase ssh -o StrictHostKeyChecking=no root@172.23.96.245 kill -SIGKILL $(pgrep memcached)

[pull] sequoiatools/cmd