Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
Cheshire-Cat
-
7.0.0-5194
-
Untriaged
-
Centos 64-bit
-
1
-
Unknown
Description
Script to Repro
./sequoia -client 172.23.96.162:2375 -provider file:centos_third_cluster.yml -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml -scale 3 -repeat 0 -log_level 0 -version 7.0.0-5194 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
|
We are also running the following script in background during this test.
for i in {0..500000}
|
do
|
`curl -X PUT -u Administrator:password http://localhost:8091/_metakv/key{$i} -d 'value=foo1'`
|
sleep 15
|
`curl -X DELETE -v -u Administrator:password http://localhost:8091/_metakv/key{$i}`
|
sleep 15
|
done
|
It hung at the hard failover fts(172.23.106.209) and rebalance out step for over 8 hours.
[2021-05-20T15:06:37-07:00, sequoiatools/couchbase-cli:7.0:4e13cd] failover -c 172.23.104.232:8091 --server-failover 172.23.106.209:8091 -u Administrator -p password --hard
|
[2021-05-20T15:06:45-07:00, sequoiatools/couchbase-cli:7.0:d752c6] rebalance -c 172.23.104.232:8091 -u Administrator -p password
|
cbcollect_info attached.