Details
-
Bug
-
Resolution: Duplicate
-
Major
-
None
-
7.1.0
-
None
-
7.1.0-2093
-
Untriaged
-
Centos 64-bit
-
-
1
-
Unknown
-
KV 2022-Jan
Description
Steps to repro:
- Create a 2 node cluster(172.23.122.245, 172.23.122.246(bucket_ram_quota = 2056 MB/node), replicas=0)
- Create 100 non default collections in default scope(collection count is 101(including default collection)
- Start Loading 500k docs in each of 100 non default collections
- While doc loading is going on change bucket ttl to 60 seconds
- Remove node 172.23.122.246 and trigger rebalance
- While rebalance is going on, trigger full compaction
- Rebalance exited with "wait_seqno_persisted_failed"
Note:
A Similar core as reported in MB-50458 was observed. Since rebalance error observed in MB-50458 is different from the error observed in this bug , so logging a different bug. Also this was a different test from MB-50458.
Rebalance Error:
Rebalance exited with reason {mover_crashed,
|
{unexpected_exit,
|
{'EXIT',<0.4376.2>,
|
{{wait_seqno_persisted_failed,"default",980,
|
15786,
|
[{'ns_1@172.23.122.245',
|
{'EXIT',
|
{socket_closed,
|
{gen_server,call,
|
[{'janitor_agent-default',
|
'ns_1@172.23.122.245'},
|
{if_rebalance,<0.22697.1>,
|
{wait_seqno_persisted,980,15786}},
|
infinity]}}}}]},
|
[{ns_single_vbucket_mover,
|
'-wait_seqno_persisted_many/5-fun-2-',5,
|
[{file,"src/ns_single_vbucket_mover.erl"},
|
{line,474}]},
|
{proc_lib,init_p,3,
|
[{file,"proc_lib.erl"},{line,211}]}]}}}}.
|
Rebalance Operation Id = 9327713d057278f0e649a1748f0f07ec
|
QE-Test:
git fetch "https://review.couchbase.org/TAF" refs/changes/88/166488/1 && git checkout FETCH_HEAD
|
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/qe_r.ini -p bucket_storage=couchstore,rerun=false,bucket_eviction_policy=fullEviction,init_loading=False -t storage.magma.magma_rebalance.MagmaRebalance.test_data_load_collections_with_rebalance_in,num_items=500000,doc_size=256,nodes_init=2,nodes_in=1,standard_buckets=1,magma_buckets=0,bucket_storage=couchstore,data_load_stage=before,sdk_timeout=60,vbuckets=1024,key_size=12,replicas=0,infra_log_level=debug,log_level=debug,skip_cleaup=True,randomize_value=True,bucket_eviction_policy=fullEviction,infra_log_level=debug,log_level=debug,init_loading=False,fragmentation=30,skip_cleanup=True,autoCompactionDefined=true,iterations=1,enable_dp=True,num_collections=100,num_scopes=1,bucket_ram_quota=2056,skip_cleanup=True,sdk_client_pool=False,ops_rate=12000,doc_ops=create,create_perc=100,delete_perc=0,update_perc=0,num_collections_to_drop=0,get-cbcollect-info=True -m rest'
|
Attachments
Issue Links
- duplicates
-
-
- Closed
-