Details
-
Bug
-
Resolution: Fixed
-
Critical
-
Cheshire-Cat
-
7.0.0-5161
-
Untriaged
-
-
1
-
Unknown
Description
Steps:
- Step 1: Create a 40 node cluster
- Step 2: Create required buckets and collections.
- Step 3: Create 500000000 items sequentially
- Step 4.1: Rebalance IN with Loading of docs
- Step 5.1: Rebalance OUT with Loading of docs
- Step 6.1: Rebalance SWAP with Loading of docs
- Step 7.1: Rebalance IN/OUT with Loading of docs
- Step 8.1: Rebalance OUT/IN with Loading of docs
- Step 4.2: Rebalance IN with Loading of docs
- Step 5.2: Rebalance OUT with Loading of docs
- Step 6.2: Rebalance SWAP with Loading of docs
- Step 7.2: Rebalance IN/OUT with Loading of docs
- Step 8.2: Rebalance OUT/IN with Loading of docs
- Step 4.3: Rebalance IN with Loading of docs
- Step 5.3: Rebalance OUT with Loading of docs
- Step 6.3: Rebalance SWAP with Loading of docs
- Step 7.3: Rebalance IN/OUT with Loading of docs
- Step 8.3: Rebalance OUT/IN with Loading of docs
- Step 4.4: Rebalance IN with Loading of docs
- Step 5.4: Rebalance OUT with Loading of docs
- Step 6.4: Rebalance SWAP with Loading of docs
- Step 7.4: Rebalance IN/OUT with Loading of docs ----> Error logs are seen during this step
172.23.106.202
['2021-05-17T06:15:33.346780-07:00 WARNING 1055: (GleamBookUsers0) DCP (Producer) eq_dcpq:secidx:proj-MAINT_STREAM_TOPIC_0fbed04daea041d081f4b3c26687b366-14710609352975182185/3 - (vb:529) Stream request failed because the snap start seqno (334893) <= start seqno (334897) <= snap end seqno (334896) is required\n']
- Step 8.4: Rebalance OUT/IN with Loading of docs
- Step 4.5: Rebalance IN with Loading of docs
- Step 5.5: Rebalance OUT with Loading of docs
- Step 6.5: Rebalance SWAP with Loading of docs
- Step 7.5: Rebalance IN/OUT with Loading of docs
- Step 8.5: Rebalance OUT/IN with Loading of docs
- Step 4.6: Rebalance IN with Loading of docs
- Step 5.6: Rebalance OUT with Loading of docs
- Step 6.6: Rebalance SWAP with Loading of docs
- Step 7.6: Rebalance IN/OUT with Loading of docs
- Step 8.6: Rebalance OUT/IN with Loading of docs
- In the step above adding the nodes failed because nodes coming in are not cleaned up in 30s after removed from cluster in previous steps.
Note - There is a 60 seconds sleep between subsequent rebalance steps.
QE Test |
git fetch "http://review.couchbase.org/TAF" refs/changes/34/151634/71 && git checkout FETCH_HEAD
|
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job4.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction,rerun=False -t aGoodDoctor.Hospital.Murphy.test_rebalance,nodes_init=40,graceful=True,skip_cleanup=True,num_items=500000000,num_buckets=1,bucket_names=GleamBook,doc_size=256,bucket_type=membase,eviction_policy=fullEviction,iterations=100,batch_size=1000,sdk_timeout=60,log_level=debug,infra_log_level=debug,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,num_collections=100,maxttl=1000,num_indexes=50,pc=1,sdk_client_pool=True,max_clients=10,index_nodes=35,query_nodes=5,cbas_nodes=0,fts_nodes=0,rebl_nodes=9,rebl_services=kv -m rest'
|
Attachments
Issue Links
- backports to
-
MB-46450 [BP to 6.6.4] [130Node]: (vb:529) 2i making invalid stream request
-
- Resolved
-