Details
-
Bug
-
Resolution: Software failure
-
Blocker
-
7.2.1
-
7.2.1-5819
-
Untriaged
-
0
-
Unknown
-
Analytics Sprint 22, Analytics Sprint 23
Description
- Create a 3 node all services co-located cluster. Create a bucket, 2 collections, and load 75M items in each collection
- Create GSI/FTS indexes, CBAS datasets/indexes. Let ingestion for all to complete.
- Start the query load for all the services.
- Scale up cluster from 3->6->9->12->15->18. At each scaling completion increment the query workload post the scaling completion.
- Scale up cluster from 18->15->12->9->6->3. Before each scaling operation decrement the query workload post the scaling completion.
- At the last scale down from 6 nodes to 3 nodes, the rebalance out of the last node is failing during analytics rebalancing.
Test |
sudo guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/couchbase_capella_volume_2.ini -p sdk_timeout=60,log_level=debug,infra_log_level=debug,mutation_perc=100,key_type=CircularKey,capella_run=true,bucket_storage=magma,bucket_eviction_policy=fullEviction,rerun=False -t aGoodDoctor.hostedHospital.Murphy.test_rebalance,skip_cleanup=True,num_buckets=1,bucket_names=GleamBook,bucket_type=membase,iterations=5,key_size=18,randomize_doc_size=False,randomize_value=True,maxttl=10,pc=20,gsi_nodes=3,cbas_nodes=3,fts_nodes=3,kv_nodes=3,n1ql_nodes=3,services=data:query:index:cbas:fts,max_rebl_nodes=27,kv_compute=n2-standard-16,gsi_compute=n2-standard-16,n1ql_compute=n2-standard-16,fts_compute=n2-standard-16,cbas_compute=n2-standard-16,kv_disk=500,n1ql_disk=50,gsi_disk=500,fts_disk=500,cbas_disk=500,provider=GCP,region=us-east1,type=PD-SSD,skip_teardown_cleanup=true,wait_timeout=14400,index_timeout=28800,runtype=dedicated,track_failures=False,skip_init=false,sanity=true,num_items=75000000 -m rest'
|
Attachments
Issue Links
- is duplicated by
-
MB-58254 Analytics service takes too long to rebalance, 7.2.1 5904 ami
-
- Resolved
-