Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46450

[BP to 6.6.4] [130Node]: (vb:529) 2i making invalid stream request

    XMLWordPrintable

Details

    Description

      Steps:

      1. Step 1: Create a 40 node cluster
      2. Step 2: Create required buckets and collections.
      3. Step 3: Create 500000000 items sequentially
      4. Step 4.1: Rebalance IN with Loading of docs
      5. Step 5.1: Rebalance OUT with Loading of docs
      6. Step 6.1: Rebalance SWAP with Loading of docs
      7. Step 7.1: Rebalance IN/OUT with Loading of docs
      8. Step 8.1: Rebalance OUT/IN with Loading of docs
      9. Step 4.2: Rebalance IN with Loading of docs
      10. Step 5.2: Rebalance OUT with Loading of docs
      11. Step 6.2: Rebalance SWAP with Loading of docs
      12. Step 7.2: Rebalance IN/OUT with Loading of docs
      13. Step 8.2: Rebalance OUT/IN with Loading of docs
      14. Step 4.3: Rebalance IN with Loading of docs
      15. Step 5.3: Rebalance OUT with Loading of docs
      16. Step 6.3: Rebalance SWAP with Loading of docs
      17. Step 7.3: Rebalance IN/OUT with Loading of docs
      18. Step 8.3: Rebalance OUT/IN with Loading of docs
      19. Step 4.4: Rebalance IN with Loading of docs
      20. Step 5.4: Rebalance OUT with Loading of docs
      21. Step 6.4: Rebalance SWAP with Loading of docs
      22. Step 7.4: Rebalance IN/OUT with Loading of docs ----> Error logs are seen during this step

        172.23.106.202

        		 
        ['2021-05-17T06:15:33.346780-07:00 WARNING 1055: (GleamBookUsers0) DCP (Producer) eq_dcpq:secidx:proj-MAINT_STREAM_TOPIC_0fbed04daea041d081f4b3c26687b366-14710609352975182185/3 - (vb:529) Stream request failed because the snap start seqno (334893) <= start seqno (334897) <= snap end seqno (334896) is required\n']

      23. Step 8.4: Rebalance OUT/IN with Loading of docs
      24. Step 4.5: Rebalance IN with Loading of docs
      25. Step 5.5: Rebalance OUT with Loading of docs
      26. Step 6.5: Rebalance SWAP with Loading of docs
      27. Step 7.5: Rebalance IN/OUT with Loading of docs
      28. Step 8.5: Rebalance OUT/IN with Loading of docs
      29. Step 4.6: Rebalance IN with Loading of docs
      30. Step 5.6: Rebalance OUT with Loading of docs
      31. Step 6.6: Rebalance SWAP with Loading of docs
      32. Step 7.6: Rebalance IN/OUT with Loading of docs
      33. Step 8.6: Rebalance OUT/IN with Loading of docs
      34. In the step above adding the nodes failed because nodes coming in are not cleaned up in 30s after removed from cluster in previous steps.

      Note - There is a 60 seconds sleep between subsequent rebalance steps.

      QE Test

      		 
      git fetch "http://review.couchbase.org/TAF" refs/changes/34/151634/71 && git checkout FETCH_HEAD
      		 
      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job4.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction,rerun=False -t aGoodDoctor.Hospital.Murphy.test_rebalance,nodes_init=40,graceful=True,skip_cleanup=True,num_items=500000000,num_buckets=1,bucket_names=GleamBook,doc_size=256,bucket_type=membase,eviction_policy=fullEviction,iterations=100,batch_size=1000,sdk_timeout=60,log_level=debug,infra_log_level=debug,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,num_collections=100,maxttl=1000,num_indexes=50,pc=1,sdk_client_pool=True,max_clients=10,index_nodes=35,query_nodes=5,cbas_nodes=0,fts_nodes=0,rebl_nodes=9,rebl_services=kv -m rest'

      Attachments

        Issue Links

          is a backport of

          Bug - A problem which impairs or prevents the functions of the product. MB-46348 [130Node]: (vb:529) 2i making invalid stream request

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              jeelan.poola Jeelan Poola
              varun.velamuri Varun Velamuri
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty