Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48352

DWQ is building up massively during upsert load.

    XMLWordPrintable

Details

    Description

      3 Kv nodes, 1 n1ql/2i node
      1. Create magma bucket, 50 collections, 100 indexes, 100 qps
      2. Randomly Load 5B items of size 1500 bytes
      3. Upsert the 5B loaded items
      4. Create another 5B items
      5. Change the reader/writer threads to 64 and storage threads to 40
      6. DWQ is very much low
      7. Once 2nd 5B random create load is finished upsert them.
      8. During the upserts DWQ is simply building up and is not coming down ever.

      QE Test

      git fetch "http://review.couchbase.org/TAF" refs/changes/34/151634/122 && git checkout FETCH_HEAD
      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job3.ini -p bucket_storage=magma,bucket_eviction_policy=fullEviction,rerun=False -t aGoodDoctor.Hospital.Murphy.test_rebalance,nodes_init=3,graceful=True,skip_cleanup=True,num_items=100000000,num_buckets=1,bucket_names=GleamBook,doc_size=1536,bucket_type=membase,eviction_policy=fullEviction,iterations=2,batch_size=1000,sdk_timeout=60,log_level=debug,infra_log_level=debug,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,num_collections=50,maxttl=10,num_indexes=100,pc=10,index_nodes=1,cbas_nodes=0,fts_nodes=0,ops_rate=150000,ramQuota=102400,doc_ops=create:update:delete:read,mutation_perc=20,rebl_ops_rate=50000,key_type=RandomKey -m rest'
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            rohan.suri Rohan Suri
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty