Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37201

Timers queue is not processing once node is rebalance out

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Duplicate
    • 6.5.0
    • 6.5.0
    • eventing
    • Untriaged
    • Yes

    Description

      Build: 6.5.0-4926

      Seeing timers test are failing as queue is not getting processed for times with 30sec from the time of creation 

      ./testrunner -i /tmp/testexec.13301.ini -p get-cbcollect-info=True,GROUP=bucket_op_with_timers -t eventing.eventing_rebalance.EventingRebalance.test_rebalance_in_with_different_topologies,doc-per-day=20,dataset=default,nodes_init=4,services_init=kv-kv:eventing-kv:eventing-index:n1ql,groups=simple,services_in=kv,eventing,reset_services=True,handler_code=bucket_op_with_timers,GROUP=bucket_op_with_timers
       
       
      Exception: Bucket operations from handler code took lot of time to complete or didn't go through. Current : 18716 Expected : 0  dcp_backlog : 0  TIMERS_IN_PAST : 0 lcb_exceptions : {'172.23.107.105': {}, '172.23.97.88': {}} 

       

      ./testrunner -i /tmp/testexec.13301.ini -p get-cbcollect-info=True,GROUP=bucket_op_with_timers -t eventing.eventing_rebalance.EventingRebalance.test_rebalance_out_with_different_topologies,doc-per-day=20,dataset=default,nodes_init=5,services_init=kv-kv-eventing-eventing-index:n1ql,groups=simple,server_out=2,reset_services=True,handler_code=bucket_op_with_timers,GROUP=bucket_op_with_timers
       
      Exception: Bucket operations from handler code took lot of time to complete or didn't go through. Current : 6372 Expected : 0  dcp_backlog : 0  TIMERS_IN_PAST : 0 lcb_exceptions : {'172.23.107.107': {}} 

       

      Attachments

        1. test_1.log
          281 kB
        2. test_1.zip
          22.58 MB
        3. test_9.zip
          60.24 MB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          In test_9 log, GO consumer has received 40320 DCP delete messages. C++ consumer has processed 33948 and 6384 messages are in queue. Since queue is not getting drained in C+, we are seeing 6372 docs in destination bucket. C+ queue not getting drained is causing this problem.

          satya.nand Satya Nand (Inactive) added a comment - In test_9 log, GO consumer has received 40320 DCP delete messages. C++ consumer has processed 33948 and 6384 messages are in queue. Since queue is not getting drained in C+ , we are seeing 6372 docs in destination bucket. C + queue not getting drained is causing this problem.
          jeelan.poola Jeelan Poola added a comment - - edited
          jeelan.poola Jeelan Poola added a comment - - edited All tests passed on a Toy ( http://server.jenkins.couchbase.com/job/toy-unix-simple/825/ ) with fix for MB-37199 . http://qa.sc.couchbase.com/job/test_suite_executor/179827/ . Closing this out as a duplicate.

          not seen on 6.5.0-4947
           

          vikas.chaudhary Vikas Chaudhary added a comment - not seen on 6.5.0-4947  

          People

            satya.nand Satya Nand (Inactive)
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty