Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-30245

Rebalance hung after memcached killed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 5.5.0
    • 5.5.0
    • eventing
    • None
    • Fucntional test
    • Untriaged
    • Unknown

    Description

      Build: 5.5.0-2929

      We observed rebalance hung when we kill memcached 

      ./testrunner -i /tmp/testexec.24577.ini -p get-cbcollect-info=True,GROUP=bucket_op_with_cron_timers -t eventing.eventing_rebalance.EventingRebalance.test_memcache_crash_on_kv_and_eventing_node_during_eventing_rebalance,doc-per-day=10,dataset=default,nodes_init=5,services_init=kv-kv-eventing-eventing-index:n1ql,groups=simple,reset_services=True,handler_code=bucket_op_with_cron_timers,GROUP=bucket_op_with_cron_timers

      Handler

      function OnUpdate(doc, meta) {
          var expiry = Math.round((new Date()).getTime() / 1000) + 5;
          cronTimer(timerCallback,  expiry, meta.id);
      }
      function OnDelete(meta) {
          var expiry = Math.round((new Date()).getTime() / 1000) + 5;
          cronTimer(NDtimerCallback,  expiry, meta.id);
      }
      function NDtimerCallback(docid) {
          delete dst_bucket[docid];
      }
      function timerCallback(docid) {
          dst_bucket[docid] = 'from timerCallback';
      }

      Observed with the bucket op logs attached .161 and .163

      function OnUpdate(doc, meta) {
          var doc_id = meta.id;
          log('creating document for : ', doc);
          dst_bucket[doc_id] = {'doc_id' : doc_id}; // SET operation
      }
       
      // This is intentionally left blank
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
       
      function OnDelete(meta) {
          log('deleting document', meta.id);
        

      Run log bucket op : http://qa.sc.couchbase.com/job/test_suite_executor/75842/artifact/logs/testrunner-18-Jun-24_09-01-34/test_24/test.log 

      Run log bucket op with cron timer : http://qa.sc.couchbase.com/job/test_suite_executor/75843/artifact/logs/testrunner-18-Jun-24_09-02-21/test_24/test.log 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            vikas.chaudhary Vikas Chaudhary
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty