Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50284

[BP 6.6.5] - Eventing: Handler stuck in pausing state after online upgrade and enforcing TLS

    XMLWordPrintable

Details

    Description

      STEPS

      1. Cluster consists of 3 nodes (data, data + eventing, index + query) running on 6.6.4-9961.
      2. Create 3 eventing handlers namely bucket_op, timers and n1ql.
      3. Deploy all 3 handlers, load docs into source bucket and verify mutations are processed or not.
      4. Perform online upgrade of the cluster to 6.6.5 - 10072.
      5. Create and deploy 4th handler.
      6. Disable auto failover, enable n2n encryption and Enforce TLS.
      7. Pause all 4 eventing handlers.

      OBSERVATION
      timers handler is stuck in pausing state.

      curl -XGET -k https://Administrator:password@172.23.106.74:18096/api/v1/status
      {
       "apps": [
        {
         "composite_status": "paused",
         "name": "bucket_op",
         "num_bootstrapping_nodes": 0,
         "num_deployed_nodes": 1,
         "deployment_status": true,
         "processing_status": false,
         "redeploy_required": false
        },
        {
         "composite_status": "paused",
         "name": "n1ql",
         "num_bootstrapping_nodes": 0,
         "num_deployed_nodes": 1,
         "deployment_status": true,
         "processing_status": false,
         "redeploy_required": false
        },
        {
         "composite_status": "pausing",
         "name": "timers",
         "num_bootstrapping_nodes": 0,
         "num_deployed_nodes": 1,
         "deployment_status": true,
         "processing_status": false,
         "redeploy_required": false
        },
        {
         "composite_status": "paused",
         "name": "test",
         "num_bootstrapping_nodes": 0,
         "num_deployed_nodes": 1,
         "deployment_status": true,
         "processing_status": false,
         "redeploy_required": false
        }
       ],
       "num_eventing_nodes": 1
      }
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Sujay Gad Please pick up the upcoming latest 6.6.5 build and test.

            abhishek.jindal Abhishek Jindal added a comment - Sujay Gad Please pick up the upcoming latest 6.6.5 build and test.

            Build couchbase-server-6.6.5-10075 contains eventing commit a6c1a26 with commit message:
            MB-50284 : Proactively stream encryption level changes to C++ consumer

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.5-10075 contains eventing commit a6c1a26 with commit message: MB-50284 : Proactively stream encryption level changes to C++ consumer

            Build couchbase-server-6.6.5-10075 contains eventing commit 6b84de9 with commit message:
            MB-50284 : Wrap timer lcb handle in early bailout wrapper

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.5-10075 contains eventing commit 6b84de9 with commit message: MB-50284 : Wrap timer lcb handle in early bailout wrapper

            Build couchbase-server-6.6.5-10075 contains eventing-ee commit f7d38a6 with commit message:
            MB-50284 : Timer store change to facilitate lcb handle with early

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.5-10075 contains eventing-ee commit f7d38a6 with commit message: MB-50284 : Timer store change to facilitate lcb handle with early
            sujay.gad Sujay Gad added a comment -

            Verified the fix on Enterprise Edition 6.6.5 build 10078.

            CASE 1
            Reproduced this issue on 6.6.5 - 10072.

            STEPS

            1. Create and deploy 2 eventing handlers - bucket_op and timers.
            2. Load docs into src bucket and verify mutations are processed or not.
            3. Disable auto failover, enable n2n encryption and enforce tls.
            4. Pause both handlers.

            OBSERVATION
            timers handler stuck in pausing state.

            CASE 2
            Verified the fix on 6.6.5 - 10078.

            STEPS

            1. Create and deploy 2 eventing handlers - bucket_op and timers.
            2. Load docs into src bucket and verify mutations are processed or not.
            3. Disable auto failover, enable n2n encryption and enforce tls.
            4. Pause and resume both handlers.
            5. Load docs into src bucket and verify mutations are processed or not.
            6. Change encryption level back to control.
            7. Pause and resume both handlers.
            8. Load docs into src bucket and verify mutations are processed or not.

            No issues observed.

            sujay.gad Sujay Gad added a comment - Verified the fix on Enterprise Edition 6.6.5 build 10078 . CASE 1 Reproduced this issue on 6.6.5 - 10072. STEPS Create and deploy 2 eventing handlers - bucket_op and timers. Load docs into src bucket and verify mutations are processed or not. Disable auto failover, enable n2n encryption and enforce tls. Pause both handlers. OBSERVATION timers handler stuck in pausing state. CASE 2 Verified the fix on 6.6.5 - 10078. STEPS Create and deploy 2 eventing handlers - bucket_op and timers. Load docs into src bucket and verify mutations are processed or not. Disable auto failover, enable n2n encryption and enforce tls. Pause and resume both handlers. Load docs into src bucket and verify mutations are processed or not. Change encryption level back to control. Pause and resume both handlers. Load docs into src bucket and verify mutations are processed or not. No issues observed.

            People

              sujay.gad Sujay Gad
              sujay.gad Sujay Gad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty