Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-537

PVC: Pod recovery/VolumeUnhealthy events are missing in the generated event list

    XMLWordPrintable

Details

    Description

       

      Testcase: TestPersistentVolumeKillAllPods

      Scenario:

      1. Created 4 node Couchbase cluster with PVC defined for all nodes
      2. Killing all couchbase-server pods
      3. All pods are recovered back and cluster is rebalanced.
      4. But recovery event is got only for 2 pods instead of 3 events

      Events:
      		 
        Type     Reason              Age              From                                 Message
      		 
        ----     ------              ----             ----                                 -------
      		 
        Normal   NewMemberAdded      10m              couchbase-operator-585d4b675d-j74s4  New member test-couchbase-xrlsc-0000 added to cluster
      		 
        Normal   NewMemberAdded      10m              couchbase-operator-585d4b675d-j74s4  New member test-couchbase-xrlsc-0001 added to cluster
      		 
        Normal   NewMemberAdded      9m               couchbase-operator-585d4b675d-j74s4  New member test-couchbase-xrlsc-0002 added to cluster
      		 
        Normal   NewMemberAdded      8m               couchbase-operator-585d4b675d-j74s4  New member test-couchbase-xrlsc-0003 added to cluster
      		 
        Normal   RebalanceStarted    8m               couchbase-operator-585d4b675d-j74s4  A rebalance has been started to balance data across the cluster
      		 
        Normal   RebalanceCompleted  8m               couchbase-operator-585d4b675d-j74s4  A rebalance has completed
      		 
        Normal   BucketCreated       8m               couchbase-operator-585d4b675d-j74s4  A new bucket `PVBucket` was created
      		 
        Warning  MemberDown          6m (x7 over 7m)  couchbase-operator-585d4b675d-j74s4  Existing member test-couchbase-xrlsc-0002 down
      		 
        Warning  MemberDown          6m (x8 over 7m)  couchbase-operator-585d4b675d-j74s4  Existing member test-couchbase-xrlsc-0000 down
      		 
        Normal   MemberRecovered     5m               couchbase-operator-585d4b675d-j74s4  Existing member test-couchbase-xrlsc-0000 recovered
      		 
        Warning  MemberDown          5m (x8 over 7m)  couchbase-operator-585d4b675d-j74s4  Existing member test-couchbase-xrlsc-0003 down
      		 
        Normal   MemberRecovered     5m               couchbase-operator-585d4b675d-j74s4  Existing member test-couchbase-xrlsc-0003 recovered
      		 
        Normal   RebalanceStarted    3m               couchbase-operator-585d4b675d-j74s4  A rebalance has been started to balance data across the cluster
      		 
        Normal   RebalanceCompleted  3m               couchbase-operator-585d4b675d-j74s4  A rebalance has completed

       

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. K8S-541 Log when events get dropped by kubernetes

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. K8S-597 Failover: MemberDown event not caught for one of the node during multinode failover

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              tommie Tommie McAfee (Inactive)
              ashwin.govindarajulu Ashwin Govindarajulu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty