Details
-
Bug
-
Resolution: Fixed
-
Major
-
None
-
None
-
None
Description
During recovery scenarios where two pods fail, the operator must remove 2 nodes from the cluster. Half the time the events show up as member 0 remove followed by member 1 removed, and the other half of the time, the opposite order takes place. For testing it would be best to deterministically remove nodes.
node_test.go:701: Expected events to be:
Type: Normal | Reason: ServiceCreated | Message: Service for admin console `test-couchbase-7fxh7-ui` was created
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0000 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0001 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0002 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0003 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0004 added to cluster
Type: Normal | Reason: RebalanceStarted | Message: A rebalance has been started to balance data across the cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0005 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0006 added to cluster
Type: Normal | Reason: RebalanceStarted | Message: A rebalance has been started to balance data across the cluster
Type: Normal | Reason: MemberRemoved | Message: Existing member test-couchbase-7fxh7-0001 removed from the cluster
Type: Normal | Reason: MemberRemoved | Message: Existing member test-couchbase-7fxh7-0000 removed from the cluster
but got:
Type: Normal | Reason: ServiceCreated | Message: Service for admin console `test-couchbase-7fxh7-ui` was created
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0000 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0001 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0002 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0003 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0004 added to cluster
Type: Normal | Reason: RebalanceStarted | Message: A rebalance has been started to balance data across the cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0005 added to cluster
Type: Normal | Reason: NewMemberAdded | Message: New member test-couchbase-7fxh7-0006 added to cluster
Type: Normal | Reason: RebalanceStarted | Message: A rebalance has been started to balance data across the cluster
Type: Normal | Reason: MemberRemoved | Message: Existing member test-couchbase-7fxh7-0000 removed from the cluster
Type: Normal | Reason: MemberRemoved | Message: Existing member test-couchbase-7fxh7-0001 removed from the cluster
This test passes 50% of the time due to the final two events