Uploaded image for project: 'Couchbase Kubernetes'
  1. Couchbase Kubernetes
  2. K8S-3491

Swap Rebalance Upgrade CB 7.2.5 to 7.6.1 with K8s 1.25 and CAO 2.6.4

    XMLWordPrintable

Details

    • Task
    • Resolution: Resolved
    • Major
    • 2.6.4
    • None
    • None
    • None

    Description

      Update 2024-06-05

      Tests Completed

      Date CAO Build Status
      2024-05-18 2.6.4-108 Fail
      2024-05-22 2.6.4-111 Pass
      2024-05-29 2.6.4-119 Pass
      2024-06-04 2.6.4-122 Pass

      Update 2024-05-29

      Performing Swap Rebalance Upgrade

      Kubernetes Version 1.25 EKS
      Couchbase Server 7.2.5 → 7.6.1
      Operator 2.6.4-119

      Cluster Setup

      • Each node is an m5.4xlarge instance. (16 vCPUs and 64GB RAM) 
      • 6 Data Service, 4 Index Service & Query Service Nodes.
      • 10 Buckets (with 3 replica), Full Eviction and Auto-failover set to 5s.
      • 125GB data per bucket → ~1.25TB data loaded onto cluster before beginning of upgrade.
      • 50 Primary Indexes with 1 Replica each. (Total 100 Indexes with Index Storage: Plasma)

      Upgrade Process

      • SwapRebalance Upgrade to update Couchbase Server from 7.2.5 to 7.6.1.
      • Continuous query and data workload on the buckets during the update process.
      • Around 35-50% CPU load on all servers during the upgrade.

      Swap Rebalance Upgrade was successful

      Logs

      Before the Upgrade

      http://supportal.couchbase.com/snapshot/ca8f26dd83c1f592a980665e9c78360e::0

      2024-05-29A_PreSwapRebalance_cbopinfo-20240529T110501+0530.tar.gz

      During the Upgrade

      http://supportal.couchbase.com/snapshot/ca8f26dd83c1f592a980665e9c78360e::1

      2024-05-29A_DuringSwapRebalance_cbopinfo-20240529T183603+0530.tar.gz

      After the Upgrade

      http://supportal.couchbase.com/snapshot/ca8f26dd83c1f592a980665e9c78360e::2

      2024-05-29A_PostSwapRebalance_cbopinfo-20240529T195359+0530.tar.gz

       

       

      Attachments

        Issue Links

          Activity

            People

              aryaan.bhaskar Aryaan Bhaskar
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty