Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56592

QI node is failed over during compute upgrade under no load.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Critical
    • None
    • 7.1.4
    • secondary-index
    • couchbase-cloud-server-7-1-4-3630-v1-0-13

    Description

      1. Create a bucket. 2 collections
      2. Load 2B items in 2 collection
      3. Create GSI indexes
      4. Trigger disk upgrade and all 6 nodes are swapped rebalanced and disk is upgraded. Logs: http://supportal.couchbase.com/snapshot/60c09d9036c20346b1a0ec598044c54f::0
      5. Trigger compute upgrade and QI node swap rebalance failed. Logs
      6. The incoming GSI/Query node is failed over: svc-qi-node-013.o-e0gimwgm2aoy9b.sandbox.nonprod-project-avengers.com
      7. Also seeing disk full on one of the QI node. 

        Approaching full disk warning. Usage of disk "/opt/couchbase/var/lib/couchbase" on node "svc-qi-node-009.o-e0gimwgm2aoy9b.sandbox.nonprod-project-avengers.com" is around 95%.

        This could be the reason for a new incoming node getting into failed over state but lets head from Deepkaran Salooja before concluding on that. Found a testware issues which ended up reducing the disk size from 3TB to 550G. Fixing and rerunning the test.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty