Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56539

[System test upgrade] Online upgrade fails in analytics with "HYR0003: Failure on node 172.23.99.11:8091"

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 0
    • No
    • Analytics Sprint 18

    Description

      Steps to Repro
      1. Run a longevity test on 7.1.4 for 4 days.

      ./sequoia -client 172.23.104.27:2375 -provider file:centos_pine.yml -test tests/integration/neo/test_neo.yml -scope tests/integration/neo/scope_neo_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.1.4-3601 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
      

      2. Start an online upgrade using swap rebalance.

      Rebalance fails during analytics service rebalance as shown below.

      172.23.105.168 6:13:20 PM 19 Apr, 2023

      Rebalance exited with reason {service_rebalance_failed,cbas,
      {worker_died,
      {'EXIT',<0.13292.1926>,
      {rebalance_failed,
      {service_error,
      <<"Rebalance 75a5815d38f77a6142644fbdd92738bf failed: HYR0003: Failure on node 172.23.99.11:8091 (6736a7344ec35099a2a0aca7bdf0ecb4)">>}}}}}.
      Rebalance Operation Id = 54573ef8c569d4056e8889ec4e184745
      

      cbcollect_info attached.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              Balakumaran.Gopal Balakumaran Gopal
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty