Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-5282

Rebooting a node, marks all its replica vbuckets to dead, due to firewall

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.8.1-release-candidate
    • Fix Version/s: 1.8.1
    • Component/s: moxi
    • Security Level: Public
    • Labels:
      None
    • Environment:
      181-810

      Description

      1) Load some items
      2) Rebooted node .15. (Firewall get turned now now)
      3) Node 15 comes back up..
      vb_replica_curr_items = 0 as all vbuckets are marked as dead.

      vb_dead_num 205

      During this time, ns_server does not detect that the node is unreachable or anything. Until we disable the firewall.

      Disable the firewall, all replica vbuckets are set back correctly.

      1. 10.1.3.118-8091-diag.txt.gz
        695 kB
        Karan Kumar
      2. 10.1.3.117-8091-diag.txt.gz
        704 kB
        Karan Kumar
      3. 10.1.3.116-8091-diag.txt.gz
        705 kB
        Karan Kumar
      4. 10.1.3.115-8091-diag.txt.gz
        579 kB
        Karan Kumar
      5. 10.1.3.114-8091-diag.txt.gz
        1.32 MB
        Karan Kumar
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        There's bug somewhere already that states this behavior is confusing. It's there for reason. I.e. janitor (piece of code that sets vbucket states) needs to be sure everything is healthy and warmed up before doing anything. I.e. it's conservative.

        Main problem (not mentioned in this ticket) is everything is marked as green but there's not indication that janitor actually needs other nodes to be up and warmed up.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - There's bug somewhere already that states this behavior is confusing. It's there for reason. I.e. janitor (piece of code that sets vbucket states) needs to be sure everything is healthy and warmed up before doing anything. I.e. it's conservative. Main problem (not mentioned in this ticket) is everything is marked as green but there's not indication that janitor actually needs other nodes to be up and warmed up.

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            karan Karan Kumar (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes