Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-13099

All incoming connections are denied

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Major
    • None
    • 3.0.1
    • ns_server
    • Security Level: Public
    • CentOS 6.6 in Azure on Standard_D12 VM (4 cores, 28G RAM, 150G Data drive)
      6 node cluster using Couchbase Community Edition 3.0.1 (build 1444-rel)
    • Triaged
    • Centos 64-bit
    • Unknown

    Description

      All of a sudden this morning our 6 node cluster stopped taking connections.
      6 of the nodes showed 0 connections, while nodes 4 and 5 showed 200 existing connections.
      At the time, compaction was happening, and it stopped at 53%. I got this to stop by updating the bucket settings to only compact when at 50%, and between the hours of 10pm and 6am. Then the status went away.
      I tried to remove one of the servers and rebalance the cluster, but that didn't seem to work. It's now been stuck at "rebalancing" for a couple of hours now. Even after issuing a "rebalance-stop" command.
      After having one of our LInux guys look at the logs for CB and Linux found nothing, we decided to reboot the primary node. That went fine so far, it came back online and loaded the keys, and the access log and now it's in a pending state, most likely because it can't complete a rebalance of the cluster.

      I ran cbcollect_info and have attached the zip file.
      Let me know if you need further information.
      Thanks!

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            perry Perry Krug
            mpreece mpreece
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty