Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4476

adding a node to a cluster which has the same otpCookie causes issues ( happens when vm is cloned or created from an AMI/VM_Template where couchbase was already installed)

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.7.2
    • Fix Version/s: 2.0-beta
    • Component/s: ns_server
    • Security Level: Public
    • Environment:
      Membase 1.7.2 installed via deb on Ubuntu 11.10 64 bit running on an Amazon EC2 m2.xlarge instance.

      Description

      I'm seeing intermittent problems when building a cluster of Membase servers. Sometimes adding an additional server to a cluster will cause another server to be marked as unhealthy. Other times the additional server will function correctly but all others will appear to be in setup mode. This only happens some times, so it's tricky to nail down properly.

      Steps to reproduce this are in this forum thread: http://www.couchbase.org/forums/thread/server-marked-unhealthy-after-adding-additional-server-cluster

      In the most recent test run, I spun up 3 m2.xlarge instances as described in the forum post. On adding the third server to the cluster (from the admin web interface on the first server), the admin interface refreshed and showed the setup dialog. When I browsed to the second server it was also in setup mode. The third server was configured correctly and appeared to be running in its own cluster of one machine. I've attached the output from /logs on all three machines.

      (Forgive me if I have the wrong component selected, I'm not quite sure which one is causing me to see this issue.)

      1. membase_a_log.json
        6 kB
        Conor
      2. membase_a_ns-diag-20111130185447.txt
        985 kB
        Conor
      3. membase_b_log.json
        5 kB
        Conor
      4. membase_b_ns-diag-20111130185430.txt
        725 kB
        Conor
      5. membase_c_log.json
        6 kB
        Conor
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Conor Conor McDermottroe created issue -
        ingenthr Matt Ingenthron made changes -
        Field Original Value New Value
        Assignee Farshid Ghods [ farshid ]
        Conor Conor McDermottroe made changes -
        Attachment membase_a_ns-diag-20111130185447.txt [ 11851 ]
        Attachment membase_a_mbcollect_info.zip [ 11852 ]
        Attachment membase_b_ns-diag-20111130185430.txt [ 11853 ]
        Attachment membase_b_mbcollect_info.zip [ 11854 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Assignee Farshid Ghods [ farshid ] Aleksey Kondratenko [ alkondratenko ]
        ingenthr Matt Ingenthron made changes -
        Fix Version/s 1.8.0 [ 10248 ]
        Priority Major [ 3 ] Critical [ 2 ]
        dipti Dipti Borkar made changes -
        Fix Version/s 1.8.1 [ 10249 ]
        Fix Version/s 1.8.0 [ 10248 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Assignee Aleksey Kondratenko [ alkondratenko ] Dale Harvey [ daleharvey ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Assignee Dale Harvey [ daleharvey ] Aleksey Kondratenko [ alkondratenko ]
        dipti Dipti Borkar made changes -
        Priority Critical [ 2 ] Blocker [ 1 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 1.8.1 [ 10295 ]
        Resolution Fixed [ 1 ]
        farshid Farshid Ghods (Inactive) made changes -
        Summary Membase server marked as unhealthy after adding an additional server to a cluster adding a node to a cluster which has the same otpCookie causes issues ( happens when vm is cloned or created from an AMI/VM_Template where couchbase was already installed)
        Labels 1.8.1-release-notes
        maria Maria McDuff (Inactive) made changes -
        Fix Version/s 2.0-beta [ 10113 ]
        Fix Version/s 1.8.2 [ 10249 ]
        Fix Version/s 1.8.1 [ 10295 ]

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            Conor Conor McDermottroe
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes