Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4506

unable to add a 1.7.2 node to a 1.8.0 cluster

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.8.0
    • Fix Version/s: 1.8.0
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None

      Description

      Failed to add node 10.1.5.58:8091 to cluster. Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details. (repeated 1 times)

      error :

      Conflicting configuration changes to field

      {node,'ns_1@10.1.5.58',ns_log}

      :
      [{'_vclock',[{'ns_1@10.1.5.58',{1,63490331315}},
      {'ns_1@127.0.0.1',{1,63490331310}}]},

      {filename,"/opt/membase/var/lib/membase/data/ns_log"}

      ] and
      [{'_vclock',[{'ns_1@10.1.5.58',{1,63490331239}},
      {'ns_1@127.0.0.1',{1,63489992446}}]},

      {filename,"/opt/couchbase/var/lib/couchbase/data/ns_log"}

      ], choosing the former, which looks newer.

      1. logs.xz
        5.48 MB
        Aleksey Kondratenko
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Farshid, we always need diag/logs. Always. Even with smaller "in-line" logs we need context. Please.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Farshid, we always need diag/logs. Always. Even with smaller "in-line" logs we need context. Please.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -
        Show
        farshid Farshid Ghods (Inactive) added a comment - repro again here http://10.1.5.38:8091/index.html#sec=log
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        Failed to add node 10.1.5.61:8091 to cluster. Prepare join failed. Got HTTP status 500 from REST call post to http://10.1.5.61:8091/engageCluster2. Body was: "[\"Unexpected server error, request logged.\"]" ns_cluster005 ns_1@10.1.5.38 11:26:51 - Mon Dec 5, 2011
        Failed to add node 10.1.5.61:8091 to cluster. Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details. ns_cluster005 ns_1@10.1.5.38 11:26:47 - Mon Dec 5, 2011
        Membase Server has started on web port 8091 on node 'ns_1@10.1.5.61'. menelaus_sup001 ns_1@10.1.5.61 11:26:47 - Mon Dec 5, 2011
        Node 'ns_1@10.1.5.38' saw that node 'ns_1@10.1.5.61' came up. ns_node_disco004 ns_1@10.1.5.38 11:26:47 - Mon Dec 5, 2011
        Failed to add node 10.1.6.61:8091 to cluster. Failed to reach erlang port mapper at node "10.1.6.61". Error: ehostunreach ns_cluster005 ns_1@10.1.5.38 11:26:41 - Mon Dec 5, 2011
        Node 'ns_1@10.1.5.38' saw that node 'ns_1@10.1.5.54' went down.

        Show
        farshid Farshid Ghods (Inactive) added a comment - Failed to add node 10.1.5.61:8091 to cluster. Prepare join failed. Got HTTP status 500 from REST call post to http://10.1.5.61:8091/engageCluster2 . Body was: " [\"Unexpected server error, request logged.\"] " ns_cluster005 ns_1@10.1.5.38 11:26:51 - Mon Dec 5, 2011 Failed to add node 10.1.5.61:8091 to cluster. Join completion call failed. Failed to start ns_server cluster processes back. Logs might have more details. ns_cluster005 ns_1@10.1.5.38 11:26:47 - Mon Dec 5, 2011 Membase Server has started on web port 8091 on node 'ns_1@10.1.5.61'. menelaus_sup001 ns_1@10.1.5.61 11:26:47 - Mon Dec 5, 2011 Node 'ns_1@10.1.5.38' saw that node 'ns_1@10.1.5.61' came up. ns_node_disco004 ns_1@10.1.5.38 11:26:47 - Mon Dec 5, 2011 Failed to add node 10.1.6.61:8091 to cluster. Failed to reach erlang port mapper at node "10.1.6.61". Error: ehostunreach ns_cluster005 ns_1@10.1.5.38 11:26:41 - Mon Dec 5, 2011 Node 'ns_1@10.1.5.38' saw that node 'ns_1@10.1.5.54' went down.
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        log of node that adds other nodes is of little use. I'm grabbing logs from 10.1.5.61, but sadly 10.1.5.58 logs are not available anymore.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - log of node that adds other nodes is of little use. I'm grabbing logs from 10.1.5.61, but sadly 10.1.5.58 logs are not available anymore.
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Inability to join 10.1.5.61 is fixed by same missing 1.8.0 commit as in MB-4507. 155629517177d93234824f137b79d19bcb600093

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Inability to join 10.1.5.61 is fixed by same missing 1.8.0 commit as in MB-4507 . 155629517177d93234824f137b79d19bcb600093
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        maximally compressed logs of 10.1.5.61

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - maximally compressed logs of 10.1.5.61
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        reran the test with a more recent 1.8 build and it seems to work fine now.

        Show
        farshid Farshid Ghods (Inactive) added a comment - reran the test with a more recent 1.8 build and it seems to work fine now.

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            farshid Farshid Ghods (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes