Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-5293

rebalance failed with "gen_fsm,sync_send_event," error during online upgrade from 1.7.2 to 1.8.1 on windows ( workaround is to wait 30 seconds between add_node and starting the rebalance )

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.8.1
    • Fix Version/s: 1.8.1
    • Component/s: ns_server
    • Security Level: Public
    • Environment:
      windows server 2008 R2 64 bit

      Description

      Install membase server 1.7.2r-20 on 4 nodes windows server 2008 R2 64bit and couchbase server 1.8.0-810 on one node.
      Create 4 nodes cluster of membase server 1.7.2.
      Load 1000000 items to default bucket.
      Add node 200 with couchbase server 1.8.1-810 to cluster.
      Rebalance. Failed
      Try rebalance one more time. Complete rebalance.

      Error in log page
      Server error during processing: ["web request failed",

      {path,"/controller/rebalance"}

      ,

      {type,exit}

      ,
      {what,
      {noproc,
      {gen_fsm,sync_send_event,
      [

      {global,ns_orchestrator}

      ,

      {start_rebalance, ['ns_1@10.3.121.182', 'ns_1@10.3.121.183', 'ns_1@10.3.121.201', 'ns_1@10.3.121.202', 'ns_1@10.3.121.200'], [],[]}

      ]}}},
      {trace,
      [

      {gen_fsm,sync_send_event,2}

      ,

      {menelaus_web,do_handle_rebalance,3}

      ,

      {menelaus_web,loop,3}

      ,

      {mochiweb_http,headers,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}]

      1. 10.3.121.182-8091-diag.txt.gz
        724 kB
        Thuan Nguyen
      2. 10.3.121.183-8091-diag.txt.gz
        736 kB
        Thuan Nguyen
      3. 10.3.121.200-8091-diag.txt.gz
        1.46 MB
        Thuan Nguyen
      4. 10.3.121.201-8091-diag.txt.gz
        700 kB
        Thuan Nguyen
      5. 10.3.121.202-8091-diag.txt.gz
        726 kB
        Thuan Nguyen
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        thuan Thuan Nguyen created issue -
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Duplicated somewhere. You need to send rebalance request to 1.8.1 node or wait 10-15 seconds before asking older node for start rebalance.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Duplicated somewhere. You need to send rebalance request to 1.8.1 node or wait 10-15 seconds before asking older node for start rebalance.
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Duplicate [ 3 ]
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        MB-5108
        Rolling upgrade from 172 to latest 181 fails with failed rebalance

        {type,exit}

        , {what,{noproc,

        {gen_fsm,sync_send_event,}

        }}

        Show
        farshid Farshid Ghods (Inactive) added a comment - MB-5108 Rolling upgrade from 172 to latest 181 fails with failed rebalance {type,exit} , {what,{noproc, {gen_fsm,sync_send_event,} }}
        Hide
        dipti Dipti Borkar added a comment -

        Trying rebalance again after waiting for 20 seconds works.

        Show
        dipti Dipti Borkar added a comment - Trying rebalance again after waiting for 20 seconds works.
        dipti Dipti Borkar made changes -
        Labels 1.8.1-release-notes
        farshid Farshid Ghods (Inactive) made changes -
        Summary rebalance failed in online upgrade from 1.7.2 to 1.8.1 on windows rebalance failed with "gen_fsm,sync_send_event," error during online upgrade from 1.7.2 to 1.8.1 on windows ( workaround is to wait 30 seconds between add_node and starting the rebalance )
        farshid Farshid Ghods (Inactive) made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            thuan Thuan Nguyen
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes