Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-5108

Rolling upgrade from 172 to latest 181 fails with failed rebalance {type,exit}, {what,{noproc, {gen_fsm,sync_send_event,}}}

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.8.1-release-candidate
    • Fix Version/s: 1.8.1
    • Component/s: ns_server
    • Security Level: Public
    • Environment:
      Ubuntu 10.04

      Description

      Failing test
      upgradetests.MultipleNodeUpgradeTests.test_upgrade,initial_version=1.7.2,create_buckets=True,insert_data=True,start_upgraded_first=False,load_ratio=10,online_upgrade=True

      2012-04-18 05:05:23,369 - root - INFO - adding node : 10.3.121.92:8091 to the cluster
      2012-04-18 05:05:23,370 - root - INFO - adding remote node : 10.3.121.92 to this cluster @ : 10.3.121.98
      2012-04-18 05:05:24,121 - root - INFO - added node : ns_1@10.3.121.92 to the cluster
      2012-04-18 05:05:24,134 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.3.121.94%2Cns_1%4010.3.121.92%2Cns_1%4010.3.121.98%2Cns_1%4010.3.121.93%2Cns_1%4010.3.121.97%2Cns_1%4010.3.121.95
      2012-04-18 05:05:24,140 - root - ERROR - http://10.3.121.98:8091/controller/rebalance error 500 reason: unknown ["Unexpected server error, request logged."]
      2012-04-18 05:05:24,140 - root - ERROR - rebalance operation failed

      INFO REPORT <0.6440.0> 2012-04-18 05:06:53
      ===============================================================================

      ns_log: logging menelaus_web:19:Server error during processing: ["web request failed",

      {path,"/controller/rebalance"}

      ,

      {type,exit}

      ,
      {what,
      {noproc,
      {gen_fsm,sync_send_event,
      [

      {global,ns_orchestrator}

      ,

      {start_rebalance, ['ns_1@10.3.121.94','ns_1@10.3.121.92', 'ns_1@10.3.121.98','ns_1@10.3.121.93', 'ns_1@10.3.121.97','ns_1@10.3.121.95'], [],[]}

      ]}}},
      {trace,
      [

      {gen_fsm,sync_send_event,2}

      ,

      {menelaus_web,do_handle_rebalance,3}

      ,

      {menelaus_web,loop,3}

      ,

      {mochiweb_http,headers,5}

      ,

      {proc_lib,init_p_do_apply,3}

      ]}]

      1. 10.3.121.92-8091-diag.txt.gz
        218 kB
        Karan Kumar
      2. 10.3.121.93-8091-diag.txt.gz
        331 kB
        Karan Kumar
      3. 10.3.121.94-8091-diag.txt.gz
        335 kB
        Karan Kumar
      4. 10.3.121.95-8091-diag.txt.gz
        333 kB
        Karan Kumar
      5. 10.3.121.97-8091-diag.txt.gz
        330 kB
        Karan Kumar
      6. 10.3.121.98-8091-diag.txt.gz
        347 kB
        Karan Kumar
      7. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.92-diag.txt.gz
        162 kB
        Karan Kumar
      8. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.93-diag.txt.gz
        295 kB
        Karan Kumar
      9. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.94-diag.txt.gz
        297 kB
        Karan Kumar
      10. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.95-diag.txt.gz
        312 kB
        Karan Kumar
      11. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.97-diag.txt.gz
        306 kB
        Karan Kumar
      12. 1cdc7aec-3cf0-4614-bcbf-1902c99b111f-10.3.121.98-diag.txt.gz
        315 kB
        Karan Kumar
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        karan Karan Kumar (Inactive) created issue -
        karan Karan Kumar (Inactive) made changes -
        Field Original Value New Value
        Priority Major [ 3 ] Blocker [ 1 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        farshid Farshid Ghods (Inactive) made changes -
        Labels 1.8.1-release-notes
        karan Karan Kumar (Inactive) made changes -
        Resolution Won't Fix [ 2 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        karan Karan Kumar (Inactive) made changes -
        Attachment 10.3.121.92-8091-diag.txt.gz [ 12902 ]
        Attachment 10.3.121.93-8091-diag.txt.gz [ 12903 ]
        Attachment 10.3.121.94-8091-diag.txt.gz [ 12904 ]
        Attachment 10.3.121.95-8091-diag.txt.gz [ 12905 ]
        Attachment 10.3.121.97-8091-diag.txt.gz [ 12906 ]
        Attachment 10.3.121.98-8091-diag.txt.gz [ 12907 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        farshid Farshid Ghods (Inactive) made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            alkondratenko Aleksey Kondratenko (Inactive)
            Reporter:
            karan Karan Kumar (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews