Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-20174

4.5.1 CLONE - Online Upgrade From 2.5.0 to Watson failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 4.5.1
    • 3.1.5, 4.1.1, 4.5.0
    • couchbase-bucket
    • Untriaged
    • No

    Description

      Whilst trying to recreate MB-19695 I encountered several rebalance failures

      • Take a 2-node 2.5.0 cluster (ubuntu 12, 1 bucket, 800K docs, <1k ops / sec)
      • Add 2 Watson nodes (build 2585) (successful)
      • Remove original nodes (failed)
        Rebalance failed several times with:

      Rebalance exited with reason {unexpected_exit,
                                    {'EXIT',<0.15842.6>,
                                     {{badmatch,[{<18684.9796.2>,noproc}]},
                                      [{misc,
                                        sync_shutdown_many_i_am_trapping_exits,1,
                                        [{file,"src/misc.erl"},{line,1610}]},
                                       {misc,try_with_maybe_ignorant_after,2,
                                        [{file,"src/misc.erl"},{line,1639}]},
                                       {gen_server,terminate,6,
                                        [{file,"gen_server.erl"},{line,719}]},
                                       {proc_lib,init_p_do_apply,3,
                                        [{file,"proc_lib.erl"},{line,239}]}]}}}
      

      Several rebalances have been run on this cluster. Rebalances at the following times failed:

      • 10:22:25 AM Fri May 20, 2016
      • 10:13:18 AM Fri May 20, 2016
      • 9:58:15 AM Fri May 20, 2016

      Logs here:
      2.5.0 nodes
      https://cb-engineering.s3.amazonaws.com/davidH/2.5.0-node2.zip
      https://cb-engineering.s3.amazonaws.com/davidH/2.5.0-node1.zip
      Watson nodes:
      https://cb-engineering.s3.amazonaws.com/davidH/collectinfo-2016-05-20T103321-ns_1%4010.141.151.101.zip
      https://cb-engineering.s3.amazonaws.com/davidH/collectinfo-2016-05-20T103321-ns_1%4010.141.151.102.zip

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ritam.sharma Ritam Sharma
              ritam.sharma Ritam Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty