Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7919

[windows] Rebalance exited with reason {bulk_set_vbucket_state_failed, {timeout, when data mutation is in progress

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • Blocker
    • 2.1.0
    • 2.0.1
    • ns_server
    • Security Level: Public
    • 2.0.1-179-rel on EC2

    Description

      Rebalance exited with below reason when data mutation is in progress with rebalance

      {{bulk_set_vbucket_state_failed,
      [{'ns_1@10.142.85.118',
      {'EXIT',
      {{{timeout,

      Test to repro:
      nohup ./testrunner -i win-aws.ini -t rebalance.rebalancein.RebalanceInTests.incremental_rebalance_in_with_ops,replicas=2,items=100000,doc_ops=update &

      The test failed at 2013-03-15 20:53:08 and the info.18 log file at the orchestrator nodes has the logs. Below crash reports can be seen.

      =========================CRASH REPORT=========================
      crasher:
      initial call: ns_single_vbucket_mover:mover/6
      pid: <0.32365.663>
      registered_name: []
      exception exit: {{{timeout,
      {gen_server,call,
      [<21714.30742.56>,
      {start_vbucket_filter_change,

      =========================CRASH REPORT=========================
      crasher:
      initial call: ns_single_vbucket_mover:mover/6
      pid: <0.32167.663>
      registered_name: []
      exception exit: {{{timeout,
      {gen_server,call,
      [<21714.30742.56>,
      {start_vbucket_filter_change,

      =========================CRASH REPORT=========================
      crasher:
      initial call: ns_single_vbucket_mover:mover/6
      pid: <0.31877.663>
      registered_name: []
      exception exit: {unexpected_exit,
      {'EXIT',<0.48.664>,
      {{wait_checkpoint_persisted_failed,"default",853,4,
      [{'ns_1@10.142.85.118',
      {'EXIT',
      {{{timeout,
      {gen_server,call,
      [<21714.30742.56>,
      {start_vbucket_filter_change,

      Attaching the testrunner logs and collect_info.zip.

      I executed the same test again and it passed so this is not consistently reproducible.

      Attachments

        1. ebucketmigrator_srv.beam
          39 kB
        2. nohup.out.rebalance_timeout
          1.25 MB
        3. ns_memcached.beam
          50 kB
        4. ns_replicas_builder.beam
          9 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            alkondratenko Aleksey Kondratenko (Inactive)
            deepkaran.salooja Deepkaran Salooja
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty