Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6493

Rebalance exits with reason "timeout, ns_memcached-bucket','ns_1@10.1.3.238'}, {get_vbucket,". Successive attempts to rebalance also fail.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0-beta
    • Fix Version/s: 2.0-beta
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None
    • Environment:
      vBuckets: 1024
      Env: Centos 64bit

      Description

      • Create a 2:2 cluster.
      • Setup unidirectional replication of 2M items
      • Rebalance out one of the destination nodes

      Example scenario:
      Source: 10.1.3.236, 10.3.2.54
      Destination: 10.1.3.238, 10.3.2.55
      Rebalance out 10.3.2.55

      Towards the end of rebalancing on the destination, rebalance fails with the following reason:
      Rebalance exited with reason {timeout,
      {gen_server,call,
      [

      {'ns_memcached-bucket','ns_1@10.1.3.238'}

      ,

      {get_vbucket,749}

      ,
      60000]}}

      1. 10.1.3.236-8091-diag.txt.gz
        1.62 MB
        Abhinav Dangeti
      2. 10.1.3.238-8091-diag.txt.gz
        5.45 MB
        Abhinav Dangeti
      3. 10.3.2.54-8091-diag.txt.gz
        10.30 MB
        Abhinav Dangeti
      4. 10.3.2.55-8091-diag.txt.gz
        5.45 MB
        Abhinav Dangeti
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        abhinav Abhinav Dangeti created issue -
        junyi Junyi Xie (Inactive) made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        junyi Junyi Xie (Inactive) made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        junyi Junyi Xie (Inactive) made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Duplicate [ 3 ]
        junyi Junyi Xie (Inactive) made changes -
        Resolution Duplicate [ 3 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        junyi Junyi Xie (Inactive) made changes -
        Comment [ Same issue as MB-6468
        ]
        farshid Farshid Ghods (Inactive) made changes -
        Fix Version/s 2.0-beta [ 10113 ]
        Affects Version/s 2.0-beta [ 10113 ]
        Affects Version/s 2.0 [ 10114 ]
        junyi Junyi Xie (Inactive) made changes -
        Assignee Junyi Xie [ junyi ] Abhinav Dangeti [ abhinav ]
        abhinav Abhinav Dangeti made changes -
        Comment [ Both ns_server and memcached seem to have crashed, aliaksey can you please take a look at this? ]
        abhinav Abhinav Dangeti made changes -
        Assignee Abhinav Dangeti [ abhinav ] Aleksey Kondratenko [ alkondratenko ]
        ketaki Ketaki Gangal made changes -
        Summary Rebalance fails when rebalancing out a destination node with ongoing unidirectional replication Rebalance exits with reason "timeout, ns_memcached-bucket','ns_1@10.1.3.238'}, {get_vbucket,". Successive attempts to rebalance also fail.
        Affects Version/s 2.0-beta [ 10113 ]
        Priority Major [ 3 ] Blocker [ 1 ]
        Component/s ns_server [ 10019 ]
        Component/s cross-datacenter-replication [ 10136 ]
        farshid Farshid Ghods (Inactive) made changes -
        Assignee Aleksey Kondratenko [ alkondratenko ] Ketaki Gangal [ ketaki ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Assignee Ketaki Gangal [ ketaki ] Junyi Xie [ junyi ]
        junyi Junyi Xie (Inactive) made changes -
        Assignee Junyi Xie [ junyi ] Peter Wansch [ peter ]
        junyi Junyi Xie (Inactive) made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Duplicate [ 3 ]
        farshid Farshid Ghods (Inactive) made changes -
        Assignee Peter Wansch [ peter ] Ketaki Gangal [ ketaki ]
        farshid Farshid Ghods (Inactive) made changes -
        Resolution Duplicate [ 3 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        farshid Farshid Ghods (Inactive) made changes -
        Assignee Ketaki Gangal [ ketaki ] Aleksey Kondratenko [ alkondratenko ]
        junyi Junyi Xie (Inactive) made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        peter peter made changes -
        Resolution Won't Fix [ 2 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        alkondratenko Aleksey Kondratenko (Inactive) made changes -
        Assignee Aleksey Kondratenko [ alkondratenko ] Damien Katz [ damien ]
        damien damien made changes -
        Assignee Damien Katz [ damien ] Abhinav Dangeti [ abhinav ]
        ketaki Ketaki Gangal made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        farshid Farshid Ghods (Inactive) made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        farshid Farshid Ghods (Inactive) made changes -
        Resolution Fixed [ 1 ]
        Status Closed [ 6 ] Reopened [ 4 ]
        Sprint Status Current Sprint
        farshid Farshid Ghods (Inactive) made changes -
        Status Reopened [ 4 ] Closed [ 6 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            abhinav Abhinav Dangeti
            Reporter:
            abhinav Abhinav Dangeti
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes