Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-4394

memcached crash while rebalancing 15 nodes with 30M items (FATAL: Object returned from mccouch with CAS == 0)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 2.0
    • Fix Version/s: 2.0
    • Component/s: couchbase-bucket
    • Security Level: Public
    • Labels:
      None
    • Environment:
      centos 5.4 64 bit on ecs

      Description

      create a cluster of 10 node couchbase server 2.0.0r-177
      Load 30 million items to cluster so that reach about 85% resident.
      Keep the load runing and add 5 more nodes 2.0.0r-177
      Rebalance cluster. Failed.

      1. core.memcached.1420.log
        15 kB
        Thuan Nguyen
      2. core.memcached.21045.log
        14 kB
        Thuan Nguyen
      3. core.memcached.2406.log
        17 kB
        Thuan Nguyen
      4. core.memcached.2408.log
        15 kB
        Thuan Nguyen
      5. core.memcached.2422.log
        15 kB
        Thuan Nguyen

        Activity

        thuan Thuan Nguyen created issue -
        thuan Thuan Nguyen made changes -
        Field Original Value New Value
        Priority Blocker [ 1 ] Critical [ 2 ]
        farshid Farshid Ghods (Inactive) made changes -
        Summary memcached crashed during rebalance memcached crash while rebalancing 15 nodes with 30M items (FATAL: Object returned from mccouch with CAS == 0)
        dustin Dustin Sallings (Inactive) made changes -
        Assignee Trond Norbye [ trond ] Dustin Sallings [ dustin ]
        dustin Dustin Sallings (Inactive) made changes -
        Assignee Dustin Sallings [ dustin ] Farshid Ghods [ farshid ]
        farshid Farshid Ghods (Inactive) made changes -
        Assignee Farshid Ghods [ farshid ] Thuan Nguyen [ thuan ]
        thuan Thuan Nguyen made changes -
        Attachment core.memcached.2406.log [ 11799 ]
        Attachment core.memcached.2408.log [ 11800 ]
        Attachment core.memcached.2422.log [ 11801 ]
        thuan Thuan Nguyen made changes -
        Assignee Thuan Nguyen [ thuan ] Dustin Sallings [ dustin ]
        farshid Farshid Ghods (Inactive) made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Duplicate [ 3 ]
        peter peter made changes -
        Component/s bucket-engine [ 10010 ]
        Component/s memcached-bucket(default-engine) [ 10015 ]
        farshid Farshid Ghods (Inactive) made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        maria Maria McDuff (Inactive) made changes -
        Component/s couchbase-bucket [ 10173 ]
        Component/s bucket-engine [ 10010 ]

          People

          • Assignee:
            dustin Dustin Sallings (Inactive)
            Reporter:
            thuan Thuan Nguyen
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes