Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-1283

running simple two node expansion/contraction test with memslap load result in get misses and a2b not_my_vbucket

    XMLWordPrintable

Details

    • Bug
    • Resolution: Incomplete
    • 1.6.0 beta1
    • 1.6.0 beta1
    • moxi
    • None
    • Operating System: CentOS 5.x
      Platform: X64

    Description

      Ran a simple expansion test which does the following

      1) start with a single node

      2) add a new node to the single and rebalance the cluster

      3) remove a the newly added node and rebalance the cluster

      All while this was happening, I was running a simple memslap load against the machines. The expansion/contraction test appeared to complete with out issue (see bottom of the report for details), but the output of memslap showed a2b not my_vbucket errors as well as some get misses
      servers : 10.253.11.144:11211,10.253.30.47:11211
      threads count: 1
      concurrency: 16
      run time: 600s
      windows size: 10k
      set proportion: set_prop=0.10
      get proportion: get_prop=0.90
      <20 SERVER_ERROR a2b not_my_vbucket
      ...
      <7 SERVER_ERROR a2b not_my_vbucket
      <7 SERVER_ERROR a2b not_my_vbucket
      <7 SERVER_ERROR a2b not_my_vbucket
      <7 SERVER_ERROR a2b not_my_vbucket
      cmd_get: 157707
      cmd_set: 17579
      get_misses: 17
      verify_misses: 15
      verify_failed: 0
      written_bytes: 30464285
      read_bytes: 175163363
      object_bytes: 19125952
      [root@domU-12-31-36-00-45-D2 py]# python rebalance_check.py --nodes 10.253.11.144,10.253.30.47 --num_items 1000
      validating node 0: 10.253.11.144
      validating buckets: PASS
      validating items: FEATURE NOT YET IMPLEMENTED

      Here is output of the test

      Adding 10.253.30.47 to 10.253.11.144: ['python', '/opt/NorthScale/bin/cli/membase', 'rebalance', '--cluster=10.253.11.144:8080', '--server-add=10.253.30.47:8080']
      SUCCESS: server added..
      rebalance POST response: SUCCESS: rebalance started..

      SUCCEEDED
      Checking cluster membership...
      10.253.11.144: MATCH
      10.253.30.47: MATCH
      validating buckets: PASS
      validating items: FEATURE NOT YET IMPLEMENTED
      Removing 10.253.30.47 to 10.253.11.144: ['python', '/opt/NorthScale/bin/cli/membase', 'rebalance', '--cluster=10.253.11.144:8080', '--server-remove=10.253.30.47:8080']
      rebalance POST response: SUCCESS: rebalance started..

      SUCCEEDED
      Checking cluster membership...
      10.253.11.144: MATCH
      validating buckets: PASS
      validating items: FEATURE NOT YET IMPLEMENTED

      Logs to be attached

      Attachments

        1. 144.dump
          3.58 MB
          Eric Lambert
        2. 47.dump
          1.42 MB
          Eric Lambert
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sean@northscale.com Sean Lynch (Inactive)
            eric@northscale.com Eric Lambert (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty