Uploaded image for project: 'Couchbase .NET client library'
  1. Couchbase .NET client library
  2. NCBC-1709

Intermittently (about 1 out of 5 tests), when 2 nodes are removed and re-balanced, then KV throughput drops significantly

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.5.12
    • None
    • None
    • 1

    Description

      When 2 nodes are removed and rebalanced, KV throughput drops from about 1600 to 80

      Attachments

        1. netlog.zip
          11.13 MB
        2. netlog-passed.zip
          13.25 MB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Ascending order - Click to sort in descending order
          jaekwon.park Jae Park [X] (Inactive) added a comment - - edited

          Attatched sdklog (netlog.zip) and this is graph output
          http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-5.0.0-xxxx/Rb2Out-HYBRID/06-08-18/068569/24672115f355047497840bc6f9df85b8-MC.html
          Test was done against spock (5.0) GA but this happens on 4.5 and 4.6 as well.
          SDK branch is release25 commit 688ffffd98f2137266052093a617b94d5b2dce25

          Expected graph output looks like this http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-5.0.0-xxxx/Rb2Out-HYBRID/06-08-18/067299/d129b91b4d580af91541cce58dfe73a0-MC.html

          jaekwon.park Jae Park [X] (Inactive) added a comment - - edited Attatched sdklog (netlog.zip) and this is graph output http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-5.0.0-xxxx/Rb2Out-HYBRID/06-08-18/068569/24672115f355047497840bc6f9df85b8-MC.html Test was done against spock (5.0) GA but this happens on 4.5 and 4.6 as well. SDK branch is release25 commit 688ffffd98f2137266052093a617b94d5b2dce25 Expected graph output looks like this http://sdk-testresults.couchbase.com.s3.amazonaws.com/SDK-SDK/CB-5.0.0-xxxx/Rb2Out-HYBRID/06-08-18/067299/d129b91b4d580af91541cce58dfe73a0-MC.html
          jaekwon.park Jae Park [X] (Inactive) added a comment -

          Attached netlog-passed.zip which is SDK log for passed case

          jaekwon.park Jae Park [X] (Inactive) added a comment - Attached netlog-passed.zip which is SDK log for passed case
          jmorris Jeff Morris added a comment -

          It appears the latency is related to retries because of NMV - in the "passed" logs they clear up after rebound, on the test that failed they continue until the end of the test.

          jmorris Jeff Morris added a comment - It appears the latency is related to retries because of NMV - in the "passed" logs they clear up after rebound, on the test that failed they continue until the end of the test.

          People

            jmorris Jeff Morris
            jaekwon.park Jae Park [X] (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty