Uploaded image for project: 'Couchbase .NET client library'
  1. Couchbase .NET client library
  2. NCBC-592

AuthenticationException in CouchbaseBucket.SendWithRetry

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Test Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0 DP3
    • Fix Version/s: 2.0 Beta
    • Component/s: library
    • Labels:
      None

      Description

      git log
      commit 3fefdd5a17884c01d5113d73db2160bec9eb55db
      Author: jeffrymorris <jeffrymorris@gmail.com>
      Date: Mon Aug 18 22:31:37 2014 -0700

      NCBC-589: ThrowInvalidOperationException in CouchbaseConfigContext.LoadConfig during rebalance

      Change-Id: I813092f07bb6fde414ea4e05a67239173a540568

      commit 732f2dcb72fe53cf7fbce27ac631a302ad9fe178
      Author: jeffrymorris <jeffrymorris@gmail.com>
      Date: Mon Aug 18 22:15:49 2014 -0700

      Check that length is positive in TypeSerializer.Deserialize

      Change-Id: Ic229fbdd0362593ac7577350cc04f549380ac7f5

      commit 5c2c0e3589b5f0099fc8048de8b398c28f6eb04c
      Author: jeffrymorris <jeffrymorris@gmail.com>
      Date: Tue Aug 12 16:48:03 2014 -0700

      NCBC-581: System.InvalidOperationException when server list is empty

      Change-Id: I8fdef46b4057bc9f3b898b789fcccd78f689fdb6
      Reviewed-on: http://review.couchbase.org/40546
      Tested-by: Jeffry Morris <jeffrymorris@gmail.com>
      Reviewed-by: Brett Lawson <brett19@gmail.com>

      commit a132c5f921dcd9aed04d8f0d55dc5ba8ad36dd8e

      C:\jenkins\workspace-net2\sdkdclient-ng>call packages\sdkdclient\bin\brun.bat -I cluster_config.ini -I sdkd.args --variants HYBRID -d all:debug --no-upload
      [0,14 INFO] (BRun run:435) Initializing history database

      ============================================================
      Running Rb2Out-HYBRID
      rebalance/count=2
      workload=HybridWorkloadGroup
      rebalance/mode=out
      testcase=RebalanceScenario
      Logging to C:\jenkins\workspace-net2\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-1105\Rb2Out-HYBRID\08-20-14\025327\b0efa6fcc6ef738b9ac6a2109416adad

      To re-run the test, copy/paste the following into the shell.
      You may also copy/paste (except the first line) into an argfile
      8<----------------------------------------
      ./stester \
      \ --rebalance-count 2 --workload HybridWorkloadGroup
      \ --rebalance-mode out --testcase RebalanceScenario -C share\rexec
      \ --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port
      \ 8675 --cluster_node=10.3.4.144 --cluster_node=10.3.4.145
      \ --cluster_node=10.3.4.146 --cluster_node=10.3.4.147
      --cluster_ssh-username=root --cluster_ssh-password=couchbase
      ---------------------------------------->8
      [1,32 WARN] (Drivers getDriver:76) 'rexec' is now mapped to local execution only. Use RemoteExecutingDriver for remote execution
      [1,61 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds.
      [1,63 INFO] (RunContext run:124) Starting cluster and driver
      [1,63 INFO] (CBCluster startCluster:360) Node http://10.3.4.144:8091 is master now
      [1,63 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations..
      [1,64 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe'
      [1,93 INFO] (SDKD log:137) — Logging Self-Test —
      [1,93 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message
      [1,93 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message
      [1,94 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message
      [1,94 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message
      [1,94 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675
      [2,19 INFO] (SDKD log:137) Call SweepOnce()
      [2,20 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [2,20 INFO] (SDKD log:137) Call SweepOnce()
      [2,20 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0
      [2,21 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [2,32 INFO] (SDKD log:137) Call SweepOnce()
      [2,32 INFO] (SDKD log:137) Call SweepOnce()
      [2,34 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":

      {"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true}

      ,"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.34014"}}
      [8,62 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.4.145:8091,ns_1@10.3.4.145>
      [9,08 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.4.146:8091,ns_1@10.3.4.146>
      [9,52 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.4.147:8091,ns_1@10.3.4.147>
      [10,10 DEBUG] (SSHConnection initUserKeys:79) Loaded indentity C:\Users\Andrei\.ssh\id_rsa
      [10,10 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
      [10,11 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
      [10,11 DEBUG] (SSHConnection initUserKeys:79) Loaded indentity C:\Users\Andrei\.ssh\id_rsa
      [12,30 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.4.144:8091
      [12,31 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.4.146:8091
      [12,31 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.4.145:8091
      [12,32 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.4.147:8091
      [12,36 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.4.145
      [12,36 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.4.147
      [12,36 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.4.146
      [12,36 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.4.144
      [13,07 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@5417c2f
      [13,07 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@65606a8d
      [13,07 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@6653fd5c
      [13,08 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@c890d48
      [13,08 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@994c3c9
      [33,08 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.4.145:8091
      [39,35 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.4.146:8091
      [52,86 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.4.147:8091
      [55,92 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance
      [56,79 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete
      [56,79 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups
      [57,01 INFO] (CBCluster setupMainBucket:209) Creating bucket default
      [57,24 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted
      [66,46 INFO] (CBCluster waitForBucketReady:203) Bucket creation done
      [69,00 INFO] (RunContext run:143) Driver and cluster initialized
      [69,25 INFO] (RunContext call:167) Running scenario..
      [69,25 INFO] (Scenario run:72) Starting RAMP phase
      [69,25 INFO] (Workload setupDesign:63) Creating design test_design
      [70,38 INFO] (Workload setupDesign:80) Design creation done
      [70,39 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [70,39 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [70,39 INFO] (SDKD log:137) Call SweepOnce()
      [70,39 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [70,40 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101
      [70,42 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net
      [70,43 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e
      [70,45 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net
      [70,46 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821
      [78,02 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@101.1
      [78,02 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@101.2 => {Options={DelayMin=0, TimeRes=0, IterWait=1, DelayMax=0}, Schema={InflateLevel=40, InflateContent=meh}, DSType=DSTYPE_SEEDED, DS={KSize=12, KSeed=ViewFillerSeed, VSize=512, VSeed=Vie
      wFillerSeed, Continuous=false, Repeat=rep, Count=1000}}
      [78,03 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CB_VIEW_LOAD
      [78,03 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [78,03 INFO] (SDKD log:137) "Options": { [78,03 INFO] (SDKD log:137) "DelayMin": 0, [78,03 INFO] (SDKD log:137) "TimeRes": 0, [78,04 INFO] (SDKD log:137) "IterWait": 1, [78,04 INFO] (SDKD log:137) "DelayMax": 0 [78,04 INFO] (SDKD log:137) },
      [78,05 INFO] (SDKD log:137) "Schema": { [78,05 INFO] (SDKD log:137) "InflateLevel": 40, [78,05 INFO] (SDKD log:137) "InflateContent": "meh" [78,05 INFO] (SDKD log:137) },
      [78,05 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [78,06 INFO] (SDKD log:137) "DS": { [78,06 INFO] (SDKD log:137) "KSize": 12, [78,07 INFO] (SDKD log:137) "KSeed": "ViewFillerSeed", [78,07 INFO] (SDKD log:137) "VSize": 512, [78,07 INFO] (SDKD log:137) "VSeed": "ViewFillerSeed", [78,08 INFO] (SDKD log:137) "Continuous": false, [78,08 INFO] (SDKD log:137) "Repeat": "rep", [78,08 INFO] (SDKD log:137) "Count": 1000 [78,08 INFO] (SDKD log:137) }
      [78,09 INFO] (SDKD log:137) }
      [230,25 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: {}
      [230,25 DEBUG] (Handle receiveMessage:158) < [SDKD:SDKD_EINVAL="Need at least one kv pair. None requested"] CB_VIEW_LOAD@101.2
      [230,26 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.3
      [230,26 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CLOSEHANDLE
      [230,26 INFO] (Workload call:112) Preloading items into cluster before workload
      [230,26 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {}
      [230,27 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@102.4 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [230,27 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Release CouchbaseBucket -788777045
      [230,27 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Release CouchbaseBucket client.Dispose()-788777045
      [230,27 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [230,27 INFO] (SDKD log:137) Call SweepOnce()
      [230,28 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [230,28 INFO] (SDKD log:137) [Sdkd.Handle|Warn] DispatchCommand(req, SdkHandle) == false
      [230,29 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 102
      [237,18 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@102.4
      [237,18 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@102.5 => {Options=

      {DelayMin=0, TimeRes=0, IterWait=100, DelayMax=0}

      , DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=false, Repeat=REP, Coun
      t=15000}}
      [237,19 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_MUTATE_SET
      [237,19 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [237,20 INFO] (SDKD log:137) "Options":

      { [237,20 INFO] (SDKD log:137) "DelayMin": 0, [237,20 INFO] (SDKD log:137) "TimeRes": 0, [237,20 INFO] (SDKD log:137) "IterWait": 100, [237,21 INFO] (SDKD log:137) "DelayMax": 0 [237,21 INFO] (SDKD log:137) }

      ,
      [237,21 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [237,21 INFO] (SDKD log:137) "DS":

      { [237,22 INFO] (SDKD log:137) "KSize": 32, [237,22 INFO] (SDKD log:137) "KSeed": "SimpleKey", [237,23 INFO] (SDKD log:137) "VSize": 128, [237,23 INFO] (SDKD log:137) "VSeed": "SimpleValue", [237,23 INFO] (SDKD log:137) "Continuous": false, [237,24 INFO] (SDKD log:137) "Repeat": "REP", [237,24 INFO] (SDKD log:137) "Count": 15000 [237,24 INFO] (SDKD log:137) }

      [237,24 INFO] (SDKD log:137) }
      [412,79 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409
      [1734,81 DEBUG] (Handle receiveMessage:158) < MC_DS_MUTATE_SET@102.5 =>

      {[OK]: 14990, [MEMD:GENERIC]: 10}

      [1734,81 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.6
      [1734,81 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command CLOSEHANDLE
      [1734,81 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {}
      [1734,81 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Release CouchbaseBucket 1508015768
      [1734,82 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Release CouchbaseBucket client.Dispose()1508015768
      [1734,82 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@107.11 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,82 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@112.16 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,82 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@108.12 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@110.14 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@111.15 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 INFO] (SDKD log:137) [Sdkd.Handle|Warn] DispatchCommand(req, SdkHandle) == false
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@109.13 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@106.10 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@105.9 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@103.7 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@104.8 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1734,83 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,83 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,84 INFO] (SDKD log:137) Call SweepOnce()
      [1734,84 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,84 INFO] (SDKD log:137) Call SweepOnce()
      [1734,84 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,84 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,85 INFO] (SDKD log:137) Call SweepOnce()
      [1734,85 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,86 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,86 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,86 INFO] (SDKD log:137) Call SweepOnce()
      [1734,86 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,87 INFO] (SDKD log:137) Call SweepOnce()
      [1734,87 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,87 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,88 INFO] (SDKD log:137) Call SweepOnce()
      [1734,88 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,88 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,89 INFO] (SDKD log:137) Call SweepOnce()
      [1734,89 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,89 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,89 INFO] (SDKD log:137) Call SweepOnce()
      [1734,89 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,90 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,90 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 107
      [1734,91 INFO] (SDKD log:137) Call SweepOnce()
      [1734,91 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,91 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1734,91 INFO] (SDKD log:137) Call SweepOnce()
      [1734,92 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1734,92 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 112
      [1734,92 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 108
      [1734,93 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 110
      [1734,93 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 111
      [1734,93 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 105
      [1734,94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 109
      [1734,94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 103
      [1734,94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 106
      [1734,94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 104
      [1741,05 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@107.11
      [1741,10 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@107.17 => {Options=

      {DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}, DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Coun
      t=15000}}
      [1741,10 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_MUTATE_SET
      [1741,11 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1741,11 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@113.18 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1741,11 INFO] (SDKD log:137) "Options": { [1741,11 INFO] (SDKD log:137) "DelayMin": 1, [1741,11 INFO] (SDKD log:137) "TimeRes": 1, [1741,12 INFO] (SDKD log:137) "IterWait": 1, [1741,12 INFO] (SDKD log:137) "DelayMax": 10 [1741,13 INFO] (SDKD log:137) },
      [1741,13 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1741,13 INFO] (SDKD log:137) "DS": { [1741,13 INFO] (SDKD log:137) "KSize": 32, [1741,13 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1741,14 INFO] (SDKD log:137) "VSize": 128, [1741,14 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1741,15 INFO] (SDKD log:137) "Continuous": true, [1741,15 INFO] (SDKD log:137) "Repeat": "REP", [1741,15 INFO] (SDKD log:137) "Count": 15000 [1741,15 INFO] (SDKD log:137) }
      [1741,16 INFO] (SDKD log:137) }
      [1741,16 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1741,16 INFO] (SDKD log:137) Call SweepOnce()
      [1741,16 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1741,17 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 113
      [1746,76 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@112.16
      [1746,76 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@112.19 => {Options={DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}

      , DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Coun
      t=15000}}
      [1746,76 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_MUTATE_SET
      [1746,76 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@114.20 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1746,76 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1746,77 INFO] (SDKD log:137) "Options": { [1746,77 INFO] (SDKD log:137) "DelayMin": 1, [1746,77 INFO] (SDKD log:137) "TimeRes": 1, [1746,77 INFO] (SDKD log:137) "IterWait": 1, [1746,78 INFO] (SDKD log:137) "DelayMax": 10 [1746,78 INFO] (SDKD log:137) },
      [1746,78 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1746,79 INFO] (SDKD log:137) "DS": { [1746,79 INFO] (SDKD log:137) "KSize": 32, [1746,79 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1746,80 INFO] (SDKD log:137) "VSize": 128, [1746,80 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1746,80 INFO] (SDKD log:137) "Continuous": true, [1746,80 INFO] (SDKD log:137) "Repeat": "REP", [1746,80 INFO] (SDKD log:137) "Count": 15000 [1746,81 INFO] (SDKD log:137) }
      [1746,81 INFO] (SDKD log:137) }
      [1746,81 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1746,82 INFO] (SDKD log:137) Call SweepOnce()
      [1746,82 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1746,82 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 114
      [1752,28 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@108.12
      [1752,28 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@108.21 => {Options={DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}, DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Coun
      t=15000}}
      [1752,28 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_MUTATE_SET
      [1752,28 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1752,29 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@115.22 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1752,29 INFO] (SDKD log:137) "Options":

      { [1752,29 INFO] (SDKD log:137) "DelayMin": 1, [1752,29 INFO] (SDKD log:137) "TimeRes": 1, [1752,29 INFO] (SDKD log:137) "IterWait": 1, [1752,30 INFO] (SDKD log:137) "DelayMax": 10 [1752,30 INFO] (SDKD log:137) }

      ,
      [1752,30 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1752,31 INFO] (SDKD log:137) "DS":

      { [1752,31 INFO] (SDKD log:137) "KSize": 32, [1752,31 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1752,31 INFO] (SDKD log:137) "VSize": 128, [1752,32 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1752,32 INFO] (SDKD log:137) "Continuous": true, [1752,32 INFO] (SDKD log:137) "Repeat": "REP", [1752,33 INFO] (SDKD log:137) "Count": 15000 [1752,33 INFO] (SDKD log:137) }

      [1752,33 INFO] (SDKD log:137) }
      [1752,34 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1752,34 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1752,34 INFO] (SDKD log:137) Call SweepOnce()
      [1752,34 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 115
      [1766,32 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@110.14
      [1766,32 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@110.23 => {Options=

      {DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}, DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Coun
      t=15000}}
      [1766,32 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_MUTATE_SET
      [1766,33 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@116.24 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1766,33 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1766,33 INFO] (SDKD log:137) "Options": { [1766,33 INFO] (SDKD log:137) "DelayMin": 1, [1766,33 INFO] (SDKD log:137) "TimeRes": 1, [1766,34 INFO] (SDKD log:137) "IterWait": 1, [1766,34 INFO] (SDKD log:137) "DelayMax": 10 [1766,34 INFO] (SDKD log:137) },
      [1766,35 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1766,35 INFO] (SDKD log:137) "DS": { [1766,35 INFO] (SDKD log:137) "KSize": 32, [1766,35 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1766,36 INFO] (SDKD log:137) "VSize": 128, [1766,36 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1766,36 INFO] (SDKD log:137) "Continuous": true, [1766,37 INFO] (SDKD log:137) "Repeat": "REP", [1766,37 INFO] (SDKD log:137) "Count": 15000 [1766,37 INFO] (SDKD log:137) }
      [1766,37 INFO] (SDKD log:137) }
      [1766,37 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1766,38 INFO] (SDKD log:137) Call SweepOnce()
      [1766,38 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1766,39 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 116
      [1781,73 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@111.15
      [1781,73 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@111.25 => {Options={DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}

      , DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Count=15000
      }}
      [1781,74 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_GET
      [1781,74 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@117.26 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}, Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1781,74 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1781,74 INFO] (SDKD log:137) "Options": { [1781,75 INFO] (SDKD log:137) "DelayMin": 1, [1781,75 INFO] (SDKD log:137) "TimeRes": 1, [1781,75 INFO] (SDKD log:137) "IterWait": 1, [1781,75 INFO] (SDKD log:137) "DelayMax": 10 [1781,76 INFO] (SDKD log:137) },
      [1781,76 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1781,76 INFO] (SDKD log:137) "DS": { [1781,76 INFO] (SDKD log:137) "KSize": 32, [1781,77 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1781,77 INFO] (SDKD log:137) "VSize": 128, [1781,78 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1781,78 INFO] (SDKD log:137) "Continuous": true, [1781,78 INFO] (SDKD log:137) "Repeat": "REP", [1781,78 INFO] (SDKD log:137) "Count": 15000 [1781,79 INFO] (SDKD log:137) }
      [1781,79 INFO] (SDKD log:137) }
      [1781,79 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1781,80 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1781,80 INFO] (SDKD log:137) Call SweepOnce()
      [1781,80 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 117
      [1787,45 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@105.9
      [1787,45 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@105.27 => {Options={DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}, DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Count=15000
      }}
      [1787,45 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_GET
      [1787,46 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@118.28 => {Options={OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1787,46 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1787,47 INFO] (SDKD log:137) "Options":

      { [1787,47 INFO] (SDKD log:137) "DelayMin": 1, [1787,47 INFO] (SDKD log:137) "TimeRes": 1, [1787,47 INFO] (SDKD log:137) "IterWait": 1, [1787,47 INFO] (SDKD log:137) "DelayMax": 10 [1787,48 INFO] (SDKD log:137) }

      ,
      [1787,48 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1787,48 INFO] (SDKD log:137) "DS":

      { [1787,49 INFO] (SDKD log:137) "KSize": 32, [1787,49 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1787,49 INFO] (SDKD log:137) "VSize": 128, [1787,50 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1787,50 INFO] (SDKD log:137) "Continuous": true, [1787,50 INFO] (SDKD log:137) "Repeat": "REP", [1787,50 INFO] (SDKD log:137) "Count": 15000 [1787,51 INFO] (SDKD log:137) }

      [1787,51 INFO] (SDKD log:137) }
      [1787,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1787,52 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1787,52 INFO] (SDKD log:137) Call SweepOnce()
      [1787,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 118
      [1802,48 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@109.13
      [1802,49 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@109.29 => {Options=

      {DelayMin=1, TimeRes=1, IterWait=1, DelayMax=10}

      , DSType=DSTYPE_SEEDED, DS={KSize=32, KSeed=SimpleKey, VSize=128, VSeed=SimpleValue, Continuous=true, Repeat=REP, Count=15000
      }}
      [1802,49 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Got command MC_DS_GET
      [1802,49 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@119.30 => {Options=

      {OtherNodes=[["10.3.4.145",8091],["10.3.4.146",8091],["10.3.4.147",8091]], Username=default, SSL=false, Password=}

      , Bucket=default, Port=8091, Hostname=10.3.4.144}
      [1802,50 INFO] (SDKD log:137) [Sdkd.Handle|Warn] Command data: {
      [1802,50 INFO] (SDKD log:137) "Options":

      { [1802,50 INFO] (SDKD log:137) "DelayMin": 1, [1802,50 INFO] (SDKD log:137) "TimeRes": 1, [1802,51 INFO] (SDKD log:137) "IterWait": 1, [1802,51 INFO] (SDKD log:137) "DelayMax": 10 [1802,51 INFO] (SDKD log:137) }

      ,
      [1802,52 INFO] (SDKD log:137) "DSType": "DSTYPE_SEEDED",
      [1802,52 INFO] (SDKD log:137) "DS":

      { [1802,52 INFO] (SDKD log:137) "KSize": 32, [1802,52 INFO] (SDKD log:137) "KSeed": "SimpleKey", [1802,53 INFO] (SDKD log:137) "VSize": 128, [1802,53 INFO] (SDKD log:137) "VSeed": "SimpleValue", [1802,53 INFO] (SDKD log:137) "Continuous": true, [1802,53 INFO] (SDKD log:137) "Repeat": "REP", [1802,54 INFO] (SDKD log:137) "Count": 15000 [1802,54 INFO] (SDKD log:137) }

      [1802,55 INFO] (SDKD log:137) }
      [1802,55 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
      [1802,55 INFO] (SDKD log:137) !!!!!!!!!!!!!!!
      [1802,55 INFO] (SDKD log:137) Call SweepOnce()
      [1802,55 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 119
      [1812,21 INFO] (SDKD log:137)
      [1812,22 INFO] (SDKD log:137) Unhandle Exception: System.Security.Authentication.AuthenticationException: default
      [1812,22 INFO] (SDKD log:137) at at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) at c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 78
      [1812,22 INFO] (SDKD log:137) at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) at c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 43
      [1812,23 INFO] (SDKD log:137) at Couchbase.Core.Server.Send[T](IOperation`1 operation) at c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 84
      [1812,23 INFO] (SDKD log:137) at Couchbase.Core.Buckets.CouchbaseBucket.SendWithRetry[T](IOperation`1 operation) at c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 98
      [1812,23 INFO] (SDKD log:137) at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) at c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 888
      [1812,23 INFO] (SDKD log:137) at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) at c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 18
      [1812,24 INFO] (SDKD log:137) at Sdkd.Commands.KVCommand.Run() at c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25
      [1812,24 INFO] (SDKD log:137) at SdkdConsole.Daemon.Handle.DispatchCommand(Request req, CouchbaseBucket cli) at c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 235
      [1812,24 INFO] (SDKD log:137) at SdkdConsole.Daemon.Handle.Run() at c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 156
      [1812,24 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
      [1812,25 INFO] (SDKD log:137) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
      [1812,25 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
      [1812,26 INFO] (SDKD log:137) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
      [1812,26 INFO] (SDKD log:137) at System.Threading.ThreadHelper.ThreadStart()
      [1977,47 ERROR] (BRun maybePropagate:237) Suppressing driver-related error
      com.couchbase.sdkdclient.context.HarnessException: java.net.SocketException: Connection reset
      at com.couchbase.sdkdclient.context.HarnessException.create(HarnessException.java:56) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.workload.Workload.makeHandle(Workload.java:91) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.workload.KeyValueWorkload.makeHandleCommon(KeyValueWorkload.java:70) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.workload.KeyValueWorkload.access$200(KeyValueWorkload.java:24) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.workload.KeyValueWorkload$1$1.call(KeyValueWorkload.java:119) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.8.0_11]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.8.0_11]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.8.0_11]
      at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_11]
      Caused by: java.net.SocketException: Connection reset
      at java.net.SocketInputStream.read(Unknown Source) ~[na:1.8.0_11]
      at java.net.SocketInputStream.read(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamDecoder.readBytes(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamDecoder.implRead(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamDecoder.read(Unknown Source) ~[na:1.8.0_11]
      at java.io.InputStreamReader.read(Unknown Source) ~[na:1.8.0_11]
      at java.io.BufferedReader.fill(Unknown Source) ~[na:1.8.0_11]
      at java.io.BufferedReader.readLine(Unknown Source) ~[na:1.8.0_11]
      at java.io.BufferedReader.readLine(Unknown Source) ~[na:1.8.0_11]
      at com.couchbase.sdkdclient.handle.Handle.receiveMessage(Handle.java:152) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.handle.Handle.sendMessage(Handle.java:173) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.handle.Handle.negotiate(Handle.java:237) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.handle.HandleFactory.createHandle(HandleFactory.java:43) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.workload.Workload.makeHandle(Workload.java:89) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      ... 7 common frames omitted
      [1977,55 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.31
      [1977,55 WARN] (STester close:170) While stopping driver
      java.net.SocketException: Connection reset by peer: socket write error
      at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.8.0_11]
      at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.8.0_11]
      at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.8.0_11]
      at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.8.0_11]
      at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.8.0_11]
      at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.8.0_11]
      at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:281) [sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:388) [sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:472) [sdkdclient-1.0-SNAPSHOT.jar:na]
      at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:504) [sdkdclient-1.0-SNAPSHOT.jar:na]

        Attachments

        For Gerrit Dashboard: NCBC-592
        # Subject Branch Project Status CR V

          Activity

          Hide
          jmorris Jeff Morris added a comment -

          This is likely caused by:
          a) missing or deleted bucket - the server will return an authentication error if it cannot locate the bucket.
          b) IO error that's currently being hidden by the AuthenticationException
          c) Bucket name and/or credentials are invalid

          There is nothing I can do for "a" - the server would have to change the message it returns and the test runner may be deleting buckets. For "b", i am working on a patch to handle this - the result may still be an uncaught exception though in SDKD, for "c" that's the domain of the caller to manage.

          I am not sure this would classifiy as a "test blocker" - a test blocker should be a bug (and the same bug) that appears on every run of every test and not intermittently/situation-ally.

          Show
          jmorris Jeff Morris added a comment - This is likely caused by: a) missing or deleted bucket - the server will return an authentication error if it cannot locate the bucket. b) IO error that's currently being hidden by the AuthenticationException c) Bucket name and/or credentials are invalid There is nothing I can do for "a" - the server would have to change the message it returns and the test runner may be deleting buckets. For "b", i am working on a patch to handle this - the result may still be an uncaught exception though in SDKD, for "c" that's the domain of the caller to manage. I am not sure this would classifiy as a "test blocker" - a test blocker should be a bug (and the same bug) that appears on every run of every test and not intermittently/situation-ally.
          Hide
          andreibaranouski Andrei Baranouski added a comment -

          seems like a) and b) are not my cases. the test is performed without any problems for a while, and then fails(bucket is not removed)
          it's reproduced every time with this scenario. will try some other.

          Show
          andreibaranouski Andrei Baranouski added a comment - seems like a) and b) are not my cases. the test is performed without any problems for a while, and then fails(bucket is not removed) it's reproduced every time with this scenario. will try some other.
          Hide
          jmorris Jeff Morris added a comment -

          Andrei -

          Can you describe in words this particular test (I am not a sdkd expert )? Does this specific test fail every time (a good thing actually)?

          My patch when completed, should fix the issue where the client tries to auth against a node that has been removed from the cluster - this causes most of the Auth exceptions.

          Thanks,

          Jeff

          Show
          jmorris Jeff Morris added a comment - Andrei - Can you describe in words this particular test (I am not a sdkd expert )? Does this specific test fail every time (a good thing actually)? My patch when completed, should fix the issue where the client tries to auth against a node that has been removed from the cluster - this causes most of the Auth exceptions. Thanks, Jeff
          Hide
          jmorris Jeff Morris added a comment -

          This where the code failed:
          2014-08-20 10:32:18,479 [21] DEBUG Couchbase.Authentication.SASL.CramMd5Mechanism - Authentication for socket fef9f34e-6c36-42a3-8970-24bd5487a28c failed: Timed out.
          2014-08-20 10:32:18,479 [21] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism - d8041012-7830-45dc-a97c-2b64a0a3215b.

          It "Timed out", which means the remote host failed to respond within the grace period. Likely the server has been ejected from the cluster at that point.

          Show
          jmorris Jeff Morris added a comment - This where the code failed: 2014-08-20 10:32:18,479 [21] DEBUG Couchbase.Authentication.SASL.CramMd5Mechanism - Authentication for socket fef9f34e-6c36-42a3-8970-24bd5487a28c failed: Timed out. 2014-08-20 10:32:18,479 [21] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism - d8041012-7830-45dc-a97c-2b64a0a3215b. It "Timed out", which means the remote host failed to respond within the grace period. Likely the server has been ejected from the cluster at that point.
          Show
          jmorris Jeff Morris added a comment - http://review.couchbase.org/#/c/40772/
          Hide
          andreibaranouski Andrei Baranouski added a comment -

          fixed

          Show
          andreibaranouski Andrei Baranouski added a comment - fixed

            People

            • Assignee:
              andreibaranouski Andrei Baranouski
              Reporter:
              andreibaranouski Andrei Baranouski
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes