c:\jenkins\workspace-net2\sdkdclient-ng>call packages\sdkdclient\bin\brun.bat -I cluster_config.ini -I sdkd.args --variants HYBRID -d all:debug --no-upload [0,14 INFO] (BRun run:435) Initializing history database Will create SASL????true Will create SASL????true Will create SASL????true Will create SASL????true ============================================================ Running Rb2Out-HYBRID rebalance/mode=out workload=HybridWorkloadGroup rebalance/count=2 testcase=RebalanceScenario Logging to c:\jenkins\workspace-net2\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-973\Rb2Out-HYBRID\07-23-14\058445\d6f339676fff4072cb96dd22c1fe0383 To re-run the test, copy/paste the following into the shell. You may also copy/paste (except the first line) into an argfile 8<---------------------------------------- ./stester \ \ --rebalance-mode out --workload HybridWorkloadGroup \ --rebalance-count 2 --testcase RebalanceScenario -C share\rexec \ --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port \ 8675 --cluster_node=10.3.121.134 --cluster_node=10.3.121.135 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase --cluster_useSSL=True ---------------------------------------->8 [1,53 WARN] (Drivers getDriver:76) 'rexec' is now mapped to *local* execution only. Use RemoteExecutingDriver for remote execution Will create SASL????true Will create SASL????true Will create SASL????true Will create SASL????true [1,76 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds. [1,77 INFO] (RunContext run:124) Starting cluster and driver [1,77 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe' [1,77 INFO] (CBCluster startCluster:360) Node http://10.3.121.134:8091 is master now [1,77 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations.. [1,92 INFO] (SDKD log:137) --- Logging Self-Test --- [1,93 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message [1,93 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message [1,93 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message [1,93 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message [1,93 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675 [2,29 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [2,29 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0 [2,40 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":{"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true},"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.34014"}} [8,53 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node [9,10 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node [9,67 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node [10,24 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [10,24 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84] [12,49 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.136:8091 [12,50 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.3.206:8091 [12,51 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.136 [12,51 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.3.206 [12,51 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.134:8091 [12,51 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.134 [12,53 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.135:8091 [12,53 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.135 [13,37 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@3dbafe70 [13,38 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@729c078 [13,38 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@192a9621 [13,40 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@1020c6a5 [13,40 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@9d25dcf [32,12 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.135:8091 [35,40 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.136:8091 [44,05 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.3.206:8091 [49,98 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance [50,96 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete [50,96 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups [51,21 INFO] (CBCluster setupMainBucket:209) Creating bucket default [51,46 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted [58,34 INFO] (CBCluster waitForBucketReady:203) Bucket creation done [61,22 INFO] (RunContext run:143) Driver and cluster initialized [61,48 INFO] (RunContext call:167) Running scenario.. [61,48 INFO] (Scenario run:72) Starting RAMP phase [61,49 INFO] (Workload setupDesign:63) Creating design test_design [62,77 INFO] (Workload setupDesign:80) Design creation done [62,77 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle [62,77 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=true, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134} [62,78 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101 [62,78 INFO] (SDKD log:137) ClientConfiguration!!!!!!!!!!!!{ [62,79 INFO] (SDKD log:137) "Port": 8091, [62,79 INFO] (SDKD log:137) "Bucket": "default", [62,79 INFO] (SDKD log:137) "Options": { [62,79 INFO] (SDKD log:137) "SSL": true, [62,79 INFO] (SDKD log:137) "Username": "default", [62,80 INFO] (SDKD log:137) "Password": "", [62,80 INFO] (SDKD log:137) "OtherNodes": [ [62,80 INFO] (SDKD log:137) [ [62,80 INFO] (SDKD log:137) "10.3.121.135", [62,81 INFO] (SDKD log:137) 8091 [62,81 INFO] (SDKD log:137) ], [62,81 INFO] (SDKD log:137) [ [62,81 INFO] (SDKD log:137) "10.3.121.136", [62,81 INFO] (SDKD log:137) 8091 [62,82 INFO] (SDKD log:137) ], [62,82 INFO] (SDKD log:137) [ [62,82 INFO] (SDKD log:137) "10.3.3.206", [62,82 INFO] (SDKD log:137) 8091 [62,82 INFO] (SDKD log:137) ] [62,83 INFO] (SDKD log:137) ] [62,83 INFO] (SDKD log:137) }, [62,83 INFO] (SDKD log:137) "Hostname": "10.3.121.134" [62,83 INFO] (SDKD log:137) } [62,83 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Creating new shared client for key 'U,P,H10.3.121.134:8091,Bdefault' [62,83 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net [62,84 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e [62,84 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net [62,84 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821 [65,19 INFO] (SDKD log:137) [65,19 INFO] (SDKD log:137) Необработанное исключение: Couchbase.Configuration.ConfigException: Could not bootstrap default. See log for details. [65,19 INFO] (SDKD log:137) в Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:строка 204 [65,20 INFO] (SDKD log:137) в Couchbase.Core.ClusterManager.CreateBucket(String bucketName) в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:строка 137 [65,20 INFO] (SDKD log:137) в Couchbase.CouchbaseCluster.OpenBucket() в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:строка 70 [65,20 INFO] (SDKD log:137) в Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) в c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:строка 78 [65,20 INFO] (SDKD log:137) в Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) в c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:строка 265 [65,20 INFO] (SDKD log:137) в SdkdConsole.Daemon.Handle.CreateHandle(Request req) в c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:строка 84 [65,21 INFO] (SDKD log:137) в SdkdConsole.Daemon.Handle.Run() в c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:строка 103 [65,21 INFO] (SDKD log:137) в System.Threading.ThreadHelper.ThreadStart_Context(Object state) [65,21 INFO] (SDKD log:137) в System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [65,21 INFO] (SDKD log:137) в System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) [65,21 INFO] (SDKD log:137) в System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) [65,21 INFO] (SDKD log:137) в System.Threading.ThreadHelper.ThreadStart() [67,71 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.2 [67,72 WARN] (STester close:170) While stopping driver java.net.SocketException: Connection reset by peer: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.7.0_60] at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.7.0_60] at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.7.0_60] at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.7.0_60] at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.7.0_60] at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:281) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:388) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:472) [sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:504) [sdkdclient-1.0-SNAPSHOT.jar:na] [68,05 ERROR] (BRun main:507) Caught exception com.couchbase.sdkdclient.context.HarnessException: java.net.SocketException: Connection reset at com.couchbase.sdkdclient.context.HarnessException.create(HarnessException.java:56) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.scenario.PhasedScenario.run(PhasedScenario.java:80) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$4.call(RunContext.java:169) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.context.RunContext$4.call(RunContext.java:165) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_60] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_60] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_60] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.7.0_60] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.7.0_60] at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_60] Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(Unknown Source) ~[na:1.7.0_60] at java.net.SocketInputStream.read(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamDecoder.readBytes(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamDecoder.implRead(Unknown Source) ~[na:1.7.0_60] at sun.nio.cs.StreamDecoder.read(Unknown Source) ~[na:1.7.0_60] at java.io.InputStreamReader.read(Unknown Source) ~[na:1.7.0_60] at java.io.BufferedReader.fill(Unknown Source) ~[na:1.7.0_60] at java.io.BufferedReader.readLine(Unknown Source) ~[na:1.7.0_60] at java.io.BufferedReader.readLine(Unknown Source) ~[na:1.7.0_60] at com.couchbase.sdkdclient.handle.Handle.receiveMessage(Handle.java:152) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.sendMessage(Handle.java:173) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.Handle.negotiate(Handle.java:237) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.handle.HandleFactory.createHandle(HandleFactory.java:43) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.workload.ViewWorkload.loadData(ViewWorkload.java:85) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.workload.HybridWorkloadGroup.start(HybridWorkloadGroup.java:82) ~[sdkdclient-1.0-SNAPSHOT.jar:na] at com.couchbase.sdkdclient.scenario.PhasedScenario.run(PhasedScenario.java:78) ~[sdkdclient-1.0-SNAPSHOT.jar:na] ... 8 common frames omitted c:\jenkins\workspace-net2\sdkdclient-ng>^A