Critical Description
Running ReAdd2-HYBRID: 2014-08-29 22:29:07
[701.03 INFO] (CBCluster failoverNodes:588) Failing over <URI:10.3.121.135:8091,ns_1@10.3.121.135>
[701.03 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/failOver
[701.57 INFO] (CBCluster failoverNodes:588) Failing over <URI:10.3.121.136:8091,ns_1@10.3.121.136>
[701.59 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/failOver
[701.88 INFO] (FailoverAction change:104) Nodes failed over. Requested sleep for 45 seconds
[703.78 INFO] (SDKD log:137)
[703.80 INFO] (SDKD log:137) Unhandled Exception: System.NotSupportedException: The BeginRead method cannot be called when another
read operation is pending.
[703.91 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409
[703.91 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409
[703.91 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 1
[703.91 INFO] (SDKD log:137) at System.Net.Security._SslStream.ProcessRead(Byte[] buffer, Int32 offset, Int32 count, AsyncProto
colRequest asyncRequest)
at System.Net.Security._SslStream.BeginRead(Byte[] buffer, Int32 offset, Int32 count, AsyncCallback asyncCallback, Object async
State)
at System.Net.Security.SslStream.BeginRead(Byte[] buffer, Int32 offset, Int32 count, AsyncCallback asyncCallback, Object asyncS
tate)
at Couchbase.IO.Strategies.SslConnection.SendCallback(IAsyncResult asyncResult) in c:\jenkins\workspace\.net-sdkdclient-ng2-and
rei\couchbase-net-client\Src\Couchbase\IO\Strategies\SslConnection.cs:line 73
at System.Net.LazyAsyncResult.Complete(IntPtr userToken)
at System.Net.LazyAsyncResult.ProtectedInvokeCallback(Object result, IntPtr userToken)
at System.Net.Security._SslStream.StartWriting(Byte[] buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)
at System.Net.Security._SslStream.WriteCallback(IAsyncResult transportResult)
at System.Net.LazyAsyncResult.Complete(IntPtr userToken)
at System.Net.ContextAwareResult.CompleteCallback(Object state)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boo
lean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean pre
serveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Net.ContextAwareResult.Complete(IntPtr userToken)
at System.Net.LazyAsyncResult.ProtectedInvokeCallback(Object result, IntPtr userToken)
at System.Net.Sockets.BaseOverlappedAsyncResult.CompletionPortCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nat
iveOverlapped)
at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVE
RLAP)
[703.93 INFO] (SDKD log:137)
[703.93 INFO] (SDKD log:137) Unhandled Exception: System.NotSupportedException: The BeginRead method cannot be called when another
read operation is pending.
[703.93 INFO] (SDKD log:137) +++ Received exception of ID 0
[703.93 INFO] (SDKD log:137)
[703.93 INFO] (SDKD log:137) Unhandled Exception:
[703.93 INFO] (SDKD log:137) System.NullReferenceException: Object reference not set to an instance of an object.
[703.96 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 3
[703.96 INFO] (SDKD log:137) at Couchbase.IO.Converters.AutoByteConverter.ToByte(Byte[] buffer, Int32 offset) in c:\jenkins\wor
kspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Converters\AutoByteConverter.cs:line 36
at Couchbase.IO.Operations.OperationBase`1.Read(Byte[] buffer, Int32 offset, Int32 length) in c:\jenkins\workspace\.net-sdkdcli
ent-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Operations\OperationBase'.cs:line 96
at Couchbase.IO.Strategies.SslConnection.ReceiveCallback(IAsyncResult asyncResult) in c:\jenkins\workspace\.net-sdkdclient-ng2-
andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\SslConnection.cs:line 88
at System.Net.LazyAsyncResult.Complete(IntPtr userToken)
at System.Net.LazyAsyncResult.ProtectedInvokeCallback(Object result, IntPtr userToken)
at System.Net.Security._SslStream.StartFrameBody(Int32 readBytes, Byte[] buffer, Int32 offset, Int32 count, AsyncProtocolReques
t asyncRequest)
at System.Net.Security._SslStream.ReadHeaderCallback(AsyncProtocolRequest asyncRequest)
at System.Net.AsyncProtocolRequest.CompleteRequest(Int32 result)
at System.Net.FixedSizeReader.CheckCompletionBeforeNextRead(Int32 bytes)
at System.Net.FixedSizeReader.ReadCallback(IAsyncResult transportResult)
at System.Net.LazyAsyncResult.Complete(IntPtr userToken)
at System.Net.ContextAwareResult.CompleteCallback(Object state)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boo
lean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean pre
serveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Net.ContextAwareResult.Complete(IntPtr userToken)
at System.Net.LazyAsyncResult.ProtectedInvokeCallback(Object result, IntPtr userToken)
at System.Net.Sockets.BaseOverlappedAsyncResult.CompletionPortCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nat
iveOverlapped)
at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVE
RLAP)
[703.98 INFO] (SDKD log:137)
[746.88 INFO] (FailoverAction doNextAction:68) Readding nodes after failover
[746.88 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/reAddNode
[746.89 TRACE] (CouchbaseAdmin getResponseJson:167) POST http://10.3.121.134:8091/controller/reAddNode