Error replacing dead connections on N1QL Failover rebalance

Whilst running a situational test where we perform n1ql queries and perform a failover on 1 of the 3 n1ql nodes and rebalance, there is an issue where the dead connections are not being replaced with this error message:

fail: Couchbase.Core.IO.Connections.DataFlow.DataFlowConnectionPool[0]      Error replacing dead connections for 10.112.194.102:11210.Couchbase.Core.Exceptions.KeyValue.DocumentNotFoundException: Exception of type 'Couchbase.Core.Exceptions.KeyValue.DocumentNotFoundException' was thrown.   at Couchbase.Core.ClusterNode.ExecuteOp(Func`4 sender, IOperation op, Object state, CancellationToken token, Nullable`1 timeout) in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/ClusterNode.cs:line 454   at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.SelectBucketAsync(IConnection connection, String bucketName, CancellationToken cancellationToken) in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/ClusterNode.cs:line 526   at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken) in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/IO/Connections/ConnectionPoolBase.cs:line 72   at Couchbase.Core.IO.Connections.DataFlow.DataFlowConnectionPool.<>c_DisplayClass28_0.<<AddConnectionsAsync>g_StartConnection|0>d.MoveNext() in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/IO/Connections/DataFlow/DataFlowConnectionPool.cs:line 251--- End of stack trace from previous location where exception was thrown --   at Couchbase.Core.IO.Connections.DataFlow.DataFlowConnectionPool.AddConnectionsAsync(Int32 count, CancellationToken cancellationToken) in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/IO/Connections/DataFlow/DataFlowConnectionPool.cs:line 287   at Couchbase.Core.IO.Connections.DataFlow.DataFlowConnectionPool.CleanupDeadConnectionsAsync() in /Users/willbroadbelt/Documents/repos/couchbase/couchbase-net-client/src/Couchbase/Core/IO/Connections/DataFlow/DataFlowConnectionPool.cs:line 358---------------------Context Info--------------------------{{

{"DispatchedFrom":null,"DispatchedTo":null,"DocumentKey":"default","ClientContextId":"2714","Cas":0,"Status":0,"BucketName":"default","CollectionName":null,"ScopeName":null,"Message":"KV Error: \{Name=\"KEY_ENOENT\", Description=\"Not Found\", Attributes=\"item-only\"}

"}}}

 

I've attached the SDK (N1QL_Failover_Rebalance.log) and sdkd (N1QL_Failover_Rebalance_SDKD.log) logs. I believe this issue occurs for other services too.