Jeelan Poola: Personally, I consider this pretty serious and I agree with you that some users are likely to see this when rebalance upgrading.
I don't think there is anything we should do on the SDKs to compensate for the defect in
MB-38978 though. There would be unintended consequences. Also, we have a large amount of documentation about handling timeouts and any app developer needs to already handle timeouts. They are sort of a fact of life when working with a distributed system that you're using for operational (a.k.a. expected to be interactive and fast) purposes. You wouldn't expect this to happen during routine maintenance, such as gathering telemetry for support. But that's why it's a bug to be fixed.
I'll take two actions here:
1) Open a bug to release note this on Couchbase Server, since that's where the issue is and the tool that triggers this and
2) Comment over on
MB-38978 and chat with Daniel Owen