Error replicating vbucket XX: {badmatch, {error,timeout}} on a bidirectional replication setup.

-Load 40M items on cluster1, 2M items on cluster2

• Setup a bidirectional replication between 2 clusters.
• No front end load on either cluster , after loading the intial data.

-After replicating 1.8M items , cluster2 replication shows errors w/ Badmatch timeout on serveral vbuckets.

• On cluster1, seeing replication errors as "Failed to grab remote bucket info from any of known nodes" after replicating 25M items.

Adding logs.

Adding screenshots from both clusters.