Details
-
Bug
-
Resolution: Fixed
-
Blocker
-
2.0
-
Security Level: Public
-
Build 2.0-1516
Ubuntu
1024 vbuckets,
Unidirectional xdcr between two clusters from bucket default to default.[3:3 node clusters]
Description
Setup:
1.Setup a unidirectional replication from source cluster to destination cluster on bucket "default".( same name at source/ destination)
2. Load ~60k data on the source
Output
------------
1. On the destination node, Memcached losing connection intermittently with message "disconnected ..function clause"
2. Data is being replicated as expected, but all the servers are losing memcached connection and are in pending state.
- Seeing no core files on any servers. Please let me know if
Output from logs
---------------------
2012-07-30 09:55:46.724 ns_orchestrator:1:info:message(ns_1@10.3.121.31) - Rebalance completed successfully.
2012-07-30 09:56:11.076 mb_master:0:info:message(ns_1@10.3.121.31) - I'm the only node, so I'm the master. (repeated 1 times)
2012-07-30 09:56:12.575 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds.
2012-07-30 09:56:13.010 menelaus_web:12:info:message(ns_1@10.3.121.31) - Created bucket "default" of type: membase
[
,
,
,
,
]
2012-07-30 09:56:13.540 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
2012-07-30 09:56:13.592 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.
2012-07-30 10:00:33.985 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause
2012-07-30 10:00:34.829 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
2012-07-30 10:00:52.213 ns_memcached:4:info:message(ns_1@10.3.121.32) - Control connection to memcached on 'ns_1@10.3.121.32' disconnected: function_clause
2012-07-30 10:00:53.055 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds.
2012-07-30 10:00:58.016 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause
2012-07-30 10:00:58.835 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.
2012-07-30 10:01:11.065 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds. (repeated 26 times)
2012-07-30 10:01:11.065 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause (repeated 39 times)
2012-07-30 10:01:11.786 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause
2012-07-30 10:01:12.291 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
2012-07-30 10:01:38.852 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds. (repeated 6 times)
2012-07-30 10:01:38.852 ns_memcached:4:info:message(ns_1@10.3.121.32) - Control connection to memcached on 'ns_1@10.3.121.32' disconnected: function_clause (repeated 7 times)
2012-07-30 10:01:45.900 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds. (repeated 18 times)
2012-07-30 10:01:45.900 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause (repeated 21 times)
2012-07-30 10:01:47.763 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause
2012-07-30 10:01:48.273 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.
Attaching the logs from the servers.