Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6052

Control connection to memcached on server disconnected: function_clause, during unidirectional replication load from cluster1 to cluster2.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 2.0
    • 2.0
    • XDCR
    • Security Level: Public
    • Build 2.0-1516
      Ubuntu
      1024 vbuckets,
      Unidirectional xdcr between two clusters from bucket default to default.[3:3 node clusters]

    Description

      Setup:

      1.Setup a unidirectional replication from source cluster to destination cluster on bucket "default".( same name at source/ destination)
      2. Load ~60k data on the source

      Output
      ------------
      1. On the destination node, Memcached losing connection intermittently with message "disconnected ..function clause"
      2. Data is being replicated as expected, but all the servers are losing memcached connection and are in pending state.

      • Seeing no core files on any servers. Please let me know if

      Output from logs
      ---------------------

      2012-07-30 09:55:46.724 ns_orchestrator:1:info:message(ns_1@10.3.121.31) - Rebalance completed successfully.

      2012-07-30 09:56:11.076 mb_master:0:info:message(ns_1@10.3.121.31) - I'm the only node, so I'm the master. (repeated 1 times)
      2012-07-30 09:56:12.575 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds.
      2012-07-30 09:56:13.010 menelaus_web:12:info:message(ns_1@10.3.121.31) - Created bucket "default" of type: membase
      [

      {num_replicas,1}

      ,

      {replica_index,false}

      ,

      {ram_quota,2097152000}

      ,

      {auth_type,sasl}

      ,

      {autocompaction,false}

      ]
      2012-07-30 09:56:13.540 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
      2012-07-30 09:56:13.592 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.
      2012-07-30 10:00:33.985 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause
      2012-07-30 10:00:34.829 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
      2012-07-30 10:00:52.213 ns_memcached:4:info:message(ns_1@10.3.121.32) - Control connection to memcached on 'ns_1@10.3.121.32' disconnected: function_clause
      2012-07-30 10:00:53.055 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds.
      2012-07-30 10:00:58.016 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause
      2012-07-30 10:00:58.835 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.
      2012-07-30 10:01:11.065 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds. (repeated 26 times)
      2012-07-30 10:01:11.065 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause (repeated 39 times)
      2012-07-30 10:01:11.786 ns_memcached:4:info:message(ns_1@10.3.121.31) - Control connection to memcached on 'ns_1@10.3.121.31' disconnected: function_clause
      2012-07-30 10:01:12.291 ns_memcached:1:info:message(ns_1@10.3.121.31) - Bucket "default" loaded on node 'ns_1@10.3.121.31' in 0 seconds.
      2012-07-30 10:01:38.852 ns_memcached:1:info:message(ns_1@10.3.121.32) - Bucket "default" loaded on node 'ns_1@10.3.121.32' in 0 seconds. (repeated 6 times)
      2012-07-30 10:01:38.852 ns_memcached:4:info:message(ns_1@10.3.121.32) - Control connection to memcached on 'ns_1@10.3.121.32' disconnected: function_clause (repeated 7 times)
      2012-07-30 10:01:45.900 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds. (repeated 18 times)
      2012-07-30 10:01:45.900 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause (repeated 21 times)
      2012-07-30 10:01:47.763 ns_memcached:4:info:message(ns_1@10.3.121.33) - Control connection to memcached on 'ns_1@10.3.121.33' disconnected: function_clause
      2012-07-30 10:01:48.273 ns_memcached:1:info:message(ns_1@10.3.121.33) - Bucket "default" loaded on node 'ns_1@10.3.121.33' in 0 seconds.

      Attaching the logs from the servers.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ketaki Ketaki Gangal (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty