Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6335

XDCR : Port server memcached on node 'ns_1@10.3.121.32' exited with status 134. on reboot of a node on source cluster.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.0-beta
    • 2.0-beta
    • couchbase-bucket, XDCR
    • Security Level: Public
    • None
    • 2.0-1611 build
      1024 vbuckets
      unidirectional replication

    Description

      Setup
      -Create a unidirectional replication between two clusters (2:5 node) on a saslbucket.
      -Loading 6-7M items on source cluster
      -Create 7 views on destination cluster. Wait for initial index building to be complete

      • Create 7 views on source cluster.
        -Reboot source non-master node(10.3.121.32), wait for it to warmup

      Error.
      Port server memcached on node 'ns_1@10.3.121.32' exited with status 134. Restarting. Messages: 3203 3: TAP (Producer)

      Port server memcached on node 'ns_1@10.3.121.32' exited with status 134. Restarting. Messages: 3203 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3209 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3215 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3221 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3227 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3234 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3240 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3246 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3252 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3258 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3264 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs
      3270 3: TAP (Producer) eq_tapq:replication_ns_1@10.3.121.31 - Suspend for 5.00 secs

      The rebooted node(10.3.121.32) is in pending state

      84176 [error_logger:error,2012-08-20T16:41:01.797,ns_1@10.3.121.32:error_logger:ale_error_logger_handler:log_report:72]
      84177 =========================CRASH REPORT=========================
      84178 crasher:
      84179 initial call: xdc_vbucket_rep:init/1
      84180 pid: <0.1781.4>
      84181 registered_name: []
      84182 exception exit: badmatch,{0,[],
      84183 [

      {xdc_vbucket_rep,init_replication_state,4}

      ,
      84184

      {xdc_vbucket_rep,init,1}

      ,
      84185

      {gen_server,init_it,6}

      ,
      84186

      {proc_lib,init_p_do_apply,3}

      ]}
      84187 in function gen_server:init_it/6
      84188 ancestors: [<0.669.4>,<0.665.4>,xdc_replication_sup,ns_server_sup,
      84189 ns_server_cluster_sup,<0.60.0>]
      84190 messages: [src_db_updated]
      84191 links: [<0.1782.4>,<0.1805.4>,<0.669.4>]
      84192 dictionary: []
      84193 trap_exit: false
      84194 status: running
      84195 heap_size: 75025
      84196 stack_size: 24
      84197 reductions: 16750
      84198 neighbours:
      84199 neighbour: [

      {pid,<0.1805.4>}

      ,
      84200

      {registered_name,[]},
      84201 {initial_call,{lhttpc_manager,init,['Argument__1']}},
      84202 {current_function,{gen_server,loop,6}},
      84203 {ancestors,[<0.1781.4>,<0.669.4>,<0.665.4>, 84204 xdc_replication_sup,ns_server_sup, 84205 ns_server_cluster_sup,<0.60.0>]},
      84206 {messages,[]},
      84207 {links,[<0.1781.4>,#Port<0.421927>]},
      84208 {dictionary,[]},
      84209 {trap_exit,false},
      84210 {status,waiting},
      84211 {heap_size,610},
      84212 {stack_size,9},
      84213 {reductions,466}]
      84214 neighbour: [{pid,<0.1782.4>},
      84215 {registered_name,[]}

      ,
      84216 {initial_call,{lhttpc_manager,init,['Argument__1']}},
      84217 {current_function,{gen_server,loop,6}},
      84218

      {ancestors,[<0.1781.4>,<0.669.4>,<0.665.4>, 84219 xdc_replication_sup,ns_server_sup, 84220 ns_server_cluster_sup,<0.60.0>]}

      ,
      84221

      {messages,[]}

      ,
      84222

      {links,[<0.1781.4>,#Port<0.421903>]}

      ,
      84165,54 63%
      Seeing no cores on the node.

      Adding logs from ns-server.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ketaki Ketaki Gangal (Inactive)
            ketaki Ketaki Gangal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty