Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46040

[System Test] status 500 returned by completeJoin REST API : Join completion call failed - Unexpected server error, request logged

    XMLWordPrintable

Details

    Description

      Build : 7.0.0-5057
      Test : -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale : 3
      Day : 1
      Iteration : 1st

      This is similar to MB-45204.

      Seeing the following in the error log of 172.23.108.103 when trying to add 172.23.105.107 to the cluster.

      [cluster:error,2021-04-29T12:38:17.748-07:00,ns_1@172.23.108.103:ns_cluster<0.244.0>:ns_cluster:node_add_transaction_finish:1064]Add transaction of 'ns_1@172.23.105.107' failed because of {error,
                                                                  complete_join,
                                                                  <<"Join completion call failed. Got HTTP status 500 from REST call post to https://172.23.105.107:18091/completeJoin. Body was: \"[\\\"Unexpected server error, request logged.\\\"]\"">>}
      

      Can see the following in the debug log on 172.23.105.107

      =========================NOTICE REPORT=========================
      {net_kernel,{net_kernel,1054,nodedown,'couchdb_ns_1@cb.local'}}
      [ns_server:debug,2021-04-29T12:38:17.067-07:00,ns_1@172.23.105.107:<0.14678.53>:ns_server_nodes_sup:do_wait_link_to_couchdb_node:164]ns_couchdb is not ready: {badrpc,nodedown}
      [ns_server:info,2021-04-29T12:38:17.072-07:00,ns_1@172.23.105.107:ns_couchdb_port<0.6290.0>:ns_port_server:log:218]ns_couchdb<0.6290.0>: [os_mon] memory supervisor port (memsup): Erlang has closed
      ns_couchdb<0.6290.0>: [os_mon] cpu supervisor port (cpu_sup): Erlang has closed
       
      [error_logger:info,2021-04-29T12:38:17.145-07:00,ns_1@172.23.105.107:<0.14913.53>:ale_error_logger_handler:do_log:101]
      =========================NOTICE REPORT=========================
      TLS server: In state certify received CLIENT ALERT: Fatal - Unknown CA
       
      [error_logger:error,2021-04-29T12:38:17.145-07:00,ns_1@172.23.105.107:cb_dist<0.14183.53>:ale_error_logger_handler:do_log:101]cb_dist: received EXIT from <0.14843.53>, reason: {error,
                                                         {tls_alert,
                                                          {unknown_ca,
                                                           "TLS server: In state certify received CLIENT ALERT: Fatal - Unknown CA\n"}}}
      [error_logger:error,2021-04-29T12:38:17.145-07:00,ns_1@172.23.105.107:cb_dist<0.14183.53>:ale_error_logger_handler:do_log:101]cb_dist: Restart acceptor for {external,inet_tls_dist}
      [error_logger:info,2021-04-29T12:38:17.162-07:00,ns_1@172.23.105.107:<0.14914.53>:ale_error_logger_handler:do_log:101]
      =========================NOTICE REPORT=========================
      TLS server: In state certify received CLIENT ALERT: Fatal - Unknown CA
       
      [error_logger:error,2021-04-29T12:38:17.162-07:00,ns_1@172.23.105.107:cb_dist<0.14183.53>:ale_error_logger_handler:do_log:101]cb_dist: received EXIT from <0.14916.53>, reason: {error,
                                                         {tls_alert,
                                                          {unknown_ca,
                                                           "TLS server: In state certify received CLIENT ALERT: Fatal - Unknown CA\n"}}}
      [error_logger:error,2021-04-29T12:38:17.163-07:00,ns_1@172.23.105.107:cb_dist<0.14183.53>:ale_error_logger_handler:do_log:101]cb_dist: Restart acceptor for {external,inet_tls_dist}
      [error_logger:info,2021-04-29T12:38:17.175-07:00,ns_1@172.23.105.107:<0.14740.53>:ale_error_logger_handler:do_log:101]
      

      Marking this as a regression since this issue was already fixed in MB-45204.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              timofey.barmin Timofey Barmin
              mihir.kamdar Mihir Kamdar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty