Uploaded image for project: 'C++ Couchbase Client'
  1. C++ Couchbase Client
  2. CXXCBC-59

TLS verification fails with certificate verify failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 1.0.0-beta
    • 1.0.0-beta
    • None
    • None
    • 1

    Description

      TLS verification fails even though the certificate is valid. The same certificate validates using cur.

      couchbases://172.23.111.130?trust_certificate=/home/couchbase/jenkins/workspace/c-cpp/cxx/cxx-scripted-build-pipeline/certs/ca.pem

      http://sdk.jenkins.couchbase.com/job/c-cpp/job/cxx/job/cxx-scripted-build-pipeline/258/console

      Test project /home/couchbase/jenkins/workspace/c-cpp/cxx/cxx-scripted-build-pipeline/ws_centos7/couchbase-cxx-client/cmake-build-tests
            Start  1: integration: bucket management
       1/56 Test  #1: integration: bucket management ...................................Subprocess aborted***Exception:  10.02 sec
      [2021-12-07 12:03:37.360] [16826,16826] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460]: use TLS certificate chain: "/home/couchbase/jenkins/workspace/c-cpp/cxx/cxx-scripted-build-pipeline/certs/ca.pem"
      [2021-12-07 12:03:37.361] [16826,16826] [debug] 1ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:37.361] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:37.379] [16826,16827] [warning] 18ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:37.379] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:37.379] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "592b836e-b2c3-4d3d-2d93-7d9030d95b78" -> "8ec742ab-767e-4568-8d11-ca68b3bf5fd9", host="172.23.111.130", port=11207
      [2021-12-07 12:03:37.379] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:37.880] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:37.880] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:37.890] [16826,16827] [warning] 10ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:37.890] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:37.890] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "8ec742ab-767e-4568-8d11-ca68b3bf5fd9" -> "1355b4d5-129d-416d-b6aa-27347539d723", host="172.23.111.130", port=11207
      [2021-12-07 12:03:37.891] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:38.391] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:38.391] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:38.397] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:38.397] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:38.398] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "1355b4d5-129d-416d-b6aa-27347539d723" -> "28e63359-57b5-4d60-061b-46922dc73408", host="172.23.111.130", port=11207
      [2021-12-07 12:03:38.398] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:38.898] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:38.898] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:38.905] [16826,16827] [warning] 7ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:38.905] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:38.905] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "28e63359-57b5-4d60-061b-46922dc73408" -> "5464e8c1-15fa-4646-1350-441efae0efff", host="172.23.111.130", port=11207
      [2021-12-07 12:03:38.905] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:39.405] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:39.406] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:39.412] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:39.412] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:39.412] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "5464e8c1-15fa-4646-1350-441efae0efff" -> "faed8680-bdbf-4f93-64a4-dd25e473f474", host="172.23.111.130", port=11207
      [2021-12-07 12:03:39.412] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:39.913] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:39.913] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:39.919] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:39.919] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:39.920] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "faed8680-bdbf-4f93-64a4-dd25e473f474" -> "7d4e8727-0423-4e2e-2f8f-5ec676689914", host="172.23.111.130", port=11207
      [2021-12-07 12:03:39.920] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:40.420] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:40.420] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:40.431] [16826,16827] [warning] 10ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:40.431] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:40.431] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "7d4e8727-0423-4e2e-2f8f-5ec676689914" -> "18336d13-1d93-4819-8542-3402e5b6ff52", host="172.23.111.130", port=11207
      [2021-12-07 12:03:40.431] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:40.931] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:40.931] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:40.937] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:40.937] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:40.938] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "18336d13-1d93-4819-8542-3402e5b6ff52" -> "755a8142-fe3e-41d2-33be-ed81d481ebdc", host="172.23.111.130", port=11207
      [2021-12-07 12:03:40.938] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:41.438] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:41.438] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:41.444] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:41.444] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:41.444] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "755a8142-fe3e-41d2-33be-ed81d481ebdc" -> "3e2de9e0-d26a-49cf-379a-895ca8d0090a", host="172.23.111.130", port=11207
      [2021-12-07 12:03:41.444] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:41.944] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:41.945] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:41.951] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:41.951] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:41.951] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "3e2de9e0-d26a-49cf-379a-895ca8d0090a" -> "05222caa-1a0d-4ab1-9655-a157159a937f", host="172.23.111.130", port=11207
      [2021-12-07 12:03:41.951] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:42.451] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:42.451] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:42.461] [16826,16827] [warning] 9ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:42.461] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:42.461] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "05222caa-1a0d-4ab1-9655-a157159a937f" -> "63a94c7f-3832-451b-e936-687adb51222a", host="172.23.111.130", port=11207
      [2021-12-07 12:03:42.461] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:42.961] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:42.961] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:42.967] [16826,16827] [warning] 5ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:42.967] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:42.967] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "63a94c7f-3832-451b-e936-687adb51222a" -> "da8e4a50-54a9-4a65-a65a-d1645eef647d", host="172.23.111.130", port=11207
      [2021-12-07 12:03:42.967] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:43.468] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:43.468] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:43.474] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:43.474] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:43.475] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "da8e4a50-54a9-4a65-a65a-d1645eef647d" -> "fc0a57b0-cedf-492b-bd7f-96dd4467644e", host="172.23.111.130", port=11207
      [2021-12-07 12:03:43.475] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:43.975] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:43.975] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:43.983] [16826,16827] [warning] 8ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:43.983] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:43.983] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "fc0a57b0-cedf-492b-bd7f-96dd4467644e" -> "5b80dd16-5fe7-4370-342e-5cf992a15593", host="172.23.111.130", port=11207
      [2021-12-07 12:03:43.983] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:44.483] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:44.484] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:44.490] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:44.490] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:44.490] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "5b80dd16-5fe7-4370-342e-5cf992a15593" -> "4b7b122f-56fc-47a1-cb8f-8c69ae0bfe2d", host="172.23.111.130", port=11207
      [2021-12-07 12:03:44.490] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:44.990] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:44.990] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:44.997] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:44.997] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:44.997] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "4b7b122f-56fc-47a1-cb8f-8c69ae0bfe2d" -> "8ea179d2-5670-48b5-5a2e-8d57a861c0b7", host="172.23.111.130", port=11207
      [2021-12-07 12:03:44.997] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:45.497] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:45.497] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:45.504] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:45.504] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:45.504] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "8ea179d2-5670-48b5-5a2e-8d57a861c0b7" -> "783ed36d-0890-4404-a855-37813a244631", host="172.23.111.130", port=11207
      [2021-12-07 12:03:45.504] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:46.004] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:46.004] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:46.011] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:46.011] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:46.011] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "783ed36d-0890-4404-a855-37813a244631" -> "a9031d25-609f-41d4-402d-e5b15d7ce582", host="172.23.111.130", port=11207
      [2021-12-07 12:03:46.011] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:46.511] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:46.511] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:46.518] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:46.518] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:46.518] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "a9031d25-609f-41d4-402d-e5b15d7ce582" -> "bcce6223-8dcd-47f5-ca58-b72f663c785f", host="172.23.111.130", port=11207
      [2021-12-07 12:03:46.518] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:47.018] [16826,16827] [debug] 500ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> attempt to establish MCBP connection
      [2021-12-07 12:03:47.018] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> connecting to 172.23.111.130:11207
      [2021-12-07 12:03:47.025] [16826,16827] [warning] 6ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to connect to 172.23.111.130:11207: 336134278 (certificate verify failed). is_open=true
      [2021-12-07 12:03:47.025] [16826,16827] [error] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> no more endpoints left to connect, will try another address
      [2021-12-07 12:03:47.025] [16826,16827] [trace] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reopen socket connection "bcce6223-8dcd-47f5-ca58-b72f663c785f" -> "b7ef4781-da64-40bb-1ef0-4dac68b904d7", host="172.23.111.130", port=11207
      [2021-12-07 12:03:47.025] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> reached the end of list of bootstrap nodes, waiting for 500ms before restart
      [2021-12-07 12:03:47.361] [16826,16827] [warning] 335ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> unable to bootstrap in time
      [2021-12-07 12:03:47.361] [16826,16827] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> stop MCBP connection, reason=do_not_retry
      [2021-12-07 12:03:47.361] [16826,16827] [warning] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> use_count=4
      [2021-12-07 12:03:47.361] [16826,16826] [critical] 0ms, unable to connect to the cluster: unambiguous_timeout, nodes="172.23.111.130:11207"
      [2021-12-07 12:03:47.361] [16826,16826] [debug] 0ms, [6b0c971e-5b73-47fd-98ec-56f6d61ee460/d0203eb3-866f-4ecd-29e7-0cb2e297aa6e/tls/-] <172.23.111.130:11207> destroy MCBP connection
      terminate called without an active exception
      Filters: integration: bucket management
      

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            avsej Sergey Avseyev
            jake.rawsthorne Jake Rawsthorne
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes