Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50516

[System Test] - ERROR: _ - Failed to update distribution configuration file. Failed to start the following required listeners: "TCP-IPv4" while enabling n2n encryption

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Minor
    • Neo.next
    • 6.6.5
    • ns_server
    • 6.6.5-10076
    • Untriaged
    • Centos 64-bit
    • 1
    • Unknown

    Description

      Script to Repro
      1. Run 6.6.5 longevity test for 5-6 days.

      ./sequoia -client 172.23.104.254:2375 -provider file:centos_second_cluster.yml -test tests/integration/test_allFeatures_madhatter_durability.yml -scope tests/integration/scope_Xattrs_Madhatter.yml -scale 3 -repeat 0 -log_level 0 -version 6.6.5-10076 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
      

      2. Enforce TLS.

      Balakumarans-MacBook-Pro-2:logs balakumaran.g$ ssh root@172.23.120.73
      root@172.23.120.73's password: 
      Last login: Thu Jan 20 23:27:17 2022 from 172.23.104.76
      -bash: warning: setlocale: LC_CTYPE: cannot change locale (UTF-8): No such file or directory
      [root@localhost ~]# curl -v -u Administrator:password -X POST http://localhost:8091/internalSettings -d "canEnableStrictEncryption=true"
      * About to connect() to localhost port 8091 (#0)
      *   Trying ::1...
      * Connected to localhost (::1) port 8091 (#0)
      * Server auth using Basic with user 'Administrator'
      > POST /internalSettings HTTP/1.1
      > Authorization: Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==
      > User-Agent: curl/7.29.0
      > Host: localhost:8091
      > Accept: */*
      > Content-Length: 30
      > Content-Type: application/x-www-form-urlencoded
      > 
      * upload completely sent off: 30 out of 30 bytes
      < HTTP/1.1 200 OK
      < X-XSS-Protection: 1; mode=block
      < X-Permitted-Cross-Domain-Policies: none
      < X-Frame-Options: DENY
      < X-Content-Type-Options: nosniff
      < Server: Couchbase Server
      < Pragma: no-cache
      < Expires: Thu, 01 Jan 1970 00:00:00 GMT
      < Date: Fri, 21 Jan 2022 07:27:52 GMT
      < Content-Type: application/json
      < Content-Length: 2
      < Cache-Control: no-cache,no-store,must-revalidate
      < 
      * Connection #0 to host localhost left intact
      []
      

      On this step when we enable n2n encryption we see error - Failed to update distribution configuration file. Failed to start the following required listeners: "TCP-IPv4".

      [root@localhost ~]# /opt/couchbase/bin/couchbase-cli node-to-node-encryption -c http://localhost:8091 -u Administrator -p password --enable
      Turned on encryption for node: http://172.23.106.134:8091
      Turned on encryption for node: http://172.23.106.136:8091
      Turned on encryption for node: http://172.23.120.58:8091
      Turned on encryption for node: http://172.23.120.73:8091
      Turned on encryption for node: http://172.23.120.74:8091
      Turned on encryption for node: http://172.23.120.75:8091
      Turned on encryption for node: http://172.23.120.77:8091
      Turned on encryption for node: http://172.23.120.81:8091
      Turned on encryption for node: http://172.23.120.86:8091
      Turned on encryption for node: http://172.23.121.77:8091
      Turned on encryption for node: http://172.23.123.25:8091
      Turned on encryption for node: http://172.23.123.26:8091
      Turned on encryption for node: http://172.23.123.31:8091
      Turned on encryption for node: http://172.23.123.32:8091
      Turned on encryption for node: http://172.23.123.33:8091
      Turned on encryption for node: http://172.23.96.122:8091
      Turned on encryption for node: http://172.23.96.243:8091
      Turned on encryption for node: http://172.23.96.254:8091
      Turned on encryption for node: http://172.23.96.48:8091
      Turned on encryption for node: http://172.23.97.105:8091
      Turned on encryption for node: http://172.23.97.110:8091
      Turned on encryption for node: http://172.23.97.112:8091
      Turned on encryption for node: http://172.23.97.148:8091
      Turned on encryption for node: http://172.23.97.149:8091
      Turned on encryption for node: http://172.23.97.150:8091
      Turned on encryption for node: http://172.23.97.241:8091
      Turned on encryption for node: http://172.23.97.74:8091
      ERROR: _ - Failed to update distribution configuration file. Failed to start the following required listeners: "TCP-IPv4"
      

      [root@localhost ~]# curl -v -u Administrator:password http://localhost:8091/settings/security -d "clusterEncryptionLevel=strict"
      * About to connect() to localhost port 8091 (#0)
      *   Trying ::1...
      * Connected to localhost (::1) port 8091 (#0)
      * Server auth using Basic with user 'Administrator'
      > POST /settings/security HTTP/1.1
      > Authorization: Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==
      > User-Agent: curl/7.29.0
      > Host: localhost:8091
      > Accept: */*
      > Content-Length: 29
      > Content-Type: application/x-www-form-urlencoded
      > 
      * upload completely sent off: 29 out of 29 bytes
      < HTTP/1.1 200 OK
      < X-XSS-Protection: 1; mode=block
      < X-Permitted-Cross-Domain-Policies: none
      < X-Frame-Options: DENY
      < X-Content-Type-Options: nosniff
      < Server: Couchbase Server
      < Pragma: no-cache
      < Expires: Thu, 01 Jan 1970 00:00:00 GMT
      < Date: Fri, 21 Jan 2022 07:46:28 GMT
      < Content-Type: application/json
      < Content-Length: 2
      < Cache-Control: no-cache,no-store,must-revalidate
      < 
      * Connection #0 to host localhost left intact
      []
      

      I was able to set clusterEncryptionLevel to strict. So a benign error maybe ?
      Also noticed somewhat of a similar message in MB-37476.

      cbcollect_info atttached.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Abhijeeth.Nuthan Abhijeeth Nuthan
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty