Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55876

[System Test] Failed to initialize metadata provider error seen

    XMLWordPrintable

Details

    • Bug
    • Resolution: Not a Bug
    • Critical
    • 7.2.0
    • 7.2.0
    • secondary-index
    • 7.2.0-5232
    • Untriaged
    • 0
    • Unknown

    Description

      Build :7.2.0-5232
      Test : -test tests/2i/neo/test_neo_idx_clusterops_recovery.yml -scope tests/2i/neo/scope_neo_plasma_idx_dgm.yml
      Scale : 3

      Seen on 172.23.106.171, 172.23.106.30, 172.23.97.108, 172.23.97.109

      172.23.105.122 : index
      /opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2023-03-07T06:59:49.393-08:00 [Error] DDLServiceMgr: Failed to start metadata provider.  Internal Error = DDLServiceMgr:handleCreateCommand: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2023-03-07T07:14:03.244-08:00 [Error] DDLServiceMgr: Failed to start metadata provider.  Internal Error = DDLServiceMgr:handleCreateCommand: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.
       
      172.23.106.171 : index
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T07:36:32.636-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T07:40:54.443-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2023-03-07T06:26:32.339-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2023-03-07T06:31:47.139-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2023-03-07T07:05:27.062-08:00 [Error] DDLServiceMgr: Failed to start metadata provider.  Internal Error = DDLServiceMgr:handleCreateCommand: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.
       
      172.23.106.30 : index
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T07:12:49.923-08:00 [Error] DDLServiceMgr: Failed to start metadata provider.  Internal Error = DDLServiceMgr:handleCreateCommand: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.
       
      172.23.97.108 : index
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T06:33:18.196-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
       
      172.23.97.109 : index
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T06:28:46.127-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T07:28:56.496-08:00 [Error] DDLServiceMgr::cleanupTokens: newMetadataProvider returned error: DDLServiceMgr::cleanupTokens:: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.. Skipping cleanup.
      /opt/couchbase/var/lib/couchbase/logs/indexer.log:2023-03-07T07:32:06.003-08:00 [Error] DDLServiceMgr: Failed to start metadata provider.  Internal Error = DDLServiceMgr:handleCreateCommand: Failed to initialize metadata provider.  Unable to connect to all indexer nodes within 30 seconds.
      

      cbcollect logs: 
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.105.122.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.106.171.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.106.30.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.96.198.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.96.230.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.96.245.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.97.100.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.97.108.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.97.109.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.97.66.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1678204382/collectinfo-2023-03-07T155304-ns_1%40172.23.97.67.zip
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavan.pb Pavan PB
            pavan.pb Pavan PB
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty