Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46198

[System Test][Eventing]Service 'eventing' exited with status 1 - observed in longevity

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Yes

    Description

      7.0.0-5127

      Test:
      -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale 3
      Iteration 1

      .104.137:

      021-05-08T02:10:47.421-07:00, ns_node_disco:4:info:node up(ns_1@172.23.123.28) - Node 'ns_1@172.23.123.28' saw that node 'ns_1@172.23.104.137' came up. Tags: [] (repeated 1 times, last seen 72.922375 secs ago)
      		 
      2021-05-08T02:15:56.643-07:00, ns_log:0:info:message(ns_1@172.23.104.137) - Service 'eventing' exited with status 1. Restarting. Messages:
      		 
      2021-05-08T02:15:52.282-07:00 [Info] serviceChangeNotifier: received PoolChangeNotification
      		 
      2021-05-08T02:15:53.177-07:00 [Info] serviceChangeNotifier: received PoolChangeNotification
      		 
      2021-05-08T02:15:56.636-07:00 [Error] Supervisor::gocbConnectCluster Connect to cluster couchbase://172.23.104.5:11210,172.23.106.100:11210,172.23.108.103:11210,172.23.96.148:11210,172.23.97.119:11210,172.23.97.121:11210,172.23.97.122:11210,172.23.97.239:11210,172.23.99.20:11210,172.23.99.21:11210,172.23.99.25:11210 failed, err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"WaitUntilReady","Opaque":"","TimeObserved":5000201774,"RetryReasons":["NOT_READY"],"RetryAttempts":6,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""}
      		 
      2021-05-08T02:15:56.636-07:00 [Info] [gocb] Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
      		 
      2021-05-08T02:15:56.637-07:00 [Error] SuperSupervisor::NewSupervisor Terminating due to not being able to initialise gocb pool after 60 retries error: retry timeout
      		 
       
      		 
      2021-05-08T02:32:39.212-07:00, ns_cluster:1:info:message(ns_1@172.23.121.3) - Node 'ns_1@172.23.121.3' is leaving cluster.
      		 
      2021-05-08T02:32:39.303-07:00, ns_orchestrator:0:info:message(ns_1@172.23.108.103) - Rebalance completed successfully.
      		 
      Rebalance Operation Id = e9117cbaa94fbc28134c1a71c92526ad

      Logs:
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.137.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.155.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.157.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.5.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.67.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.69.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.104.70.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.106.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.106.188.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.108.103.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.120.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.121.117.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.121.3.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.123.27.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.123.28.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.96.148.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.96.251.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.96.252.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.96.253.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.97.119.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.97.121.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.97.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.97.239.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.97.242.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.98.135.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.99.11.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.99.20.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.99.21.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1620467912/collectinfo-2021-05-08T095835-ns_1%40172.23.99.25.zip

      Attachments

        For Gerrit Dashboard: MB-46198
        # Subject Branch Project Status CR V
        153207,3 MB-46198: Don't wait for bootstrap to finish for cluster object unstable eventing Status: MERGED +2 +1

        Activity

          People

            arunkumar Arunkumar Senthilnathan (Inactive)
            arunkumar Arunkumar Senthilnathan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty