Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-30976

FATAL Errors during system test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • 6.0.0
    • 6.0.0
    • analytics
    • Component

    Description

      Build: 6.0.0-1529

      Test Job : http://qa.sc.couchbase.com/job/component_systest_launcher/380/console 

      We run following steps in loop for analytics component test

      • Create 7 node cluster (4 kv , 3 analytics)
      • Create 4 buckets 
      • Load data to all 4 buckets 
      • Create dataset on all bucket
      • Create index on 2 buckets
      • Load more data and run 240 queries throughout the test
      • Connect bucket 
      • Disconnect bucket
      • Add 1 cbas node
      • Connect bucket 
      • Disconnect bucket
      • Remove 1 cbas node
      • Connect bucket 
      • Do swap of cbas node
      • Kill cbas process
      • flush 1 bucket
      • disconnect link
      • drop index, datasets
      • Do swap of cbas node

      While running system test we observed following FATAL errors in the logs , although there no side effects to these errors. If these errors are not actual errors then we should print them as WARN.

      172.23.104.23
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T06:55:24.054-07:00 FATA CBAS.nc.CcConnection [Executor-2755:0d9c03d50e16e16f4d0e626b35b0c34a] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-18T21:26:29.410-07:00 FATA CBAS.nc.CcConnection [Executor-3029:fb33fa403b02ba620328a5afb92b0066] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_info.log.2.gz:2018-08-18T21:26:29.410-07:00 FATA CBAS.nc.CcConnection [Executor-3029:fb33fa403b02ba620328a5afb92b0066] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_info.log.3.gz:2018-08-17T06:55:24.054-07:00 FATA CBAS.nc.CcConnection [Executor-2755:0d9c03d50e16e16f4d0e626b35b0c34a] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-16T20:01:54.617-07:00 FATA CBAS.util.ExitUtil [Stdin Watcher] JVM halting with status 33; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-16T21:27:50.716-07:00 FATA CBAS.util.ExitUtil [Stdin Watcher] JVM halting with status 33; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-17T01:47:25.851-07:00 FATA CBAS.nc.CcConnection [Executor-5083:eb8522f553ea4088d112c9acdde2959f] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-17T01:47:25.878-07:00 FATA CBAS.util.ExitUtil [Stdin Watcher] JVM halting with status 33; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-17T04:22:52.600-07:00 FATA CBAS.util.ExitUtil [Stdin Watcher] JVM halting with status 33; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-17T06:04:42.503-07:00 FATA CBAS.util.ExitUtil [Stdin Watcher] JVM halting with status 33; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_shutdown.log:2018-08-17T06:55:27.496-07:00 FATA CBAS.util.ExitUtil [Executor-2755:0d9c03d50e16e16f4d0e626b35b0c34a] JVM halting with status 15; thread dump at halt:
      		 
       
      		 
       
      		 
       
      		 
       
      		 
       
      		 
      172.23.104.25
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:52.274-07:00 FATA CBAS.nc.CcConnection [Executor-14246:62cadc6a1cc12356040dd1fd06f2b75d] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:53.111-07:00 FATA CBAS.util.ExitUtil [Executor-14246:62cadc6a1cc12356040dd1fd06f2b75d] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:56.600-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:56.632-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:59.167-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:56:59.196-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:01.522-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:01.554-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:03.907-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:03.936-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:06.270-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:06.301-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:08.673-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:08.704-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:11.098-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:11.138-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:13.578-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:13.607-07:00 FATA CBAS.util.ExitUtil [main] JVM halting with status 15; thread dump at halt:
      		 
      /opt/couchbase/var/lib/couchbase/logs/analytics_error.log:2018-08-17T05:57:15.945-07:00 FATA CBAS.nc.CcConnection [main] Registering with ClusterControllerRemoteProxy [/172.23.104.21:9112] failed with exception

       

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-30978 [System test]: Unable to find given hostport

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              vikas.chaudhary Vikas Chaudhary
              vikas.chaudhary Vikas Chaudhary
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty