Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44754

[System Test][ERRO] (GOCBCORE) Someone preempted the config update, skipping update

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.0.0
    • Cheshire-Cat
    • fts
    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.0.0-4603

      Test: -test tests/fts/cheshire-cat/test_fts_clusterops_cheshire_cat_coll_crud.yml -scope tests/fts/cheshire-cat/scope_fts_cheshire_cat.yml
      Test Cycle: 1

      In the test,

      • there are 5 buckets, out of which 20 static fts indexes are created on collections of 3 buckets. Mutations are going on these collections
      • For the collections on other 2 buckets, we create and drop indexes and no mutations are going on these collections.
      • Continuously run queries on the indexes of collections of bucket1 and bucket2
      • wait for 15 mins
      • kill cbft on 172.23.97.217 and wait for 15 mins
      • stop all mutations and wait for 10 mins
      • add fts node 172.23.107.4 and start rebalance and wait for 15 mins
      • stop create index loop on bucket4 and bucket5
      • wait for rebalance to complete
      • Once rebalance is complete, kill cbft on 172.23.107.5 and wait for 15 mins
      • start mutations on the collections of bucket1, bucket2 and buckt3
      • wait for 2 mins and rebalance to remove node 172.23.97.232 and wait for 5 mins
      • kill memcached on 172.23.97.237 and wait for 15 mins
      • Add data node 172.23.97.232 and rebalance and wait for 10 mins. Rebalance failed with: MB-44752
      • Kill cbft on 172.23.97.217 and wait for 15 mins
      • rebalance out fts node : 172.23.97.216, which failed with MB-44752
      • Swap rebalance fts. Add:  172.23.107.4 and  remove : 172.23.97.216. Seeing below messages in fts logs.

       

      172.23.107.2 : fts
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.3.gz:2021-03-04T09:39:22.179-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
       
      		 
      172.23.107.5 : fts
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.1.gz:2021-03-04T10:51:40.037-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.2.gz:2021-03-04T08:59:29.535-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.4.gz:2021-03-04T06:05:32.086-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
       
      		 
      172.23.97.216 : fts
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.3.gz:2021-03-04T05:00:40.126-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
       
      		 
      172.23.97.227 : fts
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log:2021-03-04T11:23:49.733-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log:2021-03-04T11:28:02.635-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log:2021-03-04T11:50:33.842-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log:2021-03-04T11:51:16.429-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625
      		 
      /opt/couchbase/var/lib/couchbase/logs/fts.log.1.gz:2021-03-04T09:24:28.974-08:00 [ERRO] (GOCBCORE) Someone preempted the config update, skipping update -- cbgt.GocbcoreLogger.Log() at gocbcore_utils.go:625

      Logs:

               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.107.2.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.107.3.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.107.4.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.107.5.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.215.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.216.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.217.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.227.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.232.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.235.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.236.zip
               url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1614887985/collectinfo-2021-03-04T195946-ns_1%40172.23.97.237.zip

      Attachments

        Issue Links

          depends on

          Task - A task that needs to be done. GOCBC-1068 Drop log level for when a config update is preempted

          • Major - Major loss of function.
          • Resolved
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              girish.benakappa Girish Benakappa
              girish.benakappa Girish Benakappa
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty