Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-39165

[Collections] - Compactor daemon exits and doesn't recover while running collection tests

    XMLWordPrintable

Details

    Description

      Script to Repro

      ./testrunner -i /tmp/win10-bucket-ops.ini sdk_client_pool=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_graceful_failover_rebalance_out,nodes_init=5,nodes_failover=2,replicas_for_failover=3,override_spec_params=durability;replicas,durability=MAJORITY,replicas=Bucket.ReplicaNum.TWO,bucket_spec=multi_bucket.buckets_for_rebalance_tests,data_load_stage=during
      

      Steps to Repro
      1. Created a 5 node cluster (172.23.104.186, 172.23.120.201, 172.23.121.10, 172.23.98.195, 172.23.98.196)
      2. Create 3 buckets default, bucket1 and bucket2(ephemeral)
      3. Create 100 collections on default , 6 on bucket1 and bucket 2

      After completing collections being created successfully. I see the following exits on .196 continuously and the buckets are in warmup state forever.

      Compactor for database `default` (pid [{type,database},
      {important,true},
      {name,<<"default">>},
      {fa,
      {#Fun<compaction_daemon.4.9063353>,
      [<<"default">>,
      {config,
      {30,undefined},
      {30,undefined},
      undefined,false,false,
      {daemon_config,30,131072,20971520}},
      false,
      {[{type,bucket}]}]}}]) terminated unexpectedly: {timeout,
      {gen_server,
      call,
      [{'ns_memcached-default',
      'ns_1@172.23.98.196'},
      {raw_stats,
      <<"diskinfo">>,
      #Fun<compaction_daemon.18.9063353>,
      {<<"0">>,
      <<"0">>}},
      180000]}} 
      

      cbcollect_info attached.

      Attachments

        1. connections.png
          329 kB
          James Harrison
        2. cpu_usage.png
          382 kB
          James Harrison
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Balakumaran.Gopal Balakumaran Gopal
            Balakumaran.Gopal Balakumaran Gopal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty