Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7618

Excessive compactions are scheduled during rebalance

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.0.1
    • 2.0.1
    • ns_server
    • Security Level: Public
    • None

    Description

      I see that during rebalance compactions may be scheduled several time during a single second:

      [ns_server:info,2013-01-28T18:51:24.017,n_0@10.17.36.71:<0.27018.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:24.022,n_0@10.17.36.71:<0.27021.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:24.023,n_0@10.17.36.71:<0.27021.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:24.024,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:24.025,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:24.622,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:24.623,n_0@10.17.36.71:<0.27025.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:24.624,n_0@10.17.36.71:<0.27025.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:<0.27028.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:<0.27028.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:24.627,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:25.467,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:25.476,n_0@10.17.36.71:<0.27030.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:25.477,n_0@10.17.36.71:<0.27030.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:25.479,n_0@10.17.36.71:<0.27033.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:25.479,n_0@10.17.36.71:<0.27033.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:25.480,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:25.480,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:25.491,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:25.493,n_0@10.17.36.71:<0.27034.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:25.494,n_0@10.17.36.71:<0.27034.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:<0.27037.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:<0.27037.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s

      Attachments

        For Gerrit Dashboard: MB-7618
        # Subject Branch Project Status CR V

        Activity

          People

            Aliaksey Artamonau Aliaksey Artamonau (Inactive)
            Aliaksey Artamonau Aliaksey Artamonau (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty