Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7618

Excessive compactions are scheduled during rebalance

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.1
    • Fix Version/s: 2.0.1
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None

      Description

      I see that during rebalance compactions may be scheduled several time during a single second:

      [ns_server:info,2013-01-28T18:51:24.017,n_0@10.17.36.71:<0.27018.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:24.022,n_0@10.17.36.71:<0.27021.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:24.023,n_0@10.17.36.71:<0.27021.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:24.024,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:24.025,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:24.622,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:24.623,n_0@10.17.36.71:<0.27025.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:24.624,n_0@10.17.36.71:<0.27025.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:<0.27028.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:<0.27028.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:24.626,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:24.627,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:25.467,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:25.476,n_0@10.17.36.71:<0.27030.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:25.477,n_0@10.17.36.71:<0.27030.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:25.479,n_0@10.17.36.71:<0.27033.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:25.479,n_0@10.17.36.71:<0.27033.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:25.480,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:25.480,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s
      [ns_server:debug,2013-01-28T18:51:25.491,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:389]Starting compaction for the following buckets:
      [<<"default">>]
      [ns_server:info,2013-01-28T18:51:25.493,n_0@10.17.36.71:<0.27034.0>:compaction_daemon:try_to_cleanup_indexes:583]Cleaning up indexes for bucket `default`
      [ns_server:info,2013-01-28T18:51:25.494,n_0@10.17.36.71:<0.27034.0>:compaction_daemon:spawn_bucket_compactor:542]Compacting bucket default with config:
      [{database_fragmentation_threshold,{30,undefined}},
      {view_fragmentation_threshold,{30,undefined}}]
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:<0.27037.0>:compaction_daemon:file_needs_compaction:983]Estimated size for `default`: data 47709, file 4226094
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:<0.27037.0>:compaction_daemon:file_needs_compaction:988]Estimated file size for `default` is less than min_file_size 67239936; skipping
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:handle_info:453]Finished compaction iteration.
      [ns_server:debug,2013-01-28T18:51:25.496,n_0@10.17.36.71:compaction_daemon<0.435.0>:compaction_daemon:schedule_next_compaction:1404]Finished compaction too soon. Next run will be in 30s

      # Subject Project Status CR V
      For Gerrit Dashboard: &For+MB-7618=message:MB-7618

        Activity

        Show
        Aliaksey Artamonau Aliaksey Artamonau added a comment - http://review.couchbase.org/24257
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Fix merged

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Fix merged

          People

          • Assignee:
            Aliaksey Artamonau Aliaksey Artamonau
            Reporter:
            Aliaksey Artamonau Aliaksey Artamonau
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes