Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6278

User-triggered compaction of view `b1/_design/dev_view3` failed: {not_found, no_db_file} during cluster rebalance.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0-beta
    • Fix Version/s: 2.0-beta
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None
    • Environment:
      2.0c-700
      1024 vbuckets
      Centos

      Description

      Hi Filipe,

      Seeing errors on User-triggered compaction of view, during rebalance on a cluster.

      Not sure if this is supported. Documenting the bug, incase it is.

      Could you let me know what exact information is relevant in this case. I ll post up more accordingly.

      thanks,
      Ketaki

      1. Create 4 buckets on a single node cluster ( 3 sasl buckets), enable replica indexes on all buckets.
      2. Create 2 user defined views
      3. Add 3 nodes, and rebalance in
      4. During rebalance, create another view -view3 and compact the view ( user-triggered)

      Error
      User-triggered compaction of view `b1/_design/dev_view3` failed:

      {not_found, no_db_file}

      . See logs for detailed reason.

      Subsequent attemps to compact this , get the same output.

      [ns_server:info,2012-08-17T11:50:26.353,ns_1@10.3.121.34:<0.28242.1>:compaction_daemon:spawn_view_index_compactor:664]Compacting indexes for b1/_design/dev_view3/main
      [couchdb:info,2012-08-17T11:50:26.357,ns_1@10.3.121.34:<0.28112.1>:couch_log:info:39]Set view `b1`, main group `_design/dev_view3`, compaction starting
      [views:info,2012-08-17T11:50:26.358,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:334]
      Calling couch_set_view:add_replica_partitions([<<"b1">>,
      <<"_design/dev_view3">>,[]])
      [views:info,2012-08-17T11:50:26.362,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:335]
      couch_set_view:add_replica_partitions([<<"b1">>,<<"_design/dev_view3">>,[]]) returned ok in 0ms
      [views:info,2012-08-17T11:50:26.366,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:336]
      Calling couch_set_view:remove_replica_partitions([<<"b1">>,
      <<"_design/dev_view3">>,[]])
      [views:info,2012-08-17T11:50:26.367,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:337]
      couch_set_view:remove_replica_partitions([<<"b1">>,<<"_design/dev_view3">>,[]]) returned ok in 0ms
      [views:info,2012-08-17T11:50:26.368,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:346]
      Calling couch_set_view:mark_partitions_unindexable([<<"b1">>,
      <<"_design/dev_view3">>,
      []])
      [couchdb:info,2012-08-17T11:50:26.378,ns_1@10.3.121.34:<0.28112.1>:couch_log:info:39]Set view `b1`, main group `_design/dev_view3`, linked PID <0.28470.1> stopped normally
      [couchdb:info,2012-08-17T11:50:26.382,ns_1@10.3.121.34:<0.28112.1>:couch_log:info:39]Restarting compaction for main group `_design/dev_view3`, set view `b1`. Reason: set of unindexable partitions updated
      [ns_server:warn,2012-08-17T11:50:26.386,ns_1@10.3.121.34:<0.28241.1>:compaction_daemon:do_chain_compactors:511]Compactor for view `b1/_design/dev_view3/main` (pid [

      {type,view}

      ,

      {important,true}

      ,

      {name, <<"b1/_design/dev_view3/main">>}

      ,
      {fa,
      {#Fun<compaction_daemon.16.13428321>,
      [<<"b1">>,
      <<"_design/dev_view3">>,
      main,
      {config,

      {30, 18446744073709551616},
      {30, 18446744073709551616}

      ,
      undefined,false,
      {daemon_config,30,
      131072}},
      true,

      {view, <<"_design/dev_view3">>}

      ]}}]) terminated unexpectedly: shutdown
      [couchdb:info,2012-08-17T11:50:26.391,ns_1@10.3.121.34:<0.28112.1>:couch_log:info:39]Set view `b1`, main group `_design/dev_view3`, compaction starting
      [user:error,2012-08-17T11:50:26.392,ns_1@10.3.121.34:compaction_daemon:compaction_daemon:handle_info:321]User-triggered compaction of view `b1/_design/dev_view3` failed: shutdown. See logs for detailed reason.
      [views:info,2012-08-17T11:50:26.428,ns_1@10.3.121.34:'capi_ddoc_replication_srv-b1':capi_set_view_manager:apply_index_states:347]

      Attaching logs ..

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        shutting down compaction during rebalance is an expected behavior per Filipe comments here
        http://www.couchbase.com/issues/browse/MB-6271?jwupdated=43704&focusedCommentId=35771#comment-35771

        let's confirm whether
        1- this ONLY happens during rebalancing
        2- this is shown in the UI - and thats what is confusing us that this is a bug

        Show
        farshid Farshid Ghods (Inactive) added a comment - shutting down compaction during rebalance is an expected behavior per Filipe comments here http://www.couchbase.com/issues/browse/MB-6271?jwupdated=43704&focusedCommentId=35771#comment-35771 let's confirm whether 1- this ONLY happens during rebalancing 2- this is shown in the UI - and thats what is confusing us that this is a bug
        Hide
        FilipeManana Filipe Manana (Inactive) added a comment -

        The badmatch against

        {not_found, no_db_file}

        seems like coming from the compaction daemon in ns_server (the thing that triggers compactions). Probably harmless.

        The compaction shutdown error is expected during rebalance often as well. This can be safely ignored, and it was always like this.

        Show
        FilipeManana Filipe Manana (Inactive) added a comment - The badmatch against {not_found, no_db_file} seems like coming from the compaction daemon in ns_server (the thing that triggers compactions). Probably harmless. The compaction shutdown error is expected during rebalance often as well. This can be safely ignored, and it was always like this.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        Hi Filipe,

        since this is expected during rebalance we should not be seeing this in the UI otherwise it will be confusing to the user to see errors in the UI.
        I will assign this to Aliaksey in that case.

        Show
        farshid Farshid Ghods (Inactive) added a comment - Hi Filipe, since this is expected during rebalance we should not be seeing this in the UI otherwise it will be confusing to the user to see errors in the UI. I will assign this to Aliaksey in that case.
        Hide
        ketaki Ketaki Gangal added a comment -

        I see the same behavior without any rebalance.

        Single Node.
        Create 3 views.
        Trigger user-defined compaction

        Error
        User-triggered compaction of view `saslbucket/_design/dev_d1` failed: function_clause. See logs for detailed reason.

        Show
        ketaki Ketaki Gangal added a comment - I see the same behavior without any rebalance. Single Node. Create 3 views. Trigger user-defined compaction Error User-triggered compaction of view `saslbucket/_design/dev_d1` failed: function_clause. See logs for detailed reason.
        Hide
        farshid Farshid Ghods (Inactive) added a comment -

        dupe of MB-6312

        Show
        farshid Farshid Ghods (Inactive) added a comment - dupe of MB-6312
        Hide
        Aliaksey Artamonau Aliaksey Artamonau added a comment -

        Actually not a duplicate.

        Show
        Aliaksey Artamonau Aliaksey Artamonau added a comment - Actually not a duplicate.
        Hide
        thuan Thuan Nguyen added a comment -

        Integrated in github-ns-server-2-0 #444 (See http://qa.hq.northscale.net/job/github-ns-server-2-0/444/)
        MB-6278 Ignore no_db_file errors caused by vbucket transfer. (Revision b7f59b871bd02707d0a14de3ea0b2fd111a60047)

        Result = SUCCESS
        Aliaksey Kandratsenka :
        Files :

        • src/compaction_daemon.erl
        Show
        thuan Thuan Nguyen added a comment - Integrated in github-ns-server-2-0 #444 (See http://qa.hq.northscale.net/job/github-ns-server-2-0/444/ ) MB-6278 Ignore no_db_file errors caused by vbucket transfer. (Revision b7f59b871bd02707d0a14de3ea0b2fd111a60047) Result = SUCCESS Aliaksey Kandratsenka : Files : src/compaction_daemon.erl
        Hide
        andreibaranouski Andrei Baranouski added a comment -

        verified

        Show
        andreibaranouski Andrei Baranouski added a comment - verified

          People

          • Assignee:
            Aliaksey Artamonau Aliaksey Artamonau
            Reporter:
            ketaki Ketaki Gangal
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes