Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6371

Failed to start user triggered index compaction

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.0
    • 2.0-beta
    • ns_server
    • Security Level: Public
    • None
    • Centos 64 bit
      1617
      Using mscoda data set.

    Description

      Steps:-
      1) Remove a server, rebalance it out.
      2) Trigger view compaction on few ddocs manually

      Seems to be in ns_server, as RPC call sync_send_all_state_event seems to be failing for force_compact_view.

      Is 10 secs too less for the timeout?

      Server error during processing: ["web request failed",

      {path,"/pools/default"}

      ,

      {type,exit}

      ,
      {what,
      {noproc,

      {gen_fsm,sync_send_all_state_event, [mb_master,master_node]}

      }},
      {trace,
      [

      {gen_fsm,sync_send_all_state_event,2}

      ,

      {ns_cluster_membership, is_stop_rebalance_safe,0}

      ,

      {menelaus_web,build_pool_info,4}

      ,

      {menelaus_web,handle_pool_info_wait,6}

      ,

      {menelaus_web,check_and_handle_pool_info,2}

      ,

      {menelaus_web,loop,3}

      ,

      {mochiweb_http,headers,5}

      ,

      {proc_lib,init_p_do_apply,3}]}]


      2012-08-21 23:09:30.885 compaction_daemon:0:critical:message(ns_1@10.3.2.46) - Failed to start index compaction for `saslbucket/_design/d11` on some nodes:
      [{'ns_1@10.3.2.47',
      {'EXIT',
      {noproc,
      {gen_fsm,sync_send_all_state_event,
      [{compaction_daemon,'ns_1@10.3.2.47'},
      {force_compact_view,<<"saslbucket">>,<<"_design/d11">>},
      10000]}}}}]
      2012-08-21 23:09:31.113 compaction_daemon:0:critical:message(ns_1@10.3.2.46) - Failed to start index compaction for `saslbucket/_design/d10` on some nodes:
      [{'ns_1@10.3.2.46',
      {'EXIT',
      {badmatch,{ok,<0.28902.18>,
      [{compaction_daemon,register_forced_compaction,3},
      {compaction_daemon,handle_sync_event,4},
      {gen_fsm,handle_msg,7},
      {proc_lib,init_p_do_apply,3}

      ]},
      {gen_fsm,sync_send_all_state_event,
      [

      {compaction_daemon,'ns_1@10.3.2.46'}

      ,

      {force_compact_view,<<"saslbucket">>,<<"_design/d10">>},
      10000]}}}},
      {'ns_1@10.3.2.47',
      {'EXIT',
      {badmatch,{ok,<18275.10321.18>,
      [{compaction_daemon,register_forced_compaction,3},
      {compaction_daemon,handle_sync_event,4},
      {gen_fsm,handle_msg,7},
      {proc_lib,init_p_do_apply,3}]},
      {gen_fsm,sync_send_all_state_event,
      [{compaction_daemon,'ns_1@10.3.2.47'},
      {force_compact_view,<<"saslbucket">>,<<"_design/d10">>}

      ,
      10000]}}}},
      {'ns_1@10.3.2.48',
      {'EXIT',
      {badmatch,{ok,<18276.4531.17>,
      [

      {compaction_daemon,register_forced_compaction,3}

      ,

      {compaction_daemon,handle_sync_event,4}

      ,

      {gen_fsm,handle_msg,7}

      ,

      {proc_lib,init_p_do_apply,3}

      ]},
      {gen_fsm,sync_send_all_state_event,
      [

      {compaction_daemon,'ns_1@10.3.2.48'}

      ,

      {force_compact_view,<<"saslbucket">>,<<"_design/d10">>}

      ,
      10000]}}}}

      Views
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d1' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.key_num);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,doc.key);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d2' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.name);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.key_num]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d3' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.email);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.name]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d4' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.city);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.email]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d5' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.country);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.city]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d6' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.realm);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.country]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d7' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.coins);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.realm]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d8' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.category);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.coins]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d9' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.achievements);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.category]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d10' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.body);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.achievements]);\n}

      "} }}'
      curl -v -X PUT -H 'Content-Type: application/json' 'http://saslbucket:saslpass@localhost:8092/saslbucket/_design/d11' \
      -d '{"views": { "v1":{"map":"function(doc)

      {\nemit(doc.key,doc.city+doc.country);\n}

      "}, "v2":{"map":"function(doc,meta)

      {\nemit(meta.id,[doc.key_num,doc.body]);\n}

      "} }}'

      Attachments

        1. 10.3.2.122-8091-diag.txt.gz
          16.31 MB
        2. 10.3.2.46-8091-diag.txt.gz
          16.21 MB
        3. 10.3.2.47-8091-diag.txt.gz
          16.38 MB
        4. 10.3.2.48-8091-diag.txt.gz
          15.68 MB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            karan Karan Kumar (Inactive)
            karan Karan Kumar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty