Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44607

[Collections] badmatch uid changed but no changes

    XMLWordPrintable

Details

    Description

      Summary:
      Was trying to add .219 and remove .217 node from init nodes .215, .217 when rebalalnce failed. Was also dropping and creating a few(about 100) collections during the rebalance using bulk creation/deletion api.

      on .219 ns_server_error.log

      [ns_server:error,2021-02-26T01:39:53.160-08:00,ns_1@172.23.105.219:compaction_daemon<0.12882.1>:compaction_daemon:log_compactors_exit:1318]Compactor <0.26741.1> exited unexpectedly: {{{badmatch,
                                                    {memcached_error,internal,
                                                     <<"{\"error\":{\"context\":\"uid changed but no changes: cannot_apply_collections_manifest\"}}">>}},
                                                   [{memcached_bucket_config,
                                                     ensure_collections,2,
                                                     [{file,
                                                       "src/memcached_bucket_config.erl"},
                                                      {line,280}]},
                                                    {ns_memcached,handle_cast,2,
                                                     [{file,"src/ns_memcached.erl"},
                                                      {line,658}]},
                                                    {gen_server,try_dispatch,4,
                                                     [{file,"gen_server.erl"},
                                                      {line,637}]},
                                                    {gen_server,handle_msg,6,
                                                     [{file,"gen_server.erl"},
                                                      {line,711}]},
                                                    {proc_lib,init_p_do_apply,3,
                                                     [{file,"proc_lib.erl"},
                                                      {line,249}]}]},
                                                  {gen_server,call,
                                                   [{'ns_memcached-test_bucket',
                                                     'ns_1@172.23.105.219'},
                                                    {raw_stats,<<"diskinfo">>,
                                                     #Fun<compaction_daemon.18.3787605>,
                                                     {<<"0">>,<<"0">>}},
                                                    180000]}}. Moving to the next bucket.

      ns_server_debug.log on .219

      [error_logger:error,2021-02-26T01:39:32.914-08:00,ns_1@172.23.105.219:ns_memcached-test_bucket<0.13947.1>:ale_error_logger_handler:do_log:107]
      =========================CRASH REPORT=========================
        crasher:
          initial call: ns_memcached:init/1
          pid: <0.13947.1>
          registered_name: 'ns_memcached-test_bucket'
          exception error: no match of right hand side value 
                           {memcached_error,internal,
                                            <<"{\"error\":{\"context\":\"uid changed but no changes: cannot_apply_collections_manifest\"}}">>}
            in function  memcached_bucket_config:ensure_collections/2 (src/memcached_bucket_config.erl, line 280)
            in call from ns_memcached:handle_cast/2 (src/ns_memcached.erl, line 658)
            in call from gen_server:try_dispatch/4 (gen_server.erl, line 637)
            in call from gen_server:handle_msg/6 (gen_server.erl, line 711)
          ancestors: [<0.13864.1>,'single_bucket_kv_sup-test_bucket',
                        ns_bucket_sup,ns_bucket_worker_sup,ns_server_sup,
                        ns_server_nodes_sup,<0.12534.1>,ns_server_cluster_sup,
                        root_sup,<0.138.0>]
          message_queue_len: 1
          messages: [{'$gen_call',
                            {<0.13952.1>,#Ref<0.3746343762.3163815938.82003>},
                            {raw_stats,<<"dcp">>,#Fun<dcp_replicator.2.128554644>,
                                []}}]
          links: [#Port<0.1189>,<0.13864.1>]
          dictionary: []
          trap_exit: true
          status: running
          heap_size: 46422
          stack_size: 27
          reductions: 95814
        neighbours:

      Timeline can be seen from the UI screenshot.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sumedh.basarkod Sumedh Basarkod (Inactive)
              sumedh.basarkod Sumedh Basarkod (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty