[System Test] Control connection to memached disconnected with error "uid changed but no changes: cannot_apply_collections_manifest"

2021-03-01T04:05:23.882-08:00, ns_memcached:0:info:message(ns_1@172.23.96.14) - Bucket "bucket9" loaded on node 'ns_1@172.23.96.14' in 0 seconds.

2021-03-01T04:05:24.603-08:00, ns_vbucket_mover:0:info:message(ns_1@172.23.97.74) - Bucket "bucket9" rebalance does not seem to be swap rebalance

2021-03-01T04:05:34.665-08:00, ns_rebalancer:0:info:message(ns_1@172.23.97.74) - Started rebalancing bucket default

2021-03-01T04:05:34.735-08:00, ns_memcached:0:info:message(ns_1@172.23.96.14) - Bucket "default" loaded on node 'ns_1@172.23.96.14' in 0 seconds.

2021-03-01T04:05:35.493-08:00, ns_vbucket_mover:0:info:message(ns_1@172.23.97.74) - Bucket "default" rebalance does not seem to be swap rebalance

2021-03-01T04:09:35.958-08:00, ns_memcached:0:info:message(ns_1@172.23.96.122) - Control connection to memcached on 'ns_1@172.23.96.122' disconnected. Check logs for details.

2021-03-01T04:09:56.128-08:00, ns_memcached:0:info:message(ns_1@172.23.96.122) - Bucket "bucket8" loaded on node 'ns_1@172.23.96.122' in 0 seconds.

2021-03-01T04:14:23.456-08:00, ns_memcached:0:info:message(ns_1@172.23.123.25) - Control connection to memcached on 'ns_1@172.23.123.25' disconnected. Check logs for details.

2021-03-01T04:14:50.713-08:00, ns_memcached:0:info:message(ns_1@172.23.123.25) - Bucket "bucket9" loaded on node 'ns_1@172.23.123.25' in 0 seconds.

2021-03-01T05:01:57.078-08:00, menelaus_web_alerts_srv:0:info:message(ns_1@172.23.120.77) - Approaching full disk warning. Usage of disk "/data" on node "172.23.120.77" is around 91%.

2021-03-01T05:22:50.121-08:00, ns_memcached:0:info:message(ns_1@172.23.123.24) - Control connection to memcached on 'ns_1@172.23.123.24' disconnected. Check logs for details.

2021-03-01T05:23:09.413-08:00, ns_memcached:0:info:message(ns_1@172.23.123.24) - Bucket "bucket8" loaded on node 'ns_1@172.23.123.24' in 0 seconds.

2021-03-01T05:29:49.738-08:00, ns_memcached:0:info:message(ns_1@172.23.123.26) - Control connection to memcached on 'ns_1@172.23.123.26' disconnected. Check logs for details.

2021-03-01T05:30:22.118-08:00, ns_memcached:0:info:message(ns_1@172.23.123.26) - Bucket "bucket8" loaded on node 'ns_1@172.23.123.26' in 0 seconds.

2021-03-01T05:30:56.722-08:00, compaction_daemon:0:warning:message(ns_1@172.23.120.77) - Compactor for view `mapreduce_view/default/_design/scale/replica` (pid [{type,

                                                                         view},

                                                                        {important,

                                                                         true},

                                                                        {name,

                                                                         <<"mapreduce_view/default/_design/scale/replica">>},

                                                                        {fa,

                                                                         {#Fun<compaction_daemon.23.3787605>,

                                                                          [<<"default">>,

                                                                           <<"_design/scale">>,

                                                                           mapreduce_view,

                                                                           replica,

                                                                           {config,

                                                                            {30,

                                                                             undefined},

                                                                            {30,

                                                                             undefined},

                                                                            undefined,

                                                                            false,

                                                                            false,

                                                                            {daemon_config,

                                                                             30,

                                                                             131072,

                                                                             20971520}},

                                                                           true,

                                                                           {[{type,

                                                                              bucket}]}]}}]) terminated unexpectedly: {updater_died,

                                                                                                                       {updater_error,

                                                                                                                        timeout}}

[error_logger:error,2021-03-01T04:09:35.947-08:00,ns_1@172.23.96.122:<0.24762.662>:ale_error_logger_handler:do_log:107]

=========================CRASH REPORT=========================

  crasher:

    initial call: erlang:apply/2

    pid: <0.24762.662>

    registered_name: []

    exception error: no match of right hand side value 

                     {memcached_error,internal,

                                      <<"{\"error\":{\"context\":\"uid changed but no changes: cannot_apply_collections_manifest\"}}">>}

      in function  memcached_bucket_config:ensure_collections/2 (src/memcached_bucket_config.erl, line 280)

      in call from ns_memcached:'-run_check_and_maybe_update_config/2-fun-0-'/2 (src/ns_memcached.erl, line 874)

      in call from ns_memcached:'-perform_very_long_call/3-fun-0-'/2 (src/ns_memcached.erl, line 324)

      in call from ns_memcached_sockets_pool:'-executing_on_socket/3-fun-0-'/3 (src/ns_memcached_sockets_pool.erl, line 92)

      in call from async:'-async_init/4-fun-1-'/3 (src/async.erl, line 197)

    ancestors: ['ns_memcached-bucket8',<0.12280.1>,

                  'single_bucket_kv_sup-bucket8',ns_bucket_sup,

                  ns_bucket_worker_sup,ns_server_sup,ns_server_nodes_sup,

                  <0.22180.0>,ns_server_cluster_sup,root_sup,<0.139.0>]

    message_queue_len: 0

    messages: []

    links: [<0.12281.1>]

    dictionary: []

    trap_exit: false

    status: running

    heap_size: 987

    stack_size: 27

    reductions: 319

  neighbours:

[ns_server:debug,2021-03-01T04:09:35.947-08:00,ns_1@172.23.96.122:ns_memcached-bucket8<0.12281.1>:ns_memcached:handle_info:769]Got {'EXIT',<0.24762.662>,

        {{badmatch,

             {memcached_error,internal,

                 <<"{\"error\":{\"context\":\"uid changed but no changes: cannot_apply_collections_manifest\"}}">>}},

         [{memcached_bucket_config,ensure_collections,2,

              [{file,"src/memcached_bucket_config.erl"},{line,280}]},

          {ns_memcached,'-run_check_and_maybe_update_config/2-fun-0-',2,

              [{file,"src/ns_memcached.erl"},{line,874}]},

          {ns_memcached,'-perform_very_long_call/3-fun-0-',2,

              [{file,"src/ns_memcached.erl"},{line,324}]},

          {ns_memcached_sockets_pool,'-executing_on_socket/3-fun-0-',3,

              [{file,"src/ns_memcached_sockets_pool.erl"},{line,92}]},

          {async,'-async_init/4-fun-1-',3,

              [{file,"src/async.erl"},{line,197}]}]}}. Exiting.

[user:info,2021-03-01T04:09:35.958-08:00,ns_1@172.23.96.122:ns_memcached-bucket8<0.12281.1>:ns_memcached:do_terminate:821]Control connection to memcached on 'ns_1@172.23.96.122' disconnected. Check logs for details.

[ns_server:debug,2021-03-01T04:09:35.959-08:00,ns_1@172.23.96.122:ns_memcached-bucket8<0.12281.1>:ns_memcached:terminate:783]Terminated.

[error_logger:error,2021-03-01T04:09:35.959-08:00,ns_1@172.23.96.122:ns_memcached-bucket8<0.12281.1>:ale_error_logger_handler:do_log:107]

=========================ERROR REPORT=========================