Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.2.0
-
7.2.0-5110
-
Untriaged
-
Centos 64-bit
-
0
-
No
Description
Steps to repro:
- Create a single node cluster(172.23.107.76)
- Create four collections(total collection count = 5, including default collection)
- Enable history on all the collections(test try to enable it on default collection, though it is not supported, so there are warning messages for it)
- Start data loading
- Disable history retention of all the collections
- Sleep for 100 seconds and enable retention on all collections
- Observed node turned in to amber/pending state, and remains in the same state
- Also observed, though data loading is going on, Neither document count gets incremented nor i see temp ooms.
Cluster is still in the same state, Below are the cluster details
Logs:
=========================CRASH REPORT=========================
|
crasher:
|
initial call: ns_memcached:init/1
|
pid: <0.8688.596>
|
registered_name: 'ns_memcached-default'
|
exception error: no match of right hand side value
|
{memcached_error,einval,
|
<<"{\"error\":{\"context\":\"Collections::Manager::update manifest json invalid:{\\\"uid\\\":\\\"9\\\",\\\"scopes\\\":[{\\\"name\\\":\\\"_default\\\",\\\"uid\\\":\\\"0\\\",\\\"collections\\\":[{\\\"name\\\":\\\"FunctionCollection4"...>>}
|
in function memcached_bucket_config:ensure_collections/2 (src/memcached_bucket_config.erl, line 291)
|
in call from ns_memcached:handle_info/2 (src/ns_memcached.erl, line 705)
|
in call from gen_server:try_dispatch/4 (gen_server.erl, line 695)
|
in call from gen_server:handle_msg/6 (gen_server.erl, line 771)
|
ancestors: [<0.8535.596>,'single_bucket_kv_sup-default',ns_bucket_sup,
|
ns_bucket_worker_sup,ns_server_sup,ns_server_nodes_sup,
|
<0.271.0>,ns_server_cluster_sup,root_sup,<0.145.0>]
|
message_queue_len: 0
|
messages: []
|
links: [<0.8535.596>,#Port<0.3294517>,<0.6978.596>]
|
dictionary: []
|
trap_exit: true
|
status: running
|
heap_size: 6772
|
stack_size: 29
|
reductions: 67203
|
neighbours:
|
neighbour:
|
pid: <0.6978.596>
|
registered_name: []
|
initial call: work_queue:init/1
|
current_function: {erlang,hibernate,3}
|
ancestors: ['ns_memcached-default',<0.8535.596>,
|
'single_bucket_kv_sup-default',ns_bucket_sup,
|
ns_bucket_worker_sup,ns_server_sup,ns_server_nodes_sup,
|
<0.271.0>,ns_server_cluster_sup,root_sup,<0.145.0>]
|
message_queue_len: 0
|
links: [<0.8688.596>]
|
trap_exit: false
|
status: waiting
|
QE-TEST:
git fetch https://review.couchbase.org/TAF refs/changes/72/185372/32 && git checkout -b change-185372 FETCH_HEAD
|
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/temp_vol.ini bucket_storage=magma,init_loading=False,bucket_eviction_policy=fullEviction,rerun=False -t storage.magma.magma_crash_recovery.MagmaCrashTests.test_magma_failures_with_CDC,nodes_init=1,graceful=False,skip_cleanup=True,num_items=500000,num_buckets=3,doc_size=1024,bucket_type=membase,eviction_policy=fullEviction,iterations=1,batch_size=1000,sdk_timeout=60,log_level=info,infra_log_level=info,rerun=False,process_concurrency=4,skip_cleanup=True,key_size=22,randomize_doc_size=False,randomize_value=False,num_collections=5,ops_rate=40000,ramQuota=256,key_type=SimpleKey,vbuckets=4,replicas=0,doc_ops=update:delete,test_itr=2,default_history_retention_for_collections=true,bucket_history_retention_seconds=300,bucket_history_retention_bytes=10240,standard_buckets=1,magma_buckets=1,num_scopes=1,induce_failures=False,retention_flag=True'
|