Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-45757

CheckpointManager::removeCursor_UNLOCKED tried to remove cursor named:eq_dcpq:cbas:`^Local`.Local:bucket1:3be66735641e5148e74954f407e38687:14sid:2 but currentCheckpoint was equal to checkpointList.end() implying we have already removed it

    XMLWordPrintable

Details

    • Triaged
    • 1
    • No
    • KV-Engine CC Final Sprint

    Description

      Job: http://qa.sc.couchbase.com/job/test_suite_executor-TAF/108441/consoleFull

      172.23.123.163: 8f436485-1302-44c1-dca68dba-71ced933.dmp

      172.23.123.163

      2021-04-18T01:51:10.447959-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-04-18T01:51:10.448006-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): CheckpointManager::removeCursor_UNLOCKED tried to remove cursor named:eq_dcpq:cbas:`^Local`.Local:bucket1:3be66735641e5148e74954f407e38687:14sid:2 but currentCheckpoint was equal to checkpointList.end() implying we have already removed it
      2021-04-18T01:51:10.627254-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-4960). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/8f436485-1302-44c1-dca68dba-71ced933.dmp before terminating.
      2021-04-18T01:51:10.627283-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-04-18T01:51:10.627475-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x5066b3]
      2021-04-18T01:51:10.627496-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x52d3ea]
      2021-04-18T01:51:10.627515-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x52d728]
      2021-04-18T01:51:10.627526-07:00 CRITICAL     #3  /lib64/libpthread.so.0() [0x7f9a322ea000+0xf5f0]
      2021-04-18T01:51:10.627581-07:00 CRITICAL     #4  /lib64/libc.so.6(gsignal+0x37) [0x7f9a31f1c000+0x36337]
      2021-04-18T01:51:10.627601-07:00 CRITICAL     #5  /lib64/libc.so.6(abort+0x148) [0x7f9a31f1c000+0x37a28]
      2021-04-18T01:51:10.627625-07:00 CRITICAL     #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f9a32a20000+0x9963c]
      2021-04-18T01:51:10.627644-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x5131ef]
      2021-04-18T01:51:10.627981-07:00 CRITICAL     #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f9a32a20000+0xa48f6]
      2021-04-18T01:51:10.627998-07:00 CRITICAL     #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f9a32a20000+0xa4961]
      2021-04-18T01:51:10.628014-07:00 CRITICAL     #10 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f9a32a20000+0xa4bf4]
      2021-04-18T01:51:10.628029-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x9cbbd]
      2021-04-18T01:51:10.628051-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x36b217]
      2021-04-18T01:51:10.628071-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x44bec9]
      2021-04-18T01:51:10.628086-07:00 CRITICAL     #14 /opt/couchbase/bin/memcached() [0x400000+0x44fffc]
      2021-04-18T01:51:10.628101-07:00 CRITICAL     #15 /opt/couchbase/bin/memcached() [0x400000+0x450ed5]
      2021-04-18T01:51:10.628116-07:00 CRITICAL     #16 /opt/couchbase/bin/memcached() [0x400000+0x38bf5e]
      2021-04-18T01:51:10.628129-07:00 CRITICAL     #17 /opt/couchbase/bin/memcached() [0x400000+0x37fabd]
      2021-04-18T01:51:10.628149-07:00 CRITICAL     #18 /opt/couchbase/bin/memcached() [0x400000+0x221eb9]
      2021-04-18T01:51:10.628164-07:00 CRITICAL     #19 /opt/couchbase/bin/memcached() [0x400000+0x176862]
      2021-04-18T01:51:10.628176-07:00 CRITICAL     #20 /opt/couchbase/bin/memcached() [0x400000+0x1768f6]
      2021-04-18T01:51:10.628188-07:00 CRITICAL     #21 /opt/couchbase/bin/memcached() [0x400000+0x1806d7]
      2021-04-18T01:51:10.628199-07:00 CRITICAL     #22 /opt/couchbase/bin/memcached() [0x400000+0x1810d1]
      2021-04-18T01:51:10.628205-07:00 CRITICAL     #23 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7f9a33bb8000+0xed8e]
      2021-04-18T01:51:10.628236-07:00 CRITICAL     #24 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7f9a33bb8000+0x17d01]
      2021-04-18T01:51:10.628335-07:00 CRITICAL     #25 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7(event_base_loop+0x3bf) [0x7f9a33bb8000+0x1854f]
      2021-04-18T01:51:10.628348-07:00 CRITICAL     #26 /opt/couchbase/bin/memcached() [0x400000+0x15ac5b]
      2021-04-18T01:51:10.628360-07:00 CRITICAL     #27 /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f9a34af0000+0x32be9]
      2021-04-18T01:51:10.628372-07:00 CRITICAL     #28 /lib64/libpthread.so.0() [0x7f9a322ea000+0x7e65]
      2021-04-18T01:51:10.628403-07:00 CRITICAL     #29 /lib64/libc.so.6(clone+0x6d) [0x7f9a31f1c000+0xfe88d]
      

      QE Test

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.2281.ini GROUP=P0SET3,threads_to_use=10,upgrade_version=7.0.0-4960 -t cbas.cbas_collection_functional_test.CBASDatasetsAndCollections.test_enabling_disabling_analytics_collection_on_all_KV_collections,num_collections=10,disable_from_kv=True,upgrade_version=7.0.0-4960,run_query=True,GROUP=P0SET3,services_init=kv:n1ql-kv-cbas-cbas-cbas-cbas,bucket_spec=analytics.default,set_cbas_memory_from_available_free_memory=True,bucket_size=auto,num_buckets=1,threads_to_use=10,nodes_init=6,num_scopes=5,num_items=1250,override_spec_params=num_items;num_buckets;num_collections;bucket_size;num_scopes,parallel_load_percent=150,bucket_cardinality=3'
      

      Umang can you update the defect with the test steps please.

      Test Steps -
      1. Have a 6 node cluster with 2 KV+N1QL nodes and 4 CBAS nodes
      2. Create following KV side infra - 1 bucket, 5 scopes and 10 collections/scope
      3. Enable analytics on all KV collections using following DDL on CBAS query workbench
      "Alter collection bucket.scope.collection enable analytics"
      4. While step 3 is in progress start loading more docs into KV collections parallely.
      5. Also start CBAS query execution parallely with step 3 & 4.
      6. Once step 3 is complete, stop query execution that was started in step 5.
      7. Wait for data load started in step 4 to complete.
      8. Perform following validations - Check doc count in all the datasets that were created because of step 3, check all synonyms metadata that were created because of step 3.
      9. Repeat steps 3-8 but for disabling analytics on all KV collections.
      "Alter collection bucket.scope.collection disable analytics".

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty