Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42688

Potential crash during ExpiredItemPager::run() if vBucket state changes during visit

    XMLWordPrintable

    Details

      Description

      Script to Repo:

      ./testrunner -i /tmp/testexec.74991.ini GROUP=durability_majority,rerun=False,skip_log_scan=False,get-cbcollect-info=False,infra_log_level=critical,log_level=error,bucket_storage=couchstore,upgrade_version=7.0.0-3705 -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests,data_load_stage=during,skip_validations=False,GROUP=durability_majority
      

      2020-11-11 15:12:16,638 | test | ERROR | MainThread | [basetestcase:check_coredump_exist:683] Node 172.23.122.110 - Core dump seen: 1 172.23.122.110 : Stack Trace of first crash: e8f14034-2ab2-4818-7b271cb6-1a4b437d.dmp

      172.23.122.110 : Found message in /opt/couchbase/var/lib/couchbase/logs/memcached.log.000002.txt

      2020-11-11T15:11:32.027733-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-3705). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/e8f14034-2ab2-4818-7b271cb6-1a4b437d.dmp before terminating.
      2020-11-11T15:11:32.027767-08:00 CRITICAL Stack backtrace of crashed thread:
      2020-11-11T15:11:32.029410-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x19b1ed]
      2020-11-11T15:11:32.029437-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x1b094a]
      2020-11-11T15:11:32.029473-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x1b0c88]
      2020-11-11T15:11:32.029482-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f1a6b226000+0xf5f0]
      2020-11-11T15:11:32.029495-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x1c126f]
      2020-11-11T15:11:32.029503-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x1b2bcc]
      2020-11-11T15:11:32.029510-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x1aa097]
      2020-11-11T15:11:32.029517-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x1aa48d]
      2020-11-11T15:11:32.029526-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x196abd]
      2020-11-11T15:11:32.029533-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x1860b3]
      2020-11-11T15:11:32.029541-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f1a6ef47000+0x8748f]
      2020-11-11T15:11:32.029548-08:00 CRITICAL     /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f1a6d9de000+0x10917]
      2020-11-11T15:11:32.029554-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f1a6b226000+0x7e65]
      

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            sumedh.basarkod Sumedh Basarkod created issue -
            sumedh.basarkod Sumedh Basarkod made changes -
            Priority Major [ 3 ] Critical [ 2 ]
            sumedh.basarkod Sumedh Basarkod made changes -
            Labels affects-cc-testing collections functional-test 7.0mustpass affects-cc-testing collections functional-test
            Balakumaran.Gopal Balakumaran Gopal made changes -
            Affects Version/s Cheshire-Cat [ 15915 ]
            owend Daniel Owen made changes -
            Assignee Daniel Owen [ owend ] James Harrison [ james.harrison ]
            owend Daniel Owen made changes -
            Epic Link MB-16181 [ 44869 ]
            owend Daniel Owen made changes -
            Summary [Collections] KVBucket::visitAsync in ExpiredItemPager::run() KVBucket::visitAsync in ExpiredItemPager::run()
            owend Daniel Owen made changes -
            Link This issue relates to MB-40531 [ MB-40531 ]
            james.harrison James Harrison made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-40511 [ MB-40511 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-40528 [ MB-40528 ]
            lynn.straus Lynn Straus made changes -
            Due Date 13/Nov/20
            wayne Wayne Siu made changes -
            Labels 7.0mustpass affects-cc-testing collections functional-test 7.0mustpass affects-cc-testing approved-for-6.0.5 approved-for-6.6.1 collections functional-test
            wayne Wayne Siu made changes -
            Fix Version/s 6.6.1 [ 17002 ]
            Fix Version/s 6.0.5 [ 16729 ]
            james.harrison James Harrison made changes -
            Status In Progress [ 3 ] Open [ 1 ]
            james.harrison James Harrison made changes -
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            sumedh.basarkod Sumedh Basarkod made changes -
            Assignee James Harrison [ james.harrison ] Sumedh Basarkod [ sumedh.basarkod ]
            Status Resolved [ 5 ] Closed [ 6 ]
            drigby Dave Rigby made changes -
            Summary KVBucket::visitAsync in ExpiredItemPager::run() Potential crash during ExpiredItemPager::run() if vBucket state changes during visit
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Assignee Sumedh Basarkod [ sumedh.basarkod ] Dave Rigby [ drigby ]
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Labels 7.0mustpass affects-cc-testing approved-for-6.0.5 approved-for-6.6.1 collections functional-test 7.0mustpass affects-cc-testing approved-for-6.0.5 approved-for-6.6.1 collections functional-test request-dev-verify
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Resolution Fixed [ 1 ]
            Status Closed [ 6 ] Reopened [ 4 ]
            drigby Dave Rigby made changes -
            Triage Untriaged [ 10351 ] Triaged [ 10350 ]
            VERIFICATION STEPS Verified by unit tests which exhaustively verify all possible state changes are correctly handled.
            Resolution Fixed [ 1 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            ashwin.govindarajulu Ashwin Govindarajulu made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.0 [ 17233 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s Cheshire-Cat [ 15915 ]

              People

              Assignee:
              drigby Dave Rigby
              Reporter:
              sumedh.basarkod Sumedh Basarkod
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Due:
                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes

                    PagerDuty