Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41321

[Collections] Underflow whilst decrementing DiskCount

    XMLWordPrintable

Details

    Description

      Script to Repo:

      /testrunner -i /tmp/testexec.21132.ini rerun=False,get-cbcollect-info=True,infra_log_level=critical,log_level=error,upgrade_version=7.0.0-3016 -t failover.DiskFailoverTests.DiskAutofailoverTests.test_disk_autofailover_and_remove_failover_node,timeout=10,num_node_failures=1,failover_action=disk_full,nodes_init=5,disk_timeout=15,bucket_spec=single_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections

      2020-09-05 10:09:56,209 | test | ERROR | MainThread | [basetestcase:check_coredump_exist:707] Node 172.23.107.66 - Core dump seen: 3

      BT b6e77d07-6470-4871-af2b16bd-0e5c23ae.dmp on .66

      (gdb) bt
      #0  0x00007f1d194ac207 in raise () from /lib64/libc.so.6
      #1  0x00007f1d194ad8f8 in abort () from /lib64/libc.so.6
      #2  0x00007f1d1a009195 in __gnu_cxx::__verbose_terminate_handler () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/vterminate.cc:95
      #3  0x000000000054edb2 in backtrace_terminate_handler () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/terminate_handler.cc:86
      #4  0x00007f1d1a006f86 in __cxxabiv1::__terminate (handler=<optimized out>) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:47
      #5  0x00007f1d1a006fd1 in std::terminate () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:57
      #6  0x00007f1d1a007213 in __cxxabiv1::__cxa_throw (obj=obj@entry=0x7f1cc4000940, tinfo=0x7f1d1a2ecad8 <typeinfo for std::underflow_error>, dest=0x7f1d1a01c4f0 <std::underflow_error::~underflow_error()>)
          at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_throw.cc:93
      #7  0x00007f1d1d7a1574 in cb::ThrowExceptionUnderflowPolicy<unsigned long>::underflow (this=<optimized out>, desired=<optimized out>, current=<optimized out>, arg=<optimized out>)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/include/platform/non_negative_counter.h:48
      #8  0x00007f1d1d97f136 in fetch_sub (arg=1, this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/include/platform/non_negative_counter.h:160
      #9  operator-- (this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/include/platform/non_negative_counter.h:222
      #10 decrementDiskCount (this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest_entry.h:92
      #11 decrementDiskCount (entry=..., this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest.h:454
      #12 decrementDiskCount (this=0x7f1cdbff3f50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest_handles.h:322
      #13 Collections::VB::StatsUpdate::decrementDiskCount (this=0x7f1cdbff3f50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/flush.cc:96
      #14 0x00007f1d1d97fa3e in remove (diskSizeDelta=25610, isCommitted=true, this=0x7f1cdbff3f50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/flush.cc:164
      #15 Collections::VB::Flush::updateStats (this=this@entry=0x7f1cdbff4d10, key=..., seqno=seqno@entry=1135, isCommitted=isCommitted@entry=true, isDelete=isDelete@entry=true, size=size@entry=0, oldSeqno=542, oldIsDelete=false, oldSize=91)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/flush.cc:225
      #16 0x00007f1d1d94706b in saveDocsCallback (oldInfo=0x7f1d0a704450, newInfo=0x7f1d0a703960, context=0x7f1cdbff48b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:2165
      #17 0x00007f1d1d4d0afb in do_save_callback (valueNew=<optimized out>, valueOld=0x7f1cdbff4140, key=0x7f1cb4da7630, rq=0x7f1cdbff44b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/btree_modify.cc:431
      #18 modify_node (rq=rq@entry=0x7f1cdbff44b0, nptr=nptr@entry=0x7f1cc2be04e8, start=start@entry=0, end=end@entry=4, dst=dst@entry=0x7f1cc2be0230)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/btree_modify.cc:537
      #19 0x00007f1d1d4d04d1 in modify_node (rq=rq@entry=0x7f1cdbff44b0, nptr=nptr@entry=0x7f1cc2be0200, start=start@entry=0, end=end@entry=53, dst=dst@entry=0x7f1cc2be00c8)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/btree_modify.cc:647
      #20 0x00007f1d1d4d04d1 in modify_node (rq=rq@entry=0x7f1cdbff44b0, nptr=nptr@entry=0x7f1d0a523c40, start=start@entry=0, end=98, dst=dst@entry=0x7f1cc2be0010)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/btree_modify.cc:647
      #21 0x00007f1d1d4d1469 in modify_btree (rq=rq@entry=0x7f1cdbff44b0, root=0x7f1d0a523c40, errcode=errcode@entry=0x7f1cdbff43e4) at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/btree_modify.cc:809
      #22 0x00007f1d1d4e5530 in update_indexes (save_callback_ctx=<optimized out>, save_callback=<optimized out>, numdocs=<optimized out>, idvals=<optimized out>, ids=<optimized out>, seqvals=<optimized out>, seqs=0x7f1cb4da7010, 
          db=<optimized out>, this=<optimized out>, this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/couch_save.cc:238
      #23 couchstore_save_documents_and_callback (db=<optimized out>, docs=<optimized out>, infos=<optimized out>, numdocs=<optimized out>, options=options@entry=3, 
          save_cb=save_cb@entry=0x7f1d1d946f70 <saveDocsCallback(DocInfo const*, DocInfo const*, void*)>, save_cb_ctx=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/couchstore/src/couch_save.cc:424
      #24 0x00007f1d1d953ea0 in CouchKVStore::saveDocs (this=this@entry=0x7f1d0a73b400, vbid=..., docs=..., docinfos=..., kvctx=...)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:2270
      #25 0x00007f1d1d954daa in CouchKVStore::commit2couchstore (this=0x7f1d0a73b400, commitData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:2131
      #26 0x00007f1d1d955445 in CouchKVStore::commit (this=0x7f1d0a73b400, commitData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:1336
      #27 0x00007f1d1d835352 in EPBucket::commit (this=this@entry=0x7f1d0a709000, vbid=..., kvstore=..., commitData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:873
      #28 0x00007f1d1d838b85 in EPBucket::flushVBucket (this=0x7f1d0a709000, vbid=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:742
      #29 0x00007f1d1d89071c in Flusher::flushVB (this=this@entry=0x7f1d0a773340) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/flusher.cc:306
      #30 0x00007f1d1d8918f9 in Flusher::step (this=0x7f1d0a773340, task=0x7f1d0a7345b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/flusher.cc:207
      #31 0x00007f1d1d894653 in GlobalTask::execute (this=0x7f1d0a7345b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/globaltask.cc:73
      #32 0x00007f1d1d79b00f in CB3ExecutorThread::run (this=0x7f1d181df500) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/cb3_executorthread.cc:188
      #33 0x00007f1d1c20d777 in run (this=0x7f1d18e242a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58
      #34 platform_thread_wrap (arg=0x7f1d18e242a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71
      #35 0x00007f1d1984add5 in start_thread () from /lib64/libpthread.so.0
      #36 0x00007f1d19573ead in clone () from /lib64/libc.so.6

      bt full: bt_full.txt

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sumedh.basarkod Sumedh Basarkod (Inactive)
            sumedh.basarkod Sumedh Basarkod (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty