Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44290

Crash observed with KV rebalance out and swap

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.0.0-4390

      172.23.122.170 memcached.log

       2021-02-06T19:45:43.409886-08:00 INFO 4: Client {"ip":"172.23.96.72","port":58078} authenticated as <ud>cbadminbucket</ud>
      2021-02-06T19:46:08.306624-08:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-02-06T19:46:08.306764-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): ThrowExceptionUnderflowPolicy current:0 arg:-328
      2021-02-06T19:46:08.488921-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-4390). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/075fe5e5-c5a7-4b64-7a2352a5-96bf83a1.dmp before terminating.
      2021-02-06T19:46:08.488949-08:00 CRITICAL Stack backtrace of crashed thread:
      2021-02-06T19:46:08.489142-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x14618d]
      2021-02-06T19:46:08.489160-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x15b9ba]
      2021-02-06T19:46:08.489169-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x15bcf8]
      2021-02-06T19:46:08.489178-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f66d19c0000+0xf5f0]
      2021-02-06T19:46:08.489200-08:00 CRITICAL     /lib64/libc.so.6(gsignal+0x37) [0x7f66d15f2000+0x36337]
      2021-02-06T19:46:08.489221-08:00 CRITICAL     /lib64/libc.so.6(abort+0x148) [0x7f66d15f2000+0x37a28]
      2021-02-06T19:46:08.489246-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7f66d20f5000+0x91195]
      2021-02-06T19:46:08.489263-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x155bf2]
      2021-02-06T19:46:08.489278-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f66d20f5000+0x8ef86]
      2021-02-06T19:46:08.489420-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f66d20f5000+0x8efd1]
      2021-02-06T19:46:08.489432-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x16ee03]
      2021-02-06T19:46:08.489440-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x168e62]
      2021-02-06T19:46:08.489451-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x2e97f6]
      2021-02-06T19:46:08.489471-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x2d1cea]
      2021-02-06T19:46:08.489502-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x2ec919]
      2021-02-06T19:46:08.489521-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f66d5a26000+0x1672a3]
      2021-02-06T19:46:08.489552-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f66d20f5000+0xb9dcf]
      2021-02-06T19:46:08.489559-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f66d19c0000+0x7e65]
      2021-02-06T19:46:08.489595-08:00 CRITICAL     /lib64/libc.so.6(clone+0x6d) [0x7f66d15f2000+0xfe88d]
      2021-02-06T19:46:08.490964-08:00 INFO ---------- Closing logfile
      2021-02-06T19:46:08.580104-08:00 INFO ---------- Opening logfile: /opt/couchbase/var/lib/couchbase/logs/memcached.log.000005.txt
      2021-02-06T19:46:08.581954-08:00 INFO Couchbase version 7.0.0-4390 starting.
      
      

      Tests

      ./testrunner -i /tmp/testexec.2791.ini -p get-cbcollect-info=True,GROUP=bucket_op,skip_log_scan=False,bucket_storage=couchstore -t eventing.eventing_rebalance.EventingRebalance.test_kv_rebalance_out_when_existing_eventing_node_is_processing_mutations,nodes_init=7,services_init=kv-kv-kv-eventing-eventing-eventing-index:n1ql,dataset=default,groups=simple,reset_services=True,doc-per-day=20,GROUP=bucket_op;bucket_op_windows
       
       
      ./testrunner -i /tmp/testexec.2791.ini -p get-cbcollect-info=True,GROUP=bucket_op,skip_log_scan=False,bucket_storage=couchstore -t eventing.eventing_rebalance.EventingRebalance.test_kv_swap_rebalance_when_existing_eventing_node_is_processing_mutations,nodes_init=6,services_init=kv-kv-eventing-eventing-eventing-index:n1ql,dataset=default,groups=simple,reset_services=True,doc-per-day=20,GROUP=bucket_op;bucket_op_windows 

      Attachments

        1. 172.23.122.170-20210206-2000-diag.zip
          26.20 MB
        2. 172.23.122.172-20210206-2000-diag.zip
          18.16 MB
        3. 172.23.122.173-20210206-2000-diag.zip
          23.67 MB
        4. 172.23.122.174-20210206-2000-diag.zip
          29.87 MB
        5. 172.23.122.175-20210206-2000-diag.zip
          24.18 MB
        6. 172.23.122.176-20210206-2000-diag.zip
          16.74 MB
        7. 172.23.122.177-20210206-2000-diag.zip
          19.66 MB
        8. 172.23.122.178-20210206-2000-diag.zip
          21.72 MB
        9. test.log
          200 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            vikas.chaudhary Vikas Chaudhary
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty