Details
-
Bug
-
Resolution: Fixed
-
Critical
-
Cheshire-Cat
-
Untriaged
-
1
-
Yes
Description
Issue found in: 7.0.0-3800
Last good build: 7.0.0-3796
Test:
./testrunner -i node_conf.ini -p get-cbcollect-info=True,get-couch-dbinfo=True,skip_cleanup=False,skip_log_scan=False -t eventing.eventing_sanity.EventingSanity.test_source_doc_mutations_with_timers,nodes_init=4,services_init=kv-eventing-index-n1ql,dataset=default,groups=simple,reset_services=True,skip_cleanup=True,source_bucket_mutation=true
From memcached.log:
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009300-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x1b2c28]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009308-08:00 CRITICAL /lib64/libpthread.so.0() [0x7fba122cd000+0xf5e0]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009334-08:00 CRITICAL /lib64/libc.so.6(gsignal+0x37) [0x7fba11f0a000+0x351f7]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009356-08:00 CRITICAL /lib64/libc.so.6(abort+0x148) [0x7fba11f0a000+0x368e8]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009387-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7fba12a02000+0x91195]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009401-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x1acb92]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009423-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fba12a02000+0x8ef86]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009443-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fba12a02000+0x8efd1]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009465-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fba12a02000+0x8f213]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009479-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x2d422e]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009490-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x2d4396]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009499-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0xa1fa9]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009507-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0xa125b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009514-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0xf88c6]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009523-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x15abef]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009531-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x1517bf]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009537-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x155123]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009545-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x1a52ad]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009553-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x1dd69b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009560-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x185f73]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009567-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7fba15fef000+0x8724f]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009574-08:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7fba14a85000+0x10917]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009581-08:00 CRITICAL /lib64/libpthread.so.0() [0x7fba122cd000+0x7e25]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000007.txt:2020-11-19T08:55:36.009614-08:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7fba11f0a000+0xf834d]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.263002-08:00 CRITICAL *** Fatal error encountered during exception handling ***', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.263167-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): CBStatCollector::formatKey: Failed to format stat: "eq_dcpq:eventing:uhua9csy-12:{eventing:uhua9csy-11:172.23.105.153:8096_172.23.105.151:11210_worker_Function_186536740_test_source_doc_mutations_with_timers_1}/0:type" : argument not found', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444482-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-3800). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/bf5410f1-c35a-4229-234e2883-a0a6d7cd.dmp before terminating.', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444525-08:00 CRITICAL Stack backtrace of crashed thread:', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444760-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x19d16d]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444790-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x1b28ea]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444803-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x1b2c28]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444811-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f396c650000+0xf5e0]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444839-08:00 CRITICAL /lib64/libc.so.6(gsignal+0x37) [0x7f396c28d000+0x351f7]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444874-08:00 CRITICAL /lib64/libc.so.6(abort+0x148) [0x7f396c28d000+0x368e8]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444910-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7f396cd85000+0x91195]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444925-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x1acb92]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444946-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f396cd85000+0x8ef86]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444966-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f396cd85000+0x8efd1]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.444994-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f396cd85000+0x8f213]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445009-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x2d422e]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445019-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x2d4396]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445029-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0xa1fa9]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445036-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0xa125b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445043-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0xf88c6]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445110-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x15abef]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445120-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x1517bf]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445129-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x155123]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445138-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x1a52ad]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445147-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x1dd69b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445157-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x185f73]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445199-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f3970372000+0x8724f]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445207-08:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f396ee08000+0x10917]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445214-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f396c650000+0x7e25]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000008.txt:2020-11-19T08:56:38.445256-08:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7f396c28d000+0xf834d]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.193820-08:00 CRITICAL *** Fatal error encountered during exception handling ***', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.193888-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): CBStatCollector::formatKey: Failed to format stat: "eq_dcpq:eventing:uhua9csy-28:{eventing:uhua9csy-24:05eafb700f3455fdcbf2c476ed1b0420_Function_186536740_test_source_doc_mutations_with_timers_3_undeploy}/0:type" : argument not found', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.393783-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-3800). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/0933be59-5da0-4b2b-99e94483-502757ad.dmp before terminating.', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.393814-08:00 CRITICAL Stack backtrace of crashed thread:', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394017-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x19d16d]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394038-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x1b28ea]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394084-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x1b2c28]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394099-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f5e75292000+0xf5e0]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394130-08:00 CRITICAL /lib64/libc.so.6(gsignal+0x37) [0x7f5e74ecf000+0x351f7]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394165-08:00 CRITICAL /lib64/libc.so.6(abort+0x148) [0x7f5e74ecf000+0x368e8]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394201-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7f5e759c7000+0x91195]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394215-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x1acb92]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394237-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f5e759c7000+0x8ef86]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394257-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f5e759c7000+0x8efd1]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394286-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f5e759c7000+0x8f213]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394300-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x2d422e]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394311-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x2d4396]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394321-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0xa1fa9]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394328-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0xa125b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394336-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0xf88c6]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394345-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x15abef]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394353-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x1517bf]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394363-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x155123]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394372-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x1a52ad]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394380-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x1dd69b]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394387-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x185f73]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394395-08:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f5e78fb4000+0x8724f]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394402-08:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f5e77a4a000+0x10917]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394409-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f5e75292000+0x7e25]', '/opt/couchbase/var/lib/couchbase/logs/memcached.log.000009.txt:2020-11-19T08:57:40.394450-08:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7f5e74ecf000+0xf834d]']
|
Attaching logs