Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
7.6.0
-
7.6.0-1484, OS= Debian 11
-
Triaged
-
Linux x86_64
-
0
-
Unknown
-
KV 2023-4
Description
Steps To Recreate:
- Create a 3 node cluster[172.23.121.146(KV+N1QL), 172.23.121.105(index), 172.23.121.155 (index)indexer.settings.storage_mode': 'memory_optimized, ]
- Create a magma bucket(replicas=1, RAM_Quota=256MiB)
- indexer.settings.storage_mode': 'memory_optimized,
- create 1000 docs
- Create primary index
- Run query SELECT * FROM system:indexes where name = '#primary'
- Using cbworkloadgen load 1000000 docs(1024 bytes, json docs)
- Drop primary index
- RUN QUERY SELECT * FROM system:indexes where name = '#primary'
- Observed cbworkloadgen was triggered at 2023-09-12 07:46:00 and below error was observed at 2023-09-12T07:46:12
Below error was found on node172.23.121.146
Memcached Logs:
|
2023-09-12T07:46:12.658222-07:00 ERROR 8347: Exception occurred during DCP step(). Closing connection [ {"ip":"172.23.121.146","port":33364} - {"ip":"172.23.121.146","port":11210} (System, <ud>@projector</ud>) ]: Monotonic<m> (ActiveStream(eq_dcpq:secidx:proj-INIT_STREAM_TOPIC_688679a879ea150eeec8592c8a290cec-14660100701909649276/0 (vb:360))::curChkSeqno) invariant failed: new value (25) breaks invariant on current value (54). Cookies: [] Exception thrown from: ["#0 /opt/couchbase/bin/memcached() [0x400000+0x171eab]","#1 /opt/couchbase/bin/memcached() [0x400000+0x5f404d]","#2 /opt/couchbase/bin/memcached() [0x400000+0x6064fd]","#3 /opt/couchbase/bin/memcached() [0x400000+0x5f9b7b]","#4 /opt/couchbase/bin/memcached() [0x400000+0x5fa19d]","#5 /opt/couchbase/bin/memcached() [0x400000+0x5fff95]","#6 /opt/couchbase/bin/memcached() [0x400000+0x4f36d6]","#7 /opt/couchbase/bin/memcached() [0x400000+0x4f4414]","#8 /opt/couchbase/bin/memcached() [0x400000+0x375c6d]","#9 /opt/couchbase/bin/memcached() [0x400000+0x25cb4e]","#10 /opt/couchbase/bin/memcached() [0x400000+0x25dbd0]","#11 /opt/couchbase/bin/memcached() [0x400000+0x26a6a6]","#12 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fcb0865f000+0xf84e]","#13 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fcb0865f000+0x18b99]","#14 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7(event_base_loop+0x357) [0x7fcb0865f000+0x19287]","#15 /opt/couchbase/bin/memcached() [0x400000+0x9a5aa6]","#16 /opt/couchbase/bin/memcached() [0x400000+0x9a5fae]","#17 /opt/couchbase/bin/memcached() [0x400000+0x9a8478]","#18 /opt/couchbase/bin/memcached() [0x400000+0x20a5f9]","#19 /opt/couchbase/bin/memcached() [0x400000+0x91990c]","#20 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fcb07935000+0xd6f00]","#21 /lib/x86_64-linux-gnu/libpthread.so.0() [0x7fcb08007000+0x7ea7]","#22 /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7fcb07601000+0xfba2f]"]
|
QE-TEST:
./testrunner -i /data/workspace/debian-p0-2i-vset00-00-rebalance_green_memdb/testexec.15349.ini -p gsi_type=memory_optimized,reset_services=True,GROUP=GREEN,use_gsi_for_primary=True,index_quota_percent=30,get-cbcollect-info=True,sirius_url=http://172.23.120.103:4000 -t gsi.gsi_rebalance_gsi.SecondaryIndexingRebalanceTests.test_retry_rebalance,doc-per-day=1000,dataset=array,nodes_init=3,services_init=kv:n1ql-index-index,groups=simple,reset_services=True,sleep_time=1,wait_timeout=15,retry_time=180,GROUP=GREEN
|
JOB:: http://qa.sc.couchbase.com/job/test_suite_executor/617867/consoleFull
Attachments
Issue Links
- duplicates
-
MB-58961 ERROR 9263: Exception occurred during DCP step(). (System, @projector) ]: Monotonic<m> (ActiveStream(eq_dcpq:secidx:proj-INIT_STREAM_TOPIC_0dcc0ce7dad4cbd476f442baa974a588-9490838748024550633/0 (vb:868))::curChkSeqno) invariant failed
- Closed
For Gerrit Dashboard: MB-58621 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
197190,2 | MB-58621: Crash when DCP throws an exception in debug builds | master | kv_engine | Status: ABANDONED | -1 | +1 |
197310,2 | MB-58621: Log the curChkSeqno when we mark a stream as slow | master | kv_engine | Status: MERGED | +2 | +1 |