Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58621

ERROR 8347: ERROR 8347: Exception occurred during DCP step(). Closing connection Monotonic<m> (ActiveStream(eq_dcpq:secidx:proj-INIT_STREAM_TOPIC_688679a879ea150eeec8592c8a290cec-14660100701909649276/0 (vb:360))::curChkSeqno)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • 7.6.0
    • 7.6.0
    • couchbase-bucket
    • 7.6.0-1484, OS= Debian 11

    Description

      Steps To Recreate:

      1. Create a 3 node cluster[172.23.121.146(KV+N1QL), 172.23.121.105(index), 172.23.121.155 (index)indexer.settings.storage_mode': 'memory_optimized, ]
      2. Create a magma bucket(replicas=1, RAM_Quota=256MiB)
      3. indexer.settings.storage_mode': 'memory_optimized,
      4. create 1000 docs
      5. Create primary index
      6. Run query SELECT * FROM system:indexes where name = '#primary'
      7. Using cbworkloadgen load 1000000 docs(1024 bytes, json docs)
      8. Drop primary index
      9. RUN QUERY SELECT * FROM system:indexes where name = '#primary'
      10. Observed cbworkloadgen was triggered at 2023-09-12 07:46:00 and below error was observed at 2023-09-12T07:46:12

      Below error was found on node172.23.121.146
      Memcached Logs:

       
      2023-09-12T07:46:12.658222-07:00 ERROR 8347: Exception occurred during DCP step(). Closing connection [ {"ip":"172.23.121.146","port":33364} - {"ip":"172.23.121.146","port":11210} (System, <ud>@projector</ud>) ]: Monotonic<m> (ActiveStream(eq_dcpq:secidx:proj-INIT_STREAM_TOPIC_688679a879ea150eeec8592c8a290cec-14660100701909649276/0 (vb:360))::curChkSeqno) invariant failed: new value (25) breaks invariant on current value (54). Cookies: [] Exception thrown from: ["#0  /opt/couchbase/bin/memcached() [0x400000+0x171eab]","#1  /opt/couchbase/bin/memcached() [0x400000+0x5f404d]","#2  /opt/couchbase/bin/memcached() [0x400000+0x6064fd]","#3  /opt/couchbase/bin/memcached() [0x400000+0x5f9b7b]","#4  /opt/couchbase/bin/memcached() [0x400000+0x5fa19d]","#5  /opt/couchbase/bin/memcached() [0x400000+0x5fff95]","#6  /opt/couchbase/bin/memcached() [0x400000+0x4f36d6]","#7  /opt/couchbase/bin/memcached() [0x400000+0x4f4414]","#8  /opt/couchbase/bin/memcached() [0x400000+0x375c6d]","#9  /opt/couchbase/bin/memcached() [0x400000+0x25cb4e]","#10 /opt/couchbase/bin/memcached() [0x400000+0x25dbd0]","#11 /opt/couchbase/bin/memcached() [0x400000+0x26a6a6]","#12 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fcb0865f000+0xf84e]","#13 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7fcb0865f000+0x18b99]","#14 /opt/couchbase/bin/../lib/libevent_core-2.1.so.7(event_base_loop+0x357) [0x7fcb0865f000+0x19287]","#15 /opt/couchbase/bin/memcached() [0x400000+0x9a5aa6]","#16 /opt/couchbase/bin/memcached() [0x400000+0x9a5fae]","#17 /opt/couchbase/bin/memcached() [0x400000+0x9a8478]","#18 /opt/couchbase/bin/memcached() [0x400000+0x20a5f9]","#19 /opt/couchbase/bin/memcached() [0x400000+0x91990c]","#20 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fcb07935000+0xd6f00]","#21 /lib/x86_64-linux-gnu/libpthread.so.0() [0x7fcb08007000+0x7ea7]","#22 /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7fcb07601000+0xfba2f]"]
      

      QE-TEST:

      ./testrunner -i /data/workspace/debian-p0-2i-vset00-00-rebalance_green_memdb/testexec.15349.ini -p gsi_type=memory_optimized,reset_services=True,GROUP=GREEN,use_gsi_for_primary=True,index_quota_percent=30,get-cbcollect-info=True,sirius_url=http://172.23.120.103:4000 -t gsi.gsi_rebalance_gsi.SecondaryIndexingRebalanceTests.test_retry_rebalance,doc-per-day=1000,dataset=array,nodes_init=3,services_init=kv:n1ql-index-index,groups=simple,reset_services=True,sleep_time=1,wait_timeout=15,retry_time=180,GROUP=GREEN
      

      JOB:: http://qa.sc.couchbase.com/job/test_suite_executor/617867/consoleFull

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ankush.sharma Ankush Sharma
              ankush.sharma Ankush Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty