Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46666

[System Test][Analytics] ERRO CBAS.util.ResourceLeakDetector [nioEventLoopGroup-2-8] LEAK: ByteBuf.release() was not called before it's garbage-collected

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Yes

    Description

      7.0.0-5247

      Test:
      -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale 3
      Iteration 1

      .120.75:

      021-05-29T05:08:47.944-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.366-07:00 WARN CBAS.server.ChunkedResponse [HighPriorityHttpExecutor(port:8095)-11] Error after header write of chunked response
      		 
      2021-05-29T05:08:48.553-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.554-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.554-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.587-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.587-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:48.587-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.344-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.344-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.344-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.496-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.496-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:49.496-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.020-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.020-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.020-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.841-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.841-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:50.841-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.346-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previous seqno(0x19abd) for vbid: 286
      		 
      2021-05-29T05:08:52.438-07:00 ERRO CBAS.util.ResourceLeakDetector [nioEventLoopGroup-2-8] LEAK: ByteBuf.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
      		 
      Recent access records: 
      Created at:
      		 
      	com.couchbase.client.deps.io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:402)
      		 
      	com.couchbase.client.deps.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
      		 
      	com.couchbase.client.deps.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
      		 
      	com.couchbase.client.deps.io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:115)
      		 
      	com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.expandCumulation(ByteToMessageDecoder.java:539)
      		 
      	com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder$1.cumulate(ByteToMessageDecoder.java:97)
      		 
      	com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:274)
      		 
      	com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
      		 
      	com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
      		 
      	com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
      		 
      	com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
      		 
      	com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
      		 
      	com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
      		 
      	com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
      		 
      	com.couchbase.client.deps.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
      		 
      	com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
      		 
      	com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
      		 
      	com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
      		 
      	com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
      		 
      	com.couchbase.client.deps.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
      		 
      	com.couchbase.client.deps.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
      		 
      	com.couchbase.client.deps.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
      		 
      	java.base/java.lang.Thread.run(Unknown Source)
      		 
      2021-05-29T05:08:52.461-07:00 WARN CBAS.state.StreamPartitionState [nioEventLoopGroup-2-5] new seqno received (0x19abd) <= the previo

      Logs:
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.106.134.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.58.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.73.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.74.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.75.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.77.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.81.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.120.86.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.24.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.25.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.26.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.31.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.32.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.123.33.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.96.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.96.14.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.96.243.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.96.254.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.96.48.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.105.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.110.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.112.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.148.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.149.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.150.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.151.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.241.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1622295974/collectinfo-2021-05-29T134615-ns_1%40172.23.97.74.zip

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-46567 LEAK: ByteBuf.release() was not called before it's garbage-collected

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is triggering

          Bug - A problem which impairs or prevents the functions of the product. MB-47534 Unexpected duplicate SEQNO_ADVANCED from DCP producer

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              till Till Westmann
              arunkumar Arunkumar Senthilnathan (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty