Uploaded image for project: 'Java Couchbase JVM Core'
  1. Java Couchbase JVM Core
  2. JVMCBC-448

Sporadic Unhandled Select Bucket status 1

    XMLWordPrintable

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0, 1.4.8
    • Core

    Description

      This happens sporadically in different tests particularly when attempting to load documents into buckets

      Stacktrace:

      2017-07-25T07:08:27.343Z INFO CBASTEST.common.TestExecutor [main] Starting [TEST]: feeds/resume ... 2017-07-25T07:08:27.347Z WARN CBASTEST.endpoint.Endpoint [cb-io-1-3] [null][KeyValueEndpoint]: Authentication Failure. 2017-07-25T07:08:27.347Z WARN CBASTEST.endpoint.Endpoint [cb-io-1-3] Error during reconnect: com.couchbase.client.core.endpoint.kv.AuthenticationException: Unhandled select bucket status: 1 at com.couchbase.client.core.endpoint.kv.KeyValueSelectBucketHandler.channelRead0(KeyValueSelectBucketHandler.java:139) [core-io-1.4.7.jar:?] at com.couchbase.client.core.endpoint.kv.KeyValueSelectBucketHandler.channelRead0(KeyValueSelectBucketHandler.java:41) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:438) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:267) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:253) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:625) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:560) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:477) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:439) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144) [core-io-1.4.7.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121] 2017-07-25T07:08:27.347Z WARN CBASTEST.endpoint.Endpoint [cb-io-1-3] [null][KeyValueEndpoint]: Could not connect to endpoint, retrying with delay 4096 MILLISECONDS: com.couchbase.client.core.endpoint.kv.AuthenticationException: Unhandled select bucket status: 1 at com.couchbase.client.core.endpoint.kv.KeyValueSelectBucketHandler.channelRead0(KeyValueSelectBucketHandler.java:139) [core-io-1.4.7.jar:?] at com.couchbase.client.core.endpoint.kv.KeyValueSelectBucketHandler.channelRead0(KeyValueSelectBucketHandler.java:41) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:438) [core-io-1.4.7.jar:?] at com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293) [core-io-1.4.7.jar:?]

      Another instance:

      http://analytics.jenkins.couchbase.com/job/cbas-ingestion-test-spock/com.couchbase.analytics$cbas-ingestion-test/770/testReport/junit/com.couchbase.analytics.test.integration/IntegrationTest/test_IntegrationTest_24__feeds__load_empty_bucket_new_syntax_/

      This keeps failing for a long time then times out...

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Check the line before, looks like you got an auth error

            25T07:08:27.347Z WARN CBASTEST.endpoint.Endpoint [cb-io-1-3] [null][KeyValueEndpoint]: Authentication Failure.

            this is why select bucket returns 1 (not found or auth error)

            ... probably we are not stopping doing the select bucket on auth error before but we should. I'll see if I can enhance that but the root cause is somewhere out of our control (auth error)

            daschl Michael Nitschinger added a comment - Check the line before, looks like you got an auth error 25T07:08:27.347Z WARN CBASTEST.endpoint.Endpoint [cb-io-1-3] [null] [KeyValueEndpoint] : Authentication Failure. this is why select bucket returns 1 (not found or auth error) ... probably we are not stopping doing the select bucket on auth error before but we should. I'll see if I can enhance that but the root cause is somewhere out of our control (auth error)

            Hm against which server version (and build) are you running this? When I run it against 3456 I always get error 0x24; not 0x01 which clearly identifies it as an access error...

            daschl Michael Nitschinger added a comment - Hm against which server version (and build) are you running this? When I run it against 3456 I always get error 0x24; not 0x01 which clearly identifies it as an access error...

            Also please check the memcached server logs on what they say

            daschl Michael Nitschinger added a comment - Also please check the memcached server logs on what they say

            We are now explicitly handling/failing with that error.

            daschl Michael Nitschinger added a comment - We are now explicitly handling/failing with that error.

            People

              daschl Michael Nitschinger
              Abdullah.Alamoudi Abdullah Alamoudi [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty