Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-30007

[CX] ClusterExecutionIT: rollback: partial-rollback-primary-only fails with "The vbucket belongs to another server(0x7)"

    XMLWordPrintable

    Details

    • Triage:
      Untriaged
    • Is this a Regression?:
      Unknown
    • Sprint:
      CX Sprint 106

      Description

      2018-06-06T17:17:26.959-07:00 ERRO CBAS.active.ActiveEntityEventsListener [QueryTranslator] Failed to start the entity Default.gbook_user_bucket(CouchbaseMetadataExtension)
      org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.Exception: Failover response The vbucket belongs to another server(0x7)
      	at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:51) ~[hyracks-api.jar:6.0.0-0000]
      	at com.couchbase.analytics.util.DcpUtil.fetchCurrentState(DcpUtil.java:92) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.adapter.CouchbaseConnectorFactory.calculateStartingPoint(CouchbaseConnectorFactory.java:311) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.runtime.BucketOperatorDescriptor.calculateStartingPoint(BucketOperatorDescriptor.java:75) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.lang.ConnectBucketStatement.combine(ConnectBucketStatement.java:185) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.lang.ConnectBucketStatement.doConnect(ConnectBucketStatement.java:514) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.metadata.BucketEventsListener.doConnect(BucketEventsListener.java:185) ~[cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.metadata.BucketEventsListener.doStart(BucketEventsListener.java:167) ~[cbas-connector.jar:6.0.0-0000]
      	at org.apache.asterix.app.active.ActiveEntityEventsListener.start(ActiveEntityEventsListener.java:379) [asterix-app.jar:6.0.0-0000]
      	at com.couchbase.analytics.lang.ConnectBucketStatement.connect(ConnectBucketStatement.java:406) [cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.lang.ConnectBucketStatement.doHandle(ConnectBucketStatement.java:352) [cbas-connector.jar:6.0.0-0000]
      	at com.couchbase.analytics.lang.FailDuringRebalanceStatement.handle(FailDuringRebalanceStatement.java:32) [cbas-connector.jar:6.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:402) [asterix-app.jar:6.0.0-0000]
      	at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:130) [asterix-app.jar:6.0.0-0000]
      	at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:66) [asterix-app.jar:6.0.0-0000]
      	at org.apache.hyracks.control.cc.work.ApplicationMessageWork$1.run(ApplicationMessageWork.java:59) [hyracks-control-cc.jar:6.0.0-0000]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
      	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
      Caused by: java.lang.Exception: Failover response The vbucket belongs to another server(0x7)
      	at com.couchbase.client.dcp.conductor.DcpChannelControlMessageHandler.handleFailoverLogResponse(DcpChannelControlMessageHandler.java:122) ~[cbas-dcp-client.jar:6.0.0-0000]
      	at com.couchbase.client.dcp.conductor.DcpChannelControlMessageHandler.onEvent(DcpChannelControlMessageHandler.java:41) ~[cbas-dcp-client.jar:6.0.0-0000]
      	at com.couchbase.client.dcp.transport.netty.DcpMessageHandler.channelRead(DcpMessageHandler.java:119) ~[cbas-dcp-client.jar:6.0.0-0000]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1302) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:135) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:646) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:581) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:498) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:460) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) ~[core-io-1.5.6.jar:?]
      	at com.couchbase.client.deps.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[core-io-1.5.6.jar:?]
      
      

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          till Till Westmann added a comment -

          The same error in [ClusterExecutionIT: rollback: partial-rollback-with-secondaries] on http://analytics.jenkins.couchbase.com/job/asterixdb-gerrit-test/4670/

          Show
          till Till Westmann added a comment - The same error in [ClusterExecutionIT: rollback: partial-rollback-with-secondaries]  on  http://analytics.jenkins.couchbase.com/job/asterixdb-gerrit-test/4670/
          Hide
          till Till Westmann added a comment -

          Description for release notes:

          Summary: Known Issue It is possible for a CONNECT BUCKET statement to fail temporarily with the error message "The vbucket belongs to another server(0x7)" when rebalancing Data nodes.

          Workaround: Retry the operation.

          Show
          till Till Westmann added a comment - Description for release notes: Summary: Known Issue It is possible for a CONNECT BUCKET statement to fail temporarily with the error message "The vbucket belongs to another server(0x7)" when rebalancing Data nodes. Workaround : Retry the operation.

            People

            • Assignee:
              tanzeem.ahmed Tanzeem Ahmed
              Reporter:
              till Till Westmann
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes

                  PagerDuty

                  Error rendering 'com.pagerduty.jira-server-plugin:PagerDuty'. Please contact your Jira administrators.