Established TCP socket on 40161 maven33-agent.jar already up to date maven33-interceptor.jar already up to date maven3-interceptor-commons.jar already up to date <===[JENKINS REMOTING CAPACITY]===>channel started Executing Maven: -B -f /home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/cbas-cbserver-test/pom.xml -Dmaven.repo.local=/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository -B verify -P jenkins -Dit.test=*IT,!ClusterExecutionIT [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building cbas-cbserver-test 1.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ cbas-cbserver-test --- [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (check-java-implementation) @ cbas-cbserver-test --- [INFO] [INFO] --- formatter-maven-plugin:2.0.1:format (default) @ cbas-cbserver-test --- [INFO] Using 'UTF-8' encoding to format source files. [INFO] Number of files to be formatted: 6 [INFO] Successfully formatted: 0 file(s) [INFO] Fail to format: 0 file(s) [INFO] Skipped: 6 file(s) [INFO] Read only skipped: 0 file(s) [INFO] Approximate time taken: 0s [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ cbas-cbserver-test --- [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ cbas-cbserver-test --- [INFO] [INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ cbas-cbserver-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/cbas-cbserver-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.6.1:compile (default-compile) @ cbas-cbserver-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-checkstyle-plugin:2.17:check (verify-style) @ cbas-cbserver-test --- [INFO] [INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ cbas-cbserver-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 322 resources [INFO] [INFO] --- maven-dependency-plugin:2.10:unpack-dependencies (unpack-cbas-ingestion-test-tests) @ cbas-cbserver-test --- [INFO] cbas-ingestion-test-1.0.0-SNAPSHOT-tests.jar already exists in destination. [INFO] [INFO] --- maven-compiler-plugin:3.6.1:testCompile (default-testCompile) @ cbas-cbserver-test --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-dependency-plugin:2.10:analyze-only (default) @ cbas-cbserver-test --- [INFO] No dependency problems found [INFO] [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ cbas-cbserver-test --- [JENKINS] Recording test results [INFO] [INFO] --- maven-jar-plugin:3.0.0:jar (default-jar) @ cbas-cbserver-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] [INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ cbas-cbserver-test --- [INFO] [INFO] --- maven-failsafe-plugin:2.20:integration-test (default) @ cbas-cbserver-test --- [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running com.couchbase.analytics.test.cbq.CbqInteropIT 2017-10-09T18:15:02.527-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 10 seconds... 2017-10-09T18:15:04.554-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] starting cluster_run 2017-10-09T18:15:18.083-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster is running 2017-10-09T18:15:18.084-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] configuring cluster with services: [ANALYTICS, DATA] 2017-10-09T18:15:25.043-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-1] >> SUCCESS: Node initialized 2017-10-09T18:15:26.129-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-2] >> SUCCESS: Cluster initialized 2017-10-09T18:15:26.135-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Rebalancing from [0] to [0] 2017-10-09T18:15:26.385-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Nothing to do, requested topology already in place: [0] 2017-10-09T18:15:33.589-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-3] >> Unable to display progress bar on this os 2017-10-09T18:15:33.590-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-3] >> SUCCESS: Rebalance complete Integrated cluster running on http://couchbase:couchbase@localhost:9000; Analytics running on http://127.0.0.1:9300 (debug port: 9309) 2017-10-09T18:15:35.599-07:00 INFO CBAS.cbq.CbqInteropIT [main] Running CBQ from /home/couchbase/jenkins/workspace/cbas-cbcluster-test/install/bin/cbq ## test[CbqInteropIT 0: basic/select1.sqlpp] START 2017-10-09T18:15:35.608-07:00 INFO CBAS.cbq.CbqInteropIT [main] Invoking CBQ: [/home/couchbase/jenkins/workspace/cbas-cbcluster-test/install/bin/cbq, -quiet, -u, couchbase, -p, couchbase, -engine, http://127.0.0.1:9300, -file, /home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/cbas-cbserver-test/src/test/resources/runtimets/CbqInteropIT/queries/basic/select1.sqlpp] ## test[CbqInteropIT 0: basic/select1.sqlpp] SUCCEEDED 2017-10-09T18:15:36.995-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] shutting down cluster_run... 2017-10-09T18:15:36.998-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run sent SIGINT 2017-10-09T18:15:38.111-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run has exited [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.258 s - in com.couchbase.analytics.test.cbq.CbqInteropIT [INFO] Running com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT 2017-10-09T18:15:39.826-07:00 INFO CBAS.util.CBTestEnvironmentProvider [main] Initializing Test Couchbase Environment SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/apache/logging/log4j/log4j-slf4j-impl/2.7/log4j-slf4j-impl-2.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2017-10-09T18:15:40.181-07:00 INFO CBAS.core.CouchbaseCore [main] CouchbaseEnvironment: {sslEnabled=false, sslKeystoreFile='null', sslKeystorePassword=false, sslKeystore=null, bootstrapHttpEnabled=true, bootstrapCarrierEnabled=true, bootstrapHttpDirectPort=9000, bootstrapHttpSslPort=18091, bootstrapCarrierDirectPort=12000, bootstrapCarrierSslPort=11207, ioPoolSize=4, computationPoolSize=4, responseBufferSize=16384, requestBufferSize=16384, kvServiceEndpoints=1, viewServiceEndpoints=12, queryServiceEndpoints=12, searchServiceEndpoints=12, configPollInterval=2500, ioPool=NioEventLoopGroup, kvIoPool=null, viewIoPool=null, searchIoPool=null, queryIoPool=null, coreScheduler=CoreScheduler, memcachedHashingStrategy=DefaultMemcachedHashingStrategy, eventBus=DefaultEventBus, packageNameAndVersion=couchbase-java-client/2.5.1 (git: 2.5.1, core: 1.5.1), retryStrategy=BestEffort, maxRequestLifetime=75000, retryDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=100, upper=100000}, reconnectDelay=ExponentialDelay{growBy 1.0 MILLISECONDS, powers of 2; lower=32, upper=4096}, observeIntervalDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=10, upper=100000}, keepAliveInterval=30000, continuousKeepAliveEnabled=true, keepAliveErrorThreshold=4, keepAliveTimeout=2500, autoreleaseAfter=75000, bufferPoolingEnabled=true, tcpNodelayEnabled=true, mutationTokensEnabled=false, socketConnectTimeout=1000, callbacksOnIoPool=false, disconnectTimeout=75000, requestBufferWaitStrategy=com.couchbase.client.core.env.DefaultCoreEnvironment$2@5965d37, certAuthEnabled=false, coreSendHook=null, queryTimeout=75000, viewTimeout=75000, searchTimeout=75000, analyticsTimeout=75000, kvTimeout=75000, connectTimeout=75000, dnsSrvEnabled=false} 2017-10-09T18:15:40.283-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 10 seconds... 2017-10-09T18:15:42.309-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] backing up existing data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data.save 2017-10-09T18:15:42.310-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] backing up existing logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs.save 2017-10-09T18:15:42.311-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] starting cluster_run 2017-10-09T18:16:17.333-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster is running 2017-10-09T18:16:17.333-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] configuring cluster with services: [ANALYTICS, DATA] 2017-10-09T18:16:47.820-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-5] >> SUCCESS: Node initialized 2017-10-09T18:16:49.452-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-6] >> SUCCESS: Cluster initialized 2017-10-09T18:16:49.456-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Rebalancing from [0] to [0, 1, 2, 3, 4, 5] 2017-10-09T18:16:50.491-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] adding node(s) [1, 2, 3, 4, 5] with service(s): [ANALYTICS] 2017-10-09T18:17:06.603-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-9] >> SUCCESS: Node initialized 2017-10-09T18:17:06.724-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-8] >> SUCCESS: Node initialized 2017-10-09T18:17:07.458-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-10] >> SUCCESS: Node initialized 2017-10-09T18:17:07.658-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-7] >> SUCCESS: Node initialized 2017-10-09T18:17:15.758-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-11] >> SUCCESS: Node initialized 2017-10-09T18:17:56.984-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-12] >> SUCCESS: Server added 2017-10-09T18:17:56.994-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T18:18:12.518-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-13] >> Unable to display progress bar on this os 2017-10-09T18:18:12.553-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-13] >> SUCCESS: Rebalance complete 2017-10-09T18:18:12.654-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Waiting for 'NCs == 6' condition for up to 30 seconds... 2017-10-09T18:18:12.788-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:18:15.094-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-14] >> Unable to display progress bar on this os 2017-10-09T18:18:15.097-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-14] >> SUCCESS: Rebalance complete Integrated cluster running on http://couchbase:couchbase@localhost:9000; Analytics running on http://127.0.0.1:9300 (debug port: 9309), http://127.0.0.1:9320 (debug port: 9329), http://127.0.0.1:9340 (debug port: 9349), http://127.0.0.1:9360 (debug port: 9369), http://127.0.0.1:9380 (debug port: 9389), http://127.0.0.1:9400 (debug port: 9409) 2017-10-09T18:18:25.866-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-15] >> Errors occurred during the index creation phase. See logs for details. 2017-10-09T18:18:25.877-07:00 INFO CBAS.common.TestExecutor [main] cbdocloader exit code: 1 2017-10-09T18:18:26.052-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] Using seed in rebalancer: 1507598306052 ## test[ClusterConcurrentRebalanceIT 0: feeds: parse-failure-to-delete] START 2017-10-09T18:18:26.271-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/parse-failure-to-delete ... 2017-10-09T18:18:28.071-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4] (keepMask: 8) 2017-10-09T18:18:28.074-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] entry 2017-10-09T18:18:28.074-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 3, 4, 5] to [0, 4] 2017-10-09T18:18:28.212-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_0 to 172.17.0.2:9000 2017-10-09T18:18:28.213-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [1, 2, 3, 5] 2017-10-09T18:18:28.220-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001,127.0.0.1:9002,127.0.0.1:9003,127.0.0.1:9005] 2017-10-09T18:18:28.406-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-16] >> ERROR: Some nodes specified to be removed are not part of the cluster 2017-10-09T18:18:28.430-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] exit 2017-10-09T18:18:28.433-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:18:28.433-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] entry 2017-10-09T18:18:28.435-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 3, 4, 5] to [0, 4] 2017-10-09T18:18:28.443-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_1 to 172.17.0.2:9001 2017-10-09T18:18:28.443-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_2 to 172.17.0.2:9002 2017-10-09T18:18:28.443-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_3 to 172.17.0.2:9003 2017-10-09T18:18:28.443-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_4 to 172.17.0.2:9004 2017-10-09T18:18:28.443-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updating cluster address for n_5 to 172.17.0.2:9005 2017-10-09T18:18:28.444-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [1, 2, 3, 5] 2017-10-09T18:18:28.444-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9001,172.17.0.2:9002,172.17.0.2:9003,172.17.0.2:9005] 2017-10-09T18:18:31.436-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:18:31.765-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-17] >> Unable to display progress bar on this os 2017-10-09T18:18:31.768-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-17] >> SUCCESS: Rebalance complete 2017-10-09T18:18:31.776-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:18:32.065-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:18:32.211-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] exit 2017-10-09T18:18:32.211-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4, 5] (keepMask: 24) 2017-10-09T18:18:32.212-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4, 5] entry 2017-10-09T18:18:32.212-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 4, 5] 2017-10-09T18:18:41.241-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:18:41.293-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:18:41.311-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:18:41.663-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-18] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:18:41.683-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4, 5] exit 2017-10-09T18:18:41.684-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4, 5] was cancelled (external) 2017-10-09T18:18:41.684-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:18:43.272-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3] (keepMask: 7) 2017-10-09T18:18:43.274-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:18:43.273-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:18:43.274-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3] entry 2017-10-09T18:18:43.278-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 1, 2, 3] 2017-10-09T18:18:54.541-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3] exit 2017-10-09T18:18:54.541-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3] was cancelled (internal) 2017-10-09T18:18:54.542-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 5] (keepMask: 19) 2017-10-09T18:18:54.542-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 5] entry 2017-10-09T18:18:54.542-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 1, 2, 5] 2017-10-09T18:18:54.585-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [1, 2, 5] with service(s): [ANALYTICS] 2017-10-09T18:18:55.571-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:19:00.463-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-22] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:19:00.470-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:19:04.349-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 5001 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:19:05.674-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 5136 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:19:06.875-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 7851 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:19:08.880-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-3] Opened bucket gbook_users 2017-10-09T18:19:09.006-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.002.adm 2017-10-09T18:19:09.284-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-4] Opened bucket gbook_users 2017-10-09T18:19:09.295-07:00 INFO CBAS.util.Loader [main] +++ caught java.lang.RuntimeException: java.util.concurrent.TimeoutException; new timeout 10 (gbook_users) +++ 2017-10-09T18:19:09.306-07:00 INFO CBAS.util.Loader [main] +++ caught java.lang.RuntimeException: java.util.concurrent.TimeoutException; new timeout 20 (gbook_users) +++ 2017-10-09T18:19:09.327-07:00 INFO CBAS.util.Loader [main] +++ caught java.lang.RuntimeException: java.util.concurrent.TimeoutException; new timeout 40 (gbook_users) +++ 2017-10-09T18:19:09.368-07:00 INFO CBAS.util.Loader [main] +++ caught java.lang.RuntimeException: java.util.concurrent.TimeoutException; new timeout 80 (gbook_users) +++ 2017-10-09T18:19:09.371-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.003.adm 2017-10-09T18:19:10.747-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:19:15.748-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-19] >> SUCCESS: Node initialized 2017-10-09T18:19:16.836-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-21] >> SUCCESS: Node initialized 2017-10-09T18:19:16.900-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-20] >> SUCCESS: Node initialized 2017-10-09T18:19:36.609-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-23] >> SUCCESS: Server added 2017-10-09T18:19:36.613-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [4] 2017-10-09T18:19:36.613-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9004] 2017-10-09T18:19:48.936-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-24] >> Unable to display progress bar on this os 2017-10-09T18:19:48.936-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-24] >> ERROR: Rebalance failed. See logs for detailed reason. You can try again. 2017-10-09T18:19:48.948-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 5] exit 2017-10-09T18:19:48.948-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 5] was cancelled (external) 2017-10-09T18:19:48.948-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:19:49.222-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:19:49.223-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 4, 5] (keepMask: 26) 2017-10-09T18:19:49.223-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 12 secs 2017-10-09T18:19:49.223-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 4, 5] entry 2017-10-09T18:19:49.223-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 2, 4, 5] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.011.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The number of active operations cannot be negative! 2017-10-09T18:19:49.236-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updated state to reflect cluster (was: [0, 4] now: [0, 1, 4, 5]) org.apache.asterix.common.exceptions.AsterixException: The number of active operations cannot be negative! at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! 2017-10-09T18:19:49.240-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/parse-failure-to-delete PASSED 2017-10-09T18:19:49.244-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2] with service(s): [ANALYTICS] ## test[ClusterConcurrentRebalanceIT 0: feeds: parse-failure-to-delete] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 1: feeds: binary-doc] START 2017-10-09T18:19:49.278-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/binary-doc ... 2017-10-09T18:19:49.300-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:19:50.790-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:19:50.790-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:19:53.791-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:19:53.802-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:19:58.142-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-25] >> SUCCESS: Node initialized 2017-10-09T18:20:01.161-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:20:01.183-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:20:07.177-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-26] >> SUCCESS: Server added 2017-10-09T18:20:07.180-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 4, 5] exit 2017-10-09T18:20:07.181-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 4, 5] was cancelled (external) 2017-10-09T18:20:07.181-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:20:07.242-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:20:07.243-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 4, 5] (keepMask: 25) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/binary-doc/binary-doc.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:20:07.243-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 4, 5] entry at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114)2017-10-09T18:20:07.243-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4, 5] to [0, 1, 4, 5] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 1: feeds: binary-doc] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 2: feeds: connect-new-disconnected-bucket] START 2017-10-09T18:20:07.254-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Updated state to reflect cluster (was: [0, 1, 4, 5] now: [0, 1, 2, 4, 5]) 2017-10-09T18:20:07.254-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [2] 2017-10-09T18:20:07.254-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9002] 2017-10-09T18:20:07.263-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-new-disconnected-bucket ... 2017-10-09T18:20:07.269-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:20:10.638-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-27] >> Unable to display progress bar on this os 2017-10-09T18:20:10.638-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-27] >> SUCCESS: Rebalance complete 2017-10-09T18:20:10.644-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] interrupted; stopping rebalance... 2017-10-09T18:20:10.860-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-28] >> SUCCESS: Rebalance stopped 2017-10-09T18:20:10.863-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] stop successful... 2017-10-09T18:20:10.863-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 4, 5] exit 2017-10-09T18:20:10.864-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 4, 5] was cancelled (external) 2017-10-09T18:20:10.864-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:20:10.997-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:20:10.997-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 5] (keepMask: 20) 2017-10-09T18:20:10.997-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:20:10.997-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 5] entry 2017-10-09T18:20:10.997-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 4, 5] to [0, 3, 5] 2017-10-09T18:20:11.011-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updated state to reflect cluster (was: [0, 1, 2, 4, 5] now: [0, 1, 4, 5]) 2017-10-09T18:20:11.026-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [3] with service(s): [ANALYTICS] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:13.436-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:14.714-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 796 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:16.101-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 3652 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:17.649-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 3652 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:18.922-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 3652 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:20.095-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 5657 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:20:22.528-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:20:25.931-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-29] >> SUCCESS: Node initialized 2017-10-09T18:20:26.494-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-30] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:20:26.521-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 5] exit 2017-10-09T18:20:26.522-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 5] was cancelled (internal) 2017-10-09T18:20:26.522-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:20:26.846-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:20:26.847-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3] (keepMask: 6) 2017-10-09T18:20:26.847-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:20:26.848-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3] entry 2017-10-09T18:20:26.848-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4, 5] to [0, 2, 3] 2017-10-09T18:20:26.936-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 3] with service(s): [ANALYTICS] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:20:28.522-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:20:29.704-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 57 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:20:30.898-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 3054 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:20:32.158-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 5772 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:20:34.527-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:20:40.416-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-32] >> SUCCESS: Node initialized 2017-10-09T18:20:41.094-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-31] >> SUCCESS: Node initialized 2017-10-09T18:20:50.150-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-33] >> SUCCESS: Server added 2017-10-09T18:20:50.154-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [1, 4, 5] 2017-10-09T18:20:50.155-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9001,172.17.0.2:9004,172.17.0.2:9005] 2017-10-09T18:21:06.281-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-34] >> Unable to display progress bar on this os 2017-10-09T18:21:06.304-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-34] >> SUCCESS: Rebalance complete 2017-10-09T18:21:06.357-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'NCs == 3' condition for up to 30 seconds... 2017-10-09T18:21:36.373-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Timed out waiting for condition: NCs == 3 2017-10-09T18:21:36.378-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3] exit 2017-10-09T18:21:36.381-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3] was cancelled (external) 2017-10-09T18:21:36.383-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:21:36.583-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:21:36.585-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 5] (keepMask: 16) 2017-10-09T18:21:36.585-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] entry 2017-10-09T18:21:36.585-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 2, 3] to [0, 5] 2017-10-09T18:21:36.587-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-new-disconnected-bucket PASSED ## test[ClusterConcurrentRebalanceIT 2: feeds: connect-new-disconnected-bucket] SUCCEEDED 2017-10-09T18:21:36.598-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updated state to reflect cluster (was: [0, 2, 3] now: [0, 2]) ## test[ClusterConcurrentRebalanceIT 3: feeds: bucket-and-name] START 2017-10-09T18:21:36.605-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-and-name ... 2017-10-09T18:21:36.608-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:21:36.615-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:21:42.450-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-35] >> SUCCESS: Node initialized 2017-10-09T18:21:42.718-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-36] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:21:42.741-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] exit 2017-10-09T18:21:42.741-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 5] was cancelled (external) 2017-10-09T18:21:42.742-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:21:42.777-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:21:42.777-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 5] (keepMask: 20) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-and-name/bucket-and-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: bucket is deprecated and can't be passed along with the expected field name "name" 2017-10-09T18:21:42.778-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 7 secs ...but that was expected. 2017-10-09T18:21:42.779-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/bucket-and-name PASSED ## test[ClusterConcurrentRebalanceIT 3: feeds: bucket-and-name] SUCCEEDED 2017-10-09T18:21:42.781-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 5] entry 2017-10-09T18:21:42.781-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 2] to [0, 3, 5] ## test[ClusterConcurrentRebalanceIT 4: feeds: bucket-is-final] START 2017-10-09T18:21:42.783-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-is-final ... 2017-10-09T18:21:42.786-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:21:42.822-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3, 5] with service(s): [ANALYTICS] 2017-10-09T18:21:52.498-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-38] >> SUCCESS: Node initialized 2017-10-09T18:21:52.605-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-37] >> SUCCESS: Node initialized 2017-10-09T18:22:11.129-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-39] >> SUCCESS: Server added 2017-10-09T18:22:11.140-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [2] 2017-10-09T18:22:11.141-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9002] 2017-10-09T18:22:22.750-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-40] >> Unable to display progress bar on this os 2017-10-09T18:22:22.754-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-40] >> SUCCESS: Rebalance complete 2017-10-09T18:22:22.770-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'NCs == 3' condition for up to 30 seconds... 2017-10-09T18:22:22.929-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:22:23.031-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 5] exit 2017-10-09T18:22:23.032-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 5] was cancelled (external) 2017-10-09T18:22:23.034-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:22:23.106-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-is-final/bucket-is-final.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ can't be set at connection time +++++ 2017-10-09T18:22:23.106-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1] (keepMask: 1) 2017-10-09T18:22:23.107-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 12 secs 2017-10-09T18:22:23.107-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1] entry 2017-10-09T18:22:23.107-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 3, 5] to [0, 1] org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! 2017-10-09T18:22:23.139-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1] with service(s): [ANALYTICS] ## test[ClusterConcurrentRebalanceIT 4: feeds: bucket-is-final] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 5: feeds: bucket-name] START 2017-10-09T18:22:23.146-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-name ... 2017-10-09T18:22:23.161-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:22:30.942-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-41] >> SUCCESS: Node initialized 2017-10-09T18:22:31.525-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-42] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:22:31.538-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1] exit 2017-10-09T18:22:31.539-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1] was cancelled (external) 2017-10-09T18:22:31.539-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:22:32.484-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:22:32.484-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4] (keepMask: 12) 2017-10-09T18:22:32.485-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 4] entry 2017-10-09T18:22:32.485-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 3, 5] to [0, 3, 4] 2017-10-09T18:22:32.514-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [4] with service(s): [ANALYTICS] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:35.597-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:37.370-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 1819 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:38.788-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 2410 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:39.997-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 2410 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:41.180-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 2410 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:42.559-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 4323 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:22:44.888-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:22:46.524-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-43] >> SUCCESS: Node initialized 2017-10-09T18:22:46.791-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-44] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:22:46.803-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 4] exit 2017-10-09T18:22:46.803-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4] was cancelled (external) 2017-10-09T18:22:46.803-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:22:47.003-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:22:47.003-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0] (keepMask: 0) 2017-10-09T18:22:47.004-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/bucket-name PASSED ## test[ClusterConcurrentRebalanceIT 5: feeds: bucket-name] SUCCEEDED 2017-10-09T18:22:47.004-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0] entry 2017-10-09T18:22:47.004-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 12 secs 2017-10-09T18:22:47.008-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 3, 5] to [0] ## test[ClusterConcurrentRebalanceIT 6: feeds: connect-connected-bucket] START 2017-10-09T18:22:47.011-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-connected-bucket ... 2017-10-09T18:22:47.088-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [3, 5] 2017-10-09T18:22:47.092-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9003,172.17.0.2:9005] 2017-10-09T18:22:47.199-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:22:48.085-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:22:48.086-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:22:50.125-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-45] >> Unable to display progress bar on this os 2017-10-09T18:22:50.127-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-45] >> SUCCESS: Rebalance complete 2017-10-09T18:22:50.131-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:22:51.087-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:22:51.108-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:22:54.296-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:22:54.328-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:22:54.330-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0] exit 2017-10-09T18:22:54.333-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0] was cancelled (external) 2017-10-09T18:22:54.334-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:22:54.422-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-connected-bucket/connect-connected-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ is already connected +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180)2017-10-09T18:22:54.422-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2] (keepMask: 2) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) 2017-10-09T18:22:54.428-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 3 secs 2017-10-09T18:22:54.428-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2] entry 2017-10-09T18:22:54.429-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 2] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 6: feeds: connect-connected-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 7: feeds: connect-connected-bucket-conditional] START 2017-10-09T18:22:54.559-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2] with service(s): [ANALYTICS] 2017-10-09T18:22:54.559-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-connected-bucket-conditional ... 2017-10-09T18:22:54.600-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:22:55.480-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:22:55.481-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:22:58.482-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:22:58.501-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:23:09.038-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-46] >> SUCCESS: Node initialized 2017-10-09T18:23:09.471-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-47] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:23:09.489-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2] exit 2017-10-09T18:23:09.489-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2] was cancelled (internal) 2017-10-09T18:23:09.490-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:23:09.493-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] entry 2017-10-09T18:23:09.494-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:23:09.496-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 1, 2, 3, 4, 5] 2017-10-09T18:23:09.652-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [1, 2, 3, 4, 5] with service(s): [ANALYTICS] 2017-10-09T18:23:11.048-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:23:11.137-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:23:24.904-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-48] >> SUCCESS: Node initialized 2017-10-09T18:23:25.146-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-51] >> SUCCESS: Node initialized 2017-10-09T18:23:25.404-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-49] >> SUCCESS: Node initialized 2017-10-09T18:23:25.463-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-50] >> SUCCESS: Node initialized 2017-10-09T18:23:34.786-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-52] >> SUCCESS: Node initialized 2017-10-09T18:23:35.985-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-53] >> ERROR: Join completion call failed. Could not connect to "172.17.0.2" on port "9005". This could be due to an incorrect host/port combination or a firewall in place between the servers. 2017-10-09T18:23:36.009-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:23:36.011-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:23:36.012-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:23:36.112-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-connected-bucket-conditional/connect-connected-bucket-conditional.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:23:36.116-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 5] (keepMask: 23) 2017-10-09T18:23:36.117-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 7 secs at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! 2017-10-09T18:23:36.118-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 5] entry 2017-10-09T18:23:36.122-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 1, 2, 3, 5] ## test[ClusterConcurrentRebalanceIT 7: feeds: connect-connected-bucket-conditional] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 8: feeds: connect-multiple-filtered-buckets] START 2017-10-09T18:23:36.150-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-multiple-filtered-buckets ... 2017-10-09T18:23:36.153-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:23:47.423-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1, 2, 3, 5] with service(s): [ANALYTICS] 2017-10-09T18:23:58.865-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-54] >> SUCCESS: Node initialized 2017-10-09T18:24:00.572-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-55] >> SUCCESS: Node initialized 2017-10-09T18:24:00.909-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-56] >> SUCCESS: Node initialized 2017-10-09T18:24:01.340-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-57] >> SUCCESS: Node initialized 2017-10-09T18:24:33.397-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-58] >> SUCCESS: Server added 2017-10-09T18:24:33.403-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase] 2017-10-09T18:24:45.704-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-59] >> Unable to display progress bar on this os 2017-10-09T18:24:45.704-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-59] >> SUCCESS: Rebalance complete 2017-10-09T18:24:45.706-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 5' condition for up to 30 seconds... 2017-10-09T18:25:15.709-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Timed out waiting for condition: NCs == 5 2017-10-09T18:25:15.710-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 5] exit 2017-10-09T18:25:15.711-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 5] was cancelled (external) 2017-10-09T18:25:15.712-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:25:16.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:25:16.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 4] (keepMask: 13) 2017-10-09T18:25:16.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:25:16.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 4] entry 2017-10-09T18:25:16.290-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 2, 3, 5] to [0, 1, 3, 4] 2017-10-09T18:25:16.320-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [4] with service(s): [ANALYTICS] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:19.406-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:22.685-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 168 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:23.983-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1195 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:25.198-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1195 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:26.481-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1201 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:27.745-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 2383 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:28.905-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 3729 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:25:30.070-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 5257 } 2017-10-09T18:25:31.184-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-60] >> SUCCESS: Node initialized Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.005.adm 2017-10-09T18:25:31.747-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-61] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:25:31.764-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 4] exit 2017-10-09T18:25:31.765-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 4] was cancelled (internal) 2017-10-09T18:25:31.767-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 5] (keepMask: 18) 2017-10-09T18:25:31.767-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 5] entry 2017-10-09T18:25:31.768-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 2, 3, 5] to [0, 2, 5] 2017-10-09T18:25:31.786-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [1, 3] 2017-10-09T18:25:31.787-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9001,172.17.0.2:9003] 2017-10-09T18:25:32.747-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:25:36.194-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-62] >> Unable to display progress bar on this os 2017-10-09T18:25:36.194-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-62] >> SUCCESS: Rebalance complete 2017-10-09T18:25:36.511-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] interrupted; stopping rebalance... 2017-10-09T18:25:37.395-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-63] >> SUCCESS: Rebalance stopped 2017-10-09T18:25:37.397-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] stop successful... 2017-10-09T18:25:37.398-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 5] exit 2017-10-09T18:25:37.398-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 5] was cancelled (external) 2017-10-09T18:25:37.398-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:25:37.537-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:25:37.537-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-multiple-filtered-buckets PASSED 2017-10-09T18:25:37.537-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4] (keepMask: 8) 2017-10-09T18:25:37.538-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] entry ## test[ClusterConcurrentRebalanceIT 8: feeds: connect-multiple-filtered-buckets] SUCCEEDED 2017-10-09T18:25:37.538-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 3, 5] to [0, 4] ## test[ClusterConcurrentRebalanceIT 9: feeds: connect-or-filtered-buckets] START 2017-10-09T18:25:37.555-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-or-filtered-buckets ... 2017-10-09T18:25:37.556-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updated state to reflect cluster (was: [0, 1, 2, 3, 5] now: [0, 2, 5]) 2017-10-09T18:25:37.565-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:25:37.569-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [4] with service(s): [ANALYTICS] 2017-10-09T18:25:45.231-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-64] >> SUCCESS: Node initialized 2017-10-09T18:26:01.362-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-65] >> SUCCESS: Server added 2017-10-09T18:26:01.369-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [2, 5] 2017-10-09T18:26:01.370-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9002,172.17.0.2:9005] 2017-10-09T18:26:12.772-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-66] >> Unable to display progress bar on this os 2017-10-09T18:26:12.772-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-66] >> SUCCESS: Rebalance complete 2017-10-09T18:26:12.787-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:26:12.869-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:26:12.922-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4] exit 2017-10-09T18:26:12.924-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4] was cancelled (external) 2017-10-09T18:26:12.924-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:13.253-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4, 5] (keepMask: 24) 2017-10-09T18:26:13.253-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:13.254-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4, 5] entry 2017-10-09T18:26:13.254-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 4, 5] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm 2017-10-09T18:26:14.629-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5874 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm 2017-10-09T18:26:15.944-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5874 } > { "count": 1005 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm 2017-10-09T18:26:17.113-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5874 } > { "count": 2927 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm 2017-10-09T18:26:18.262-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5874 } > { "count": 2982 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.005.adm 2017-10-09T18:26:20.602-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:20.604-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:26:20.932-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-67] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:26:20.950-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4, 5] exit 2017-10-09T18:26:20.951-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4, 5] was cancelled (external) 2017-10-09T18:26:20.953-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:21.098-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:21.098-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-or-filtered-buckets PASSED ## test[ClusterConcurrentRebalanceIT 9: feeds: connect-or-filtered-buckets] SUCCEEDED 2017-10-09T18:26:21.098-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 5] (keepMask: 16) 2017-10-09T18:26:21.100-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:26:21.100-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] entry 2017-10-09T18:26:21.100-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 5] ## test[ClusterConcurrentRebalanceIT 10: feeds: connect-shadowless-bucket] START 2017-10-09T18:26:21.101-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-shadowless-bucket ... 2017-10-09T18:26:21.104-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:21.149-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:26:21.436-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-68] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:26:21.469-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] exit 2017-10-09T18:26:21.470-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 5] was cancelled (external) 2017-10-09T18:26:21.470-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:21.534-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 5] (keepMask: 17) 2017-10-09T18:26:21.534-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 12 secs 2017-10-09T18:26:21.534-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:21.534-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] entry 2017-10-09T18:26:21.535-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 1, 5] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-shadowless-bucket/connect-shadowless-bucket.002.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The bucket beer_bucket doesn't have any shadow datasets. ...but that was expected. 2017-10-09T18:26:21.608-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:21.638-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [1, 5] with service(s): [ANALYTICS] 2017-10-09T18:26:22.113-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-69] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:26:22.161-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] exit 2017-10-09T18:26:22.161-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 5] was cancelled (external) 2017-10-09T18:26:22.162-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:22.228-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:22.229-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-shadowless-bucket PASSED ## test[ClusterConcurrentRebalanceIT 10: feeds: connect-shadowless-bucket] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 11: feeds: connect-with-unrecognized] START 2017-10-09T18:26:22.228-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 5] (keepMask: 18) 2017-10-09T18:26:22.231-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 5] entry 2017-10-09T18:26:22.232-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 2, 5] 2017-10-09T18:26:22.230-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-with-unrecognized ... 2017-10-09T18:26:22.231-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:26:22.236-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:24.614-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:26:25.203-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-71] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:26:25.276-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 5] exit 2017-10-09T18:26:25.276-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 5] was cancelled (external) 2017-10-09T18:26:25.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:25.562-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:25.562-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4, 5] (keepMask: 24) 2017-10-09T18:26:25.563-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4, 5] entry 2017-10-09T18:26:25.564-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 4, 5] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-with-unrecognized/connect-with-unrecognized.002.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: unknown is not a recognized bucket connect field ...but that was expected. 2017-10-09T18:26:25.652-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:25.655-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:26:26.117-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-73] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:26:26.141-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4, 5] exit 2017-10-09T18:26:26.142-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4, 5] was cancelled (external) 2017-10-09T18:26:26.144-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:26:26.257-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:26:26.258-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 4, 5] (keepMask: 29) 2017-10-09T18:26:26.258-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-with-unrecognized PASSED 2017-10-09T18:26:26.259-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4, 5] entry 2017-10-09T18:26:26.259-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 1, 3, 4, 5] ## test[ClusterConcurrentRebalanceIT 11: feeds: connect-with-unrecognized] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 12: feeds: default-host-format] START 2017-10-09T18:26:26.261-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/default-host-format ... 2017-10-09T18:26:26.266-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:26:34.069-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-70] >> SUCCESS: Node initialized 2017-10-09T18:26:34.582-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1, 3, 5] with service(s): [ANALYTICS] 2017-10-09T18:26:36.148-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-72] >> SUCCESS: Node initialized 2017-10-09T18:26:50.291-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-76] >> SUCCESS: Node initialized 2017-10-09T18:26:50.444-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-74] >> SUCCESS: Node initialized 2017-10-09T18:26:50.754-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-75] >> SUCCESS: Node initialized 2017-10-09T18:27:02.948-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-77] >> ERROR: Prepare join failed. Got HTTP status 500 from REST call post to http://172.17.0.2:9003/engageCluster2. Body was: "[\"Unexpected server error, request logged.\"]" 2017-10-09T18:27:02.969-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4, 5] exit 2017-10-09T18:27:02.970-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 4, 5] was cancelled (external) 2017-10-09T18:27:02.971-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:27:03.101-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:27:03.101-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:27:03.102-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] entry 2017-10-09T18:27:03.102-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 1, 2, 3, 4, 5] 2017-10-09T18:27:03.120-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Updated state to reflect cluster (was: [0, 4] now: [0, 1, 4]) Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm 2017-10-09T18:27:03.764-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/default-host-format/default-host-format.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm 2017-10-09T18:27:04.851-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/default-host-format/default-host-format.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 3623 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm 2017-10-09T18:27:06.977-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:27:06.979-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 3, 5] with service(s): [ANALYTICS] 2017-10-09T18:27:07.381-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-78] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:27:07.400-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:27:07.401-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:27:07.402-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:27:07.478-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:27:07.478-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/default-host-format PASSED ## test[ClusterConcurrentRebalanceIT 12: feeds: default-host-format] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 13: feeds: disconnect-disconnected-bucket] START 2017-10-09T18:27:07.479-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 5] (keepMask: 16) 2017-10-09T18:27:07.481-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/disconnect-disconnected-bucket ... 2017-10-09T18:27:07.481-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] entry 2017-10-09T18:27:07.482-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 5] 2017-10-09T18:27:07.499-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:27:07.578-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:27:07.958-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-81] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:27:07.986-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] exit 2017-10-09T18:27:07.992-07:00 WARN CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] caught exception java.util.concurrent.ExecutionException: java.lang.AssertionError: couchbase-cli non-zero exit code; output: ERROR: Unable to connect to host at http://172.17.0.2:9005 expected:<0> but was:<1> trying to rebalance; will sleep 2s before proceeding 2017-10-09T18:27:08.686-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:27:08.686-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:27:09.993-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4, 5] (keepMask: 28) 2017-10-09T18:27:09.993-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 11 secs 2017-10-09T18:27:09.993-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] entry 2017-10-09T18:27:09.993-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 3, 4, 5] 2017-10-09T18:27:11.686-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:27:11.699-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:27:21.135-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:27:21.172-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:27:21.800-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-80] >> SUCCESS: Node initialized 2017-10-09T18:27:22.176-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-79] >> SUCCESS: Node initialized 2017-10-09T18:28:10.037-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] exit 2017-10-09T18:28:10.038-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4, 5] was cancelled (internal) 2017-10-09T18:28:10.040-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:28:10.094-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/disconnect-disconnected-bucket/disconnect-disconnected-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ is not connected +++++ 2017-10-09T18:28:10.095-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 4] (keepMask: 13) 2017-10-09T18:28:10.095-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 4] entry org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:28:10.095-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1, 3, 4] at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 13: feeds: disconnect-disconnected-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 14: feeds: disconnect-disconnected-bucket-conditional] START 2017-10-09T18:28:10.136-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/disconnect-disconnected-bucket-conditional ... 2017-10-09T18:28:10.167-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:28:10.853-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:28:10.853-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:28:13.854-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:28:13.869-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:28:17.054-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:28:17.093-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:28:17.094-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:28:17.364-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-82] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:28:17.384-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 4] exit 2017-10-09T18:28:17.384-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 4] was cancelled (external) 2017-10-09T18:28:17.387-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:28:17.493-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/disconnect-disconnected-bucket-conditional/disconnect-disconnected-bucket-conditional.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 14: feeds: disconnect-disconnected-bucket-conditional] FAILED (java.lang.Exception) 2017-10-09T18:28:17.493-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3] (keepMask: 7) 2017-10-09T18:28:17.496-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 4 secs 2017-10-09T18:28:17.496-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3] entry ## test[ClusterConcurrentRebalanceIT 15: feeds: drop-connected-bucket] START 2017-10-09T18:28:17.497-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 2, 3] 2017-10-09T18:28:17.498-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-connected-bucket ... 2017-10-09T18:28:17.529-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:28:18.167-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:28:18.168-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:28:21.168-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:28:21.179-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:28:21.496-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 3] with service(s): [ANALYTICS] 2017-10-09T18:28:21.966-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-83] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:28:21.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3] exit 2017-10-09T18:28:21.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3] was cancelled (internal) 2017-10-09T18:28:21.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1] (keepMask: 1) 2017-10-09T18:28:21.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:28:21.993-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1] entry 2017-10-09T18:28:21.993-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1] 2017-10-09T18:28:22.002-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [4] 2017-10-09T18:28:22.002-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9004] 2017-10-09T18:28:31.186-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:28:31.202-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:28:32.024-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-84] >> SUCCESS: Node initialized 2017-10-09T18:28:36.820-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-85] >> Unable to display progress bar on this os 2017-10-09T18:28:36.820-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-85] >> SUCCESS: Rebalance complete 2017-10-09T18:28:36.824-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] interrupted; stopping rebalance... 2017-10-09T18:28:37.044-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-86] >> SUCCESS: Rebalance stopped 2017-10-09T18:28:37.050-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] stop successful... 2017-10-09T18:28:37.051-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1] exit 2017-10-09T18:28:37.051-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1] was cancelled (internal) 2017-10-09T18:28:37.051-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:28:37.178-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-bucket/drop-connected-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ can't be dropped because it is in the connected state +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists.2017-10-09T18:28:37.178-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:28:37.179-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 11 secs at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) 2017-10-09T18:28:37.179-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] entry at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) 2017-10-09T18:28:37.179-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1, 2, 3, 4, 5] at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 15: feeds: drop-connected-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 16: feeds: drop-connected-shadow] START 2017-10-09T18:28:37.185-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-connected-shadow ... 2017-10-09T18:28:37.190-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Updated state to reflect cluster (was: [0, 1, 4] now: [0, 1]) 2017-10-09T18:28:37.215-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:28:38.935-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:28:38.936-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:28:41.936-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:28:41.945-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:28:51.477-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:28:51.501-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:29:37.202-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:29:37.203-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (internal) 2017-10-09T18:29:37.203-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:29:37.259-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 4] (keepMask: 11) 2017-10-09T18:29:37.260-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4] entry 2017-10-09T18:29:37.260-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1] to [0, 1, 2, 4] 2017-10-09T18:29:37.259-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-shadow/drop-connected-shadow.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ Can't drop shadow dataset because its bucket is in the connected state +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 16: feeds: drop-connected-shadow] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 17: feeds: drop-index-for-connected-shadow] START 2017-10-09T18:29:37.289-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-index-for-connected-shadow ... 2017-10-09T18:29:37.290-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 4] with service(s): [ANALYTICS] 2017-10-09T18:29:37.306-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:29:38.262-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:29:38.263-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:29:41.263-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:29:41.272-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:29:49.108-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-87] >> SUCCESS: Node initialized 2017-10-09T18:29:50.606-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-88] >> SUCCESS: Node initialized 2017-10-09T18:29:51.817-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:29:51.836-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:30:13.749-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-89] >> SUCCESS: Server added 2017-10-09T18:30:13.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4] exit 2017-10-09T18:30:13.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 4] was cancelled (external) 2017-10-09T18:30:13.751-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:30:13.814-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-index-for-connected-shadow/drop-index-for-connected-shadow.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ is currently being fed into by the following active entities +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 17: feeds: drop-index-for-connected-shadow] FAILED (java.lang.Exception) 2017-10-09T18:30:13.817-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0] (keepMask: 0) 2017-10-09T18:30:13.821-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0] entry 2017-10-09T18:30:13.821-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1] to [0] ## test[ClusterConcurrentRebalanceIT 18: feeds: drop-shadowed-bucket] START 2017-10-09T18:30:13.839-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-shadowed-bucket ... 2017-10-09T18:30:13.844-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Updated state to reflect cluster (was: [0, 1] now: [0, 1, 2, 4]) 2017-10-09T18:30:13.856-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [1, 2, 4] 2017-10-09T18:30:13.857-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:30:13.858-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9001,172.17.0.2:9002,172.17.0.2:9004] 2017-10-09T18:30:14.887-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:30:14.887-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:30:16.923-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-90] >> Unable to display progress bar on this os 2017-10-09T18:30:16.923-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-90] >> SUCCESS: Rebalance complete 2017-10-09T18:30:16.927-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:30:17.887-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:30:17.897-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:30:26.286-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:30:26.319-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:30:26.321-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0] exit 2017-10-09T18:30:26.321-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0] was cancelled (external) 2017-10-09T18:30:26.322-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:30:26.433-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4, 5] (keepMask: 28) 2017-10-09T18:30:26.433-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:30:26.433-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 7 secs testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-shadowed-bucket/drop-shadowed-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ cannot be dropped because the following datasets shadow it +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:30:26.434-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] entry at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125)2017-10-09T18:30:26.434-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 3, 4, 5] at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 18: feeds: drop-shadowed-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 19: feeds: duplicate-bucket] START 2017-10-09T18:30:26.435-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-bucket ... 2017-10-09T18:30:26.612-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:31:26.530-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] exit 2017-10-09T18:31:26.530-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4, 5] was cancelled (external) 2017-10-09T18:31:26.530-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:31:26.622-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/duplicate-bucket/duplicate-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name beersample already exists. ...but that was expected. 2017-10-09T18:31:26.622-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-bucket PASSED ## test[ClusterConcurrentRebalanceIT 19: feeds: duplicate-bucket] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 20: feeds: duplicate-bucket-if-not-exists] START 2017-10-09T18:31:26.623-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-bucket-if-not-exists ... 2017-10-09T18:31:26.624-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:31:26.625-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 4] (keepMask: 13) 2017-10-09T18:31:26.625-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:31:26.625-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4] entry 2017-10-09T18:31:26.625-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 1, 3, 4] 2017-10-09T18:31:26.647-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1, 3, 4] with service(s): [ANALYTICS] 2017-10-09T18:31:27.038-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-91] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:31:27.071-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4] exit 2017-10-09T18:31:27.071-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 4] was cancelled (external) 2017-10-09T18:31:27.072-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:31:27.149-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:31:27.149-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-bucket-if-not-exists PASSED ## test[ClusterConcurrentRebalanceIT 20: feeds: duplicate-bucket-if-not-exists] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 21: feeds: duplicate-shadow] START 2017-10-09T18:31:27.149-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-shadow ... 2017-10-09T18:31:27.149-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:31:27.150-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 4 secs 2017-10-09T18:31:27.150-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] entry 2017-10-09T18:31:27.150-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 1, 2, 3, 4, 5] 2017-10-09T18:31:27.156-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:31:27.190-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [1, 2, 3, 4, 5] with service(s): [ANALYTICS] 2017-10-09T18:31:27.475-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-95] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:31:27.488-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:31:27.488-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:31:27.488-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:31:27.604-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/duplicate-shadow/duplicate-shadow.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A dataset with name beers already exists. ...but that was expected. 2017-10-09T18:31:27.604-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-shadow PASSED ## test[ClusterConcurrentRebalanceIT 21: feeds: duplicate-shadow] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 22: feeds: duplicate-shadow-if-not-exists] START 2017-10-09T18:31:27.604-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-shadow-if-not-exists ... 2017-10-09T18:31:27.605-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0] (keepMask: 0) 2017-10-09T18:31:27.607-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0] entry 2017-10-09T18:31:27.607-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0] 2017-10-09T18:31:27.614-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:31:27.617-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Nothing to do, requested topology already in place: [0] 2017-10-09T18:31:27.617-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0] exit 2017-10-09T18:31:27.619-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0] was cancelled (external) 2017-10-09T18:31:27.620-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:31:27.854-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:31:27.854-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 5] (keepMask: 17) 2017-10-09T18:31:27.855-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-shadow-if-not-exists PASSED ## test[ClusterConcurrentRebalanceIT 22: feeds: duplicate-shadow-if-not-exists] SUCCEEDED 2017-10-09T18:31:27.855-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:31:27.855-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] entry 2017-10-09T18:31:27.855-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 1, 5] ## test[ClusterConcurrentRebalanceIT 23: feeds: empty-bucket-name] START 2017-10-09T18:31:27.855-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/empty-bucket-name ... 2017-10-09T18:31:27.856-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:31:27.874-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [1, 5] with service(s): [ANALYTICS] 2017-10-09T18:31:42.352-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-93] >> SUCCESS: Node initialized 2017-10-09T18:31:44.612-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-92] >> SUCCESS: Node initialized 2017-10-09T18:31:45.204-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-96] >> SUCCESS: Node initialized 2017-10-09T18:31:45.468-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-98] >> ERROR: Unable to connect to host at http://172.17.0.2:9001 2017-10-09T18:31:45.546-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] exit 2017-10-09T18:31:45.546-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 5] was cancelled (external) 2017-10-09T18:31:45.546-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:31:45.590-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/empty-bucket-name/empty-bucket-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Field bucket can't be empty ...but that was expected. 2017-10-09T18:31:45.590-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/empty-bucket-name PASSED ## test[ClusterConcurrentRebalanceIT 23: feeds: empty-bucket-name] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 24: feeds: index-connected-shadow] START 2017-10-09T18:31:45.591-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/index-connected-shadow ... 2017-10-09T18:31:45.591-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 5] (keepMask: 18) 2017-10-09T18:31:45.591-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 5] entry 2017-10-09T18:31:45.591-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 2, 5] 2017-10-09T18:31:45.617-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:31:45.633-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:31:45.633-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-94] >> SUCCESS: Node initialized 2017-10-09T18:31:47.677-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:31:47.678-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:31:50.678-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:31:50.701-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:32:01.321-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:32:01.374-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:32:04.793-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-100] >> SUCCESS: Node initialized 2017-10-09T18:32:05.288-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-97] >> SUCCESS: Node initialized 2017-10-09T18:32:07.196-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-99] >> SUCCESS: Node initialized 2017-10-09T18:32:08.084-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-101] >> ERROR: Join completion call failed. Could not connect to "172.17.0.2" on port "9002". This could be due to an incorrect host/port combination or a firewall in place between the servers. 2017-10-09T18:32:08.103-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 5] exit 2017-10-09T18:32:08.103-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 5] was cancelled (external) 2017-10-09T18:32:08.103-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:32:08.185-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/index-connected-shadow/index-connected-shadow.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ is currently being fed into by the following active entities +++++ org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 24: feeds: index-connected-shadow] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 25: feeds: load-empty-bucket-new-syntax] START 2017-10-09T18:32:08.187-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/load-empty-bucket-new-syntax ... 2017-10-09T18:32:08.187-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3, 5] (keepMask: 22) 2017-10-09T18:32:08.188-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 9 secs 2017-10-09T18:32:08.188-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3, 5] entry 2017-10-09T18:32:08.188-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 2, 3, 5] 2017-10-09T18:32:08.218-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:32:09.107-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:32:09.107-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:32:12.107-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:32:12.118-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:32:21.574-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:32:21.588-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:32:24.256-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 3, 5] with service(s): [ANALYTICS] 2017-10-09T18:32:24.757-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-104] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:32:24.807-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3, 5] exit 2017-10-09T18:32:24.807-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3, 5] was cancelled (internal) 2017-10-09T18:32:24.808-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:32:24.884-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) 2017-10-09T18:32:24.888-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4] (keepMask: 12) 2017-10-09T18:32:24.888-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 4 secs 2017-10-09T18:32:24.888-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4] entry 2017-10-09T18:32:24.888-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 3, 4] at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 25: feeds: load-empty-bucket-new-syntax] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 26: feeds: resume] START 2017-10-09T18:32:24.896-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/resume ... 2017-10-09T18:32:24.936-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:32:25.718-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:32:25.718-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:32:28.719-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:32:28.727-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:32:35.572-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-102] >> SUCCESS: Node initialized 2017-10-09T18:32:36.133-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:32:36.158-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:32:36.292-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-103] >> SUCCESS: Node initialized 2017-10-09T18:33:24.913-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4] exit 2017-10-09T18:33:24.913-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4] was cancelled (internal) 2017-10-09T18:33:24.914-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:33:24.979-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:33:24.979-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3] (keepMask: 4) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:33:24.979-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 11 secs org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:33:24.979-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3] entry 2017-10-09T18:33:24.979-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0] to [0, 3] at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 26: feeds: resume] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 27: feeds: password-not-allowed] START 2017-10-09T18:33:24.980-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/password-not-allowed ... 2017-10-09T18:33:24.983-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:33:24.989-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:33:25.208-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-105] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:33:25.233-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3] exit 2017-10-09T18:33:25.233-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3] was cancelled (external) 2017-10-09T18:33:25.233-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:33:25.297-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:33:25.297-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4, 5] (keepMask: 24) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/password-not-allowed/password-not-allowed.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: password can only be passed at connection time ...but that was expected. 2017-10-09T18:33:25.297-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:33:25.297-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/password-not-allowed PASSED ## test[ClusterConcurrentRebalanceIT 27: feeds: password-not-allowed] SUCCEEDED 2017-10-09T18:33:25.297-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4, 5] entry 2017-10-09T18:33:25.297-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0] to [0, 4, 5] ## test[ClusterConcurrentRebalanceIT 28: feeds: passwordless] START 2017-10-09T18:33:25.300-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/passwordless ... 2017-10-09T18:33:25.301-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:33:25.335-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [4, 5] with service(s): [ANALYTICS] 2017-10-09T18:33:34.260-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-106] >> SUCCESS: Node initialized 2017-10-09T18:33:34.441-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-107] >> SUCCESS: Node initialized 2017-10-09T18:33:55.740-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-108] >> SUCCESS: Server added 2017-10-09T18:33:55.746-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase] 2017-10-09T18:34:05.006-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-109] >> Unable to display progress bar on this os 2017-10-09T18:34:05.006-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-109] >> SUCCESS: Rebalance complete 2017-10-09T18:34:05.013-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 3' condition for up to 30 seconds... 2017-10-09T18:34:35.013-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Timed out waiting for condition: NCs == 3 2017-10-09T18:34:35.013-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 4, 5] exit 2017-10-09T18:34:35.013-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4, 5] was cancelled (external) 2017-10-09T18:34:35.014-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:34:35.508-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:34:35.508-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4, 5] (keepMask: 28) 2017-10-09T18:34:35.508-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs 2017-10-09T18:34:35.508-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 4, 5] entry 2017-10-09T18:34:35.508-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4, 5] to [0, 3, 4, 5] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:34:38.013-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/passwordless/passwordless.003.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:34:39.954-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/passwordless/passwordless.003.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1402 } 2017-10-09T18:34:40.509-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:34:40.863-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-110] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:34:40.878-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3, 4, 5] exit 2017-10-09T18:34:40.878-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4, 5] was cancelled (internal) 2017-10-09T18:34:40.878-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 4, 5] (keepMask: 26) 2017-10-09T18:34:40.878-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 4, 5] entry 2017-10-09T18:34:40.879-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4, 5] to [0, 2, 4, 5] 2017-10-09T18:34:40.947-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2] with service(s): [ANALYTICS] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:34:41.087-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/passwordless/passwordless.003.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1963 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:34:42.262-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/passwordless/passwordless.003.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 2829 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:34:44.619-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:34:48.843-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-111] >> SUCCESS: Node initialized 2017-10-09T18:34:49.017-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-112] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:34:49.029-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 4, 5] exit 2017-10-09T18:34:49.030-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 4, 5] was cancelled (external) 2017-10-09T18:34:49.030-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:34:49.201-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:34:49.202-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/passwordless PASSED 2017-10-09T18:34:49.202-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:34:49.202-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 4, 5] entry 2017-10-09T18:34:49.202-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4, 5] to [0, 1, 2, 3, 4, 5] ## test[ClusterConcurrentRebalanceIT 28: feeds: passwordless] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 29: feeds: shadow-connected-bucket] START 2017-10-09T18:34:49.215-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/shadow-connected-bucket ... 2017-10-09T18:34:49.248-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:34:50.996-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:34:50.996-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:34:53.996-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:34:54.021-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:35:01.323-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:35:01.335-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:35:01.337-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1, 2, 3] with service(s): [ANALYTICS] 2017-10-09T18:35:01.497-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-114] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:35:10.624-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-115] >> SUCCESS: Node initialized 2017-10-09T18:35:10.973-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-113] >> SUCCESS: Node initialized 2017-10-09T18:35:10.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:35:10.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:35:10.992-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:35:11.054-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:35:11.054-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 4, 5] (keepMask: 26) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/shadow-connected-bucket/shadow-connected-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. Expected to find the following in error text: +++++ Shadow can't be created because Bucket gbook_user_bucket is in connected state +++++ 2017-10-09T18:35:11.057-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 4, 5] entry org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists.2017-10-09T18:35:11.057-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4, 5] to [0, 2, 4, 5] at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 29: feeds: shadow-connected-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 30: feeds: unsupported-fields-in-bucket] START 2017-10-09T18:35:11.079-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/unsupported-fields-in-bucket ... 2017-10-09T18:35:11.080-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:35:11.085-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2] with service(s): [ANALYTICS] 2017-10-09T18:35:18.988-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-116] >> SUCCESS: Node initialized 2017-10-09T18:35:27.320-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-117] >> SUCCESS: Server added 2017-10-09T18:35:27.335-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase] 2017-10-09T18:35:35.734-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-118] >> Unable to display progress bar on this os 2017-10-09T18:35:35.735-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-118] >> SUCCESS: Rebalance complete 2017-10-09T18:35:35.742-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'NCs == 4' condition for up to 30 seconds... 2017-10-09T18:35:35.876-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:35:35.953-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 4, 5] exit 2017-10-09T18:35:35.954-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 4, 5] was cancelled (external) 2017-10-09T18:35:35.954-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:35:35.997-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/unsupported-fields-in-bucket/unsupported-fields-in-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: unknown is not a recognized bucket create field ...but that was expected. 2017-10-09T18:35:35.997-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/unsupported-fields-in-bucket PASSED ## test[ClusterConcurrentRebalanceIT 30: feeds: unsupported-fields-in-bucket] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 31: feeds: flush-bucket] START 2017-10-09T18:35:35.998-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/flush-bucket ... 2017-10-09T18:35:35.998-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3, 4] (keepMask: 14) 2017-10-09T18:35:35.998-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 4] entry 2017-10-09T18:35:35.998-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 2, 4, 5] to [0, 2, 3, 4] 2017-10-09T18:35:36.028-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:35:36.766-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:35:36.767-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:35:39.767-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:35:39.776-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:35:51.337-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:35:51.353-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:35:51.354-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:35:51.490-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-119] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:35:51.500-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 4] exit 2017-10-09T18:35:51.500-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3, 4] was cancelled (external) 2017-10-09T18:35:51.500-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:35:51.533-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/flush-bucket/flush-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 31: feeds: flush-bucket] FAILED (java.lang.Exception) 2017-10-09T18:35:51.535-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 4] (keepMask: 8) 2017-10-09T18:35:51.535-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4] entry 2017-10-09T18:35:51.535-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 2, 4, 5] to [0, 4] ## test[ClusterConcurrentRebalanceIT 32: feeds: connect-flushed-bucket] START 2017-10-09T18:35:51.539-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-flushed-bucket ... 2017-10-09T18:35:51.543-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [2, 5] 2017-10-09T18:35:51.543-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9002,172.17.0.2:9005] 2017-10-09T18:35:51.553-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:35:52.267-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:35:52.267-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:35:54.288-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-120] >> Unable to display progress bar on this os 2017-10-09T18:35:54.288-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-120] >> SUCCESS: Rebalance complete 2017-10-09T18:35:54.291-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:35:55.267-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:35:55.276-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:36:05.796-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:36:05.809-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:36:05.813-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 4] exit 2017-10-09T18:36:05.813-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 4] was cancelled (external) 2017-10-09T18:36:05.814-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:36:05.855-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-flushed-bucket/flush-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 32: feeds: connect-flushed-bucket] FAILED (java.lang.Exception) 2017-10-09T18:36:05.856-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 5] (keepMask: 19) 2017-10-09T18:36:05.857-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 5] entry 2017-10-09T18:36:05.857-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 4] to [0, 1, 2, 5] ## test[ClusterConcurrentRebalanceIT 33: feeds: mb-22837] START 2017-10-09T18:36:05.870-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/mb-22837 ... 2017-10-09T18:36:05.915-07:00 INFO CBAS.util.Loader [main] Creating bucket policies 2017-10-09T18:36:09.882-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [1, 2, 5] with service(s): [ANALYTICS] 2017-10-09T18:36:16.318-07:00 INFO CBAS.util.Loader [main] Bucket policies created 2017-10-09T18:36:16.350-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:36:23.449-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-122] >> SUCCESS: Node initialized 2017-10-09T18:36:24.135-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-123] >> SUCCESS: Node initialized 2017-10-09T18:36:25.105-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-121] >> SUCCESS: Node initialized 2017-10-09T18:36:39.741-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-124] >> ERROR: Prepare join failed. Got HTTP status 500 from REST call post to http://172.17.0.2:9005/engageCluster2. Body was: "[\"Unexpected server error, request logged.\"]" 2017-10-09T18:36:39.759-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 5] exit 2017-10-09T18:36:39.759-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 5] was cancelled (external) 2017-10-09T18:36:39.759-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:36:39.985-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:36:39.985-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3, 5] (keepMask: 22) 2017-10-09T18:36:39.985-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3, 5] entry 2017-10-09T18:36:39.985-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 4] to [0, 2, 3, 5] 2017-10-09T18:36:39.998-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Updated state to reflect cluster (was: [0, 4] now: [0, 1, 4]) 2017-10-09T18:36:40.830-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b policies -g %policyno% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:36:41.077-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-125] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:36:41.086-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:36:42.420-07:00 INFO CBAS.common.TestExecutor [main] received exception on poll org.apache.asterix.common.exceptions.AsterixException: ASX0005: Invalid item type: function agg-sum cannot process item type object in an input array (or multiset) at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeQuery(TestExecutor.java:1210) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:904) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:1.0.0-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.lambda$poll$3(TestExecutor.java:1251) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_131] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_131] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/mb-22837/mb-22837.005.pollquery.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: ASX0005: Invalid item type: function agg-sum cannot process item type object in an input array (or multiset) ...but that was expected. 2017-10-09T18:36:43.543-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:36:43.544-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 3, 5] with service(s): [ANALYTICS] 2017-10-09T18:36:44.020-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-126] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:36:44.030-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-127] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:36:44.060-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3, 5] exit 2017-10-09T18:36:44.061-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3, 5] was cancelled (external) 2017-10-09T18:36:44.061-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:36:44.161-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:36:44.162-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/mb-22837 PASSED ## test[ClusterConcurrentRebalanceIT 33: feeds: mb-22837] SUCCEEDED 2017-10-09T18:36:44.162-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4] (keepMask: 15) 2017-10-09T18:36:44.162-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 4] entry 2017-10-09T18:36:44.162-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 2, 3, 4] ## test[ClusterConcurrentRebalanceIT 34: feeds: mb-22837-2] START 2017-10-09T18:36:44.165-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/mb-22837-2 ... 2017-10-09T18:36:44.186-07:00 INFO CBAS.util.Loader [main] Dropping bucket policies with ClusterManager.removeBucket ... 2017-10-09T18:36:45.967-07:00 INFO CBAS.util.Loader [main] Removal of bucket policies returned successful 2017-10-09T18:36:45.968-07:00 INFO CBAS.util.Loader [main] Waiting for bucket policies to be dropped 2017-10-09T18:36:48.968-07:00 INFO CBAS.util.Loader [main] Bucket policies dropped 2017-10-09T18:36:48.980-07:00 INFO CBAS.util.Loader [main] Creating bucket policies 2017-10-09T18:36:53.588-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-128] >> SUCCESS: Node initialized 2017-10-09T18:36:56.351-07:00 INFO CBAS.util.Loader [main] Bucket policies created 2017-10-09T18:36:56.380-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:36:56.381-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 3] with service(s): [ANALYTICS] 2017-10-09T18:36:56.776-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-129] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:36:56.796-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3, 4] exit 2017-10-09T18:36:56.796-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4] was cancelled (external) 2017-10-09T18:36:56.797-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:36:56.948-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:36:56.948-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3] (keepMask: 6) 2017-10-09T18:36:56.949-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3] entry 2017-10-09T18:36:56.949-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 2, 3] 2017-10-09T18:36:57.463-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b policies -g %policyno% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:36:57.661-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-131] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:36:57.668-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/policies/policies.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm 2017-10-09T18:36:58.268-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/mb-22837-2/mb-22837-2.005.pollquery.sqlpp changed at line 1: < { "state": "AZ", "risk": 2.0 } > after 1 lines Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm 2017-10-09T18:37:01.342-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:37:07.068-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 3] with service(s): [ANALYTICS] 2017-10-09T18:37:07.099-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-130] >> SUCCESS: Node initialized 2017-10-09T18:37:07.388-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-133] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:37:07.406-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 3] exit 2017-10-09T18:37:07.407-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3] was cancelled (external) 2017-10-09T18:37:07.407-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:37:07.473-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:37:07.473-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/mb-22837-2 PASSED ## test[ClusterConcurrentRebalanceIT 34: feeds: mb-22837-2] SUCCEEDED 2017-10-09T18:37:07.473-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3] (keepMask: 7) 2017-10-09T18:37:07.473-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3] entry 2017-10-09T18:37:07.473-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 2, 3] ## test[ClusterConcurrentRebalanceIT 35: feeds: re-create-connected-bucket] START 2017-10-09T18:37:07.475-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/re-create-connected-bucket ... 2017-10-09T18:37:07.541-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:37:09.377-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:37:09.377-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:37:12.377-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:37:12.393-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:37:19.678-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-132] >> SUCCESS: Node initialized 2017-10-09T18:37:20.798-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:37:20.891-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:37:20.893-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 3] with service(s): [ANALYTICS] 2017-10-09T18:37:21.190-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-135] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:37:21.212-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 3] exit 2017-10-09T18:37:21.213-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3] was cancelled (external) 2017-10-09T18:37:21.213-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:37:21.255-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:37:21.255-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3] (keepMask: 4) org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) 2017-10-09T18:37:21.256-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3] entry 2017-10-09T18:37:21.256-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 3] at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 35: feeds: re-create-connected-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 36: feeds: two-buckets-one-connection] START 2017-10-09T18:37:21.259-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/two-buckets-one-connection ... 2017-10-09T18:37:21.299-07:00 INFO CBAS.util.Loader [main] Creating bucket medicine 2017-10-09T18:37:31.137-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-134] >> SUCCESS: Node initialized 2017-10-09T18:37:31.771-07:00 INFO CBAS.util.Loader [main] Bucket medicine created 2017-10-09T18:37:31.794-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:37:31.795-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:37:31.967-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-136] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:37:31.978-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 3] exit 2017-10-09T18:37:31.978-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3] was cancelled (external) 2017-10-09T18:37:31.978-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:37:32.139-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:37:32.139-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4, 5] (keepMask: 28) 2017-10-09T18:37:32.139-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 8 secs 2017-10-09T18:37:32.139-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] entry 2017-10-09T18:37:32.139-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 3, 4, 5] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm 2017-10-09T18:37:32.839-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/two-buckets-one-connection/two-buckets-one-connection.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm 2017-10-09T18:37:33.920-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/two-buckets-one-connection/two-buckets-one-connection.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 674 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm 2017-10-09T18:37:35.056-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/two-buckets-one-connection/two-buckets-one-connection.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 5162 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.006.adm 2017-10-09T18:37:37.536-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:32.174-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] exit 2017-10-09T18:38:32.174-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4, 5] was cancelled (external) 2017-10-09T18:38:32.175-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:32.300-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:32.300-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/two-buckets-one-connection PASSED ## test[ClusterConcurrentRebalanceIT 36: feeds: two-buckets-one-connection] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 37: tutorials: let-there-be-beer] START 2017-10-09T18:38:32.300-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: tutorials/let-there-be-beer ... 2017-10-09T18:38:32.300-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 5] (keepMask: 19) 2017-10-09T18:38:32.300-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 5] entry 2017-10-09T18:38:32.300-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1, 2, 5] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.001.adm 2017-10-09T18:38:32.386-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:32.388-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:38:32.775-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-137] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:38:32.813-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 5] exit 2017-10-09T18:38:32.814-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 5] was cancelled (external) 2017-10-09T18:38:32.814-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:32.995-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:32.995-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 4] (keepMask: 13) 2017-10-09T18:38:32.996-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:38:32.996-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4] entry 2017-10-09T18:38:32.996-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 3, 4] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm 2017-10-09T18:38:33.815-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/tutorials/let-there-be-beer/let-there-be-beer.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm 2017-10-09T18:38:34.929-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/tutorials/let-there-be-beer/let-there-be-beer.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 1302 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.007.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.008.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.009.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.010.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.011.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.012.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.013.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.014.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.015.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.016.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.017.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.018.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.019.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.020.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.021.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.022.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.023.adm 2017-10-09T18:38:42.435-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:42.437-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:38:42.918-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-139] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:38:42.945-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 3, 4] exit 2017-10-09T18:38:42.945-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 4] was cancelled (external) 2017-10-09T18:38:42.946-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:43.045-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:43.045-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: tutorials/let-there-be-beer PASSED ## test[ClusterConcurrentRebalanceIT 37: tutorials: let-there-be-beer] SUCCEEDED 2017-10-09T18:38:43.045-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 5] (keepMask: 17) 2017-10-09T18:38:43.046-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] entry 2017-10-09T18:38:43.046-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1, 5] ## test[ClusterConcurrentRebalanceIT 38: api: version_1] START 2017-10-09T18:38:43.047-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: api/version_1 ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/api/version_1/version_1.1.regex 2017-10-09T18:38:43.078-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: api/version_1 PASSED ## test[ClusterConcurrentRebalanceIT 38: api: version_1] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 39: index: index-before-ingest] START 2017-10-09T18:38:43.081-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-before-ingest ... 2017-10-09T18:38:43.087-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:43.088-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:38:43.631-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-140] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:38:43.696-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 5] exit 2017-10-09T18:38:43.696-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 5] was cancelled (external) 2017-10-09T18:38:43.697-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:43.831-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:43.832-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 4, 5] (keepMask: 27) 2017-10-09T18:38:43.832-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 7 secs 2017-10-09T18:38:43.832-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4, 5] entry 2017-10-09T18:38:43.832-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 2, 4, 5] 2017-10-09T18:38:43.834-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:45.916-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:38:45.927-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-138] >> SUCCESS: Node initialized 2017-10-09T18:38:46.474-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-141] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:38:46.535-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4, 5] exit 2017-10-09T18:38:46.535-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 4, 5] was cancelled (external) 2017-10-09T18:38:46.536-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:46.841-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:46.842-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 4] (keepMask: 11) 2017-10-09T18:38:46.842-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 4] entry 2017-10-09T18:38:46.842-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1, 2, 4] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm 2017-10-09T18:38:47.402-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-before-ingest/index-before-ingest.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm 2017-10-09T18:38:48.500-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-before-ingest/index-before-ingest.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 2093 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.007.adm 2017-10-09T18:38:51.074-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:51.075-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2] with service(s): [ANALYTICS] 2017-10-09T18:38:51.418-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-143] >> ERROR: Unable to connect to host at http://172.17.0.2:9002 2017-10-09T18:38:51.443-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 4] exit 2017-10-09T18:38:51.443-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 4] was cancelled (external) 2017-10-09T18:38:51.444-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:38:51.560-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:38:51.560-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-before-ingest PASSED ## test[ClusterConcurrentRebalanceIT 39: index: index-before-ingest] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 40: index: index-after-ingest] START 2017-10-09T18:38:51.561-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-after-ingest ... 2017-10-09T18:38:51.561-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 3, 4, 5] (keepMask: 28) 2017-10-09T18:38:51.561-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 9 secs 2017-10-09T18:38:51.562-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] entry 2017-10-09T18:38:51.562-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 3, 4, 5] 2017-10-09T18:38:51.569-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:38:56.476-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-142] >> SUCCESS: Node initialized 2017-10-09T18:39:51.588-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 3, 4, 5] exit 2017-10-09T18:39:51.588-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 3, 4, 5] was cancelled (external) 2017-10-09T18:39:51.588-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:39:51.746-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:39:51.746-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1] (keepMask: 1) 2017-10-09T18:39:51.746-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1] entry 2017-10-09T18:39:51.746-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 4] to [0, 1] 2017-10-09T18:39:51.758-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] removing nodes [4] 2017-10-09T18:39:51.758-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9004] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm 2017-10-09T18:39:52.754-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-after-ingest/index-after-ingest.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm 2017-10-09T18:39:53.952-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-after-ingest/index-after-ingest.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 1555 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm 2017-10-09T18:39:55.099-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:40:05.259-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-144] >> Unable to display progress bar on this os 2017-10-09T18:40:05.260-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-144] >> SUCCESS: Rebalance complete 2017-10-09T18:40:05.272-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] interrupted; stopping rebalance... 2017-10-09T18:40:05.590-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-145] >> SUCCESS: Rebalance stopped 2017-10-09T18:40:05.593-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] stop successful... 2017-10-09T18:40:05.593-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1] exit 2017-10-09T18:40:05.593-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1] was cancelled (external) 2017-10-09T18:40:05.593-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:40:07.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:40:07.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 5] (keepMask: 19) 2017-10-09T18:40:07.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 4 secs 2017-10-09T18:40:07.751-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 5] entry 2017-10-09T18:40:07.751-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 4] to [0, 1, 2, 5] 2017-10-09T18:40:07.753-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:40:07.758-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Updated state to reflect cluster (was: [0, 1, 4] now: [0, 1]) 2017-10-09T18:40:07.770-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:40:07.995-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-146] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:40:08.021-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 5] exit 2017-10-09T18:40:08.021-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 5] was cancelled (external) 2017-10-09T18:40:08.021-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:40:10.090-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:40:10.090-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 5] (keepMask: 18) 2017-10-09T18:40:10.090-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 5] entry 2017-10-09T18:40:10.090-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1] to [0, 2, 5] Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.007.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.008.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.009.adm 2017-10-09T18:40:11.015-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:40:20.275-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-147] >> SUCCESS: Node initialized 2017-10-09T18:40:21.172-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [2, 5] with service(s): [ANALYTICS] 2017-10-09T18:40:21.729-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-148] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:40:21.749-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 2, 5] exit 2017-10-09T18:40:21.749-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 5] was cancelled (external) 2017-10-09T18:40:21.750-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:40:21.942-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:40:21.942-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3, 4, 5] (keepMask: 30) 2017-10-09T18:40:21.942-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-after-ingest PASSED 2017-10-09T18:40:21.942-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 4, 5] entry ## test[ClusterConcurrentRebalanceIT 40: index: index-after-ingest] SUCCEEDED 2017-10-09T18:40:21.942-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1] to [0, 2, 3, 4, 5] ## test[ClusterConcurrentRebalanceIT 41: index: index-bad-type] START 2017-10-09T18:40:21.947-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-bad-type ... 2017-10-09T18:40:21.954-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:40:31.597-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-149] >> SUCCESS: Node initialized 2017-10-09T18:41:22.010-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 4, 5] exit 2017-10-09T18:41:22.010-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:41:22.010-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:41:22.118-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:41:22.118-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3] (keepMask: 5) 2017-10-09T18:41:22.118-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3] entry 2017-10-09T18:41:22.118-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1] to [0, 1, 3] 2017-10-09T18:41:22.120-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:41:22.138-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [3] with service(s): [ANALYTICS] 2017-10-09T18:41:22.278-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-150] >> ERROR: Unable to connect to host at http://172.17.0.2:9003 2017-10-09T18:41:22.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3] exit 2017-10-09T18:41:22.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3] was cancelled (external) 2017-10-09T18:41:22.290-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:41:22.329-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:41:22.329-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 5] (keepMask: 16) 2017-10-09T18:41:22.329-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] entry 2017-10-09T18:41:22.329-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1] to [0, 5] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-bad-type/index-bad-type.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0013: Unsupported index type ...but that was expected. 2017-10-09T18:41:22.330-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:41:22.333-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:41:22.474-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-151] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:41:22.483-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 5] exit 2017-10-09T18:41:22.484-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 5] was cancelled (external) 2017-10-09T18:41:22.484-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:41:22.533-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:41:22.533-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-bad-type PASSED ## test[ClusterConcurrentRebalanceIT 41: index: index-bad-type] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 42: index: index-bad-field-type] START 2017-10-09T18:41:22.533-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-bad-field-type ... 2017-10-09T18:41:22.533-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 4] (keepMask: 9) 2017-10-09T18:41:22.533-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 12 secs 2017-10-09T18:41:22.534-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 4] entry 2017-10-09T18:41:22.534-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1] to [0, 1, 4] 2017-10-09T18:41:22.536-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:41:22.539-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [4] with service(s): [ANALYTICS] 2017-10-09T18:41:31.357-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-152] >> SUCCESS: Node initialized 2017-10-09T18:41:31.833-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-153] >> ERROR: Failed to reach erlang port mapper at node "8091". Error: badarg 2017-10-09T18:41:31.866-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 4] exit 2017-10-09T18:41:31.866-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 4] was cancelled (external) 2017-10-09T18:41:31.866-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:41:31.967-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:41:31.967-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 4] (keepMask: 11) 2017-10-09T18:41:31.967-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:41:31.967-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4] entry 2017-10-09T18:41:31.967-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1] to [0, 1, 2, 4] 2017-10-09T18:41:31.969-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:41:32.020-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] adding node(s) [2, 4] with service(s): [ANALYTICS] 2017-10-09T18:41:42.908-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-155] >> SUCCESS: Node initialized 2017-10-09T18:41:45.026-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-154] >> SUCCESS: Node initialized 2017-10-09T18:42:08.387-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-156] >> SUCCESS: Server added 2017-10-09T18:42:08.400-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase] 2017-10-09T18:42:22.103-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-157] >> Unable to display progress bar on this os 2017-10-09T18:42:22.109-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-157] >> SUCCESS: Rebalance complete 2017-10-09T18:42:22.112-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'NCs == 4' condition for up to 30 seconds... 2017-10-09T18:42:22.188-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:42:22.241-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 1, 2, 4] exit 2017-10-09T18:42:22.242-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 4] was cancelled (external) 2017-10-09T18:42:22.242-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:42:22.306-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-bad-field-type/index-bad-field-type.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0006: Cannot index field [ts] on type datetime. Supported types: bigint, double, string ...but that was expected. 2017-10-09T18:42:22.308-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 3, 5] (keepMask: 21) 2017-10-09T18:42:22.309-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 5] entry 2017-10-09T18:42:22.309-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 2, 4] to [0, 1, 3, 5] 2017-10-09T18:42:22.312-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:43:22.343-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 3, 5] exit 2017-10-09T18:43:22.343-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 3, 5] was cancelled (external) 2017-10-09T18:43:22.343-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:43:22.531-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:43:22.531-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 3, 4, 5] (keepMask: 31) 2017-10-09T18:43:22.531-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] entry 2017-10-09T18:43:22.532-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 2, 4] to [0, 1, 2, 3, 4, 5] 2017-10-09T18:43:22.532-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-bad-field-type PASSED ## test[ClusterConcurrentRebalanceIT 42: index: index-bad-field-type] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 43: index: flush-bucket] START 2017-10-09T18:43:22.536-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/flush-bucket ... 2017-10-09T18:43:22.599-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:43:23.679-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:43:23.679-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:43:26.679-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:43:26.705-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:43:36.218-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:43:36.246-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:44:22.554-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 3, 4, 5] exit 2017-10-09T18:44:22.554-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 3, 4, 5] was cancelled (external) 2017-10-09T18:44:22.554-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:44:22.622-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/flush-bucket/flush-bucket.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. 2017-10-09T18:44:22.622-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2, 3, 5] (keepMask: 22) 2017-10-09T18:44:22.622-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 10 secs 2017-10-09T18:44:22.623-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 5] entry 2017-10-09T18:44:22.623-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 4] to [0, 2, 3, 5] org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) at org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1306) at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:870) at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) at org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1443) at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) ...Unexpected! ## test[ClusterConcurrentRebalanceIT 43: index: flush-bucket] FAILED (java.lang.Exception) ## test[ClusterConcurrentRebalanceIT 44: internal: create-missing-kv-bucket] START 2017-10-09T18:44:22.631-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/create-missing-kv-bucket ... 2017-10-09T18:44:22.633-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:45:22.642-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2, 3, 5] exit 2017-10-09T18:45:22.643-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 2, 3, 5] was cancelled (external) 2017-10-09T18:45:22.643-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:45:22.710-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/internal/create-missing-kv-bucket/create-missing-kv-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0016: Bucket (invalid_kv_bucket) does not exist ...but that was expected. 2017-10-09T18:45:22.710-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: internal/create-missing-kv-bucket PASSED ## test[ClusterConcurrentRebalanceIT 44: internal: create-missing-kv-bucket] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 45: internal: connect-deleted-bucket] START 2017-10-09T18:45:22.711-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/connect-deleted-bucket ... 2017-10-09T18:45:22.711-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 1, 2, 4, 5] (keepMask: 27) 2017-10-09T18:45:22.711-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 7 secs 2017-10-09T18:45:22.711-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 4, 5] entry 2017-10-09T18:45:22.711-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] Rebalancing from [0, 1, 2, 4] to [0, 1, 2, 4, 5] ## test[ClusterConcurrentRebalanceIT 45: internal: connect-deleted-bucket] SUCCEEDED ## test[ClusterConcurrentRebalanceIT 46: internal: default-bucket-name] START 2017-10-09T18:45:22.713-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/default-bucket-name ... 2017-10-09T18:45:22.714-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspending rebalances due to ddl... 2017-10-09T18:45:22.720-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-2] adding node(s) [5] with service(s): [ANALYTICS] 2017-10-09T18:45:22.842-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-158] >> ERROR: Unable to connect to host at http://172.17.0.2:9005 2017-10-09T18:45:22.850-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-2] rebalance [0, 1, 2, 4, 5] exit 2017-10-09T18:45:22.850-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalance [0, 1, 2, 4, 5] was cancelled (external) 2017-10-09T18:45:22.850-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] suspended rebalances due to ddl 2017-10-09T18:45:22.901-07:00 INFO CBAS.cbserver.PerpetualRebalancer [main] rebalances resumed due to ddl complete 2017-10-09T18:45:22.901-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] rebalancing to: [0, 2] (keepMask: 2) testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/internal/default-bucket-name/default-bucket-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0016: Bucket (wrong_bucket) does not exist ...but that was expected. 2017-10-09T18:45:22.902-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: internal/default-bucket-name PASSED 2017-10-09T18:45:22.902-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-0] will cancel rebalance if not completed within 5 secs ## test[ClusterConcurrentRebalanceIT 46: internal: default-bucket-name] SUCCEEDED 2017-10-09T18:45:22.902-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2] entry 2017-10-09T18:45:22.902-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] Rebalancing from [0, 1, 2, 4] to [0, 2] 2017-10-09T18:45:22.903-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] shutting down cluster_run... 2017-10-09T18:45:22.906-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] removing nodes [1, 4] 2017-10-09T18:45:22.908-07:00 INFO CBAS.test.ClusterIntegrationUtil [Rebalancer-1] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 172.17.0.2:9001,172.17.0.2:9004] 2017-10-09T18:45:22.915-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run sent SIGINT 2017-10-09T18:45:24.177-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-159] >> Unable to display progress bar on this os 2017-10-09T18:45:24.177-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-159] >> ERROR: Rebalance failed. See logs for detailed reason. You can try again. 2017-10-09T18:45:24.187-07:00 INFO CBAS.cbserver.PerpetualRebalancer [Rebalancer-1] rebalance [0, 2] exit 2017-10-09T18:45:24.607-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run has exited 2017-10-09T18:45:25.652-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] restoring data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data 2017-10-09T18:45:26.041-07:00 WARN CBAS.test.ClusterIntegrationUtil [main] Ignoring IOException on deleting /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data (will retry in 1s) java.io.IOException: Unable to delete directory /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data/n_0/datadir. at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1581) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2372) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1679) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1575) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2372) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1679) ~[commons-io-2.5.jar:2.5] at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1575) ~[commons-io-2.5.jar:2.5] at com.couchbase.analytics.test.common.ClusterTestBase.tryDeleteDirectory(ClusterTestBase.java:605) [cbas-server-1.0.0-SNAPSHOT-tests.jar:1.0.0-SNAPSHOT] at com.couchbase.analytics.test.ClusterIntegrationUtil.deinit(ClusterIntegrationUtil.java:143) [cbas-server-1.0.0-SNAPSHOT-tests.jar:1.0.0-SNAPSHOT] at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.teardown(ClusterConcurrentRebalanceIT.java:195) [test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [surefire-junit4-2.20.jar:2.20] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272) [surefire-junit4-2.20.jar:2.20] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236) [surefire-junit4-2.20.jar:2.20] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [surefire-junit4-2.20.jar:2.20] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) [surefire-booter-2.20.jar:2.20] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) [surefire-booter-2.20.jar:2.20] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) [surefire-booter-2.20.jar:2.20] 2017-10-09T18:45:27.049-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] restoring logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs [ERROR] Tests run: 47, Failures: 0, Errors: 19, Skipped: 0, Time elapsed: 1,788.373 s <<< FAILURE! - in com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT [ERROR] test[ClusterConcurrentRebalanceIT 0: feeds: parse-failure-to-delete](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 83.29 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.011.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: The number of active operations cannot be negative! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 1: feeds: binary-doc](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 17.797 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/binary-doc/binary-doc.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 4: feeds: bucket-is-final](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 40.377 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-is-final/bucket-is-final.001.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 6: feeds: connect-connected-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 7.549 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-connected-bucket/connect-connected-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 7: feeds: connect-connected-bucket-conditional](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 41.59 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-connected-bucket-conditional/connect-connected-bucket-conditional.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 13: feeds: disconnect-disconnected-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 62.656 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/disconnect-disconnected-bucket/disconnect-disconnected-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 14: feeds: disconnect-disconnected-bucket-conditional](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 7.37 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/disconnect-disconnected-bucket-conditional/disconnect-disconnected-bucket-conditional.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 15: feeds: drop-connected-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 19.684 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-bucket/drop-connected-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 16: feeds: drop-connected-shadow](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 60.091 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-shadow/drop-connected-shadow.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 17: feeds: drop-index-for-connected-shadow](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 36.547 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-index-for-connected-shadow/drop-index-for-connected-shadow.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 18: feeds: drop-shadowed-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 12.853 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-shadowed-bucket/drop-shadowed-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 24: feeds: index-connected-shadow](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 22.599 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/index-connected-shadow/index-connected-shadow.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 25: feeds: load-empty-bucket-new-syntax](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 16.713 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 26: feeds: resume](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 60.086 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 29: feeds: shadow-connected-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 21.86 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/shadow-connected-bucket/shadow-connected-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 31: feeds: flush-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 15.543 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/flush-bucket/flush-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 32: feeds: connect-flushed-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 14.34 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-flushed-bucket/flush-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 35: feeds: re-create-connected-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 13.784 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [ERROR] test[ClusterConcurrentRebalanceIT 43: index: flush-bucket](com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT) Time elapsed: 60.107 s <<< ERROR! java.lang.Exception: Test "src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/flush-bucket/flush-bucket.002.ddl.sqlpp" FAILED! at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) Caused by: org.apache.asterix.common.exceptions.AsterixException: A bucket with name gbook_user_bucket already exists. at com.couchbase.analytics.test.cbserver.ClusterConcurrentRebalanceIT.test(ClusterConcurrentRebalanceIT.java:125) [INFO] Running com.couchbase.analytics.test.cbserver.ClusterIntegrationIT 2017-10-09T18:45:29.537-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 10 seconds... 2017-10-09T18:45:31.574-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] backing up existing data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data.save 2017-10-09T18:45:31.575-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] backing up existing logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs.save ## singleNodeCluster START 2017-10-09T18:45:31.615-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:45:49.639-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:46:01.140-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-1] >> SUCCESS: Node initialized 2017-10-09T18:46:02.148-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-2] >> SUCCESS: Cluster initialized 2017-10-09T18:46:02.155-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:46:12.096-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:46:12.117-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:46:12.121-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:46:13.268-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:46:13.269-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:46:13.275-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:46:14.276-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... ## singleNodeCluster SUCCEEDED ## twoNodeCancelledRemove START 2017-10-09T18:46:17.300-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:46:37.431-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:46:49.588-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-4] >> SUCCESS: Node initialized 2017-10-09T18:46:50.565-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-5] >> SUCCESS: Cluster initialized 2017-10-09T18:46:50.567-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:46:59.303-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:46:59.336-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] adding second analytics node... 2017-10-09T18:47:04.099-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-6] >> SUCCESS: Node initialized 2017-10-09T18:47:11.918-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-7] >> SUCCESS: Server added 2017-10-09T18:47:16.922-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] calling rebalance... 2017-10-09T18:47:23.101-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-8] >> Unable to display progress bar on this os 2017-10-09T18:47:23.102-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-8] >> SUCCESS: Rebalance complete 2017-10-09T18:47:23.106-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:47:23.149-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:47:23.194-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] +/analytics/admin/rebalance/setRebalanceDelay?delay=10 (n_0) 2017-10-09T18:47:23.234-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] removing second analytics node/rebalance... 2017-10-09T18:47:24.380-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-10] >> SUCCESS: Rebalance stopped 2017-10-09T18:47:24.393-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'rebalance status == notRunning' condition for up to 60 seconds... 2017-10-09T18:47:24.526-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-11] >> { 2017-10-09T18:47:24.526-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-11] >> "status": "notRunning", 2017-10-09T18:47:24.527-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-11] >> "msg": "Rebalance is not running", 2017-10-09T18:47:24.527-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-11] >> "details": {} 2017-10-09T18:47:24.527-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-11] >> } 2017-10-09T18:47:25.406-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-9] >> Unable to display progress bar on this os 2017-10-09T18:47:25.406-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-9] >> SUCCESS: Rebalance complete 2017-10-09T18:47:25.409-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cancelled rebalance invocation got exitcode 0 2017-10-09T18:47:25.410-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:47:25.439-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:47:44.707-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-12] >> Unable to display progress bar on this os 2017-10-09T18:47:44.707-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-12] >> SUCCESS: Rebalance complete 2017-10-09T18:47:44.710-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:47:44.728-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:47:44.743-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:47:44.746-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:47:45.910-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:47:45.910-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:47:45.917-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:47:46.918-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... ## twoNodeCancelledRemove SUCCEEDED ## rbacIntegrationTest START 2017-10-09T18:47:49.940-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:48:10.147-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:48:22.918-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-14] >> SUCCESS: Node initialized 2017-10-09T18:48:23.977-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-15] >> SUCCESS: Cluster initialized 2017-10-09T18:48:23.980-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:48:33.683-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:48:33.704-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] adding second analytics node... 2017-10-09T18:48:38.771-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-16] >> SUCCESS: Node initialized 2017-10-09T18:48:46.606-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-17] >> SUCCESS: Server added 2017-10-09T18:48:51.636-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] calling rebalance... 2017-10-09T18:48:57.827-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-18] >> Unable to display progress bar on this os 2017-10-09T18:48:57.831-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-18] >> SUCCESS: Rebalance complete 2017-10-09T18:48:57.835-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:48:57.897-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:49:03.120-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:49:03.124-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:49:04.286-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:49:04.287-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:49:04.299-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:49:05.302-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... ## rbacIntegrationTest SUCCEEDED ## twoNodeCluster START 2017-10-09T18:49:08.336-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:49:28.544-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:49:40.746-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-20] >> SUCCESS: Node initialized 2017-10-09T18:49:41.595-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-21] >> SUCCESS: Cluster initialized 2017-10-09T18:49:41.597-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:49:51.295-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:49:51.318-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] adding second analytics node... 2017-10-09T18:49:56.340-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-22] >> SUCCESS: Node initialized 2017-10-09T18:50:03.944-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-23] >> SUCCESS: Server added 2017-10-09T18:50:08.951-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] calling rebalance... 2017-10-09T18:50:15.143-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-24] >> Unable to display progress bar on this os 2017-10-09T18:50:15.146-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-24] >> SUCCESS: Rebalance complete 2017-10-09T18:50:15.154-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:50:15.259-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:50:15.314-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:50:15.322-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:50:16.469-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:50:16.469-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:50:16.490-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:50:17.492-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:50:20.494-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:50:38.997-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:50:38.997-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:50:52.027-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:50:52.071-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] removing second analytics node/rebalance... 2017-10-09T18:50:53.238-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-26] >> Unable to display progress bar on this os 2017-10-09T18:50:53.244-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-26] >> SUCCESS: Rebalance complete 2017-10-09T18:50:53.244-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:50:53.422-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:50:53.475-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:50:53.482-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:50:54.716-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:50:54.717-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:50:54.735-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:50:55.739-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:50:58.741-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:51:15.263-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:51:15.264-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:51:27.145-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:51:27.212-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:51:27.233-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:51:29.191-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:51:29.192-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:51:29.197-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... ## twoNodeCluster SUCCEEDED ## webUiEndPoints START 2017-10-09T18:51:32.219-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] starting cluster_run 2017-10-09T18:51:50.397-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster is running 2017-10-09T18:52:03.925-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-29] >> SUCCESS: Node initialized 2017-10-09T18:52:05.009-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-30] >> SUCCESS: Cluster initialized 2017-10-09T18:52:05.016-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T18:52:14.754-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:52:14.774-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] adding second analytics node... 2017-10-09T18:52:21.069-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-31] >> SUCCESS: Node initialized 2017-10-09T18:52:29.371-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-32] >> SUCCESS: Server added 2017-10-09T18:52:34.375-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] calling rebalance... 2017-10-09T18:52:40.552-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-33] >> Unable to display progress bar on this os 2017-10-09T18:52:40.553-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [Thread-33] >> SUCCESS: Rebalance complete 2017-10-09T18:52:40.560-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T18:52:40.607-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T18:52:41.085-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] shutting down cluster_run... 2017-10-09T18:52:41.088-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run sent SIGINT 2017-10-09T18:52:42.234-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] cluster_run has exited 2017-10-09T18:52:42.234-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T18:52:42.241-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... 2017-10-09T18:52:43.245-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [waitForCondition] [9301] still running... ## webUiEndPoints SUCCEEDED 2017-10-09T18:52:46.565-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] restoring data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data 2017-10-09T18:52:46.582-07:00 INFO CBAS.cbserver.ClusterIntegrationIT [main] restoring logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs [INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 437.816 s - in com.couchbase.analytics.test.cbserver.ClusterIntegrationIT [INFO] Running com.couchbase.analytics.test.cbserver.ClusterSharedExecutionIT 2017-10-09T18:52:49.001-07:00 INFO CBAS.util.CBTestEnvironmentProvider [main] Initializing Test Couchbase Environment SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/apache/logging/log4j/log4j-slf4j-impl/2.7/log4j-slf4j-impl-2.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2017-10-09T18:52:49.223-07:00 INFO CBAS.core.CouchbaseCore [main] CouchbaseEnvironment: {sslEnabled=false, sslKeystoreFile='null', sslKeystorePassword=false, sslKeystore=null, bootstrapHttpEnabled=true, bootstrapCarrierEnabled=true, bootstrapHttpDirectPort=9000, bootstrapHttpSslPort=18091, bootstrapCarrierDirectPort=12000, bootstrapCarrierSslPort=11207, ioPoolSize=4, computationPoolSize=4, responseBufferSize=16384, requestBufferSize=16384, kvServiceEndpoints=1, viewServiceEndpoints=12, queryServiceEndpoints=12, searchServiceEndpoints=12, configPollInterval=2500, ioPool=NioEventLoopGroup, kvIoPool=null, viewIoPool=null, searchIoPool=null, queryIoPool=null, coreScheduler=CoreScheduler, memcachedHashingStrategy=DefaultMemcachedHashingStrategy, eventBus=DefaultEventBus, packageNameAndVersion=couchbase-java-client/2.5.1 (git: 2.5.1, core: 1.5.1), retryStrategy=BestEffort, maxRequestLifetime=75000, retryDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=100, upper=100000}, reconnectDelay=ExponentialDelay{growBy 1.0 MILLISECONDS, powers of 2; lower=32, upper=4096}, observeIntervalDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=10, upper=100000}, keepAliveInterval=30000, continuousKeepAliveEnabled=true, keepAliveErrorThreshold=4, keepAliveTimeout=2500, autoreleaseAfter=75000, bufferPoolingEnabled=true, tcpNodelayEnabled=true, mutationTokensEnabled=false, socketConnectTimeout=1000, callbacksOnIoPool=false, disconnectTimeout=75000, requestBufferWaitStrategy=com.couchbase.client.core.env.DefaultCoreEnvironment$2@4007f65e, certAuthEnabled=false, coreSendHook=null, queryTimeout=75000, viewTimeout=75000, searchTimeout=75000, analyticsTimeout=75000, kvTimeout=75000, connectTimeout=75000, dnsSrvEnabled=false} 2017-10-09T18:52:49.300-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 10 seconds... 2017-10-09T18:52:51.334-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] backing up existing data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data.save 2017-10-09T18:52:51.335-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] backing up existing logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs.save 2017-10-09T18:52:51.335-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] starting cluster_run 2017-10-09T18:53:03.905-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster is running 2017-10-09T18:53:03.905-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] configuring cluster with services: [ANALYTICS, DATA] 2017-10-09T18:53:10.629-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-5] >> SUCCESS: Node initialized 2017-10-09T18:53:11.673-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-6] >> SUCCESS: Cluster initialized 2017-10-09T18:53:11.677-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Rebalancing from [0] to [0] 2017-10-09T18:53:11.918-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] Nothing to do, requested topology already in place: [0] 2017-10-09T18:53:18.098-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-7] >> Unable to display progress bar on this os 2017-10-09T18:53:18.098-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-7] >> SUCCESS: Rebalance complete Integrated cluster running on http://couchbase:couchbase@localhost:9000; Analytics running on http://127.0.0.1:9300 (debug port: 9309) 2017-10-09T18:53:27.876-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-8] >> Errors occurred during the index creation phase. See logs for details. 2017-10-09T18:53:27.879-07:00 INFO CBAS.common.TestExecutor [main] cbdocloader exit code: 1 ## test[ClusterSharedExecutionIT 0: feeds: parse-failure-to-delete] START 2017-10-09T18:53:27.906-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/parse-failure-to-delete ... 2017-10-09T18:53:28.486-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:53:39.116-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:53:41.229-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:53:42.238-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-9] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:53:42.266-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:53:43.451-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/parse-failure-to-delete/parse-failure-to-delete.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 3652 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.001.adm 2017-10-09T18:53:44.841-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-3] Opened bucket gbook_users 2017-10-09T18:53:44.878-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.002.adm 2017-10-09T18:53:45.021-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-3] Opened bucket gbook_users 2017-10-09T18:53:45.028-07:00 INFO CBAS.util.Loader [main] +++ caught java.lang.RuntimeException: java.util.concurrent.TimeoutException; new timeout 10 (gbook_users) +++ 2017-10-09T18:53:45.033-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/parse-failure-to-delete/parse-failure-to-delete.003.adm 2017-10-09T18:53:46.303-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/parse-failure-to-delete PASSED ## test[ClusterSharedExecutionIT 0: feeds: parse-failure-to-delete] SUCCEEDED ## test[ClusterSharedExecutionIT 1: feeds: binary-doc] START 2017-10-09T18:53:46.305-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/binary-doc ... 2017-10-09T18:53:46.318-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:53:46.772-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:53:46.772-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:53:49.772-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:53:49.781-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:53:59.181-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:53:59.694-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:54:00.395-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-10] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:54:00.398-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.001.adm 2017-10-09T18:54:00.564-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/binary-doc/binary-doc.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.001.adm 2017-10-09T18:54:01.696-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/binary-doc/binary-doc.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 7564 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.001.adm 2017-10-09T18:54:02.814-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-3] Opened bucket gbook_users 2017-10-09T18:54:02.818-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users 2017-10-09T18:54:02.824-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:54:03.584-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-11] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:54:03.587-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.002.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.002.adm 2017-10-09T18:54:03.788-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/binary-doc/binary-doc.008.pollquery.sqlpp changed at line 1: < { "count": 20000 } > { "count": 15152 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/binary-doc/binary-doc.002.adm 2017-10-09T18:54:05.963-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/binary-doc PASSED ## test[ClusterSharedExecutionIT 1: feeds: binary-doc] SUCCEEDED ## test[ClusterSharedExecutionIT 2: feeds: connect-new-disconnected-bucket] START 2017-10-09T18:54:05.965-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-new-disconnected-bucket ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm 2017-10-09T18:54:06.456-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:54:09.005-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-new-disconnected-bucket/connect-new-disconnected-bucket.006.adm 2017-10-09T18:54:11.203-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-new-disconnected-bucket PASSED ## test[ClusterSharedExecutionIT 2: feeds: connect-new-disconnected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 3: feeds: bucket-and-name] START 2017-10-09T18:54:11.203-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-and-name ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-and-name/bucket-and-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: bucket is deprecated and can't be passed along with the expected field name "name" ...but that was expected. 2017-10-09T18:54:11.240-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/bucket-and-name PASSED ## test[ClusterSharedExecutionIT 3: feeds: bucket-and-name] SUCCEEDED ## test[ClusterSharedExecutionIT 4: feeds: bucket-is-final] START 2017-10-09T18:54:11.240-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-is-final ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-is-final/bucket-is-final.002.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: bucket can't be set at connection time ...but that was expected. 2017-10-09T18:54:11.385-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/bucket-is-final PASSED ## test[ClusterSharedExecutionIT 4: feeds: bucket-is-final] SUCCEEDED ## test[ClusterSharedExecutionIT 5: feeds: bucket-name] START 2017-10-09T18:54:11.385-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/bucket-name ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:54:11.858-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/bucket-name/bucket-name.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/bucket-name/bucket-name.003.adm 2017-10-09T18:54:14.023-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/bucket-name PASSED ## test[ClusterSharedExecutionIT 5: feeds: bucket-name] SUCCEEDED ## test[ClusterSharedExecutionIT 6: feeds: connect-connected-bucket] START 2017-10-09T18:54:14.024-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-connected-bucket ... 2017-10-09T18:54:14.035-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:54:14.517-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:54:14.517-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:54:17.517-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:54:17.529-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:54:23.784-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-connected-bucket/connect-connected-bucket.004.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The bucket gbook_user_bucket is already connected. ...but that was expected. 2017-10-09T18:54:25.489-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-connected-bucket PASSED ## test[ClusterSharedExecutionIT 6: feeds: connect-connected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 7: feeds: connect-connected-bucket-conditional] START 2017-10-09T18:54:25.489-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-connected-bucket-conditional ... 2017-10-09T18:54:25.501-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:54:25.925-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:54:25.925-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:54:28.925-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:54:28.934-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:54:39.372-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:54:41.068-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-connected-bucket-conditional PASSED ## test[ClusterSharedExecutionIT 7: feeds: connect-connected-bucket-conditional] SUCCEEDED ## test[ClusterSharedExecutionIT 8: feeds: connect-multiple-filtered-buckets] START 2017-10-09T18:54:41.069-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-multiple-filtered-buckets ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm 2017-10-09T18:54:41.494-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-multiple-filtered-buckets/connect-multiple-filtered-buckets.005.adm 2017-10-09T18:54:43.718-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-multiple-filtered-buckets PASSED ## test[ClusterSharedExecutionIT 8: feeds: connect-multiple-filtered-buckets] SUCCEEDED ## test[ClusterSharedExecutionIT 9: feeds: connect-or-filtered-buckets] START 2017-10-09T18:54:43.719-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-or-filtered-buckets ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm 2017-10-09T18:54:44.121-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.pollquery.sqlpp changed at line 1: < { "count": 5874 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-or-filtered-buckets/connect-or-filtered-buckets.005.adm 2017-10-09T18:54:46.338-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-or-filtered-buckets PASSED ## test[ClusterSharedExecutionIT 9: feeds: connect-or-filtered-buckets] SUCCEEDED ## test[ClusterSharedExecutionIT 10: feeds: connect-shadowless-bucket] START 2017-10-09T18:54:46.338-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-shadowless-bucket ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-shadowless-bucket/connect-shadowless-bucket.002.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The bucket beer_bucket doesn't have any shadow datasets. ...but that was expected. 2017-10-09T18:54:46.432-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-shadowless-bucket PASSED ## test[ClusterSharedExecutionIT 10: feeds: connect-shadowless-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 11: feeds: connect-with-unrecognized] START 2017-10-09T18:54:46.433-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-with-unrecognized ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-with-unrecognized/connect-with-unrecognized.002.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: unknown is not a recognized bucket connect field ...but that was expected. 2017-10-09T18:54:46.558-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-with-unrecognized PASSED ## test[ClusterSharedExecutionIT 11: feeds: connect-with-unrecognized] SUCCEEDED ## test[ClusterSharedExecutionIT 12: feeds: default-host-format] START 2017-10-09T18:54:46.559-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/default-host-format ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm 2017-10-09T18:54:46.954-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/default-host-format/default-host-format.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/default-host-format/default-host-format.004.adm 2017-10-09T18:54:49.094-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/default-host-format PASSED ## test[ClusterSharedExecutionIT 12: feeds: default-host-format] SUCCEEDED ## test[ClusterSharedExecutionIT 13: feeds: disconnect-disconnected-bucket] START 2017-10-09T18:54:49.094-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/disconnect-disconnected-bucket ... 2017-10-09T18:54:49.107-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:54:49.530-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:54:49.530-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:54:52.531-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:54:52.541-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:54:58.801-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/disconnect-disconnected-bucket/disconnect-disconnected-bucket.003.update.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The bucket gbook_user_bucket is not connected. ...but that was expected. 2017-10-09T18:54:58.925-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/disconnect-disconnected-bucket PASSED ## test[ClusterSharedExecutionIT 13: feeds: disconnect-disconnected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 14: feeds: disconnect-disconnected-bucket-conditional] START 2017-10-09T18:54:58.925-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/disconnect-disconnected-bucket-conditional ... 2017-10-09T18:54:58.935-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:54:59.356-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:54:59.357-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:55:02.357-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:55:02.365-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:55:09.693-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:55:09.806-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/disconnect-disconnected-bucket-conditional PASSED ## test[ClusterSharedExecutionIT 14: feeds: disconnect-disconnected-bucket-conditional] SUCCEEDED ## test[ClusterSharedExecutionIT 15: feeds: drop-connected-bucket] START 2017-10-09T18:55:09.808-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-connected-bucket ... 2017-10-09T18:55:09.821-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:55:10.245-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:55:10.246-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:55:13.246-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:55:13.254-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:55:19.502-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-bucket/drop-connected-bucket.004.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: The bucket gbook_user_bucket can't be dropped because it is in the connected state. ...but that was expected. 2017-10-09T18:55:21.208-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/drop-connected-bucket PASSED ## test[ClusterSharedExecutionIT 15: feeds: drop-connected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 16: feeds: drop-connected-shadow] START 2017-10-09T18:55:21.208-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-connected-shadow ... 2017-10-09T18:55:21.221-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:55:21.639-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:55:21.639-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:55:24.639-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:55:24.651-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:55:34.024-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-connected-shadow/drop-connected-shadow.004.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Can't drop shadow dataset because its bucket is in the connected state ...but that was expected. 2017-10-09T18:55:35.700-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/drop-connected-shadow PASSED ## test[ClusterSharedExecutionIT 16: feeds: drop-connected-shadow] SUCCEEDED ## test[ClusterSharedExecutionIT 17: feeds: drop-index-for-connected-shadow] START 2017-10-09T18:55:35.701-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-index-for-connected-shadow ... 2017-10-09T18:55:35.711-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:55:37.143-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:55:37.144-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:55:40.144-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:55:40.152-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:55:49.525-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-index-for-connected-shadow/drop-index-for-connected-shadow.004.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Datasetgbook_users is currently being fed into by the following active entities: Default.gbook_user_bucket(CouchbaseMetadataExtension)-->gbook_users ...but that was expected. 2017-10-09T18:55:51.279-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/drop-index-for-connected-shadow PASSED ## test[ClusterSharedExecutionIT 17: feeds: drop-index-for-connected-shadow] SUCCEEDED ## test[ClusterSharedExecutionIT 18: feeds: drop-shadowed-bucket] START 2017-10-09T18:55:51.280-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/drop-shadowed-bucket ... 2017-10-09T18:55:51.290-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:55:51.724-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:55:51.724-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:55:54.724-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:55:54.732-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:56:04.109-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/drop-shadowed-bucket/drop-shadowed-bucket.003.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0009: The bucket Default.gbook_user_bucket(CouchbaseMetadataExtension) cannot be dropped because the following datasets shadow it: gbook_users. ...but that was expected. 2017-10-09T18:56:04.241-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/drop-shadowed-bucket PASSED ## test[ClusterSharedExecutionIT 18: feeds: drop-shadowed-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 19: feeds: duplicate-bucket] START 2017-10-09T18:56:04.243-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-bucket ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/duplicate-bucket/duplicate-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A bucket with name beersample already exists. ...but that was expected. 2017-10-09T18:56:04.282-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-bucket PASSED ## test[ClusterSharedExecutionIT 19: feeds: duplicate-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 20: feeds: duplicate-bucket-if-not-exists] START 2017-10-09T18:56:04.282-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-bucket-if-not-exists ... 2017-10-09T18:56:04.328-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-bucket-if-not-exists PASSED ## test[ClusterSharedExecutionIT 20: feeds: duplicate-bucket-if-not-exists] SUCCEEDED ## test[ClusterSharedExecutionIT 21: feeds: duplicate-shadow] START 2017-10-09T18:56:04.328-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-shadow ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/duplicate-shadow/duplicate-shadow.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: A dataset with name beers already exists. ...but that was expected. 2017-10-09T18:56:04.408-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-shadow PASSED ## test[ClusterSharedExecutionIT 21: feeds: duplicate-shadow] SUCCEEDED ## test[ClusterSharedExecutionIT 22: feeds: duplicate-shadow-if-not-exists] START 2017-10-09T18:56:04.408-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/duplicate-shadow-if-not-exists ... 2017-10-09T18:56:04.486-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/duplicate-shadow-if-not-exists PASSED ## test[ClusterSharedExecutionIT 22: feeds: duplicate-shadow-if-not-exists] SUCCEEDED ## test[ClusterSharedExecutionIT 23: feeds: empty-bucket-name] START 2017-10-09T18:56:04.486-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/empty-bucket-name ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/empty-bucket-name/empty-bucket-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Field bucket can't be empty ...but that was expected. 2017-10-09T18:56:04.515-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/empty-bucket-name PASSED ## test[ClusterSharedExecutionIT 23: feeds: empty-bucket-name] SUCCEEDED ## test[ClusterSharedExecutionIT 24: feeds: index-connected-shadow] START 2017-10-09T18:56:04.516-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/index-connected-shadow ... 2017-10-09T18:56:04.528-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:56:04.989-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:56:04.989-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:56:07.989-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:56:08.002-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:56:14.245-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/index-connected-shadow/index-connected-shadow.004.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Dataset Default.gbook_users is currently being fed into by the following active entities. Default.gbook_user_bucket(CouchbaseMetadataExtension) ...but that was expected. 2017-10-09T18:56:16.001-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/index-connected-shadow PASSED ## test[ClusterSharedExecutionIT 24: feeds: index-connected-shadow] SUCCEEDED ## test[ClusterSharedExecutionIT 25: feeds: load-empty-bucket-new-syntax] START 2017-10-09T18:56:16.002-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/load-empty-bucket-new-syntax ... 2017-10-09T18:56:16.018-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:56:16.450-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:56:16.450-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:56:19.451-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:56:19.458-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:56:28.785-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:56:29.107-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:56:29.902-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-12] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:29.904-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:56:29.905-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:56:30.893-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-13] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:30.895-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.001.adm 2017-10-09T18:56:31.084-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.005.pollquery.sqlpp changed at line 1: < { "count": 20000 } > { "count": 2804 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.001.adm 2017-10-09T18:56:32.156-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/1.json 2017-10-09T18:56:32.225-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-14] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/1.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:32.228-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/mutations/1.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.002.adm 2017-10-09T18:56:32.330-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-3] Opened bucket gbook_users 2017-10-09T18:56:32.466-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.003.adm 2017-10-09T18:56:32.530-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/2.json 2017-10-09T18:56:32.749-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-15] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/2.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:32.752-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/mutations/2.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.004.adm 2017-10-09T18:56:32.870-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/3.json 2017-10-09T18:56:32.960-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-16] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/3.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:32.962-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/mutations/3.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/load-empty-bucket-new-syntax/load-empty-bucket-new-syntax.005.adm 2017-10-09T18:56:34.133-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/load-empty-bucket-new-syntax PASSED ## test[ClusterSharedExecutionIT 25: feeds: load-empty-bucket-new-syntax] SUCCEEDED ## test[ClusterSharedExecutionIT 26: feeds: resume] START 2017-10-09T18:56:34.133-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/resume ... 2017-10-09T18:56:34.145-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:56:34.618-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:56:34.618-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:56:37.618-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:56:37.626-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:56:43.874-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:56:44.172-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:56:44.834-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-17] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:44.837-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:56:44.837-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:56:45.576-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-18] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:45.582-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:56:45.583-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p3/gbook_users.json 2017-10-09T18:56:46.271-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-19] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p3/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:46.274-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p3/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm 2017-10-09T18:56:46.387-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.005.pollquery.sqlpp changed at line 1: < { "count": 30000 } > { "count": 7707 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm 2017-10-09T18:56:47.471-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.005.pollquery.sqlpp changed at line 1: < { "count": 30000 } > { "count": 24821 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm 2017-10-09T18:56:48.538-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.005.pollquery.sqlpp changed at line 1: < { "count": 30000 } > { "count": 24821 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.001.adm 2017-10-09T18:56:50.657-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/4.json 2017-10-09T18:56:50.702-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-20] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/mutations/4.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:56:50.707-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/mutations/4.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.002.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/resume/resume.002.adm 2017-10-09T18:56:51.034-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/resume/resume.009.pollquery.sqlpp changed at line 1: < { "count": 30004 } > { "count": 30000 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/resume/resume.002.adm 2017-10-09T18:56:53.177-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/resume PASSED ## test[ClusterSharedExecutionIT 26: feeds: resume] SUCCEEDED ## test[ClusterSharedExecutionIT 27: feeds: password-not-allowed] START 2017-10-09T18:56:53.178-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/password-not-allowed ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/password-not-allowed/password-not-allowed.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: password can only be passed at connection time ...but that was expected. 2017-10-09T18:56:53.209-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/password-not-allowed PASSED ## test[ClusterSharedExecutionIT 27: feeds: password-not-allowed] SUCCEEDED ## test[ClusterSharedExecutionIT 28: feeds: passwordless] START 2017-10-09T18:56:53.210-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/passwordless ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:56:53.554-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/passwordless/passwordless.003.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/passwordless/passwordless.004.adm 2017-10-09T18:56:55.682-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/passwordless PASSED ## test[ClusterSharedExecutionIT 28: feeds: passwordless] SUCCEEDED ## test[ClusterSharedExecutionIT 29: feeds: shadow-connected-bucket] START 2017-10-09T18:56:55.682-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/shadow-connected-bucket ... 2017-10-09T18:56:55.695-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:56:56.601-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:56:56.601-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:56:59.602-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:56:59.609-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:57:08.962-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/shadow-connected-bucket/shadow-connected-bucket.004.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: Shadow can't be created because Bucket gbook_user_bucket is in connected state. ...but that was expected. 2017-10-09T18:57:10.623-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/shadow-connected-bucket PASSED ## test[ClusterSharedExecutionIT 29: feeds: shadow-connected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 30: feeds: unsupported-fields-in-bucket] START 2017-10-09T18:57:10.624-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/unsupported-fields-in-bucket ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/unsupported-fields-in-bucket/unsupported-fields-in-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: unknown is not a recognized bucket create field ...but that was expected. 2017-10-09T18:57:10.648-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/unsupported-fields-in-bucket PASSED ## test[ClusterSharedExecutionIT 30: feeds: unsupported-fields-in-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 31: feeds: flush-bucket] START 2017-10-09T18:57:10.649-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/flush-bucket ... 2017-10-09T18:57:10.662-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:57:11.106-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:57:11.106-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:57:14.106-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:57:14.114-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:57:17.237-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:57:17.555-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:57:18.101-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-21] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:57:18.104-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.001.adm 2017-10-09T18:57:18.161-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/flush-bucket/flush-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 228 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.001.adm 2017-10-09T18:57:19.237-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-2] Opened bucket gbook_users 2017-10-09T18:57:23.149-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.002.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.002.adm 2017-10-09T18:57:23.212-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/flush-bucket/flush-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 0 } > { "count": 10000 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.002.adm 2017-10-09T18:57:24.267-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:57:24.906-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-22] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:57:24.908-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.003.adm 2017-10-09T18:57:24.988-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/flush-bucket/flush-bucket.009.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 2439 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/flush-bucket/flush-bucket.003.adm 2017-10-09T18:57:27.111-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/flush-bucket PASSED ## test[ClusterSharedExecutionIT 31: feeds: flush-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 32: feeds: connect-flushed-bucket] START 2017-10-09T18:57:27.112-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/connect-flushed-bucket ... 2017-10-09T18:57:27.122-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:57:27.555-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:57:27.555-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:57:30.555-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:57:30.565-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:57:38.872-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:57:39.129-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:57:39.821-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-23] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:57:39.824-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.001.adm 2017-10-09T18:57:39.891-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-flushed-bucket/flush-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 26 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.001.adm 2017-10-09T18:57:42.018-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-1] Opened bucket gbook_users 2017-10-09T18:57:43.774-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.002.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.003.adm 2017-10-09T18:57:44.348-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:57:44.887-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-24] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:57:44.890-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.004.adm 2017-10-09T18:57:44.943-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/connect-flushed-bucket/flush-bucket.012.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 53 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/connect-flushed-bucket/connect-flushed-bucket.004.adm 2017-10-09T18:57:47.071-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/connect-flushed-bucket PASSED ## test[ClusterSharedExecutionIT 32: feeds: connect-flushed-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 33: feeds: mb-22837] START 2017-10-09T18:57:47.071-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/mb-22837 ... 2017-10-09T18:57:47.093-07:00 INFO CBAS.util.Loader [main] Creating bucket policies 2017-10-09T18:57:54.379-07:00 INFO CBAS.util.Loader [main] Bucket policies created 2017-10-09T18:57:54.695-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b policies -g %policyno% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:57:54.778-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-25] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:57:54.782-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:57:55.190-07:00 INFO CBAS.common.TestExecutor [main] received exception on poll java.lang.NullPointerException: null at org.apache.asterix.test.common.TestExecutor.writeOutputToFile(TestExecutor.java:432) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeQuery(TestExecutor.java:1219) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:904) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:1.0.0-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.lambda$poll$3(TestExecutor.java:1251) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_131] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_131] 2017-10-09T18:57:56.322-07:00 INFO CBAS.common.TestExecutor [main] received exception on poll org.apache.asterix.common.exceptions.AsterixException: ASX0005: Invalid item type: function agg-sum cannot process item type object in an input array (or multiset) at org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:180) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:114) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:84) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeQuery(TestExecutor.java:1210) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:904) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at com.couchbase.analytics.test.CBASTestExecutor.executeTestFile(CBASTestExecutor.java:194) ~[cbas-server-1.0.0-SNAPSHOT-tests.jar:1.0.0-SNAPSHOT] at org.apache.asterix.test.common.TestExecutor.lambda$poll$3(TestExecutor.java:1251) ~[asterix-app-0.9.3-SNAPSHOT-tests.jar:0.9.3-SNAPSHOT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_131] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_131] testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/mb-22837/mb-22837.005.pollquery.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: ASX0005: Invalid item type: function agg-sum cannot process item type object in an input array (or multiset) ...but that was expected. 2017-10-09T18:57:57.396-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/mb-22837 PASSED ## test[ClusterSharedExecutionIT 33: feeds: mb-22837] SUCCEEDED ## test[ClusterSharedExecutionIT 34: feeds: mb-22837-2] START 2017-10-09T18:57:57.396-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/mb-22837-2 ... 2017-10-09T18:57:57.408-07:00 INFO CBAS.util.Loader [main] Dropping bucket policies with ClusterManager.removeBucket ... 2017-10-09T18:57:57.840-07:00 INFO CBAS.util.Loader [main] Removal of bucket policies returned successful 2017-10-09T18:57:57.841-07:00 INFO CBAS.util.Loader [main] Waiting for bucket policies to be dropped 2017-10-09T18:58:00.841-07:00 INFO CBAS.util.Loader [main] Bucket policies dropped 2017-10-09T18:58:00.850-07:00 INFO CBAS.util.Loader [main] Creating bucket policies 2017-10-09T18:58:09.153-07:00 INFO CBAS.util.Loader [main] Bucket policies created 2017-10-09T18:58:09.458-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b policies -g %policyno% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json 2017-10-09T18:58:09.517-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-26] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/policies/policies.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:58:09.524-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/policies/policies.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm 2017-10-09T18:58:09.666-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/mb-22837-2/mb-22837-2.005.pollquery.sqlpp changed at line 1: < { "state": "AZ", "risk": 2.0 } > after 1 lines Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/mb-22837-2/mb-22837-2.003.adm 2017-10-09T18:58:11.898-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/mb-22837-2 PASSED ## test[ClusterSharedExecutionIT 34: feeds: mb-22837-2] SUCCEEDED ## test[ClusterSharedExecutionIT 35: feeds: re-create-connected-bucket] START 2017-10-09T18:58:11.899-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/re-create-connected-bucket ... 2017-10-09T18:58:11.912-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:58:12.390-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:58:12.390-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:58:15.390-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:58:15.400-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:58:23.741-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:58:24.034-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:58:24.785-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-27] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:58:24.788-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm 2017-10-09T18:58:24.845-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 250 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm 2017-10-09T18:58:25.903-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 8734 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm 2017-10-09T18:58:26.960-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 8734 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.001.adm 2017-10-09T18:58:28.025-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:58:28.927-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:58:28.927-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:58:31.927-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:58:31.938-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:58:39.273-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.002.adm 2017-10-09T18:58:39.339-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:58:39.973-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-28] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:58:39.976-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.003.adm 2017-10-09T18:58:40.056-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/re-create-connected-bucket/re-create-connected-bucket.009.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 4702 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/re-create-connected-bucket/re-create-connected-bucket.003.adm 2017-10-09T18:58:42.188-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/re-create-connected-bucket PASSED ## test[ClusterSharedExecutionIT 35: feeds: re-create-connected-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 36: feeds: two-buckets-one-connection] START 2017-10-09T18:58:42.188-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: feeds/two-buckets-one-connection ... 2017-10-09T18:58:42.203-07:00 INFO CBAS.util.Loader [main] Creating bucket medicine 2017-10-09T18:58:49.530-07:00 INFO CBAS.util.Loader [main] Bucket medicine created Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm 2017-10-09T18:58:49.956-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/feeds/two-buckets-one-connection/two-buckets-one-connection.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/feeds/two-buckets-one-connection/two-buckets-one-connection.006.adm 2017-10-09T18:58:52.212-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: feeds/two-buckets-one-connection PASSED ## test[ClusterSharedExecutionIT 36: feeds: two-buckets-one-connection] SUCCEEDED ## test[ClusterSharedExecutionIT 37: tutorials: let-there-be-beer] START 2017-10-09T18:58:52.212-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: tutorials/let-there-be-beer ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.001.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm 2017-10-09T18:58:52.628-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/tutorials/let-there-be-beer/let-there-be-beer.004.pollquery.sqlpp changed at line 1: < { "count": 5891 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.007.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.008.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.009.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.010.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.011.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.012.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.013.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.014.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.015.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.016.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.017.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.018.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.019.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.020.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.021.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.022.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/tutorials/let-there-be-beer/let-there-be-beer.023.adm 2017-10-09T18:58:57.241-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: tutorials/let-there-be-beer PASSED ## test[ClusterSharedExecutionIT 37: tutorials: let-there-be-beer] SUCCEEDED ## test[ClusterSharedExecutionIT 38: api: version_1] START 2017-10-09T18:58:57.242-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: api/version_1 ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/api/version_1/version_1.1.regex 2017-10-09T18:58:57.275-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: api/version_1 PASSED ## test[ClusterSharedExecutionIT 38: api: version_1] SUCCEEDED ## test[ClusterSharedExecutionIT 39: index: index-before-ingest] START 2017-10-09T18:58:57.276-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-before-ingest ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm 2017-10-09T18:58:57.787-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-before-ingest/index-before-ingest.004.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.004.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.005.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-before-ingest/index-before-ingest.007.adm 2017-10-09T18:59:00.145-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-before-ingest PASSED ## test[ClusterSharedExecutionIT 39: index: index-before-ingest] SUCCEEDED ## test[ClusterSharedExecutionIT 40: index: index-after-ingest] START 2017-10-09T18:59:00.145-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-after-ingest ... Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm 2017-10-09T18:59:00.489-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-after-ingest/index-after-ingest.003.pollquery.sqlpp changed at line 1: < { "count": 7303 } > { "count": 0 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.003.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.006.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.007.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.008.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/index-after-ingest/index-after-ingest.009.adm 2017-10-09T18:59:03.565-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-after-ingest PASSED ## test[ClusterSharedExecutionIT 40: index: index-after-ingest] SUCCEEDED ## test[ClusterSharedExecutionIT 41: index: index-bad-type] START 2017-10-09T18:59:03.565-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-bad-type ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-bad-type/index-bad-type.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0013: Unsupported index type ...but that was expected. 2017-10-09T18:59:03.701-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-bad-type PASSED ## test[ClusterSharedExecutionIT 41: index: index-bad-type] SUCCEEDED ## test[ClusterSharedExecutionIT 42: index: index-bad-field-type] START 2017-10-09T18:59:03.702-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/index-bad-field-type ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/index-bad-field-type/index-bad-field-type.002.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0006: Cannot index field [ts] on type datetime. Supported types: bigint, double, string ...but that was expected. 2017-10-09T18:59:03.828-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/index-bad-field-type PASSED ## test[ClusterSharedExecutionIT 42: index: index-bad-field-type] SUCCEEDED ## test[ClusterSharedExecutionIT 43: index: flush-bucket] START 2017-10-09T18:59:03.829-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: index/flush-bucket ... 2017-10-09T18:59:03.844-07:00 INFO CBAS.util.Loader [main] Dropping bucket gbook_users with ClusterManager.removeBucket ... 2017-10-09T18:59:04.310-07:00 INFO CBAS.util.Loader [main] Removal of bucket gbook_users returned successful 2017-10-09T18:59:04.310-07:00 INFO CBAS.util.Loader [main] Waiting for bucket gbook_users to be dropped 2017-10-09T18:59:07.310-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users dropped 2017-10-09T18:59:07.323-07:00 INFO CBAS.util.Loader [main] Creating bucket gbook_users 2017-10-09T18:59:14.607-07:00 INFO CBAS.util.Loader [main] Bucket gbook_users created 2017-10-09T18:59:14.998-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json 2017-10-09T18:59:15.701-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-29] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p2/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:59:15.704-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p2/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.001.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.001.adm 2017-10-09T18:59:15.774-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/flush-bucket/flush-bucket.005.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 168 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.001.adm 2017-10-09T18:59:16.864-07:00 INFO CBAS.config.ConfigurationProvider [cb-computations-2] Opened bucket gbook_users 2017-10-09T18:59:20.663-07:00 INFO CBAS.config.ConfigurationProvider [main] Closed bucket gbook_users Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.002.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.002.adm 2017-10-09T18:59:20.733-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/flush-bucket/flush-bucket.007.pollquery.sqlpp changed at line 1: < { "count": 0 } > { "count": 10000 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.002.adm 2017-10-09T18:59:21.785-07:00 INFO CBAS.common.CBImportCommand [main] Executing: sh -c ./cbimport json -c 127.0.0.1:9000 -u couchbase -p couchbase -b gbook_users -g %id% -f lines -d file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json 2017-10-09T18:59:22.297-07:00 INFO CBAS.test.ClusterIntegrationUtil [Thread-30] >> Json `file:///home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/ingestion/src/test/resources/data/p1/gbook_users.json` imported to `http://127.0.0.1:9000` successfully 2017-10-09T18:59:22.300-07:00 INFO CBAS.common.TestExecutor [main] cbimport exit code: 0 for file ../ingestion/src/test/resources/data/p1/gbook_users.json Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.003.adm Actual results file: target/rttest/ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.003.adm 2017-10-09T18:59:22.406-07:00 INFO CBAS.common.TestExecutor [main] Comparison failure on poll: Result for src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/index/flush-bucket/flush-bucket.009.pollquery.sqlpp changed at line 1: < { "count": 10000 } > { "count": 2196 } Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.003.adm Expected results file: src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/results/index/flush-bucket/flush-bucket.004.adm 2017-10-09T18:59:24.614-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: index/flush-bucket PASSED ## test[ClusterSharedExecutionIT 43: index: flush-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 44: internal: create-missing-kv-bucket] START 2017-10-09T18:59:24.615-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/create-missing-kv-bucket ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/internal/create-missing-kv-bucket/create-missing-kv-bucket.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0016: Bucket (invalid_kv_bucket) does not exist ...but that was expected. 2017-10-09T18:59:24.662-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: internal/create-missing-kv-bucket PASSED ## test[ClusterSharedExecutionIT 44: internal: create-missing-kv-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 45: internal: connect-deleted-bucket] START 2017-10-09T18:59:24.663-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/connect-deleted-bucket ... ## test[ClusterSharedExecutionIT 45: internal: connect-deleted-bucket] SUCCEEDED ## test[ClusterSharedExecutionIT 46: internal: default-bucket-name] START 2017-10-09T18:59:24.663-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: internal/default-bucket-name ... testFile src/test/resources/runtimets/../../../../../ingestion/src/test/resources/integrationts/queries/internal/default-bucket-name/default-bucket-name.001.ddl.sqlpp raised an exception: org.apache.asterix.common.exceptions.AsterixException: CBAS0016: Bucket (wrong_bucket) does not exist ...but that was expected. 2017-10-09T18:59:24.710-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: internal/default-bucket-name PASSED ## test[ClusterSharedExecutionIT 46: internal: default-bucket-name] SUCCEEDED 2017-10-09T18:59:24.710-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] shutting down cluster_run... 2017-10-09T18:59:24.718-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run sent SIGINT 2017-10-09T18:59:26.290-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] cluster_run has exited 2017-10-09T18:59:26.578-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] restoring data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data 2017-10-09T18:59:26.899-07:00 INFO CBAS.test.ClusterIntegrationUtil [main] restoring logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs [INFO] Tests run: 47, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 398.969 s - in com.couchbase.analytics.test.cbserver.ClusterSharedExecutionIT [INFO] Running com.couchbase.analytics.test.cbserver.ClusterStressIT 2017-10-09T18:59:28.616-07:00 INFO CBAS.util.CBTestEnvironmentProvider [main] Initializing Test Couchbase Environment SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/couchbase/jenkins/workspace/cbas-cbcluster-test/.repository/org/apache/logging/log4j/log4j-slf4j-impl/2.7/log4j-slf4j-impl-2.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2017-10-09T18:59:28.809-07:00 INFO CBAS.core.CouchbaseCore [main] CouchbaseEnvironment: {sslEnabled=false, sslKeystoreFile='null', sslKeystorePassword=false, sslKeystore=null, bootstrapHttpEnabled=true, bootstrapCarrierEnabled=true, bootstrapHttpDirectPort=9000, bootstrapHttpSslPort=18091, bootstrapCarrierDirectPort=12000, bootstrapCarrierSslPort=11207, ioPoolSize=4, computationPoolSize=4, responseBufferSize=16384, requestBufferSize=16384, kvServiceEndpoints=1, viewServiceEndpoints=12, queryServiceEndpoints=12, searchServiceEndpoints=12, configPollInterval=2500, ioPool=NioEventLoopGroup, kvIoPool=null, viewIoPool=null, searchIoPool=null, queryIoPool=null, coreScheduler=CoreScheduler, memcachedHashingStrategy=DefaultMemcachedHashingStrategy, eventBus=DefaultEventBus, packageNameAndVersion=couchbase-java-client/2.5.1 (git: 2.5.1, core: 1.5.1), retryStrategy=BestEffort, maxRequestLifetime=75000, retryDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=100, upper=100000}, reconnectDelay=ExponentialDelay{growBy 1.0 MILLISECONDS, powers of 2; lower=32, upper=4096}, observeIntervalDelay=ExponentialDelay{growBy 1.0 MICROSECONDS, powers of 2; lower=10, upper=100000}, keepAliveInterval=30000, continuousKeepAliveEnabled=true, keepAliveErrorThreshold=4, keepAliveTimeout=2500, autoreleaseAfter=75000, bufferPoolingEnabled=true, tcpNodelayEnabled=true, mutationTokensEnabled=false, socketConnectTimeout=1000, callbacksOnIoPool=false, disconnectTimeout=75000, requestBufferWaitStrategy=com.couchbase.client.core.env.DefaultCoreEnvironment$2@3e08ff24, certAuthEnabled=false, coreSendHook=null, queryTimeout=75000, viewTimeout=75000, searchTimeout=75000, analyticsTimeout=75000, kvTimeout=75000, connectTimeout=75000, dnsSrvEnabled=false} 2017-10-09T18:59:28.874-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 10 seconds... 2017-10-09T18:59:30.897-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] backing up existing data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data.save 2017-10-09T18:59:30.904-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] backing up existing logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs.save ## test[ClusterStressIT 0: stress: restart] START 2017-10-09T18:59:30.962-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: stress/restart ... 2017-10-09T18:59:30.972-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] starting cluster_run 2017-10-09T18:59:44.465-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster is running 2017-10-09T18:59:46.466-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] configuring cluster with services: [DATA, ANALYTICS] 2017-10-09T18:59:51.573-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-6] >> SUCCESS: Node initialized 2017-10-09T18:59:52.628-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-7] >> SUCCESS: Cluster initialized 2017-10-09T18:59:52.634-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:00:02.392-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:02.838-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:08.985-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE 2017-10-09T19:00:08.989-07:00 INFO CBAS.common.TestExecutor [main] Starting loop for 180s back to 'restart.1.post.http'... Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:09.048-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:15.135-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:15.192-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:21.344-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:21.410-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:27.469-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:27.534-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:33.565-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:33.623-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:39.703-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:39.765-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:46.422-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:46.468-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:52.608-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:52.665-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:00:58.881-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:00:58.956-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:05.146-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:05.206-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:11.239-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:11.294-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:17.473-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:17.532-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:23.646-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:23.700-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:29.794-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:29.848-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:35.951-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:36.010-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:42.252-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:42.310-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:48.555-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:48.631-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:01:54.793-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:01:54.856-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:00.931-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:00.999-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:07.077-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:07.131-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:13.287-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:13.362-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:19.427-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:19.490-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:25.670-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:25.731-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:31.890-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:31.942-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:38.056-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:38.112-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:44.184-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:44.246-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:50.389-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:50.463-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:02:56.519-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:02:56.584-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:03:02.610-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:03:02.664-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:03:08.827-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart/restart.1.regex 2017-10-09T19:03:08.884-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:03:15.095-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE 2017-10-09T19:03:15.095-07:00 INFO CBAS.common.TestExecutor [main] Loop to 'restart.1.post.http' complete! 2017-10-09T19:03:15.095-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: stress/restart PASSED 2017-10-09T19:03:15.096-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] shutting down cluster_run... 2017-10-09T19:03:15.105-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run sent SIGINT 2017-10-09T19:03:16.205-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run has exited 2017-10-09T19:03:16.213-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T19:03:16.218-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:03:17.219-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:03:20.220-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Copying logs+data to 'target/ClusterStressIT/test[ClusterStressIT 0: stress: restart](com.couchbase.analytics.test.cbserver.ClusterStressIT)'... ## test[ClusterStressIT 0: stress: restart] SUCCEEDED ## test[ClusterStressIT 1: stress: restart-two-node] START 2017-10-09T19:03:20.301-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: stress/restart-two-node ... 2017-10-09T19:03:20.301-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] starting cluster_run 2017-10-09T19:03:38.482-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster is running 2017-10-09T19:03:40.482-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] configuring cluster with services: [DATA, ANALYTICS] 2017-10-09T19:03:46.890-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-42] >> SUCCESS: Node initialized 2017-10-09T19:03:47.798-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-43] >> SUCCESS: Cluster initialized 2017-10-09T19:03:47.801-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:03:57.298-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T19:03:57.323-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:03:57.351-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:04:02.407-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-44] >> SUCCESS: Node initialized 2017-10-09T19:04:10.303-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-45] >> SUCCESS: Server added 2017-10-09T19:04:10.305-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:04:16.623-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-46] >> Unable to display progress bar on this os 2017-10-09T19:04:16.623-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-46] >> SUCCESS: Rebalance complete 2017-10-09T19:04:16.627-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:04:16.670-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:16.748-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:23.838-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE 2017-10-09T19:04:23.840-07:00 INFO CBAS.common.TestExecutor [main] Starting loop for 180s back to 'restart-two-node.1.post.http'... Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:23.920-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:30.519-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:30.697-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:37.836-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:37.912-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:44.589-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:44.684-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:51.431-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:51.523-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:04:58.251-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:04:58.349-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:05.170-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:05.264-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:12.022-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:12.113-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:18.778-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:18.854-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:25.542-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:25.647-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:32.339-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:32.453-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:39.130-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:39.209-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:45.960-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:46.051-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:52.799-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:52.902-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:05:59.675-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:05:59.779-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:06.947-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:07.038-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:13.661-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:13.948-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:20.582-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:20.780-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:27.502-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:27.697-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:34.201-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:34.384-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:40.920-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:41.003-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:47.717-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:47.836-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:06:54.511-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:06:54.684-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:07:01.833-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:07:01.914-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:07:08.738-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:07:08.820-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:07:16.117-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:07:16.179-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:07:22.795-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE Expected results file: src/test/resources/runtimets/results/stress/restart-two-node/restart-two-node.1.regex 2017-10-09T19:07:22.942-07:00 INFO CBAS.common.TestExecutor [main] Waiting for cluster state ACTIVE... 2017-10-09T19:07:29.535-07:00 INFO CBAS.common.TestExecutor [main] Cluster state now ACTIVE 2017-10-09T19:07:29.536-07:00 INFO CBAS.common.TestExecutor [main] Loop to 'restart-two-node.1.post.http' complete! 2017-10-09T19:07:29.537-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: stress/restart-two-node PASSED 2017-10-09T19:07:29.537-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] shutting down cluster_run... 2017-10-09T19:07:29.541-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run sent SIGINT 2017-10-09T19:07:30.665-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run has exited 2017-10-09T19:07:30.674-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T19:07:30.682-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:07:31.683-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:07:34.686-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Copying logs+data to 'target/ClusterStressIT/test[ClusterStressIT 1: stress: restart-two-node](com.couchbase.analytics.test.cbserver.ClusterStressIT)'... ## test[ClusterStressIT 1: stress: restart-two-node] SUCCEEDED ## test[ClusterStressIT 2: stress: rebalance_out] START 2017-10-09T19:07:34.905-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: stress/rebalance_out ... 2017-10-09T19:07:34.906-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] starting cluster_run 2017-10-09T19:07:55.297-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster is running 2017-10-09T19:07:57.298-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] configuring cluster with services: [DATA, ANALYTICS] 2017-10-09T19:08:05.461-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-78] >> SUCCESS: Node initialized 2017-10-09T19:08:06.505-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-79] >> SUCCESS: Cluster initialized 2017-10-09T19:08:06.510-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:08:16.908-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.3.adm 2017-10-09T19:08:20.464-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:08:20.635-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:08:25.896-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-80] >> SUCCESS: Node initialized 2017-10-09T19:08:32.074-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-81] >> SUCCESS: Server added 2017-10-09T19:08:32.078-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:08:40.285-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-82] >> Unable to display progress bar on this os 2017-10-09T19:08:40.286-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-82] >> SUCCESS: Rebalance complete 2017-10-09T19:08:40.289-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:08:40.372-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:08:41.736-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:08:41.765-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:08:41.770-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:08:43.938-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-83] >> Unable to display progress bar on this os 2017-10-09T19:08:43.939-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-83] >> SUCCESS: Rebalance complete 2017-10-09T19:08:43.942-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:08:43.985-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:08:44.120-07:00 INFO CBAS.common.TestExecutor [main] Starting loop for 300s back to 'rebalance_out.4.cb.cmd'... 2017-10-09T19:08:44.126-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:08:51.443-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:08:58.024-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-84] >> SUCCESS: Node initialized 2017-10-09T19:09:04.146-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-85] >> SUCCESS: Server added 2017-10-09T19:09:04.149-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:09:12.361-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-86] >> Unable to display progress bar on this os 2017-10-09T19:09:12.362-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-86] >> SUCCESS: Rebalance complete 2017-10-09T19:09:12.364-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:09:12.394-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:09:13.119-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:09:13.136-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:09:13.136-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:09:15.295-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-87] >> Unable to display progress bar on this os 2017-10-09T19:09:15.296-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-87] >> SUCCESS: Rebalance complete 2017-10-09T19:09:15.299-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:09:15.326-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:09:15.430-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:09:22.586-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:09:28.940-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-88] >> SUCCESS: Node initialized 2017-10-09T19:09:34.554-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-89] >> SUCCESS: Server added 2017-10-09T19:09:34.562-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:09:42.774-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-90] >> Unable to display progress bar on this os 2017-10-09T19:09:42.775-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-90] >> SUCCESS: Rebalance complete 2017-10-09T19:09:42.777-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:09:42.844-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:09:44.029-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:09:44.058-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:09:44.059-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:09:46.232-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-91] >> Unable to display progress bar on this os 2017-10-09T19:09:46.233-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-91] >> SUCCESS: Rebalance complete 2017-10-09T19:09:46.236-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:09:46.279-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:09:46.364-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:09:54.231-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:10:01.274-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-92] >> SUCCESS: Node initialized 2017-10-09T19:10:08.048-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-93] >> SUCCESS: Server added 2017-10-09T19:10:08.058-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:10:16.274-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-94] >> Unable to display progress bar on this os 2017-10-09T19:10:16.274-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-94] >> SUCCESS: Rebalance complete 2017-10-09T19:10:16.278-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:10:16.299-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:10:17.009-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:10:17.015-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:10:17.015-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:10:19.186-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-95] >> Unable to display progress bar on this os 2017-10-09T19:10:19.187-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-95] >> SUCCESS: Rebalance complete 2017-10-09T19:10:19.189-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:10:19.211-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:10:19.280-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:10:26.334-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:10:32.731-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-96] >> SUCCESS: Node initialized 2017-10-09T19:10:40.667-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-97] >> SUCCESS: Server added 2017-10-09T19:10:40.763-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:10:49.036-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-98] >> Unable to display progress bar on this os 2017-10-09T19:10:49.036-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-98] >> SUCCESS: Rebalance complete 2017-10-09T19:10:49.040-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:10:49.111-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:10:50.409-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:10:50.421-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:10:50.422-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:10:52.633-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-99] >> Unable to display progress bar on this os 2017-10-09T19:10:52.634-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-99] >> SUCCESS: Rebalance complete 2017-10-09T19:10:52.636-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:10:52.671-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:10:52.752-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:11:00.791-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:11:07.504-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-100] >> SUCCESS: Node initialized 2017-10-09T19:11:14.210-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-101] >> SUCCESS: Server added 2017-10-09T19:11:14.214-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:11:22.424-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-102] >> Unable to display progress bar on this os 2017-10-09T19:11:22.425-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-102] >> SUCCESS: Rebalance complete 2017-10-09T19:11:22.428-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:11:22.450-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:11:23.134-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:11:23.140-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:11:23.140-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:11:25.335-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-103] >> Unable to display progress bar on this os 2017-10-09T19:11:25.335-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-103] >> SUCCESS: Rebalance complete 2017-10-09T19:11:25.338-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:11:25.360-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:11:25.445-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:11:33.533-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:11:40.051-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-104] >> SUCCESS: Node initialized 2017-10-09T19:11:46.152-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-105] >> SUCCESS: Server added 2017-10-09T19:11:46.155-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:11:54.391-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-106] >> Unable to display progress bar on this os 2017-10-09T19:11:54.391-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-106] >> SUCCESS: Rebalance complete 2017-10-09T19:11:54.393-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:11:54.434-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:11:55.522-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:11:55.531-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:11:55.532-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:11:57.693-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-107] >> Unable to display progress bar on this os 2017-10-09T19:11:57.693-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-107] >> SUCCESS: Rebalance complete 2017-10-09T19:11:57.696-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:11:57.715-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:11:57.772-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:12:04.816-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:12:11.380-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-108] >> SUCCESS: Node initialized 2017-10-09T19:12:17.702-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-109] >> SUCCESS: Server added 2017-10-09T19:12:17.706-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:12:25.961-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-110] >> Unable to display progress bar on this os 2017-10-09T19:12:25.962-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-110] >> SUCCESS: Rebalance complete 2017-10-09T19:12:25.964-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:12:26.013-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:12:26.762-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:12:26.771-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:12:26.773-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:12:28.937-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-111] >> Unable to display progress bar on this os 2017-10-09T19:12:28.938-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-111] >> SUCCESS: Rebalance complete 2017-10-09T19:12:28.941-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:12:28.960-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:12:29.019-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:12:36.055-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:12:42.539-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-112] >> SUCCESS: Node initialized 2017-10-09T19:12:48.739-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-113] >> SUCCESS: Server added 2017-10-09T19:12:48.746-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:12:56.952-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-114] >> Unable to display progress bar on this os 2017-10-09T19:12:56.952-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-114] >> SUCCESS: Rebalance complete 2017-10-09T19:12:56.955-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:12:56.996-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:12:58.160-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:12:58.167-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:12:58.167-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:13:00.324-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-115] >> Unable to display progress bar on this os 2017-10-09T19:13:00.324-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-115] >> SUCCESS: Rebalance complete 2017-10-09T19:13:00.327-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:13:00.347-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:13:00.413-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:13:07.541-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:13:14.153-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-116] >> SUCCESS: Node initialized 2017-10-09T19:13:20.457-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-117] >> SUCCESS: Server added 2017-10-09T19:13:20.462-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:13:28.685-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-118] >> Unable to display progress bar on this os 2017-10-09T19:13:28.686-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-118] >> SUCCESS: Rebalance complete 2017-10-09T19:13:28.689-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:13:28.738-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:13:29.365-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:13:29.372-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:13:29.373-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:13:31.551-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-119] >> Unable to display progress bar on this os 2017-10-09T19:13:31.551-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-119] >> SUCCESS: Rebalance complete 2017-10-09T19:13:31.554-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:13:31.571-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:13:31.633-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:13:39.674-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:13:46.097-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-120] >> SUCCESS: Node initialized 2017-10-09T19:13:52.748-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-121] >> SUCCESS: Server added 2017-10-09T19:13:52.751-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:14:01.123-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-122] >> Unable to display progress bar on this os 2017-10-09T19:14:01.123-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-122] >> SUCCESS: Rebalance complete 2017-10-09T19:14:01.126-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:14:01.188-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.5.regexadm Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.6.adm 2017-10-09T19:14:02.380-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:14:02.390-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:14:02.391-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:14:04.556-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-123] >> Unable to display progress bar on this os 2017-10-09T19:14:04.556-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-123] >> SUCCESS: Rebalance complete 2017-10-09T19:14:04.559-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:14:04.583-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... Expected results file: src/test/resources/runtimets/results/stress/rebalance_out/rebalance_out.8.regexadm 2017-10-09T19:14:04.639-07:00 INFO CBAS.common.TestExecutor [main] Loop to 'rebalance_out.4.cb.cmd' complete! 2017-10-09T19:14:04.640-07:00 INFO CBAS.common.TestExecutor [main] [TEST]: stress/rebalance_out PASSED 2017-10-09T19:14:04.640-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] shutting down cluster_run... 2017-10-09T19:14:04.643-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run sent SIGINT 2017-10-09T19:14:06.498-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run has exited 2017-10-09T19:14:06.512-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T19:14:06.521-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:14:07.522-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:14:10.526-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Copying logs+data to 'target/ClusterStressIT/test[ClusterStressIT 2: stress: rebalance_out](com.couchbase.analytics.test.cbserver.ClusterStressIT)'... ## test[ClusterStressIT 2: stress: rebalance_out] SUCCEEDED ## test[ClusterStressIT 3: stress: rebalance_empty] START 2017-10-09T19:14:11.353-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] starting cluster_run 2017-10-09T19:14:30.499-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster is running 2017-10-09T19:14:32.499-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] configuring cluster with services: [DATA, ANALYTICS] 2017-10-09T19:14:43.782-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-127] >> SUCCESS: Node initialized 2017-10-09T19:14:44.849-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-128] >> SUCCESS: Cluster initialized 2017-10-09T19:14:44.853-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 1' condition for up to 30 seconds... 2017-10-09T19:14:54.294-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T19:14:54.324-07:00 INFO CBAS.common.TestExecutor [main] Starting [TEST]: stress/rebalance_empty ... 2017-10-09T19:14:54.326-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0] to [0, 1] 2017-10-09T19:14:54.339-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] adding node(s) [1] with service(s): [ANALYTICS] 2017-10-09T19:15:00.306-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-129] >> SUCCESS: Node initialized 2017-10-09T19:15:08.958-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-130] >> SUCCESS: Server added 2017-10-09T19:15:08.966-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 127.0.0.1:9000, -u, couchbase, -p, couchbase] 2017-10-09T19:15:15.230-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-131] >> Unable to display progress bar on this os 2017-10-09T19:15:15.238-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-131] >> SUCCESS: Rebalance complete 2017-10-09T19:15:15.250-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'NCs == 2' condition for up to 30 seconds... 2017-10-09T19:15:15.471-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'All NCs & Cluster ACTIVE' condition for up to 30 seconds... 2017-10-09T19:15:15.619-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Rebalancing from [0, 1] to [0] 2017-10-09T19:15:15.774-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Updating cluster address for n_0 to 172.17.0.2:9000 2017-10-09T19:15:15.776-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] removing nodes [1] 2017-10-09T19:15:15.781-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] calling rebalance with following args: [rebalance, -c, 172.17.0.2:9000, -u, couchbase, -p, couchbase, --server-remove, 127.0.0.1:9001] 2017-10-09T19:15:15.921-07:00 INFO CBAS.cbserver.ClusterExecutionIT [Thread-132] >> ERROR: Some nodes specified to be removed are not part of the cluster 2017-10-09T19:15:15.953-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] shutting down cluster_run... 2017-10-09T19:15:15.969-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run sent SIGINT 2017-10-09T19:15:17.142-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] cluster_run has exited 2017-10-09T19:15:17.153-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Waiting for 'CB cluster (incl. analytics nodes) shutdown' condition for up to 30 seconds... 2017-10-09T19:15:17.166-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:15:18.168-07:00 INFO CBAS.cbserver.ClusterExecutionIT [waitForCondition] [9301] still running... 2017-10-09T19:15:21.172-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] Copying logs+data to 'target/ClusterStressIT/test[ClusterStressIT 3: stress: rebalance_empty](com.couchbase.analytics.test.cbserver.ClusterStressIT)'... ## test[ClusterStressIT 3: stress: rebalance_empty] FAILED (java.lang.AssertionError) 2017-10-09T19:15:21.699-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] restoring data dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/data 2017-10-09T19:15:21.699-07:00 INFO CBAS.cbserver.ClusterExecutionIT [main] restoring logs dir to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/ns_server/logs [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 953.894 s <<< FAILURE! - in com.couchbase.analytics.test.cbserver.ClusterStressIT [ERROR] test[ClusterStressIT 3: stress: rebalance_empty](com.couchbase.analytics.test.cbserver.ClusterStressIT) Time elapsed: 70.367 s <<< FAILURE! java.lang.AssertionError: couchbase-cli non-zero exit code; output: ERROR: Some nodes specified to be removed are not part of the cluster expected:<0> but was:<1> [INFO] [INFO] Results: [INFO] [ERROR] Failures: [ERROR] ClusterStressIT>ClusterExecutionIT.test:109->ClusterTestBase.runCli:392 couchbase-cli non-zero exit code; output: ERROR: Some nodes specified to be removed are not part of the cluster expected:<0> but was:<1> [ERROR] Errors: [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [ERROR] ClusterConcurrentRebalanceIT.test:125 » Test "src/test/resources/runtimets/..... [INFO] [ERROR] Tests run: 104, Failures: 1, Errors: 19, Skipped: 0 [INFO] [JENKINS] Recording test results [INFO] [INFO] --- maven-failsafe-plugin:2.20:verify (default) @ cbas-cbserver-test --- [ERROR] There are test failures. Please refer to /home/couchbase/jenkins/workspace/cbas-cbcluster-test/analytics/asterixdb/asterix-opt/cbas-test/cbas-cbserver-test/target/failsafe-reports for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. [JENKINS] Recording test results [JENKINS] Archiving disabled [JENKINS] Archiving disabled [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:00 h [INFO] Finished at: 2017-10-09T19:15:27-07:00 [INFO] Final Memory: 33M/383M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "jenkins" could not be activated because it does not exist. Waiting for Jenkins to finish collecting data