Building Updating tree for run 24.03.2016-07.40 Switching indexing to unstable indexing is at 5720a51, changes since last good build: none query is at ade1e41, changes since last good build: none couchdb is at 58b8edf, changes since last good build: none couchstore is at 85bf96b, changes since last good build: none forestdb is at d69bba3, changes since last good build: d69bba3 Fix to a minor memory leak in fdb_functional_test 88ae8e2 add fixed retry attempts for stat update 83eb6aa Disable compaction and rollback interleaving test 86594dc MB-18747: Temporarily disable WAL sharing 532e494 MB-18747 Don't grab the spinlock when incrementing a file ref counter b57342c Fix compact_functional_test failure c3eb7ba MB-18747 Don't grab spinlock when decrementing a file's ref counter 923d253 MB-18846: Update minimum cmake version required 1abf325 Real Use Case Simulation with Configurable Disk behaviour 2641acc MB-18753: Retain offset of immediately deleted docs f7c15a5 MB-18747 Get rid of locking on closing dirty index node snapshot bf67fcb MB-18765 Abort the 2nd phase of compaction on rollback request 889f945 alloca needs include of alloca.h on Solaris ep-engine is at 4ae20bd, changes since last good build: none testrunner is at 7b46326, changes since last good build: 7b46326 CBQE-3067 Add final set of MCP tests, add timeout=60s to query_json, assert on query failures, print status of every query response Building main product Testing 32-bit compilation Testing Using storage type: fdb Simple Test test_MB_12751 (regressions.regressiontest.RegressionTests) ... ok test_MB_14288 (regressions.regressiontest.RegressionTests) ... ok rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok do_warmup_100k (memcapable.WarmUpMemcachedTest) ... ok test_view_ops (view.createdeleteview.CreateDeleteViewTests) ... ok summary so far suite regressions.regressiontest.RegressionTests , pass 1 , fail 0 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 Logs will be stored at /opt/build/testrunner/ltest_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok load_with_ops (xdcr.uniXDCR.unidirectional) ... ok load_with_failover (xdcr.uniXDCR.unidirectional) ... ogs/testrunner-16-Mar-24_07-51-49/test_5 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0 summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0 summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0 summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0 {'doc-ops': 'update-delete', 'log_level': 'CRITICAL'ok summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0 summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0 summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0 ./testrunner -i b/resources/dev-4-nodes-xdcr.ini makefile=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,failover=source {'doc-ops': 'update-delete', 'log_level': 'CRITICAL', 'replicas': '1', 'items': '10000', 'failover': 'source', 'makefile': 'True', 'conf_file': 'conf/simple.conf', 'num_nodes': 4, 'cluster_name': 'dev-4-nodes-xdcr', 'ctopology': 'chain', 'rdirection': 'unidirection', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'case_number': 9, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_07-51-49/test_9', 'spec': 'simple'} summary so far suite regressions.regressiontest.RegressionTests , pass 2 , fail 0 summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0 summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0 summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0 summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0 summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0 Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover regressions.regressiontest.RegressionTests.test_MB_12751 pass regressions.regressiontest.RegressionTests.test_MB_14288 pass rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops pass memcapable.WarmUpMemcachedTest.do_warmup_100k pass view.createdeleteview.CreateDeleteViewTests.test_view_ops pass view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in pass view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification pass xdcr.uniXDCR.unidirectional.load_with_ops pass xdcr.uniXDCR.unidirectional.load_with_failover pass Functional tests Starting server: attempt 1 Starting functional tests Rolling back parsec Note: checking out 'e21c7f3098914abb1dd42e77eafe8c93d26aaedc'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b new_branch_name HEAD is now at e21c7f3... bugfix: while reverting patternCache to scanner-local. Unit tests === RUN TestMerger --- PASS: TestMerger (0.02s) === RUN TestInsert --- PASS: TestInsert (0.00s) === RUN TestInsertPerf 16000000 items took 30.503446799s -> 524530.8868020951 items/s conflicts 17 --- PASS: TestInsertPerf (30.50s) === RUN TestGetPerf 16000000 items took 9.567041171s -> 1.672408398168061e+06 items/s --- PASS: TestGetPerf (10.84s) === RUN TestGetRangeSplitItems node_count = 1000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3351 memory_used = 37360992 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 749144 level1 => 187776 level2 => 47222 level3 => 11903 level4 => 2974 level5 => 735 level6 => 182 level7 => 48 level8 => 12 level9 => 2 level10 => 2 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Split range keys [35911 108875 357987 462344 598654 671258 781160] No of items in each range [35911 72964 249112 104357 136310 72604 109902 218840] --- PASS: TestGetRangeSplitItems (1.24s) === RUN TestBuilder node_count = 50000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3333 memory_used = 1866650928 node_allocs = 50000000 node_frees = 0 level_node_distribution: level0 => 37500395 level1 => 9374070 level2 => 2344403 level3 => 586130 level4 => 146617 level5 => 36338 level6 => 9033 level7 => 2299 level8 => 539 level9 => 123 level10 => 39 level11 => 9 level12 => 5 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Took 15.46675665s to build 50000000 items, 3.2327398e+06 items/sec Took 723.120432ms to iterate 50000000 items --- PASS: TestBuilder (16.19s) PASS ok github.com/couchbase/indexing/secondary/memdb/skiplist 58.975s === RUN TestInsert --- PASS: TestInsert (0.01s) === RUN TestInsertPerf 20000000 items took 42.840441642s -> 466848.5952393254 items/s snapshots_created 210 live_snapshots 1 --- PASS: TestInsertPerf (45.30s) === RUN TestInsertDuplicates --- PASS: TestInsertDuplicates (0.02s) === RUN TestGetPerf 16000000 items took 16.305886347s -> 981240.7408900971 items/s --- PASS: TestGetPerf (18.16s) === RUN TestLoadStoreDisk Inserting 1000000 items took 1.423036584s node_count = 1000004 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 6 next_pointers_per_node = 1.3341 memory_used = 57345580 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 749368 level1 => 188006 level2 => 47021 level3 => 11701 level4 => 2897 level5 => 769 level6 => 189 level7 => 40 level8 => 10 level9 => 2 level10 => 1 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Storing to disk took 97.025845ms Loading from disk took 375.84677ms node_count = 1000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3330 memory_used = 57328624 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 750536 level1 => 186793 level2 => 47077 level3 => 11604 level4 => 2999 level5 => 742 level6 => 191 level7 => 42 level8 => 11 level9 => 4 level10 => 1 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 --- PASS: TestLoadStoreDisk (1.92s) === RUN TestStoreDiskShutdown Inserting 1000000 items took 1.301796727s node_count = 999999 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 5 next_pointers_per_node = 1.3329 memory_used = 57330376 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 750115 level1 => 187689 level2 => 46638 level3 => 11585 level4 => 2966 level5 => 762 level6 => 179 level7 => 51 level8 => 10 level9 => 3 level10 => 1 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 --- PASS: TestStoreDiskShutdown (1.31s) === RUN TestDelete node_count = 10 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.4000 memory_used = 604 node_allocs = 10 node_frees = 0 level_node_distribution: level0 => 7 level1 => 2 level2 => 1 level3 => 0 level4 => 0 level5 => 0 level6 => 0 level7 => 0 level8 => 0 level9 => 0 level10 => 0 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 node_count = 10 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3000 memory_used = 588 node_allocs = 20 node_frees = 0 level_node_distribution: level0 => 7 level1 => 3 level2 => 0 level3 => 0 level4 => 0 level5 => 0 level6 => 0 level7 => 0 level8 => 0 level9 => 0 level10 => 0 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 --- PASS: TestDelete (1.00s) === RUN TestGCPerf final_node_count = 16000, average_live_node_count = 70170, wait_time_for_collection = 24ms --- PASS: TestGCPerf (52.81s) === RUN TestMemoryInUse ItemsCount: 5000, MemoryInUse: 298000, NodesCount: 5000 ItemsCount: 0, MemoryInUse: 64, NodesCount: 0 --- PASS: TestMemoryInUse (1.02s) === RUN TestFullScan Inserting 1000000 items took 1.514384161s node_count = 1000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 13 next_pointers_per_node = 1.3342 memory_used = 57347680 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 749454 level1 => 187718 level2 => 47172 level3 => 11705 level4 => 3004 level5 => 721 level6 => 171 level7 => 42 level8 => 8 level9 => 3 level10 => 1 level11 => 1 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Full iteration of 1000000 items took 113.43699ms --- PASS: TestFullScan (1.73s) === RUN TestVisitor node_count = 1000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3340 memory_used = 57343264 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 749404 level1 => 187889 level2 => 47072 level3 => 11821 level4 => 2899 level5 => 688 level6 => 178 level7 => 40 level8 => 7 level9 => 2 level10 => 0 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Took 49.03046ms to iterate 1000000 items, 2.0395484e+07 items/s shard - 0 count = 14274, range: 0-14273 shard - 1 count = 22432, range: 14274-36705 shard - 2 count = 21996, range: 36706-58701 shard - 3 count = 12867, range: 58702-71568 shard - 4 count = 18180, range: 71569-89748 shard - 5 count = 54156, range: 89749-143904 shard - 6 count = 30260, range: 143905-174164 shard - 7 count = 22593, range: 174165-196757 shard - 8 count = 90239, range: 196758-286996 shard - 9 count = 36474, range: 286997-323470 shard - 10 count = 34430, range: 323471-357900 shard - 11 count = 27672, range: 357901-385572 shard - 12 count = 143184, range: 385573-528756 shard - 13 count = 29275, range: 528757-558031 shard - 14 count = 21208, range: 558032-579239 shard - 15 count = 21307, range: 579240-600546 shard - 16 count = 42504, range: 600547-643050 shard - 17 count = 55672, range: 643051-698722 shard - 18 count = 101048, range: 698723-799770 shard - 19 count = 8806, range: 799771-808576 shard - 20 count = 46761, range: 808577-855337 shard - 21 count = 37341, range: 855338-892678 shard - 22 count = 28629, range: 892679-921307 shard - 23 count = 20267, range: 921308-941574 shard - 24 count = 4870, range: 941575-946444 shard - 25 count = 53555, range: 946445-999999 shard - 26 count = 0, range: 0-0 shard - 27 count = 0, range: 0-0 shard - 28 count = 0, range: 0-0 shard - 29 count = 0, range: 0-0 shard - 30 count = 0, range: 0-0 shard - 31 count = 0, range: 0-0 --- PASS: TestVisitor (1.98s) === RUN TestVisitorError --- PASS: TestVisitorError (0.17s) === RUN TestLoadDeltaStoreDisk Storing to disk took 32.385422742s Loading from disk took 2.238774418s node_count = 1000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 0 next_pointers_per_node = 1.3328 memory_used = 57325520 node_allocs = 1000000 node_frees = 0 level_node_distribution: level0 => 750339 level1 => 187447 level2 => 46508 level3 => 11744 level4 => 2988 level5 => 724 level6 => 192 level7 => 42 level8 => 13 level9 => 2 level10 => 1 level11 => 0 level12 => 0 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Restored 11560 RestoredFailed 764127 --- PASS: TestLoadDeltaStoreDisk (38.40s) === RUN TestNodeList --- PASS: TestNodeList (0.00s) PASS ok github.com/couchbase/indexing/secondary/memdb 163.950s === RUN TestForestDBIterator --- PASS: TestForestDBIterator (0.01s) === RUN TestForestDBIteratorSeek --- PASS: TestForestDBIteratorSeek (0.00s) === RUN TestPrimaryIndexEntry --- PASS: TestPrimaryIndexEntry (0.00s) === RUN TestSecondaryIndexEntry --- PASS: TestSecondaryIndexEntry (0.00s) === RUN TestPrimaryIndexEntryMatch --- PASS: TestPrimaryIndexEntryMatch (0.00s) === RUN TestSecondaryIndexEntryMatch --- PASS: TestSecondaryIndexEntryMatch (0.00s) === RUN TestMemDBInsertionPerf 2016-03-24T08:13:56.856+05:30 [Info] MemDBSlice:NewMemDBSlice Created New Slice Id 0 IndexInstId 0 WriterThreads 16 2016-03-24T08:13:57.024+05:30 [Info] logWriterStat:: 0 FlushedCount 1 QueuedCount 1065 2016-03-24T08:13:57.16+05:30 [Info] logWriterStat:: 0 FlushedCount 10000 QueuedCount 20308 2016-03-24T08:13:57.319+05:30 [Info] logWriterStat:: 0 FlushedCount 20000 QueuedCount 17232 2016-03-24T08:13:57.426+05:30 [Info] logWriterStat:: 0 FlushedCount 30000 QueuedCount 12271 2016-03-24T08:13:57.64+05:30 [Info] logWriterStat:: 0 FlushedCount 40000 QueuedCount 6648 2016-03-24T08:13:58.129+05:30 [Info] MemDBSlice::OpenSnapshot SliceId 0 IndexInstId 0 Creating New Snapshot SnapshotInfo: count:49105 committed:false 2016-03-24T08:13:58.187+05:30 [Info] logWriterStat:: 0 FlushedCount 50000 QueuedCount 5881 2016-03-24T08:13:58.495+05:30 [Info] logWriterStat:: 0 FlushedCount 60000 QueuedCount 49961 2016-03-24T08:13:58.621+05:30 [Info] logWriterStat:: 0 FlushedCount 70000 QueuedCount 44316 2016-03-24T08:13:58.724+05:30 [Info] logWriterStat:: 0 FlushedCount 80000 QueuedCount 48140 2016-03-24T08:13:58.815+05:30 [Info] logWriterStat:: 0 FlushedCount 90000 QueuedCount 48592 2016-03-24T08:13:58.941+05:30 [Info] logWriterStat:: 0 FlushedCount 100000 QueuedCount 48717 2016-03-24T08:13:59.066+05:30 [Info] logWriterStat:: 0 FlushedCount 110000 QueuedCount 48556 2016-03-24T08:13:59.167+05:30 [Info] logWriterStat:: 0 FlushedCount 120000 QueuedCount 48217 2016-03-24T08:13:59.313+05:30 [Info] logWriterStat:: 0 FlushedCount 130000 QueuedCount 49280 2016-03-24T08:13:59.425+05:30 [Info] logWriterStat:: 0 FlushedCount 140000 QueuedCount 49278 2016-03-24T08:13:59.527+05:30 [Info] logWriterStat:: 0 FlushedCount 150000 QueuedCount 48780 2016-03-24T08:13:59.619+05:30 [Info] logWriterStat:: 0 FlushedCount 160000 QueuedCount 46967 2016-03-24T08:13:59.726+05:30 [Info] logWriterStat:: 0 FlushedCount 170000 QueuedCount 48490 2016-03-24T08:13:59.823+05:30 [Info] logWriterStat:: 0 FlushedCount 180000 QueuedCount 48187 2016-03-24T08:13:59.919+05:30 [Info] logWriterStat:: 0 FlushedCount 190000 QueuedCount 48143 2016-03-24T08:14:00.209+05:30 [Info] logWriterStat:: 0 FlushedCount 200000 QueuedCount 48457 2016-03-24T08:14:00.422+05:30 [Info] logWriterStat:: 0 FlushedCount 210000 QueuedCount 46513 2016-03-24T08:14:00.566+05:30 [Info] logWriterStat:: 0 FlushedCount 220000 QueuedCount 43931 2016-03-24T08:14:00.701+05:30 [Info] logWriterStat:: 0 FlushedCount 230000 QueuedCount 41867 2016-03-24T08:14:00.832+05:30 [Info] logWriterStat:: 0 FlushedCount 240000 QueuedCount 46752 2016-03-24T08:14:00.974+05:30 [Info] logWriterStat:: 0 FlushedCount 250000 QueuedCount 48287 2016-03-24T08:14:01.089+05:30 [Info] logWriterStat:: 0 FlushedCount 260000 QueuedCount 48754 2016-03-24T08:14:01.194+05:30 [Info] logWriterStat:: 0 FlushedCount 270000 QueuedCount 48306 2016-03-24T08:14:01.305+05:30 [Info] logWriterStat:: 0 FlushedCount 280000 QueuedCount 48222 2016-03-24T08:14:01.402+05:30 [Info] logWriterStat:: 0 FlushedCount 290000 QueuedCount 48132 2016-03-24T08:14:01.5+05:30 [Info] logWriterStat:: 0 FlushedCount 300000 QueuedCount 47995 2016-03-24T08:14:01.599+05:30 [Info] logWriterStat:: 0 FlushedCount 310000 QueuedCount 48503 2016-03-24T08:14:01.704+05:30 [Info] logWriterStat:: 0 FlushedCount 320000 QueuedCount 48374 2016-03-24T08:14:01.808+05:30 [Info] logWriterStat:: 0 FlushedCount 330000 QueuedCount 48106 2016-03-24T08:14:01.912+05:30 [Info] logWriterStat:: 0 FlushedCount 340000 QueuedCount 49245 2016-03-24T08:14:02.014+05:30 [Info] logWriterStat:: 0 FlushedCount 350000 QueuedCount 48465 2016-03-24T08:14:02.212+05:30 [Info] logWriterStat:: 0 FlushedCount 360000 QueuedCount 49645 2016-03-24T08:14:02.576+05:30 [Info] logWriterStat:: 0 FlushedCount 370000 QueuedCount 48384 2016-03-24T08:14:02.716+05:30 [Info] logWriterStat:: 0 FlushedCount 380000 QueuedCount 40332 2016-03-24T08:14:02.838+05:30 [Info] logWriterStat:: 0 FlushedCount 390000 QueuedCount 40938 2016-03-24T08:14:02.969+05:30 [Info] logWriterStat:: 0 FlushedCount 400000 QueuedCount 40788 2016-03-24T08:14:03.17+05:30 [Info] logWriterStat:: 0 FlushedCount 410000 QueuedCount 49491 2016-03-24T08:14:03.349+05:30 [Info] logWriterStat:: 0 FlushedCount 420000 QueuedCount 47673 2016-03-24T08:14:03.463+05:30 [Info] logWriterStat:: 0 FlushedCount 430000 QueuedCount 47745 2016-03-24T08:14:03.574+05:30 [Info] logWriterStat:: 0 FlushedCount 440000 QueuedCount 48456 2016-03-24T08:14:03.684+05:30 [Info] logWriterStat:: 0 FlushedCount 450000 QueuedCount 49039 2016-03-24T08:14:03.789+05:30 [Info] logWriterStat:: 0 FlushedCount 460000 QueuedCount 48760 2016-03-24T08:14:03.886+05:30 [Info] logWriterStat:: 0 FlushedCount 470000 QueuedCount 48870 2016-03-24T08:14:03.997+05:30 [Info] logWriterStat:: 0 FlushedCount 480000 QueuedCount 48062 2016-03-24T08:14:04.11+05:30 [Info] logWriterStat:: 0 FlushedCount 490000 QueuedCount 48256 2016-03-24T08:14:04.23+05:30 [Info] logWriterStat:: 0 FlushedCount 500000 QueuedCount 48777 2016-03-24T08:14:04.34+05:30 [Info] logWriterStat:: 0 FlushedCount 510000 QueuedCount 48765 2016-03-24T08:14:04.453+05:30 [Info] logWriterStat:: 0 FlushedCount 520000 QueuedCount 48316 2016-03-24T08:14:04.559+05:30 [Info] logWriterStat:: 0 FlushedCount 530000 QueuedCount 48420 2016-03-24T08:14:04.664+05:30 [Info] logWriterStat:: 0 FlushedCount 540000 QueuedCount 48629 2016-03-24T08:14:04.76+05:30 [Info] logWriterStat:: 0 FlushedCount 550000 QueuedCount 47602 2016-03-24T08:14:04.86+05:30 [Info] logWriterStat:: 0 FlushedCount 560000 QueuedCount 48532 2016-03-24T08:14:04.966+05:30 [Info] logWriterStat:: 0 FlushedCount 570000 QueuedCount 48245 2016-03-24T08:14:05.073+05:30 [Info] logWriterStat:: 0 FlushedCount 580000 QueuedCount 48790 2016-03-24T08:14:05.277+05:30 [Info] logWriterStat:: 0 FlushedCount 590000 QueuedCount 49971 2016-03-24T08:14:05.603+05:30 [Info] logWriterStat:: 0 FlushedCount 600000 QueuedCount 47826 2016-03-24T08:14:05.891+05:30 [Info] logWriterStat:: 0 FlushedCount 610000 QueuedCount 47235 2016-03-24T08:14:06.15+05:30 [Info] logWriterStat:: 0 FlushedCount 620000 QueuedCount 48726 2016-03-24T08:14:06.261+05:30 [Info] logWriterStat:: 0 FlushedCount 630000 QueuedCount 46346 2016-03-24T08:14:06.366+05:30 [Info] logWriterStat:: 0 FlushedCount 640000 QueuedCount 39179 2016-03-24T08:14:06.478+05:30 [Info] logWriterStat:: 0 FlushedCount 650000 QueuedCount 42434 2016-03-24T08:14:06.696+05:30 [Info] logWriterStat:: 0 FlushedCount 660000 QueuedCount 49585 2016-03-24T08:14:06.865+05:30 [Info] logWriterStat:: 0 FlushedCount 670000 QueuedCount 47046 2016-03-24T08:14:06.994+05:30 [Info] logWriterStat:: 0 FlushedCount 680000 QueuedCount 49927 2016-03-24T08:14:07.14+05:30 [Info] logWriterStat:: 0 FlushedCount 690000 QueuedCount 47922 2016-03-24T08:14:07.237+05:30 [Info] logWriterStat:: 0 FlushedCount 700000 QueuedCount 47931 2016-03-24T08:14:07.33+05:30 [Info] logWriterStat:: 0 FlushedCount 710000 QueuedCount 46956 2016-03-24T08:14:07.43+05:30 [Info] logWriterStat:: 0 FlushedCount 720000 QueuedCount 45633 2016-03-24T08:14:07.547+05:30 [Info] logWriterStat:: 0 FlushedCount 730000 QueuedCount 44208 2016-03-24T08:14:07.659+05:30 [Info] logWriterStat:: 0 FlushedCount 740000 QueuedCount 43284 2016-03-24T08:14:07.773+05:30 [Info] logWriterStat:: 0 FlushedCount 750000 QueuedCount 42566 2016-03-24T08:14:07.879+05:30 [Info] logWriterStat:: 0 FlushedCount 760000 QueuedCount 42282 2016-03-24T08:14:07.977+05:30 [Info] logWriterStat:: 0 FlushedCount 770000 QueuedCount 41395 2016-03-24T08:14:08.087+05:30 [Info] logWriterStat:: 0 FlushedCount 780000 QueuedCount 41639 2016-03-24T08:14:08.202+05:30 [Info] logWriterStat:: 0 FlushedCount 790000 QueuedCount 40890 2016-03-24T08:14:08.313+05:30 [Info] logWriterStat:: 0 FlushedCount 800000 QueuedCount 40721 2016-03-24T08:14:08.418+05:30 [Info] logWriterStat:: 0 FlushedCount 810000 QueuedCount 40016 2016-03-24T08:14:08.538+05:30 [Info] logWriterStat:: 0 FlushedCount 820000 QueuedCount 38410 2016-03-24T08:14:08.652+05:30 [Info] logWriterStat:: 0 FlushedCount 830000 QueuedCount 37928 2016-03-24T08:14:08.76+05:30 [Info] logWriterStat:: 0 FlushedCount 840000 QueuedCount 36001 2016-03-24T08:14:08.873+05:30 [Info] logWriterStat:: 0 FlushedCount 850000 QueuedCount 33561 2016-03-24T08:14:08.983+05:30 [Info] logWriterStat:: 0 FlushedCount 860000 QueuedCount 31077 2016-03-24T08:14:09.49+05:30 [Info] logWriterStat:: 0 FlushedCount 870000 QueuedCount 31533 2016-03-24T08:14:09.917+05:30 [Info] logWriterStat:: 0 FlushedCount 880000 QueuedCount 30068 2016-03-24T08:14:10.268+05:30 [Info] logWriterStat:: 0 FlushedCount 890000 QueuedCount 30107 2016-03-24T08:14:10.409+05:30 [Info] logWriterStat:: 0 FlushedCount 900000 QueuedCount 27893 2016-03-24T08:14:10.681+05:30 [Info] logWriterStat:: 0 FlushedCount 910000 QueuedCount 25875 2016-03-24T08:14:10.838+05:30 [Info] logWriterStat:: 0 FlushedCount 920000 QueuedCount 19354 2016-03-24T08:14:10.97+05:30 [Info] logWriterStat:: 0 FlushedCount 930000 QueuedCount 14723 2016-03-24T08:14:11.157+05:30 [Info] logWriterStat:: 0 FlushedCount 940000 QueuedCount 12263 2016-03-24T08:14:11.376+05:30 [Info] logWriterStat:: 0 FlushedCount 950000 QueuedCount 7711 2016-03-24T08:14:11.806+05:30 [Info] logWriterStat:: 0 FlushedCount 960000 QueuedCount 2984 2016-03-24T08:14:12.229+05:30 [Info] MemDBSlice::OpenSnapshot SliceId 0 IndexInstId 0 Creating New Snapshot SnapshotInfo: count:964685 committed:false 2016-03-24T08:14:12.399+05:30 [Info] logWriterStat:: 0 FlushedCount 970000 QueuedCount 17840 2016-03-24T08:14:12.528+05:30 [Info] logWriterStat:: 0 FlushedCount 980000 QueuedCount 31922 2016-03-24T08:14:12.644+05:30 [Info] logWriterStat:: 0 FlushedCount 990000 QueuedCount 45065 2016-03-24T08:14:12.746+05:30 [Info] logWriterStat:: 0 FlushedCount 1000000 QueuedCount 48505 2016-03-24T08:14:12.849+05:30 [Info] logWriterStat:: 0 FlushedCount 1010000 QueuedCount 48212 2016-03-24T08:14:12.952+05:30 [Info] logWriterStat:: 0 FlushedCount 1020000 QueuedCount 48929 2016-03-24T08:14:13.081+05:30 [Info] logWriterStat:: 0 FlushedCount 1030000 QueuedCount 49007 2016-03-24T08:14:13.281+05:30 [Info] logWriterStat:: 0 FlushedCount 1040000 QueuedCount 49207 2016-03-24T08:14:13.7+05:30 [Info] logWriterStat:: 0 FlushedCount 1050000 QueuedCount 47873 2016-03-24T08:14:14.053+05:30 [Info] logWriterStat:: 0 FlushedCount 1060000 QueuedCount 46303 2016-03-24T08:14:14.4+05:30 [Info] logWriterStat:: 0 FlushedCount 1070000 QueuedCount 44049 2016-03-24T08:14:14.643+05:30 [Info] logWriterStat:: 0 FlushedCount 1080000 QueuedCount 47797 2016-03-24T08:14:14.788+05:30 [Info] logWriterStat:: 0 FlushedCount 1090000 QueuedCount 46326 2016-03-24T08:14:15.002+05:30 [Info] logWriterStat:: 0 FlushedCount 1100000 QueuedCount 49342 2016-03-24T08:14:15.163+05:30 [Info] logWriterStat:: 0 FlushedCount 1110000 QueuedCount 44297 2016-03-24T08:14:15.325+05:30 [Info] logWriterStat:: 0 FlushedCount 1120000 QueuedCount 46786 2016-03-24T08:14:15.418+05:30 [Info] logWriterStat:: 0 FlushedCount 1130000 QueuedCount 48091 2016-03-24T08:14:15.512+05:30 [Info] logWriterStat:: 0 FlushedCount 1140000 QueuedCount 46967 2016-03-24T08:14:15.614+05:30 [Info] logWriterStat:: 0 FlushedCount 1150000 QueuedCount 46986 2016-03-24T08:14:15.708+05:30 [Info] logWriterStat:: 0 FlushedCount 1160000 QueuedCount 47755 2016-03-24T08:14:15.802+05:30 [Info] logWriterStat:: 0 FlushedCount 1170000 QueuedCount 48414 2016-03-24T08:14:15.898+05:30 [Info] logWriterStat:: 0 FlushedCount 1180000 QueuedCount 47815 2016-03-24T08:14:15.984+05:30 [Info] logWriterStat:: 0 FlushedCount 1190000 QueuedCount 47282 2016-03-24T08:14:16.096+05:30 [Info] logWriterStat:: 0 FlushedCount 1200000 QueuedCount 49844 2016-03-24T08:14:16.196+05:30 [Info] logWriterStat:: 0 FlushedCount 1210000 QueuedCount 49890 2016-03-24T08:14:16.281+05:30 [Info] logWriterStat:: 0 FlushedCount 1220000 QueuedCount 49210 2016-03-24T08:14:16.367+05:30 [Info] logWriterStat:: 0 FlushedCount 1230000 QueuedCount 49919 2016-03-24T08:14:16.453+05:30 [Info] logWriterStat:: 0 FlushedCount 1240000 QueuedCount 49889 2016-03-24T08:14:16.528+05:30 [Info] logWriterStat:: 0 FlushedCount 1250000 QueuedCount 49946 2016-03-24T08:14:16.605+05:30 [Info] logWriterStat:: 0 FlushedCount 1260000 QueuedCount 49954 2016-03-24T08:14:16.687+05:30 [Info] logWriterStat:: 0 FlushedCount 1270000 QueuedCount 49934 2016-03-24T08:14:16.767+05:30 [Info] logWriterStat:: 0 FlushedCount 1280000 QueuedCount 49957 2016-03-24T08:14:16.849+05:30 [Info] logWriterStat:: 0 FlushedCount 1290000 QueuedCount 49939 2016-03-24T08:14:16.931+05:30 [Info] logWriterStat:: 0 FlushedCount 1300000 QueuedCount 49961 2016-03-24T08:14:17.012+05:30 [Info] logWriterStat:: 0 FlushedCount 1310000 QueuedCount 48971 2016-03-24T08:14:17.104+05:30 [Info] logWriterStat:: 0 FlushedCount 1320000 QueuedCount 49956 2016-03-24T08:14:17.19+05:30 [Info] logWriterStat:: 0 FlushedCount 1330000 QueuedCount 49939 2016-03-24T08:14:17.273+05:30 [Info] logWriterStat:: 0 FlushedCount 1340000 QueuedCount 49946 2016-03-24T08:14:17.352+05:30 [Info] logWriterStat:: 0 FlushedCount 1350000 QueuedCount 49815 2016-03-24T08:14:17.434+05:30 [Info] logWriterStat:: 0 FlushedCount 1360000 QueuedCount 49976 2016-03-24T08:14:17.525+05:30 [Info] logWriterStat:: 0 FlushedCount 1370000 QueuedCount 49922 2016-03-24T08:14:17.602+05:30 [Info] logWriterStat:: 0 FlushedCount 1380000 QueuedCount 49709 2016-03-24T08:14:17.684+05:30 [Info] logWriterStat:: 0 FlushedCount 1390000 QueuedCount 49333 2016-03-24T08:14:17.771+05:30 [Info] logWriterStat:: 0 FlushedCount 1400000 QueuedCount 49923 2016-03-24T08:14:17.851+05:30 [Info] logWriterStat:: 0 FlushedCount 1410000 QueuedCount 49868 2016-03-24T08:14:17.931+05:30 [Info] logWriterStat:: 0 FlushedCount 1420000 QueuedCount 49834 2016-03-24T08:14:18.014+05:30 [Info] logWriterStat:: 0 FlushedCount 1430000 QueuedCount 49823 2016-03-24T08:14:18.106+05:30 [Info] logWriterStat:: 0 FlushedCount 1440000 QueuedCount 49940 2016-03-24T08:14:18.199+05:30 [Info] logWriterStat:: 0 FlushedCount 1450000 QueuedCount 49895 2016-03-24T08:14:18.284+05:30 [Info] logWriterStat:: 0 FlushedCount 1460000 QueuedCount 49921 2016-03-24T08:14:18.369+05:30 [Info] logWriterStat:: 0 FlushedCount 1470000 QueuedCount 49884 2016-03-24T08:14:18.46+05:30 [Info] logWriterStat:: 0 FlushedCount 1480000 QueuedCount 49922 2016-03-24T08:14:18.547+05:30 [Info] logWriterStat:: 0 FlushedCount 1490000 QueuedCount 49969 2016-03-24T08:14:18.629+05:30 [Info] logWriterStat:: 0 FlushedCount 1500000 QueuedCount 49939 2016-03-24T08:14:18.716+05:30 [Info] logWriterStat:: 0 FlushedCount 1510000 QueuedCount 49938 2016-03-24T08:14:18.792+05:30 [Info] logWriterStat:: 0 FlushedCount 1520000 QueuedCount 49405 2016-03-24T08:14:18.874+05:30 [Info] logWriterStat:: 0 FlushedCount 1530000 QueuedCount 49886 2016-03-24T08:14:18.963+05:30 [Info] logWriterStat:: 0 FlushedCount 1540000 QueuedCount 46832 2016-03-24T08:14:19.046+05:30 [Info] logWriterStat:: 0 FlushedCount 1550000 QueuedCount 47295 2016-03-24T08:14:19.144+05:30 [Info] logWriterStat:: 0 FlushedCount 1560000 QueuedCount 47607 2016-03-24T08:14:19.247+05:30 [Info] logWriterStat:: 0 FlushedCount 1570000 QueuedCount 47701 2016-03-24T08:14:19.331+05:30 [Info] logWriterStat:: 0 FlushedCount 1580000 QueuedCount 48555 2016-03-24T08:14:19.419+05:30 [Info] logWriterStat:: 0 FlushedCount 1590000 QueuedCount 47769 2016-03-24T08:14:19.5+05:30 [Info] logWriterStat:: 0 FlushedCount 1600000 QueuedCount 46841 2016-03-24T08:14:19.579+05:30 [Info] logWriterStat:: 0 FlushedCount 1610000 QueuedCount 46905 2016-03-24T08:14:19.656+05:30 [Info] logWriterStat:: 0 FlushedCount 1620000 QueuedCount 45580 2016-03-24T08:14:19.742+05:30 [Info] logWriterStat:: 0 FlushedCount 1630000 QueuedCount 48528 2016-03-24T08:14:19.828+05:30 [Info] logWriterStat:: 0 FlushedCount 1640000 QueuedCount 47788 2016-03-24T08:14:19.915+05:30 [Info] logWriterStat:: 0 FlushedCount 1650000 QueuedCount 48390 2016-03-24T08:14:20.002+05:30 [Info] logWriterStat:: 0 FlushedCount 1660000 QueuedCount 47843 2016-03-24T08:14:20.121+05:30 [Info] logWriterStat:: 0 FlushedCount 1670000 QueuedCount 48194 2016-03-24T08:14:20.233+05:30 [Info] logWriterStat:: 0 FlushedCount 1680000 QueuedCount 47899 2016-03-24T08:14:20.322+05:30 [Info] logWriterStat:: 0 FlushedCount 1690000 QueuedCount 47839 2016-03-24T08:14:20.41+05:30 [Info] logWriterStat:: 0 FlushedCount 1700000 QueuedCount 47949 2016-03-24T08:14:20.495+05:30 [Info] logWriterStat:: 0 FlushedCount 1710000 QueuedCount 47798 2016-03-24T08:14:20.58+05:30 [Info] logWriterStat:: 0 FlushedCount 1720000 QueuedCount 47720 2016-03-24T08:14:20.668+05:30 [Info] logWriterStat:: 0 FlushedCount 1730000 QueuedCount 48224 2016-03-24T08:14:20.751+05:30 [Info] logWriterStat:: 0 FlushedCount 1740000 QueuedCount 46729 2016-03-24T08:14:20.839+05:30 [Info] logWriterStat:: 0 FlushedCount 1750000 QueuedCount 46620 2016-03-24T08:14:20.923+05:30 [Info] logWriterStat:: 0 FlushedCount 1760000 QueuedCount 47490 2016-03-24T08:14:21.01+05:30 [Info] logWriterStat:: 0 FlushedCount 1770000 QueuedCount 48219 2016-03-24T08:14:21.115+05:30 [Info] logWriterStat:: 0 FlushedCount 1780000 QueuedCount 47548 2016-03-24T08:14:21.203+05:30 [Info] logWriterStat:: 0 FlushedCount 1790000 QueuedCount 48736 2016-03-24T08:14:21.291+05:30 [Info] logWriterStat:: 0 FlushedCount 1800000 QueuedCount 48049 2016-03-24T08:14:21.376+05:30 [Info] logWriterStat:: 0 FlushedCount 1810000 QueuedCount 47611 2016-03-24T08:14:21.461+05:30 [Info] logWriterStat:: 0 FlushedCount 1820000 QueuedCount 47458 2016-03-24T08:14:21.543+05:30 [Info] logWriterStat:: 0 FlushedCount 1830000 QueuedCount 47310 2016-03-24T08:14:21.628+05:30 [Info] logWriterStat:: 0 FlushedCount 1840000 QueuedCount 48743 2016-03-24T08:14:21.713+05:30 [Info] logWriterStat:: 0 FlushedCount 1850000 QueuedCount 47424 2016-03-24T08:14:21.798+05:30 [Info] logWriterStat:: 0 FlushedCount 1860000 QueuedCount 48658 2016-03-24T08:14:21.884+05:30 [Info] logWriterStat:: 0 FlushedCount 1870000 QueuedCount 48418 2016-03-24T08:14:21.967+05:30 [Info] logWriterStat:: 0 FlushedCount 1880000 QueuedCount 47537 2016-03-24T08:14:22.056+05:30 [Info] logWriterStat:: 0 FlushedCount 1890000 QueuedCount 47711 2016-03-24T08:14:22.144+05:30 [Info] logWriterStat:: 0 FlushedCount 1900000 QueuedCount 48199 2016-03-24T08:14:22.231+05:30 [Info] logWriterStat:: 0 FlushedCount 1910000 QueuedCount 46871 2016-03-24T08:14:22.315+05:30 [Info] logWriterStat:: 0 FlushedCount 1920000 QueuedCount 47351 2016-03-24T08:14:22.397+05:30 [Info] logWriterStat:: 0 FlushedCount 1930000 QueuedCount 47980 2016-03-24T08:14:22.484+05:30 [Info] logWriterStat:: 0 FlushedCount 1940000 QueuedCount 48286 2016-03-24T08:14:22.573+05:30 [Info] logWriterStat:: 0 FlushedCount 1950000 QueuedCount 48200 2016-03-24T08:14:22.654+05:30 [Info] logWriterStat:: 0 FlushedCount 1960000 QueuedCount 46156 2016-03-24T08:14:22.738+05:30 [Info] logWriterStat:: 0 FlushedCount 1970000 QueuedCount 46388 2016-03-24T08:14:22.814+05:30 [Info] logWriterStat:: 0 FlushedCount 1980000 QueuedCount 47949 2016-03-24T08:14:22.897+05:30 [Info] logWriterStat:: 0 FlushedCount 1990000 QueuedCount 48390 2016-03-24T08:14:22.981+05:30 [Info] logWriterStat:: 0 FlushedCount 2000000 QueuedCount 47778 2016-03-24T08:14:23.075+05:30 [Info] logWriterStat:: 0 FlushedCount 2010000 QueuedCount 48700 2016-03-24T08:14:23.153+05:30 [Info] logWriterStat:: 0 FlushedCount 2020000 QueuedCount 47070 2016-03-24T08:14:23.242+05:30 [Info] logWriterStat:: 0 FlushedCount 2030000 QueuedCount 47174 2016-03-24T08:14:23.323+05:30 [Info] logWriterStat:: 0 FlushedCount 2040000 QueuedCount 47258 2016-03-24T08:14:23.404+05:30 [Info] logWriterStat:: 0 FlushedCount 2050000 QueuedCount 47636 2016-03-24T08:14:23.491+05:30 [Info] logWriterStat:: 0 FlushedCount 2060000 QueuedCount 48690 2016-03-24T08:14:23.56+05:30 [Info] logWriterStat:: 0 FlushedCount 2070000 QueuedCount 47038 2016-03-24T08:14:23.641+05:30 [Info] logWriterStat:: 0 FlushedCount 2080000 QueuedCount 47586 2016-03-24T08:14:23.717+05:30 [Info] logWriterStat:: 0 FlushedCount 2090000 QueuedCount 47361 2016-03-24T08:14:23.797+05:30 [Info] logWriterStat:: 0 FlushedCount 2100000 QueuedCount 48092 2016-03-24T08:14:23.875+05:30 [Info] logWriterStat:: 0 FlushedCount 2110000 QueuedCount 48006 2016-03-24T08:14:23.951+05:30 [Info] logWriterStat:: 0 FlushedCount 2120000 QueuedCount 47148 2016-03-24T08:14:24.032+05:30 [Info] logWriterStat:: 0 FlushedCount 2130000 QueuedCount 47976 2016-03-24T08:14:24.12+05:30 [Info] logWriterStat:: 0 FlushedCount 2140000 QueuedCount 47756 2016-03-24T08:14:24.21+05:30 [Info] logWriterStat:: 0 FlushedCount 2150000 QueuedCount 48426 2016-03-24T08:14:24.295+05:30 [Info] logWriterStat:: 0 FlushedCount 2160000 QueuedCount 47527 2016-03-24T08:14:24.368+05:30 [Info] logWriterStat:: 0 FlushedCount 2170000 QueuedCount 48059 2016-03-24T08:14:24.447+05:30 [Info] logWriterStat:: 0 FlushedCount 2180000 QueuedCount 47192 2016-03-24T08:14:24.527+05:30 [Info] logWriterStat:: 0 FlushedCount 2190000 QueuedCount 48135 2016-03-24T08:14:24.607+05:30 [Info] logWriterStat:: 0 FlushedCount 2200000 QueuedCount 47386 2016-03-24T08:14:24.686+05:30 [Info] logWriterStat:: 0 FlushedCount 2210000 QueuedCount 48073 2016-03-24T08:14:24.767+05:30 [Info] logWriterStat:: 0 FlushedCount 2220000 QueuedCount 47301 2016-03-24T08:14:24.852+05:30 [Info] logWriterStat:: 0 FlushedCount 2230000 QueuedCount 47211 2016-03-24T08:14:24.933+05:30 [Info] logWriterStat:: 0 FlushedCount 2240000 QueuedCount 47745 2016-03-24T08:14:25.011+05:30 [Info] logWriterStat:: 0 FlushedCount 2250000 QueuedCount 48543 2016-03-24T08:14:25.099+05:30 [Info] logWriterStat:: 0 FlushedCount 2260000 QueuedCount 48508 2016-03-24T08:14:25.178+05:30 [Info] logWriterStat:: 0 FlushedCount 2270000 QueuedCount 47791 2016-03-24T08:14:25.268+05:30 [Info] logWriterStat:: 0 FlushedCount 2280000 QueuedCount 47303 2016-03-24T08:14:25.343+05:30 [Info] logWriterStat:: 0 FlushedCount 2290000 QueuedCount 48660 2016-03-24T08:14:25.42+05:30 [Info] logWriterStat:: 0 FlushedCount 2300000 QueuedCount 47637 2016-03-24T08:14:25.494+05:30 [Info] logWriterStat:: 0 FlushedCount 2310000 QueuedCount 48084 2016-03-24T08:14:25.574+05:30 [Info] logWriterStat:: 0 FlushedCount 2320000 QueuedCount 48405 2016-03-24T08:14:25.651+05:30 [Info] logWriterStat:: 0 FlushedCount 2330000 QueuedCount 47504 2016-03-24T08:14:25.727+05:30 [Info] logWriterStat:: 0 FlushedCount 2340000 QueuedCount 47728 2016-03-24T08:14:25.802+05:30 [Info] logWriterStat:: 0 FlushedCount 2350000 QueuedCount 46238 2016-03-24T08:14:25.883+05:30 [Info] logWriterStat:: 0 FlushedCount 2360000 QueuedCount 47869 2016-03-24T08:14:25.959+05:30 [Info] logWriterStat:: 0 FlushedCount 2370000 QueuedCount 47933 2016-03-24T08:14:26.031+05:30 [Info] logWriterStat:: 0 FlushedCount 2380000 QueuedCount 47701 2016-03-24T08:14:26.135+05:30 [Info] logWriterStat:: 0 FlushedCount 2390000 QueuedCount 47747 2016-03-24T08:14:26.215+05:30 [Info] logWriterStat:: 0 FlushedCount 2400000 QueuedCount 47197 2016-03-24T08:14:26.287+05:30 [Info] logWriterStat:: 0 FlushedCount 2410000 QueuedCount 48017 2016-03-24T08:14:26.36+05:30 [Info] logWriterStat:: 0 FlushedCount 2420000 QueuedCount 47832 2016-03-24T08:14:26.435+05:30 [Info] logWriterStat:: 0 FlushedCount 2430000 QueuedCount 48130 2016-03-24T08:14:26.513+05:30 [Info] logWriterStat:: 0 FlushedCount 2440000 QueuedCount 46993 2016-03-24T08:14:26.588+05:30 [Info] logWriterStat:: 0 FlushedCount 2450000 QueuedCount 48041 2016-03-24T08:14:26.669+05:30 [Info] logWriterStat:: 0 FlushedCount 2460000 QueuedCount 47770 2016-03-24T08:14:26.742+05:30 [Info] logWriterStat:: 0 FlushedCount 2470000 QueuedCount 47740 2016-03-24T08:14:26.823+05:30 [Info] logWriterStat:: 0 FlushedCount 2480000 QueuedCount 47615 2016-03-24T08:14:26.895+05:30 [Info] logWriterStat:: 0 FlushedCount 2490000 QueuedCount 46589 2016-03-24T08:14:26.969+05:30 [Info] logWriterStat:: 0 FlushedCount 2500000 QueuedCount 47694 2016-03-24T08:14:27.045+05:30 [Info] logWriterStat:: 0 FlushedCount 2510000 QueuedCount 46970 2016-03-24T08:14:27.134+05:30 [Info] logWriterStat:: 0 FlushedCount 2520000 QueuedCount 49007 2016-03-24T08:14:27.215+05:30 [Info] logWriterStat:: 0 FlushedCount 2530000 QueuedCount 47865 2016-03-24T08:14:27.29+05:30 [Info] logWriterStat:: 0 FlushedCount 2540000 QueuedCount 47746 2016-03-24T08:14:27.375+05:30 [Info] logWriterStat:: 0 FlushedCount 2550000 QueuedCount 48062 2016-03-24T08:14:27.45+05:30 [Info] logWriterStat:: 0 FlushedCount 2560000 QueuedCount 47451 2016-03-24T08:14:27.529+05:30 [Info] logWriterStat:: 0 FlushedCount 2570000 QueuedCount 48322 2016-03-24T08:14:27.603+05:30 [Info] logWriterStat:: 0 FlushedCount 2580000 QueuedCount 47380 2016-03-24T08:14:27.678+05:30 [Info] logWriterStat:: 0 FlushedCount 2590000 QueuedCount 47298 2016-03-24T08:14:27.755+05:30 [Info] logWriterStat:: 0 FlushedCount 2600000 QueuedCount 48062 2016-03-24T08:14:27.835+05:30 [Info] logWriterStat:: 0 FlushedCount 2610000 QueuedCount 48387 2016-03-24T08:14:27.91+05:30 [Info] logWriterStat:: 0 FlushedCount 2620000 QueuedCount 47701 2016-03-24T08:14:27.985+05:30 [Info] logWriterStat:: 0 FlushedCount 2630000 QueuedCount 48649 2016-03-24T08:14:28.077+05:30 [Info] logWriterStat:: 0 FlushedCount 2640000 QueuedCount 48309 2016-03-24T08:14:28.156+05:30 [Info] logWriterStat:: 0 FlushedCount 2650000 QueuedCount 48211 2016-03-24T08:14:28.24+05:30 [Info] logWriterStat:: 0 FlushedCount 2660000 QueuedCount 48075 2016-03-24T08:14:28.317+05:30 [Info] logWriterStat:: 0 FlushedCount 2670000 QueuedCount 47416 2016-03-24T08:14:28.396+05:30 [Info] logWriterStat:: 0 FlushedCount 2680000 QueuedCount 47767 2016-03-24T08:14:28.475+05:30 [Info] logWriterStat:: 0 FlushedCount 2690000 QueuedCount 47331 2016-03-24T08:14:28.552+05:30 [Info] logWriterStat:: 0 FlushedCount 2700000 QueuedCount 47719 2016-03-24T08:14:28.634+05:30 [Info] logWriterStat:: 0 FlushedCount 2710000 QueuedCount 47816 2016-03-24T08:14:28.712+05:30 [Info] logWriterStat:: 0 FlushedCount 2720000 QueuedCount 47355 2016-03-24T08:14:28.786+05:30 [Info] logWriterStat:: 0 FlushedCount 2730000 QueuedCount 47859 2016-03-24T08:14:28.865+05:30 [Info] logWriterStat:: 0 FlushedCount 2740000 QueuedCount 48291 2016-03-24T08:14:28.945+05:30 [Info] logWriterStat:: 0 FlushedCount 2750000 QueuedCount 47553 2016-03-24T08:14:29.021+05:30 [Info] logWriterStat:: 0 FlushedCount 2760000 QueuedCount 47058 2016-03-24T08:14:29.104+05:30 [Info] logWriterStat:: 0 FlushedCount 2770000 QueuedCount 47362 2016-03-24T08:14:29.178+05:30 [Info] logWriterStat:: 0 FlushedCount 2780000 QueuedCount 48255 2016-03-24T08:14:29.272+05:30 [Info] logWriterStat:: 0 FlushedCount 2790000 QueuedCount 47822 2016-03-24T08:14:29.352+05:30 [Info] logWriterStat:: 0 FlushedCount 2800000 QueuedCount 47689 2016-03-24T08:14:29.431+05:30 [Info] logWriterStat:: 0 FlushedCount 2810000 QueuedCount 48794 2016-03-24T08:14:29.508+05:30 [Info] logWriterStat:: 0 FlushedCount 2820000 QueuedCount 47871 2016-03-24T08:14:29.581+05:30 [Info] logWriterStat:: 0 FlushedCount 2830000 QueuedCount 46711 2016-03-24T08:14:29.659+05:30 [Info] logWriterStat:: 0 FlushedCount 2840000 QueuedCount 47738 2016-03-24T08:14:29.764+05:30 [Info] logWriterStat:: 0 FlushedCount 2850000 QueuedCount 49741 2016-03-24T08:14:29.943+05:30 [Info] logWriterStat:: 0 FlushedCount 2860000 QueuedCount 48256 2016-03-24T08:14:30.161+05:30 [Info] logWriterStat:: 0 FlushedCount 2870000 QueuedCount 49878 2016-03-24T08:14:30.393+05:30 [Info] logWriterStat:: 0 FlushedCount 2880000 QueuedCount 49963 2016-03-24T08:14:30.604+05:30 [Info] logWriterStat:: 0 FlushedCount 2890000 QueuedCount 48773 2016-03-24T08:14:30.801+05:30 [Info] logWriterStat:: 0 FlushedCount 2900000 QueuedCount 48040 2016-03-24T08:14:30.978+05:30 [Info] logWriterStat:: 0 FlushedCount 2910000 QueuedCount 48918 2016-03-24T08:14:31.199+05:30 [Info] logWriterStat:: 0 FlushedCount 2920000 QueuedCount 48832 2016-03-24T08:14:31.355+05:30 [Info] logWriterStat:: 0 FlushedCount 2930000 QueuedCount 49081 2016-03-24T08:14:31.438+05:30 [Info] logWriterStat:: 0 FlushedCount 2940000 QueuedCount 49968 2016-03-24T08:14:31.546+05:30 [Info] logWriterStat:: 0 FlushedCount 2950000 QueuedCount 49984 2016-03-24T08:14:31.636+05:30 [Info] logWriterStat:: 0 FlushedCount 2960000 QueuedCount 48815 2016-03-24T08:14:31.751+05:30 [Info] logWriterStat:: 0 FlushedCount 2970000 QueuedCount 49942 2016-03-24T08:14:31.882+05:30 [Info] logWriterStat:: 0 FlushedCount 2980000 QueuedCount 49980 2016-03-24T08:14:32.014+05:30 [Info] logWriterStat:: 0 FlushedCount 2990000 QueuedCount 49883 2016-03-24T08:14:32.153+05:30 [Info] logWriterStat:: 0 FlushedCount 3000000 QueuedCount 49831 2016-03-24T08:14:32.273+05:30 [Info] logWriterStat:: 0 FlushedCount 3010000 QueuedCount 49986 2016-03-24T08:14:32.385+05:30 [Info] logWriterStat:: 0 FlushedCount 3020000 QueuedCount 49989 2016-03-24T08:14:32.508+05:30 [Info] logWriterStat:: 0 FlushedCount 3030000 QueuedCount 49982 2016-03-24T08:14:32.608+05:30 [Info] logWriterStat:: 0 FlushedCount 3040000 QueuedCount 49933 2016-03-24T08:14:32.676+05:30 [Info] logWriterStat:: 0 FlushedCount 3050000 QueuedCount 49986 2016-03-24T08:14:32.74+05:30 [Info] logWriterStat:: 0 FlushedCount 3060000 QueuedCount 49990 2016-03-24T08:14:32.807+05:30 [Info] logWriterStat:: 0 FlushedCount 3070000 QueuedCount 49964 2016-03-24T08:14:32.875+05:30 [Info] logWriterStat:: 0 FlushedCount 3080000 QueuedCount 49888 2016-03-24T08:14:32.938+05:30 [Info] logWriterStat:: 0 FlushedCount 3090000 QueuedCount 49942 2016-03-24T08:14:33.002+05:30 [Info] logWriterStat:: 0 FlushedCount 3100000 QueuedCount 49880 2016-03-24T08:14:33.079+05:30 [Info] logWriterStat:: 0 FlushedCount 3110000 QueuedCount 49964 2016-03-24T08:14:33.146+05:30 [Info] logWriterStat:: 0 FlushedCount 3120000 QueuedCount 49855 2016-03-24T08:14:33.225+05:30 [Info] logWriterStat:: 0 FlushedCount 3130000 QueuedCount 49972 2016-03-24T08:14:33.295+05:30 [Info] logWriterStat:: 0 FlushedCount 3140000 QueuedCount 49984 2016-03-24T08:14:33.374+05:30 [Info] logWriterStat:: 0 FlushedCount 3150000 QueuedCount 49925 2016-03-24T08:14:33.446+05:30 [Info] logWriterStat:: 0 FlushedCount 3160000 QueuedCount 49987 2016-03-24T08:14:33.515+05:30 [Info] logWriterStat:: 0 FlushedCount 3170000 QueuedCount 49935 2016-03-24T08:14:33.584+05:30 [Info] logWriterStat:: 0 FlushedCount 3180000 QueuedCount 49972 2016-03-24T08:14:33.652+05:30 [Info] logWriterStat:: 0 FlushedCount 3190000 QueuedCount 49927 2016-03-24T08:14:33.719+05:30 [Info] logWriterStat:: 0 FlushedCount 3200000 QueuedCount 49942 2016-03-24T08:14:33.789+05:30 [Info] logWriterStat:: 0 FlushedCount 3210000 QueuedCount 49986 2016-03-24T08:14:33.856+05:30 [Info] logWriterStat:: 0 FlushedCount 3220000 QueuedCount 49973 2016-03-24T08:14:33.925+05:30 [Info] logWriterStat:: 0 FlushedCount 3230000 QueuedCount 49940 2016-03-24T08:14:33.997+05:30 [Info] logWriterStat:: 0 FlushedCount 3240000 QueuedCount 49959 2016-03-24T08:14:34.074+05:30 [Info] logWriterStat:: 0 FlushedCount 3250000 QueuedCount 49911 2016-03-24T08:14:34.147+05:30 [Info] logWriterStat:: 0 FlushedCount 3260000 QueuedCount 49921 2016-03-24T08:14:34.229+05:30 [Info] logWriterStat:: 0 FlushedCount 3270000 QueuedCount 49968 2016-03-24T08:14:34.3+05:30 [Info] logWriterStat:: 0 FlushedCount 3280000 QueuedCount 49921 2016-03-24T08:14:34.369+05:30 [Info] logWriterStat:: 0 FlushedCount 3290000 QueuedCount 49897 2016-03-24T08:14:34.442+05:30 [Info] logWriterStat:: 0 FlushedCount 3300000 QueuedCount 49975 2016-03-24T08:14:34.512+05:30 [Info] logWriterStat:: 0 FlushedCount 3310000 QueuedCount 49924 2016-03-24T08:14:34.583+05:30 [Info] logWriterStat:: 0 FlushedCount 3320000 QueuedCount 49947 2016-03-24T08:14:34.652+05:30 [Info] logWriterStat:: 0 FlushedCount 3330000 QueuedCount 49987 2016-03-24T08:14:34.723+05:30 [Info] logWriterStat:: 0 FlushedCount 3340000 QueuedCount 49968 2016-03-24T08:14:34.79+05:30 [Info] logWriterStat:: 0 FlushedCount 3350000 QueuedCount 49927 2016-03-24T08:14:34.86+05:30 [Info] logWriterStat:: 0 FlushedCount 3360000 QueuedCount 49983 2016-03-24T08:14:34.934+05:30 [Info] logWriterStat:: 0 FlushedCount 3370000 QueuedCount 49903 2016-03-24T08:14:35.004+05:30 [Info] logWriterStat:: 0 FlushedCount 3380000 QueuedCount 49975 2016-03-24T08:14:35.083+05:30 [Info] logWriterStat:: 0 FlushedCount 3390000 QueuedCount 49837 2016-03-24T08:14:35.159+05:30 [Info] logWriterStat:: 0 FlushedCount 3400000 QueuedCount 49902 2016-03-24T08:14:35.243+05:30 [Info] logWriterStat:: 0 FlushedCount 3410000 QueuedCount 49929 2016-03-24T08:14:35.317+05:30 [Info] logWriterStat:: 0 FlushedCount 3420000 QueuedCount 49882 2016-03-24T08:14:35.389+05:30 [Info] logWriterStat:: 0 FlushedCount 3430000 QueuedCount 49987 2016-03-24T08:14:35.459+05:30 [Info] logWriterStat:: 0 FlushedCount 3440000 QueuedCount 49940 2016-03-24T08:14:35.531+05:30 [Info] logWriterStat:: 0 FlushedCount 3450000 QueuedCount 49865 2016-03-24T08:14:35.601+05:30 [Info] logWriterStat:: 0 FlushedCount 3460000 QueuedCount 49974 2016-03-24T08:14:35.669+05:30 [Info] logWriterStat:: 0 FlushedCount 3470000 QueuedCount 49927 2016-03-24T08:14:35.735+05:30 [Info] logWriterStat:: 0 FlushedCount 3480000 QueuedCount 49924 2016-03-24T08:14:35.811+05:30 [Info] logWriterStat:: 0 FlushedCount 3490000 QueuedCount 49956 2016-03-24T08:14:35.881+05:30 [Info] logWriterStat:: 0 FlushedCount 3500000 QueuedCount 49960 2016-03-24T08:14:35.951+05:30 [Info] logWriterStat:: 0 FlushedCount 3510000 QueuedCount 49982 2016-03-24T08:14:36.018+05:30 [Info] logWriterStat:: 0 FlushedCount 3520000 QueuedCount 49821 2016-03-24T08:14:36.096+05:30 [Info] logWriterStat:: 0 FlushedCount 3530000 QueuedCount 49980 2016-03-24T08:14:36.177+05:30 [Info] logWriterStat:: 0 FlushedCount 3540000 QueuedCount 49982 2016-03-24T08:14:36.259+05:30 [Info] logWriterStat:: 0 FlushedCount 3550000 QueuedCount 49955 2016-03-24T08:14:36.329+05:30 [Info] logWriterStat:: 0 FlushedCount 3560000 QueuedCount 49959 2016-03-24T08:14:36.397+05:30 [Info] logWriterStat:: 0 FlushedCount 3570000 QueuedCount 49945 2016-03-24T08:14:36.469+05:30 [Info] logWriterStat:: 0 FlushedCount 3580000 QueuedCount 49917 2016-03-24T08:14:36.54+05:30 [Info] logWriterStat:: 0 FlushedCount 3590000 QueuedCount 49934 2016-03-24T08:14:36.611+05:30 [Info] logWriterStat:: 0 FlushedCount 3600000 QueuedCount 49978 2016-03-24T08:14:36.681+05:30 [Info] logWriterStat:: 0 FlushedCount 3610000 QueuedCount 49878 2016-03-24T08:14:36.752+05:30 [Info] logWriterStat:: 0 FlushedCount 3620000 QueuedCount 49968 2016-03-24T08:14:36.822+05:30 [Info] logWriterStat:: 0 FlushedCount 3630000 QueuedCount 49947 2016-03-24T08:14:36.89+05:30 [Info] logWriterStat:: 0 FlushedCount 3640000 QueuedCount 49964 2016-03-24T08:14:36.964+05:30 [Info] logWriterStat:: 0 FlushedCount 3650000 QueuedCount 49991 2016-03-24T08:14:37.034+05:30 [Info] logWriterStat:: 0 FlushedCount 3660000 QueuedCount 49959 2016-03-24T08:14:37.115+05:30 [Info] logWriterStat:: 0 FlushedCount 3670000 QueuedCount 49941 2016-03-24T08:14:37.188+05:30 [Info] logWriterStat:: 0 FlushedCount 3680000 QueuedCount 49869 2016-03-24T08:14:37.26+05:30 [Info] logWriterStat:: 0 FlushedCount 3690000 QueuedCount 49943 2016-03-24T08:14:37.328+05:30 [Info] logWriterStat:: 0 FlushedCount 3700000 QueuedCount 49972 2016-03-24T08:14:37.398+05:30 [Info] logWriterStat:: 0 FlushedCount 3710000 QueuedCount 49545 2016-03-24T08:14:37.47+05:30 [Info] logWriterStat:: 0 FlushedCount 3720000 QueuedCount 49975 2016-03-24T08:14:37.542+05:30 [Info] logWriterStat:: 0 FlushedCount 3730000 QueuedCount 49901 2016-03-24T08:14:37.612+05:30 [Info] logWriterStat:: 0 FlushedCount 3740000 QueuedCount 49985 2016-03-24T08:14:37.682+05:30 [Info] logWriterStat:: 0 FlushedCount 3750000 QueuedCount 48640 2016-03-24T08:14:37.751+05:30 [Info] logWriterStat:: 0 FlushedCount 3760000 QueuedCount 49897 2016-03-24T08:14:37.82+05:30 [Info] logWriterStat:: 0 FlushedCount 3770000 QueuedCount 49991 2016-03-24T08:14:37.889+05:30 [Info] logWriterStat:: 0 FlushedCount 3780000 QueuedCount 49909 2016-03-24T08:14:37.957+05:30 [Info] logWriterStat:: 0 FlushedCount 3790000 QueuedCount 49985 2016-03-24T08:14:38.029+05:30 [Info] logWriterStat:: 0 FlushedCount 3800000 QueuedCount 49960 2016-03-24T08:14:38.111+05:30 [Info] logWriterStat:: 0 FlushedCount 3810000 QueuedCount 49971 2016-03-24T08:14:38.186+05:30 [Info] logWriterStat:: 0 FlushedCount 3820000 QueuedCount 49986 2016-03-24T08:14:38.258+05:30 [Info] logWriterStat:: 0 FlushedCount 3830000 QueuedCount 49938 2016-03-24T08:14:38.326+05:30 [Info] logWriterStat:: 0 FlushedCount 3840000 QueuedCount 49968 2016-03-24T08:14:38.397+05:30 [Info] logWriterStat:: 0 FlushedCount 3850000 QueuedCount 49877 2016-03-24T08:14:38.472+05:30 [Info] logWriterStat:: 0 FlushedCount 3860000 QueuedCount 49953 2016-03-24T08:14:38.543+05:30 [Info] logWriterStat:: 0 FlushedCount 3870000 QueuedCount 49920 2016-03-24T08:14:38.61+05:30 [Info] logWriterStat:: 0 FlushedCount 3880000 QueuedCount 49931 2016-03-24T08:14:38.672+05:30 [Info] logWriterStat:: 0 FlushedCount 3890000 QueuedCount 45863 2016-03-24T08:14:38.738+05:30 [Info] logWriterStat:: 0 FlushedCount 3900000 QueuedCount 40953 2016-03-24T08:14:38.809+05:30 [Info] logWriterStat:: 0 FlushedCount 3910000 QueuedCount 49971 2016-03-24T08:14:38.881+05:30 [Info] logWriterStat:: 0 FlushedCount 3920000 QueuedCount 49952 2016-03-24T08:14:38.952+05:30 [Info] logWriterStat:: 0 FlushedCount 3930000 QueuedCount 49863 2016-03-24T08:14:39.018+05:30 [Info] logWriterStat:: 0 FlushedCount 3940000 QueuedCount 49962 2016-03-24T08:14:39.094+05:30 [Info] logWriterStat:: 0 FlushedCount 3950000 QueuedCount 49925 2016-03-24T08:14:39.164+05:30 [Info] logWriterStat:: 0 FlushedCount 3960000 QueuedCount 49937 2016-03-24T08:14:39.257+05:30 [Info] logWriterStat:: 0 FlushedCount 3970000 QueuedCount 49977 2016-03-24T08:14:39.327+05:30 [Info] logWriterStat:: 0 FlushedCount 3980000 QueuedCount 49893 2016-03-24T08:14:39.398+05:30 [Info] logWriterStat:: 0 FlushedCount 3990000 QueuedCount 49948 2016-03-24T08:14:39.466+05:30 [Info] logWriterStat:: 0 FlushedCount 4000000 QueuedCount 49966 2016-03-24T08:14:39.533+05:30 [Info] logWriterStat:: 0 FlushedCount 4010000 QueuedCount 49935 2016-03-24T08:14:39.601+05:30 [Info] logWriterStat:: 0 FlushedCount 4020000 QueuedCount 49976 2016-03-24T08:14:39.669+05:30 [Info] logWriterStat:: 0 FlushedCount 4030000 QueuedCount 49827 2016-03-24T08:14:39.736+05:30 [Info] logWriterStat:: 0 FlushedCount 4040000 QueuedCount 49944 2016-03-24T08:14:39.801+05:30 [Info] logWriterStat:: 0 FlushedCount 4050000 QueuedCount 49967 2016-03-24T08:14:39.866+05:30 [Info] logWriterStat:: 0 FlushedCount 4060000 QueuedCount 49967 2016-03-24T08:14:39.934+05:30 [Info] logWriterStat:: 0 FlushedCount 4070000 QueuedCount 49946 2016-03-24T08:14:40.004+05:30 [Info] logWriterStat:: 0 FlushedCount 4080000 QueuedCount 49982 2016-03-24T08:14:40.096+05:30 [Info] logWriterStat:: 0 FlushedCount 4090000 QueuedCount 49912 2016-03-24T08:14:40.189+05:30 [Info] logWriterStat:: 0 FlushedCount 4100000 QueuedCount 49961 2016-03-24T08:14:40.273+05:30 [Info] logWriterStat:: 0 FlushedCount 4110000 QueuedCount 49961 2016-03-24T08:14:40.341+05:30 [Info] logWriterStat:: 0 FlushedCount 4120000 QueuedCount 49968 2016-03-24T08:14:40.407+05:30 [Info] logWriterStat:: 0 FlushedCount 4130000 QueuedCount 49963 2016-03-24T08:14:40.474+05:30 [Info] logWriterStat:: 0 FlushedCount 4140000 QueuedCount 49964 2016-03-24T08:14:40.543+05:30 [Info] logWriterStat:: 0 FlushedCount 4150000 QueuedCount 49951 2016-03-24T08:14:40.616+05:30 [Info] logWriterStat:: 0 FlushedCount 4160000 QueuedCount 49944 2016-03-24T08:14:40.686+05:30 [Info] logWriterStat:: 0 FlushedCount 4170000 QueuedCount 49997 2016-03-24T08:14:40.755+05:30 [Info] logWriterStat:: 0 FlushedCount 4180000 QueuedCount 49947 2016-03-24T08:14:40.823+05:30 [Info] logWriterStat:: 0 FlushedCount 4190000 QueuedCount 49990 2016-03-24T08:14:40.892+05:30 [Info] logWriterStat:: 0 FlushedCount 4200000 QueuedCount 49940 2016-03-24T08:14:40.961+05:30 [Info] logWriterStat:: 0 FlushedCount 4210000 QueuedCount 49957 2016-03-24T08:14:41.031+05:30 [Info] logWriterStat:: 0 FlushedCount 4220000 QueuedCount 49937 2016-03-24T08:14:41.115+05:30 [Info] logWriterStat:: 0 FlushedCount 4230000 QueuedCount 49950 2016-03-24T08:14:41.179+05:30 [Info] logWriterStat:: 0 FlushedCount 4240000 QueuedCount 49991 2016-03-24T08:14:41.26+05:30 [Info] logWriterStat:: 0 FlushedCount 4250000 QueuedCount 49947 2016-03-24T08:14:41.326+05:30 [Info] logWriterStat:: 0 FlushedCount 4260000 QueuedCount 49843 2016-03-24T08:14:41.395+05:30 [Info] logWriterStat:: 0 FlushedCount 4270000 QueuedCount 49984 2016-03-24T08:14:41.468+05:30 [Info] logWriterStat:: 0 FlushedCount 4280000 QueuedCount 49943 2016-03-24T08:14:41.535+05:30 [Info] logWriterStat:: 0 FlushedCount 4290000 QueuedCount 49956 2016-03-24T08:14:41.604+05:30 [Info] logWriterStat:: 0 FlushedCount 4300000 QueuedCount 49955 2016-03-24T08:14:41.675+05:30 [Info] logWriterStat:: 0 FlushedCount 4310000 QueuedCount 49948 2016-03-24T08:14:41.744+05:30 [Info] logWriterStat:: 0 FlushedCount 4320000 QueuedCount 49990 2016-03-24T08:14:41.81+05:30 [Info] logWriterStat:: 0 FlushedCount 4330000 QueuedCount 49880 2016-03-24T08:14:41.88+05:30 [Info] logWriterStat:: 0 FlushedCount 4340000 QueuedCount 49976 2016-03-24T08:14:41.949+05:30 [Info] logWriterStat:: 0 FlushedCount 4350000 QueuedCount 49968 2016-03-24T08:14:42.017+05:30 [Info] logWriterStat:: 0 FlushedCount 4360000 QueuedCount 49917 2016-03-24T08:14:42.097+05:30 [Info] logWriterStat:: 0 FlushedCount 4370000 QueuedCount 49936 2016-03-24T08:14:42.171+05:30 [Info] logWriterStat:: 0 FlushedCount 4380000 QueuedCount 49982 2016-03-24T08:14:42.243+05:30 [Info] logWriterStat:: 0 FlushedCount 4390000 QueuedCount 49338 2016-03-24T08:14:42.308+05:30 [Info] logWriterStat:: 0 FlushedCount 4400000 QueuedCount 49932 2016-03-24T08:14:42.377+05:30 [Info] logWriterStat:: 0 FlushedCount 4410000 QueuedCount 49956 2016-03-24T08:14:42.446+05:30 [Info] logWriterStat:: 0 FlushedCount 4420000 QueuedCount 49987 2016-03-24T08:14:42.514+05:30 [Info] logWriterStat:: 0 FlushedCount 4430000 QueuedCount 49943 2016-03-24T08:14:42.587+05:30 [Info] logWriterStat:: 0 FlushedCount 4440000 QueuedCount 49964 2016-03-24T08:14:42.656+05:30 [Info] logWriterStat:: 0 FlushedCount 4450000 QueuedCount 49854 2016-03-24T08:14:42.726+05:30 [Info] logWriterStat:: 0 FlushedCount 4460000 QueuedCount 49878 2016-03-24T08:14:42.795+05:30 [Info] logWriterStat:: 0 FlushedCount 4470000 QueuedCount 49902 2016-03-24T08:14:42.862+05:30 [Info] logWriterStat:: 0 FlushedCount 4480000 QueuedCount 49993 2016-03-24T08:14:42.931+05:30 [Info] logWriterStat:: 0 FlushedCount 4490000 QueuedCount 49943 2016-03-24T08:14:42.998+05:30 [Info] logWriterStat:: 0 FlushedCount 4500000 QueuedCount 49905 2016-03-24T08:14:43.078+05:30 [Info] logWriterStat:: 0 FlushedCount 4510000 QueuedCount 49985 2016-03-24T08:14:43.146+05:30 [Info] logWriterStat:: 0 FlushedCount 4520000 QueuedCount 49921 2016-03-24T08:14:43.226+05:30 [Info] logWriterStat:: 0 FlushedCount 4530000 QueuedCount 49961 2016-03-24T08:14:43.296+05:30 [Info] logWriterStat:: 0 FlushedCount 4540000 QueuedCount 49985 2016-03-24T08:14:43.366+05:30 [Info] logWriterStat:: 0 FlushedCount 4550000 QueuedCount 49980 2016-03-24T08:14:43.441+05:30 [Info] logWriterStat:: 0 FlushedCount 4560000 QueuedCount 49964 2016-03-24T08:14:43.512+05:30 [Info] logWriterStat:: 0 FlushedCount 4570000 QueuedCount 49931 2016-03-24T08:14:43.581+05:30 [Info] logWriterStat:: 0 FlushedCount 4580000 QueuedCount 49922 2016-03-24T08:14:43.651+05:30 [Info] logWriterStat:: 0 FlushedCount 4590000 QueuedCount 49963 2016-03-24T08:14:43.722+05:30 [Info] logWriterStat:: 0 FlushedCount 4600000 QueuedCount 49967 2016-03-24T08:14:43.789+05:30 [Info] logWriterStat:: 0 FlushedCount 4610000 QueuedCount 49939 2016-03-24T08:14:43.856+05:30 [Info] logWriterStat:: 0 FlushedCount 4620000 QueuedCount 49989 2016-03-24T08:14:43.927+05:30 [Info] logWriterStat:: 0 FlushedCount 4630000 QueuedCount 49955 2016-03-24T08:14:43.996+05:30 [Info] logWriterStat:: 0 FlushedCount 4640000 QueuedCount 49986 2016-03-24T08:14:44.079+05:30 [Info] logWriterStat:: 0 FlushedCount 4650000 QueuedCount 49966 2016-03-24T08:14:44.149+05:30 [Info] logWriterStat:: 0 FlushedCount 4660000 QueuedCount 49950 2016-03-24T08:14:44.233+05:30 [Info] logWriterStat:: 0 FlushedCount 4670000 QueuedCount 49939 2016-03-24T08:14:44.302+05:30 [Info] logWriterStat:: 0 FlushedCount 4680000 QueuedCount 49994 2016-03-24T08:14:44.37+05:30 [Info] logWriterStat:: 0 FlushedCount 4690000 QueuedCount 49884 2016-03-24T08:14:44.437+05:30 [Info] logWriterStat:: 0 FlushedCount 4700000 QueuedCount 49904 2016-03-24T08:14:44.506+05:30 [Info] logWriterStat:: 0 FlushedCount 4710000 QueuedCount 49978 2016-03-24T08:14:44.579+05:30 [Info] logWriterStat:: 0 FlushedCount 4720000 QueuedCount 49812 2016-03-24T08:14:44.649+05:30 [Info] logWriterStat:: 0 FlushedCount 4730000 QueuedCount 49969 2016-03-24T08:14:44.718+05:30 [Info] logWriterStat:: 0 FlushedCount 4740000 QueuedCount 49944 2016-03-24T08:14:44.787+05:30 [Info] logWriterStat:: 0 FlushedCount 4750000 QueuedCount 49934 2016-03-24T08:14:44.858+05:30 [Info] logWriterStat:: 0 FlushedCount 4760000 QueuedCount 49998 2016-03-24T08:14:44.927+05:30 [Info] logWriterStat:: 0 FlushedCount 4770000 QueuedCount 49865 2016-03-24T08:14:44.997+05:30 [Info] logWriterStat:: 0 FlushedCount 4780000 QueuedCount 49936 2016-03-24T08:14:45.075+05:30 [Info] logWriterStat:: 0 FlushedCount 4790000 QueuedCount 49939 2016-03-24T08:14:45.148+05:30 [Info] logWriterStat:: 0 FlushedCount 4800000 QueuedCount 49867 2016-03-24T08:14:45.243+05:30 [Info] logWriterStat:: 0 FlushedCount 4810000 QueuedCount 49971 2016-03-24T08:14:45.311+05:30 [Info] logWriterStat:: 0 FlushedCount 4820000 QueuedCount 49749 2016-03-24T08:14:45.382+05:30 [Info] logWriterStat:: 0 FlushedCount 4830000 QueuedCount 49918 2016-03-24T08:14:45.448+05:30 [Info] logWriterStat:: 0 FlushedCount 4840000 QueuedCount 49990 2016-03-24T08:14:45.521+05:30 [Info] logWriterStat:: 0 FlushedCount 4850000 QueuedCount 49957 2016-03-24T08:14:45.591+05:30 [Info] logWriterStat:: 0 FlushedCount 4860000 QueuedCount 49991 2016-03-24T08:14:45.658+05:30 [Info] logWriterStat:: 0 FlushedCount 4870000 QueuedCount 49873 2016-03-24T08:14:45.727+05:30 [Info] logWriterStat:: 0 FlushedCount 4880000 QueuedCount 49990 2016-03-24T08:14:45.797+05:30 [Info] logWriterStat:: 0 FlushedCount 4890000 QueuedCount 49973 2016-03-24T08:14:45.868+05:30 [Info] logWriterStat:: 0 FlushedCount 4900000 QueuedCount 49938 2016-03-24T08:14:45.941+05:30 [Info] logWriterStat:: 0 FlushedCount 4910000 QueuedCount 49935 2016-03-24T08:14:46.011+05:30 [Info] logWriterStat:: 0 FlushedCount 4920000 QueuedCount 49976 2016-03-24T08:14:46.088+05:30 [Info] logWriterStat:: 0 FlushedCount 4930000 QueuedCount 49941 2016-03-24T08:14:46.158+05:30 [Info] logWriterStat:: 0 FlushedCount 4940000 QueuedCount 49971 2016-03-24T08:14:46.242+05:30 [Info] logWriterStat:: 0 FlushedCount 4950000 QueuedCount 49977 2016-03-24T08:14:46.312+05:30 [Info] logWriterStat:: 0 FlushedCount 4960000 QueuedCount 49905 2016-03-24T08:14:46.38+05:30 [Info] logWriterStat:: 0 FlushedCount 4970000 QueuedCount 49961 2016-03-24T08:14:46.451+05:30 [Info] logWriterStat:: 0 FlushedCount 4980000 QueuedCount 49983 2016-03-24T08:14:46.518+05:30 [Info] logWriterStat:: 0 FlushedCount 4990000 QueuedCount 49962 2016-03-24T08:14:46.586+05:30 [Info] logWriterStat:: 0 FlushedCount 5000000 QueuedCount 49979 2016-03-24T08:14:46.656+05:30 [Info] logWriterStat:: 0 FlushedCount 5010000 QueuedCount 49944 2016-03-24T08:14:46.724+05:30 [Info] logWriterStat:: 0 FlushedCount 5020000 QueuedCount 49974 2016-03-24T08:14:46.793+05:30 [Info] logWriterStat:: 0 FlushedCount 5030000 QueuedCount 49926 2016-03-24T08:14:46.862+05:30 [Info] logWriterStat:: 0 FlushedCount 5040000 QueuedCount 49993 2016-03-24T08:14:46.932+05:30 [Info] logWriterStat:: 0 FlushedCount 5050000 QueuedCount 49951 2016-03-24T08:14:47+05:30 [Info] logWriterStat:: 0 FlushedCount 5060000 QueuedCount 49952 2016-03-24T08:14:47.08+05:30 [Info] logWriterStat:: 0 FlushedCount 5070000 QueuedCount 49854 2016-03-24T08:14:47.151+05:30 [Info] logWriterStat:: 0 FlushedCount 5080000 QueuedCount 49987 2016-03-24T08:14:47.221+05:30 [Info] logWriterStat:: 0 FlushedCount 5090000 QueuedCount 49896 2016-03-24T08:14:47.29+05:30 [Info] logWriterStat:: 0 FlushedCount 5100000 QueuedCount 49984 2016-03-24T08:14:47.363+05:30 [Info] logWriterStat:: 0 FlushedCount 5110000 QueuedCount 49959 2016-03-24T08:14:47.427+05:30 [Info] logWriterStat:: 0 FlushedCount 5120000 QueuedCount 49978 2016-03-24T08:14:47.497+05:30 [Info] logWriterStat:: 0 FlushedCount 5130000 QueuedCount 49951 2016-03-24T08:14:47.564+05:30 [Info] logWriterStat:: 0 FlushedCount 5140000 QueuedCount 49400 2016-03-24T08:14:47.631+05:30 [Info] logWriterStat:: 0 FlushedCount 5150000 QueuedCount 49956 2016-03-24T08:14:47.697+05:30 [Info] logWriterStat:: 0 FlushedCount 5160000 QueuedCount 49932 2016-03-24T08:14:47.767+05:30 [Info] logWriterStat:: 0 FlushedCount 5170000 QueuedCount 49964 2016-03-24T08:14:47.836+05:30 [Info] logWriterStat:: 0 FlushedCount 5180000 QueuedCount 49945 2016-03-24T08:14:47.904+05:30 [Info] logWriterStat:: 0 FlushedCount 5190000 QueuedCount 49984 2016-03-24T08:14:47.972+05:30 [Info] logWriterStat:: 0 FlushedCount 5200000 QueuedCount 49840 2016-03-24T08:14:48.043+05:30 [Info] logWriterStat:: 0 FlushedCount 5210000 QueuedCount 49886 2016-03-24T08:14:48.126+05:30 [Info] logWriterStat:: 0 FlushedCount 5220000 QueuedCount 49910 2016-03-24T08:14:48.203+05:30 [Info] logWriterStat:: 0 FlushedCount 5230000 QueuedCount 49961 2016-03-24T08:14:48.274+05:30 [Info] logWriterStat:: 0 FlushedCount 5240000 QueuedCount 49903 2016-03-24T08:14:48.344+05:30 [Info] logWriterStat:: 0 FlushedCount 5250000 QueuedCount 49975 2016-03-24T08:14:48.413+05:30 [Info] logWriterStat:: 0 FlushedCount 5260000 QueuedCount 49966 2016-03-24T08:14:48.477+05:30 [Info] logWriterStat:: 0 FlushedCount 5270000 QueuedCount 49970 2016-03-24T08:14:48.545+05:30 [Info] logWriterStat:: 0 FlushedCount 5280000 QueuedCount 49981 2016-03-24T08:14:48.612+05:30 [Info] logWriterStat:: 0 FlushedCount 5290000 QueuedCount 49981 2016-03-24T08:14:48.68+05:30 [Info] logWriterStat:: 0 FlushedCount 5300000 QueuedCount 49969 2016-03-24T08:14:48.749+05:30 [Info] logWriterStat:: 0 FlushedCount 5310000 QueuedCount 49964 2016-03-24T08:14:48.816+05:30 [Info] logWriterStat:: 0 FlushedCount 5320000 QueuedCount 49901 2016-03-24T08:14:48.883+05:30 [Info] logWriterStat:: 0 FlushedCount 5330000 QueuedCount 49849 2016-03-24T08:14:48.95+05:30 [Info] logWriterStat:: 0 FlushedCount 5340000 QueuedCount 49912 2016-03-24T08:14:49.02+05:30 [Info] logWriterStat:: 0 FlushedCount 5350000 QueuedCount 49959 2016-03-24T08:14:49.097+05:30 [Info] logWriterStat:: 0 FlushedCount 5360000 QueuedCount 49956 2016-03-24T08:14:49.166+05:30 [Info] logWriterStat:: 0 FlushedCount 5370000 QueuedCount 49956 2016-03-24T08:14:49.248+05:30 [Info] logWriterStat:: 0 FlushedCount 5380000 QueuedCount 49944 2016-03-24T08:14:49.318+05:30 [Info] logWriterStat:: 0 FlushedCount 5390000 QueuedCount 49949 2016-03-24T08:14:49.387+05:30 [Info] logWriterStat:: 0 FlushedCount 5400000 QueuedCount 49963 2016-03-24T08:14:49.454+05:30 [Info] logWriterStat:: 0 FlushedCount 5410000 QueuedCount 49923 2016-03-24T08:14:49.518+05:30 [Info] logWriterStat:: 0 FlushedCount 5420000 QueuedCount 49963 2016-03-24T08:14:49.588+05:30 [Info] logWriterStat:: 0 FlushedCount 5430000 QueuedCount 49986 2016-03-24T08:14:49.655+05:30 [Info] logWriterStat:: 0 FlushedCount 5440000 QueuedCount 49936 2016-03-24T08:14:49.72+05:30 [Info] logWriterStat:: 0 FlushedCount 5450000 QueuedCount 49268 2016-03-24T08:14:49.789+05:30 [Info] logWriterStat:: 0 FlushedCount 5460000 QueuedCount 49947 2016-03-24T08:14:49.859+05:30 [Info] logWriterStat:: 0 FlushedCount 5470000 QueuedCount 49974 2016-03-24T08:14:49.929+05:30 [Info] logWriterStat:: 0 FlushedCount 5480000 QueuedCount 49922 2016-03-24T08:14:49.996+05:30 [Info] logWriterStat:: 0 FlushedCount 5490000 QueuedCount 49926 2016-03-24T08:14:50.093+05:30 [Info] logWriterStat:: 0 FlushedCount 5500000 QueuedCount 49929 2016-03-24T08:14:50.187+05:30 [Info] logWriterStat:: 0 FlushedCount 5510000 QueuedCount 49988 2016-03-24T08:14:50.274+05:30 [Info] logWriterStat:: 0 FlushedCount 5520000 QueuedCount 49980 2016-03-24T08:14:50.344+05:30 [Info] logWriterStat:: 0 FlushedCount 5530000 QueuedCount 49961 2016-03-24T08:14:50.413+05:30 [Info] logWriterStat:: 0 FlushedCount 5540000 QueuedCount 49891 2016-03-24T08:14:50.483+05:30 [Info] logWriterStat:: 0 FlushedCount 5550000 QueuedCount 49955 2016-03-24T08:14:50.553+05:30 [Info] logWriterStat:: 0 FlushedCount 5560000 QueuedCount 49936 2016-03-24T08:14:50.623+05:30 [Info] logWriterStat:: 0 FlushedCount 5570000 QueuedCount 49940 2016-03-24T08:14:50.692+05:30 [Info] logWriterStat:: 0 FlushedCount 5580000 QueuedCount 49937 2016-03-24T08:14:50.76+05:30 [Info] logWriterStat:: 0 FlushedCount 5590000 QueuedCount 49941 2016-03-24T08:14:50.829+05:30 [Info] logWriterStat:: 0 FlushedCount 5600000 QueuedCount 49962 2016-03-24T08:14:50.899+05:30 [Info] logWriterStat:: 0 FlushedCount 5610000 QueuedCount 49955 2016-03-24T08:14:50.967+05:30 [Info] logWriterStat:: 0 FlushedCount 5620000 QueuedCount 49931 2016-03-24T08:14:51.032+05:30 [Info] logWriterStat:: 0 FlushedCount 5630000 QueuedCount 49241 2016-03-24T08:14:51.113+05:30 [Info] logWriterStat:: 0 FlushedCount 5640000 QueuedCount 49975 2016-03-24T08:14:51.185+05:30 [Info] logWriterStat:: 0 FlushedCount 5650000 QueuedCount 49956 2016-03-24T08:14:51.276+05:30 [Info] logWriterStat:: 0 FlushedCount 5660000 QueuedCount 49913 2016-03-24T08:14:51.349+05:30 [Info] logWriterStat:: 0 FlushedCount 5670000 QueuedCount 49959 2016-03-24T08:14:51.418+05:30 [Info] logWriterStat:: 0 FlushedCount 5680000 QueuedCount 49949 2016-03-24T08:14:51.537+05:30 [Info] logWriterStat:: 0 FlushedCount 5690000 QueuedCount 49001 2016-03-24T08:14:51.723+05:30 [Info] logWriterStat:: 0 FlushedCount 5700000 QueuedCount 48956 2016-03-24T08:14:51.936+05:30 [Info] logWriterStat:: 0 FlushedCount 5710000 QueuedCount 49172 2016-03-24T08:14:52.136+05:30 [Info] logWriterStat:: 0 FlushedCount 5720000 QueuedCount 48809 2016-03-24T08:14:52.348+05:30 [Info] logWriterStat:: 0 FlushedCount 5730000 QueuedCount 49866 2016-03-24T08:14:52.466+05:30 [Info] logWriterStat:: 0 FlushedCount 5740000 QueuedCount 44758 2016-03-24T08:14:52.597+05:30 [Info] logWriterStat:: 0 FlushedCount 5750000 QueuedCount 49919 2016-03-24T08:14:52.739+05:30 [Info] logWriterStat:: 0 FlushedCount 5760000 QueuedCount 49966 2016-03-24T08:14:52.864+05:30 [Info] logWriterStat:: 0 FlushedCount 5770000 QueuedCount 49946 2016-03-24T08:14:52.99+05:30 [Info] logWriterStat:: 0 FlushedCount 5780000 QueuedCount 49955 2016-03-24T08:14:53.113+05:30 [Info] logWriterStat:: 0 FlushedCount 5790000 QueuedCount 49793 2016-03-24T08:14:53.244+05:30 [Info] logWriterStat:: 0 FlushedCount 5800000 QueuedCount 49952 2016-03-24T08:14:53.356+05:30 [Info] logWriterStat:: 0 FlushedCount 5810000 QueuedCount 49928 2016-03-24T08:14:53.462+05:30 [Info] logWriterStat:: 0 FlushedCount 5820000 QueuedCount 49843 2016-03-24T08:14:53.588+05:30 [Info] logWriterStat:: 0 FlushedCount 5830000 QueuedCount 49989 2016-03-24T08:14:53.714+05:30 [Info] logWriterStat:: 0 FlushedCount 5840000 QueuedCount 49980 2016-03-24T08:14:53.832+05:30 [Info] logWriterStat:: 0 FlushedCount 5850000 QueuedCount 49952 2016-03-24T08:14:53.937+05:30 [Info] logWriterStat:: 0 FlushedCount 5860000 QueuedCount 49986 2016-03-24T08:14:54.005+05:30 [Info] logWriterStat:: 0 FlushedCount 5870000 QueuedCount 49891 2016-03-24T08:14:54.081+05:30 [Info] logWriterStat:: 0 FlushedCount 5880000 QueuedCount 49957 2016-03-24T08:14:54.141+05:30 [Info] logWriterStat:: 0 FlushedCount 5890000 QueuedCount 48463 2016-03-24T08:14:54.223+05:30 [Info] logWriterStat:: 0 FlushedCount 5900000 QueuedCount 49921 2016-03-24T08:14:54.298+05:30 [Info] logWriterStat:: 0 FlushedCount 5910000 QueuedCount 49904 2016-03-24T08:14:54.374+05:30 [Info] logWriterStat:: 0 FlushedCount 5920000 QueuedCount 49894 2016-03-24T08:14:54.443+05:30 [Info] logWriterStat:: 0 FlushedCount 5930000 QueuedCount 49958 2016-03-24T08:14:54.515+05:30 [Info] logWriterStat:: 0 FlushedCount 5940000 QueuedCount 49942 2016-03-24T08:14:54.583+05:30 [Info] logWriterStat:: 0 FlushedCount 5950000 QueuedCount 49941 2016-03-24T08:14:54.653+05:30 [Info] logWriterStat:: 0 FlushedCount 5960000 QueuedCount 49931 2016-03-24T08:14:54.719+05:30 [Info] logWriterStat:: 0 FlushedCount 5970000 QueuedCount 49949 2016-03-24T08:14:54.787+05:30 [Info] logWriterStat:: 0 FlushedCount 5980000 QueuedCount 49987 2016-03-24T08:14:54.854+05:30 [Info] logWriterStat:: 0 FlushedCount 5990000 QueuedCount 49955 2016-03-24T08:14:54.921+05:30 [Info] logWriterStat:: 0 FlushedCount 6000000 QueuedCount 49941 2016-03-24T08:14:54.99+05:30 [Info] logWriterStat:: 0 FlushedCount 6010000 QueuedCount 49996 2016-03-24T08:14:55.067+05:30 [Info] logWriterStat:: 0 FlushedCount 6020000 QueuedCount 49924 2016-03-24T08:14:55.137+05:30 [Info] logWriterStat:: 0 FlushedCount 6030000 QueuedCount 49964 2016-03-24T08:14:55.205+05:30 [Info] logWriterStat:: 0 FlushedCount 6040000 QueuedCount 49971 2016-03-24T08:14:55.288+05:30 [Info] logWriterStat:: 0 FlushedCount 6050000 QueuedCount 49959 2016-03-24T08:14:55.36+05:30 [Info] logWriterStat:: 0 FlushedCount 6060000 QueuedCount 49967 2016-03-24T08:14:55.429+05:30 [Info] logWriterStat:: 0 FlushedCount 6070000 QueuedCount 49869 2016-03-24T08:14:55.499+05:30 [Info] logWriterStat:: 0 FlushedCount 6080000 QueuedCount 49981 2016-03-24T08:14:55.569+05:30 [Info] logWriterStat:: 0 FlushedCount 6090000 QueuedCount 49926 2016-03-24T08:14:55.637+05:30 [Info] logWriterStat:: 0 FlushedCount 6100000 QueuedCount 49959 2016-03-24T08:14:55.706+05:30 [Info] logWriterStat:: 0 FlushedCount 6110000 QueuedCount 49974 2016-03-24T08:14:55.773+05:30 [Info] logWriterStat:: 0 FlushedCount 6120000 QueuedCount 49956 2016-03-24T08:14:55.841+05:30 [Info] logWriterStat:: 0 FlushedCount 6130000 QueuedCount 49962 2016-03-24T08:14:55.908+05:30 [Info] logWriterStat:: 0 FlushedCount 6140000 QueuedCount 49934 2016-03-24T08:14:55.976+05:30 [Info] logWriterStat:: 0 FlushedCount 6150000 QueuedCount 49962 2016-03-24T08:14:56.047+05:30 [Info] logWriterStat:: 0 FlushedCount 6160000 QueuedCount 49910 2016-03-24T08:14:56.127+05:30 [Info] logWriterStat:: 0 FlushedCount 6170000 QueuedCount 49982 2016-03-24T08:14:56.199+05:30 [Info] logWriterStat:: 0 FlushedCount 6180000 QueuedCount 49963 2016-03-24T08:14:56.266+05:30 [Info] logWriterStat:: 0 FlushedCount 6190000 QueuedCount 49998 2016-03-24T08:14:56.354+05:30 [Info] logWriterStat:: 0 FlushedCount 6200000 QueuedCount 49951 2016-03-24T08:14:56.425+05:30 [Info] logWriterStat:: 0 FlushedCount 6210000 QueuedCount 49981 2016-03-24T08:14:56.505+05:30 [Info] logWriterStat:: 0 FlushedCount 6220000 QueuedCount 49969 2016-03-24T08:14:56.575+05:30 [Info] logWriterStat:: 0 FlushedCount 6230000 QueuedCount 49845 2016-03-24T08:14:56.644+05:30 [Info] logWriterStat:: 0 FlushedCount 6240000 QueuedCount 49988 2016-03-24T08:14:56.711+05:30 [Info] logWriterStat:: 0 FlushedCount 6250000 QueuedCount 49971 2016-03-24T08:14:56.782+05:30 [Info] logWriterStat:: 0 FlushedCount 6260000 QueuedCount 49941 2016-03-24T08:14:56.852+05:30 [Info] logWriterStat:: 0 FlushedCount 6270000 QueuedCount 49976 2016-03-24T08:14:56.922+05:30 [Info] logWriterStat:: 0 FlushedCount 6280000 QueuedCount 49953 2016-03-24T08:14:56.995+05:30 [Info] logWriterStat:: 0 FlushedCount 6290000 QueuedCount 49973 2016-03-24T08:14:57.072+05:30 [Info] logWriterStat:: 0 FlushedCount 6300000 QueuedCount 48702 2016-03-24T08:14:57.135+05:30 [Info] logWriterStat:: 0 FlushedCount 6310000 QueuedCount 43736 2016-03-24T08:14:57.207+05:30 [Info] logWriterStat:: 0 FlushedCount 6320000 QueuedCount 39277 2016-03-24T08:14:57.284+05:30 [Info] logWriterStat:: 0 FlushedCount 6330000 QueuedCount 49959 2016-03-24T08:14:57.356+05:30 [Info] logWriterStat:: 0 FlushedCount 6340000 QueuedCount 49875 2016-03-24T08:14:57.425+05:30 [Info] logWriterStat:: 0 FlushedCount 6350000 QueuedCount 49955 2016-03-24T08:14:57.497+05:30 [Info] logWriterStat:: 0 FlushedCount 6360000 QueuedCount 49954 2016-03-24T08:14:57.573+05:30 [Info] logWriterStat:: 0 FlushedCount 6370000 QueuedCount 49982 2016-03-24T08:14:57.647+05:30 [Info] logWriterStat:: 0 FlushedCount 6380000 QueuedCount 49969 2016-03-24T08:14:57.716+05:30 [Info] logWriterStat:: 0 FlushedCount 6390000 QueuedCount 49951 2016-03-24T08:14:57.786+05:30 [Info] logWriterStat:: 0 FlushedCount 6400000 QueuedCount 49976 2016-03-24T08:14:57.858+05:30 [Info] logWriterStat:: 0 FlushedCount 6410000 QueuedCount 49858 2016-03-24T08:14:57.928+05:30 [Info] logWriterStat:: 0 FlushedCount 6420000 QueuedCount 49870 2016-03-24T08:14:57.994+05:30 [Info] logWriterStat:: 0 FlushedCount 6430000 QueuedCount 48485 2016-03-24T08:14:58.072+05:30 [Info] logWriterStat:: 0 FlushedCount 6440000 QueuedCount 49947 2016-03-24T08:14:58.14+05:30 [Info] logWriterStat:: 0 FlushedCount 6450000 QueuedCount 49931 2016-03-24T08:14:58.215+05:30 [Info] logWriterStat:: 0 FlushedCount 6460000 QueuedCount 49984 2016-03-24T08:14:58.29+05:30 [Info] logWriterStat:: 0 FlushedCount 6470000 QueuedCount 49970 2016-03-24T08:14:58.36+05:30 [Info] logWriterStat:: 0 FlushedCount 6480000 QueuedCount 49988 2016-03-24T08:14:58.431+05:30 [Info] logWriterStat:: 0 FlushedCount 6490000 QueuedCount 49869 2016-03-24T08:14:58.51+05:30 [Info] logWriterStat:: 0 FlushedCount 6500000 QueuedCount 49957 2016-03-24T08:14:58.583+05:30 [Info] logWriterStat:: 0 FlushedCount 6510000 QueuedCount 49949 2016-03-24T08:14:58.654+05:30 [Info] logWriterStat:: 0 FlushedCount 6520000 QueuedCount 49887 2016-03-24T08:14:58.717+05:30 [Info] logWriterStat:: 0 FlushedCount 6530000 QueuedCount 49964 2016-03-24T08:14:58.789+05:30 [Info] logWriterStat:: 0 FlushedCount 6540000 QueuedCount 49935 2016-03-24T08:14:58.86+05:30 [Info] logWriterStat:: 0 FlushedCount 6550000 QueuedCount 49926 2016-03-24T08:14:58.933+05:30 [Info] logWriterStat:: 0 FlushedCount 6560000 QueuedCount 49937 2016-03-24T08:14:59.004+05:30 [Info] logWriterStat:: 0 FlushedCount 6570000 QueuedCount 49989 2016-03-24T08:14:59.087+05:30 [Info] logWriterStat:: 0 FlushedCount 6580000 QueuedCount 49999 2016-03-24T08:14:59.155+05:30 [Info] logWriterStat:: 0 FlushedCount 6590000 QueuedCount 49978 2016-03-24T08:14:59.246+05:30 [Info] logWriterStat:: 0 FlushedCount 6600000 QueuedCount 49977 2016-03-24T08:14:59.317+05:30 [Info] logWriterStat:: 0 FlushedCount 6610000 QueuedCount 49834 2016-03-24T08:14:59.391+05:30 [Info] logWriterStat:: 0 FlushedCount 6620000 QueuedCount 49977 2016-03-24T08:14:59.458+05:30 [Info] logWriterStat:: 0 FlushedCount 6630000 QueuedCount 49941 2016-03-24T08:14:59.532+05:30 [Info] logWriterStat:: 0 FlushedCount 6640000 QueuedCount 49961 2016-03-24T08:14:59.604+05:30 [Info] logWriterStat:: 0 FlushedCount 6650000 QueuedCount 49940 2016-03-24T08:14:59.674+05:30 [Info] logWriterStat:: 0 FlushedCount 6660000 QueuedCount 49925 2016-03-24T08:14:59.745+05:30 [Info] logWriterStat:: 0 FlushedCount 6670000 QueuedCount 49963 2016-03-24T08:14:59.816+05:30 [Info] logWriterStat:: 0 FlushedCount 6680000 QueuedCount 49908 2016-03-24T08:14:59.889+05:30 [Info] logWriterStat:: 0 FlushedCount 6690000 QueuedCount 49894 2016-03-24T08:14:59.962+05:30 [Info] logWriterStat:: 0 FlushedCount 6700000 QueuedCount 49988 2016-03-24T08:15:00.038+05:30 [Info] logWriterStat:: 0 FlushedCount 6710000 QueuedCount 49905 2016-03-24T08:15:00.166+05:30 [Info] logWriterStat:: 0 FlushedCount 6720000 QueuedCount 49962 2016-03-24T08:15:00.258+05:30 [Info] logWriterStat:: 0 FlushedCount 6730000 QueuedCount 49959 2016-03-24T08:15:00.332+05:30 [Info] logWriterStat:: 0 FlushedCount 6740000 QueuedCount 49969 2016-03-24T08:15:00.406+05:30 [Info] logWriterStat:: 0 FlushedCount 6750000 QueuedCount 49904 2016-03-24T08:15:00.48+05:30 [Info] logWriterStat:: 0 FlushedCount 6760000 QueuedCount 49853 2016-03-24T08:15:00.553+05:30 [Info] logWriterStat:: 0 FlushedCount 6770000 QueuedCount 49930 2016-03-24T08:15:00.628+05:30 [Info] logWriterStat:: 0 FlushedCount 6780000 QueuedCount 49968 2016-03-24T08:15:00.698+05:30 [Info] logWriterStat:: 0 FlushedCount 6790000 QueuedCount 49908 2016-03-24T08:15:00.774+05:30 [Info] logWriterStat:: 0 FlushedCount 6800000 QueuedCount 49886 2016-03-24T08:15:00.849+05:30 [Info] logWriterStat:: 0 FlushedCount 6810000 QueuedCount 49813 2016-03-24T08:15:00.924+05:30 [Info] logWriterStat:: 0 FlushedCount 6820000 QueuedCount 49895 2016-03-24T08:15:01.001+05:30 [Info] logWriterStat:: 0 FlushedCount 6830000 QueuedCount 49992 2016-03-24T08:15:01.088+05:30 [Info] logWriterStat:: 0 FlushedCount 6840000 QueuedCount 49967 2016-03-24T08:15:01.166+05:30 [Info] logWriterStat:: 0 FlushedCount 6850000 QueuedCount 49953 2016-03-24T08:15:01.248+05:30 [Info] logWriterStat:: 0 FlushedCount 6860000 QueuedCount 46202 2016-03-24T08:15:01.332+05:30 [Info] logWriterStat:: 0 FlushedCount 6870000 QueuedCount 49880 2016-03-24T08:15:01.407+05:30 [Info] logWriterStat:: 0 FlushedCount 6880000 QueuedCount 49967 2016-03-24T08:15:01.48+05:30 [Info] logWriterStat:: 0 FlushedCount 6890000 QueuedCount 49988 2016-03-24T08:15:01.552+05:30 [Info] logWriterStat:: 0 FlushedCount 6900000 QueuedCount 49952 2016-03-24T08:15:01.628+05:30 [Info] logWriterStat:: 0 FlushedCount 6910000 QueuedCount 49942 2016-03-24T08:15:01.702+05:30 [Info] logWriterStat:: 0 FlushedCount 6920000 QueuedCount 49959 2016-03-24T08:15:01.776+05:30 [Info] logWriterStat:: 0 FlushedCount 6930000 QueuedCount 49943 2016-03-24T08:15:01.851+05:30 [Info] logWriterStat:: 0 FlushedCount 6940000 QueuedCount 49963 2016-03-24T08:15:01.926+05:30 [Info] logWriterStat:: 0 FlushedCount 6950000 QueuedCount 49912 2016-03-24T08:15:02.009+05:30 [Info] logWriterStat:: 0 FlushedCount 6960000 QueuedCount 49979 2016-03-24T08:15:02.099+05:30 [Info] logWriterStat:: 0 FlushedCount 6970000 QueuedCount 49965 2016-03-24T08:15:02.178+05:30 [Info] logWriterStat:: 0 FlushedCount 6980000 QueuedCount 49372 2016-03-24T08:15:02.255+05:30 [Info] logWriterStat:: 0 FlushedCount 6990000 QueuedCount 48461 2016-03-24T08:15:02.328+05:30 [Info] logWriterStat:: 0 FlushedCount 7000000 QueuedCount 47670 2016-03-24T08:15:02.403+05:30 [Info] logWriterStat:: 0 FlushedCount 7010000 QueuedCount 46987 2016-03-24T08:15:02.479+05:30 [Info] logWriterStat:: 0 FlushedCount 7020000 QueuedCount 46832 2016-03-24T08:15:02.558+05:30 [Info] logWriterStat:: 0 FlushedCount 7030000 QueuedCount 46866 2016-03-24T08:15:02.633+05:30 [Info] logWriterStat:: 0 FlushedCount 7040000 QueuedCount 46851 2016-03-24T08:15:02.709+05:30 [Info] logWriterStat:: 0 FlushedCount 7050000 QueuedCount 46739 2016-03-24T08:15:02.783+05:30 [Info] logWriterStat:: 0 FlushedCount 7060000 QueuedCount 46828 2016-03-24T08:15:02.855+05:30 [Info] logWriterStat:: 0 FlushedCount 7070000 QueuedCount 46814 2016-03-24T08:15:02.933+05:30 [Info] logWriterStat:: 0 FlushedCount 7080000 QueuedCount 46825 2016-03-24T08:15:03.002+05:30 [Info] logWriterStat:: 0 FlushedCount 7090000 QueuedCount 46849 2016-03-24T08:15:03.086+05:30 [Info] logWriterStat:: 0 FlushedCount 7100000 QueuedCount 46829 2016-03-24T08:15:03.172+05:30 [Info] logWriterStat:: 0 FlushedCount 7110000 QueuedCount 46801 2016-03-24T08:15:03.284+05:30 [Info] logWriterStat:: 0 FlushedCount 7120000 QueuedCount 46829 2016-03-24T08:15:03.39+05:30 [Info] logWriterStat:: 0 FlushedCount 7130000 QueuedCount 46850 2016-03-24T08:15:03.469+05:30 [Info] logWriterStat:: 0 FlushedCount 7140000 QueuedCount 46864 2016-03-24T08:15:03.543+05:30 [Info] logWriterStat:: 0 FlushedCount 7150000 QueuedCount 46760 2016-03-24T08:15:03.618+05:30 [Info] logWriterStat:: 0 FlushedCount 7160000 QueuedCount 46838 2016-03-24T08:15:03.694+05:30 [Info] logWriterStat:: 0 FlushedCount 7170000 QueuedCount 46865 2016-03-24T08:15:03.768+05:30 [Info] logWriterStat:: 0 FlushedCount 7180000 QueuedCount 46771 2016-03-24T08:15:03.845+05:30 [Info] logWriterStat:: 0 FlushedCount 7190000 QueuedCount 46828 2016-03-24T08:15:03.922+05:30 [Info] logWriterStat:: 0 FlushedCount 7200000 QueuedCount 46815 2016-03-24T08:15:03.995+05:30 [Info] logWriterStat:: 0 FlushedCount 7210000 QueuedCount 46861 2016-03-24T08:15:04.089+05:30 [Info] logWriterStat:: 0 FlushedCount 7220000 QueuedCount 46852 2016-03-24T08:15:04.169+05:30 [Info] logWriterStat:: 0 FlushedCount 7230000 QueuedCount 46827 2016-03-24T08:15:04.25+05:30 [Info] logWriterStat:: 0 FlushedCount 7240000 QueuedCount 46792 2016-03-24T08:15:04.326+05:30 [Info] logWriterStat:: 0 FlushedCount 7250000 QueuedCount 46850 2016-03-24T08:15:04.398+05:30 [Info] logWriterStat:: 0 FlushedCount 7260000 QueuedCount 46813 2016-03-24T08:15:04.467+05:30 [Info] logWriterStat:: 0 FlushedCount 7270000 QueuedCount 46858 2016-03-24T08:15:04.54+05:30 [Info] logWriterStat:: 0 FlushedCount 7280000 QueuedCount 46860 2016-03-24T08:15:04.753+05:30 [Info] logWriterStat:: 0 FlushedCount 7290000 QueuedCount 46728 2016-03-24T08:15:04.922+05:30 [Info] logWriterStat:: 0 FlushedCount 7300000 QueuedCount 45756 2016-03-24T08:15:05.146+05:30 [Info] logWriterStat:: 0 FlushedCount 7310000 QueuedCount 45103 2016-03-24T08:15:05.276+05:30 [Info] logWriterStat:: 0 FlushedCount 7320000 QueuedCount 46715 2016-03-24T08:15:05.405+05:30 [Info] logWriterStat:: 0 FlushedCount 7330000 QueuedCount 46638 2016-03-24T08:15:05.544+05:30 [Info] logWriterStat:: 0 FlushedCount 7340000 QueuedCount 46874 2016-03-24T08:15:05.681+05:30 [Info] logWriterStat:: 0 FlushedCount 7350000 QueuedCount 46817 2016-03-24T08:15:05.809+05:30 [Info] logWriterStat:: 0 FlushedCount 7360000 QueuedCount 46857 2016-03-24T08:15:05.948+05:30 [Info] logWriterStat:: 0 FlushedCount 7370000 QueuedCount 46777 2016-03-24T08:15:06.091+05:30 [Info] logWriterStat:: 0 FlushedCount 7380000 QueuedCount 46755 2016-03-24T08:15:06.243+05:30 [Info] logWriterStat:: 0 FlushedCount 7390000 QueuedCount 45575 2016-03-24T08:15:06.331+05:30 [Info] logWriterStat:: 0 FlushedCount 7400000 QueuedCount 45391 2016-03-24T08:15:06.406+05:30 [Info] logWriterStat:: 0 FlushedCount 7410000 QueuedCount 44801 2016-03-24T08:15:06.479+05:30 [Info] logWriterStat:: 0 FlushedCount 7420000 QueuedCount 44132 2016-03-24T08:15:06.551+05:30 [Info] logWriterStat:: 0 FlushedCount 7430000 QueuedCount 43748 2016-03-24T08:15:06.626+05:30 [Info] logWriterStat:: 0 FlushedCount 7440000 QueuedCount 43739 2016-03-24T08:15:06.698+05:30 [Info] logWriterStat:: 0 FlushedCount 7450000 QueuedCount 43728 2016-03-24T08:15:06.773+05:30 [Info] logWriterStat:: 0 FlushedCount 7460000 QueuedCount 43728 2016-03-24T08:15:06.848+05:30 [Info] logWriterStat:: 0 FlushedCount 7470000 QueuedCount 43321 2016-03-24T08:15:06.919+05:30 [Info] logWriterStat:: 0 FlushedCount 7480000 QueuedCount 42526 2016-03-24T08:15:06.991+05:30 [Info] logWriterStat:: 0 FlushedCount 7490000 QueuedCount 41487 2016-03-24T08:15:07.074+05:30 [Info] logWriterStat:: 0 FlushedCount 7500000 QueuedCount 39943 2016-03-24T08:15:07.15+05:30 [Info] logWriterStat:: 0 FlushedCount 7510000 QueuedCount 38722 2016-03-24T08:15:07.22+05:30 [Info] logWriterStat:: 0 FlushedCount 7520000 QueuedCount 37870 2016-03-24T08:15:07.291+05:30 [Info] logWriterStat:: 0 FlushedCount 7530000 QueuedCount 37443 2016-03-24T08:15:07.367+05:30 [Info] logWriterStat:: 0 FlushedCount 7540000 QueuedCount 37473 2016-03-24T08:15:07.444+05:30 [Info] logWriterStat:: 0 FlushedCount 7550000 QueuedCount 37418 2016-03-24T08:15:07.511+05:30 [Info] logWriterStat:: 0 FlushedCount 7560000 QueuedCount 36040 2016-03-24T08:15:07.586+05:30 [Info] logWriterStat:: 0 FlushedCount 7570000 QueuedCount 34182 2016-03-24T08:15:07.658+05:30 [Info] logWriterStat:: 0 FlushedCount 7580000 QueuedCount 32461 2016-03-24T08:15:07.734+05:30 [Info] logWriterStat:: 0 FlushedCount 7590000 QueuedCount 31232 2016-03-24T08:15:07.806+05:30 [Info] logWriterStat:: 0 FlushedCount 7600000 QueuedCount 31226 2016-03-24T08:15:07.88+05:30 [Info] logWriterStat:: 0 FlushedCount 7610000 QueuedCount 30527 2016-03-24T08:15:07.948+05:30 [Info] logWriterStat:: 0 FlushedCount 7620000 QueuedCount 29555 2016-03-24T08:15:08.024+05:30 [Info] logWriterStat:: 0 FlushedCount 7630000 QueuedCount 28608 2016-03-24T08:15:08.109+05:30 [Info] logWriterStat:: 0 FlushedCount 7640000 QueuedCount 27646 2016-03-24T08:15:08.19+05:30 [Info] logWriterStat:: 0 FlushedCount 7650000 QueuedCount 26616 2016-03-24T08:15:08.264+05:30 [Info] logWriterStat:: 0 FlushedCount 7660000 QueuedCount 25612 2016-03-24T08:15:08.329+05:30 [Info] logWriterStat:: 0 FlushedCount 7670000 QueuedCount 24965 2016-03-24T08:15:08.397+05:30 [Info] logWriterStat:: 0 FlushedCount 7680000 QueuedCount 24937 2016-03-24T08:15:08.465+05:30 [Info] logWriterStat:: 0 FlushedCount 7690000 QueuedCount 24975 2016-03-24T08:15:08.534+05:30 [Info] logWriterStat:: 0 FlushedCount 7700000 QueuedCount 24940 2016-03-24T08:15:08.599+05:30 [Info] logWriterStat:: 0 FlushedCount 7710000 QueuedCount 24954 2016-03-24T08:15:08.664+05:30 [Info] logWriterStat:: 0 FlushedCount 7720000 QueuedCount 24461 2016-03-24T08:15:08.722+05:30 [Info] logWriterStat:: 0 FlushedCount 7730000 QueuedCount 21957 2016-03-24T08:15:08.782+05:30 [Info] logWriterStat:: 0 FlushedCount 7740000 QueuedCount 19932 2016-03-24T08:15:08.845+05:30 [Info] logWriterStat:: 0 FlushedCount 7750000 QueuedCount 18719 2016-03-24T08:15:08.905+05:30 [Info] logWriterStat:: 0 FlushedCount 7760000 QueuedCount 17486 2016-03-24T08:15:08.964+05:30 [Info] logWriterStat:: 0 FlushedCount 7770000 QueuedCount 15614 2016-03-24T08:15:09.023+05:30 [Info] logWriterStat:: 0 FlushedCount 7780000 QueuedCount 15591 2016-03-24T08:15:09.089+05:30 [Info] logWriterStat:: 0 FlushedCount 7790000 QueuedCount 14197 2016-03-24T08:15:09.146+05:30 [Info] logWriterStat:: 0 FlushedCount 7800000 QueuedCount 11644 2016-03-24T08:15:09.208+05:30 [Info] logWriterStat:: 0 FlushedCount 7810000 QueuedCount 9350 2016-03-24T08:15:09.282+05:30 [Info] logWriterStat:: 0 FlushedCount 7820000 QueuedCount 6701 2016-03-24T08:15:09.367+05:30 [Info] logWriterStat:: 0 FlushedCount 7830000 QueuedCount 6215 2016-03-24T08:15:09.447+05:30 [Info] logWriterStat:: 0 FlushedCount 7840000 QueuedCount 6220 2016-03-24T08:15:09.53+05:30 [Info] logWriterStat:: 0 FlushedCount 7850000 QueuedCount 5793 2016-03-24T08:15:09.631+05:30 [Info] MemDBSlice::OpenSnapshot SliceId 0 IndexInstId 0 Creating New Snapshot SnapshotInfo: count:7858542 committed:false 2016-03-24T08:15:09.642+05:30 [Info] logWriterStat:: 0 FlushedCount 7860000 QueuedCount 14186 2016-03-24T08:15:09.876+05:30 [Info] logWriterStat:: 0 FlushedCount 7870000 QueuedCount 48931 2016-03-24T08:15:10.068+05:30 [Info] logWriterStat:: 0 FlushedCount 7880000 QueuedCount 49015 2016-03-24T08:15:10.235+05:30 [Info] logWriterStat:: 0 FlushedCount 7890000 QueuedCount 44716 2016-03-24T08:15:10.427+05:30 [Info] logWriterStat:: 0 FlushedCount 7900000 QueuedCount 47985 2016-03-24T08:15:10.627+05:30 [Info] logWriterStat:: 0 FlushedCount 7910000 QueuedCount 46287 2016-03-24T08:15:10.781+05:30 [Info] logWriterStat:: 0 FlushedCount 7920000 QueuedCount 47457 2016-03-24T08:15:10.971+05:30 [Info] logWriterStat:: 0 FlushedCount 7930000 QueuedCount 47504 2016-03-24T08:15:11.151+05:30 [Info] logWriterStat:: 0 FlushedCount 7940000 QueuedCount 46912 2016-03-24T08:15:11.292+05:30 [Info] logWriterStat:: 0 FlushedCount 7950000 QueuedCount 49433 2016-03-24T08:15:11.456+05:30 [Info] logWriterStat:: 0 FlushedCount 7960000 QueuedCount 48712 2016-03-24T08:15:11.66+05:30 [Info] logWriterStat:: 0 FlushedCount 7970000 QueuedCount 49630 2016-03-24T08:15:11.86+05:30 [Info] logWriterStat:: 0 FlushedCount 7980000 QueuedCount 49450 2016-03-24T08:15:12.333+05:30 [Info] logWriterStat:: 0 FlushedCount 7990000 QueuedCount 49080 2016-03-24T08:15:12.595+05:30 [Info] logWriterStat:: 0 FlushedCount 8000000 QueuedCount 49885 2016-03-24T08:15:12.783+05:30 [Info] logWriterStat:: 0 FlushedCount 8010000 QueuedCount 49161 2016-03-24T08:15:12.912+05:30 [Info] logWriterStat:: 0 FlushedCount 8020000 QueuedCount 43252 2016-03-24T08:15:13.105+05:30 [Info] logWriterStat:: 0 FlushedCount 8030000 QueuedCount 47905 2016-03-24T08:15:13.299+05:30 [Info] logWriterStat:: 0 FlushedCount 8040000 QueuedCount 44448 2016-03-24T08:15:13.505+05:30 [Info] logWriterStat:: 0 FlushedCount 8050000 QueuedCount 48313 2016-03-24T08:15:13.681+05:30 [Info] logWriterStat:: 0 FlushedCount 8060000 QueuedCount 48946 2016-03-24T08:15:13.798+05:30 [Info] logWriterStat:: 0 FlushedCount 8070000 QueuedCount 46513 2016-03-24T08:15:13.949+05:30 [Info] logWriterStat:: 0 FlushedCount 8080000 QueuedCount 46200 2016-03-24T08:15:14.102+05:30 [Info] logWriterStat:: 0 FlushedCount 8090000 QueuedCount 47312 2016-03-24T08:15:14.287+05:30 [Info] logWriterStat:: 0 FlushedCount 8100000 QueuedCount 47770 2016-03-24T08:15:14.456+05:30 [Info] logWriterStat:: 0 FlushedCount 8110000 QueuedCount 47935 2016-03-24T08:15:14.588+05:30 [Info] logWriterStat:: 0 FlushedCount 8120000 QueuedCount 47608 2016-03-24T08:15:14.795+05:30 [Info] logWriterStat:: 0 FlushedCount 8130000 QueuedCount 48896 2016-03-24T08:15:14.961+05:30 [Info] logWriterStat:: 0 FlushedCount 8140000 QueuedCount 45520 2016-03-24T08:15:15.104+05:30 [Info] logWriterStat:: 0 FlushedCount 8150000 QueuedCount 47163 2016-03-24T08:15:15.292+05:30 [Info] logWriterStat:: 0 FlushedCount 8160000 QueuedCount 47188 2016-03-24T08:15:15.438+05:30 [Info] logWriterStat:: 0 FlushedCount 8170000 QueuedCount 46653 2016-03-24T08:15:15.595+05:30 [Info] logWriterStat:: 0 FlushedCount 8180000 QueuedCount 47250 2016-03-24T08:15:15.764+05:30 [Info] logWriterStat:: 0 FlushedCount 8190000 QueuedCount 49309 2016-03-24T08:15:15.95+05:30 [Info] logWriterStat:: 0 FlushedCount 8200000 QueuedCount 48966 2016-03-24T08:15:16.071+05:30 [Info] logWriterStat:: 0 FlushedCount 8210000 QueuedCount 47289 2016-03-24T08:15:16.329+05:30 [Info] logWriterStat:: 0 FlushedCount 8220000 QueuedCount 49356 2016-03-24T08:15:16.692+05:30 [Info] logWriterStat:: 0 FlushedCount 8230000 QueuedCount 48923 2016-03-24T08:15:16.976+05:30 [Info] logWriterStat:: 0 FlushedCount 8240000 QueuedCount 49267 2016-03-24T08:15:17.324+05:30 [Info] logWriterStat:: 0 FlushedCount 8250000 QueuedCount 48674 2016-03-24T08:15:17.658+05:30 [Info] logWriterStat:: 0 FlushedCount 8260000 QueuedCount 48505 2016-03-24T08:15:17.866+05:30 [Info] logWriterStat:: 0 FlushedCount 8270000 QueuedCount 48749 2016-03-24T08:15:17.992+05:30 [Info] logWriterStat:: 0 FlushedCount 8280000 QueuedCount 44413 2016-03-24T08:15:18.156+05:30 [Info] logWriterStat:: 0 FlushedCount 8290000 QueuedCount 46377 2016-03-24T08:15:18.294+05:30 [Info] logWriterStat:: 0 FlushedCount 8300000 QueuedCount 46246 2016-03-24T08:15:18.42+05:30 [Info] logWriterStat:: 0 FlushedCount 8310000 QueuedCount 48640 2016-03-24T08:15:18.589+05:30 [Info] logWriterStat:: 0 FlushedCount 8320000 QueuedCount 49937 2016-03-24T08:15:18.753+05:30 [Info] logWriterStat:: 0 FlushedCount 8330000 QueuedCount 49823 2016-03-24T08:15:18.877+05:30 [Info] logWriterStat:: 0 FlushedCount 8340000 QueuedCount 49982 2016-03-24T08:15:18.954+05:30 [Info] logWriterStat:: 0 FlushedCount 8350000 QueuedCount 49917 2016-03-24T08:15:19.032+05:30 [Info] logWriterStat:: 0 FlushedCount 8360000 QueuedCount 49949 2016-03-24T08:15:19.116+05:30 [Info] logWriterStat:: 0 FlushedCount 8370000 QueuedCount 49976 2016-03-24T08:15:19.189+05:30 [Info] logWriterStat:: 0 FlushedCount 8380000 QueuedCount 49932 2016-03-24T08:15:19.28+05:30 [Info] logWriterStat:: 0 FlushedCount 8390000 QueuedCount 49939 2016-03-24T08:15:19.361+05:30 [Info] logWriterStat:: 0 FlushedCount 8400000 QueuedCount 49862 2016-03-24T08:15:19.443+05:30 [Info] logWriterStat:: 0 FlushedCount 8410000 QueuedCount 49972 2016-03-24T08:15:19.517+05:30 [Info] logWriterStat:: 0 FlushedCount 8420000 QueuedCount 49895 2016-03-24T08:15:19.595+05:30 [Info] logWriterStat:: 0 FlushedCount 8430000 QueuedCount 49956 2016-03-24T08:15:19.672+05:30 [Info] logWriterStat:: 0 FlushedCount 8440000 QueuedCount 49894 2016-03-24T08:15:19.746+05:30 [Info] logWriterStat:: 0 FlushedCount 8450000 QueuedCount 49901 2016-03-24T08:15:19.823+05:30 [Info] logWriterStat:: 0 FlushedCount 8460000 QueuedCount 49992 2016-03-24T08:15:19.898+05:30 [Info] logWriterStat:: 0 FlushedCount 8470000 QueuedCount 49973 2016-03-24T08:15:19.962+05:30 [Info] logWriterStat:: 0 FlushedCount 8480000 QueuedCount 47733 2016-03-24T08:15:20.044+05:30 [Info] logWriterStat:: 0 FlushedCount 8490000 QueuedCount 49972 2016-03-24T08:15:20.171+05:30 [Info] logWriterStat:: 0 FlushedCount 8500000 QueuedCount 49901 2016-03-24T08:15:20.263+05:30 [Info] logWriterStat:: 0 FlushedCount 8510000 QueuedCount 49973 2016-03-24T08:15:20.343+05:30 [Info] logWriterStat:: 0 FlushedCount 8520000 QueuedCount 49979 2016-03-24T08:15:20.409+05:30 [Info] logWriterStat:: 0 FlushedCount 8530000 QueuedCount 48637 2016-03-24T08:15:20.488+05:30 [Info] logWriterStat:: 0 FlushedCount 8540000 QueuedCount 49986 2016-03-24T08:15:20.567+05:30 [Info] logWriterStat:: 0 FlushedCount 8550000 QueuedCount 49962 2016-03-24T08:15:20.677+05:30 [Info] logWriterStat:: 0 FlushedCount 8560000 QueuedCount 49951 2016-03-24T08:15:20.755+05:30 [Info] logWriterStat:: 0 FlushedCount 8570000 QueuedCount 49858 2016-03-24T08:15:20.834+05:30 [Info] logWriterStat:: 0 FlushedCount 8580000 QueuedCount 49968 2016-03-24T08:15:20.912+05:30 [Info] logWriterStat:: 0 FlushedCount 8590000 QueuedCount 49957 2016-03-24T08:15:20.991+05:30 [Info] logWriterStat:: 0 FlushedCount 8600000 QueuedCount 49955 2016-03-24T08:15:21.078+05:30 [Info] logWriterStat:: 0 FlushedCount 8610000 QueuedCount 49965 2016-03-24T08:15:21.154+05:30 [Info] logWriterStat:: 0 FlushedCount 8620000 QueuedCount 49951 2016-03-24T08:15:21.239+05:30 [Info] logWriterStat:: 0 FlushedCount 8630000 QueuedCount 49970 2016-03-24T08:15:21.318+05:30 [Info] logWriterStat:: 0 FlushedCount 8640000 QueuedCount 49952 2016-03-24T08:15:21.397+05:30 [Info] logWriterStat:: 0 FlushedCount 8650000 QueuedCount 49951 2016-03-24T08:15:21.493+05:30 [Info] logWriterStat:: 0 FlushedCount 8660000 QueuedCount 49993 2016-03-24T08:15:21.571+05:30 [Info] logWriterStat:: 0 FlushedCount 8670000 QueuedCount 49916 2016-03-24T08:15:21.653+05:30 [Info] logWriterStat:: 0 FlushedCount 8680000 QueuedCount 49989 2016-03-24T08:15:21.731+05:30 [Info] logWriterStat:: 0 FlushedCount 8690000 QueuedCount 49915 2016-03-24T08:15:21.81+05:30 [Info] logWriterStat:: 0 FlushedCount 8700000 QueuedCount 49950 2016-03-24T08:15:21.889+05:30 [Info] logWriterStat:: 0 FlushedCount 8710000 QueuedCount 49949 2016-03-24T08:15:21.967+05:30 [Info] logWriterStat:: 0 FlushedCount 8720000 QueuedCount 49923 2016-03-24T08:15:22.035+05:30 [Info] logWriterStat:: 0 FlushedCount 8730000 QueuedCount 49911 2016-03-24T08:15:22.124+05:30 [Info] logWriterStat:: 0 FlushedCount 8740000 QueuedCount 49966 2016-03-24T08:15:22.205+05:30 [Info] logWriterStat:: 0 FlushedCount 8750000 QueuedCount 49800 2016-03-24T08:15:22.278+05:30 [Info] logWriterStat:: 0 FlushedCount 8760000 QueuedCount 48105 2016-03-24T08:15:22.347+05:30 [Info] logWriterStat:: 0 FlushedCount 8770000 QueuedCount 43308 2016-03-24T08:15:22.43+05:30 [Info] logWriterStat:: 0 FlushedCount 8780000 QueuedCount 49988 2016-03-24T08:15:22.51+05:30 [Info] logWriterStat:: 0 FlushedCount 8790000 QueuedCount 49871 2016-03-24T08:15:22.594+05:30 [Info] logWriterStat:: 0 FlushedCount 8800000 QueuedCount 49970 2016-03-24T08:15:22.671+05:30 [Info] logWriterStat:: 0 FlushedCount 8810000 QueuedCount 49942 2016-03-24T08:15:22.748+05:30 [Info] logWriterStat:: 0 FlushedCount 8820000 QueuedCount 49937 2016-03-24T08:15:22.824+05:30 [Info] logWriterStat:: 0 FlushedCount 8830000 QueuedCount 49993 2016-03-24T08:15:22.901+05:30 [Info] logWriterStat:: 0 FlushedCount 8840000 QueuedCount 49979 2016-03-24T08:15:22.98+05:30 [Info] logWriterStat:: 0 FlushedCount 8850000 QueuedCount 49946 2016-03-24T08:15:23.065+05:30 [Info] logWriterStat:: 0 FlushedCount 8860000 QueuedCount 49945 2016-03-24T08:15:23.144+05:30 [Info] logWriterStat:: 0 FlushedCount 8870000 QueuedCount 49968 2016-03-24T08:15:23.211+05:30 [Info] logWriterStat:: 0 FlushedCount 8880000 QueuedCount 45856 2016-03-24T08:15:23.292+05:30 [Info] logWriterStat:: 0 FlushedCount 8890000 QueuedCount 49951 2016-03-24T08:15:23.367+05:30 [Info] logWriterStat:: 0 FlushedCount 8900000 QueuedCount 49987 2016-03-24T08:15:23.451+05:30 [Info] logWriterStat:: 0 FlushedCount 8910000 QueuedCount 49976 2016-03-24T08:15:23.528+05:30 [Info] logWriterStat:: 0 FlushedCount 8920000 QueuedCount 49592 2016-03-24T08:15:23.594+05:30 [Info] logWriterStat:: 0 FlushedCount 8930000 QueuedCount 44154 2016-03-24T08:15:23.67+05:30 [Info] logWriterStat:: 0 FlushedCount 8940000 QueuedCount 41812 2016-03-24T08:15:23.749+05:30 [Info] logWriterStat:: 0 FlushedCount 8950000 QueuedCount 49992 2016-03-24T08:15:23.823+05:30 [Info] logWriterStat:: 0 FlushedCount 8960000 QueuedCount 49942 2016-03-24T08:15:23.9+05:30 [Info] logWriterStat:: 0 FlushedCount 8970000 QueuedCount 49964 2016-03-24T08:15:23.978+05:30 [Info] logWriterStat:: 0 FlushedCount 8980000 QueuedCount 49965 2016-03-24T08:15:24.072+05:30 [Info] logWriterStat:: 0 FlushedCount 8990000 QueuedCount 49935 2016-03-24T08:15:24.152+05:30 [Info] logWriterStat:: 0 FlushedCount 9000000 QueuedCount 49858 2016-03-24T08:15:24.241+05:30 [Info] logWriterStat:: 0 FlushedCount 9010000 QueuedCount 49982 2016-03-24T08:15:24.321+05:30 [Info] logWriterStat:: 0 FlushedCount 9020000 QueuedCount 49985 2016-03-24T08:15:24.4+05:30 [Info] logWriterStat:: 0 FlushedCount 9030000 QueuedCount 49868 2016-03-24T08:15:24.48+05:30 [Info] logWriterStat:: 0 FlushedCount 9040000 QueuedCount 49947 2016-03-24T08:15:24.557+05:30 [Info] logWriterStat:: 0 FlushedCount 9050000 QueuedCount 49928 2016-03-24T08:15:24.635+05:30 [Info] logWriterStat:: 0 FlushedCount 9060000 QueuedCount 49941 2016-03-24T08:15:24.712+05:30 [Info] logWriterStat:: 0 FlushedCount 9070000 QueuedCount 49963 2016-03-24T08:15:24.788+05:30 [Info] logWriterStat:: 0 FlushedCount 9080000 QueuedCount 49976 2016-03-24T08:15:24.86+05:30 [Info] logWriterStat:: 0 FlushedCount 9090000 QueuedCount 49899 2016-03-24T08:15:24.928+05:30 [Info] logWriterStat:: 0 FlushedCount 9100000 QueuedCount 49865 2016-03-24T08:15:25.008+05:30 [Info] logWriterStat:: 0 FlushedCount 9110000 QueuedCount 49984 2016-03-24T08:15:25.095+05:30 [Info] logWriterStat:: 0 FlushedCount 9120000 QueuedCount 49887 2016-03-24T08:15:25.178+05:30 [Info] logWriterStat:: 0 FlushedCount 9130000 QueuedCount 49939 2016-03-24T08:15:25.263+05:30 [Info] logWriterStat:: 0 FlushedCount 9140000 QueuedCount 49942 2016-03-24T08:15:25.339+05:30 [Info] logWriterStat:: 0 FlushedCount 9150000 QueuedCount 49908 2016-03-24T08:15:25.419+05:30 [Info] logWriterStat:: 0 FlushedCount 9160000 QueuedCount 49963 2016-03-24T08:15:25.498+05:30 [Info] logWriterStat:: 0 FlushedCount 9170000 QueuedCount 49914 2016-03-24T08:15:25.577+05:30 [Info] logWriterStat:: 0 FlushedCount 9180000 QueuedCount 49991 2016-03-24T08:15:25.654+05:30 [Info] logWriterStat:: 0 FlushedCount 9190000 QueuedCount 49949 2016-03-24T08:15:25.732+05:30 [Info] logWriterStat:: 0 FlushedCount 9200000 QueuedCount 49901 2016-03-24T08:15:25.812+05:30 [Info] logWriterStat:: 0 FlushedCount 9210000 QueuedCount 49864 2016-03-24T08:15:25.893+05:30 [Info] logWriterStat:: 0 FlushedCount 9220000 QueuedCount 49966 2016-03-24T08:15:25.97+05:30 [Info] logWriterStat:: 0 FlushedCount 9230000 QueuedCount 49930 2016-03-24T08:15:26.047+05:30 [Info] logWriterStat:: 0 FlushedCount 9240000 QueuedCount 49999 2016-03-24T08:15:26.135+05:30 [Info] logWriterStat:: 0 FlushedCount 9250000 QueuedCount 49972 2016-03-24T08:15:26.215+05:30 [Info] logWriterStat:: 0 FlushedCount 9260000 QueuedCount 49862 2016-03-24T08:15:26.296+05:30 [Info] logWriterStat:: 0 FlushedCount 9270000 QueuedCount 49904 2016-03-24T08:15:26.375+05:30 [Info] logWriterStat:: 0 FlushedCount 9280000 QueuedCount 49992 2016-03-24T08:15:26.447+05:30 [Info] logWriterStat:: 0 FlushedCount 9290000 QueuedCount 48033 2016-03-24T08:15:26.543+05:30 [Info] logWriterStat:: 0 FlushedCount 9300000 QueuedCount 49982 2016-03-24T08:15:26.624+05:30 [Info] logWriterStat:: 0 FlushedCount 9310000 QueuedCount 49950 2016-03-24T08:15:26.703+05:30 [Info] logWriterStat:: 0 FlushedCount 9320000 QueuedCount 49887 2016-03-24T08:15:26.779+05:30 [Info] logWriterStat:: 0 FlushedCount 9330000 QueuedCount 49983 2016-03-24T08:15:26.859+05:30 [Info] logWriterStat:: 0 FlushedCount 9340000 QueuedCount 49975 2016-03-24T08:15:26.937+05:30 [Info] logWriterStat:: 0 FlushedCount 9350000 QueuedCount 49921 2016-03-24T08:15:27.014+05:30 [Info] logWriterStat:: 0 FlushedCount 9360000 QueuedCount 49978 2016-03-24T08:15:27.099+05:30 [Info] logWriterStat:: 0 FlushedCount 9370000 QueuedCount 49983 2016-03-24T08:15:27.179+05:30 [Info] logWriterStat:: 0 FlushedCount 9380000 QueuedCount 49524 2016-03-24T08:15:27.266+05:30 [Info] logWriterStat:: 0 FlushedCount 9390000 QueuedCount 49966 2016-03-24T08:15:27.35+05:30 [Info] logWriterStat:: 0 FlushedCount 9400000 QueuedCount 49910 2016-03-24T08:15:27.427+05:30 [Info] logWriterStat:: 0 FlushedCount 9410000 QueuedCount 49397 2016-03-24T08:15:27.505+05:30 [Info] logWriterStat:: 0 FlushedCount 9420000 QueuedCount 47860 2016-03-24T08:15:27.586+05:30 [Info] logWriterStat:: 0 FlushedCount 9430000 QueuedCount 46273 2016-03-24T08:15:27.665+05:30 [Info] logWriterStat:: 0 FlushedCount 9440000 QueuedCount 44834 2016-03-24T08:15:27.74+05:30 [Info] logWriterStat:: 0 FlushedCount 9450000 QueuedCount 43659 2016-03-24T08:15:27.817+05:30 [Info] logWriterStat:: 0 FlushedCount 9460000 QueuedCount 43731 2016-03-24T08:15:27.894+05:30 [Info] logWriterStat:: 0 FlushedCount 9470000 QueuedCount 43682 2016-03-24T08:15:27.974+05:30 [Info] logWriterStat:: 0 FlushedCount 9480000 QueuedCount 43739 2016-03-24T08:15:28.064+05:30 [Info] logWriterStat:: 0 FlushedCount 9490000 QueuedCount 43744 2016-03-24T08:15:28.146+05:30 [Info] logWriterStat:: 0 FlushedCount 9500000 QueuedCount 43629 2016-03-24T08:15:28.221+05:30 [Info] logWriterStat:: 0 FlushedCount 9510000 QueuedCount 43714 2016-03-24T08:15:28.3+05:30 [Info] logWriterStat:: 0 FlushedCount 9520000 QueuedCount 43664 2016-03-24T08:15:28.381+05:30 [Info] logWriterStat:: 0 FlushedCount 9530000 QueuedCount 43726 2016-03-24T08:15:28.462+05:30 [Info] logWriterStat:: 0 FlushedCount 9540000 QueuedCount 43721 2016-03-24T08:15:28.542+05:30 [Info] logWriterStat:: 0 FlushedCount 9550000 QueuedCount 43679 2016-03-24T08:15:28.618+05:30 [Info] logWriterStat:: 0 FlushedCount 9560000 QueuedCount 43694 2016-03-24T08:15:28.693+05:30 [Info] logWriterStat:: 0 FlushedCount 9570000 QueuedCount 43357 2016-03-24T08:15:28.769+05:30 [Info] logWriterStat:: 0 FlushedCount 9580000 QueuedCount 43733 2016-03-24T08:15:28.843+05:30 [Info] logWriterStat:: 0 FlushedCount 9590000 QueuedCount 43709 2016-03-24T08:15:28.92+05:30 [Info] logWriterStat:: 0 FlushedCount 9600000 QueuedCount 43365 2016-03-24T08:15:29.001+05:30 [Info] logWriterStat:: 0 FlushedCount 9610000 QueuedCount 42692 2016-03-24T08:15:29.089+05:30 [Info] logWriterStat:: 0 FlushedCount 9620000 QueuedCount 41249 2016-03-24T08:15:29.167+05:30 [Info] logWriterStat:: 0 FlushedCount 9630000 QueuedCount 39656 2016-03-24T08:15:29.254+05:30 [Info] logWriterStat:: 0 FlushedCount 9640000 QueuedCount 37735 2016-03-24T08:15:29.336+05:30 [Info] logWriterStat:: 0 FlushedCount 9650000 QueuedCount 36299 2016-03-24T08:15:29.417+05:30 [Info] logWriterStat:: 0 FlushedCount 9660000 QueuedCount 35352 2016-03-24T08:15:29.499+05:30 [Info] logWriterStat:: 0 FlushedCount 9670000 QueuedCount 34669 2016-03-24T08:15:29.578+05:30 [Info] logWriterStat:: 0 FlushedCount 9680000 QueuedCount 34319 2016-03-24T08:15:29.656+05:30 [Info] logWriterStat:: 0 FlushedCount 9690000 QueuedCount 34361 2016-03-24T08:15:29.738+05:30 [Info] logWriterStat:: 0 FlushedCount 9700000 QueuedCount 34279 2016-03-24T08:15:29.818+05:30 [Info] logWriterStat:: 0 FlushedCount 9710000 QueuedCount 34282 2016-03-24T08:15:29.892+05:30 [Info] logWriterStat:: 0 FlushedCount 9720000 QueuedCount 34336 2016-03-24T08:15:29.969+05:30 [Info] logWriterStat:: 0 FlushedCount 9730000 QueuedCount 33745 2016-03-24T08:15:30.042+05:30 [Info] logWriterStat:: 0 FlushedCount 9740000 QueuedCount 33028 2016-03-24T08:15:30.165+05:30 [Info] logWriterStat:: 0 FlushedCount 9750000 QueuedCount 32336 2016-03-24T08:15:30.246+05:30 [Info] logWriterStat:: 0 FlushedCount 9760000 QueuedCount 31435 2016-03-24T08:15:30.322+05:30 [Info] logWriterStat:: 0 FlushedCount 9770000 QueuedCount 31235 2016-03-24T08:15:30.394+05:30 [Info] logWriterStat:: 0 FlushedCount 9780000 QueuedCount 31229 2016-03-24T08:15:30.471+05:30 [Info] logWriterStat:: 0 FlushedCount 9790000 QueuedCount 31041 2016-03-24T08:15:30.543+05:30 [Info] logWriterStat:: 0 FlushedCount 9800000 QueuedCount 29481 2016-03-24T08:15:30.613+05:30 [Info] logWriterStat:: 0 FlushedCount 9810000 QueuedCount 27743 2016-03-24T08:15:30.686+05:30 [Info] logWriterStat:: 0 FlushedCount 9820000 QueuedCount 25749 2016-03-24T08:15:30.759+05:30 [Info] logWriterStat:: 0 FlushedCount 9830000 QueuedCount 24951 2016-03-24T08:15:30.828+05:30 [Info] logWriterStat:: 0 FlushedCount 9840000 QueuedCount 24753 2016-03-24T08:15:30.894+05:30 [Info] logWriterStat:: 0 FlushedCount 9850000 QueuedCount 24963 2016-03-24T08:15:30.962+05:30 [Info] logWriterStat:: 0 FlushedCount 9860000 QueuedCount 24985 2016-03-24T08:15:31.029+05:30 [Info] logWriterStat:: 0 FlushedCount 9870000 QueuedCount 24945 2016-03-24T08:15:31.109+05:30 [Info] logWriterStat:: 0 FlushedCount 9880000 QueuedCount 24937 2016-03-24T08:15:31.177+05:30 [Info] logWriterStat:: 0 FlushedCount 9890000 QueuedCount 24763 2016-03-24T08:15:31.247+05:30 [Info] logWriterStat:: 0 FlushedCount 9900000 QueuedCount 23221 2016-03-24T08:15:31.318+05:30 [Info] logWriterStat:: 0 FlushedCount 9910000 QueuedCount 21871 2016-03-24T08:15:31.389+05:30 [Info] logWriterStat:: 0 FlushedCount 9920000 QueuedCount 21832 2016-03-24T08:15:31.46+05:30 [Info] logWriterStat:: 0 FlushedCount 9930000 QueuedCount 19030 2016-03-24T08:15:31.528+05:30 [Info] logWriterStat:: 0 FlushedCount 9940000 QueuedCount 13667 2016-03-24T08:15:31.601+05:30 [Info] logWriterStat:: 0 FlushedCount 9950000 QueuedCount 9401 2016-03-24T08:15:31.671+05:30 [Info] logWriterStat:: 0 FlushedCount 9960000 QueuedCount 9356 2016-03-24T08:15:31.738+05:30 [Info] logWriterStat:: 0 FlushedCount 9970000 QueuedCount 8931 2016-03-24T08:15:31.806+05:30 [Info] logWriterStat:: 0 FlushedCount 9980000 QueuedCount 9348 2016-03-24T08:15:31.874+05:30 [Info] logWriterStat:: 0 FlushedCount 9990000 QueuedCount 6902 2016-03-24T08:15:31.975+05:30 [Info] logWriterStat:: 0 FlushedCount 10000000 QueuedCount 0 2016-03-24T08:15:31.975+05:30 [Info] MemDBSlice::OpenSnapshot SliceId 0 IndexInstId 0 Creating New Snapshot SnapshotInfo: count:10000000 committed:false 2016-03-24T08:15:32.092+05:30 [Info] logWriterStat:: 0 FlushedCount 10010000 QueuedCount 48114 2016-03-24T08:15:32.185+05:30 [Info] logWriterStat:: 0 FlushedCount 10020000 QueuedCount 49788 2016-03-24T08:15:32.288+05:30 [Info] logWriterStat:: 0 FlushedCount 10030000 QueuedCount 49853 2016-03-24T08:15:32.392+05:30 [Info] logWriterStat:: 0 FlushedCount 10040000 QueuedCount 49903 2016-03-24T08:15:32.488+05:30 [Info] logWriterStat:: 0 FlushedCount 10050000 QueuedCount 49908 2016-03-24T08:15:32.588+05:30 [Info] logWriterStat:: 0 FlushedCount 10060000 QueuedCount 49850 2016-03-24T08:15:32.681+05:30 [Info] logWriterStat:: 0 FlushedCount 10070000 QueuedCount 48549 2016-03-24T08:15:32.777+05:30 [Info] logWriterStat:: 0 FlushedCount 10080000 QueuedCount 48238 2016-03-24T08:15:32.865+05:30 [Info] logWriterStat:: 0 FlushedCount 10090000 QueuedCount 47967 2016-03-24T08:15:32.968+05:30 [Info] logWriterStat:: 0 FlushedCount 10100000 QueuedCount 47524 2016-03-24T08:15:33.072+05:30 [Info] logWriterStat:: 0 FlushedCount 10110000 QueuedCount 48112 2016-03-24T08:15:33.175+05:30 [Info] logWriterStat:: 0 FlushedCount 10120000 QueuedCount 48473 2016-03-24T08:15:33.632+05:30 [Info] logWriterStat:: 0 FlushedCount 10130000 QueuedCount 49971 2016-03-24T08:15:34.084+05:30 [Info] logWriterStat:: 0 FlushedCount 10140000 QueuedCount 47469 2016-03-24T08:15:34.414+05:30 [Info] logWriterStat:: 0 FlushedCount 10150000 QueuedCount 45211 2016-03-24T08:15:34.714+05:30 [Info] logWriterStat:: 0 FlushedCount 10160000 QueuedCount 44038 2016-03-24T08:15:34.837+05:30 [Info] logWriterStat:: 0 FlushedCount 10170000 QueuedCount 49883 2016-03-24T08:15:34.963+05:30 [Info] logWriterStat:: 0 FlushedCount 10180000 QueuedCount 49947 2016-03-24T08:15:35.103+05:30 [Info] logWriterStat:: 0 FlushedCount 10190000 QueuedCount 49955 2016-03-24T08:15:35.255+05:30 [Info] logWriterStat:: 0 FlushedCount 10200000 QueuedCount 49995 2016-03-24T08:15:35.394+05:30 [Info] logWriterStat:: 0 FlushedCount 10210000 QueuedCount 49999 2016-03-24T08:15:35.517+05:30 [Info] logWriterStat:: 0 FlushedCount 10220000 QueuedCount 49833 2016-03-24T08:15:35.634+05:30 [Info] logWriterStat:: 0 FlushedCount 10230000 QueuedCount 49959 2016-03-24T08:15:35.767+05:30 [Info] logWriterStat:: 0 FlushedCount 10240000 QueuedCount 49952 2016-03-24T08:15:35.908+05:30 [Info] logWriterStat:: 0 FlushedCount 10250000 QueuedCount 49969 2016-03-24T08:15:36.035+05:30 [Info] logWriterStat:: 0 FlushedCount 10260000 QueuedCount 49943 2016-03-24T08:15:36.163+05:30 [Info] logWriterStat:: 0 FlushedCount 10270000 QueuedCount 49985 2016-03-24T08:15:36.296+05:30 [Info] logWriterStat:: 0 FlushedCount 10280000 QueuedCount 49804 2016-03-24T08:15:36.414+05:30 [Info] logWriterStat:: 0 FlushedCount 10290000 QueuedCount 49883 2016-03-24T08:15:36.498+05:30 [Info] logWriterStat:: 0 FlushedCount 10300000 QueuedCount 49963 2016-03-24T08:15:36.595+05:30 [Info] logWriterStat:: 0 FlushedCount 10310000 QueuedCount 49944 2016-03-24T08:15:36.681+05:30 [Info] logWriterStat:: 0 FlushedCount 10320000 QueuedCount 49875 2016-03-24T08:15:36.77+05:30 [Info] logWriterStat:: 0 FlushedCount 10330000 QueuedCount 49946 2016-03-24T08:15:36.854+05:30 [Info] logWriterStat:: 0 FlushedCount 10340000 QueuedCount 49963 2016-03-24T08:15:36.944+05:30 [Info] logWriterStat:: 0 FlushedCount 10350000 QueuedCount 49978 2016-03-24T08:15:37.029+05:30 [Info] logWriterStat:: 0 FlushedCount 10360000 QueuedCount 49899 2016-03-24T08:15:37.123+05:30 [Info] logWriterStat:: 0 FlushedCount 10370000 QueuedCount 49908 2016-03-24T08:15:37.21+05:30 [Info] logWriterStat:: 0 FlushedCount 10380000 QueuedCount 49985 2016-03-24T08:15:37.296+05:30 [Info] logWriterStat:: 0 FlushedCount 10390000 QueuedCount 49927 2016-03-24T08:15:37.383+05:30 [Info] logWriterStat:: 0 FlushedCount 10400000 QueuedCount 49979 2016-03-24T08:15:37.47+05:30 [Info] logWriterStat:: 0 FlushedCount 10410000 QueuedCount 49961 2016-03-24T08:15:37.557+05:30 [Info] logWriterStat:: 0 FlushedCount 10420000 QueuedCount 49985 2016-03-24T08:15:37.646+05:30 [Info] logWriterStat:: 0 FlushedCount 10430000 QueuedCount 49989 2016-03-24T08:15:37.732+05:30 [Info] logWriterStat:: 0 FlushedCount 10440000 QueuedCount 49919 2016-03-24T08:15:37.818+05:30 [Info] logWriterStat:: 0 FlushedCount 10450000 QueuedCount 49880 2016-03-24T08:15:37.901+05:30 [Info] logWriterStat:: 0 FlushedCount 10460000 QueuedCount 49572 2016-03-24T08:15:37.985+05:30 [Info] logWriterStat:: 0 FlushedCount 10470000 QueuedCount 49937 2016-03-24T08:15:38.079+05:30 [Info] logWriterStat:: 0 FlushedCount 10480000 QueuedCount 49971 2016-03-24T08:15:38.164+05:30 [Info] logWriterStat:: 0 FlushedCount 10490000 QueuedCount 49925 2016-03-24T08:15:38.255+05:30 [Info] logWriterStat:: 0 FlushedCount 10500000 QueuedCount 49979 2016-03-24T08:15:38.342+05:30 [Info] logWriterStat:: 0 FlushedCount 10510000 QueuedCount 49428 2016-03-24T08:15:38.43+05:30 [Info] logWriterStat:: 0 FlushedCount 10520000 QueuedCount 49947 2016-03-24T08:15:38.522+05:30 [Info] logWriterStat:: 0 FlushedCount 10530000 QueuedCount 49902 2016-03-24T08:15:38.605+05:30 [Info] logWriterStat:: 0 FlushedCount 10540000 QueuedCount 49914 2016-03-24T08:15:38.69+05:30 [Info] logWriterStat:: 0 FlushedCount 10550000 QueuedCount 49925 2016-03-24T08:15:38.775+05:30 [Info] logWriterStat:: 0 FlushedCount 10560000 QueuedCount 49959 2016-03-24T08:15:38.859+05:30 [Info] logWriterStat:: 0 FlushedCount 10570000 QueuedCount 49969 2016-03-24T08:15:38.94+05:30 [Info] logWriterStat:: 0 FlushedCount 10580000 QueuedCount 49986 2016-03-24T08:15:39.026+05:30 [Info] logWriterStat:: 0 FlushedCount 10590000 QueuedCount 49893 2016-03-24T08:15:39.121+05:30 [Info] logWriterStat:: 0 FlushedCount 10600000 QueuedCount 49911 2016-03-24T08:15:39.212+05:30 [Info] logWriterStat:: 0 FlushedCount 10610000 QueuedCount 49983 2016-03-24T08:15:39.311+05:30 [Info] logWriterStat:: 0 FlushedCount 10620000 QueuedCount 49362 2016-03-24T08:15:39.395+05:30 [Info] logWriterStat:: 0 FlushedCount 10630000 QueuedCount 49847 2016-03-24T08:15:39.475+05:30 [Info] logWriterStat:: 0 FlushedCount 10640000 QueuedCount 47555 2016-03-24T08:15:39.552+05:30 [Info] logWriterStat:: 0 FlushedCount 10650000 QueuedCount 41063 2016-03-24T08:15:39.637+05:30 [Info] logWriterStat:: 0 FlushedCount 10660000 QueuedCount 47663 2016-03-24T08:15:39.723+05:30 [Info] logWriterStat:: 0 FlushedCount 10670000 QueuedCount 49889 2016-03-24T08:15:39.809+05:30 [Info] logWriterStat:: 0 FlushedCount 10680000 QueuedCount 49925 2016-03-24T08:15:39.897+05:30 [Info] logWriterStat:: 0 FlushedCount 10690000 QueuedCount 49956 2016-03-24T08:15:39.982+05:30 [Info] logWriterStat:: 0 FlushedCount 10700000 QueuedCount 49997 2016-03-24T08:15:40.085+05:30 [Info] logWriterStat:: 0 FlushedCount 10710000 QueuedCount 49521 2016-03-24T08:15:40.194+05:30 [Info] logWriterStat:: 0 FlushedCount 10720000 QueuedCount 49901 2016-03-24T08:15:40.291+05:30 [Info] logWriterStat:: 0 FlushedCount 10730000 QueuedCount 49965 2016-03-24T08:15:40.38+05:30 [Info] logWriterStat:: 0 FlushedCount 10740000 QueuedCount 49907 2016-03-24T08:15:40.467+05:30 [Info] logWriterStat:: 0 FlushedCount 10750000 QueuedCount 49828 2016-03-24T08:15:40.554+05:30 [Info] logWriterStat:: 0 FlushedCount 10760000 QueuedCount 49982 2016-03-24T08:15:40.645+05:30 [Info] logWriterStat:: 0 FlushedCount 10770000 QueuedCount 49930 2016-03-24T08:15:40.727+05:30 [Info] logWriterStat:: 0 FlushedCount 10780000 QueuedCount 49925 2016-03-24T08:15:40.813+05:30 [Info] logWriterStat:: 0 FlushedCount 10790000 QueuedCount 49895 2016-03-24T08:15:40.894+05:30 [Info] logWriterStat:: 0 FlushedCount 10800000 QueuedCount 49965 2016-03-24T08:15:40.981+05:30 [Info] logWriterStat:: 0 FlushedCount 10810000 QueuedCount 49969 2016-03-24T08:15:41.078+05:30 [Info] logWriterStat:: 0 FlushedCount 10820000 QueuedCount 49931 2016-03-24T08:15:41.163+05:30 [Info] logWriterStat:: 0 FlushedCount 10830000 QueuedCount 49944 2016-03-24T08:15:41.249+05:30 [Info] logWriterStat:: 0 FlushedCount 10840000 QueuedCount 49906 2016-03-24T08:15:41.334+05:30 [Info] logWriterStat:: 0 FlushedCount 10850000 QueuedCount 49940 2016-03-24T08:15:41.42+05:30 [Info] logWriterStat:: 0 FlushedCount 10860000 QueuedCount 49979 2016-03-24T08:15:41.505+05:30 [Info] logWriterStat:: 0 FlushedCount 10870000 QueuedCount 49887 2016-03-24T08:15:41.599+05:30 [Info] logWriterStat:: 0 FlushedCount 10880000 QueuedCount 49992 2016-03-24T08:15:41.69+05:30 [Info] logWriterStat:: 0 FlushedCount 10890000 QueuedCount 48709 2016-03-24T08:15:41.776+05:30 [Info] logWriterStat:: 0 FlushedCount 10900000 QueuedCount 49955 2016-03-24T08:15:41.86+05:30 [Info] logWriterStat:: 0 FlushedCount 10910000 QueuedCount 49984 2016-03-24T08:15:41.941+05:30 [Info] logWriterStat:: 0 FlushedCount 10920000 QueuedCount 49973 2016-03-24T08:15:42.029+05:30 [Info] logWriterStat:: 0 FlushedCount 10930000 QueuedCount 49909 2016-03-24T08:15:42.116+05:30 [Info] logWriterStat:: 0 FlushedCount 10940000 QueuedCount 49132 2016-03-24T08:15:42.21+05:30 [Info] logWriterStat:: 0 FlushedCount 10950000 QueuedCount 49979 2016-03-24T08:15:42.291+05:30 [Info] logWriterStat:: 0 FlushedCount 10960000 QueuedCount 49893 2016-03-24T08:15:42.379+05:30 [Info] logWriterStat:: 0 FlushedCount 10970000 QueuedCount 49985 2016-03-24T08:15:42.466+05:30 [Info] logWriterStat:: 0 FlushedCount 10980000 QueuedCount 49988 2016-03-24T08:15:42.554+05:30 [Info] logWriterStat:: 0 FlushedCount 10990000 QueuedCount 49852 2016-03-24T08:15:42.645+05:30 [Info] logWriterStat:: 0 FlushedCount 11000000 QueuedCount 49968 2016-03-24T08:15:42.733+05:30 [Info] logWriterStat:: 0 FlushedCount 11010000 QueuedCount 49921 2016-03-24T08:15:42.82+05:30 [Info] logWriterStat:: 0 FlushedCount 11020000 QueuedCount 49990 2016-03-24T08:15:42.905+05:30 [Info] logWriterStat:: 0 FlushedCount 11030000 QueuedCount 49957 2016-03-24T08:15:42.992+05:30 [Info] logWriterStat:: 0 FlushedCount 11040000 QueuedCount 49983 2016-03-24T08:15:43.089+05:30 [Info] logWriterStat:: 0 FlushedCount 11050000 QueuedCount 49992 2016-03-24T08:15:43.175+05:30 [Info] logWriterStat:: 0 FlushedCount 11060000 QueuedCount 49920 2016-03-24T08:15:43.257+05:30 [Info] logWriterStat:: 0 FlushedCount 11070000 QueuedCount 47806 2016-03-24T08:15:43.349+05:30 [Info] logWriterStat:: 0 FlushedCount 11080000 QueuedCount 49904 2016-03-24T08:15:43.44+05:30 [Info] logWriterStat:: 0 FlushedCount 11090000 QueuedCount 49975 2016-03-24T08:15:43.53+05:30 [Info] logWriterStat:: 0 FlushedCount 11100000 QueuedCount 49956 2016-03-24T08:15:43.619+05:30 [Info] logWriterStat:: 0 FlushedCount 11110000 QueuedCount 49903 2016-03-24T08:15:43.705+05:30 [Info] logWriterStat:: 0 FlushedCount 11120000 QueuedCount 49966 2016-03-24T08:15:43.792+05:30 [Info] logWriterStat:: 0 FlushedCount 11130000 QueuedCount 49979 2016-03-24T08:15:43.877+05:30 [Info] logWriterStat:: 0 FlushedCount 11140000 QueuedCount 49915 2016-03-24T08:15:43.957+05:30 [Info] logWriterStat:: 0 FlushedCount 11150000 QueuedCount 49963 2016-03-24T08:15:44.043+05:30 [Info] logWriterStat:: 0 FlushedCount 11160000 QueuedCount 49969 2016-03-24T08:15:44.146+05:30 [Info] logWriterStat:: 0 FlushedCount 11170000 QueuedCount 49950 2016-03-24T08:15:44.239+05:30 [Info] logWriterStat:: 0 FlushedCount 11180000 QueuedCount 49941 2016-03-24T08:15:44.326+05:30 [Info] logWriterStat:: 0 FlushedCount 11190000 QueuedCount 49948 2016-03-24T08:15:44.414+05:30 [Info] logWriterStat:: 0 FlushedCount 11200000 QueuedCount 49772 2016-03-24T08:15:44.498+05:30 [Info] logWriterStat:: 0 FlushedCount 11210000 QueuedCount 49993 2016-03-24T08:15:44.585+05:30 [Info] logWriterStat:: 0 FlushedCount 11220000 QueuedCount 49919 2016-03-24T08:15:44.671+05:30 [Info] logWriterStat:: 0 FlushedCount 11230000 QueuedCount 49962 2016-03-24T08:15:44.757+05:30 [Info] logWriterStat:: 0 FlushedCount 11240000 QueuedCount 49908 2016-03-24T08:15:44.838+05:30 [Info] logWriterStat:: 0 FlushedCount 11250000 QueuedCount 49976 2016-03-24T08:15:44.924+05:30 [Info] logWriterStat:: 0 FlushedCount 11260000 QueuedCount 49497 2016-03-24T08:15:45.005+05:30 [Info] logWriterStat:: 0 FlushedCount 11270000 QueuedCount 49957 2016-03-24T08:15:45.096+05:30 [Info] logWriterStat:: 0 FlushedCount 11280000 QueuedCount 48815 2016-03-24T08:15:45.185+05:30 [Info] logWriterStat:: 0 FlushedCount 11290000 QueuedCount 49940 2016-03-24T08:15:45.287+05:30 [Info] logWriterStat:: 0 FlushedCount 11300000 QueuedCount 49968 2016-03-24T08:15:45.381+05:30 [Info] logWriterStat:: 0 FlushedCount 11310000 QueuedCount 49990 2016-03-24T08:15:45.464+05:30 [Info] logWriterStat:: 0 FlushedCount 11320000 QueuedCount 49915 2016-03-24T08:15:45.55+05:30 [Info] logWriterStat:: 0 FlushedCount 11330000 QueuedCount 49931 2016-03-24T08:15:45.638+05:30 [Info] logWriterStat:: 0 FlushedCount 11340000 QueuedCount 49974 2016-03-24T08:15:45.724+05:30 [Info] logWriterStat:: 0 FlushedCount 11350000 QueuedCount 49983 2016-03-24T08:15:45.81+05:30 [Info] logWriterStat:: 0 FlushedCount 11360000 QueuedCount 49920 2016-03-24T08:15:45.895+05:30 [Info] logWriterStat:: 0 FlushedCount 11370000 QueuedCount 49946 2016-03-24T08:15:45.981+05:30 [Info] logWriterStat:: 0 FlushedCount 11380000 QueuedCount 49415 2016-03-24T08:15:46.078+05:30 [Info] logWriterStat:: 0 FlushedCount 11390000 QueuedCount 49938 2016-03-24T08:15:46.164+05:30 [Info] logWriterStat:: 0 FlushedCount 11400000 QueuedCount 49612 2016-03-24T08:15:46.248+05:30 [Info] logWriterStat:: 0 FlushedCount 11410000 QueuedCount 49880 2016-03-24T08:15:46.342+05:30 [Info] logWriterStat:: 0 FlushedCount 11420000 QueuedCount 49929 2016-03-24T08:15:46.429+05:30 [Info] logWriterStat:: 0 FlushedCount 11430000 QueuedCount 49918 2016-03-24T08:15:46.502+05:30 [Info] logWriterStat:: 0 FlushedCount 11440000 QueuedCount 47032 2016-03-24T08:15:46.592+05:30 [Info] logWriterStat:: 0 FlushedCount 11450000 QueuedCount 49970 2016-03-24T08:15:46.695+05:30 [Info] logWriterStat:: 0 FlushedCount 11460000 QueuedCount 49950 2016-03-24T08:15:46.775+05:30 [Info] logWriterStat:: 0 FlushedCount 11470000 QueuedCount 48748 2016-03-24T08:15:46.856+05:30 [Info] logWriterStat:: 0 FlushedCount 11480000 QueuedCount 49957 2016-03-24T08:15:46.936+05:30 [Info] logWriterStat:: 0 FlushedCount 11490000 QueuedCount 49931 2016-03-24T08:15:47.023+05:30 [Info] logWriterStat:: 0 FlushedCount 11500000 QueuedCount 49943 2016-03-24T08:15:47.119+05:30 [Info] logWriterStat:: 0 FlushedCount 11510000 QueuedCount 49976 2016-03-24T08:15:47.209+05:30 [Info] logWriterStat:: 0 FlushedCount 11520000 QueuedCount 49954 2016-03-24T08:15:47.301+05:30 [Info] logWriterStat:: 0 FlushedCount 11530000 QueuedCount 49990 2016-03-24T08:15:47.387+05:30 [Info] logWriterStat:: 0 FlushedCount 11540000 QueuedCount 49993 2016-03-24T08:15:47.467+05:30 [Info] logWriterStat:: 0 FlushedCount 11550000 QueuedCount 49959 2016-03-24T08:15:47.554+05:30 [Info] logWriterStat:: 0 FlushedCount 11560000 QueuedCount 49942 2016-03-24T08:15:47.642+05:30 [Info] logWriterStat:: 0 FlushedCount 11570000 QueuedCount 49838 2016-03-24T08:15:47.728+05:30 [Info] logWriterStat:: 0 FlushedCount 11580000 QueuedCount 49965 2016-03-24T08:15:47.814+05:30 [Info] logWriterStat:: 0 FlushedCount 11590000 QueuedCount 49930 2016-03-24T08:15:47.901+05:30 [Info] logWriterStat:: 0 FlushedCount 11600000 QueuedCount 49932 2016-03-24T08:15:47.986+05:30 [Info] logWriterStat:: 0 FlushedCount 11610000 QueuedCount 49971 2016-03-24T08:15:48.084+05:30 [Info] logWriterStat:: 0 FlushedCount 11620000 QueuedCount 49988 2016-03-24T08:15:48.171+05:30 [Info] logWriterStat:: 0 FlushedCount 11630000 QueuedCount 49982 2016-03-24T08:15:48.264+05:30 [Info] logWriterStat:: 0 FlushedCount 11640000 QueuedCount 49953 2016-03-24T08:15:48.347+05:30 [Info] logWriterStat:: 0 FlushedCount 11650000 QueuedCount 49919 2016-03-24T08:15:48.434+05:30 [Info] logWriterStat:: 0 FlushedCount 11660000 QueuedCount 49996 2016-03-24T08:15:48.526+05:30 [Info] logWriterStat:: 0 FlushedCount 11670000 QueuedCount 49985 2016-03-24T08:15:48.613+05:30 [Info] logWriterStat:: 0 FlushedCount 11680000 QueuedCount 49933 2016-03-24T08:15:48.704+05:30 [Info] logWriterStat:: 0 FlushedCount 11690000 QueuedCount 49965 2016-03-24T08:15:48.785+05:30 [Info] logWriterStat:: 0 FlushedCount 11700000 QueuedCount 49977 2016-03-24T08:15:48.876+05:30 [Info] logWriterStat:: 0 FlushedCount 11710000 QueuedCount 49961 2016-03-24T08:15:48.962+05:30 [Info] logWriterStat:: 0 FlushedCount 11720000 QueuedCount 49924 2016-03-24T08:15:49.047+05:30 [Info] logWriterStat:: 0 FlushedCount 11730000 QueuedCount 49974 2016-03-24T08:15:49.147+05:30 [Info] logWriterStat:: 0 FlushedCount 11740000 QueuedCount 49928 2016-03-24T08:15:49.249+05:30 [Info] logWriterStat:: 0 FlushedCount 11750000 QueuedCount 49993 2016-03-24T08:15:49.322+05:30 [Info] logWriterStat:: 0 FlushedCount 11760000 QueuedCount 48055 2016-03-24T08:15:49.412+05:30 [Info] logWriterStat:: 0 FlushedCount 11770000 QueuedCount 49969 2016-03-24T08:15:49.501+05:30 [Info] logWriterStat:: 0 FlushedCount 11780000 QueuedCount 49921 2016-03-24T08:15:49.588+05:30 [Info] logWriterStat:: 0 FlushedCount 11790000 QueuedCount 49963 2016-03-24T08:15:49.677+05:30 [Info] logWriterStat:: 0 FlushedCount 11800000 QueuedCount 49978 2016-03-24T08:15:49.764+05:30 [Info] logWriterStat:: 0 FlushedCount 11810000 QueuedCount 49943 2016-03-24T08:15:49.851+05:30 [Info] logWriterStat:: 0 FlushedCount 11820000 QueuedCount 49925 2016-03-24T08:15:49.936+05:30 [Info] logWriterStat:: 0 FlushedCount 11830000 QueuedCount 49978 2016-03-24T08:15:50.021+05:30 [Info] logWriterStat:: 0 FlushedCount 11840000 QueuedCount 49949 2016-03-24T08:15:50.153+05:30 [Info] logWriterStat:: 0 FlushedCount 11850000 QueuedCount 49844 2016-03-24T08:15:50.249+05:30 [Info] logWriterStat:: 0 FlushedCount 11860000 QueuedCount 49991 2016-03-24T08:15:50.344+05:30 [Info] logWriterStat:: 0 FlushedCount 11870000 QueuedCount 49953 2016-03-24T08:15:50.429+05:30 [Info] logWriterStat:: 0 FlushedCount 11880000 QueuedCount 49999 2016-03-24T08:15:50.518+05:30 [Info] logWriterStat:: 0 FlushedCount 11890000 QueuedCount 49897 2016-03-24T08:15:50.606+05:30 [Info] logWriterStat:: 0 FlushedCount 11900000 QueuedCount 49936 2016-03-24T08:15:50.693+05:30 [Info] logWriterStat:: 0 FlushedCount 11910000 QueuedCount 49976 2016-03-24T08:15:50.778+05:30 [Info] logWriterStat:: 0 FlushedCount 11920000 QueuedCount 49977 2016-03-24T08:15:50.862+05:30 [Info] logWriterStat:: 0 FlushedCount 11930000 QueuedCount 49965 2016-03-24T08:15:50.948+05:30 [Info] logWriterStat:: 0 FlushedCount 11940000 QueuedCount 49956 2016-03-24T08:15:51.029+05:30 [Info] logWriterStat:: 0 FlushedCount 11950000 QueuedCount 49954 2016-03-24T08:15:51.116+05:30 [Info] logWriterStat:: 0 FlushedCount 11960000 QueuedCount 49945 2016-03-24T08:15:51.201+05:30 [Info] logWriterStat:: 0 FlushedCount 11970000 QueuedCount 49942 2016-03-24T08:15:51.287+05:30 [Info] logWriterStat:: 0 FlushedCount 11980000 QueuedCount 49923 2016-03-24T08:15:51.369+05:30 [Info] logWriterStat:: 0 FlushedCount 11990000 QueuedCount 49981 2016-03-24T08:15:51.453+05:30 [Info] logWriterStat:: 0 FlushedCount 12000000 QueuedCount 49974 2016-03-24T08:15:51.53+05:30 [Info] logWriterStat:: 0 FlushedCount 12010000 QueuedCount 49872 2016-03-24T08:15:51.61+05:30 [Info] logWriterStat:: 0 FlushedCount 12020000 QueuedCount 49928 2016-03-24T08:15:51.711+05:30 [Info] logWriterStat:: 0 FlushedCount 12030000 QueuedCount 49907 2016-03-24T08:15:51.793+05:30 [Info] logWriterStat:: 0 FlushedCount 12040000 QueuedCount 49954 2016-03-24T08:15:51.873+05:30 [Info] logWriterStat:: 0 FlushedCount 12050000 QueuedCount 49565 2016-03-24T08:15:51.951+05:30 [Info] logWriterStat:: 0 FlushedCount 12060000 QueuedCount 49954 2016-03-24T08:15:52.029+05:30 [Info] logWriterStat:: 0 FlushedCount 12070000 QueuedCount 49973 2016-03-24T08:15:52.121+05:30 [Info] logWriterStat:: 0 FlushedCount 12080000 QueuedCount 49993 2016-03-24T08:15:52.203+05:30 [Info] logWriterStat:: 0 FlushedCount 12090000 QueuedCount 49934 2016-03-24T08:15:52.284+05:30 [Info] logWriterStat:: 0 FlushedCount 12100000 QueuedCount 49076 2016-03-24T08:15:52.364+05:30 [Info] logWriterStat:: 0 FlushedCount 12110000 QueuedCount 49968 2016-03-24T08:15:52.442+05:30 [Info] logWriterStat:: 0 FlushedCount 12120000 QueuedCount 49975 2016-03-24T08:15:52.524+05:30 [Info] logWriterStat:: 0 FlushedCount 12130000 QueuedCount 49919 2016-03-24T08:15:52.609+05:30 [Info] logWriterStat:: 0 FlushedCount 12140000 QueuedCount 49799 2016-03-24T08:15:52.681+05:30 [Info] logWriterStat:: 0 FlushedCount 12150000 QueuedCount 49979 2016-03-24T08:15:52.759+05:30 [Info] logWriterStat:: 0 FlushedCount 12160000 QueuedCount 49277 2016-03-24T08:15:52.837+05:30 [Info] logWriterStat:: 0 FlushedCount 12170000 QueuedCount 49998 2016-03-24T08:15:52.918+05:30 [Info] logWriterStat:: 0 FlushedCount 12180000 QueuedCount 49959 2016-03-24T08:15:53.001+05:30 [Info] logWriterStat:: 0 FlushedCount 12190000 QueuedCount 49868 2016-03-24T08:15:53.083+05:30 [Info] logWriterStat:: 0 FlushedCount 12200000 QueuedCount 49978 2016-03-24T08:15:53.159+05:30 [Info] logWriterStat:: 0 FlushedCount 12210000 QueuedCount 49930 2016-03-24T08:15:53.243+05:30 [Info] logWriterStat:: 0 FlushedCount 12220000 QueuedCount 49908 2016-03-24T08:15:53.322+05:30 [Info] logWriterStat:: 0 FlushedCount 12230000 QueuedCount 49881 2016-03-24T08:15:53.42+05:30 [Info] logWriterStat:: 0 FlushedCount 12240000 QueuedCount 49222 2016-03-24T08:15:53.496+05:30 [Info] logWriterStat:: 0 FlushedCount 12250000 QueuedCount 45339 2016-03-24T08:15:53.581+05:30 [Info] logWriterStat:: 0 FlushedCount 12260000 QueuedCount 49952 2016-03-24T08:15:53.661+05:30 [Info] logWriterStat:: 0 FlushedCount 12270000 QueuedCount 49796 2016-03-24T08:15:53.732+05:30 [Info] logWriterStat:: 0 FlushedCount 12280000 QueuedCount 49974 2016-03-24T08:15:53.812+05:30 [Info] logWriterStat:: 0 FlushedCount 12290000 QueuedCount 48599 2016-03-24T08:15:53.886+05:30 [Info] logWriterStat:: 0 FlushedCount 12300000 QueuedCount 45873 2016-03-24T08:15:53.962+05:30 [Info] logWriterStat:: 0 FlushedCount 12310000 QueuedCount 49921 2016-03-24T08:15:54.029+05:30 [Info] logWriterStat:: 0 FlushedCount 12320000 QueuedCount 45189 2016-03-24T08:15:54.112+05:30 [Info] logWriterStat:: 0 FlushedCount 12330000 QueuedCount 49978 2016-03-24T08:15:54.183+05:30 [Info] logWriterStat:: 0 FlushedCount 12340000 QueuedCount 45332 2016-03-24T08:15:54.278+05:30 [Info] logWriterStat:: 0 FlushedCount 12350000 QueuedCount 47417 2016-03-24T08:15:54.361+05:30 [Info] logWriterStat:: 0 FlushedCount 12360000 QueuedCount 47890 2016-03-24T08:15:54.449+05:30 [Info] logWriterStat:: 0 FlushedCount 12370000 QueuedCount 47264 2016-03-24T08:15:54.536+05:30 [Info] logWriterStat:: 0 FlushedCount 12380000 QueuedCount 48586 2016-03-24T08:15:54.623+05:30 [Info] logWriterStat:: 0 FlushedCount 12390000 QueuedCount 48151 2016-03-24T08:15:54.708+05:30 [Info] logWriterStat:: 0 FlushedCount 12400000 QueuedCount 47872 2016-03-24T08:15:54.794+05:30 [Info] logWriterStat:: 0 FlushedCount 12410000 QueuedCount 48242 2016-03-24T08:15:54.88+05:30 [Info] logWriterStat:: 0 FlushedCount 12420000 QueuedCount 47584 2016-03-24T08:15:54.963+05:30 [Info] logWriterStat:: 0 FlushedCount 12430000 QueuedCount 46916 2016-03-24T08:15:55.059+05:30 [Info] logWriterStat:: 0 FlushedCount 12440000 QueuedCount 48186 2016-03-24T08:15:55.146+05:30 [Info] logWriterStat:: 0 FlushedCount 12450000 QueuedCount 47834 2016-03-24T08:15:55.249+05:30 [Info] logWriterStat:: 0 FlushedCount 12460000 QueuedCount 48585 2016-03-24T08:15:55.335+05:30 [Info] logWriterStat:: 0 FlushedCount 12470000 QueuedCount 47456 2016-03-24T08:15:55.426+05:30 [Info] logWriterStat:: 0 FlushedCount 12480000 QueuedCount 47450 2016-03-24T08:15:55.516+05:30 [Info] logWriterStat:: 0 FlushedCount 12490000 QueuedCount 48235 2016-03-24T08:15:55.603+05:30 [Info] logWriterStat:: 0 FlushedCount 12500000 QueuedCount 47193 2016-03-24T08:15:55.694+05:30 [Info] logWriterStat:: 0 FlushedCount 12510000 QueuedCount 47974 2016-03-24T08:15:55.781+05:30 [Info] logWriterStat:: 0 FlushedCount 12520000 QueuedCount 47819 2016-03-24T08:15:55.87+05:30 [Info] logWriterStat:: 0 FlushedCount 12530000 QueuedCount 47813 2016-03-24T08:15:55.956+05:30 [Info] logWriterStat:: 0 FlushedCount 12540000 QueuedCount 47718 2016-03-24T08:15:56.043+05:30 [Info] logWriterStat:: 0 FlushedCount 12550000 QueuedCount 48374 2016-03-24T08:15:56.147+05:30 [Info] logWriterStat:: 0 FlushedCount 12560000 QueuedCount 49940 2016-03-24T08:15:56.242+05:30 [Info] logWriterStat:: 0 FlushedCount 12570000 QueuedCount 49947 2016-03-24T08:15:56.334+05:30 [Info] logWriterStat:: 0 FlushedCount 12580000 QueuedCount 49913 2016-03-24T08:15:56.427+05:30 [Info] logWriterStat:: 0 FlushedCount 12590000 QueuedCount 49908 2016-03-24T08:15:56.55+05:30 [Info] logWriterStat:: 0 FlushedCount 12600000 QueuedCount 49907 2016-03-24T08:15:56.656+05:30 [Info] logWriterStat:: 0 FlushedCount 12610000 QueuedCount 49903 2016-03-24T08:15:56.777+05:30 [Info] logWriterStat:: 0 FlushedCount 12620000 QueuedCount 49940 2016-03-24T08:15:56.875+05:30 [Info] logWriterStat:: 0 FlushedCount 12630000 QueuedCount 49918 2016-03-24T08:15:56.968+05:30 [Info] logWriterStat:: 0 FlushedCount 12640000 QueuedCount 49991 2016-03-24T08:15:57.074+05:30 [Info] logWriterStat:: 0 FlushedCount 12650000 QueuedCount 49948 2016-03-24T08:15:57.17+05:30 [Info] logWriterStat:: 0 FlushedCount 12660000 QueuedCount 49956 2016-03-24T08:15:57.272+05:30 [Info] logWriterStat:: 0 FlushedCount 12670000 QueuedCount 49941 2016-03-24T08:15:57.369+05:30 [Info] logWriterStat:: 0 FlushedCount 12680000 QueuedCount 49957 2016-03-24T08:15:57.462+05:30 [Info] logWriterStat:: 0 FlushedCount 12690000 QueuedCount 49959 2016-03-24T08:15:57.558+05:30 [Info] logWriterStat:: 0 FlushedCount 12700000 QueuedCount 49967 2016-03-24T08:15:57.656+05:30 [Info] logWriterStat:: 0 FlushedCount 12710000 QueuedCount 49902 2016-03-24T08:15:57.754+05:30 [Info] logWriterStat:: 0 FlushedCount 12720000 QueuedCount 49896 2016-03-24T08:15:57.848+05:30 [Info] logWriterStat:: 0 FlushedCount 12730000 QueuedCount 49941 2016-03-24T08:15:57.942+05:30 [Info] logWriterStat:: 0 FlushedCount 12740000 QueuedCount 49981 2016-03-24T08:15:58.03+05:30 [Info] logWriterStat:: 0 FlushedCount 12750000 QueuedCount 50000 2016-03-24T08:15:58.137+05:30 [Info] logWriterStat:: 0 FlushedCount 12760000 QueuedCount 49884 2016-03-24T08:15:58.238+05:30 [Info] logWriterStat:: 0 FlushedCount 12770000 QueuedCount 49874 2016-03-24T08:15:58.333+05:30 [Info] logWriterStat:: 0 FlushedCount 12780000 QueuedCount 49996 2016-03-24T08:15:58.43+05:30 [Info] logWriterStat:: 0 FlushedCount 12790000 QueuedCount 49974 2016-03-24T08:15:58.533+05:30 [Info] logWriterStat:: 0 FlushedCount 12800000 QueuedCount 49946 2016-03-24T08:15:58.628+05:30 [Info] logWriterStat:: 0 FlushedCount 12810000 QueuedCount 49919 2016-03-24T08:15:58.717+05:30 [Info] logWriterStat:: 0 FlushedCount 12820000 QueuedCount 49916 2016-03-24T08:15:58.809+05:30 [Info] logWriterStat:: 0 FlushedCount 12830000 QueuedCount 49885 2016-03-24T08:15:58.902+05:30 [Info] logWriterStat:: 0 FlushedCount 12840000 QueuedCount 49941 2016-03-24T08:15:58.989+05:30 [Info] logWriterStat:: 0 FlushedCount 12850000 QueuedCount 47843 2016-03-24T08:15:59.086+05:30 [Info] logWriterStat:: 0 FlushedCount 12860000 QueuedCount 48656 2016-03-24T08:15:59.178+05:30 [Info] logWriterStat:: 0 FlushedCount 12870000 QueuedCount 48351 2016-03-24T08:15:59.28+05:30 [Info] logWriterStat:: 0 FlushedCount 12880000 QueuedCount 47818 2016-03-24T08:15:59.375+05:30 [Info] logWriterStat:: 0 FlushedCount 12890000 QueuedCount 47739 2016-03-24T08:15:59.47+05:30 [Info] logWriterStat:: 0 FlushedCount 12900000 QueuedCount 47974 2016-03-24T08:15:59.569+05:30 [Info] logWriterStat:: 0 FlushedCount 12910000 QueuedCount 49953 2016-03-24T08:15:59.666+05:30 [Info] logWriterStat:: 0 FlushedCount 12920000 QueuedCount 49972 2016-03-24T08:15:59.761+05:30 [Info] logWriterStat:: 0 FlushedCount 12930000 QueuedCount 49880 2016-03-24T08:15:59.857+05:30 [Info] logWriterStat:: 0 FlushedCount 12940000 QueuedCount 49954 2016-03-24T08:16:00.093+05:30 [Info] logWriterStat:: 0 FlushedCount 12950000 QueuedCount 49894 2016-03-24T08:16:00.317+05:30 [Info] logWriterStat:: 0 FlushedCount 12960000 QueuedCount 49060 2016-03-24T08:16:00.532+05:30 [Info] logWriterStat:: 0 FlushedCount 12970000 QueuedCount 49214 2016-03-24T08:16:00.76+05:30 [Info] logWriterStat:: 0 FlushedCount 12980000 QueuedCount 49113 2016-03-24T08:16:00.968+05:30 [Info] logWriterStat:: 0 FlushedCount 12990000 QueuedCount 48698 2016-03-24T08:16:01.196+05:30 [Info] logWriterStat:: 0 FlushedCount 13000000 QueuedCount 49166 2016-03-24T08:16:01.393+05:30 [Info] logWriterStat:: 0 FlushedCount 13010000 QueuedCount 49460 2016-03-24T08:16:01.602+05:30 [Info] logWriterStat:: 0 FlushedCount 13020000 QueuedCount 49202 2016-03-24T08:16:01.745+05:30 [Info] logWriterStat:: 0 FlushedCount 13030000 QueuedCount 49950 2016-03-24T08:16:01.914+05:30 [Info] logWriterStat:: 0 FlushedCount 13040000 QueuedCount 49946 2016-03-24T08:16:02.041+05:30 [Info] logWriterStat:: 0 FlushedCount 13050000 QueuedCount 49964 2016-03-24T08:16:02.184+05:30 [Info] logWriterStat:: 0 FlushedCount 13060000 QueuedCount 49917 2016-03-24T08:16:02.321+05:30 [Info] logWriterStat:: 0 FlushedCount 13070000 QueuedCount 49992 2016-03-24T08:16:02.456+05:30 [Info] logWriterStat:: 0 FlushedCount 13080000 QueuedCount 49952 2016-03-24T08:16:02.595+05:30 [Info] logWriterStat:: 0 FlushedCount 13090000 QueuedCount 49865 2016-03-24T08:16:02.721+05:30 [Info] logWriterStat:: 0 FlushedCount 13100000 QueuedCount 49985 2016-03-24T08:16:02.855+05:30 [Info] logWriterStat:: 0 FlushedCount 13110000 QueuedCount 49908 2016-03-24T08:16:02.979+05:30 [Info] logWriterStat:: 0 FlushedCount 13120000 QueuedCount 49987 2016-03-24T08:16:03.122+05:30 [Info] logWriterStat:: 0 FlushedCount 13130000 QueuedCount 49904 2016-03-24T08:16:03.262+05:30 [Info] logWriterStat:: 0 FlushedCount 13140000 QueuedCount 49933 2016-03-24T08:16:03.407+05:30 [Info] logWriterStat:: 0 FlushedCount 13150000 QueuedCount 49964 2016-03-24T08:16:03.601+05:30 [Info] logWriterStat:: 0 FlushedCount 13160000 QueuedCount 49981 2016-03-24T08:16:03.682+05:30 [Info] logWriterStat:: 0 FlushedCount 13170000 QueuedCount 49959 2016-03-24T08:16:03.762+05:30 [Info] logWriterStat:: 0 FlushedCount 13180000 QueuedCount 49980 2016-03-24T08:16:03.837+05:30 [Info] logWriterStat:: 0 FlushedCount 13190000 QueuedCount 49985 2016-03-24T08:16:03.918+05:30 [Info] logWriterStat:: 0 FlushedCount 13200000 QueuedCount 49966 2016-03-24T08:16:03.994+05:30 [Info] logWriterStat:: 0 FlushedCount 13210000 QueuedCount 49977 2016-03-24T08:16:04.087+05:30 [Info] logWriterStat:: 0 FlushedCount 13220000 QueuedCount 49979 2016-03-24T08:16:04.171+05:30 [Info] logWriterStat:: 0 FlushedCount 13230000 QueuedCount 49951 2016-03-24T08:16:04.265+05:30 [Info] logWriterStat:: 0 FlushedCount 13240000 QueuedCount 49976 2016-03-24T08:16:04.344+05:30 [Info] logWriterStat:: 0 FlushedCount 13250000 QueuedCount 49954 2016-03-24T08:16:04.426+05:30 [Info] logWriterStat:: 0 FlushedCount 13260000 QueuedCount 49978 2016-03-24T08:16:04.513+05:30 [Info] logWriterStat:: 0 FlushedCount 13270000 QueuedCount 49896 2016-03-24T08:16:04.593+05:30 [Info] logWriterStat:: 0 FlushedCount 13280000 QueuedCount 49972 2016-03-24T08:16:04.674+05:30 [Info] logWriterStat:: 0 FlushedCount 13290000 QueuedCount 49920 2016-03-24T08:16:04.754+05:30 [Info] logWriterStat:: 0 FlushedCount 13300000 QueuedCount 49927 2016-03-24T08:16:04.837+05:30 [Info] logWriterStat:: 0 FlushedCount 13310000 QueuedCount 49907 2016-03-24T08:16:04.919+05:30 [Info] logWriterStat:: 0 FlushedCount 13320000 QueuedCount 49876 2016-03-24T08:16:05.002+05:30 [Info] logWriterStat:: 0 FlushedCount 13330000 QueuedCount 49989 2016-03-24T08:16:05.091+05:30 [Info] logWriterStat:: 0 FlushedCount 13340000 QueuedCount 49988 2016-03-24T08:16:05.171+05:30 [Info] logWriterStat:: 0 FlushedCount 13350000 QueuedCount 49940 2016-03-24T08:16:05.263+05:30 [Info] logWriterStat:: 0 FlushedCount 13360000 QueuedCount 49896 2016-03-24T08:16:05.341+05:30 [Info] logWriterStat:: 0 FlushedCount 13370000 QueuedCount 49982 2016-03-24T08:16:05.42+05:30 [Info] logWriterStat:: 0 FlushedCount 13380000 QueuedCount 49989 2016-03-24T08:16:05.501+05:30 [Info] logWriterStat:: 0 FlushedCount 13390000 QueuedCount 49978 2016-03-24T08:16:05.584+05:30 [Info] logWriterStat:: 0 FlushedCount 13400000 QueuedCount 49962 2016-03-24T08:16:05.667+05:30 [Info] logWriterStat:: 0 FlushedCount 13410000 QueuedCount 49921 2016-03-24T08:16:05.749+05:30 [Info] logWriterStat:: 0 FlushedCount 13420000 QueuedCount 49972 2016-03-24T08:16:05.829+05:30 [Info] logWriterStat:: 0 FlushedCount 13430000 QueuedCount 49983 2016-03-24T08:16:05.909+05:30 [Info] logWriterStat:: 0 FlushedCount 13440000 QueuedCount 49966 2016-03-24T08:16:05.99+05:30 [Info] logWriterStat:: 0 FlushedCount 13450000 QueuedCount 49966 2016-03-24T08:16:06.079+05:30 [Info] logWriterStat:: 0 FlushedCount 13460000 QueuedCount 49967 2016-03-24T08:16:06.162+05:30 [Info] logWriterStat:: 0 FlushedCount 13470000 QueuedCount 49972 2016-03-24T08:16:06.279+05:30 [Info] logWriterStat:: 0 FlushedCount 13480000 QueuedCount 49872 2016-03-24T08:16:06.394+05:30 [Info] logWriterStat:: 0 FlushedCount 13490000 QueuedCount 49981 2016-03-24T08:16:06.475+05:30 [Info] logWriterStat:: 0 FlushedCount 13500000 QueuedCount 49961 2016-03-24T08:16:06.56+05:30 [Info] logWriterStat:: 0 FlushedCount 13510000 QueuedCount 49968 2016-03-24T08:16:06.642+05:30 [Info] logWriterStat:: 0 FlushedCount 13520000 QueuedCount 49955 2016-03-24T08:16:06.724+05:30 [Info] logWriterStat:: 0 FlushedCount 13530000 QueuedCount 49912 2016-03-24T08:16:06.81+05:30 [Info] logWriterStat:: 0 FlushedCount 13540000 QueuedCount 49901 2016-03-24T08:16:06.899+05:30 [Info] logWriterStat:: 0 FlushedCount 13550000 QueuedCount 49967 2016-03-24T08:16:06.981+05:30 [Info] logWriterStat:: 0 FlushedCount 13560000 QueuedCount 49950 2016-03-24T08:16:07.066+05:30 [Info] logWriterStat:: 0 FlushedCount 13570000 QueuedCount 49968 2016-03-24T08:16:07.149+05:30 [Info] logWriterStat:: 0 FlushedCount 13580000 QueuedCount 49988 2016-03-24T08:16:07.229+05:30 [Info] logWriterStat:: 0 FlushedCount 13590000 QueuedCount 49908 2016-03-24T08:16:07.308+05:30 [Info] logWriterStat:: 0 FlushedCount 13600000 QueuedCount 49939 2016-03-24T08:16:07.392+05:30 [Info] logWriterStat:: 0 FlushedCount 13610000 QueuedCount 49967 2016-03-24T08:16:07.475+05:30 [Info] logWriterStat:: 0 FlushedCount 13620000 QueuedCount 49854 2016-03-24T08:16:07.561+05:30 [Info] logWriterStat:: 0 FlushedCount 13630000 QueuedCount 49990 2016-03-24T08:16:07.64+05:30 [Info] logWriterStat:: 0 FlushedCount 13640000 QueuedCount 49980 2016-03-24T08:16:07.719+05:30 [Info] logWriterStat:: 0 FlushedCount 13650000 QueuedCount 49980 2016-03-24T08:16:07.799+05:30 [Info] logWriterStat:: 0 FlushedCount 13660000 QueuedCount 49981 2016-03-24T08:16:07.879+05:30 [Info] logWriterStat:: 0 FlushedCount 13670000 QueuedCount 49993 2016-03-24T08:16:07.959+05:30 [Info] logWriterStat:: 0 FlushedCount 13680000 QueuedCount 49944 2016-03-24T08:16:08.039+05:30 [Info] logWriterStat:: 0 FlushedCount 13690000 QueuedCount 49964 2016-03-24T08:16:08.13+05:30 [Info] logWriterStat:: 0 FlushedCount 13700000 QueuedCount 49993 2016-03-24T08:16:08.213+05:30 [Info] logWriterStat:: 0 FlushedCount 13710000 QueuedCount 49924 2016-03-24T08:16:08.29+05:30 [Info] logWriterStat:: 0 FlushedCount 13720000 QueuedCount 49972 2016-03-24T08:16:08.369+05:30 [Info] logWriterStat:: 0 FlushedCount 13730000 QueuedCount 49974 2016-03-24T08:16:08.45+05:30 [Info] logWriterStat:: 0 FlushedCount 13740000 QueuedCount 49943 2016-03-24T08:16:08.533+05:30 [Info] logWriterStat:: 0 FlushedCount 13750000 QueuedCount 49893 2016-03-24T08:16:08.615+05:30 [Info] logWriterStat:: 0 FlushedCount 13760000 QueuedCount 49985 2016-03-24T08:16:08.7+05:30 [Info] logWriterStat:: 0 FlushedCount 13770000 QueuedCount 49949 2016-03-24T08:16:08.78+05:30 [Info] logWriterStat:: 0 FlushedCount 13780000 QueuedCount 49070 2016-03-24T08:16:08.865+05:30 [Info] logWriterStat:: 0 FlushedCount 13790000 QueuedCount 49981 2016-03-24T08:16:08.949+05:30 [Info] logWriterStat:: 0 FlushedCount 13800000 QueuedCount 49995 2016-03-24T08:16:09.034+05:30 [Info] logWriterStat:: 0 FlushedCount 13810000 QueuedCount 49927 2016-03-24T08:16:09.12+05:30 [Info] logWriterStat:: 0 FlushedCount 13820000 QueuedCount 49936 2016-03-24T08:16:09.205+05:30 [Info] logWriterStat:: 0 FlushedCount 13830000 QueuedCount 49991 2016-03-24T08:16:09.301+05:30 [Info] logWriterStat:: 0 FlushedCount 13840000 QueuedCount 50000 2016-03-24T08:16:09.387+05:30 [Info] logWriterStat:: 0 FlushedCount 13850000 QueuedCount 49922 2016-03-24T08:16:09.472+05:30 [Info] logWriterStat:: 0 FlushedCount 13860000 QueuedCount 49965 2016-03-24T08:16:09.553+05:30 [Info] logWriterStat:: 0 FlushedCount 13870000 QueuedCount 49943 2016-03-24T08:16:09.635+05:30 [Info] logWriterStat:: 0 FlushedCount 13880000 QueuedCount 49986 2016-03-24T08:16:09.716+05:30 [Info] logWriterStat:: 0 FlushedCount 13890000 QueuedCount 49959 2016-03-24T08:16:09.798+05:30 [Info] logWriterStat:: 0 FlushedCount 13900000 QueuedCount 49993 2016-03-24T08:16:09.88+05:30 [Info] logWriterStat:: 0 FlushedCount 13910000 QueuedCount 49989 2016-03-24T08:16:09.958+05:30 [Info] logWriterStat:: 0 FlushedCount 13920000 QueuedCount 49971 2016-03-24T08:16:10.038+05:30 [Info] logWriterStat:: 0 FlushedCount 13930000 QueuedCount 49982 2016-03-24T08:16:10.171+05:30 [Info] logWriterStat:: 0 FlushedCount 13940000 QueuedCount 49915 2016-03-24T08:16:10.262+05:30 [Info] logWriterStat:: 0 FlushedCount 13950000 QueuedCount 49957 2016-03-24T08:16:10.344+05:30 [Info] logWriterStat:: 0 FlushedCount 13960000 QueuedCount 49978 2016-03-24T08:16:10.427+05:30 [Info] logWriterStat:: 0 FlushedCount 13970000 QueuedCount 49983 2016-03-24T08:16:10.507+05:30 [Info] logWriterStat:: 0 FlushedCount 13980000 QueuedCount 49920 2016-03-24T08:16:10.59+05:30 [Info] logWriterStat:: 0 FlushedCount 13990000 QueuedCount 49913 2016-03-24T08:16:10.674+05:30 [Info] logWriterStat:: 0 FlushedCount 14000000 QueuedCount 49940 2016-03-24T08:16:10.756+05:30 [Info] logWriterStat:: 0 FlushedCount 14010000 QueuedCount 49956 2016-03-24T08:16:10.836+05:30 [Info] logWriterStat:: 0 FlushedCount 14020000 QueuedCount 49971 2016-03-24T08:16:10.915+05:30 [Info] logWriterStat:: 0 FlushedCount 14030000 QueuedCount 49986 2016-03-24T08:16:10.994+05:30 [Info] logWriterStat:: 0 FlushedCount 14040000 QueuedCount 49928 2016-03-24T08:16:11.084+05:30 [Info] logWriterStat:: 0 FlushedCount 14050000 QueuedCount 49957 2016-03-24T08:16:11.171+05:30 [Info] logWriterStat:: 0 FlushedCount 14060000 QueuedCount 49936 2016-03-24T08:16:11.25+05:30 [Info] logWriterStat:: 0 FlushedCount 14070000 QueuedCount 49990 2016-03-24T08:16:11.332+05:30 [Info] logWriterStat:: 0 FlushedCount 14080000 QueuedCount 49942 2016-03-24T08:16:11.412+05:30 [Info] logWriterStat:: 0 FlushedCount 14090000 QueuedCount 49965 2016-03-24T08:16:11.496+05:30 [Info] logWriterStat:: 0 FlushedCount 14100000 QueuedCount 49956 2016-03-24T08:16:11.577+05:30 [Info] logWriterStat:: 0 FlushedCount 14110000 QueuedCount 49970 2016-03-24T08:16:11.653+05:30 [Info] logWriterStat:: 0 FlushedCount 14120000 QueuedCount 49072 2016-03-24T08:16:11.732+05:30 [Info] logWriterStat:: 0 FlushedCount 14130000 QueuedCount 49944 2016-03-24T08:16:11.808+05:30 [Info] logWriterStat:: 0 FlushedCount 14140000 QueuedCount 49151 2016-03-24T08:16:11.905+05:30 [Info] logWriterStat:: 0 FlushedCount 14150000 QueuedCount 49903 2016-03-24T08:16:11.986+05:30 [Info] logWriterStat:: 0 FlushedCount 14160000 QueuedCount 49979 2016-03-24T08:16:12.076+05:30 [Info] logWriterStat:: 0 FlushedCount 14170000 QueuedCount 49926 2016-03-24T08:16:12.161+05:30 [Info] logWriterStat:: 0 FlushedCount 14180000 QueuedCount 49951 2016-03-24T08:16:12.251+05:30 [Info] logWriterStat:: 0 FlushedCount 14190000 QueuedCount 49931 2016-03-24T08:16:12.334+05:30 [Info] logWriterStat:: 0 FlushedCount 14200000 QueuedCount 49971 2016-03-24T08:16:12.418+05:30 [Info] logWriterStat:: 0 FlushedCount 14210000 QueuedCount 49923 2016-03-24T08:16:12.502+05:30 [Info] logWriterStat:: 0 FlushedCount 14220000 QueuedCount 49968 2016-03-24T08:16:12.591+05:30 [Info] logWriterStat:: 0 FlushedCount 14230000 QueuedCount 49947 2016-03-24T08:16:12.671+05:30 [Info] logWriterStat:: 0 FlushedCount 14240000 QueuedCount 49982 2016-03-24T08:16:12.753+05:30 [Info] logWriterStat:: 0 FlushedCount 14250000 QueuedCount 49987 2016-03-24T08:16:12.835+05:30 [Info] logWriterStat:: 0 FlushedCount 14260000 QueuedCount 49920 2016-03-24T08:16:12.914+05:30 [Info] logWriterStat:: 0 FlushedCount 14270000 QueuedCount 49976 2016-03-24T08:16:12.994+05:30 [Info] logWriterStat:: 0 FlushedCount 14280000 QueuedCount 49989 2016-03-24T08:16:13.088+05:30 [Info] logWriterStat:: 0 FlushedCount 14290000 QueuedCount 49904 2016-03-24T08:16:13.171+05:30 [Info] logWriterStat:: 0 FlushedCount 14300000 QueuedCount 49953 2016-03-24T08:16:13.256+05:30 [Info] logWriterStat:: 0 FlushedCount 14310000 QueuedCount 49987 2016-03-24T08:16:13.338+05:30 [Info] logWriterStat:: 0 FlushedCount 14320000 QueuedCount 49934 2016-03-24T08:16:13.417+05:30 [Info] logWriterStat:: 0 FlushedCount 14330000 QueuedCount 49462 2016-03-24T08:16:13.502+05:30 [Info] logWriterStat:: 0 FlushedCount 14340000 QueuedCount 49958 2016-03-24T08:16:13.583+05:30 [Info] logWriterStat:: 0 FlushedCount 14350000 QueuedCount 49955 2016-03-24T08:16:13.664+05:30 [Info] logWriterStat:: 0 FlushedCount 14360000 QueuedCount 49988 2016-03-24T08:16:13.742+05:30 [Info] logWriterStat:: 0 FlushedCount 14370000 QueuedCount 48686 2016-03-24T08:16:13.82+05:30 [Info] logWriterStat:: 0 FlushedCount 14380000 QueuedCount 49993 2016-03-24T08:16:13.899+05:30 [Info] logWriterStat:: 0 FlushedCount 14390000 QueuedCount 49990 2016-03-24T08:16:13.973+05:30 [Info] logWriterStat:: 0 FlushedCount 14400000 QueuedCount 49957 2016-03-24T08:16:14.061+05:30 [Info] logWriterStat:: 0 FlushedCount 14410000 QueuedCount 49958 2016-03-24T08:16:14.146+05:30 [Info] logWriterStat:: 0 FlushedCount 14420000 QueuedCount 49965 2016-03-24T08:16:14.226+05:30 [Info] logWriterStat:: 0 FlushedCount 14430000 QueuedCount 49979 2016-03-24T08:16:14.322+05:30 [Info] logWriterStat:: 0 FlushedCount 14440000 QueuedCount 49989 2016-03-24T08:16:14.402+05:30 [Info] logWriterStat:: 0 FlushedCount 14450000 QueuedCount 49927 2016-03-24T08:16:14.475+05:30 [Info] logWriterStat:: 0 FlushedCount 14460000 QueuedCount 45769 2016-03-24T08:16:14.557+05:30 [Info] logWriterStat:: 0 FlushedCount 14470000 QueuedCount 49938 2016-03-24T08:16:14.642+05:30 [Info] logWriterStat:: 0 FlushedCount 14480000 QueuedCount 49948 2016-03-24T08:16:14.72+05:30 [Info] logWriterStat:: 0 FlushedCount 14490000 QueuedCount 49967 2016-03-24T08:16:14.801+05:30 [Info] logWriterStat:: 0 FlushedCount 14500000 QueuedCount 49976 2016-03-24T08:16:14.882+05:30 [Info] logWriterStat:: 0 FlushedCount 14510000 QueuedCount 49968 2016-03-24T08:16:14.966+05:30 [Info] logWriterStat:: 0 FlushedCount 14520000 QueuedCount 49990 2016-03-24T08:16:15.046+05:30 [Info] logWriterStat:: 0 FlushedCount 14530000 QueuedCount 49877 2016-03-24T08:16:15.136+05:30 [Info] logWriterStat:: 0 FlushedCount 14540000 QueuedCount 49977 2016-03-24T08:16:15.223+05:30 [Info] logWriterStat:: 0 FlushedCount 14550000 QueuedCount 49980 2016-03-24T08:16:15.314+05:30 [Info] logWriterStat:: 0 FlushedCount 14560000 QueuedCount 49984 2016-03-24T08:16:15.393+05:30 [Info] logWriterStat:: 0 FlushedCount 14570000 QueuedCount 49951 2016-03-24T08:16:15.474+05:30 [Info] logWriterStat:: 0 FlushedCount 14580000 QueuedCount 49890 2016-03-24T08:16:15.556+05:30 [Info] logWriterStat:: 0 FlushedCount 14590000 QueuedCount 49960 2016-03-24T08:16:15.636+05:30 [Info] logWriterStat:: 0 FlushedCount 14600000 QueuedCount 49488 2016-03-24T08:16:15.707+05:30 [Info] logWriterStat:: 0 FlushedCount 14610000 QueuedCount 49907 2016-03-24T08:16:15.786+05:30 [Info] logWriterStat:: 0 FlushedCount 14620000 QueuedCount 49964 2016-03-24T08:16:15.868+05:30 [Info] logWriterStat:: 0 FlushedCount 14630000 QueuedCount 49971 2016-03-24T08:16:15.948+05:30 [Info] logWriterStat:: 0 FlushedCount 14640000 QueuedCount 49945 2016-03-24T08:16:16.027+05:30 [Info] logWriterStat:: 0 FlushedCount 14650000 QueuedCount 49935 2016-03-24T08:16:16.116+05:30 [Info] logWriterStat:: 0 FlushedCount 14660000 QueuedCount 49997 2016-03-24T08:16:16.198+05:30 [Info] logWriterStat:: 0 FlushedCount 14670000 QueuedCount 49970 2016-03-24T08:16:16.276+05:30 [Info] logWriterStat:: 0 FlushedCount 14680000 QueuedCount 49936 2016-03-24T08:16:16.356+05:30 [Info] logWriterStat:: 0 FlushedCount 14690000 QueuedCount 49964 2016-03-24T08:16:16.436+05:30 [Info] logWriterStat:: 0 FlushedCount 14700000 QueuedCount 49980 2016-03-24T08:16:16.515+05:30 [Info] logWriterStat:: 0 FlushedCount 14710000 QueuedCount 49943 2016-03-24T08:16:16.595+05:30 [Info] logWriterStat:: 0 FlushedCount 14720000 QueuedCount 49980 2016-03-24T08:16:16.674+05:30 [Info] logWriterStat:: 0 FlushedCount 14730000 QueuedCount 49944 2016-03-24T08:16:16.753+05:30 [Info] logWriterStat:: 0 FlushedCount 14740000 QueuedCount 49961 2016-03-24T08:16:16.836+05:30 [Info] logWriterStat:: 0 FlushedCount 14750000 QueuedCount 49962 2016-03-24T08:16:16.933+05:30 [Info] logWriterStat:: 0 FlushedCount 14760000 QueuedCount 49966 2016-03-24T08:16:17.012+05:30 [Info] logWriterStat:: 0 FlushedCount 14770000 QueuedCount 48811 2016-03-24T08:16:17.101+05:30 [Info] logWriterStat:: 0 FlushedCount 14780000 QueuedCount 49930 2016-03-24T08:16:17.184+05:30 [Info] logWriterStat:: 0 FlushedCount 14790000 QueuedCount 49901 2016-03-24T08:16:17.263+05:30 [Info] logWriterStat:: 0 FlushedCount 14800000 QueuedCount 49939 2016-03-24T08:16:17.343+05:30 [Info] logWriterStat:: 0 FlushedCount 14810000 QueuedCount 49953 2016-03-24T08:16:17.422+05:30 [Info] logWriterStat:: 0 FlushedCount 14820000 QueuedCount 49943 2016-03-24T08:16:17.502+05:30 [Info] logWriterStat:: 0 FlushedCount 14830000 QueuedCount 49953 2016-03-24T08:16:17.583+05:30 [Info] logWriterStat:: 0 FlushedCount 14840000 QueuedCount 49971 2016-03-24T08:16:17.658+05:30 [Info] logWriterStat:: 0 FlushedCount 14850000 QueuedCount 48456 2016-03-24T08:16:17.737+05:30 [Info] logWriterStat:: 0 FlushedCount 14860000 QueuedCount 49992 2016-03-24T08:16:17.818+05:30 [Info] logWriterStat:: 0 FlushedCount 14870000 QueuedCount 49976 2016-03-24T08:16:17.892+05:30 [Info] logWriterStat:: 0 FlushedCount 14880000 QueuedCount 49990 2016-03-24T08:16:17.971+05:30 [Info] logWriterStat:: 0 FlushedCount 14890000 QueuedCount 49982 2016-03-24T08:16:18.06+05:30 [Info] logWriterStat:: 0 FlushedCount 14900000 QueuedCount 49996 2016-03-24T08:16:18.148+05:30 [Info] logWriterStat:: 0 FlushedCount 14910000 QueuedCount 49958 2016-03-24T08:16:18.238+05:30 [Info] logWriterStat:: 0 FlushedCount 14920000 QueuedCount 49985 2016-03-24T08:16:18.314+05:30 [Info] logWriterStat:: 0 FlushedCount 14930000 QueuedCount 49983 2016-03-24T08:16:18.396+05:30 [Info] logWriterStat:: 0 FlushedCount 14940000 QueuedCount 48918 2016-03-24T08:16:18.484+05:30 [Info] logWriterStat:: 0 FlushedCount 14950000 QueuedCount 49971 2016-03-24T08:16:18.569+05:30 [Info] logWriterStat:: 0 FlushedCount 14960000 QueuedCount 49930 2016-03-24T08:16:18.649+05:30 [Info] logWriterStat:: 0 FlushedCount 14970000 QueuedCount 49873 2016-03-24T08:16:18.722+05:30 [Info] logWriterStat:: 0 FlushedCount 14980000 QueuedCount 49377 2016-03-24T08:16:18.802+05:30 [Info] logWriterStat:: 0 FlushedCount 14990000 QueuedCount 49978 2016-03-24T08:16:18.88+05:30 [Info] logWriterStat:: 0 FlushedCount 15000000 QueuedCount 49913 2016-03-24T08:16:18.961+05:30 [Info] logWriterStat:: 0 FlushedCount 15010000 QueuedCount 49944 2016-03-24T08:16:19.038+05:30 [Info] logWriterStat:: 0 FlushedCount 15020000 QueuedCount 49959 2016-03-24T08:16:19.128+05:30 [Info] logWriterStat:: 0 FlushedCount 15030000 QueuedCount 49432 2016-03-24T08:16:19.206+05:30 [Info] logWriterStat:: 0 FlushedCount 15040000 QueuedCount 49984 2016-03-24T08:16:19.296+05:30 [Info] logWriterStat:: 0 FlushedCount 15050000 QueuedCount 49981 2016-03-24T08:16:19.376+05:30 [Info] logWriterStat:: 0 FlushedCount 15060000 QueuedCount 49983 2016-03-24T08:16:19.46+05:30 [Info] logWriterStat:: 0 FlushedCount 15070000 QueuedCount 49928 2016-03-24T08:16:19.541+05:30 [Info] logWriterStat:: 0 FlushedCount 15080000 QueuedCount 49966 2016-03-24T08:16:19.618+05:30 [Info] logWriterStat:: 0 FlushedCount 15090000 QueuedCount 49979 2016-03-24T08:16:19.696+05:30 [Info] logWriterStat:: 0 FlushedCount 15100000 QueuedCount 49957 2016-03-24T08:16:19.777+05:30 [Info] logWriterStat:: 0 FlushedCount 15110000 QueuedCount 49938 2016-03-24T08:16:19.857+05:30 [Info] logWriterStat:: 0 FlushedCount 15120000 QueuedCount 49929 2016-03-24T08:16:19.939+05:30 [Info] logWriterStat:: 0 FlushedCount 15130000 QueuedCount 49986 2016-03-24T08:16:20.021+05:30 [Info] logWriterStat:: 0 FlushedCount 15140000 QueuedCount 49956 2016-03-24T08:16:20.141+05:30 [Info] logWriterStat:: 0 FlushedCount 15150000 QueuedCount 49963 2016-03-24T08:16:20.23+05:30 [Info] logWriterStat:: 0 FlushedCount 15160000 QueuedCount 49945 2016-03-24T08:16:20.321+05:30 [Info] logWriterStat:: 0 FlushedCount 15170000 QueuedCount 49971 2016-03-24T08:16:20.405+05:30 [Info] logWriterStat:: 0 FlushedCount 15180000 QueuedCount 49910 2016-03-24T08:16:20.482+05:30 [Info] logWriterStat:: 0 FlushedCount 15190000 QueuedCount 49962 2016-03-24T08:16:20.563+05:30 [Info] logWriterStat:: 0 FlushedCount 15200000 QueuedCount 49952 2016-03-24T08:16:20.645+05:30 [Info] logWriterStat:: 0 FlushedCount 15210000 QueuedCount 49935 2016-03-24T08:16:20.725+05:30 [Info] logWriterStat:: 0 FlushedCount 15220000 QueuedCount 49863 2016-03-24T08:16:20.805+05:30 [Info] logWriterStat:: 0 FlushedCount 15230000 QueuedCount 49982 2016-03-24T08:16:20.888+05:30 [Info] logWriterStat:: 0 FlushedCount 15240000 QueuedCount 49954 2016-03-24T08:16:20.969+05:30 [Info] logWriterStat:: 0 FlushedCount 15250000 QueuedCount 49985 2016-03-24T08:16:21.057+05:30 [Info] logWriterStat:: 0 FlushedCount 15260000 QueuedCount 49913 2016-03-24T08:16:21.138+05:30 [Info] logWriterStat:: 0 FlushedCount 15270000 QueuedCount 49997 2016-03-24T08:16:21.223+05:30 [Info] logWriterStat:: 0 FlushedCount 15280000 QueuedCount 49923 2016-03-24T08:16:21.303+05:30 [Info] logWriterStat:: 0 FlushedCount 15290000 QueuedCount 49967 2016-03-24T08:16:21.381+05:30 [Info] logWriterStat:: 0 FlushedCount 15300000 QueuedCount 49979 2016-03-24T08:16:21.46+05:30 [Info] logWriterStat:: 0 FlushedCount 15310000 QueuedCount 49967 2016-03-24T08:16:21.54+05:30 [Info] logWriterStat:: 0 FlushedCount 15320000 QueuedCount 49944 2016-03-24T08:16:21.615+05:30 [Info] logWriterStat:: 0 FlushedCount 15330000 QueuedCount 49971 2016-03-24T08:16:21.695+05:30 [Info] logWriterStat:: 0 FlushedCount 15340000 QueuedCount 49979 2016-03-24T08:16:21.778+05:30 [Info] logWriterStat:: 0 FlushedCount 15350000 QueuedCount 49955 2016-03-24T08:16:21.862+05:30 [Info] logWriterStat:: 0 FlushedCount 15360000 QueuedCount 49914 2016-03-24T08:16:21.959+05:30 [Info] logWriterStat:: 0 FlushedCount 15370000 QueuedCount 49465 2016-03-24T08:16:22.038+05:30 [Info] logWriterStat:: 0 FlushedCount 15380000 QueuedCount 49960 2016-03-24T08:16:22.136+05:30 [Info] logWriterStat:: 0 FlushedCount 15390000 QueuedCount 49989 2016-03-24T08:16:22.214+05:30 [Info] logWriterStat:: 0 FlushedCount 15400000 QueuedCount 49922 2016-03-24T08:16:22.296+05:30 [Info] logWriterStat:: 0 FlushedCount 15410000 QueuedCount 49943 2016-03-24T08:16:22.378+05:30 [Info] logWriterStat:: 0 FlushedCount 15420000 QueuedCount 49985 2016-03-24T08:16:22.457+05:30 [Info] logWriterStat:: 0 FlushedCount 15430000 QueuedCount 49665 2016-03-24T08:16:22.534+05:30 [Info] logWriterStat:: 0 FlushedCount 15440000 QueuedCount 49992 2016-03-24T08:16:22.622+05:30 [Info] logWriterStat:: 0 FlushedCount 15450000 QueuedCount 49664 2016-03-24T08:16:22.703+05:30 [Info] logWriterStat:: 0 FlushedCount 15460000 QueuedCount 49883 2016-03-24T08:16:22.785+05:30 [Info] logWriterStat:: 0 FlushedCount 15470000 QueuedCount 49986 2016-03-24T08:16:22.868+05:30 [Info] logWriterStat:: 0 FlushedCount 15480000 QueuedCount 49964 2016-03-24T08:16:22.949+05:30 [Info] logWriterStat:: 0 FlushedCount 15490000 QueuedCount 49972 2016-03-24T08:16:23.031+05:30 [Info] logWriterStat:: 0 FlushedCount 15500000 QueuedCount 49948 2016-03-24T08:16:23.121+05:30 [Info] logWriterStat:: 0 FlushedCount 15510000 QueuedCount 49966 2016-03-24T08:16:23.206+05:30 [Info] logWriterStat:: 0 FlushedCount 15520000 QueuedCount 49919 2016-03-24T08:16:23.287+05:30 [Info] logWriterStat:: 0 FlushedCount 15530000 QueuedCount 49906 2016-03-24T08:16:23.37+05:30 [Info] logWriterStat:: 0 FlushedCount 15540000 QueuedCount 49965 2016-03-24T08:16:23.453+05:30 [Info] logWriterStat:: 0 FlushedCount 15550000 QueuedCount 49943 2016-03-24T08:16:23.539+05:30 [Info] logWriterStat:: 0 FlushedCount 15560000 QueuedCount 49967 2016-03-24T08:16:23.62+05:30 [Info] logWriterStat:: 0 FlushedCount 15570000 QueuedCount 49991 2016-03-24T08:16:23.7+05:30 [Info] logWriterStat:: 0 FlushedCount 15580000 QueuedCount 49845 2016-03-24T08:16:23.779+05:30 [Info] logWriterStat:: 0 FlushedCount 15590000 QueuedCount 49985 2016-03-24T08:16:23.862+05:30 [Info] logWriterStat:: 0 FlushedCount 15600000 QueuedCount 49935 2016-03-24T08:16:23.941+05:30 [Info] logWriterStat:: 0 FlushedCount 15610000 QueuedCount 49976 2016-03-24T08:16:24.021+05:30 [Info] logWriterStat:: 0 FlushedCount 15620000 QueuedCount 49993 2016-03-24T08:16:24.113+05:30 [Info] logWriterStat:: 0 FlushedCount 15630000 QueuedCount 49983 2016-03-24T08:16:24.199+05:30 [Info] logWriterStat:: 0 FlushedCount 15640000 QueuedCount 49969 2016-03-24T08:16:24.293+05:30 [Info] logWriterStat:: 0 FlushedCount 15650000 QueuedCount 49978 2016-03-24T08:16:24.377+05:30 [Info] logWriterStat:: 0 FlushedCount 15660000 QueuedCount 49988 2016-03-24T08:16:24.454+05:30 [Info] logWriterStat:: 0 FlushedCount 15670000 QueuedCount 49909 2016-03-24T08:16:24.531+05:30 [Info] logWriterStat:: 0 FlushedCount 15680000 QueuedCount 49925 2016-03-24T08:16:24.605+05:30 [Info] logWriterStat:: 0 FlushedCount 15690000 QueuedCount 49980 2016-03-24T08:16:24.687+05:30 [Info] logWriterStat:: 0 FlushedCount 15700000 QueuedCount 49961 2016-03-24T08:16:24.765+05:30 [Info] logWriterStat:: 0 FlushedCount 15710000 QueuedCount 49970 2016-03-24T08:16:24.85+05:30 [Info] logWriterStat:: 0 FlushedCount 15720000 QueuedCount 49955 2016-03-24T08:16:24.921+05:30 [Info] logWriterStat:: 0 FlushedCount 15730000 QueuedCount 47878 2016-03-24T08:16:25.001+05:30 [Info] logWriterStat:: 0 FlushedCount 15740000 QueuedCount 49991 2016-03-24T08:16:25.094+05:30 [Info] logWriterStat:: 0 FlushedCount 15750000 QueuedCount 49932 2016-03-24T08:16:25.18+05:30 [Info] logWriterStat:: 0 FlushedCount 15760000 QueuedCount 49950 2016-03-24T08:16:25.265+05:30 [Info] logWriterStat:: 0 FlushedCount 15770000 QueuedCount 50000 2016-03-24T08:16:25.349+05:30 [Info] logWriterStat:: 0 FlushedCount 15780000 QueuedCount 49952 2016-03-24T08:16:25.428+05:30 [Info] logWriterStat:: 0 FlushedCount 15790000 QueuedCount 49948 2016-03-24T08:16:25.512+05:30 [Info] logWriterStat:: 0 FlushedCount 15800000 QueuedCount 49880 2016-03-24T08:16:25.586+05:30 [Info] logWriterStat:: 0 FlushedCount 15810000 QueuedCount 49894 2016-03-24T08:16:25.667+05:30 [Info] logWriterStat:: 0 FlushedCount 15820000 QueuedCount 49927 2016-03-24T08:16:25.751+05:30 [Info] logWriterStat:: 0 FlushedCount 15830000 QueuedCount 49981 2016-03-24T08:16:25.828+05:30 [Info] logWriterStat:: 0 FlushedCount 15840000 QueuedCount 49057 2016-03-24T08:16:25.912+05:30 [Info] logWriterStat:: 0 FlushedCount 15850000 QueuedCount 49983 2016-03-24T08:16:25.99+05:30 [Info] logWriterStat:: 0 FlushedCount 15860000 QueuedCount 48997 2016-03-24T08:16:26.081+05:30 [Info] logWriterStat:: 0 FlushedCount 15870000 QueuedCount 49967 2016-03-24T08:16:26.164+05:30 [Info] logWriterStat:: 0 FlushedCount 15880000 QueuedCount 49953 2016-03-24T08:16:26.247+05:30 [Info] logWriterStat:: 0 FlushedCount 15890000 QueuedCount 49958 2016-03-24T08:16:26.326+05:30 [Info] logWriterStat:: 0 FlushedCount 15900000 QueuedCount 49943 2016-03-24T08:16:26.405+05:30 [Info] logWriterStat:: 0 FlushedCount 15910000 QueuedCount 49971 2016-03-24T08:16:26.488+05:30 [Info] logWriterStat:: 0 FlushedCount 15920000 QueuedCount 49930 2016-03-24T08:16:26.57+05:30 [Info] logWriterStat:: 0 FlushedCount 15930000 QueuedCount 49872 2016-03-24T08:16:26.653+05:30 [Info] logWriterStat:: 0 FlushedCount 15940000 QueuedCount 49980 2016-03-24T08:16:26.732+05:30 [Info] logWriterStat:: 0 FlushedCount 15950000 QueuedCount 49923 2016-03-24T08:16:26.815+05:30 [Info] logWriterStat:: 0 FlushedCount 15960000 QueuedCount 49970 2016-03-24T08:16:26.897+05:30 [Info] logWriterStat:: 0 FlushedCount 15970000 QueuedCount 49953 2016-03-24T08:16:26.99+05:30 [Info] logWriterStat:: 0 FlushedCount 15980000 QueuedCount 49985 2016-03-24T08:16:27.074+05:30 [Info] logWriterStat:: 0 FlushedCount 15990000 QueuedCount 49986 2016-03-24T08:16:27.159+05:30 [Info] logWriterStat:: 0 FlushedCount 16000000 QueuedCount 49959 2016-03-24T08:16:27.246+05:30 [Info] logWriterStat:: 0 FlushedCount 16010000 QueuedCount 49991 2016-03-24T08:16:27.33+05:30 [Info] logWriterStat:: 0 FlushedCount 16020000 QueuedCount 49950 2016-03-24T08:16:27.421+05:30 [Info] logWriterStat:: 0 FlushedCount 16030000 QueuedCount 49974 2016-03-24T08:16:27.505+05:30 [Info] logWriterStat:: 0 FlushedCount 16040000 QueuedCount 49777 2016-03-24T08:16:27.573+05:30 [Info] logWriterStat:: 0 FlushedCount 16050000 QueuedCount 47178 2016-03-24T08:16:27.658+05:30 [Info] logWriterStat:: 0 FlushedCount 16060000 QueuedCount 49924 2016-03-24T08:16:27.738+05:30 [Info] logWriterStat:: 0 FlushedCount 16070000 QueuedCount 49902 2016-03-24T08:16:27.817+05:30 [Info] logWriterStat:: 0 FlushedCount 16080000 QueuedCount 49985 2016-03-24T08:16:27.898+05:30 [Info] logWriterStat:: 0 FlushedCount 16090000 QueuedCount 49977 2016-03-24T08:16:27.981+05:30 [Info] logWriterStat:: 0 FlushedCount 16100000 QueuedCount 49965 2016-03-24T08:16:28.072+05:30 [Info] logWriterStat:: 0 FlushedCount 16110000 QueuedCount 49939 2016-03-24T08:16:28.152+05:30 [Info] logWriterStat:: 0 FlushedCount 16120000 QueuedCount 49936 2016-03-24T08:16:28.243+05:30 [Info] logWriterStat:: 0 FlushedCount 16130000 QueuedCount 49973 2016-03-24T08:16:28.327+05:30 [Info] logWriterStat:: 0 FlushedCount 16140000 QueuedCount 49972 2016-03-24T08:16:28.407+05:30 [Info] logWriterStat:: 0 FlushedCount 16150000 QueuedCount 49977 2016-03-24T08:16:28.487+05:30 [Info] logWriterStat:: 0 FlushedCount 16160000 QueuedCount 49973 2016-03-24T08:16:28.57+05:30 [Info] logWriterStat:: 0 FlushedCount 16170000 QueuedCount 49967 2016-03-24T08:16:28.646+05:30 [Info] logWriterStat:: 0 FlushedCount 16180000 QueuedCount 49962 2016-03-24T08:16:28.725+05:30 [Info] logWriterStat:: 0 FlushedCount 16190000 QueuedCount 49974 2016-03-24T08:16:28.809+05:30 [Info] logWriterStat:: 0 FlushedCount 16200000 QueuedCount 49953 2016-03-24T08:16:28.889+05:30 [Info] logWriterStat:: 0 FlushedCount 16210000 QueuedCount 49925 2016-03-24T08:16:28.968+05:30 [Info] logWriterStat:: 0 FlushedCount 16220000 QueuedCount 49998 2016-03-24T08:16:29.047+05:30 [Info] logWriterStat:: 0 FlushedCount 16230000 QueuedCount 49941 2016-03-24T08:16:29.125+05:30 [Info] logWriterStat:: 0 FlushedCount 16240000 QueuedCount 49871 2016-03-24T08:16:29.204+05:30 [Info] logWriterStat:: 0 FlushedCount 16250000 QueuedCount 49943 2016-03-24T08:16:29.293+05:30 [Info] logWriterStat:: 0 FlushedCount 16260000 QueuedCount 49835 2016-03-24T08:16:29.375+05:30 [Info] logWriterStat:: 0 FlushedCount 16270000 QueuedCount 49890 2016-03-24T08:16:29.457+05:30 [Info] logWriterStat:: 0 FlushedCount 16280000 QueuedCount 49982 2016-03-24T08:16:29.539+05:30 [Info] logWriterStat:: 0 FlushedCount 16290000 QueuedCount 49918 2016-03-24T08:16:29.619+05:30 [Info] logWriterStat:: 0 FlushedCount 16300000 QueuedCount 49990 2016-03-24T08:16:29.703+05:30 [Info] logWriterStat:: 0 FlushedCount 16310000 QueuedCount 49981 2016-03-24T08:16:29.78+05:30 [Info] logWriterStat:: 0 FlushedCount 16320000 QueuedCount 49772 2016-03-24T08:16:29.854+05:30 [Info] logWriterStat:: 0 FlushedCount 16330000 QueuedCount 47051 2016-03-24T08:16:29.935+05:30 [Info] logWriterStat:: 0 FlushedCount 16340000 QueuedCount 49976 2016-03-24T08:16:30.013+05:30 [Info] logWriterStat:: 0 FlushedCount 16350000 QueuedCount 49415 2016-03-24T08:16:30.122+05:30 [Info] logWriterStat:: 0 FlushedCount 16360000 QueuedCount 49906 2016-03-24T08:16:30.232+05:30 [Info] logWriterStat:: 0 FlushedCount 16370000 QueuedCount 49979 2016-03-24T08:16:30.32+05:30 [Info] logWriterStat:: 0 FlushedCount 16380000 QueuedCount 49926 2016-03-24T08:16:30.394+05:30 [Info] logWriterStat:: 0 FlushedCount 16390000 QueuedCount 44655 2016-03-24T08:16:30.468+05:30 [Info] logWriterStat:: 0 FlushedCount 16400000 QueuedCount 48431 2016-03-24T08:16:30.544+05:30 [Info] logWriterStat:: 0 FlushedCount 16410000 QueuedCount 48653 2016-03-24T08:16:30.625+05:30 [Info] logWriterStat:: 0 FlushedCount 16420000 QueuedCount 49910 2016-03-24T08:16:30.706+05:30 [Info] logWriterStat:: 0 FlushedCount 16430000 QueuedCount 49974 2016-03-24T08:16:30.784+05:30 [Info] logWriterStat:: 0 FlushedCount 16440000 QueuedCount 49818 2016-03-24T08:16:30.866+05:30 [Info] logWriterStat:: 0 FlushedCount 16450000 QueuedCount 49934 2016-03-24T08:16:30.944+05:30 [Info] logWriterStat:: 0 FlushedCount 16460000 QueuedCount 49900 2016-03-24T08:16:31.023+05:30 [Info] logWriterStat:: 0 FlushedCount 16470000 QueuedCount 49960 2016-03-24T08:16:31.116+05:30 [Info] logWriterStat:: 0 FlushedCount 16480000 QueuedCount 49986 2016-03-24T08:16:31.197+05:30 [Info] logWriterStat:: 0 FlushedCount 16490000 QueuedCount 49954 2016-03-24T08:16:31.278+05:30 [Info] logWriterStat:: 0 FlushedCount 16500000 QueuedCount 49971 2016-03-24T08:16:31.363+05:30 [Info] logWriterStat:: 0 FlushedCount 16510000 QueuedCount 49924 2016-03-24T08:16:31.444+05:30 [Info] logWriterStat:: 0 FlushedCount 16520000 QueuedCount 49977 2016-03-24T08:16:31.516+05:30 [Info] logWriterStat:: 0 FlushedCount 16530000 QueuedCount 48351 2016-03-24T08:16:31.592+05:30 [Info] logWriterStat:: 0 FlushedCount 16540000 QueuedCount 49946 2016-03-24T08:16:31.672+05:30 [Info] logWriterStat:: 0 FlushedCount 16550000 QueuedCount 49875 2016-03-24T08:16:31.752+05:30 [Info] logWriterStat:: 0 FlushedCount 16560000 QueuedCount 49996 2016-03-24T08:16:31.835+05:30 [Info] logWriterStat:: 0 FlushedCount 16570000 QueuedCount 49993 2016-03-24T08:16:31.916+05:30 [Info] logWriterStat:: 0 FlushedCount 16580000 QueuedCount 49957 2016-03-24T08:16:32.02+05:30 [Info] logWriterStat:: 0 FlushedCount 16590000 QueuedCount 49962 2016-03-24T08:16:32.25+05:30 [Info] logWriterStat:: 0 FlushedCount 16600000 QueuedCount 49355 2016-03-24T08:16:32.628+05:30 [Info] logWriterStat:: 0 FlushedCount 16610000 QueuedCount 49357 2016-03-24T08:16:32.881+05:30 [Info] logWriterStat:: 0 FlushedCount 16620000 QueuedCount 49999 2016-03-24T08:16:33.013+05:30 [Info] logWriterStat:: 0 FlushedCount 16630000 QueuedCount 49909 2016-03-24T08:16:33.16+05:30 [Info] logWriterStat:: 0 FlushedCount 16640000 QueuedCount 49866 2016-03-24T08:16:33.299+05:30 [Info] logWriterStat:: 0 FlushedCount 16650000 QueuedCount 49997 2016-03-24T08:16:33.449+05:30 [Info] logWriterStat:: 0 FlushedCount 16660000 QueuedCount 49405 2016-03-24T08:16:33.584+05:30 [Info] logWriterStat:: 0 FlushedCount 16670000 QueuedCount 49983 2016-03-24T08:16:33.719+05:30 [Info] logWriterStat:: 0 FlushedCount 16680000 QueuedCount 49918 2016-03-24T08:16:33.835+05:30 [Info] logWriterStat:: 0 FlushedCount 16690000 QueuedCount 49967 2016-03-24T08:16:33.968+05:30 [Info] logWriterStat:: 0 FlushedCount 16700000 QueuedCount 49996 2016-03-24T08:16:34.112+05:30 [Info] logWriterStat:: 0 FlushedCount 16710000 QueuedCount 49979 2016-03-24T08:16:34.255+05:30 [Info] logWriterStat:: 0 FlushedCount 16720000 QueuedCount 49770 2016-03-24T08:16:34.386+05:30 [Info] logWriterStat:: 0 FlushedCount 16730000 QueuedCount 49770 2016-03-24T08:16:34.521+05:30 [Info] logWriterStat:: 0 FlushedCount 16740000 QueuedCount 49980 2016-03-24T08:16:34.654+05:30 [Info] logWriterStat:: 0 FlushedCount 16750000 QueuedCount 49886 2016-03-24T08:16:34.762+05:30 [Info] logWriterStat:: 0 FlushedCount 16760000 QueuedCount 49847 2016-03-24T08:16:34.915+05:30 [Info] logWriterStat:: 0 FlushedCount 16770000 QueuedCount 49933 2016-03-24T08:16:35.014+05:30 [Info] logWriterStat:: 0 FlushedCount 16780000 QueuedCount 49937 2016-03-24T08:16:35.105+05:30 [Info] logWriterStat:: 0 FlushedCount 16790000 QueuedCount 49932 2016-03-24T08:16:35.184+05:30 [Info] logWriterStat:: 0 FlushedCount 16800000 QueuedCount 49983 2016-03-24T08:16:35.278+05:30 [Info] logWriterStat:: 0 FlushedCount 16810000 QueuedCount 49995 2016-03-24T08:16:35.358+05:30 [Info] logWriterStat:: 0 FlushedCount 16820000 QueuedCount 49950 2016-03-24T08:16:35.44+05:30 [Info] logWriterStat:: 0 FlushedCount 16830000 QueuedCount 49909 2016-03-24T08:16:35.522+05:30 [Info] logWriterStat:: 0 FlushedCount 16840000 QueuedCount 49950 2016-03-24T08:16:35.599+05:30 [Info] logWriterStat:: 0 FlushedCount 16850000 QueuedCount 49971 2016-03-24T08:16:35.68+05:30 [Info] logWriterStat:: 0 FlushedCount 16860000 QueuedCount 49960 2016-03-24T08:16:35.761+05:30 [Info] logWriterStat:: 0 FlushedCount 16870000 QueuedCount 49955 2016-03-24T08:16:35.839+05:30 [Info] logWriterStat:: 0 FlushedCount 16880000 QueuedCount 49885 2016-03-24T08:16:35.919+05:30 [Info] logWriterStat:: 0 FlushedCount 16890000 QueuedCount 49970 2016-03-24T08:16:36.003+05:30 [Info] logWriterStat:: 0 FlushedCount 16900000 QueuedCount 49961 2016-03-24T08:16:36.096+05:30 [Info] logWriterStat:: 0 FlushedCount 16910000 QueuedCount 49960 2016-03-24T08:16:36.179+05:30 [Info] logWriterStat:: 0 FlushedCount 16920000 QueuedCount 49959 2016-03-24T08:16:36.266+05:30 [Info] logWriterStat:: 0 FlushedCount 16930000 QueuedCount 50000 2016-03-24T08:16:36.346+05:30 [Info] logWriterStat:: 0 FlushedCount 16940000 QueuedCount 49982 2016-03-24T08:16:36.429+05:30 [Info] logWriterStat:: 0 FlushedCount 16950000 QueuedCount 49988 2016-03-24T08:16:36.511+05:30 [Info] logWriterStat:: 0 FlushedCount 16960000 QueuedCount 49980 2016-03-24T08:16:36.593+05:30 [Info] logWriterStat:: 0 FlushedCount 16970000 QueuedCount 49985 2016-03-24T08:16:36.675+05:30 [Info] logWriterStat:: 0 FlushedCount 16980000 QueuedCount 49932 2016-03-24T08:16:36.758+05:30 [Info] logWriterStat:: 0 FlushedCount 16990000 QueuedCount 49961 2016-03-24T08:16:36.837+05:30 [Info] logWriterStat:: 0 FlushedCount 17000000 QueuedCount 49862 2016-03-24T08:16:36.92+05:30 [Info] logWriterStat:: 0 FlushedCount 17010000 QueuedCount 49943 2016-03-24T08:16:37.015+05:30 [Info] logWriterStat:: 0 FlushedCount 17020000 QueuedCount 49985 2016-03-24T08:16:37.114+05:30 [Info] logWriterStat:: 0 FlushedCount 17030000 QueuedCount 49980 2016-03-24T08:16:37.201+05:30 [Info] logWriterStat:: 0 FlushedCount 17040000 QueuedCount 49959 2016-03-24T08:16:37.281+05:30 [Info] logWriterStat:: 0 FlushedCount 17050000 QueuedCount 49974 2016-03-24T08:16:37.362+05:30 [Info] logWriterStat:: 0 FlushedCount 17060000 QueuedCount 49976 2016-03-24T08:16:37.443+05:30 [Info] logWriterStat:: 0 FlushedCount 17070000 QueuedCount 49972 2016-03-24T08:16:37.529+05:30 [Info] logWriterStat:: 0 FlushedCount 17080000 QueuedCount 49974 2016-03-24T08:16:37.609+05:30 [Info] logWriterStat:: 0 FlushedCount 17090000 QueuedCount 49977 2016-03-24T08:16:37.69+05:30 [Info] logWriterStat:: 0 FlushedCount 17100000 QueuedCount 49893 2016-03-24T08:16:37.772+05:30 [Info] logWriterStat:: 0 FlushedCount 17110000 QueuedCount 49982 2016-03-24T08:16:37.856+05:30 [Info] logWriterStat:: 0 FlushedCount 17120000 QueuedCount 49963 2016-03-24T08:16:37.937+05:30 [Info] logWriterStat:: 0 FlushedCount 17130000 QueuedCount 49984 2016-03-24T08:16:38.014+05:30 [Info] logWriterStat:: 0 FlushedCount 17140000 QueuedCount 49977 2016-03-24T08:16:38.103+05:30 [Info] logWriterStat:: 0 FlushedCount 17150000 QueuedCount 49920 2016-03-24T08:16:38.189+05:30 [Info] logWriterStat:: 0 FlushedCount 17160000 QueuedCount 49954 2016-03-24T08:16:38.27+05:30 [Info] logWriterStat:: 0 FlushedCount 17170000 QueuedCount 49982 2016-03-24T08:16:38.348+05:30 [Info] logWriterStat:: 0 FlushedCount 17180000 QueuedCount 49976 2016-03-24T08:16:38.434+05:30 [Info] logWriterStat:: 0 FlushedCount 17190000 QueuedCount 49951 2016-03-24T08:16:38.515+05:30 [Info] logWriterStat:: 0 FlushedCount 17200000 QueuedCount 49957 2016-03-24T08:16:38.596+05:30 [Info] logWriterStat:: 0 FlushedCount 17210000 QueuedCount 49961 2016-03-24T08:16:38.678+05:30 [Info] logWriterStat:: 0 FlushedCount 17220000 QueuedCount 49980 2016-03-24T08:16:38.759+05:30 [Info] logWriterStat:: 0 FlushedCount 17230000 QueuedCount 49952 2016-03-24T08:16:38.84+05:30 [Info] logWriterStat:: 0 FlushedCount 17240000 QueuedCount 49977 2016-03-24T08:16:38.924+05:30 [Info] logWriterStat:: 0 FlushedCount 17250000 QueuedCount 49968 2016-03-24T08:16:39.002+05:30 [Info] logWriterStat:: 0 FlushedCount 17260000 QueuedCount 49972 2016-03-24T08:16:39.092+05:30 [Info] logWriterStat:: 0 FlushedCount 17270000 QueuedCount 49956 2016-03-24T08:16:39.172+05:30 [Info] logWriterStat:: 0 FlushedCount 17280000 QueuedCount 49970 2016-03-24T08:16:39.269+05:30 [Info] logWriterStat:: 0 FlushedCount 17290000 QueuedCount 49230 2016-03-24T08:16:39.353+05:30 [Info] logWriterStat:: 0 FlushedCount 17300000 QueuedCount 49976 2016-03-24T08:16:39.436+05:30 [Info] logWriterStat:: 0 FlushedCount 17310000 QueuedCount 49984 2016-03-24T08:16:39.517+05:30 [Info] logWriterStat:: 0 FlushedCount 17320000 QueuedCount 49964 2016-03-24T08:16:39.596+05:30 [Info] logWriterStat:: 0 FlushedCount 17330000 QueuedCount 49985 2016-03-24T08:16:39.677+05:30 [Info] logWriterStat:: 0 FlushedCount 17340000 QueuedCount 49963 2016-03-24T08:16:39.755+05:30 [Info] logWriterStat:: 0 FlushedCount 17350000 QueuedCount 49012 2016-03-24T08:16:39.836+05:30 [Info] logWriterStat:: 0 FlushedCount 17360000 QueuedCount 49938 2016-03-24T08:16:39.916+05:30 [Info] logWriterStat:: 0 FlushedCount 17370000 QueuedCount 49959 2016-03-24T08:16:39.99+05:30 [Info] logWriterStat:: 0 FlushedCount 17380000 QueuedCount 47301 2016-03-24T08:16:40.096+05:30 [Info] logWriterStat:: 0 FlushedCount 17390000 QueuedCount 49991 2016-03-24T08:16:40.197+05:30 [Info] logWriterStat:: 0 FlushedCount 17400000 QueuedCount 49967 2016-03-24T08:16:40.286+05:30 [Info] logWriterStat:: 0 FlushedCount 17410000 QueuedCount 49931 2016-03-24T08:16:40.369+05:30 [Info] logWriterStat:: 0 FlushedCount 17420000 QueuedCount 49919 2016-03-24T08:16:40.45+05:30 [Info] logWriterStat:: 0 FlushedCount 17430000 QueuedCount 49976 2016-03-24T08:16:40.53+05:30 [Info] logWriterStat:: 0 FlushedCount 17440000 QueuedCount 49985 2016-03-24T08:16:40.613+05:30 [Info] logWriterStat:: 0 FlushedCount 17450000 QueuedCount 49881 2016-03-24T08:16:40.696+05:30 [Info] logWriterStat:: 0 FlushedCount 17460000 QueuedCount 49975 2016-03-24T08:16:40.776+05:30 [Info] logWriterStat:: 0 FlushedCount 17470000 QueuedCount 49968 2016-03-24T08:16:40.859+05:30 [Info] logWriterStat:: 0 FlushedCount 17480000 QueuedCount 49569 2016-03-24T08:16:40.942+05:30 [Info] logWriterStat:: 0 FlushedCount 17490000 QueuedCount 48893 2016-03-24T08:16:41.025+05:30 [Info] logWriterStat:: 0 FlushedCount 17500000 QueuedCount 47914 2016-03-24T08:16:41.112+05:30 [Info] logWriterStat:: 0 FlushedCount 17510000 QueuedCount 46573 2016-03-24T08:16:41.192+05:30 [Info] logWriterStat:: 0 FlushedCount 17520000 QueuedCount 45021 2016-03-24T08:16:41.273+05:30 [Info] logWriterStat:: 0 FlushedCount 17530000 QueuedCount 44302 2016-03-24T08:16:41.356+05:30 [Info] logWriterStat:: 0 FlushedCount 17540000 QueuedCount 43719 2016-03-24T08:16:41.441+05:30 [Info] logWriterStat:: 0 FlushedCount 17550000 QueuedCount 43690 2016-03-24T08:16:41.524+05:30 [Info] logWriterStat:: 0 FlushedCount 17560000 QueuedCount 43739 2016-03-24T08:16:41.605+05:30 [Info] logWriterStat:: 0 FlushedCount 17570000 QueuedCount 43748 2016-03-24T08:16:41.685+05:30 [Info] logWriterStat:: 0 FlushedCount 17580000 QueuedCount 43722 2016-03-24T08:16:41.77+05:30 [Info] logWriterStat:: 0 FlushedCount 17590000 QueuedCount 43734 2016-03-24T08:16:41.846+05:30 [Info] logWriterStat:: 0 FlushedCount 17600000 QueuedCount 43731 2016-03-24T08:16:41.928+05:30 [Info] logWriterStat:: 0 FlushedCount 17610000 QueuedCount 43722 2016-03-24T08:16:42.005+05:30 [Info] logWriterStat:: 0 FlushedCount 17620000 QueuedCount 43565 2016-03-24T08:16:42.111+05:30 [Info] logWriterStat:: 0 FlushedCount 17630000 QueuedCount 43726 2016-03-24T08:16:42.198+05:30 [Info] logWriterStat:: 0 FlushedCount 17640000 QueuedCount 43664 2016-03-24T08:16:42.281+05:30 [Info] logWriterStat:: 0 FlushedCount 17650000 QueuedCount 43684 2016-03-24T08:16:42.361+05:30 [Info] logWriterStat:: 0 FlushedCount 17660000 QueuedCount 43727 2016-03-24T08:16:42.444+05:30 [Info] logWriterStat:: 0 FlushedCount 17670000 QueuedCount 43710 2016-03-24T08:16:42.527+05:30 [Info] logWriterStat:: 0 FlushedCount 17680000 QueuedCount 43698 2016-03-24T08:16:42.613+05:30 [Info] logWriterStat:: 0 FlushedCount 17690000 QueuedCount 43716 2016-03-24T08:16:42.697+05:30 [Info] logWriterStat:: 0 FlushedCount 17700000 QueuedCount 43725 2016-03-24T08:16:42.781+05:30 [Info] logWriterStat:: 0 FlushedCount 17710000 QueuedCount 43710 2016-03-24T08:16:42.864+05:30 [Info] logWriterStat:: 0 FlushedCount 17720000 QueuedCount 43701 2016-03-24T08:16:42.946+05:30 [Info] logWriterStat:: 0 FlushedCount 17730000 QueuedCount 43741 2016-03-24T08:16:43.027+05:30 [Info] logWriterStat:: 0 FlushedCount 17740000 QueuedCount 43705 2016-03-24T08:16:43.118+05:30 [Info] logWriterStat:: 0 FlushedCount 17750000 QueuedCount 43730 2016-03-24T08:16:43.196+05:30 [Info] logWriterStat:: 0 FlushedCount 17760000 QueuedCount 43719 2016-03-24T08:16:43.279+05:30 [Info] logWriterStat:: 0 FlushedCount 17770000 QueuedCount 43732 2016-03-24T08:16:43.364+05:30 [Info] logWriterStat:: 0 FlushedCount 17780000 QueuedCount 43233 2016-03-24T08:16:43.451+05:30 [Info] logWriterStat:: 0 FlushedCount 17790000 QueuedCount 42481 2016-03-24T08:16:43.537+05:30 [Info] logWriterStat:: 0 FlushedCount 17800000 QueuedCount 41231 2016-03-24T08:16:43.622+05:30 [Info] logWriterStat:: 0 FlushedCount 17810000 QueuedCount 39923 2016-03-24T08:16:43.7+05:30 [Info] logWriterStat:: 0 FlushedCount 17820000 QueuedCount 38268 2016-03-24T08:16:43.781+05:30 [Info] logWriterStat:: 0 FlushedCount 17830000 QueuedCount 37448 2016-03-24T08:16:43.858+05:30 [Info] logWriterStat:: 0 FlushedCount 17840000 QueuedCount 37426 2016-03-24T08:16:43.936+05:30 [Info] logWriterStat:: 0 FlushedCount 17850000 QueuedCount 37422 2016-03-24T08:16:44.019+05:30 [Info] logWriterStat:: 0 FlushedCount 17860000 QueuedCount 36905 2016-03-24T08:16:44.117+05:30 [Info] logWriterStat:: 0 FlushedCount 17870000 QueuedCount 35947 2016-03-24T08:16:44.204+05:30 [Info] logWriterStat:: 0 FlushedCount 17880000 QueuedCount 35109 2016-03-24T08:16:44.298+05:30 [Info] logWriterStat:: 0 FlushedCount 17890000 QueuedCount 34329 2016-03-24T08:16:44.385+05:30 [Info] logWriterStat:: 0 FlushedCount 17900000 QueuedCount 33713 2016-03-24T08:16:44.466+05:30 [Info] logWriterStat:: 0 FlushedCount 17910000 QueuedCount 31263 2016-03-24T08:16:44.547+05:30 [Info] logWriterStat:: 0 FlushedCount 17920000 QueuedCount 27733 2016-03-24T08:16:44.625+05:30 [Info] logWriterStat:: 0 FlushedCount 17930000 QueuedCount 24222 2016-03-24T08:16:44.696+05:30 [Info] logWriterStat:: 0 FlushedCount 17940000 QueuedCount 21505 2016-03-24T08:16:44.773+05:30 [Info] logWriterStat:: 0 FlushedCount 17950000 QueuedCount 18891 2016-03-24T08:16:44.848+05:30 [Info] logWriterStat:: 0 FlushedCount 17960000 QueuedCount 15616 2016-03-24T08:16:44.918+05:30 [Info] logWriterStat:: 0 FlushedCount 17970000 QueuedCount 13093 2016-03-24T08:16:44.986+05:30 [Info] logWriterStat:: 0 FlushedCount 17980000 QueuedCount 10183 2016-03-24T08:16:45.065+05:30 [Info] logWriterStat:: 0 FlushedCount 17990000 QueuedCount 6485 2016-03-24T08:16:45.191+05:30 [Info] logWriterStat:: 0 FlushedCount 18000000 QueuedCount 0 2016-03-24T08:16:45.191+05:30 [Info] MemDBSlice::OpenSnapshot SliceId 0 IndexInstId 0 Creating New Snapshot SnapshotInfo: count:10000000 committed:false Initial build: 10000000 items took 1m12.774936623s -> 137409.9444676063 items/s Incr build: 10000000 items took 1m35.55970739s -> 104646.61595485867 items/s Main Index: node_count = 18000000 soft_deletes = 0 read_conflicts = 0 insert_conflicts = 4 next_pointers_per_node = 1.3333 memory_used = 1695887740 node_allocs = 18000000 node_frees = 0 level_node_distribution: level0 => 13500190 level1 => 3375549 level2 => 843074 level3 => 210794 level4 => 52734 level5 => 13348 level6 => 3245 level7 => 782 level8 => 221 level9 => 42 level10 => 17 level11 => 3 level12 => 1 level13 => 0 level14 => 0 level15 => 0 level16 => 0 level17 => 0 level18 => 0 level19 => 0 level20 => 0 level21 => 0 level22 => 0 level23 => 0 level24 => 0 level25 => 0 level26 => 0 level27 => 0 level28 => 0 level29 => 0 level30 => 0 level31 => 0 level32 => 0 Back Index 0 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 1 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 2 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 3 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 4 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 5 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 6 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 7 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 8 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 9 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 10 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 11 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 12 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 13 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 14 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 Back Index 15 : FastHTCount = 625000 SlowHTCount = 0 Conflicts = 0 MemoryInUse = 26250000 --- PASS: TestMemDBInsertionPerf (168.34s) PASS ok github.com/couchbase/indexing/secondary/indexer 168.848s Functional tests 2016/03/24 08:16:50 In init() 2016/03/24 08:16:50 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000 2016/03/24 08:16:50 Type of settings value is float64 2016/03/24 08:16:50 Type of config value that was updated is float64 2016/03/24 08:16:50 After updation, Setting is indexer.settings.persisted_snapshot_init_build.moi.interval = 60000 2016/03/24 08:16:50 Settings updated indexer.settings.persisted_snapshot_init_build.moi.interval = 60000 2016/03/24 08:16:50 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000 2016/03/24 08:16:50 Type of settings value is float64 2016/03/24 08:16:50 Type of config value that was updated is float64 2016/03/24 08:16:50 After updation, Setting is indexer.settings.persisted_snapshot.moi.interval = 60000 2016/03/24 08:16:50 Settings updated indexer.settings.persisted_snapshot.moi.interval = 60000 2016/03/24 08:16:50 Using forestdb for creating indexes 2016/03/24 08:16:50 Changing config key indexer.settings.storage_mode to value forestdb 2016/03/24 08:16:51 Type of settings value is string 2016/03/24 08:16:51 Type of config value that was updated is string 2016/03/24 08:16:51 After updation, Setting is indexer.settings.storage_mode = forestdb 2016/03/24 08:16:51 Settings updated indexer.settings.storage_mode = forestdb 2016/03/24 08:16:56 In DropAllSecondaryIndexes() 2016/03/24 08:17:01 Data file exists. Skipping download 2016/03/24 08:17:01 Data file exists. Skipping download 2016/03/24 08:17:02 Emptying the default bucket 2016/03/24 08:17:05 Flush Enabled on bucket default 2016/03/24 08:17:29 Flushed the bucket default 2016/03/24 08:17:34 Create Index On the empty default Bucket() 2016/03/24 08:17:36 Created the secondary index index_eyeColor. Waiting for it become active 2016/03/24 08:17:36 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:17:36 Index is now active 2016/03/24 08:17:36 PERFSTAT CreateAndBuildIndex 1.8657 seconds 2016/03/24 08:17:36 Populating the default bucket === RUN TestScanAfterBucketPopulate 2016/03/24 08:17:46 In TestScanAfterBucketPopulate() 2016/03/24 08:17:46 Create an index on empty bucket, populate the bucket and Run a scan on the index 2016/03/24 08:17:46 PERFSTAT Range 0.2240 seconds 2016/03/24 08:17:46 Expected and Actual scan responses are the same --- PASS: TestScanAfterBucketPopulate (0.28s) === RUN TestThreeIndexCreates 2016/03/24 08:17:46 In TestThreeIndexCreates() 2016/03/24 08:17:49 Created the secondary index index_balance. Waiting for it become active 2016/03/24 08:17:49 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:17:49 Index is now active 2016/03/24 08:17:49 PERFSTAT CreateAndBuildIndex 3.0328 seconds 2016/03/24 08:17:49 Create docs mutations 2016/03/24 08:17:50 PERFSTAT Range 0.2266 seconds 2016/03/24 08:17:50 Expected and Actual scan responses are the same 2016/03/24 08:17:53 Created the secondary index index_email. Waiting for it become active 2016/03/24 08:17:53 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:17:53 Index is now active 2016/03/24 08:17:53 PERFSTAT CreateAndBuildIndex 3.0295 seconds 2016/03/24 08:17:53 Create docs mutations 2016/03/24 08:17:53 PERFSTAT Range 0.0400 seconds 2016/03/24 08:17:53 Expected and Actual scan responses are the same 2016/03/24 08:17:56 Created the secondary index index_pin. Waiting for it become active 2016/03/24 08:17:56 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:17:56 Index is now active 2016/03/24 08:17:56 PERFSTAT CreateAndBuildIndex 3.1102 seconds 2016/03/24 08:17:56 Delete docs mutations 2016/03/24 08:17:57 PERFSTAT Range 0.1938 seconds 2016/03/24 08:17:57 Expected and Actual scan responses are the same --- PASS: TestThreeIndexCreates (10.32s) === RUN TestMultipleIndexCreatesDropsWithMutations 2016/03/24 08:17:57 In TestThreeIndexCreates() 2016/03/24 08:18:00 Created the secondary index index_state. Waiting for it become active 2016/03/24 08:18:00 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:00 Index is now active 2016/03/24 08:18:00 PERFSTAT CreateAndBuildIndex 3.1733 seconds 2016/03/24 08:18:00 Create docs mutations 2016/03/24 08:18:00 PERFSTAT Range 0.2809 seconds 2016/03/24 08:18:00 Expected and Actual scan responses are the same 2016/03/24 08:18:03 Created the secondary index index_registered. Waiting for it become active 2016/03/24 08:18:03 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:03 Index is now active 2016/03/24 08:18:03 PERFSTAT CreateAndBuildIndex 3.0836 seconds 2016/03/24 08:18:03 Create docs mutations 2016/03/24 08:18:04 PERFSTAT Range 0.2239 seconds 2016/03/24 08:18:04 Expected and Actual scan responses are the same 2016/03/24 08:18:07 Created the secondary index index_gender. Waiting for it become active 2016/03/24 08:18:07 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:07 Index is now active 2016/03/24 08:18:07 PERFSTAT CreateAndBuildIndex 3.0572 seconds 2016/03/24 08:18:07 Create docs mutations 2016/03/24 08:18:07 PERFSTAT Lookup 0.1786 seconds 2016/03/24 08:18:07 Expected and Actual scan responses are the same 2016/03/24 08:18:07 Dropping the secondary index index_registered 2016/03/24 08:18:07 Index dropped 2016/03/24 08:18:07 PERFSTAT DropIndex 0.0155 seconds 2016/03/24 08:18:07 Create docs mutations 2016/03/24 08:18:07 Delete docs mutations 2016/03/24 08:18:08 PERFSTAT Range 0.2182 seconds 2016/03/24 08:18:08 Expected and Actual scan responses are the same 2016/03/24 08:18:11 Created the secondary index index_longitude. Waiting for it become active 2016/03/24 08:18:11 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:11 Index is now active 2016/03/24 08:18:11 PERFSTAT CreateAndBuildIndex 3.1356 seconds 2016/03/24 08:18:11 Create docs mutations 2016/03/24 08:18:11 PERFSTAT Range 0.2800 seconds 2016/03/24 08:18:11 Expected and Actual scan responses are the same --- PASS: TestMultipleIndexCreatesDropsWithMutations (14.87s) === RUN TestCreateDropScan 2016/03/24 08:18:11 In TestCreateDropScan() 2016/03/24 08:18:14 Created the secondary index index_cd. Waiting for it become active 2016/03/24 08:18:14 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:14 Index is now active 2016/03/24 08:18:14 PERFSTAT CreateAndBuildIndex 3.0450 seconds 2016/03/24 08:18:15 PERFSTAT Range 0.0954 seconds 2016/03/24 08:18:15 Expected and Actual scan responses are the same 2016/03/24 08:18:15 Dropping the secondary index index_cd 2016/03/24 08:18:15 Index dropped 2016/03/24 08:18:15 PERFSTAT DropIndex 0.0187 seconds 2016/03/24 08:18:15 Connection error in Scan occured: queryport.indexNotFound 2016/03/24 08:18:15 Scan failed as expected with error: queryport.indexNotFound --- PASS: TestCreateDropScan (3.25s) === RUN TestCreateDropCreate 2016/03/24 08:18:15 In TestCreateDropCreate() 2016/03/24 08:18:18 Created the secondary index index_cdc. Waiting for it become active 2016/03/24 08:18:18 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:18 Index is now active 2016/03/24 08:18:18 PERFSTAT CreateAndBuildIndex 3.1519 seconds 2016/03/24 08:18:18 PERFSTAT Range 0.0701 seconds 2016/03/24 08:18:18 Expected and Actual scan responses are the same 2016/03/24 08:18:18 Dropping the secondary index index_cdc 2016/03/24 08:18:18 Index dropped 2016/03/24 08:18:18 PERFSTAT DropIndex 0.0161 seconds 2016/03/24 08:18:18 Connection error in Scan occured: queryport.indexNotFound 2016/03/24 08:18:18 Scan 2 failed as expected with error: queryport.indexNotFound 2016/03/24 08:18:21 Created the secondary index index_cdc. Waiting for it become active 2016/03/24 08:18:21 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:21 Index is now active 2016/03/24 08:18:21 PERFSTAT CreateAndBuildIndex 3.0665 seconds 2016/03/24 08:18:21 PERFSTAT Range 0.0691 seconds 2016/03/24 08:18:21 Expected and Actual scan responses are the same 2016/03/24 08:18:21 (Inclusion 1) Lengths of expected and actual scan results are 5040 and 5040. Num of docs in bucket = 10402 2016/03/24 08:18:21 PERFSTAT Range 0.0709 seconds 2016/03/24 08:18:21 Expected and Actual scan responses are the same 2016/03/24 08:18:21 (Inclusion 3) Lengths of expected and actual scan results are 5040 and 5040. Num of docs in bucket = 10402 --- PASS: TestCreateDropCreate (6.70s) === RUN TestCreate2Drop1Scan2 2016/03/24 08:18:21 In TestCreate2Drop1Scan2() 2016/03/24 08:18:25 Created the secondary index index_i1. Waiting for it become active 2016/03/24 08:18:25 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:25 Index is now active 2016/03/24 08:18:25 PERFSTAT CreateAndBuildIndex 3.0941 seconds 2016/03/24 08:18:28 Created the secondary index index_i2. Waiting for it become active 2016/03/24 08:18:28 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:28 Index is now active 2016/03/24 08:18:28 PERFSTAT CreateAndBuildIndex 3.0429 seconds 2016/03/24 08:18:28 PERFSTAT Range 0.0724 seconds 2016/03/24 08:18:28 Expected and Actual scan responses are the same 2016/03/24 08:18:28 PERFSTAT Range 0.0787 seconds 2016/03/24 08:18:28 Expected and Actual scan responses are the same 2016/03/24 08:18:28 Dropping the secondary index index_i1 2016/03/24 08:18:28 Index dropped 2016/03/24 08:18:28 PERFSTAT DropIndex 0.0197 seconds 2016/03/24 08:18:28 PERFSTAT Range 0.1428 seconds 2016/03/24 08:18:28 Expected and Actual scan responses are the same --- PASS: TestCreate2Drop1Scan2 (6.60s) === RUN TestIndexNameCaseSensitivity 2016/03/24 08:18:28 In TestIndexNameCaseSensitivity() 2016/03/24 08:18:31 Created the secondary index index_age. Waiting for it become active 2016/03/24 08:18:31 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:31 Index is now active 2016/03/24 08:18:31 PERFSTAT CreateAndBuildIndex 3.0700 seconds 2016/03/24 08:18:31 PERFSTAT Range 0.0389 seconds 2016/03/24 08:18:31 Expected and Actual scan responses are the same 2016/03/24 08:18:31 Connection error in Scan occured: queryport.indexNotFound 2016/03/24 08:18:31 Scan failed as expected with error: queryport.indexNotFound --- PASS: TestIndexNameCaseSensitivity (3.16s) === RUN TestCreateDuplicateIndex 2016/03/24 08:18:31 In TestCreateDuplicateIndex() 2016/03/24 08:18:34 Created the secondary index index_di1. Waiting for it become active 2016/03/24 08:18:34 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:34 Index is now active 2016/03/24 08:18:34 PERFSTAT CreateAndBuildIndex 3.0978 seconds 2016/03/24 08:18:34 Index found: index_di1 2016/03/24 08:18:34 Create failed as expected with error: Index index_di1 already exist. --- PASS: TestCreateDuplicateIndex (3.13s) === RUN TestDropNonExistingIndex 2016/03/24 08:18:34 In TestDropNonExistingIndex() 2016/03/24 08:18:34 Dropping the secondary index 123456 2016/03/24 08:18:34 Index drop failed as expected with error: Index does not exist. --- PASS: TestDropNonExistingIndex (0.01s) === RUN TestCreateIndexNonExistentBucket 2016/03/24 08:18:34 In TestCreateIndexNonExistentBucket() 2016/03/24 08:18:34 Index create failed as expected with error: Bucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time (err=Bucket not found). --- PASS: TestCreateIndexNonExistentBucket (0.02s) === RUN TestScanWithNoTimeout 2016/03/24 08:18:34 Create an index on empty bucket, populate the bucket and Run a scan on the index 2016/03/24 08:18:34 Changing config key indexer.settings.scan_timeout to value 0 2016/03/24 08:18:34 Type of settings value is float64 2016/03/24 08:18:34 Type of config value that was updated is float64 2016/03/24 08:18:34 After updation, Setting is indexer.settings.scan_timeout = 0 2016/03/24 08:18:34 Settings updated indexer.settings.scan_timeout = 0 2016/03/24 08:18:35 PERFSTAT Range 0.1822 seconds 2016/03/24 08:18:35 Expected and Actual scan responses are the same --- PASS: TestScanWithNoTimeout (0.51s) === RUN TestSimpleIndex_FloatDataType 2016/03/24 08:18:35 In TestSimpleIndex_FloatDataType() 2016/03/24 08:18:35 Index found: index_age 2016/03/24 08:18:35 PERFSTAT Range 0.0402 seconds 2016/03/24 08:18:35 Expected and Actual scan responses are the same --- PASS: TestSimpleIndex_FloatDataType (0.08s) === RUN TestSimpleIndex_StringDataType 2016/03/24 08:18:35 In TestSimpleIndex_StringDataType() 2016/03/24 08:18:38 Created the secondary index index_company. Waiting for it become active 2016/03/24 08:18:38 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:38 Index is now active 2016/03/24 08:18:38 PERFSTAT CreateAndBuildIndex 3.0502 seconds 2016/03/24 08:18:38 PERFSTAT Range 0.0578 seconds 2016/03/24 08:18:38 Expected and Actual scan responses are the same 2016/03/24 08:18:38 PERFSTAT Range 0.1403 seconds 2016/03/24 08:18:38 Expected and Actual scan responses are the same --- PASS: TestSimpleIndex_StringDataType (3.38s) === RUN TestSimpleIndex_FieldValueCaseSensitivity 2016/03/24 08:18:38 In TestSimpleIndex_StringCaseSensitivity() 2016/03/24 08:18:38 Index found: index_company 2016/03/24 08:18:38 PERFSTAT Range 0.0107 seconds 2016/03/24 08:18:38 Expected and Actual scan responses are the same 2016/03/24 08:18:38 PERFSTAT Range 0.1241 seconds 2016/03/24 08:18:38 Expected and Actual scan responses are the same --- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.21s) === RUN TestSimpleIndex_BoolDataType 2016/03/24 08:18:38 In TestSimpleIndex_BoolDataType() 2016/03/24 08:18:42 Created the secondary index index_isActive. Waiting for it become active 2016/03/24 08:18:42 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:42 Index is now active 2016/03/24 08:18:42 PERFSTAT CreateAndBuildIndex 3.2023 seconds 2016/03/24 08:18:42 PERFSTAT Range 0.0657 seconds 2016/03/24 08:18:42 Expected and Actual scan responses are the same --- PASS: TestSimpleIndex_BoolDataType (3.31s) === RUN TestBasicLookup 2016/03/24 08:18:42 In TestBasicLookup() 2016/03/24 08:18:42 Index found: index_company 2016/03/24 08:18:42 PERFSTAT Lookup 0.0034 seconds 2016/03/24 08:18:42 Expected and Actual scan responses are the same --- PASS: TestBasicLookup (0.04s) === RUN TestIndexOnNonExistentField 2016/03/24 08:18:42 In TestIndexOnNonExistentField() 2016/03/24 08:18:45 Created the secondary index index_height. Waiting for it become active 2016/03/24 08:18:45 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:45 Index is now active 2016/03/24 08:18:45 PERFSTAT CreateAndBuildIndex 2.9740 seconds 2016/03/24 08:18:45 PERFSTAT Range 0.0032 seconds 2016/03/24 08:18:45 Expected and Actual scan responses are the same --- PASS: TestIndexOnNonExistentField (3.02s) === RUN TestIndexPartiallyMissingField 2016/03/24 08:18:45 In TestIndexPartiallyMissingField() 2016/03/24 08:18:48 Created the secondary index index_nationality. Waiting for it become active 2016/03/24 08:18:48 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:48 Index is now active 2016/03/24 08:18:48 PERFSTAT CreateAndBuildIndex 2.9571 seconds 2016/03/24 08:18:48 PERFSTAT Range 0.0032 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestIndexPartiallyMissingField (3.00s) === RUN TestScanNonMatchingDatatype 2016/03/24 08:18:48 In TestScanNonMatchingDatatype() 2016/03/24 08:18:48 Index found: index_age 2016/03/24 08:18:48 PERFSTAT Range 0.0031 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestScanNonMatchingDatatype (0.03s) === RUN TestInclusionNeither 2016/03/24 08:18:48 In TestInclusionNeither() 2016/03/24 08:18:48 Index found: index_age 2016/03/24 08:18:48 PERFSTAT Range 0.0334 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestInclusionNeither (0.07s) === RUN TestInclusionLow 2016/03/24 08:18:48 In TestInclusionLow() 2016/03/24 08:18:48 Index found: index_age 2016/03/24 08:18:48 PERFSTAT Range 0.0345 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestInclusionLow (0.07s) === RUN TestInclusionHigh 2016/03/24 08:18:48 In TestInclusionHigh() 2016/03/24 08:18:48 Index found: index_age 2016/03/24 08:18:48 PERFSTAT Range 0.0398 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestInclusionHigh (0.07s) === RUN TestInclusionBoth 2016/03/24 08:18:48 In TestInclusionBoth() 2016/03/24 08:18:48 Index found: index_age 2016/03/24 08:18:48 PERFSTAT Range 0.0428 seconds 2016/03/24 08:18:48 Expected and Actual scan responses are the same --- PASS: TestInclusionBoth (0.08s) === RUN TestNestedIndex_String 2016/03/24 08:18:48 In TestNestedIndex_String() 2016/03/24 08:18:51 Created the secondary index index_streetname. Waiting for it become active 2016/03/24 08:18:51 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:51 Index is now active 2016/03/24 08:18:51 PERFSTAT CreateAndBuildIndex 2.9580 seconds 2016/03/24 08:18:51 PERFSTAT Range 0.0032 seconds 2016/03/24 08:18:51 Expected and Actual scan responses are the same --- PASS: TestNestedIndex_String (3.00s) === RUN TestNestedIndex_Float 2016/03/24 08:18:51 In TestNestedIndex_Float() 2016/03/24 08:18:54 Created the secondary index index_floor. Waiting for it become active 2016/03/24 08:18:54 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:54 Index is now active 2016/03/24 08:18:54 PERFSTAT CreateAndBuildIndex 2.9552 seconds 2016/03/24 08:18:54 PERFSTAT Range 0.0033 seconds 2016/03/24 08:18:54 Expected and Actual scan responses are the same --- PASS: TestNestedIndex_Float (3.00s) === RUN TestNestedIndex_Bool 2016/03/24 08:18:54 In TestNestedIndex_Bool() 2016/03/24 08:18:57 Created the secondary index index_isresidential. Waiting for it become active 2016/03/24 08:18:57 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:18:57 Index is now active 2016/03/24 08:18:57 PERFSTAT CreateAndBuildIndex 2.9584 seconds 2016/03/24 08:18:57 PERFSTAT Range 0.0031 seconds 2016/03/24 08:18:57 Expected and Actual scan responses are the same --- PASS: TestNestedIndex_Bool (3.00s) === RUN TestLookupJsonObject 2016/03/24 08:18:57 In TestLookupJsonObject() 2016/03/24 08:19:02 Created the secondary index index_streetaddress. Waiting for it become active 2016/03/24 08:19:02 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:02 Index is now active 2016/03/24 08:19:02 PERFSTAT CreateAndBuildIndex 3.0400 seconds 2016/03/24 08:19:02 PERFSTAT Lookup 0.0199 seconds 2016/03/24 08:19:02 Count of docScanResults is 1 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[streetname:Hill Street doornumber:12B floor:5 buildingname:Sterling Heights]] 2016/03/24 08:19:02 Count of scanResults is 1 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[streetname:Hill Street buildingname:Sterling Heights doornumber:12B floor:5]] 2016/03/24 08:19:02 Expected and Actual scan responses are the same --- PASS: TestLookupJsonObject (5.17s) === RUN TestLookupObjDifferentOrdering 2016/03/24 08:19:02 In TestLookupObjDifferentOrdering() 2016/03/24 08:19:02 Index found: index_streetaddress 2016/03/24 08:19:02 PERFSTAT Lookup 0.0038 seconds 2016/03/24 08:19:02 Count of docScanResults is 1 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[doornumber:12B floor:5 buildingname:Sterling Heights streetname:Hill Street]] 2016/03/24 08:19:02 Count of scanResults is 1 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]] 2016/03/24 08:19:02 Expected and Actual scan responses are the same --- PASS: TestLookupObjDifferentOrdering (0.07s) === RUN TestRangeJsonObject 2016/03/24 08:19:02 In TestRangeJsonObject() 2016/03/24 08:19:02 Index found: index_streetaddress 2016/03/24 08:19:02 PERFSTAT Range 0.0036 seconds 2016/03/24 08:19:02 Count of scanResults is 2 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[floor:5 streetname:Hill Street buildingname:Sterling Heights doornumber:12B]] 2016/03/24 08:19:02 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]] 2016/03/24 08:19:02 Count of docScanResults is 2 2016/03/24 08:19:02 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[streetname:Hill Street buildingname:Sterling Heights doornumber:12B floor:5]] 2016/03/24 08:19:02 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]] 2016/03/24 08:19:02 Expected and Actual scan responses are the same --- PASS: TestRangeJsonObject (0.03s) === RUN TestLookupFloatDiffForms 2016/03/24 08:19:02 In TestLookupFloatDiffForms() 2016/03/24 08:19:06 Created the secondary index index_latitude. Waiting for it become active 2016/03/24 08:19:06 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:06 Index is now active 2016/03/24 08:19:06 PERFSTAT CreateAndBuildIndex 3.1101 seconds 2016/03/24 08:19:06 Scan 1 2016/03/24 08:19:06 PERFSTAT Range 0.0701 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 2 2016/03/24 08:19:06 PERFSTAT Lookup 0.0033 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 3 2016/03/24 08:19:06 PERFSTAT Lookup 0.0028 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 4 2016/03/24 08:19:06 PERFSTAT Lookup 0.0030 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 5 2016/03/24 08:19:06 PERFSTAT Lookup 0.0035 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 6 2016/03/24 08:19:06 PERFSTAT Lookup 0.0034 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same --- PASS: TestLookupFloatDiffForms (3.34s) === RUN TestRangeFloatInclVariations 2016/03/24 08:19:06 In TestRangeFloatInclVariations() 2016/03/24 08:19:06 Index found: index_latitude 2016/03/24 08:19:06 Scan 1 2016/03/24 08:19:06 PERFSTAT Range 0.0032 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 2 2016/03/24 08:19:06 PERFSTAT Range 0.0033 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 3 2016/03/24 08:19:06 PERFSTAT Range 0.0038 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 4 2016/03/24 08:19:06 PERFSTAT Range 0.0030 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 5 2016/03/24 08:19:06 PERFSTAT Range 0.0030 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same 2016/03/24 08:19:06 Scan 6 2016/03/24 08:19:06 PERFSTAT Range 0.0030 seconds 2016/03/24 08:19:06 Expected and Actual scan responses are the same --- PASS: TestRangeFloatInclVariations (0.14s) === RUN TestScanAll 2016/03/24 08:19:06 In TestScanAll() 2016/03/24 08:19:09 Created the secondary index index_name. Waiting for it become active 2016/03/24 08:19:09 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:09 Index is now active 2016/03/24 08:19:09 PERFSTAT CreateAndBuildIndex 3.1897 seconds 2016/03/24 08:19:09 Length of docScanResults = 10503 2016/03/24 08:19:09 PERFSTAT ScanAll 0.1379 seconds 2016/03/24 08:19:09 Length of scanResults = 10503 2016/03/24 08:19:09 Expected and Actual scan responses are the same --- PASS: TestScanAll (3.39s) === RUN TestScanAllNestedField 2016/03/24 08:19:09 In TestScanAllNestedField() 2016/03/24 08:19:09 Index found: index_streetname 2016/03/24 08:19:09 Length of docScanResults = 2 2016/03/24 08:19:09 PERFSTAT ScanAll 0.0032 seconds 2016/03/24 08:19:09 Length of scanResults = 2 2016/03/24 08:19:09 Expected and Actual scan responses are the same --- PASS: TestScanAllNestedField (0.04s) === RUN TestBasicPrimaryIndex 2016/03/24 08:19:09 In TestBasicPrimaryIndex() 2016/03/24 08:19:12 Created the secondary index index_p1. Waiting for it become active 2016/03/24 08:19:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:12 Index is now active 2016/03/24 08:19:12 PERFSTAT CreateAndBuildIndex 2.9839 seconds 2016/03/24 08:19:13 PERFSTAT ScanAll 0.1272 seconds 2016/03/24 08:19:13 PERFSTAT Range 0.0408 seconds 2016/03/24 08:19:13 Expected and Actual scan responses are the same 2016/03/24 08:19:13 CountRange() expected and actual is: 1981 and 1981 2016/03/24 08:19:13 lookupkey for CountLookup() = Usered886de8-c2fd-40aa-abef-d4e565e1aec5 2016/03/24 08:19:13 CountLookup() = 1 --- PASS: TestBasicPrimaryIndex (3.28s) === RUN TestBasicNullDataType 2016/03/24 08:19:13 In TestBasicNullDataType() 2016/03/24 08:19:13 Index found: index_email 2016/03/24 08:19:13 PERFSTAT Lookup 0.0032 seconds 2016/03/24 08:19:13 Expected and Actual scan responses are the same --- PASS: TestBasicNullDataType (0.04s) === RUN TestBasicArrayDataType_ScanAll 2016/03/24 08:19:13 In TestBasicArrayDataType_ScanAll() 2016/03/24 08:19:16 Created the secondary index index_tags. Waiting for it become active 2016/03/24 08:19:16 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:16 Index is now active 2016/03/24 08:19:16 PERFSTAT CreateAndBuildIndex 3.1634 seconds 2016/03/24 08:19:16 PERFSTAT ScanAll 0.2295 seconds 2016/03/24 08:19:16 Expected and Actual scan responses are the same --- PASS: TestBasicArrayDataType_ScanAll (3.46s) === RUN TestBasicArrayDataType_Lookup 2016/03/24 08:19:16 In TestBasicArrayDataType_Lookup() 2016/03/24 08:19:18 Index found: index_tags 2016/03/24 08:19:18 PERFSTAT Lookup 0.0033 seconds 2016/03/24 08:19:18 Count of scanResults is 1 2016/03/24 08:19:18 Key: Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: [[reprehenderit tempor officia exercitation labore sunt tempor]] --- PASS: TestBasicArrayDataType_Lookup (2.04s) === RUN TestArrayDataType_LookupMissingArrayValue 2016/03/24 08:19:18 In TestArrayDataType_LookupMissingArrayValue() 2016/03/24 08:19:18 Index found: index_tags 2016/03/24 08:19:18 PERFSTAT Lookup 0.0030 seconds 2016/03/24 08:19:18 Count of scanResults is 0 --- PASS: TestArrayDataType_LookupMissingArrayValue (0.04s) === RUN TestArrayDataType_LookupWrongOrder 2016/03/24 08:19:18 In TestArrayDataType_LookupWrongOrder() 2016/03/24 08:19:18 Index found: index_tags 2016/03/24 08:19:18 PERFSTAT Lookup 0.0031 seconds 2016/03/24 08:19:18 Count of scanResults is 0 --- PASS: TestArrayDataType_LookupWrongOrder (0.03s) === RUN TestArrayDataType_LookupSubset 2016/03/24 08:19:18 In TestArrayDataType_LookupSubset() 2016/03/24 08:19:18 Index found: index_tags 2016/03/24 08:19:18 PERFSTAT Lookup 0.0029 seconds 2016/03/24 08:19:18 Count of scanResults is 0 --- PASS: TestArrayDataType_LookupSubset (0.03s) === RUN TestScanLimitParameter 2016/03/24 08:19:18 In TestScanLimitParameter() 2016/03/24 08:19:18 Index found: index_age 2016/03/24 08:19:18 PERFSTAT Range 0.0128 seconds 2016/03/24 08:19:18 PERFSTAT Range 0.0183 seconds --- PASS: TestScanLimitParameter (0.07s) === RUN TestCountRange 2016/03/24 08:19:18 In TestRangeCount() 2016/03/24 08:19:18 Index found: index_age 2016/03/24 08:19:18 Count of expected and actual Range is: 2505 and 2505 2016/03/24 08:19:19 Count of expected and actual Range is: 10503 and 10503 2016/03/24 08:19:19 Count of expected and actual Range are: 0 and 0 2016/03/24 08:19:19 Count of expected and actual Range are: 517 and 517 2016/03/24 08:19:19 Testing CountRange() for key <= val 2016/03/24 08:19:19 Count of expected and actual CountRange for key <= 30 are: 5483 and 5483 2016/03/24 08:19:19 Testing CountRange() for key >= val 2016/03/24 08:19:19 Count of expected and actual CountRange for key >= 25 are: 8080 and 8080 2016/03/24 08:19:19 Testing CountRange() for null < key <= val 2016/03/24 08:19:19 Count of expected and actual CountRange for key > null && key <= 30 are: 5483 and 5483 2016/03/24 08:19:19 Testing CountRange() for val <= key < null 2016/03/24 08:19:19 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0 2016/03/24 08:19:19 Count of expected and actual Range are: 0 and 0 --- PASS: TestCountRange (0.65s) === RUN TestCountLookup 2016/03/24 08:19:19 In TestCountLookup() 2016/03/24 08:19:19 Index found: index_age 2016/03/24 08:19:19 Count of expected and actual Range are: 523 and 523 2016/03/24 08:19:19 Count of expected and actual Range are: 0 and 0 --- PASS: TestCountLookup (0.06s) === RUN TestRangeStatistics 2016/03/24 08:19:19 In TestRangeCount() 2016/03/24 08:19:19 Index found: index_age --- PASS: TestRangeStatistics (0.02s) === RUN TestIndexCreateWithWhere 2016/03/24 08:19:19 In TestIndexCreateWithWhere() 2016/03/24 08:19:22 Created the secondary index index_ageabove30. Waiting for it become active 2016/03/24 08:19:22 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:22 Index is now active 2016/03/24 08:19:22 PERFSTAT CreateAndBuildIndex 3.1309 seconds 2016/03/24 08:19:22 PERFSTAT Range 0.0685 seconds 2016/03/24 08:19:22 Expected and Actual scan responses are the same 2016/03/24 08:19:22 Lengths of expected and actual scanReuslts are: 4503 and 4503 2016/03/24 08:19:25 Created the secondary index index_ageteens. Waiting for it become active 2016/03/24 08:19:25 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:25 Index is now active 2016/03/24 08:19:25 PERFSTAT CreateAndBuildIndex 2.9936 seconds 2016/03/24 08:19:25 PERFSTAT Range 0.0043 seconds 2016/03/24 08:19:25 Expected and Actual scan responses are the same 2016/03/24 08:19:25 Lengths of expected and actual scanReuslts are: 0 and 0 2016/03/24 08:19:28 Created the secondary index index_age35to45. Waiting for it become active 2016/03/24 08:19:28 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:28 Index is now active 2016/03/24 08:19:28 PERFSTAT CreateAndBuildIndex 3.0444 seconds 2016/03/24 08:19:28 PERFSTAT ScanAll 0.0459 seconds 2016/03/24 08:19:28 Expected and Actual scan responses are the same 2016/03/24 08:19:28 Lengths of expected and actual scanReuslts are: 3022 and 3022 --- PASS: TestIndexCreateWithWhere (9.40s) === RUN TestDeferredIndexCreate 2016/03/24 08:19:28 In TestDeferredIndexCreate() 2016/03/24 08:19:29 Created the secondary index index_deferred 2016/03/24 08:19:29 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY 2016/03/24 08:19:31 Build the deferred index index_deferred. Waiting for the index to become active 2016/03/24 08:19:31 Index state is INDEX_STATE_INITIAL 2016/03/24 08:19:32 Index state is INDEX_STATE_CATCHUP 2016/03/24 08:19:33 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:33 Index is now active 2016/03/24 08:19:33 PERFSTAT BuildIndex 4.0238 seconds 2016/03/24 08:19:33 PERFSTAT Range 0.0322 seconds 2016/03/24 08:19:33 Expected and Actual scan responses are the same --- PASS: TestDeferredIndexCreate (4.20s) === RUN TestCompositeIndex_NumAndString 2016/03/24 08:19:33 In TestCompositeIndex() 2016/03/24 08:19:36 Created the secondary index index_composite1. Waiting for it become active 2016/03/24 08:19:36 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:36 Index is now active 2016/03/24 08:19:36 PERFSTAT CreateAndBuildIndex 3.1732 seconds 2016/03/24 08:19:36 PERFSTAT ScanAll 0.1486 seconds 2016/03/24 08:19:36 PERFSTAT Range 0.0427 seconds 2016/03/24 08:19:36 PERFSTAT Lookup 0.0031 seconds 2016/03/24 08:19:36 Expected and Actual scan responses are the same --- PASS: TestCompositeIndex_NumAndString (3.47s) === RUN TestCompositeIndex_TwoNumberFields 2016/03/24 08:19:36 In TestCompositeIndex() 2016/03/24 08:19:39 Created the secondary index index_composite2. Waiting for it become active 2016/03/24 08:19:39 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:19:39 Index is now active 2016/03/24 08:19:39 PERFSTAT CreateAndBuildIndex 3.1979 seconds 2016/03/24 08:19:40 PERFSTAT ScanAll 0.1457 seconds --- PASS: TestCompositeIndex_TwoNumberFields (3.37s) === RUN TestRestartIndexer 2016/03/24 08:19:40 In TestRestartIndexer() 2016/03/24 08:19:40 [] 2016/03/24 08:20:40 PERFSTAT Range 0.1487 seconds 2016/03/24 08:20:40 Len of expected and actual scan results are : 10503 and 10503 2016/03/24 08:20:40 Expected and Actual scan responses are the same --- PASS: TestRestartIndexer (60.30s) === RUN TestCreateDocsMutation 2016/03/24 08:20:40 In TestCreateDocsMutation() 2016/03/24 08:20:40 Index found: index_age 2016/03/24 08:20:40 PERFSTAT Range 0.1476 seconds 2016/03/24 08:20:40 Len of expected and actual scan results are : 10503 and 10503 2016/03/24 08:20:40 Expected and Actual scan responses are the same 2016/03/24 08:20:41 PERFSTAT Range 0.2238 seconds 2016/03/24 08:20:41 Index Scan after mutations took 388.003941ms 2016/03/24 08:20:41 Len of expected and actual scan results are : 10603 and 10603 2016/03/24 08:20:41 Expected and Actual scan responses are the same --- PASS: TestCreateDocsMutation (0.83s) === RUN TestRestartProjector 2016/03/24 08:20:41 In TestRestartProjector() 2016/03/24 08:20:41 [] 2016/03/24 08:21:41 PERFSTAT Range 0.1483 seconds 2016/03/24 08:21:41 Len of expected and actual scan results are : 10603 and 10603 2016/03/24 08:21:41 Expected and Actual scan responses are the same --- PASS: TestRestartProjector (60.26s) === RUN TestDeleteDocsMutation 2016/03/24 08:21:41 In TestDeleteDocsMutation() 2016/03/24 08:21:41 Index found: index_age 2016/03/24 08:21:41 PERFSTAT Range 0.1808 seconds 2016/03/24 08:21:41 Len of expected and actual scan results are : 10603 and 10603 2016/03/24 08:21:41 Expected and Actual scan responses are the same 2016/03/24 08:21:42 PERFSTAT Range 0.5597 seconds 2016/03/24 08:21:42 Index Scan after mutations took 583.300569ms 2016/03/24 08:21:42 Len of expected and actual scan results are : 10403 and 10403 2016/03/24 08:21:42 Expected and Actual scan responses are the same --- PASS: TestDeleteDocsMutation (1.02s) === RUN TestUpdateDocsMutation 2016/03/24 08:21:42 In TestUpdateDocsMutation() 2016/03/24 08:21:42 Index found: index_age 2016/03/24 08:21:42 PERFSTAT Range 0.1556 seconds 2016/03/24 08:21:42 Len of expected and actual scan results are : 9910 and 9910 2016/03/24 08:21:42 Expected and Actual scan responses are the same 2016/03/24 08:21:42 Num of keysFromMutDocs: 100 2016/03/24 08:21:42 Updating number of documents: 100 2016/03/24 08:21:43 PERFSTAT Range 0.3341 seconds 2016/03/24 08:21:43 Index Scan after mutations took 383.88953ms 2016/03/24 08:21:43 Len of expected and actual scan results are : 9912 and 9912 2016/03/24 08:21:43 Expected and Actual scan responses are the same --- PASS: TestUpdateDocsMutation (0.81s) === RUN TestLargeMutations 2016/03/24 08:21:43 In TestLargeMutations() 2016/03/24 08:21:43 In DropAllSecondaryIndexes() 2016/03/24 08:21:43 Dropped index index_ageabove30 2016/03/24 08:21:43 Dropped index index_age35to45 2016/03/24 08:21:43 Dropped index index_company 2016/03/24 08:21:43 Dropped index index_deferred 2016/03/24 08:21:43 Dropped index index_name 2016/03/24 08:21:43 Dropped index index_email 2016/03/24 08:21:43 Dropped index index_p1 2016/03/24 08:21:43 Dropped index index_i2 2016/03/24 08:21:43 Dropped index index_age 2016/03/24 08:21:43 Dropped index index_composite2 2016/03/24 08:21:43 Dropped index index_height 2016/03/24 08:21:43 Dropped index index_latitude 2016/03/24 08:21:43 Dropped index index_streetname 2016/03/24 08:21:43 Dropped index index_state 2016/03/24 08:21:43 Dropped index index_isActive 2016/03/24 08:21:43 Dropped index index_cdc 2016/03/24 08:21:43 Dropped index index_di1 2016/03/24 08:21:43 Dropped index index_pin 2016/03/24 08:21:44 Dropped index index_eyeColor 2016/03/24 08:21:44 Dropped index index_gender 2016/03/24 08:21:44 Dropped index index_isresidential 2016/03/24 08:21:44 Dropped index index_longitude 2016/03/24 08:21:44 Dropped index index_balance 2016/03/24 08:21:44 Dropped index index_composite1 2016/03/24 08:21:44 Dropped index index_floor 2016/03/24 08:21:44 Dropped index index_ageteens 2016/03/24 08:21:44 Dropped index index_nationality 2016/03/24 08:21:44 Dropped index index_tags 2016/03/24 08:21:44 Dropped index index_streetaddress 2016/03/24 08:22:07 Created the secondary index indexmut_1. Waiting for it become active 2016/03/24 08:22:07 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:22:07 Index is now active 2016/03/24 08:22:07 PERFSTAT CreateAndBuildIndex 3.7721 seconds 2016/03/24 08:22:07 PERFSTAT ScanAll 0.3720 seconds 2016/03/24 08:22:07 Expected and Actual scan responses are the same 2016/03/24 08:22:07 Len of expected and actual scan results are : 30403 and 30403 2016/03/24 08:22:07 ITERATION 0 2016/03/24 08:22:24 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:22:24 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:22:24 Index is now active 2016/03/24 08:22:24 PERFSTAT CreateAndBuildIndex 4.8706 seconds 2016/03/24 08:22:25 PERFSTAT ScanAll 0.7018 seconds 2016/03/24 08:22:25 Expected and Actual scan responses are the same 2016/03/24 08:22:25 Len of expected and actual scan results are : 40403 and 40403 2016/03/24 08:22:25 PERFSTAT ScanAll 0.5212 seconds 2016/03/24 08:22:25 Expected and Actual scan responses are the same 2016/03/24 08:22:25 Len of expected and actual scan results are : 40403 and 40403 2016/03/24 08:22:25 Dropping the secondary index indexmut_2 2016/03/24 08:22:25 Index dropped 2016/03/24 08:22:25 PERFSTAT DropIndex 0.0387 seconds 2016/03/24 08:22:25 ITERATION 1 2016/03/24 08:22:45 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:22:45 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:22:45 Index is now active 2016/03/24 08:22:45 PERFSTAT CreateAndBuildIndex 7.3370 seconds 2016/03/24 08:22:46 PERFSTAT ScanAll 0.6290 seconds 2016/03/24 08:22:46 Expected and Actual scan responses are the same 2016/03/24 08:22:46 Len of expected and actual scan results are : 50403 and 50403 2016/03/24 08:22:46 PERFSTAT ScanAll 0.6360 seconds 2016/03/24 08:22:46 Expected and Actual scan responses are the same 2016/03/24 08:22:46 Len of expected and actual scan results are : 50403 and 50403 2016/03/24 08:22:46 Dropping the secondary index indexmut_2 2016/03/24 08:22:46 Index dropped 2016/03/24 08:22:46 PERFSTAT DropIndex 0.0411 seconds 2016/03/24 08:22:46 ITERATION 2 2016/03/24 08:23:05 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:23:05 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:23:05 Index is now active 2016/03/24 08:23:05 PERFSTAT CreateAndBuildIndex 6.9147 seconds 2016/03/24 08:23:06 PERFSTAT ScanAll 0.8128 seconds 2016/03/24 08:23:06 Expected and Actual scan responses are the same 2016/03/24 08:23:06 Len of expected and actual scan results are : 60403 and 60403 2016/03/24 08:23:07 PERFSTAT ScanAll 0.7546 seconds 2016/03/24 08:23:07 Expected and Actual scan responses are the same 2016/03/24 08:23:07 Len of expected and actual scan results are : 60403 and 60403 2016/03/24 08:23:07 Dropping the secondary index indexmut_2 2016/03/24 08:23:07 Index dropped 2016/03/24 08:23:07 PERFSTAT DropIndex 0.0478 seconds 2016/03/24 08:23:07 ITERATION 3 2016/03/24 08:23:26 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:23:26 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:23:26 Index is now active 2016/03/24 08:23:26 PERFSTAT CreateAndBuildIndex 7.8817 seconds 2016/03/24 08:23:27 PERFSTAT ScanAll 0.9211 seconds 2016/03/24 08:23:27 Expected and Actual scan responses are the same 2016/03/24 08:23:27 Len of expected and actual scan results are : 70403 and 70403 2016/03/24 08:23:29 PERFSTAT ScanAll 1.5481 seconds 2016/03/24 08:23:29 Expected and Actual scan responses are the same 2016/03/24 08:23:29 Len of expected and actual scan results are : 70403 and 70403 2016/03/24 08:23:29 Dropping the secondary index indexmut_2 2016/03/24 08:23:29 Index dropped 2016/03/24 08:23:29 PERFSTAT DropIndex 0.0992 seconds 2016/03/24 08:23:29 ITERATION 4 2016/03/24 08:23:49 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:23:49 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:23:49 Index is now active 2016/03/24 08:23:49 PERFSTAT CreateAndBuildIndex 9.1957 seconds 2016/03/24 08:23:50 PERFSTAT ScanAll 1.0073 seconds 2016/03/24 08:23:50 Expected and Actual scan responses are the same 2016/03/24 08:23:50 Len of expected and actual scan results are : 80403 and 80403 2016/03/24 08:23:52 PERFSTAT ScanAll 1.4666 seconds 2016/03/24 08:23:52 Expected and Actual scan responses are the same 2016/03/24 08:23:52 Len of expected and actual scan results are : 80403 and 80403 2016/03/24 08:23:52 Dropping the secondary index indexmut_2 2016/03/24 08:23:52 Index dropped 2016/03/24 08:23:52 PERFSTAT DropIndex 0.0488 seconds 2016/03/24 08:23:52 ITERATION 5 2016/03/24 08:24:15 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:24:15 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:24:15 Index is now active 2016/03/24 08:24:15 PERFSTAT CreateAndBuildIndex 12.3696 seconds 2016/03/24 08:24:16 PERFSTAT ScanAll 1.1297 seconds 2016/03/24 08:24:17 Expected and Actual scan responses are the same 2016/03/24 08:24:17 Len of expected and actual scan results are : 90403 and 90403 2016/03/24 08:24:18 PERFSTAT ScanAll 1.1230 seconds 2016/03/24 08:24:18 Expected and Actual scan responses are the same 2016/03/24 08:24:18 Len of expected and actual scan results are : 90403 and 90403 2016/03/24 08:24:18 Dropping the secondary index indexmut_2 2016/03/24 08:24:18 Index dropped 2016/03/24 08:24:18 PERFSTAT DropIndex 0.0451 seconds 2016/03/24 08:24:18 ITERATION 6 2016/03/24 08:24:44 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:24:44 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:24:44 Index is now active 2016/03/24 08:24:44 PERFSTAT CreateAndBuildIndex 12.9022 seconds 2016/03/24 08:24:45 PERFSTAT ScanAll 1.2629 seconds 2016/03/24 08:24:45 Expected and Actual scan responses are the same 2016/03/24 08:24:45 Len of expected and actual scan results are : 100403 and 100403 2016/03/24 08:24:47 PERFSTAT ScanAll 1.7236 seconds 2016/03/24 08:24:47 Expected and Actual scan responses are the same 2016/03/24 08:24:47 Len of expected and actual scan results are : 100403 and 100403 2016/03/24 08:24:47 Dropping the secondary index indexmut_2 2016/03/24 08:24:47 Index dropped 2016/03/24 08:24:47 PERFSTAT DropIndex 0.0487 seconds 2016/03/24 08:24:47 ITERATION 7 2016/03/24 08:25:11 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:25:11 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:25:11 Index is now active 2016/03/24 08:25:11 PERFSTAT CreateAndBuildIndex 12.5011 seconds 2016/03/24 08:25:14 PERFSTAT ScanAll 2.6223 seconds 2016/03/24 08:25:14 Expected and Actual scan responses are the same 2016/03/24 08:25:14 Len of expected and actual scan results are : 110403 and 110403 2016/03/24 08:25:16 PERFSTAT ScanAll 1.8548 seconds 2016/03/24 08:25:16 Expected and Actual scan responses are the same 2016/03/24 08:25:16 Len of expected and actual scan results are : 110403 and 110403 2016/03/24 08:25:16 Dropping the secondary index indexmut_2 2016/03/24 08:25:16 Index dropped 2016/03/24 08:25:16 PERFSTAT DropIndex 0.0499 seconds 2016/03/24 08:25:16 ITERATION 8 2016/03/24 08:25:44 Created the secondary index indexmut_2. Waiting for it become active 2016/03/24 08:25:44 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:25:44 Index is now active 2016/03/24 08:25:44 PERFSTAT CreateAndBuildIndex 17.2037 seconds 2016/03/24 08:25:46 PERFSTAT ScanAll 1.5462 seconds 2016/03/24 08:25:46 Expected scan count 120403 does not match actual scan count 119153 --- FAIL: TestLargeMutations (243.04s) common_test.go:102: Error in scan result validation: Expected scan count 120403 does not match actual scan count 119153 === RUN TestRestfulAPI 2016/03/24 08:25:46 In TestRestfulAPI() 2016/03/24 08:25:46 In DropAllSecondaryIndexes() 2016/03/24 08:25:46 Dropped index indexmut_2 2016/03/24 08:25:46 Dropped index indexmut_1 2016/03/24 08:25:46 Setting JSON docs in KV 2016/03/24 08:25:47 GET all indexes 2016/03/24 08:25:47 200 OK 2016/03/24 08:25:47 FOUND indexes: [] 2016/03/24 08:25:47 DROP index: badindexid 2016/03/24 08:25:47 status: 400 Bad Request 2016/03/24 08:25:47 DROP index: 23544142 2016/03/24 08:25:47 status: 500 Internal Server Error 2016/03/24 08:25:47 TEST: malformed body 2016/03/24 08:25:47 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string" 2016/03/24 08:25:47 TEST: missing field ``name`` 2016/03/24 08:25:47 400 Bad Request "missing field name" 2016/03/24 08:25:47 TEST: empty field ``name`` 2016/03/24 08:25:47 400 Bad Request "empty field name" 2016/03/24 08:25:47 TEST: missing field ``bucket`` 2016/03/24 08:25:47 400 Bad Request "missing field bucket" 2016/03/24 08:25:47 TEST: empty field ``bucket`` 2016/03/24 08:25:47 400 Bad Request "empty field bucket" 2016/03/24 08:25:47 TEST: missing field ``secExprs`` 2016/03/24 08:25:47 400 Bad Request "missing field secExprs" 2016/03/24 08:25:47 TEST: empty field ``secExprs`` 2016/03/24 08:25:47 400 Bad Request "empty field secExprs" 2016/03/24 08:25:47 2016/03/24 08:25:47 CREATE INDEX: idx1 2016/03/24 08:26:00 status : 201 Created 2016/03/24 08:26:00 {"id": "14941941455780037475"} 2016/03/24 08:26:00 CREATE INDEX: idx2 (defer) 2016/03/24 08:26:00 status : 201 Created 2016/03/24 08:26:00 {"id": "7916754210656381149"} 2016/03/24 08:26:00 CREATE INDEX: idx3 (defer) 2016/03/24 08:26:00 status : 201 Created 2016/03/24 08:26:00 {"id": "206678638117763477"} 2016/03/24 08:26:00 CREATE INDEX: idx4 (defer) 2016/03/24 08:26:00 status : 201 Created 2016/03/24 08:26:00 {"id": "5843108231275616844"} 2016/03/24 08:26:00 BUILD single deferred index 2016/03/24 08:26:00 202 Accepted 2016/03/24 08:26:00 GET all indexes 2016/03/24 08:26:00 200 OK 2016/03/24 08:26:00 index idx1 in INDEX_STATE_ACTIVE 2016/03/24 08:26:00 GET all indexes 2016/03/24 08:26:00 200 OK 2016/03/24 08:26:00 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:01 GET all indexes 2016/03/24 08:26:01 200 OK 2016/03/24 08:26:01 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:03 GET all indexes 2016/03/24 08:26:03 200 OK 2016/03/24 08:26:03 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:04 GET all indexes 2016/03/24 08:26:04 200 OK 2016/03/24 08:26:04 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:05 GET all indexes 2016/03/24 08:26:05 200 OK 2016/03/24 08:26:05 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:06 GET all indexes 2016/03/24 08:26:06 200 OK 2016/03/24 08:26:06 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:07 GET all indexes 2016/03/24 08:26:07 200 OK 2016/03/24 08:26:07 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:08 GET all indexes 2016/03/24 08:26:08 200 OK 2016/03/24 08:26:08 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:09 GET all indexes 2016/03/24 08:26:09 200 OK 2016/03/24 08:26:09 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:10 GET all indexes 2016/03/24 08:26:10 200 OK 2016/03/24 08:26:10 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:11 GET all indexes 2016/03/24 08:26:11 200 OK 2016/03/24 08:26:11 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:12 GET all indexes 2016/03/24 08:26:12 200 OK 2016/03/24 08:26:12 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:13 GET all indexes 2016/03/24 08:26:13 200 OK 2016/03/24 08:26:13 index idx2 in INDEX_STATE_INITIAL 2016/03/24 08:26:14 GET all indexes 2016/03/24 08:26:14 200 OK 2016/03/24 08:26:14 index idx2 in INDEX_STATE_ACTIVE 2016/03/24 08:26:14 BUILD many deferred index 2016/03/24 08:26:14 202 Accepted 2016/03/24 08:26:14 GET all indexes 2016/03/24 08:26:14 200 OK 2016/03/24 08:26:14 index idx1 in INDEX_STATE_ACTIVE 2016/03/24 08:26:14 GET all indexes 2016/03/24 08:26:14 200 OK 2016/03/24 08:26:14 index idx2 in INDEX_STATE_ACTIVE 2016/03/24 08:26:14 GET all indexes 2016/03/24 08:26:14 200 OK 2016/03/24 08:26:14 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:15 GET all indexes 2016/03/24 08:26:15 200 OK 2016/03/24 08:26:15 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:16 GET all indexes 2016/03/24 08:26:16 200 OK 2016/03/24 08:26:16 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:17 GET all indexes 2016/03/24 08:26:17 200 OK 2016/03/24 08:26:17 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:18 GET all indexes 2016/03/24 08:26:18 200 OK 2016/03/24 08:26:18 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:19 GET all indexes 2016/03/24 08:26:19 200 OK 2016/03/24 08:26:19 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:20 GET all indexes 2016/03/24 08:26:20 200 OK 2016/03/24 08:26:20 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:21 GET all indexes 2016/03/24 08:26:21 200 OK 2016/03/24 08:26:21 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:22 GET all indexes 2016/03/24 08:26:22 200 OK 2016/03/24 08:26:22 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:23 GET all indexes 2016/03/24 08:26:23 200 OK 2016/03/24 08:26:23 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:24 GET all indexes 2016/03/24 08:26:24 200 OK 2016/03/24 08:26:24 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:25 GET all indexes 2016/03/24 08:26:25 200 OK 2016/03/24 08:26:25 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:26 GET all indexes 2016/03/24 08:26:27 200 OK 2016/03/24 08:26:27 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:28 GET all indexes 2016/03/24 08:26:28 200 OK 2016/03/24 08:26:28 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:29 GET all indexes 2016/03/24 08:26:29 200 OK 2016/03/24 08:26:29 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:30 GET all indexes 2016/03/24 08:26:30 200 OK 2016/03/24 08:26:30 index idx3 in INDEX_STATE_INITIAL 2016/03/24 08:26:31 GET all indexes 2016/03/24 08:26:31 200 OK 2016/03/24 08:26:31 index idx3 in INDEX_STATE_ACTIVE 2016/03/24 08:26:31 GET all indexes 2016/03/24 08:26:31 200 OK 2016/03/24 08:26:31 index idx4 in INDEX_STATE_ACTIVE 2016/03/24 08:26:31 GET all indexes 2016/03/24 08:26:31 200 OK 2016/03/24 08:26:31 CREATED indexes: [14941941455780037475 7916754210656381149 206678638117763477 5843108231275616844] 2016/03/24 08:26:31 2016/03/24 08:26:31 LOOKUP missing index 2016/03/24 08:26:31 status : 404 Not Found 2016/03/24 08:26:31 LOOKUP Pyongyang 2016/03/24 08:26:31 status : 200 OK 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 221 2016/03/24 08:26:31 GOT CHUNK: 44 2016/03/24 08:26:31 GOT CHUNK: 0 2016/03/24 08:26:31 number of entries 481 2016/03/24 08:26:31 Expected and Actual scan responses are the same 2016/03/24 08:26:31 LOOKUP with stale as false 2016/03/24 08:26:31 status : 200 OK 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 221 2016/03/24 08:26:31 GOT CHUNK: 44 2016/03/24 08:26:31 GOT CHUNK: 0 2016/03/24 08:26:31 number of entries 481 2016/03/24 08:26:31 Expected and Actual scan responses are the same 2016/03/24 08:26:31 LOOKUP with Rome 2016/03/24 08:26:31 status : 200 OK 2016/03/24 08:26:31 GOT CHUNK: 249 2016/03/24 08:26:31 GOT CHUNK: 225 2016/03/24 08:26:31 GOT CHUNK: 0 2016/03/24 08:26:31 number of entries 474 2016/03/24 08:26:31 Expected and Actual scan responses are the same 2016/03/24 08:26:31 RANGE missing index 2016/03/24 08:26:31 Status : 404 Not Found 2016/03/24 08:26:31 RANGE cities - none 2016/03/24 08:26:31 Status : 200 OK 2016/03/24 08:26:31 GOT CHUNK: 223 2016/03/24 08:26:31 GOT CHUNK: 234 2016/03/24 08:26:31 GOT CHUNK: 210 2016/03/24 08:26:31 GOT CHUNK: 220 2016/03/24 08:26:31 GOT CHUNK: 235 2016/03/24 08:26:31 GOT CHUNK: 247 2016/03/24 08:26:31 GOT CHUNK: 237 2016/03/24 08:26:31 GOT CHUNK: 245 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 222 2016/03/24 08:26:31 GOT CHUNK: 203 2016/03/24 08:26:31 GOT CHUNK: 209 2016/03/24 08:26:31 GOT CHUNK: 177 2016/03/24 08:26:31 GOT CHUNK: 226 2016/03/24 08:26:31 GOT CHUNK: 235 2016/03/24 08:26:31 GOT CHUNK: 187 2016/03/24 08:26:31 GOT CHUNK: 213 2016/03/24 08:26:31 GOT CHUNK: 228 2016/03/24 08:26:31 GOT CHUNK: 245 2016/03/24 08:26:31 GOT CHUNK: 235 2016/03/24 08:26:31 GOT CHUNK: 219 2016/03/24 08:26:31 GOT CHUNK: 200 2016/03/24 08:26:31 GOT CHUNK: 184 2016/03/24 08:26:31 GOT CHUNK: 196 2016/03/24 08:26:31 GOT CHUNK: 236 2016/03/24 08:26:31 GOT CHUNK: 229 2016/03/24 08:26:31 GOT CHUNK: 202 2016/03/24 08:26:31 GOT CHUNK: 207 2016/03/24 08:26:31 GOT CHUNK: 250 2016/03/24 08:26:31 GOT CHUNK: 244 2016/03/24 08:26:31 GOT CHUNK: 225 2016/03/24 08:26:31 GOT CHUNK: 232 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 237 2016/03/24 08:26:31 GOT CHUNK: 232 2016/03/24 08:26:31 GOT CHUNK: 218 2016/03/24 08:26:31 GOT CHUNK: 228 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 224 2016/03/24 08:26:31 GOT CHUNK: 237 2016/03/24 08:26:31 GOT CHUNK: 218 2016/03/24 08:26:31 GOT CHUNK: 230 2016/03/24 08:26:31 GOT CHUNK: 217 2016/03/24 08:26:31 GOT CHUNK: 251 2016/03/24 08:26:31 GOT CHUNK: 239 2016/03/24 08:26:31 GOT CHUNK: 237 2016/03/24 08:26:31 GOT CHUNK: 217 2016/03/24 08:26:31 GOT CHUNK: 171 2016/03/24 08:26:31 GOT CHUNK: 174 2016/03/24 08:26:31 GOT CHUNK: 205 2016/03/24 08:26:31 GOT CHUNK: 232 2016/03/24 08:26:31 GOT CHUNK: 230 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 239 2016/03/24 08:26:31 GOT CHUNK: 197 2016/03/24 08:26:31 GOT CHUNK: 211 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 186 2016/03/24 08:26:31 GOT CHUNK: 230 2016/03/24 08:26:31 GOT CHUNK: 235 2016/03/24 08:26:31 GOT CHUNK: 239 2016/03/24 08:26:31 GOT CHUNK: 225 2016/03/24 08:26:31 GOT CHUNK: 225 2016/03/24 08:26:31 GOT CHUNK: 204 2016/03/24 08:26:31 GOT CHUNK: 224 2016/03/24 08:26:31 GOT CHUNK: 222 2016/03/24 08:26:31 GOT CHUNK: 200 2016/03/24 08:26:31 GOT CHUNK: 239 2016/03/24 08:26:31 GOT CHUNK: 240 2016/03/24 08:26:31 GOT CHUNK: 253 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 230 2016/03/24 08:26:31 GOT CHUNK: 231 2016/03/24 08:26:31 GOT CHUNK: 237 2016/03/24 08:26:31 GOT CHUNK: 212 2016/03/24 08:26:31 GOT CHUNK: 194 2016/03/24 08:26:31 GOT CHUNK: 203 2016/03/24 08:26:31 GOT CHUNK: 197 2016/03/24 08:26:31 GOT CHUNK: 238 2016/03/24 08:26:31 GOT CHUNK: 203 2016/03/24 08:26:31 GOT CHUNK: 176 2016/03/24 08:26:31 GOT CHUNK: 218 2016/03/24 08:26:31 GOT CHUNK: 217 2016/03/24 08:26:31 GOT CHUNK: 213 2016/03/24 08:26:31 GOT CHUNK: 210 2016/03/24 08:26:31 GOT CHUNK: 206 2016/03/24 08:26:31 GOT CHUNK: 201 2016/03/24 08:26:31 GOT CHUNK: 204 2016/03/24 08:26:31 GOT CHUNK: 214 2016/03/24 08:26:31 GOT CHUNK: 183 2016/03/24 08:26:31 GOT CHUNK: 222 2016/03/24 08:26:31 GOT CHUNK: 223 2016/03/24 08:26:31 GOT CHUNK: 216 2016/03/24 08:26:31 GOT CHUNK: 222 2016/03/24 08:26:31 GOT CHUNK: 222 2016/03/24 08:26:31 GOT CHUNK: 228 2016/03/24 08:26:31 GOT CHUNK: 203 2016/03/24 08:26:31 GOT CHUNK: 203 2016/03/24 08:26:31 GOT CHUNK: 211 2016/03/24 08:26:31 GOT CHUNK: 219 2016/03/24 08:26:31 GOT CHUNK: 210 2016/03/24 08:26:31 GOT CHUNK: 244 2016/03/24 08:26:31 GOT CHUNK: 213 2016/03/24 08:26:31 GOT CHUNK: 207 2016/03/24 08:26:31 GOT CHUNK: 226 2016/03/24 08:26:31 GOT CHUNK: 207 2016/03/24 08:26:31 GOT CHUNK: 218 2016/03/24 08:26:31 GOT CHUNK: 224 2016/03/24 08:26:31 GOT CHUNK: 230 2016/03/24 08:26:31 GOT CHUNK: 209 2016/03/24 08:26:31 GOT CHUNK: 185 2016/03/24 08:26:31 GOT CHUNK: 224 2016/03/24 08:26:31 GOT CHUNK: 205 2016/03/24 08:26:31 GOT CHUNK: 229 2016/03/24 08:26:31 GOT CHUNK: 224 2016/03/24 08:26:31 GOT CHUNK: 171 2016/03/24 08:26:31 GOT CHUNK: 217 2016/03/24 08:26:31 GOT CHUNK: 208 2016/03/24 08:26:31 GOT CHUNK: 188 2016/03/24 08:26:31 GOT CHUNK: 225 2016/03/24 08:26:31 GOT CHUNK: 192 2016/03/24 08:26:31 GOT CHUNK: 168 2016/03/24 08:26:31 GOT CHUNK: 196 2016/03/24 08:26:31 GOT CHUNK: 201 2016/03/24 08:26:31 GOT CHUNK: 205 2016/03/24 08:26:31 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 231 2016/03/24 08:26:32 GOT CHUNK: 205 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 159 2016/03/24 08:26:32 GOT CHUNK: 158 2016/03/24 08:26:32 GOT CHUNK: 240 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 212 2016/03/24 08:26:32 GOT CHUNK: 160 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 247 2016/03/24 08:26:32 GOT CHUNK: 242 2016/03/24 08:26:32 GOT CHUNK: 256 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 246 2016/03/24 08:26:32 GOT CHUNK: 255 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 206 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 190 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 218 2016/03/24 08:26:32 GOT CHUNK: 200 2016/03/24 08:26:32 GOT CHUNK: 184 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 213 2016/03/24 08:26:32 GOT CHUNK: 158 2016/03/24 08:26:32 GOT CHUNK: 160 2016/03/24 08:26:32 GOT CHUNK: 182 2016/03/24 08:26:32 GOT CHUNK: 185 2016/03/24 08:26:32 GOT CHUNK: 169 2016/03/24 08:26:32 GOT CHUNK: 205 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 195 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 201 2016/03/24 08:26:32 GOT CHUNK: 191 2016/03/24 08:26:32 GOT CHUNK: 208 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 213 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 195 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 165 2016/03/24 08:26:32 GOT CHUNK: 156 2016/03/24 08:26:32 GOT CHUNK: 161 2016/03/24 08:26:32 GOT CHUNK: 191 2016/03/24 08:26:32 GOT CHUNK: 196 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 201 2016/03/24 08:26:32 GOT CHUNK: 218 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 242 2016/03/24 08:26:32 GOT CHUNK: 242 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 182 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 218 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 172 2016/03/24 08:26:32 GOT CHUNK: 161 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 177 2016/03/24 08:26:32 GOT CHUNK: 218 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 203 2016/03/24 08:26:32 GOT CHUNK: 233 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 200 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 256 2016/03/24 08:26:32 GOT CHUNK: 231 2016/03/24 08:26:32 GOT CHUNK: 243 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 207 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 184 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 255 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 181 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 206 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 206 2016/03/24 08:26:32 GOT CHUNK: 208 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 161 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 251 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 231 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 247 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 240 2016/03/24 08:26:32 GOT CHUNK: 178 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 208 2016/03/24 08:26:32 GOT CHUNK: 238 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 234 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 243 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 233 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 219 2016/03/24 08:26:32 GOT CHUNK: 241 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 204 2016/03/24 08:26:32 GOT CHUNK: 238 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 205 2016/03/24 08:26:32 GOT CHUNK: 223 2016/03/24 08:26:32 GOT CHUNK: 234 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 247 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 240 2016/03/24 08:26:32 GOT CHUNK: 225 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 194 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 234 2016/03/24 08:26:32 GOT CHUNK: 238 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 234 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 219 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 242 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 218 2016/03/24 08:26:32 GOT CHUNK: 262 2016/03/24 08:26:32 GOT CHUNK: 210 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 230 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 176 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 203 2016/03/24 08:26:32 GOT CHUNK: 210 2016/03/24 08:26:32 GOT CHUNK: 238 2016/03/24 08:26:32 GOT CHUNK: 255 2016/03/24 08:26:32 GOT CHUNK: 186 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 209 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 255 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 239 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 208 2016/03/24 08:26:32 GOT CHUNK: 224 2016/03/24 08:26:32 GOT CHUNK: 254 2016/03/24 08:26:32 GOT CHUNK: 235 2016/03/24 08:26:32 GOT CHUNK: 233 2016/03/24 08:26:32 GOT CHUNK: 210 2016/03/24 08:26:32 GOT CHUNK: 210 2016/03/24 08:26:32 GOT CHUNK: 225 2016/03/24 08:26:32 GOT CHUNK: 234 2016/03/24 08:26:32 GOT CHUNK: 213 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 236 2016/03/24 08:26:32 GOT CHUNK: 248 2016/03/24 08:26:32 GOT CHUNK: 205 2016/03/24 08:26:32 GOT CHUNK: 210 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 227 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 200 2016/03/24 08:26:32 GOT CHUNK: 205 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 220 2016/03/24 08:26:32 GOT CHUNK: 203 2016/03/24 08:26:32 GOT CHUNK: 198 2016/03/24 08:26:32 GOT CHUNK: 197 2016/03/24 08:26:32 GOT CHUNK: 192 2016/03/24 08:26:32 GOT CHUNK: 196 2016/03/24 08:26:32 GOT CHUNK: 211 2016/03/24 08:26:32 GOT CHUNK: 216 2016/03/24 08:26:32 GOT CHUNK: 232 2016/03/24 08:26:32 GOT CHUNK: 240 2016/03/24 08:26:32 GOT CHUNK: 242 2016/03/24 08:26:32 GOT CHUNK: 247 2016/03/24 08:26:32 GOT CHUNK: 230 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 225 2016/03/24 08:26:32 GOT CHUNK: 225 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 219 2016/03/24 08:26:32 GOT CHUNK: 229 2016/03/24 08:26:32 GOT CHUNK: 245 2016/03/24 08:26:32 GOT CHUNK: 244 2016/03/24 08:26:32 GOT CHUNK: 247 2016/03/24 08:26:32 GOT CHUNK: 200 2016/03/24 08:26:32 GOT CHUNK: 212 2016/03/24 08:26:32 GOT CHUNK: 207 2016/03/24 08:26:32 GOT CHUNK: 228 2016/03/24 08:26:32 GOT CHUNK: 256 2016/03/24 08:26:32 GOT CHUNK: 203 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 245 2016/03/24 08:26:32 GOT CHUNK: 253 2016/03/24 08:26:32 GOT CHUNK: 185 2016/03/24 08:26:32 GOT CHUNK: 243 2016/03/24 08:26:32 GOT CHUNK: 251 2016/03/24 08:26:32 GOT CHUNK: 215 2016/03/24 08:26:32 GOT CHUNK: 240 2016/03/24 08:26:32 GOT CHUNK: 172 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 241 2016/03/24 08:26:32 GOT CHUNK: 208 2016/03/24 08:26:32 GOT CHUNK: 221 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:32 GOT CHUNK: 217 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 207 2016/03/24 08:26:32 GOT CHUNK: 202 2016/03/24 08:26:32 GOT CHUNK: 212 2016/03/24 08:26:32 GOT CHUNK: 237 2016/03/24 08:26:32 GOT CHUNK: 214 2016/03/24 08:26:32 GOT CHUNK: 222 2016/03/24 08:26:32 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 196 2016/03/24 08:26:33 GOT CHUNK: 200 2016/03/24 08:26:33 GOT CHUNK: 216 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 187 2016/03/24 08:26:33 GOT CHUNK: 241 2016/03/24 08:26:33 GOT CHUNK: 242 2016/03/24 08:26:33 GOT CHUNK: 165 2016/03/24 08:26:33 GOT CHUNK: 216 2016/03/24 08:26:33 GOT CHUNK: 217 2016/03/24 08:26:33 GOT CHUNK: 235 2016/03/24 08:26:33 GOT CHUNK: 231 2016/03/24 08:26:33 GOT CHUNK: 212 2016/03/24 08:26:33 GOT CHUNK: 248 2016/03/24 08:26:33 GOT CHUNK: 174 2016/03/24 08:26:33 GOT CHUNK: 200 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 211 2016/03/24 08:26:33 GOT CHUNK: 216 2016/03/24 08:26:33 GOT CHUNK: 211 2016/03/24 08:26:33 GOT CHUNK: 215 2016/03/24 08:26:33 GOT CHUNK: 196 2016/03/24 08:26:33 GOT CHUNK: 194 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 214 2016/03/24 08:26:33 GOT CHUNK: 216 2016/03/24 08:26:33 GOT CHUNK: 231 2016/03/24 08:26:33 GOT CHUNK: 210 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 211 2016/03/24 08:26:33 GOT CHUNK: 196 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 189 2016/03/24 08:26:33 GOT CHUNK: 241 2016/03/24 08:26:33 GOT CHUNK: 236 2016/03/24 08:26:33 GOT CHUNK: 229 2016/03/24 08:26:33 GOT CHUNK: 215 2016/03/24 08:26:33 GOT CHUNK: 210 2016/03/24 08:26:33 GOT CHUNK: 254 2016/03/24 08:26:33 GOT CHUNK: 213 2016/03/24 08:26:33 GOT CHUNK: 214 2016/03/24 08:26:33 GOT CHUNK: 224 2016/03/24 08:26:33 GOT CHUNK: 239 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 234 2016/03/24 08:26:33 GOT CHUNK: 201 2016/03/24 08:26:33 GOT CHUNK: 204 2016/03/24 08:26:33 GOT CHUNK: 215 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 222 2016/03/24 08:26:33 GOT CHUNK: 232 2016/03/24 08:26:33 GOT CHUNK: 207 2016/03/24 08:26:33 GOT CHUNK: 208 2016/03/24 08:26:33 GOT CHUNK: 221 2016/03/24 08:26:33 GOT CHUNK: 238 2016/03/24 08:26:33 GOT CHUNK: 206 2016/03/24 08:26:33 GOT CHUNK: 229 2016/03/24 08:26:33 GOT CHUNK: 223 2016/03/24 08:26:33 GOT CHUNK: 203 2016/03/24 08:26:33 GOT CHUNK: 239 2016/03/24 08:26:33 GOT CHUNK: 228 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 223 2016/03/24 08:26:33 GOT CHUNK: 247 2016/03/24 08:26:33 GOT CHUNK: 195 2016/03/24 08:26:33 GOT CHUNK: 200 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 217 2016/03/24 08:26:33 GOT CHUNK: 234 2016/03/24 08:26:33 GOT CHUNK: 202 2016/03/24 08:26:33 GOT CHUNK: 214 2016/03/24 08:26:33 GOT CHUNK: 231 2016/03/24 08:26:33 GOT CHUNK: 246 2016/03/24 08:26:33 GOT CHUNK: 201 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 212 2016/03/24 08:26:33 GOT CHUNK: 201 2016/03/24 08:26:33 GOT CHUNK: 241 2016/03/24 08:26:33 GOT CHUNK: 236 2016/03/24 08:26:33 GOT CHUNK: 223 2016/03/24 08:26:33 GOT CHUNK: 217 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 210 2016/03/24 08:26:33 GOT CHUNK: 198 2016/03/24 08:26:33 GOT CHUNK: 204 2016/03/24 08:26:33 GOT CHUNK: 187 2016/03/24 08:26:33 GOT CHUNK: 224 2016/03/24 08:26:33 GOT CHUNK: 229 2016/03/24 08:26:33 GOT CHUNK: 236 2016/03/24 08:26:33 GOT CHUNK: 229 2016/03/24 08:26:33 GOT CHUNK: 218 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 230 2016/03/24 08:26:33 GOT CHUNK: 215 2016/03/24 08:26:33 GOT CHUNK: 173 2016/03/24 08:26:33 GOT CHUNK: 237 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 187 2016/03/24 08:26:33 GOT CHUNK: 191 2016/03/24 08:26:33 GOT CHUNK: 163 2016/03/24 08:26:33 GOT CHUNK: 190 2016/03/24 08:26:33 GOT CHUNK: 213 2016/03/24 08:26:33 GOT CHUNK: 201 2016/03/24 08:26:33 GOT CHUNK: 207 2016/03/24 08:26:33 GOT CHUNK: 200 2016/03/24 08:26:33 GOT CHUNK: 166 2016/03/24 08:26:33 GOT CHUNK: 212 2016/03/24 08:26:33 GOT CHUNK: 207 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 227 2016/03/24 08:26:33 GOT CHUNK: 172 2016/03/24 08:26:33 GOT CHUNK: 187 2016/03/24 08:26:33 GOT CHUNK: 202 2016/03/24 08:26:33 GOT CHUNK: 209 2016/03/24 08:26:33 GOT CHUNK: 224 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 244 2016/03/24 08:26:33 GOT CHUNK: 240 2016/03/24 08:26:33 GOT CHUNK: 230 2016/03/24 08:26:33 GOT CHUNK: 207 2016/03/24 08:26:33 GOT CHUNK: 235 2016/03/24 08:26:33 GOT CHUNK: 224 2016/03/24 08:26:33 GOT CHUNK: 0 2016/03/24 08:26:33 number of entries 121403 2016/03/24 08:26:33 Expected and Actual scan responses are the same 2016/03/24 08:26:33 RANGE cities -low 2016/03/24 08:26:33 Status : 200 OK 2016/03/24 08:26:33 GOT CHUNK: 223 2016/03/24 08:26:33 GOT CHUNK: 234 2016/03/24 08:26:33 GOT CHUNK: 210 2016/03/24 08:26:33 GOT CHUNK: 220 2016/03/24 08:26:33 GOT CHUNK: 235 2016/03/24 08:26:33 GOT CHUNK: 247 2016/03/24 08:26:33 GOT CHUNK: 237 2016/03/24 08:26:33 GOT CHUNK: 245 2016/03/24 08:26:33 GOT CHUNK: 216 2016/03/24 08:26:33 GOT CHUNK: 222 2016/03/24 08:26:33 GOT CHUNK: 203 2016/03/24 08:26:33 GOT CHUNK: 209 2016/03/24 08:26:33 GOT CHUNK: 177 2016/03/24 08:26:33 GOT CHUNK: 226 2016/03/24 08:26:33 GOT CHUNK: 235 2016/03/24 08:26:33 GOT CHUNK: 187 2016/03/24 08:26:33 GOT CHUNK: 213 2016/03/24 08:26:33 GOT CHUNK: 228 2016/03/24 08:26:33 GOT CHUNK: 245 2016/03/24 08:26:33 GOT CHUNK: 235 2016/03/24 08:26:33 GOT CHUNK: 219 2016/03/24 08:26:33 GOT CHUNK: 200 2016/03/24 08:26:33 GOT CHUNK: 184 2016/03/24 08:26:33 GOT CHUNK: 196 2016/03/24 08:26:33 GOT CHUNK: 236 2016/03/24 08:26:33 GOT CHUNK: 229 2016/03/24 08:26:33 GOT CHUNK: 202 2016/03/24 08:26:33 GOT CHUNK: 207 2016/03/24 08:26:33 GOT CHUNK: 250 2016/03/24 08:26:33 GOT CHUNK: 244 2016/03/24 08:26:33 GOT CHUNK: 225 2016/03/24 08:26:33 GOT CHUNK: 232 2016/03/24 08:26:33 GOT CHUNK: 238 2016/03/24 08:26:33 GOT CHUNK: 238 2016/03/24 08:26:33 GOT CHUNK: 237 2016/03/24 08:26:33 GOT CHUNK: 232 2016/03/24 08:26:33 GOT CHUNK: 218 2016/03/24 08:26:33 GOT CHUNK: 228 2016/03/24 08:26:33 GOT CHUNK: 238 2016/03/24 08:26:33 GOT CHUNK: 224 2016/03/24 08:26:33 GOT CHUNK: 237 2016/03/24 08:26:33 GOT CHUNK: 218 2016/03/24 08:26:33 GOT CHUNK: 230 2016/03/24 08:26:33 GOT CHUNK: 217 2016/03/24 08:26:33 GOT CHUNK: 251 2016/03/24 08:26:33 GOT CHUNK: 239 2016/03/24 08:26:33 GOT CHUNK: 237 2016/03/24 08:26:33 GOT CHUNK: 217 2016/03/24 08:26:33 GOT CHUNK: 171 2016/03/24 08:26:33 GOT CHUNK: 174 2016/03/24 08:26:33 GOT CHUNK: 205 2016/03/24 08:26:33 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 230 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 197 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 186 2016/03/24 08:26:34 GOT CHUNK: 230 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 225 2016/03/24 08:26:34 GOT CHUNK: 225 2016/03/24 08:26:34 GOT CHUNK: 204 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 200 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 240 2016/03/24 08:26:34 GOT CHUNK: 253 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 230 2016/03/24 08:26:34 GOT CHUNK: 231 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 212 2016/03/24 08:26:34 GOT CHUNK: 194 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 197 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 176 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 213 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 206 2016/03/24 08:26:34 GOT CHUNK: 201 2016/03/24 08:26:34 GOT CHUNK: 204 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 183 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 219 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 244 2016/03/24 08:26:34 GOT CHUNK: 213 2016/03/24 08:26:34 GOT CHUNK: 207 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 207 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 230 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 185 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 205 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 171 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 208 2016/03/24 08:26:34 GOT CHUNK: 188 2016/03/24 08:26:34 GOT CHUNK: 225 2016/03/24 08:26:34 GOT CHUNK: 192 2016/03/24 08:26:34 GOT CHUNK: 168 2016/03/24 08:26:34 GOT CHUNK: 196 2016/03/24 08:26:34 GOT CHUNK: 201 2016/03/24 08:26:34 GOT CHUNK: 205 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 231 2016/03/24 08:26:34 GOT CHUNK: 205 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 159 2016/03/24 08:26:34 GOT CHUNK: 158 2016/03/24 08:26:34 GOT CHUNK: 240 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 212 2016/03/24 08:26:34 GOT CHUNK: 160 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 247 2016/03/24 08:26:34 GOT CHUNK: 242 2016/03/24 08:26:34 GOT CHUNK: 256 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 246 2016/03/24 08:26:34 GOT CHUNK: 255 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 202 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 206 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 190 2016/03/24 08:26:34 GOT CHUNK: 202 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 202 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 200 2016/03/24 08:26:34 GOT CHUNK: 184 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 213 2016/03/24 08:26:34 GOT CHUNK: 158 2016/03/24 08:26:34 GOT CHUNK: 160 2016/03/24 08:26:34 GOT CHUNK: 182 2016/03/24 08:26:34 GOT CHUNK: 185 2016/03/24 08:26:34 GOT CHUNK: 169 2016/03/24 08:26:34 GOT CHUNK: 205 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 195 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 201 2016/03/24 08:26:34 GOT CHUNK: 191 2016/03/24 08:26:34 GOT CHUNK: 208 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 213 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 195 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 165 2016/03/24 08:26:34 GOT CHUNK: 156 2016/03/24 08:26:34 GOT CHUNK: 161 2016/03/24 08:26:34 GOT CHUNK: 191 2016/03/24 08:26:34 GOT CHUNK: 196 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 201 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 242 2016/03/24 08:26:34 GOT CHUNK: 242 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 182 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 172 2016/03/24 08:26:34 GOT CHUNK: 161 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 177 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 233 2016/03/24 08:26:34 GOT CHUNK: 221 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 200 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 256 2016/03/24 08:26:34 GOT CHUNK: 231 2016/03/24 08:26:34 GOT CHUNK: 243 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 207 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 184 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 255 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 181 2016/03/24 08:26:34 GOT CHUNK: 202 2016/03/24 08:26:34 GOT CHUNK: 206 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 206 2016/03/24 08:26:34 GOT CHUNK: 208 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 161 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 251 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 231 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 247 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 240 2016/03/24 08:26:34 GOT CHUNK: 178 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 208 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 234 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 243 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 233 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 219 2016/03/24 08:26:34 GOT CHUNK: 241 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 204 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 205 2016/03/24 08:26:34 GOT CHUNK: 223 2016/03/24 08:26:34 GOT CHUNK: 234 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 247 2016/03/24 08:26:34 GOT CHUNK: 221 2016/03/24 08:26:34 GOT CHUNK: 221 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 240 2016/03/24 08:26:34 GOT CHUNK: 225 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 214 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 194 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 234 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 202 2016/03/24 08:26:34 GOT CHUNK: 234 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 219 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 229 2016/03/24 08:26:34 GOT CHUNK: 227 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 242 2016/03/24 08:26:34 GOT CHUNK: 237 2016/03/24 08:26:34 GOT CHUNK: 217 2016/03/24 08:26:34 GOT CHUNK: 222 2016/03/24 08:26:34 GOT CHUNK: 218 2016/03/24 08:26:34 GOT CHUNK: 262 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 220 2016/03/24 08:26:34 GOT CHUNK: 230 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 226 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 176 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 216 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 232 2016/03/24 08:26:34 GOT CHUNK: 203 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 238 2016/03/24 08:26:34 GOT CHUNK: 255 2016/03/24 08:26:34 GOT CHUNK: 186 2016/03/24 08:26:34 GOT CHUNK: 211 2016/03/24 08:26:34 GOT CHUNK: 209 2016/03/24 08:26:34 GOT CHUNK: 221 2016/03/24 08:26:34 GOT CHUNK: 255 2016/03/24 08:26:34 GOT CHUNK: 228 2016/03/24 08:26:34 GOT CHUNK: 239 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 208 2016/03/24 08:26:34 GOT CHUNK: 224 2016/03/24 08:26:34 GOT CHUNK: 254 2016/03/24 08:26:34 GOT CHUNK: 235 2016/03/24 08:26:34 GOT CHUNK: 233 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 210 2016/03/24 08:26:34 GOT CHUNK: 225 2016/03/24 08:26:34 GOT CHUNK: 234 2016/03/24 08:26:34 GOT CHUNK: 213 2016/03/24 08:26:34 GOT CHUNK: 215 2016/03/24 08:26:34 GOT CHUNK: 236 2016/03/24 08:26:34 GOT CHUNK: 248 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 210 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 222 2016/03/24 08:26:35 GOT CHUNK: 227 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 200 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 220 2016/03/24 08:26:35 GOT CHUNK: 203 2016/03/24 08:26:35 GOT CHUNK: 198 2016/03/24 08:26:35 GOT CHUNK: 197 2016/03/24 08:26:35 GOT CHUNK: 192 2016/03/24 08:26:35 GOT CHUNK: 196 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 232 2016/03/24 08:26:35 GOT CHUNK: 240 2016/03/24 08:26:35 GOT CHUNK: 242 2016/03/24 08:26:35 GOT CHUNK: 247 2016/03/24 08:26:35 GOT CHUNK: 230 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 225 2016/03/24 08:26:35 GOT CHUNK: 225 2016/03/24 08:26:35 GOT CHUNK: 221 2016/03/24 08:26:35 GOT CHUNK: 219 2016/03/24 08:26:35 GOT CHUNK: 229 2016/03/24 08:26:35 GOT CHUNK: 245 2016/03/24 08:26:35 GOT CHUNK: 244 2016/03/24 08:26:35 GOT CHUNK: 247 2016/03/24 08:26:35 GOT CHUNK: 200 2016/03/24 08:26:35 GOT CHUNK: 212 2016/03/24 08:26:35 GOT CHUNK: 207 2016/03/24 08:26:35 GOT CHUNK: 228 2016/03/24 08:26:35 GOT CHUNK: 256 2016/03/24 08:26:35 GOT CHUNK: 203 2016/03/24 08:26:35 GOT CHUNK: 237 2016/03/24 08:26:35 GOT CHUNK: 245 2016/03/24 08:26:35 GOT CHUNK: 253 2016/03/24 08:26:35 GOT CHUNK: 185 2016/03/24 08:26:35 GOT CHUNK: 243 2016/03/24 08:26:35 GOT CHUNK: 251 2016/03/24 08:26:35 GOT CHUNK: 215 2016/03/24 08:26:35 GOT CHUNK: 240 2016/03/24 08:26:35 GOT CHUNK: 172 2016/03/24 08:26:35 GOT CHUNK: 217 2016/03/24 08:26:35 GOT CHUNK: 241 2016/03/24 08:26:35 GOT CHUNK: 208 2016/03/24 08:26:35 GOT CHUNK: 221 2016/03/24 08:26:35 GOT CHUNK: 222 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 217 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 207 2016/03/24 08:26:35 GOT CHUNK: 202 2016/03/24 08:26:35 GOT CHUNK: 212 2016/03/24 08:26:35 GOT CHUNK: 237 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 222 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 196 2016/03/24 08:26:35 GOT CHUNK: 200 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 187 2016/03/24 08:26:35 GOT CHUNK: 241 2016/03/24 08:26:35 GOT CHUNK: 242 2016/03/24 08:26:35 GOT CHUNK: 165 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 217 2016/03/24 08:26:35 GOT CHUNK: 235 2016/03/24 08:26:35 GOT CHUNK: 231 2016/03/24 08:26:35 GOT CHUNK: 212 2016/03/24 08:26:35 GOT CHUNK: 248 2016/03/24 08:26:35 GOT CHUNK: 174 2016/03/24 08:26:35 GOT CHUNK: 200 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 215 2016/03/24 08:26:35 GOT CHUNK: 196 2016/03/24 08:26:35 GOT CHUNK: 194 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 216 2016/03/24 08:26:35 GOT CHUNK: 231 2016/03/24 08:26:35 GOT CHUNK: 210 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 211 2016/03/24 08:26:35 GOT CHUNK: 196 2016/03/24 08:26:35 GOT CHUNK: 219 2016/03/24 08:26:35 GOT CHUNK: 189 2016/03/24 08:26:35 GOT CHUNK: 241 2016/03/24 08:26:35 GOT CHUNK: 236 2016/03/24 08:26:35 GOT CHUNK: 229 2016/03/24 08:26:35 GOT CHUNK: 215 2016/03/24 08:26:35 GOT CHUNK: 210 2016/03/24 08:26:35 GOT CHUNK: 254 2016/03/24 08:26:35 GOT CHUNK: 213 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 224 2016/03/24 08:26:35 GOT CHUNK: 239 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 234 2016/03/24 08:26:35 GOT CHUNK: 201 2016/03/24 08:26:35 GOT CHUNK: 204 2016/03/24 08:26:35 GOT CHUNK: 215 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 222 2016/03/24 08:26:35 GOT CHUNK: 232 2016/03/24 08:26:35 GOT CHUNK: 207 2016/03/24 08:26:35 GOT CHUNK: 208 2016/03/24 08:26:35 GOT CHUNK: 221 2016/03/24 08:26:35 GOT CHUNK: 238 2016/03/24 08:26:35 GOT CHUNK: 206 2016/03/24 08:26:35 GOT CHUNK: 229 2016/03/24 08:26:35 GOT CHUNK: 223 2016/03/24 08:26:35 GOT CHUNK: 203 2016/03/24 08:26:35 GOT CHUNK: 239 2016/03/24 08:26:35 GOT CHUNK: 228 2016/03/24 08:26:35 GOT CHUNK: 226 2016/03/24 08:26:35 GOT CHUNK: 223 2016/03/24 08:26:35 GOT CHUNK: 247 2016/03/24 08:26:35 GOT CHUNK: 195 2016/03/24 08:26:35 GOT CHUNK: 200 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:35 GOT CHUNK: 217 2016/03/24 08:26:35 GOT CHUNK: 234 2016/03/24 08:26:35 GOT CHUNK: 202 2016/03/24 08:26:35 GOT CHUNK: 214 2016/03/24 08:26:35 GOT CHUNK: 231 2016/03/24 08:26:35 GOT CHUNK: 246 2016/03/24 08:26:35 GOT CHUNK: 201 2016/03/24 08:26:35 GOT CHUNK: 219 2016/03/24 08:26:35 GOT CHUNK: 219 2016/03/24 08:26:35 GOT CHUNK: 212 2016/03/24 08:26:35 GOT CHUNK: 201 2016/03/24 08:26:35 GOT CHUNK: 241 2016/03/24 08:26:35 GOT CHUNK: 236 2016/03/24 08:26:35 GOT CHUNK: 223 2016/03/24 08:26:35 GOT CHUNK: 217 2016/03/24 08:26:35 GOT CHUNK: 205 2016/03/24 08:26:36 GOT CHUNK: 210 2016/03/24 08:26:36 GOT CHUNK: 198 2016/03/24 08:26:36 GOT CHUNK: 204 2016/03/24 08:26:36 GOT CHUNK: 187 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 229 2016/03/24 08:26:36 GOT CHUNK: 236 2016/03/24 08:26:36 GOT CHUNK: 229 2016/03/24 08:26:36 GOT CHUNK: 218 2016/03/24 08:26:36 GOT CHUNK: 219 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 215 2016/03/24 08:26:36 GOT CHUNK: 173 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 219 2016/03/24 08:26:36 GOT CHUNK: 187 2016/03/24 08:26:36 GOT CHUNK: 191 2016/03/24 08:26:36 GOT CHUNK: 163 2016/03/24 08:26:36 GOT CHUNK: 190 2016/03/24 08:26:36 GOT CHUNK: 213 2016/03/24 08:26:36 GOT CHUNK: 201 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 200 2016/03/24 08:26:36 GOT CHUNK: 166 2016/03/24 08:26:36 GOT CHUNK: 212 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 205 2016/03/24 08:26:36 GOT CHUNK: 227 2016/03/24 08:26:36 GOT CHUNK: 172 2016/03/24 08:26:36 GOT CHUNK: 187 2016/03/24 08:26:36 GOT CHUNK: 202 2016/03/24 08:26:36 GOT CHUNK: 209 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 226 2016/03/24 08:26:36 GOT CHUNK: 244 2016/03/24 08:26:36 GOT CHUNK: 240 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 235 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 0 2016/03/24 08:26:36 number of entries 121403 2016/03/24 08:26:36 Expected and Actual scan responses are the same 2016/03/24 08:26:36 RANGE cities -high 2016/03/24 08:26:36 Status : 200 OK 2016/03/24 08:26:36 GOT CHUNK: 223 2016/03/24 08:26:36 GOT CHUNK: 234 2016/03/24 08:26:36 GOT CHUNK: 210 2016/03/24 08:26:36 GOT CHUNK: 220 2016/03/24 08:26:36 GOT CHUNK: 235 2016/03/24 08:26:36 GOT CHUNK: 247 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 245 2016/03/24 08:26:36 GOT CHUNK: 216 2016/03/24 08:26:36 GOT CHUNK: 222 2016/03/24 08:26:36 GOT CHUNK: 203 2016/03/24 08:26:36 GOT CHUNK: 209 2016/03/24 08:26:36 GOT CHUNK: 177 2016/03/24 08:26:36 GOT CHUNK: 226 2016/03/24 08:26:36 GOT CHUNK: 235 2016/03/24 08:26:36 GOT CHUNK: 187 2016/03/24 08:26:36 GOT CHUNK: 213 2016/03/24 08:26:36 GOT CHUNK: 228 2016/03/24 08:26:36 GOT CHUNK: 245 2016/03/24 08:26:36 GOT CHUNK: 235 2016/03/24 08:26:36 GOT CHUNK: 219 2016/03/24 08:26:36 GOT CHUNK: 200 2016/03/24 08:26:36 GOT CHUNK: 184 2016/03/24 08:26:36 GOT CHUNK: 196 2016/03/24 08:26:36 GOT CHUNK: 236 2016/03/24 08:26:36 GOT CHUNK: 229 2016/03/24 08:26:36 GOT CHUNK: 202 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 250 2016/03/24 08:26:36 GOT CHUNK: 244 2016/03/24 08:26:36 GOT CHUNK: 225 2016/03/24 08:26:36 GOT CHUNK: 232 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 232 2016/03/24 08:26:36 GOT CHUNK: 218 2016/03/24 08:26:36 GOT CHUNK: 228 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 218 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 217 2016/03/24 08:26:36 GOT CHUNK: 251 2016/03/24 08:26:36 GOT CHUNK: 239 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 217 2016/03/24 08:26:36 GOT CHUNK: 171 2016/03/24 08:26:36 GOT CHUNK: 174 2016/03/24 08:26:36 GOT CHUNK: 205 2016/03/24 08:26:36 GOT CHUNK: 232 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 239 2016/03/24 08:26:36 GOT CHUNK: 197 2016/03/24 08:26:36 GOT CHUNK: 211 2016/03/24 08:26:36 GOT CHUNK: 216 2016/03/24 08:26:36 GOT CHUNK: 186 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 235 2016/03/24 08:26:36 GOT CHUNK: 239 2016/03/24 08:26:36 GOT CHUNK: 225 2016/03/24 08:26:36 GOT CHUNK: 225 2016/03/24 08:26:36 GOT CHUNK: 204 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 222 2016/03/24 08:26:36 GOT CHUNK: 200 2016/03/24 08:26:36 GOT CHUNK: 239 2016/03/24 08:26:36 GOT CHUNK: 240 2016/03/24 08:26:36 GOT CHUNK: 253 2016/03/24 08:26:36 GOT CHUNK: 216 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 231 2016/03/24 08:26:36 GOT CHUNK: 237 2016/03/24 08:26:36 GOT CHUNK: 212 2016/03/24 08:26:36 GOT CHUNK: 194 2016/03/24 08:26:36 GOT CHUNK: 203 2016/03/24 08:26:36 GOT CHUNK: 197 2016/03/24 08:26:36 GOT CHUNK: 238 2016/03/24 08:26:36 GOT CHUNK: 203 2016/03/24 08:26:36 GOT CHUNK: 176 2016/03/24 08:26:36 GOT CHUNK: 218 2016/03/24 08:26:36 GOT CHUNK: 217 2016/03/24 08:26:36 GOT CHUNK: 213 2016/03/24 08:26:36 GOT CHUNK: 210 2016/03/24 08:26:36 GOT CHUNK: 206 2016/03/24 08:26:36 GOT CHUNK: 201 2016/03/24 08:26:36 GOT CHUNK: 204 2016/03/24 08:26:36 GOT CHUNK: 214 2016/03/24 08:26:36 GOT CHUNK: 183 2016/03/24 08:26:36 GOT CHUNK: 222 2016/03/24 08:26:36 GOT CHUNK: 223 2016/03/24 08:26:36 GOT CHUNK: 216 2016/03/24 08:26:36 GOT CHUNK: 222 2016/03/24 08:26:36 GOT CHUNK: 222 2016/03/24 08:26:36 GOT CHUNK: 228 2016/03/24 08:26:36 GOT CHUNK: 203 2016/03/24 08:26:36 GOT CHUNK: 203 2016/03/24 08:26:36 GOT CHUNK: 211 2016/03/24 08:26:36 GOT CHUNK: 219 2016/03/24 08:26:36 GOT CHUNK: 210 2016/03/24 08:26:36 GOT CHUNK: 244 2016/03/24 08:26:36 GOT CHUNK: 213 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 226 2016/03/24 08:26:36 GOT CHUNK: 207 2016/03/24 08:26:36 GOT CHUNK: 218 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 230 2016/03/24 08:26:36 GOT CHUNK: 209 2016/03/24 08:26:36 GOT CHUNK: 185 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 205 2016/03/24 08:26:36 GOT CHUNK: 229 2016/03/24 08:26:36 GOT CHUNK: 224 2016/03/24 08:26:36 GOT CHUNK: 171 2016/03/24 08:26:36 GOT CHUNK: 217 2016/03/24 08:26:36 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 188 2016/03/24 08:26:37 GOT CHUNK: 225 2016/03/24 08:26:37 GOT CHUNK: 192 2016/03/24 08:26:37 GOT CHUNK: 168 2016/03/24 08:26:37 GOT CHUNK: 196 2016/03/24 08:26:37 GOT CHUNK: 201 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 231 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 159 2016/03/24 08:26:37 GOT CHUNK: 158 2016/03/24 08:26:37 GOT CHUNK: 240 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 212 2016/03/24 08:26:37 GOT CHUNK: 160 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 247 2016/03/24 08:26:37 GOT CHUNK: 242 2016/03/24 08:26:37 GOT CHUNK: 256 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 246 2016/03/24 08:26:37 GOT CHUNK: 255 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 202 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 206 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 190 2016/03/24 08:26:37 GOT CHUNK: 202 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 202 2016/03/24 08:26:37 GOT CHUNK: 218 2016/03/24 08:26:37 GOT CHUNK: 200 2016/03/24 08:26:37 GOT CHUNK: 184 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 213 2016/03/24 08:26:37 GOT CHUNK: 158 2016/03/24 08:26:37 GOT CHUNK: 160 2016/03/24 08:26:37 GOT CHUNK: 182 2016/03/24 08:26:37 GOT CHUNK: 185 2016/03/24 08:26:37 GOT CHUNK: 169 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 195 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 201 2016/03/24 08:26:37 GOT CHUNK: 191 2016/03/24 08:26:37 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 213 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 195 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 165 2016/03/24 08:26:37 GOT CHUNK: 156 2016/03/24 08:26:37 GOT CHUNK: 161 2016/03/24 08:26:37 GOT CHUNK: 191 2016/03/24 08:26:37 GOT CHUNK: 196 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 201 2016/03/24 08:26:37 GOT CHUNK: 218 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 242 2016/03/24 08:26:37 GOT CHUNK: 242 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 182 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 218 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 172 2016/03/24 08:26:37 GOT CHUNK: 161 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 177 2016/03/24 08:26:37 GOT CHUNK: 218 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 203 2016/03/24 08:26:37 GOT CHUNK: 233 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 200 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 256 2016/03/24 08:26:37 GOT CHUNK: 231 2016/03/24 08:26:37 GOT CHUNK: 243 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 207 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 184 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 255 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 181 2016/03/24 08:26:37 GOT CHUNK: 202 2016/03/24 08:26:37 GOT CHUNK: 206 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 206 2016/03/24 08:26:37 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 161 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 251 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 231 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 247 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 240 2016/03/24 08:26:37 GOT CHUNK: 178 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 238 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 234 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 243 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 233 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 219 2016/03/24 08:26:37 GOT CHUNK: 241 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 204 2016/03/24 08:26:37 GOT CHUNK: 238 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 223 2016/03/24 08:26:37 GOT CHUNK: 234 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 247 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 240 2016/03/24 08:26:37 GOT CHUNK: 225 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 194 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 234 2016/03/24 08:26:37 GOT CHUNK: 238 2016/03/24 08:26:37 GOT CHUNK: 202 2016/03/24 08:26:37 GOT CHUNK: 234 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 219 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 242 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 218 2016/03/24 08:26:37 GOT CHUNK: 262 2016/03/24 08:26:37 GOT CHUNK: 210 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 230 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 176 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 203 2016/03/24 08:26:37 GOT CHUNK: 210 2016/03/24 08:26:37 GOT CHUNK: 238 2016/03/24 08:26:37 GOT CHUNK: 255 2016/03/24 08:26:37 GOT CHUNK: 186 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 209 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 255 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 239 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 224 2016/03/24 08:26:37 GOT CHUNK: 254 2016/03/24 08:26:37 GOT CHUNK: 235 2016/03/24 08:26:37 GOT CHUNK: 233 2016/03/24 08:26:37 GOT CHUNK: 210 2016/03/24 08:26:37 GOT CHUNK: 210 2016/03/24 08:26:37 GOT CHUNK: 225 2016/03/24 08:26:37 GOT CHUNK: 234 2016/03/24 08:26:37 GOT CHUNK: 213 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 236 2016/03/24 08:26:37 GOT CHUNK: 248 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 210 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:37 GOT CHUNK: 227 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 200 2016/03/24 08:26:37 GOT CHUNK: 205 2016/03/24 08:26:37 GOT CHUNK: 214 2016/03/24 08:26:37 GOT CHUNK: 220 2016/03/24 08:26:37 GOT CHUNK: 203 2016/03/24 08:26:37 GOT CHUNK: 198 2016/03/24 08:26:37 GOT CHUNK: 197 2016/03/24 08:26:37 GOT CHUNK: 192 2016/03/24 08:26:37 GOT CHUNK: 196 2016/03/24 08:26:37 GOT CHUNK: 211 2016/03/24 08:26:37 GOT CHUNK: 216 2016/03/24 08:26:37 GOT CHUNK: 232 2016/03/24 08:26:37 GOT CHUNK: 240 2016/03/24 08:26:37 GOT CHUNK: 242 2016/03/24 08:26:37 GOT CHUNK: 247 2016/03/24 08:26:37 GOT CHUNK: 230 2016/03/24 08:26:37 GOT CHUNK: 226 2016/03/24 08:26:37 GOT CHUNK: 225 2016/03/24 08:26:37 GOT CHUNK: 225 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 219 2016/03/24 08:26:37 GOT CHUNK: 229 2016/03/24 08:26:37 GOT CHUNK: 245 2016/03/24 08:26:37 GOT CHUNK: 244 2016/03/24 08:26:37 GOT CHUNK: 247 2016/03/24 08:26:37 GOT CHUNK: 200 2016/03/24 08:26:37 GOT CHUNK: 212 2016/03/24 08:26:37 GOT CHUNK: 207 2016/03/24 08:26:37 GOT CHUNK: 228 2016/03/24 08:26:37 GOT CHUNK: 256 2016/03/24 08:26:37 GOT CHUNK: 203 2016/03/24 08:26:37 GOT CHUNK: 237 2016/03/24 08:26:37 GOT CHUNK: 245 2016/03/24 08:26:37 GOT CHUNK: 253 2016/03/24 08:26:37 GOT CHUNK: 185 2016/03/24 08:26:37 GOT CHUNK: 243 2016/03/24 08:26:37 GOT CHUNK: 251 2016/03/24 08:26:37 GOT CHUNK: 215 2016/03/24 08:26:37 GOT CHUNK: 240 2016/03/24 08:26:37 GOT CHUNK: 172 2016/03/24 08:26:37 GOT CHUNK: 217 2016/03/24 08:26:37 GOT CHUNK: 241 2016/03/24 08:26:37 GOT CHUNK: 208 2016/03/24 08:26:37 GOT CHUNK: 221 2016/03/24 08:26:37 GOT CHUNK: 222 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 214 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 202 2016/03/24 08:26:38 GOT CHUNK: 212 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 214 2016/03/24 08:26:38 GOT CHUNK: 222 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 196 2016/03/24 08:26:38 GOT CHUNK: 200 2016/03/24 08:26:38 GOT CHUNK: 216 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 187 2016/03/24 08:26:38 GOT CHUNK: 241 2016/03/24 08:26:38 GOT CHUNK: 242 2016/03/24 08:26:38 GOT CHUNK: 165 2016/03/24 08:26:38 GOT CHUNK: 216 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 235 2016/03/24 08:26:38 GOT CHUNK: 231 2016/03/24 08:26:38 GOT CHUNK: 212 2016/03/24 08:26:38 GOT CHUNK: 248 2016/03/24 08:26:38 GOT CHUNK: 174 2016/03/24 08:26:38 GOT CHUNK: 200 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 211 2016/03/24 08:26:38 GOT CHUNK: 216 2016/03/24 08:26:38 GOT CHUNK: 211 2016/03/24 08:26:38 GOT CHUNK: 215 2016/03/24 08:26:38 GOT CHUNK: 196 2016/03/24 08:26:38 GOT CHUNK: 194 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 214 2016/03/24 08:26:38 GOT CHUNK: 216 2016/03/24 08:26:38 GOT CHUNK: 231 2016/03/24 08:26:38 GOT CHUNK: 210 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 211 2016/03/24 08:26:38 GOT CHUNK: 196 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 189 2016/03/24 08:26:38 GOT CHUNK: 241 2016/03/24 08:26:38 GOT CHUNK: 236 2016/03/24 08:26:38 GOT CHUNK: 229 2016/03/24 08:26:38 GOT CHUNK: 215 2016/03/24 08:26:38 GOT CHUNK: 210 2016/03/24 08:26:38 GOT CHUNK: 254 2016/03/24 08:26:38 GOT CHUNK: 213 2016/03/24 08:26:38 GOT CHUNK: 214 2016/03/24 08:26:38 GOT CHUNK: 224 2016/03/24 08:26:38 GOT CHUNK: 239 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 234 2016/03/24 08:26:38 GOT CHUNK: 201 2016/03/24 08:26:38 GOT CHUNK: 204 2016/03/24 08:26:38 GOT CHUNK: 215 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 222 2016/03/24 08:26:38 GOT CHUNK: 232 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 208 2016/03/24 08:26:38 GOT CHUNK: 221 2016/03/24 08:26:38 GOT CHUNK: 238 2016/03/24 08:26:38 GOT CHUNK: 206 2016/03/24 08:26:38 GOT CHUNK: 229 2016/03/24 08:26:38 GOT CHUNK: 223 2016/03/24 08:26:38 GOT CHUNK: 203 2016/03/24 08:26:38 GOT CHUNK: 239 2016/03/24 08:26:38 GOT CHUNK: 228 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 223 2016/03/24 08:26:38 GOT CHUNK: 247 2016/03/24 08:26:38 GOT CHUNK: 195 2016/03/24 08:26:38 GOT CHUNK: 200 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 234 2016/03/24 08:26:38 GOT CHUNK: 202 2016/03/24 08:26:38 GOT CHUNK: 214 2016/03/24 08:26:38 GOT CHUNK: 231 2016/03/24 08:26:38 GOT CHUNK: 246 2016/03/24 08:26:38 GOT CHUNK: 201 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 212 2016/03/24 08:26:38 GOT CHUNK: 201 2016/03/24 08:26:38 GOT CHUNK: 241 2016/03/24 08:26:38 GOT CHUNK: 236 2016/03/24 08:26:38 GOT CHUNK: 223 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 210 2016/03/24 08:26:38 GOT CHUNK: 198 2016/03/24 08:26:38 GOT CHUNK: 204 2016/03/24 08:26:38 GOT CHUNK: 187 2016/03/24 08:26:38 GOT CHUNK: 224 2016/03/24 08:26:38 GOT CHUNK: 229 2016/03/24 08:26:38 GOT CHUNK: 236 2016/03/24 08:26:38 GOT CHUNK: 229 2016/03/24 08:26:38 GOT CHUNK: 218 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 230 2016/03/24 08:26:38 GOT CHUNK: 215 2016/03/24 08:26:38 GOT CHUNK: 173 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 187 2016/03/24 08:26:38 GOT CHUNK: 191 2016/03/24 08:26:38 GOT CHUNK: 163 2016/03/24 08:26:38 GOT CHUNK: 190 2016/03/24 08:26:38 GOT CHUNK: 213 2016/03/24 08:26:38 GOT CHUNK: 201 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 200 2016/03/24 08:26:38 GOT CHUNK: 166 2016/03/24 08:26:38 GOT CHUNK: 212 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 227 2016/03/24 08:26:38 GOT CHUNK: 172 2016/03/24 08:26:38 GOT CHUNK: 187 2016/03/24 08:26:38 GOT CHUNK: 202 2016/03/24 08:26:38 GOT CHUNK: 209 2016/03/24 08:26:38 GOT CHUNK: 224 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 244 2016/03/24 08:26:38 GOT CHUNK: 240 2016/03/24 08:26:38 GOT CHUNK: 230 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 235 2016/03/24 08:26:38 GOT CHUNK: 224 2016/03/24 08:26:38 GOT CHUNK: 0 2016/03/24 08:26:38 number of entries 121403 2016/03/24 08:26:38 Expected and Actual scan responses are the same 2016/03/24 08:26:38 RANGE cities - both 2016/03/24 08:26:38 Status : 200 OK 2016/03/24 08:26:38 GOT CHUNK: 223 2016/03/24 08:26:38 GOT CHUNK: 234 2016/03/24 08:26:38 GOT CHUNK: 210 2016/03/24 08:26:38 GOT CHUNK: 220 2016/03/24 08:26:38 GOT CHUNK: 235 2016/03/24 08:26:38 GOT CHUNK: 247 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 245 2016/03/24 08:26:38 GOT CHUNK: 216 2016/03/24 08:26:38 GOT CHUNK: 222 2016/03/24 08:26:38 GOT CHUNK: 203 2016/03/24 08:26:38 GOT CHUNK: 209 2016/03/24 08:26:38 GOT CHUNK: 177 2016/03/24 08:26:38 GOT CHUNK: 226 2016/03/24 08:26:38 GOT CHUNK: 235 2016/03/24 08:26:38 GOT CHUNK: 187 2016/03/24 08:26:38 GOT CHUNK: 213 2016/03/24 08:26:38 GOT CHUNK: 228 2016/03/24 08:26:38 GOT CHUNK: 245 2016/03/24 08:26:38 GOT CHUNK: 235 2016/03/24 08:26:38 GOT CHUNK: 219 2016/03/24 08:26:38 GOT CHUNK: 200 2016/03/24 08:26:38 GOT CHUNK: 184 2016/03/24 08:26:38 GOT CHUNK: 196 2016/03/24 08:26:38 GOT CHUNK: 236 2016/03/24 08:26:38 GOT CHUNK: 229 2016/03/24 08:26:38 GOT CHUNK: 202 2016/03/24 08:26:38 GOT CHUNK: 207 2016/03/24 08:26:38 GOT CHUNK: 250 2016/03/24 08:26:38 GOT CHUNK: 244 2016/03/24 08:26:38 GOT CHUNK: 225 2016/03/24 08:26:38 GOT CHUNK: 232 2016/03/24 08:26:38 GOT CHUNK: 238 2016/03/24 08:26:38 GOT CHUNK: 238 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 232 2016/03/24 08:26:38 GOT CHUNK: 218 2016/03/24 08:26:38 GOT CHUNK: 228 2016/03/24 08:26:38 GOT CHUNK: 238 2016/03/24 08:26:38 GOT CHUNK: 224 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 218 2016/03/24 08:26:38 GOT CHUNK: 230 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 251 2016/03/24 08:26:38 GOT CHUNK: 239 2016/03/24 08:26:38 GOT CHUNK: 237 2016/03/24 08:26:38 GOT CHUNK: 217 2016/03/24 08:26:38 GOT CHUNK: 171 2016/03/24 08:26:38 GOT CHUNK: 174 2016/03/24 08:26:38 GOT CHUNK: 205 2016/03/24 08:26:38 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 230 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 197 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 186 2016/03/24 08:26:39 GOT CHUNK: 230 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 225 2016/03/24 08:26:39 GOT CHUNK: 225 2016/03/24 08:26:39 GOT CHUNK: 204 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 200 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 240 2016/03/24 08:26:39 GOT CHUNK: 253 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 230 2016/03/24 08:26:39 GOT CHUNK: 231 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 212 2016/03/24 08:26:39 GOT CHUNK: 194 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 197 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 176 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 213 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 206 2016/03/24 08:26:39 GOT CHUNK: 201 2016/03/24 08:26:39 GOT CHUNK: 204 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 183 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 219 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 244 2016/03/24 08:26:39 GOT CHUNK: 213 2016/03/24 08:26:39 GOT CHUNK: 207 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 207 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 230 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 185 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 171 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 208 2016/03/24 08:26:39 GOT CHUNK: 188 2016/03/24 08:26:39 GOT CHUNK: 225 2016/03/24 08:26:39 GOT CHUNK: 192 2016/03/24 08:26:39 GOT CHUNK: 168 2016/03/24 08:26:39 GOT CHUNK: 196 2016/03/24 08:26:39 GOT CHUNK: 201 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 231 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 159 2016/03/24 08:26:39 GOT CHUNK: 158 2016/03/24 08:26:39 GOT CHUNK: 240 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 212 2016/03/24 08:26:39 GOT CHUNK: 160 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 247 2016/03/24 08:26:39 GOT CHUNK: 242 2016/03/24 08:26:39 GOT CHUNK: 256 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 246 2016/03/24 08:26:39 GOT CHUNK: 255 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 202 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 206 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 190 2016/03/24 08:26:39 GOT CHUNK: 202 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 202 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 200 2016/03/24 08:26:39 GOT CHUNK: 184 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 213 2016/03/24 08:26:39 GOT CHUNK: 158 2016/03/24 08:26:39 GOT CHUNK: 160 2016/03/24 08:26:39 GOT CHUNK: 182 2016/03/24 08:26:39 GOT CHUNK: 185 2016/03/24 08:26:39 GOT CHUNK: 169 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 195 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 201 2016/03/24 08:26:39 GOT CHUNK: 191 2016/03/24 08:26:39 GOT CHUNK: 208 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 213 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 195 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 165 2016/03/24 08:26:39 GOT CHUNK: 156 2016/03/24 08:26:39 GOT CHUNK: 161 2016/03/24 08:26:39 GOT CHUNK: 191 2016/03/24 08:26:39 GOT CHUNK: 196 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 201 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 242 2016/03/24 08:26:39 GOT CHUNK: 242 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 182 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 172 2016/03/24 08:26:39 GOT CHUNK: 161 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 177 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 233 2016/03/24 08:26:39 GOT CHUNK: 221 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 200 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 256 2016/03/24 08:26:39 GOT CHUNK: 231 2016/03/24 08:26:39 GOT CHUNK: 243 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 207 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 184 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 255 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 181 2016/03/24 08:26:39 GOT CHUNK: 202 2016/03/24 08:26:39 GOT CHUNK: 206 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 206 2016/03/24 08:26:39 GOT CHUNK: 208 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 161 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 251 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 231 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 247 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 240 2016/03/24 08:26:39 GOT CHUNK: 178 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 208 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 234 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 243 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 233 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 219 2016/03/24 08:26:39 GOT CHUNK: 241 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 204 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 223 2016/03/24 08:26:39 GOT CHUNK: 234 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 247 2016/03/24 08:26:39 GOT CHUNK: 221 2016/03/24 08:26:39 GOT CHUNK: 221 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 240 2016/03/24 08:26:39 GOT CHUNK: 225 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 214 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 194 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 234 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 202 2016/03/24 08:26:39 GOT CHUNK: 234 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 219 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 229 2016/03/24 08:26:39 GOT CHUNK: 227 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 242 2016/03/24 08:26:39 GOT CHUNK: 237 2016/03/24 08:26:39 GOT CHUNK: 217 2016/03/24 08:26:39 GOT CHUNK: 222 2016/03/24 08:26:39 GOT CHUNK: 218 2016/03/24 08:26:39 GOT CHUNK: 262 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 220 2016/03/24 08:26:39 GOT CHUNK: 230 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 226 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 176 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 216 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 232 2016/03/24 08:26:39 GOT CHUNK: 203 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 238 2016/03/24 08:26:39 GOT CHUNK: 255 2016/03/24 08:26:39 GOT CHUNK: 186 2016/03/24 08:26:39 GOT CHUNK: 211 2016/03/24 08:26:39 GOT CHUNK: 209 2016/03/24 08:26:39 GOT CHUNK: 221 2016/03/24 08:26:39 GOT CHUNK: 255 2016/03/24 08:26:39 GOT CHUNK: 228 2016/03/24 08:26:39 GOT CHUNK: 239 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 208 2016/03/24 08:26:39 GOT CHUNK: 224 2016/03/24 08:26:39 GOT CHUNK: 254 2016/03/24 08:26:39 GOT CHUNK: 235 2016/03/24 08:26:39 GOT CHUNK: 233 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:39 GOT CHUNK: 225 2016/03/24 08:26:39 GOT CHUNK: 234 2016/03/24 08:26:39 GOT CHUNK: 213 2016/03/24 08:26:39 GOT CHUNK: 215 2016/03/24 08:26:39 GOT CHUNK: 236 2016/03/24 08:26:39 GOT CHUNK: 248 2016/03/24 08:26:39 GOT CHUNK: 205 2016/03/24 08:26:39 GOT CHUNK: 210 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 222 2016/03/24 08:26:40 GOT CHUNK: 227 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 220 2016/03/24 08:26:40 GOT CHUNK: 203 2016/03/24 08:26:40 GOT CHUNK: 198 2016/03/24 08:26:40 GOT CHUNK: 197 2016/03/24 08:26:40 GOT CHUNK: 192 2016/03/24 08:26:40 GOT CHUNK: 196 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 232 2016/03/24 08:26:40 GOT CHUNK: 240 2016/03/24 08:26:40 GOT CHUNK: 242 2016/03/24 08:26:40 GOT CHUNK: 247 2016/03/24 08:26:40 GOT CHUNK: 230 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 225 2016/03/24 08:26:40 GOT CHUNK: 225 2016/03/24 08:26:40 GOT CHUNK: 221 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 229 2016/03/24 08:26:40 GOT CHUNK: 245 2016/03/24 08:26:40 GOT CHUNK: 244 2016/03/24 08:26:40 GOT CHUNK: 247 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 212 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 228 2016/03/24 08:26:40 GOT CHUNK: 256 2016/03/24 08:26:40 GOT CHUNK: 203 2016/03/24 08:26:40 GOT CHUNK: 237 2016/03/24 08:26:40 GOT CHUNK: 245 2016/03/24 08:26:40 GOT CHUNK: 253 2016/03/24 08:26:40 GOT CHUNK: 185 2016/03/24 08:26:40 GOT CHUNK: 243 2016/03/24 08:26:40 GOT CHUNK: 251 2016/03/24 08:26:40 GOT CHUNK: 215 2016/03/24 08:26:40 GOT CHUNK: 240 2016/03/24 08:26:40 GOT CHUNK: 172 2016/03/24 08:26:40 GOT CHUNK: 217 2016/03/24 08:26:40 GOT CHUNK: 241 2016/03/24 08:26:40 GOT CHUNK: 208 2016/03/24 08:26:40 GOT CHUNK: 221 2016/03/24 08:26:40 GOT CHUNK: 222 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 217 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 202 2016/03/24 08:26:40 GOT CHUNK: 212 2016/03/24 08:26:40 GOT CHUNK: 237 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 222 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 196 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 187 2016/03/24 08:26:40 GOT CHUNK: 241 2016/03/24 08:26:40 GOT CHUNK: 242 2016/03/24 08:26:40 GOT CHUNK: 165 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 217 2016/03/24 08:26:40 GOT CHUNK: 235 2016/03/24 08:26:40 GOT CHUNK: 231 2016/03/24 08:26:40 GOT CHUNK: 212 2016/03/24 08:26:40 GOT CHUNK: 248 2016/03/24 08:26:40 GOT CHUNK: 174 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 215 2016/03/24 08:26:40 GOT CHUNK: 196 2016/03/24 08:26:40 GOT CHUNK: 194 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 216 2016/03/24 08:26:40 GOT CHUNK: 231 2016/03/24 08:26:40 GOT CHUNK: 210 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 211 2016/03/24 08:26:40 GOT CHUNK: 196 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 189 2016/03/24 08:26:40 GOT CHUNK: 241 2016/03/24 08:26:40 GOT CHUNK: 236 2016/03/24 08:26:40 GOT CHUNK: 229 2016/03/24 08:26:40 GOT CHUNK: 215 2016/03/24 08:26:40 GOT CHUNK: 210 2016/03/24 08:26:40 GOT CHUNK: 254 2016/03/24 08:26:40 GOT CHUNK: 213 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 224 2016/03/24 08:26:40 GOT CHUNK: 239 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 234 2016/03/24 08:26:40 GOT CHUNK: 201 2016/03/24 08:26:40 GOT CHUNK: 204 2016/03/24 08:26:40 GOT CHUNK: 215 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 222 2016/03/24 08:26:40 GOT CHUNK: 232 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 208 2016/03/24 08:26:40 GOT CHUNK: 221 2016/03/24 08:26:40 GOT CHUNK: 238 2016/03/24 08:26:40 GOT CHUNK: 206 2016/03/24 08:26:40 GOT CHUNK: 229 2016/03/24 08:26:40 GOT CHUNK: 223 2016/03/24 08:26:40 GOT CHUNK: 203 2016/03/24 08:26:40 GOT CHUNK: 239 2016/03/24 08:26:40 GOT CHUNK: 228 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 223 2016/03/24 08:26:40 GOT CHUNK: 247 2016/03/24 08:26:40 GOT CHUNK: 195 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 217 2016/03/24 08:26:40 GOT CHUNK: 234 2016/03/24 08:26:40 GOT CHUNK: 202 2016/03/24 08:26:40 GOT CHUNK: 214 2016/03/24 08:26:40 GOT CHUNK: 231 2016/03/24 08:26:40 GOT CHUNK: 246 2016/03/24 08:26:40 GOT CHUNK: 201 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 212 2016/03/24 08:26:40 GOT CHUNK: 201 2016/03/24 08:26:40 GOT CHUNK: 241 2016/03/24 08:26:40 GOT CHUNK: 236 2016/03/24 08:26:40 GOT CHUNK: 223 2016/03/24 08:26:40 GOT CHUNK: 217 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 210 2016/03/24 08:26:40 GOT CHUNK: 198 2016/03/24 08:26:40 GOT CHUNK: 204 2016/03/24 08:26:40 GOT CHUNK: 187 2016/03/24 08:26:40 GOT CHUNK: 224 2016/03/24 08:26:40 GOT CHUNK: 229 2016/03/24 08:26:40 GOT CHUNK: 236 2016/03/24 08:26:40 GOT CHUNK: 229 2016/03/24 08:26:40 GOT CHUNK: 218 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 230 2016/03/24 08:26:40 GOT CHUNK: 215 2016/03/24 08:26:40 GOT CHUNK: 173 2016/03/24 08:26:40 GOT CHUNK: 237 2016/03/24 08:26:40 GOT CHUNK: 219 2016/03/24 08:26:40 GOT CHUNK: 187 2016/03/24 08:26:40 GOT CHUNK: 191 2016/03/24 08:26:40 GOT CHUNK: 163 2016/03/24 08:26:40 GOT CHUNK: 190 2016/03/24 08:26:40 GOT CHUNK: 213 2016/03/24 08:26:40 GOT CHUNK: 201 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 200 2016/03/24 08:26:40 GOT CHUNK: 166 2016/03/24 08:26:40 GOT CHUNK: 212 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 205 2016/03/24 08:26:40 GOT CHUNK: 227 2016/03/24 08:26:40 GOT CHUNK: 172 2016/03/24 08:26:40 GOT CHUNK: 187 2016/03/24 08:26:40 GOT CHUNK: 202 2016/03/24 08:26:40 GOT CHUNK: 209 2016/03/24 08:26:40 GOT CHUNK: 224 2016/03/24 08:26:40 GOT CHUNK: 226 2016/03/24 08:26:40 GOT CHUNK: 244 2016/03/24 08:26:40 GOT CHUNK: 240 2016/03/24 08:26:40 GOT CHUNK: 230 2016/03/24 08:26:40 GOT CHUNK: 207 2016/03/24 08:26:40 GOT CHUNK: 235 2016/03/24 08:26:40 GOT CHUNK: 224 2016/03/24 08:26:40 GOT CHUNK: 0 2016/03/24 08:26:40 number of entries 121403 2016/03/24 08:26:41 Expected and Actual scan responses are the same 2016/03/24 08:26:41 RANGE missing cities 2016/03/24 08:26:41 Status : 200 OK 2016/03/24 08:26:41 GOT CHUNK: 0 2016/03/24 08:26:41 number of entries 0 2016/03/24 08:26:41 Expected and Actual scan responses are the same 2016/03/24 08:26:41 2016/03/24 08:26:41 SCANALL missing index 2016/03/24 08:26:41 {"limit":1000000,"stale":"ok"} 2016/03/24 08:26:41 Status : 404 Not Found 2016/03/24 08:26:41 SCANALL stale ok 2016/03/24 08:26:41 {"limit":1000000,"stale":"ok"} 2016/03/24 08:26:41 Status : 200 OK 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 234 2016/03/24 08:26:41 GOT CHUNK: 210 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 247 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 245 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 209 2016/03/24 08:26:41 GOT CHUNK: 177 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 187 2016/03/24 08:26:41 GOT CHUNK: 213 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 245 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 219 2016/03/24 08:26:41 GOT CHUNK: 200 2016/03/24 08:26:41 GOT CHUNK: 184 2016/03/24 08:26:41 GOT CHUNK: 196 2016/03/24 08:26:41 GOT CHUNK: 236 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 202 2016/03/24 08:26:41 GOT CHUNK: 207 2016/03/24 08:26:41 GOT CHUNK: 250 2016/03/24 08:26:41 GOT CHUNK: 244 2016/03/24 08:26:41 GOT CHUNK: 225 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 230 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 251 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 171 2016/03/24 08:26:41 GOT CHUNK: 174 2016/03/24 08:26:41 GOT CHUNK: 205 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 230 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 197 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 186 2016/03/24 08:26:41 GOT CHUNK: 230 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 225 2016/03/24 08:26:41 GOT CHUNK: 225 2016/03/24 08:26:41 GOT CHUNK: 204 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 200 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 240 2016/03/24 08:26:41 GOT CHUNK: 253 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 230 2016/03/24 08:26:41 GOT CHUNK: 231 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 212 2016/03/24 08:26:41 GOT CHUNK: 194 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 197 2016/03/24 08:26:41 GOT CHUNK: 238 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 176 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 213 2016/03/24 08:26:41 GOT CHUNK: 210 2016/03/24 08:26:41 GOT CHUNK: 206 2016/03/24 08:26:41 GOT CHUNK: 201 2016/03/24 08:26:41 GOT CHUNK: 204 2016/03/24 08:26:41 GOT CHUNK: 214 2016/03/24 08:26:41 GOT CHUNK: 183 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 219 2016/03/24 08:26:41 GOT CHUNK: 210 2016/03/24 08:26:41 GOT CHUNK: 244 2016/03/24 08:26:41 GOT CHUNK: 213 2016/03/24 08:26:41 GOT CHUNK: 207 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 207 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 230 2016/03/24 08:26:41 GOT CHUNK: 209 2016/03/24 08:26:41 GOT CHUNK: 185 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 205 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 171 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 208 2016/03/24 08:26:41 GOT CHUNK: 188 2016/03/24 08:26:41 GOT CHUNK: 225 2016/03/24 08:26:41 GOT CHUNK: 192 2016/03/24 08:26:41 GOT CHUNK: 168 2016/03/24 08:26:41 GOT CHUNK: 196 2016/03/24 08:26:41 GOT CHUNK: 201 2016/03/24 08:26:41 GOT CHUNK: 205 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 214 2016/03/24 08:26:41 GOT CHUNK: 231 2016/03/24 08:26:41 GOT CHUNK: 205 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 159 2016/03/24 08:26:41 GOT CHUNK: 158 2016/03/24 08:26:41 GOT CHUNK: 240 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 212 2016/03/24 08:26:41 GOT CHUNK: 160 2016/03/24 08:26:41 GOT CHUNK: 209 2016/03/24 08:26:41 GOT CHUNK: 247 2016/03/24 08:26:41 GOT CHUNK: 242 2016/03/24 08:26:41 GOT CHUNK: 256 2016/03/24 08:26:41 GOT CHUNK: 214 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 246 2016/03/24 08:26:41 GOT CHUNK: 255 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 202 2016/03/24 08:26:41 GOT CHUNK: 236 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 206 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 190 2016/03/24 08:26:41 GOT CHUNK: 202 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 202 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 200 2016/03/24 08:26:41 GOT CHUNK: 184 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 213 2016/03/24 08:26:41 GOT CHUNK: 158 2016/03/24 08:26:41 GOT CHUNK: 160 2016/03/24 08:26:41 GOT CHUNK: 182 2016/03/24 08:26:41 GOT CHUNK: 185 2016/03/24 08:26:41 GOT CHUNK: 169 2016/03/24 08:26:41 GOT CHUNK: 205 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 195 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 227 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 201 2016/03/24 08:26:41 GOT CHUNK: 191 2016/03/24 08:26:41 GOT CHUNK: 208 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 213 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 195 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 165 2016/03/24 08:26:41 GOT CHUNK: 156 2016/03/24 08:26:41 GOT CHUNK: 161 2016/03/24 08:26:41 GOT CHUNK: 191 2016/03/24 08:26:41 GOT CHUNK: 196 2016/03/24 08:26:41 GOT CHUNK: 214 2016/03/24 08:26:41 GOT CHUNK: 227 2016/03/24 08:26:41 GOT CHUNK: 201 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 215 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 242 2016/03/24 08:26:41 GOT CHUNK: 242 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 182 2016/03/24 08:26:41 GOT CHUNK: 236 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 227 2016/03/24 08:26:41 GOT CHUNK: 172 2016/03/24 08:26:41 GOT CHUNK: 161 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 224 2016/03/24 08:26:41 GOT CHUNK: 177 2016/03/24 08:26:41 GOT CHUNK: 218 2016/03/24 08:26:41 GOT CHUNK: 214 2016/03/24 08:26:41 GOT CHUNK: 203 2016/03/24 08:26:41 GOT CHUNK: 233 2016/03/24 08:26:41 GOT CHUNK: 221 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 200 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 209 2016/03/24 08:26:41 GOT CHUNK: 237 2016/03/24 08:26:41 GOT CHUNK: 256 2016/03/24 08:26:41 GOT CHUNK: 231 2016/03/24 08:26:41 GOT CHUNK: 243 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 207 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 184 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 227 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 255 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 217 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 228 2016/03/24 08:26:41 GOT CHUNK: 181 2016/03/24 08:26:41 GOT CHUNK: 202 2016/03/24 08:26:41 GOT CHUNK: 206 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 227 2016/03/24 08:26:41 GOT CHUNK: 206 2016/03/24 08:26:41 GOT CHUNK: 208 2016/03/24 08:26:41 GOT CHUNK: 235 2016/03/24 08:26:41 GOT CHUNK: 232 2016/03/24 08:26:41 GOT CHUNK: 161 2016/03/24 08:26:41 GOT CHUNK: 211 2016/03/24 08:26:41 GOT CHUNK: 216 2016/03/24 08:26:41 GOT CHUNK: 222 2016/03/24 08:26:41 GOT CHUNK: 229 2016/03/24 08:26:41 GOT CHUNK: 251 2016/03/24 08:26:41 GOT CHUNK: 226 2016/03/24 08:26:41 GOT CHUNK: 231 2016/03/24 08:26:41 GOT CHUNK: 236 2016/03/24 08:26:41 GOT CHUNK: 215 2016/03/24 08:26:41 GOT CHUNK: 220 2016/03/24 08:26:41 GOT CHUNK: 223 2016/03/24 08:26:41 GOT CHUNK: 247 2016/03/24 08:26:41 GOT CHUNK: 239 2016/03/24 08:26:41 GOT CHUNK: 240 2016/03/24 08:26:41 GOT CHUNK: 178 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 209 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 208 2016/03/24 08:26:42 GOT CHUNK: 238 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 243 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 233 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 223 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 241 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 204 2016/03/24 08:26:42 GOT CHUNK: 238 2016/03/24 08:26:42 GOT CHUNK: 228 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 223 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 209 2016/03/24 08:26:42 GOT CHUNK: 209 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 247 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 240 2016/03/24 08:26:42 GOT CHUNK: 225 2016/03/24 08:26:42 GOT CHUNK: 227 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 194 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 238 2016/03/24 08:26:42 GOT CHUNK: 202 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 227 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 242 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 218 2016/03/24 08:26:42 GOT CHUNK: 262 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 220 2016/03/24 08:26:42 GOT CHUNK: 230 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 176 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 228 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 203 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 238 2016/03/24 08:26:42 GOT CHUNK: 255 2016/03/24 08:26:42 GOT CHUNK: 186 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 209 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 255 2016/03/24 08:26:42 GOT CHUNK: 228 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 208 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 254 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 233 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 225 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 213 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 248 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 227 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 220 2016/03/24 08:26:42 GOT CHUNK: 203 2016/03/24 08:26:42 GOT CHUNK: 198 2016/03/24 08:26:42 GOT CHUNK: 197 2016/03/24 08:26:42 GOT CHUNK: 192 2016/03/24 08:26:42 GOT CHUNK: 196 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 240 2016/03/24 08:26:42 GOT CHUNK: 242 2016/03/24 08:26:42 GOT CHUNK: 247 2016/03/24 08:26:42 GOT CHUNK: 230 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 225 2016/03/24 08:26:42 GOT CHUNK: 225 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 245 2016/03/24 08:26:42 GOT CHUNK: 244 2016/03/24 08:26:42 GOT CHUNK: 247 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 212 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 228 2016/03/24 08:26:42 GOT CHUNK: 256 2016/03/24 08:26:42 GOT CHUNK: 203 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 245 2016/03/24 08:26:42 GOT CHUNK: 253 2016/03/24 08:26:42 GOT CHUNK: 185 2016/03/24 08:26:42 GOT CHUNK: 243 2016/03/24 08:26:42 GOT CHUNK: 251 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 240 2016/03/24 08:26:42 GOT CHUNK: 172 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 241 2016/03/24 08:26:42 GOT CHUNK: 208 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 202 2016/03/24 08:26:42 GOT CHUNK: 212 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 196 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 187 2016/03/24 08:26:42 GOT CHUNK: 241 2016/03/24 08:26:42 GOT CHUNK: 242 2016/03/24 08:26:42 GOT CHUNK: 165 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 231 2016/03/24 08:26:42 GOT CHUNK: 212 2016/03/24 08:26:42 GOT CHUNK: 248 2016/03/24 08:26:42 GOT CHUNK: 174 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 196 2016/03/24 08:26:42 GOT CHUNK: 194 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 216 2016/03/24 08:26:42 GOT CHUNK: 231 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 211 2016/03/24 08:26:42 GOT CHUNK: 196 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 189 2016/03/24 08:26:42 GOT CHUNK: 241 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 254 2016/03/24 08:26:42 GOT CHUNK: 213 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 201 2016/03/24 08:26:42 GOT CHUNK: 204 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 222 2016/03/24 08:26:42 GOT CHUNK: 232 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 208 2016/03/24 08:26:42 GOT CHUNK: 221 2016/03/24 08:26:42 GOT CHUNK: 238 2016/03/24 08:26:42 GOT CHUNK: 206 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 223 2016/03/24 08:26:42 GOT CHUNK: 203 2016/03/24 08:26:42 GOT CHUNK: 239 2016/03/24 08:26:42 GOT CHUNK: 228 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 223 2016/03/24 08:26:42 GOT CHUNK: 247 2016/03/24 08:26:42 GOT CHUNK: 195 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 234 2016/03/24 08:26:42 GOT CHUNK: 202 2016/03/24 08:26:42 GOT CHUNK: 214 2016/03/24 08:26:42 GOT CHUNK: 231 2016/03/24 08:26:42 GOT CHUNK: 246 2016/03/24 08:26:42 GOT CHUNK: 201 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 212 2016/03/24 08:26:42 GOT CHUNK: 201 2016/03/24 08:26:42 GOT CHUNK: 241 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 223 2016/03/24 08:26:42 GOT CHUNK: 217 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 210 2016/03/24 08:26:42 GOT CHUNK: 198 2016/03/24 08:26:42 GOT CHUNK: 204 2016/03/24 08:26:42 GOT CHUNK: 187 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 236 2016/03/24 08:26:42 GOT CHUNK: 229 2016/03/24 08:26:42 GOT CHUNK: 218 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 230 2016/03/24 08:26:42 GOT CHUNK: 215 2016/03/24 08:26:42 GOT CHUNK: 173 2016/03/24 08:26:42 GOT CHUNK: 237 2016/03/24 08:26:42 GOT CHUNK: 219 2016/03/24 08:26:42 GOT CHUNK: 187 2016/03/24 08:26:42 GOT CHUNK: 191 2016/03/24 08:26:42 GOT CHUNK: 163 2016/03/24 08:26:42 GOT CHUNK: 190 2016/03/24 08:26:42 GOT CHUNK: 213 2016/03/24 08:26:42 GOT CHUNK: 201 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 200 2016/03/24 08:26:42 GOT CHUNK: 166 2016/03/24 08:26:42 GOT CHUNK: 212 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 205 2016/03/24 08:26:42 GOT CHUNK: 227 2016/03/24 08:26:42 GOT CHUNK: 172 2016/03/24 08:26:42 GOT CHUNK: 187 2016/03/24 08:26:42 GOT CHUNK: 202 2016/03/24 08:26:42 GOT CHUNK: 209 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 226 2016/03/24 08:26:42 GOT CHUNK: 244 2016/03/24 08:26:42 GOT CHUNK: 240 2016/03/24 08:26:42 GOT CHUNK: 230 2016/03/24 08:26:42 GOT CHUNK: 207 2016/03/24 08:26:42 GOT CHUNK: 235 2016/03/24 08:26:42 GOT CHUNK: 224 2016/03/24 08:26:42 GOT CHUNK: 0 2016/03/24 08:26:42 number of entries 121403 2016/03/24 08:26:43 Expected and Actual scan responses are the same 2016/03/24 08:26:43 SCANALL stale false 2016/03/24 08:26:43 {"limit":1000000,"stale":"false"} 2016/03/24 08:26:43 Status : 200 OK 2016/03/24 08:26:43 GOT CHUNK: 223 2016/03/24 08:26:43 GOT CHUNK: 234 2016/03/24 08:26:43 GOT CHUNK: 210 2016/03/24 08:26:43 GOT CHUNK: 220 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 247 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 245 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 203 2016/03/24 08:26:43 GOT CHUNK: 209 2016/03/24 08:26:43 GOT CHUNK: 177 2016/03/24 08:26:43 GOT CHUNK: 226 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 187 2016/03/24 08:26:43 GOT CHUNK: 213 2016/03/24 08:26:43 GOT CHUNK: 228 2016/03/24 08:26:43 GOT CHUNK: 245 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 219 2016/03/24 08:26:43 GOT CHUNK: 200 2016/03/24 08:26:43 GOT CHUNK: 184 2016/03/24 08:26:43 GOT CHUNK: 196 2016/03/24 08:26:43 GOT CHUNK: 236 2016/03/24 08:26:43 GOT CHUNK: 229 2016/03/24 08:26:43 GOT CHUNK: 202 2016/03/24 08:26:43 GOT CHUNK: 207 2016/03/24 08:26:43 GOT CHUNK: 250 2016/03/24 08:26:43 GOT CHUNK: 244 2016/03/24 08:26:43 GOT CHUNK: 225 2016/03/24 08:26:43 GOT CHUNK: 232 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 232 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 228 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 230 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 251 2016/03/24 08:26:43 GOT CHUNK: 239 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 171 2016/03/24 08:26:43 GOT CHUNK: 174 2016/03/24 08:26:43 GOT CHUNK: 205 2016/03/24 08:26:43 GOT CHUNK: 232 2016/03/24 08:26:43 GOT CHUNK: 230 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 239 2016/03/24 08:26:43 GOT CHUNK: 197 2016/03/24 08:26:43 GOT CHUNK: 211 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 186 2016/03/24 08:26:43 GOT CHUNK: 230 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 239 2016/03/24 08:26:43 GOT CHUNK: 225 2016/03/24 08:26:43 GOT CHUNK: 225 2016/03/24 08:26:43 GOT CHUNK: 204 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 200 2016/03/24 08:26:43 GOT CHUNK: 239 2016/03/24 08:26:43 GOT CHUNK: 240 2016/03/24 08:26:43 GOT CHUNK: 253 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 230 2016/03/24 08:26:43 GOT CHUNK: 231 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 212 2016/03/24 08:26:43 GOT CHUNK: 194 2016/03/24 08:26:43 GOT CHUNK: 203 2016/03/24 08:26:43 GOT CHUNK: 197 2016/03/24 08:26:43 GOT CHUNK: 238 2016/03/24 08:26:43 GOT CHUNK: 203 2016/03/24 08:26:43 GOT CHUNK: 176 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 213 2016/03/24 08:26:43 GOT CHUNK: 210 2016/03/24 08:26:43 GOT CHUNK: 206 2016/03/24 08:26:43 GOT CHUNK: 201 2016/03/24 08:26:43 GOT CHUNK: 204 2016/03/24 08:26:43 GOT CHUNK: 214 2016/03/24 08:26:43 GOT CHUNK: 183 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 223 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 228 2016/03/24 08:26:43 GOT CHUNK: 203 2016/03/24 08:26:43 GOT CHUNK: 203 2016/03/24 08:26:43 GOT CHUNK: 211 2016/03/24 08:26:43 GOT CHUNK: 219 2016/03/24 08:26:43 GOT CHUNK: 210 2016/03/24 08:26:43 GOT CHUNK: 244 2016/03/24 08:26:43 GOT CHUNK: 213 2016/03/24 08:26:43 GOT CHUNK: 207 2016/03/24 08:26:43 GOT CHUNK: 226 2016/03/24 08:26:43 GOT CHUNK: 207 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 230 2016/03/24 08:26:43 GOT CHUNK: 209 2016/03/24 08:26:43 GOT CHUNK: 185 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 205 2016/03/24 08:26:43 GOT CHUNK: 229 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 171 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 208 2016/03/24 08:26:43 GOT CHUNK: 188 2016/03/24 08:26:43 GOT CHUNK: 225 2016/03/24 08:26:43 GOT CHUNK: 192 2016/03/24 08:26:43 GOT CHUNK: 168 2016/03/24 08:26:43 GOT CHUNK: 196 2016/03/24 08:26:43 GOT CHUNK: 201 2016/03/24 08:26:43 GOT CHUNK: 205 2016/03/24 08:26:43 GOT CHUNK: 232 2016/03/24 08:26:43 GOT CHUNK: 214 2016/03/24 08:26:43 GOT CHUNK: 231 2016/03/24 08:26:43 GOT CHUNK: 205 2016/03/24 08:26:43 GOT CHUNK: 211 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 159 2016/03/24 08:26:43 GOT CHUNK: 158 2016/03/24 08:26:43 GOT CHUNK: 240 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 223 2016/03/24 08:26:43 GOT CHUNK: 212 2016/03/24 08:26:43 GOT CHUNK: 160 2016/03/24 08:26:43 GOT CHUNK: 209 2016/03/24 08:26:43 GOT CHUNK: 247 2016/03/24 08:26:43 GOT CHUNK: 242 2016/03/24 08:26:43 GOT CHUNK: 256 2016/03/24 08:26:43 GOT CHUNK: 214 2016/03/24 08:26:43 GOT CHUNK: 226 2016/03/24 08:26:43 GOT CHUNK: 229 2016/03/24 08:26:43 GOT CHUNK: 239 2016/03/24 08:26:43 GOT CHUNK: 246 2016/03/24 08:26:43 GOT CHUNK: 255 2016/03/24 08:26:43 GOT CHUNK: 220 2016/03/24 08:26:43 GOT CHUNK: 232 2016/03/24 08:26:43 GOT CHUNK: 202 2016/03/24 08:26:43 GOT CHUNK: 236 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 206 2016/03/24 08:26:43 GOT CHUNK: 226 2016/03/24 08:26:43 GOT CHUNK: 190 2016/03/24 08:26:43 GOT CHUNK: 202 2016/03/24 08:26:43 GOT CHUNK: 220 2016/03/24 08:26:43 GOT CHUNK: 202 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 200 2016/03/24 08:26:43 GOT CHUNK: 184 2016/03/24 08:26:43 GOT CHUNK: 223 2016/03/24 08:26:43 GOT CHUNK: 213 2016/03/24 08:26:43 GOT CHUNK: 158 2016/03/24 08:26:43 GOT CHUNK: 160 2016/03/24 08:26:43 GOT CHUNK: 182 2016/03/24 08:26:43 GOT CHUNK: 185 2016/03/24 08:26:43 GOT CHUNK: 169 2016/03/24 08:26:43 GOT CHUNK: 205 2016/03/24 08:26:43 GOT CHUNK: 226 2016/03/24 08:26:43 GOT CHUNK: 195 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 227 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 201 2016/03/24 08:26:43 GOT CHUNK: 191 2016/03/24 08:26:43 GOT CHUNK: 208 2016/03/24 08:26:43 GOT CHUNK: 211 2016/03/24 08:26:43 GOT CHUNK: 211 2016/03/24 08:26:43 GOT CHUNK: 213 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 195 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 222 2016/03/24 08:26:43 GOT CHUNK: 165 2016/03/24 08:26:43 GOT CHUNK: 156 2016/03/24 08:26:43 GOT CHUNK: 161 2016/03/24 08:26:43 GOT CHUNK: 191 2016/03/24 08:26:43 GOT CHUNK: 196 2016/03/24 08:26:43 GOT CHUNK: 214 2016/03/24 08:26:43 GOT CHUNK: 227 2016/03/24 08:26:43 GOT CHUNK: 201 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 215 2016/03/24 08:26:43 GOT CHUNK: 224 2016/03/24 08:26:43 GOT CHUNK: 216 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 242 2016/03/24 08:26:43 GOT CHUNK: 242 2016/03/24 08:26:43 GOT CHUNK: 235 2016/03/24 08:26:43 GOT CHUNK: 237 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 228 2016/03/24 08:26:43 GOT CHUNK: 182 2016/03/24 08:26:43 GOT CHUNK: 236 2016/03/24 08:26:43 GOT CHUNK: 218 2016/03/24 08:26:43 GOT CHUNK: 217 2016/03/24 08:26:43 GOT CHUNK: 227 2016/03/24 08:26:43 GOT CHUNK: 172 2016/03/24 08:26:43 GOT CHUNK: 161 2016/03/24 08:26:43 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 224 2016/03/24 08:26:44 GOT CHUNK: 177 2016/03/24 08:26:44 GOT CHUNK: 218 2016/03/24 08:26:44 GOT CHUNK: 214 2016/03/24 08:26:44 GOT CHUNK: 203 2016/03/24 08:26:44 GOT CHUNK: 233 2016/03/24 08:26:44 GOT CHUNK: 221 2016/03/24 08:26:44 GOT CHUNK: 220 2016/03/24 08:26:44 GOT CHUNK: 200 2016/03/24 08:26:44 GOT CHUNK: 217 2016/03/24 08:26:44 GOT CHUNK: 209 2016/03/24 08:26:44 GOT CHUNK: 237 2016/03/24 08:26:44 GOT CHUNK: 256 2016/03/24 08:26:44 GOT CHUNK: 231 2016/03/24 08:26:44 GOT CHUNK: 243 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 207 2016/03/24 08:26:44 GOT CHUNK: 220 2016/03/24 08:26:44 GOT CHUNK: 184 2016/03/24 08:26:44 GOT CHUNK: 217 2016/03/24 08:26:44 GOT CHUNK: 227 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 255 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 223 2016/03/24 08:26:44 GOT CHUNK: 226 2016/03/24 08:26:44 GOT CHUNK: 217 2016/03/24 08:26:44 GOT CHUNK: 222 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 181 2016/03/24 08:26:44 GOT CHUNK: 202 2016/03/24 08:26:44 GOT CHUNK: 206 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 227 2016/03/24 08:26:44 GOT CHUNK: 206 2016/03/24 08:26:44 GOT CHUNK: 208 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 161 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 222 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 251 2016/03/24 08:26:44 GOT CHUNK: 226 2016/03/24 08:26:44 GOT CHUNK: 231 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 215 2016/03/24 08:26:44 GOT CHUNK: 220 2016/03/24 08:26:44 GOT CHUNK: 223 2016/03/24 08:26:44 GOT CHUNK: 247 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 240 2016/03/24 08:26:44 GOT CHUNK: 178 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 226 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 209 2016/03/24 08:26:44 GOT CHUNK: 215 2016/03/24 08:26:44 GOT CHUNK: 208 2016/03/24 08:26:44 GOT CHUNK: 238 2016/03/24 08:26:44 GOT CHUNK: 222 2016/03/24 08:26:44 GOT CHUNK: 237 2016/03/24 08:26:44 GOT CHUNK: 234 2016/03/24 08:26:44 GOT CHUNK: 237 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 243 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 233 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 223 2016/03/24 08:26:44 GOT CHUNK: 219 2016/03/24 08:26:44 GOT CHUNK: 241 2016/03/24 08:26:44 GOT CHUNK: 214 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 204 2016/03/24 08:26:44 GOT CHUNK: 238 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 224 2016/03/24 08:26:44 GOT CHUNK: 205 2016/03/24 08:26:44 GOT CHUNK: 223 2016/03/24 08:26:44 GOT CHUNK: 234 2016/03/24 08:26:44 GOT CHUNK: 209 2016/03/24 08:26:44 GOT CHUNK: 209 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 247 2016/03/24 08:26:44 GOT CHUNK: 221 2016/03/24 08:26:44 GOT CHUNK: 221 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 240 2016/03/24 08:26:44 GOT CHUNK: 225 2016/03/24 08:26:44 GOT CHUNK: 227 2016/03/24 08:26:44 GOT CHUNK: 214 2016/03/24 08:26:44 GOT CHUNK: 215 2016/03/24 08:26:44 GOT CHUNK: 194 2016/03/24 08:26:44 GOT CHUNK: 237 2016/03/24 08:26:44 GOT CHUNK: 234 2016/03/24 08:26:44 GOT CHUNK: 238 2016/03/24 08:26:44 GOT CHUNK: 202 2016/03/24 08:26:44 GOT CHUNK: 234 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 219 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 229 2016/03/24 08:26:44 GOT CHUNK: 227 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 242 2016/03/24 08:26:44 GOT CHUNK: 237 2016/03/24 08:26:44 GOT CHUNK: 217 2016/03/24 08:26:44 GOT CHUNK: 222 2016/03/24 08:26:44 GOT CHUNK: 218 2016/03/24 08:26:44 GOT CHUNK: 262 2016/03/24 08:26:44 GOT CHUNK: 210 2016/03/24 08:26:44 GOT CHUNK: 220 2016/03/24 08:26:44 GOT CHUNK: 230 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 226 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 176 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 203 2016/03/24 08:26:44 GOT CHUNK: 210 2016/03/24 08:26:44 GOT CHUNK: 238 2016/03/24 08:26:44 GOT CHUNK: 255 2016/03/24 08:26:44 GOT CHUNK: 186 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 209 2016/03/24 08:26:44 GOT CHUNK: 221 2016/03/24 08:26:44 GOT CHUNK: 255 2016/03/24 08:26:44 GOT CHUNK: 228 2016/03/24 08:26:44 GOT CHUNK: 239 2016/03/24 08:26:44 GOT CHUNK: 215 2016/03/24 08:26:44 GOT CHUNK: 208 2016/03/24 08:26:44 GOT CHUNK: 224 2016/03/24 08:26:44 GOT CHUNK: 254 2016/03/24 08:26:44 GOT CHUNK: 235 2016/03/24 08:26:44 GOT CHUNK: 233 2016/03/24 08:26:44 GOT CHUNK: 210 2016/03/24 08:26:44 GOT CHUNK: 210 2016/03/24 08:26:44 GOT CHUNK: 225 2016/03/24 08:26:44 GOT CHUNK: 234 2016/03/24 08:26:44 GOT CHUNK: 213 2016/03/24 08:26:44 GOT CHUNK: 215 2016/03/24 08:26:44 GOT CHUNK: 236 2016/03/24 08:26:44 GOT CHUNK: 248 2016/03/24 08:26:44 GOT CHUNK: 205 2016/03/24 08:26:44 GOT CHUNK: 210 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 222 2016/03/24 08:26:44 GOT CHUNK: 227 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 200 2016/03/24 08:26:44 GOT CHUNK: 205 2016/03/24 08:26:44 GOT CHUNK: 214 2016/03/24 08:26:44 GOT CHUNK: 220 2016/03/24 08:26:44 GOT CHUNK: 203 2016/03/24 08:26:44 GOT CHUNK: 198 2016/03/24 08:26:44 GOT CHUNK: 197 2016/03/24 08:26:44 GOT CHUNK: 192 2016/03/24 08:26:44 GOT CHUNK: 196 2016/03/24 08:26:44 GOT CHUNK: 211 2016/03/24 08:26:44 GOT CHUNK: 216 2016/03/24 08:26:44 GOT CHUNK: 232 2016/03/24 08:26:44 GOT CHUNK: 240 2016/03/24 08:26:44 GOT CHUNK: 242 2016/03/24 08:26:44 GOT CHUNK: 247 2016/03/24 08:26:44 GOT CHUNK: 230 2016/03/24 08:26:44 GOT CHUNK: 226 2016/03/24 08:26:44 GOT CHUNK: 225 2016/03/24 08:26:44 GOT CHUNK: 225 2016/03/24 08:26:44 GOT CHUNK: 221 2016/03/24 08:26:44 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 229 2016/03/24 08:26:45 GOT CHUNK: 245 2016/03/24 08:26:45 GOT CHUNK: 244 2016/03/24 08:26:45 GOT CHUNK: 247 2016/03/24 08:26:45 GOT CHUNK: 200 2016/03/24 08:26:45 GOT CHUNK: 212 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 228 2016/03/24 08:26:45 GOT CHUNK: 256 2016/03/24 08:26:45 GOT CHUNK: 203 2016/03/24 08:26:45 GOT CHUNK: 237 2016/03/24 08:26:45 GOT CHUNK: 245 2016/03/24 08:26:45 GOT CHUNK: 253 2016/03/24 08:26:45 GOT CHUNK: 185 2016/03/24 08:26:45 GOT CHUNK: 243 2016/03/24 08:26:45 GOT CHUNK: 251 2016/03/24 08:26:45 GOT CHUNK: 215 2016/03/24 08:26:45 GOT CHUNK: 240 2016/03/24 08:26:45 GOT CHUNK: 172 2016/03/24 08:26:45 GOT CHUNK: 217 2016/03/24 08:26:45 GOT CHUNK: 241 2016/03/24 08:26:45 GOT CHUNK: 208 2016/03/24 08:26:45 GOT CHUNK: 221 2016/03/24 08:26:45 GOT CHUNK: 222 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 217 2016/03/24 08:26:45 GOT CHUNK: 214 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 202 2016/03/24 08:26:45 GOT CHUNK: 212 2016/03/24 08:26:45 GOT CHUNK: 237 2016/03/24 08:26:45 GOT CHUNK: 214 2016/03/24 08:26:45 GOT CHUNK: 222 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 196 2016/03/24 08:26:45 GOT CHUNK: 200 2016/03/24 08:26:45 GOT CHUNK: 216 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 187 2016/03/24 08:26:45 GOT CHUNK: 241 2016/03/24 08:26:45 GOT CHUNK: 242 2016/03/24 08:26:45 GOT CHUNK: 165 2016/03/24 08:26:45 GOT CHUNK: 216 2016/03/24 08:26:45 GOT CHUNK: 217 2016/03/24 08:26:45 GOT CHUNK: 235 2016/03/24 08:26:45 GOT CHUNK: 231 2016/03/24 08:26:45 GOT CHUNK: 212 2016/03/24 08:26:45 GOT CHUNK: 248 2016/03/24 08:26:45 GOT CHUNK: 174 2016/03/24 08:26:45 GOT CHUNK: 200 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 211 2016/03/24 08:26:45 GOT CHUNK: 216 2016/03/24 08:26:45 GOT CHUNK: 211 2016/03/24 08:26:45 GOT CHUNK: 215 2016/03/24 08:26:45 GOT CHUNK: 196 2016/03/24 08:26:45 GOT CHUNK: 194 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 214 2016/03/24 08:26:45 GOT CHUNK: 216 2016/03/24 08:26:45 GOT CHUNK: 231 2016/03/24 08:26:45 GOT CHUNK: 210 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 211 2016/03/24 08:26:45 GOT CHUNK: 196 2016/03/24 08:26:45 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 189 2016/03/24 08:26:45 GOT CHUNK: 241 2016/03/24 08:26:45 GOT CHUNK: 236 2016/03/24 08:26:45 GOT CHUNK: 229 2016/03/24 08:26:45 GOT CHUNK: 215 2016/03/24 08:26:45 GOT CHUNK: 210 2016/03/24 08:26:45 GOT CHUNK: 254 2016/03/24 08:26:45 GOT CHUNK: 213 2016/03/24 08:26:45 GOT CHUNK: 214 2016/03/24 08:26:45 GOT CHUNK: 224 2016/03/24 08:26:45 GOT CHUNK: 239 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 234 2016/03/24 08:26:45 GOT CHUNK: 201 2016/03/24 08:26:45 GOT CHUNK: 204 2016/03/24 08:26:45 GOT CHUNK: 215 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 222 2016/03/24 08:26:45 GOT CHUNK: 232 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 208 2016/03/24 08:26:45 GOT CHUNK: 221 2016/03/24 08:26:45 GOT CHUNK: 238 2016/03/24 08:26:45 GOT CHUNK: 206 2016/03/24 08:26:45 GOT CHUNK: 229 2016/03/24 08:26:45 GOT CHUNK: 223 2016/03/24 08:26:45 GOT CHUNK: 203 2016/03/24 08:26:45 GOT CHUNK: 239 2016/03/24 08:26:45 GOT CHUNK: 228 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 223 2016/03/24 08:26:45 GOT CHUNK: 247 2016/03/24 08:26:45 GOT CHUNK: 195 2016/03/24 08:26:45 GOT CHUNK: 200 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 217 2016/03/24 08:26:45 GOT CHUNK: 234 2016/03/24 08:26:45 GOT CHUNK: 202 2016/03/24 08:26:45 GOT CHUNK: 214 2016/03/24 08:26:45 GOT CHUNK: 231 2016/03/24 08:26:45 GOT CHUNK: 246 2016/03/24 08:26:45 GOT CHUNK: 201 2016/03/24 08:26:45 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 212 2016/03/24 08:26:45 GOT CHUNK: 201 2016/03/24 08:26:45 GOT CHUNK: 241 2016/03/24 08:26:45 GOT CHUNK: 236 2016/03/24 08:26:45 GOT CHUNK: 223 2016/03/24 08:26:45 GOT CHUNK: 217 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 210 2016/03/24 08:26:45 GOT CHUNK: 198 2016/03/24 08:26:45 GOT CHUNK: 204 2016/03/24 08:26:45 GOT CHUNK: 187 2016/03/24 08:26:45 GOT CHUNK: 224 2016/03/24 08:26:45 GOT CHUNK: 229 2016/03/24 08:26:45 GOT CHUNK: 236 2016/03/24 08:26:45 GOT CHUNK: 229 2016/03/24 08:26:45 GOT CHUNK: 218 2016/03/24 08:26:45 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 230 2016/03/24 08:26:45 GOT CHUNK: 215 2016/03/24 08:26:45 GOT CHUNK: 173 2016/03/24 08:26:45 GOT CHUNK: 237 2016/03/24 08:26:45 GOT CHUNK: 219 2016/03/24 08:26:45 GOT CHUNK: 187 2016/03/24 08:26:45 GOT CHUNK: 191 2016/03/24 08:26:45 GOT CHUNK: 163 2016/03/24 08:26:45 GOT CHUNK: 190 2016/03/24 08:26:45 GOT CHUNK: 213 2016/03/24 08:26:45 GOT CHUNK: 201 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 200 2016/03/24 08:26:45 GOT CHUNK: 166 2016/03/24 08:26:45 GOT CHUNK: 212 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 205 2016/03/24 08:26:45 GOT CHUNK: 227 2016/03/24 08:26:45 GOT CHUNK: 172 2016/03/24 08:26:45 GOT CHUNK: 187 2016/03/24 08:26:45 GOT CHUNK: 202 2016/03/24 08:26:45 GOT CHUNK: 209 2016/03/24 08:26:45 GOT CHUNK: 224 2016/03/24 08:26:45 GOT CHUNK: 226 2016/03/24 08:26:45 GOT CHUNK: 244 2016/03/24 08:26:45 GOT CHUNK: 240 2016/03/24 08:26:45 GOT CHUNK: 230 2016/03/24 08:26:45 GOT CHUNK: 207 2016/03/24 08:26:45 GOT CHUNK: 235 2016/03/24 08:26:45 GOT CHUNK: 224 2016/03/24 08:26:45 GOT CHUNK: 0 2016/03/24 08:26:45 number of entries 121403 2016/03/24 08:26:45 Expected and Actual scan responses are the same 2016/03/24 08:26:45 2016/03/24 08:26:45 COUNT missing index 2016/03/24 08:26:46 Status : 404 Not Found 2016/03/24 08:26:46 COUNT cities - none 2016/03/24 08:26:47 Status : 200 OK 2016/03/24 08:26:47 number of entries 121403 2016/03/24 08:26:47 COUNT cities -low 2016/03/24 08:26:48 Status : 200 OK 2016/03/24 08:26:48 number of entries 121403 2016/03/24 08:26:49 COUNT cities -high 2016/03/24 08:26:50 Status : 200 OK 2016/03/24 08:26:50 number of entries 121403 2016/03/24 08:26:50 COUNT cities - both 2016/03/24 08:26:52 Status : 200 OK 2016/03/24 08:26:52 number of entries 121403 2016/03/24 08:26:52 COUNT missing cities 2016/03/24 08:26:52 Status : 200 OK 2016/03/24 08:26:52 number of entries 0 2016/03/24 08:26:52 --- PASS: TestRestfulAPI (66.24s) === RUN TestBucketDefaultDelete 2016/03/24 08:26:53 Deleted bucket default 2016/03/24 08:27:23 Created bucket default 2016/03/24 08:27:54 Populating the default bucket 2016/03/24 08:28:03 Connection error in Scan occured: queryport.indexNotFound 2016/03/24 08:28:03 Scan failed as expected with error: queryport.indexNotFound 2016/03/24 08:28:03 Populating the default bucket after it was deleted 2016/03/24 08:28:12 Created the secondary index index_isActive. Waiting for it become active 2016/03/24 08:28:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:12 Index is now active 2016/03/24 08:28:12 PERFSTAT CreateAndBuildIndex 2.3469 seconds 2016/03/24 08:28:12 PERFSTAT Lookup 0.0037 seconds 2016/03/24 08:28:12 Expected and Actual scan responses are the same --- PASS: TestBucketDefaultDelete (80.47s) === RUN TestMixedDatatypesScanAll 2016/03/24 08:28:12 In TestMixedDatatypesScanAll() 2016/03/24 08:28:12 Before test begin: Length of kv docs is 10002 2016/03/24 08:28:12 In DropAllSecondaryIndexes() 2016/03/24 08:28:13 Dropped index index_isActive 2016/03/24 08:28:13 Number of number fields is: 239 2016/03/24 08:28:13 Number of string fields is: 252 2016/03/24 08:28:13 Number of json fields is: 259 2016/03/24 08:28:13 Number of true bool fields is: 123 2016/03/24 08:28:13 Number of false bool fields is: 127 2016/03/24 08:28:13 After generate docs: Length of kv docs is 11002 2016/03/24 08:28:13 Setting mixed datatypes JSON docs in KV 2016/03/24 08:28:15 Created the secondary index index_mixeddt. Waiting for it become active 2016/03/24 08:28:15 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:15 Index is now active 2016/03/24 08:28:15 PERFSTAT CreateAndBuildIndex 2.2259 seconds 2016/03/24 08:28:15 PERFSTAT ScanAll 0.0188 seconds 2016/03/24 08:28:15 Expected and Actual scan responses are the same 2016/03/24 08:28:15 Lengths of expected and actual scan results are: 1000 and 1000 2016/03/24 08:28:15 End: Length of kv docs is 11002 --- PASS: TestMixedDatatypesScanAll (2.89s) === RUN TestMixedDatatypesRange_Float 2016/03/24 08:28:15 In TestMixedDatatypesRange_Float() 2016/03/24 08:28:15 In DropAllSecondaryIndexes() 2016/03/24 08:28:15 Dropped index index_mixeddt 2016/03/24 08:28:16 Number of number fields is: 256 2016/03/24 08:28:16 Number of string fields is: 250 2016/03/24 08:28:16 Number of json fields is: 253 2016/03/24 08:28:16 Number of true bool fields is: 124 2016/03/24 08:28:16 Number of false bool fields is: 117 2016/03/24 08:28:16 Setting mixed datatypes JSON docs in KV 2016/03/24 08:28:19 Created the secondary index index_mixeddt. Waiting for it become active 2016/03/24 08:28:19 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:19 Index is now active 2016/03/24 08:28:19 PERFSTAT CreateAndBuildIndex 2.4055 seconds 2016/03/24 08:28:19 PERFSTAT Range 0.0034 seconds 2016/03/24 08:28:19 Expected and Actual scan responses are the same 2016/03/24 08:28:19 Lengths of expected and actual scan results are: 12 and 12 2016/03/24 08:28:19 PERFSTAT Range 0.0030 seconds 2016/03/24 08:28:19 Expected and Actual scan responses are the same 2016/03/24 08:28:19 Lengths of expected and actual scan results are: 4 and 4 2016/03/24 08:28:19 Length of kv docs is 12002 --- PASS: TestMixedDatatypesRange_Float (3.16s) === RUN TestMixedDatatypesRange_String 2016/03/24 08:28:19 In TestMixedDatatypesRange_String() 2016/03/24 08:28:19 In DropAllSecondaryIndexes() 2016/03/24 08:28:19 Dropped index index_mixeddt 2016/03/24 08:28:19 Number of number fields is: 245 2016/03/24 08:28:19 Number of string fields is: 225 2016/03/24 08:28:19 Number of json fields is: 239 2016/03/24 08:28:19 Number of true bool fields is: 152 2016/03/24 08:28:19 Number of false bool fields is: 139 2016/03/24 08:28:19 Setting mixed datatypes JSON docs in KV 2016/03/24 08:28:22 Created the secondary index index_mixeddt. Waiting for it become active 2016/03/24 08:28:22 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:22 Index is now active 2016/03/24 08:28:22 PERFSTAT CreateAndBuildIndex 2.3109 seconds 2016/03/24 08:28:22 PERFSTAT Range 0.0059 seconds 2016/03/24 08:28:22 Expected and Actual scan responses are the same 2016/03/24 08:28:22 Lengths of expected and actual scan results are: 174 and 174 2016/03/24 08:28:22 Length of kv docs is 13002 --- PASS: TestMixedDatatypesRange_String (3.27s) === RUN TestMixedDatatypesRange_Json 2016/03/24 08:28:22 In TestMixedDatatypesRange_Json() 2016/03/24 08:28:22 In DropAllSecondaryIndexes() 2016/03/24 08:28:22 Dropped index index_mixeddt 2016/03/24 08:28:22 Number of number fields is: 229 2016/03/24 08:28:22 Number of string fields is: 239 2016/03/24 08:28:22 Number of json fields is: 255 2016/03/24 08:28:22 Number of true bool fields is: 146 2016/03/24 08:28:22 Number of false bool fields is: 131 2016/03/24 08:28:22 Setting mixed datatypes JSON docs in KV 2016/03/24 08:28:25 Created the secondary index index_mixeddt. Waiting for it become active 2016/03/24 08:28:25 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:25 Index is now active 2016/03/24 08:28:25 PERFSTAT CreateAndBuildIndex 2.4095 seconds 2016/03/24 08:28:25 PERFSTAT Range 0.0166 seconds 2016/03/24 08:28:25 Expected and Actual scan responses are the same 2016/03/24 08:28:25 Lengths of expected and actual scan results are: 747 and 747 2016/03/24 08:28:25 Length of kv docs is 14002 --- PASS: TestMixedDatatypesRange_Json (3.38s) === RUN TestMixedDatatypesScan_Bool 2016/03/24 08:28:25 In TestMixedDatatypesScan_Bool() 2016/03/24 08:28:25 In DropAllSecondaryIndexes() 2016/03/24 08:28:25 Dropped index index_mixeddt 2016/03/24 08:28:25 Number of number fields is: 247 2016/03/24 08:28:25 Number of string fields is: 254 2016/03/24 08:28:25 Number of json fields is: 248 2016/03/24 08:28:25 Number of true bool fields is: 129 2016/03/24 08:28:25 Number of false bool fields is: 122 2016/03/24 08:28:25 Setting mixed datatypes JSON docs in KV 2016/03/24 08:28:29 Created the secondary index index_mixeddt. Waiting for it become active 2016/03/24 08:28:29 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:29 Index is now active 2016/03/24 08:28:29 PERFSTAT CreateAndBuildIndex 2.6209 seconds 2016/03/24 08:28:29 PERFSTAT Range 0.0111 seconds 2016/03/24 08:28:29 Expected and Actual scan responses are the same 2016/03/24 08:28:29 Lengths of expected and actual scan results are: 551 and 551 2016/03/24 08:28:29 PERFSTAT Range 0.0105 seconds 2016/03/24 08:28:29 Expected and Actual scan responses are the same 2016/03/24 08:28:29 Lengths of expected and actual scan results are: 509 and 509 2016/03/24 08:28:29 Length of kv docs is 15002 --- PASS: TestMixedDatatypesScan_Bool (3.39s) === RUN TestLargeSecondaryKeyLength 2016/03/24 08:28:29 In TestLargeSecondaryKeyLength() 2016/03/24 08:28:29 In DropAllSecondaryIndexes() 2016/03/24 08:28:29 Dropped index index_mixeddt 2016/03/24 08:28:29 Setting JSON docs in KV 2016/03/24 08:28:32 Created the secondary index index_LongSecField. Waiting for it become active 2016/03/24 08:28:32 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:32 Index is now active 2016/03/24 08:28:32 PERFSTAT CreateAndBuildIndex 2.4320 seconds 2016/03/24 08:28:32 PERFSTAT ScanAll 0.0390 seconds 2016/03/24 08:28:32 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000 2016/03/24 08:28:32 Expected and Actual scan responses are the same 2016/03/24 08:28:32 PERFSTAT Range 0.0321 seconds 2016/03/24 08:28:32 Range: Lengths of expected and actual scan results are: 821 and 821 2016/03/24 08:28:32 Expected and Actual scan responses are the same 2016/03/24 08:28:32 End: Length of kv docs is 16002 --- PASS: TestLargeSecondaryKeyLength (3.33s) === RUN TestLargePrimaryKeyLength 2016/03/24 08:28:32 In TestLargePrimaryKeyLength() 2016/03/24 08:28:32 In DropAllSecondaryIndexes() 2016/03/24 08:28:32 Dropped index index_LongSecField 2016/03/24 08:28:32 Setting JSON docs in KV 2016/03/24 08:28:35 Created the secondary index index_LongPrimaryField. Waiting for it become active 2016/03/24 08:28:35 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:35 Index is now active 2016/03/24 08:28:35 PERFSTAT CreateAndBuildIndex 2.4112 seconds 2016/03/24 08:28:35 PERFSTAT ScanAll 0.2036 seconds 2016/03/24 08:28:35 Lengths of num of docs and scanResults are: 17002 and 17002 2016/03/24 08:28:35 End: Length of kv docs is 17002 --- PASS: TestLargePrimaryKeyLength (3.51s) === RUN TestUpdateMutations_DeleteField 2016/03/24 08:28:35 In TestUpdateMutations_DeleteField() 2016/03/24 08:28:36 Setting JSON docs in KV 2016/03/24 08:28:40 Created the secondary index index_bal. Waiting for it become active 2016/03/24 08:28:40 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:40 Index is now active 2016/03/24 08:28:40 PERFSTAT CreateAndBuildIndex 3.3911 seconds 2016/03/24 08:28:40 PERFSTAT ScanAll 0.1564 seconds 2016/03/24 08:28:40 Expected and Actual scan responses are the same 2016/03/24 08:28:41 PERFSTAT ScanAll 0.2616 seconds 2016/03/24 08:28:41 Expected and Actual scan responses are the same --- PASS: TestUpdateMutations_DeleteField (5.32s) === RUN TestUpdateMutations_AddField 2016/03/24 08:28:41 In TestUpdateMutations_AddField() 2016/03/24 08:28:41 Setting JSON docs in KV 2016/03/24 08:28:45 Created the secondary index index_newField. Waiting for it become active 2016/03/24 08:28:45 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:45 Index is now active 2016/03/24 08:28:45 PERFSTAT CreateAndBuildIndex 3.3010 seconds 2016/03/24 08:28:45 PERFSTAT ScanAll 0.0035 seconds 2016/03/24 08:28:45 Count of scan results before add field mutations: 0 2016/03/24 08:28:45 Expected and Actual scan responses are the same 2016/03/24 08:28:46 PERFSTAT ScanAll 0.0705 seconds 2016/03/24 08:28:46 Count of scan results after add field mutations: 300 2016/03/24 08:28:46 Expected and Actual scan responses are the same --- PASS: TestUpdateMutations_AddField (5.05s) === RUN TestUpdateMutations_DataTypeChange 2016/03/24 08:28:46 In TestUpdateMutations_DataTypeChange() 2016/03/24 08:28:46 Setting JSON docs in KV 2016/03/24 08:28:52 Created the secondary index index_isUserActive. Waiting for it become active 2016/03/24 08:28:52 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:28:52 Index is now active 2016/03/24 08:28:52 PERFSTAT CreateAndBuildIndex 3.4233 seconds 2016/03/24 08:28:53 PERFSTAT ScanAll 0.1677 seconds 2016/03/24 08:28:53 Expected and Actual scan responses are the same 2016/03/24 08:28:53 PERFSTAT ScanAll 0.1829 seconds 2016/03/24 08:28:53 Expected and Actual scan responses are the same 2016/03/24 08:28:53 PERFSTAT Lookup 0.0043 seconds 2016/03/24 08:28:53 Expected and Actual scan responses are the same 2016/03/24 08:28:53 PERFSTAT Lookup 0.0065 seconds 2016/03/24 08:28:53 Expected and Actual scan responses are the same --- PASS: TestUpdateMutations_DataTypeChange (7.52s) === RUN TestMultipleBuckets 2016/03/24 08:28:53 In TestMultipleBuckets() 2016/03/24 08:28:53 In DropAllSecondaryIndexes() 2016/03/24 08:28:53 Dropped index index_newField 2016/03/24 08:28:53 Dropped index index_isUserActive 2016/03/24 08:28:54 Dropped index index_bal 2016/03/24 08:28:54 Dropped index index_LongPrimaryField 2016/03/24 08:29:19 Flushed the bucket default 2016/03/24 08:29:22 Modified parameters of bucket default 2016/03/24 08:29:22 Created bucket testbucket2 2016/03/24 08:29:22 Created bucket testbucket3 2016/03/24 08:29:22 Created bucket testbucket4 2016/03/24 08:29:52 Generating docs and Populating all the buckets 2016/03/24 08:29:56 Created the secondary index bucket1_age. Waiting for it become active 2016/03/24 08:29:56 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:29:56 Index is now active 2016/03/24 08:29:56 PERFSTAT CreateAndBuildIndex 2.4088 seconds 2016/03/24 08:30:00 Created the secondary index bucket2_city. Waiting for it become active 2016/03/24 08:30:00 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:30:00 Index is now active 2016/03/24 08:30:00 PERFSTAT CreateAndBuildIndex 2.7036 seconds 2016/03/24 08:30:03 Created the secondary index bucket3_gender. Waiting for it become active 2016/03/24 08:30:03 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:30:03 Index is now active 2016/03/24 08:30:03 PERFSTAT CreateAndBuildIndex 2.5340 seconds 2016/03/24 08:30:07 Created the secondary index bucket4_balance. Waiting for it become active 2016/03/24 08:30:07 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:30:07 Index is now active 2016/03/24 08:30:07 PERFSTAT CreateAndBuildIndex 2.5043 seconds 2016/03/24 08:30:10 PERFSTAT Range 0.0083 seconds 2016/03/24 08:30:10 Expected and Actual scan responses are the same 2016/03/24 08:30:10 PERFSTAT Range 0.0101 seconds 2016/03/24 08:30:10 Expected and Actual scan responses are the same 2016/03/24 08:30:10 PERFSTAT Range 0.0108 seconds 2016/03/24 08:30:10 Expected and Actual scan responses are the same 2016/03/24 08:30:10 PERFSTAT Range 0.0045 seconds 2016/03/24 08:30:10 Expected and Actual scan responses are the same 2016/03/24 08:30:12 Deleted bucket testbucket2 2016/03/24 08:30:13 Deleted bucket testbucket3 2016/03/24 08:30:14 Deleted bucket testbucket4 2016/03/24 08:30:17 Modified parameters of bucket default --- PASS: TestMultipleBuckets (114.16s) === RUN TestBucketFlush 2016/03/24 08:30:47 In TestBucketFlush() 2016/03/24 08:30:47 In DropAllSecondaryIndexes() 2016/03/24 08:30:48 Dropped index bucket1_age 2016/03/24 08:31:12 Flushed the bucket default 2016/03/24 08:31:15 Created the secondary index index_age. Waiting for it become active 2016/03/24 08:31:15 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:31:15 Index is now active 2016/03/24 08:31:15 PERFSTAT CreateAndBuildIndex 2.0412 seconds 2016/03/24 08:31:15 PERFSTAT ScanAll 0.0180 seconds 2016/03/24 08:31:15 Expected and Actual scan responses are the same 2016/03/24 08:31:18 Created the secondary index index_gender. Waiting for it become active 2016/03/24 08:31:18 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:31:18 Index is now active 2016/03/24 08:31:18 PERFSTAT CreateAndBuildIndex 2.9140 seconds 2016/03/24 08:31:18 PERFSTAT ScanAll 0.0175 seconds 2016/03/24 08:31:18 Expected and Actual scan responses are the same 2016/03/24 08:31:21 Created the secondary index index_city. Waiting for it become active 2016/03/24 08:31:21 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:31:21 Index is now active 2016/03/24 08:31:21 PERFSTAT CreateAndBuildIndex 3.0178 seconds 2016/03/24 08:31:21 PERFSTAT ScanAll 0.0178 seconds 2016/03/24 08:31:21 Expected and Actual scan responses are the same 2016/03/24 08:31:46 Flushed the bucket default 2016/03/24 08:31:51 TestBucketFlush:: Flushed the bucket 2016/03/24 08:31:51 PERFSTAT ScanAll 0.0029 seconds 2016/03/24 08:31:51 PERFSTAT ScanAll 0.0034 seconds 2016/03/24 08:31:51 PERFSTAT ScanAll 0.0026 seconds --- PASS: TestBucketFlush (63.29s) === RUN TestSaslBucket 2016/03/24 08:31:51 In TestSaslBucket() 2016/03/24 08:31:51 http://127.0.0.1:9000/pools/default/buckets/BucketA 2016/03/24 08:31:51 &{DELETE http://127.0.0.1:9000/pools/default/buckets/BucketA HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 08:31:51 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:01:51 GMT] Content-Type:[text/plain] Content-Length:[31] Cache-Control:[no-cache] Server:[Couchbase Server]] 0xc837b89340 31 [] false map[] 0xc8201e09a0 } 2016/03/24 08:31:51 DeleteBucket failed for bucket BucketA 2016/03/24 08:31:51 Deleted bucket BucketA 2016/03/24 08:32:21 Created bucket BucketA 2016/03/24 08:32:54 Created the secondary index i_age. Waiting for it become active 2016/03/24 08:32:54 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:32:54 Index is now active 2016/03/24 08:32:54 PERFSTAT CreateAndBuildIndex 2.2638 seconds 2016/03/24 08:32:54 PERFSTAT Range 0.0048 seconds 2016/03/24 08:32:54 Expected and Actual scan responses are the same --- PASS: TestSaslBucket (63.33s) === RUN TestLargeDocumentSize 2016/03/24 08:32:54 In TestLargeDocumentSize() 2016/03/24 08:32:54 Data file exists. Skipping download 2016/03/24 08:32:54 Length of docs and largeDocs = 200 and 200 2016/03/24 08:32:58 Created the secondary index index_userscreenname. Waiting for it become active 2016/03/24 08:32:58 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:32:58 Index is now active 2016/03/24 08:32:58 PERFSTAT CreateAndBuildIndex 3.1073 seconds 2016/03/24 08:32:58 PERFSTAT ScanAll 0.0084 seconds 2016/03/24 08:32:58 Expected and Actual scan responses are the same --- PASS: TestLargeDocumentSize (3.57s) === RUN TestFieldsWithSpecialCharacters 2016/03/24 08:32:58 In TestFieldsWithSpecialCharacters() 2016/03/24 08:33:02 Created the secondary index index_specialchar. Waiting for it become active 2016/03/24 08:33:02 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:33:02 Index is now active 2016/03/24 08:33:02 PERFSTAT CreateAndBuildIndex 3.1993 seconds 2016/03/24 08:33:02 Looking up for value xvƒ,†§1 2016/03/24 08:33:02 PERFSTAT Lookup 0.0032 seconds 2016/03/24 08:33:02 Expected and Actual scan responses are the same --- PASS: TestFieldsWithSpecialCharacters (4.58s) === RUN TestIndexNameValidation 2016/03/24 08:33:02 In TestIndexNameValidation() 2016/03/24 08:33:03 Setting JSON docs in KV 2016/03/24 08:33:04 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected 2016/03/24 08:33:07 Created the secondary index #primary-Index_test. Waiting for it become active 2016/03/24 08:33:07 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:33:07 Index is now active 2016/03/24 08:33:07 PERFSTAT CreateAndBuildIndex 3.2306 seconds 2016/03/24 08:33:07 PERFSTAT Range 0.0139 seconds 2016/03/24 08:33:07 Expected and Actual scan responses are the same --- PASS: TestIndexNameValidation (4.83s) === RUN TestSameFieldNameAtDifferentLevels 2016/03/24 08:33:07 In TestSameFieldNameAtDifferentLevels() 2016/03/24 08:33:07 Setting JSON docs in KV 2016/03/24 08:33:12 Created the secondary index cityindex. Waiting for it become active 2016/03/24 08:33:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:33:12 Index is now active 2016/03/24 08:33:12 PERFSTAT CreateAndBuildIndex 3.2748 seconds 2016/03/24 08:33:12 PERFSTAT Range 0.0100 seconds 2016/03/24 08:33:12 Expected and Actual scan responses are the same --- PASS: TestSameFieldNameAtDifferentLevels (4.68s) === RUN TestSameIndexNameInTwoBuckets 2016/03/24 08:33:12 In TestSameIndexNameInTwoBuckets() 2016/03/24 08:33:12 In DropAllSecondaryIndexes() 2016/03/24 08:33:12 Dropped index index_userscreenname 2016/03/24 08:33:12 Dropped index index_age 2016/03/24 08:33:12 Dropped index i_age 2016/03/24 08:33:12 Dropped index #primary-Index_test 2016/03/24 08:33:12 Dropped index index_gender 2016/03/24 08:33:12 Dropped index cityindex 2016/03/24 08:33:12 Dropped index index_specialchar 2016/03/24 08:33:12 Dropped index index_city 2016/03/24 08:33:37 Flushed the bucket default 2016/03/24 08:33:40 Modified parameters of bucket default 2016/03/24 08:33:40 Created bucket buck2 2016/03/24 08:34:10 Generating docs and Populating all the buckets 2016/03/24 08:34:13 Created the secondary index b_idx. Waiting for it become active 2016/03/24 08:34:13 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:34:13 Index is now active 2016/03/24 08:34:13 PERFSTAT CreateAndBuildIndex 2.4730 seconds 2016/03/24 08:34:17 Created the secondary index b_idx. Waiting for it become active 2016/03/24 08:34:17 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:34:17 Index is now active 2016/03/24 08:34:17 PERFSTAT CreateAndBuildIndex 2.4907 seconds 2016/03/24 08:34:20 PERFSTAT Range 0.0081 seconds 2016/03/24 08:34:20 Expected and Actual scan responses are the same 2016/03/24 08:34:20 PERFSTAT Range 0.0100 seconds 2016/03/24 08:34:20 Expected and Actual scan responses are the same 2016/03/24 08:34:23 Modified parameters of bucket default 2016/03/24 08:34:24 Deleted bucket buck2 --- PASS: TestSameIndexNameInTwoBuckets (102.55s) === RUN TestBuildDeferredAnotherBuilding 2016/03/24 08:34:54 In TestBuildDeferredAnotherBuilding() 2016/03/24 08:34:54 In DropAllSecondaryIndexes() 2016/03/24 08:34:54 Dropped index b_idx 2016/03/24 08:35:57 Setting JSON docs in KV 2016/03/24 08:38:28 Created the secondary index id_company 2016/03/24 08:38:28 Created the secondary index id_age 2016/03/24 08:38:29 Build command issued for the deferred indexes [13835310950889217808] 2016/03/24 08:38:34 Build index failed as expected: Build Already In Progress. Bucket default 2016/03/24 08:38:34 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:35 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:36 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:37 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:40 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:41 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:42 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:43 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:44 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:45 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:46 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:47 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:48 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:49 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:50 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:52 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:38:58 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:38:58 Index is now active 2016/03/24 08:39:01 Build the deferred index id_age. Waiting for the index to become active 2016/03/24 08:39:01 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:04 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:05 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:06 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:07 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:08 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:09 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:10 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:11 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:12 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:13 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:14 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:15 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:16 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:17 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:18 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:19 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:20 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:21 Index state is INDEX_STATE_INITIAL 2016/03/24 08:39:22 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:39:22 Index is now active 2016/03/24 08:39:22 PERFSTAT BuildIndex 23.0412 seconds 2016/03/24 08:39:23 PERFSTAT Range 1.0000 seconds 2016/03/24 08:39:23 Expected and Actual scan responses are the same 2016/03/24 08:39:24 PERFSTAT Range 0.8717 seconds 2016/03/24 08:39:24 Expected and Actual scan responses are the same --- PASS: TestBuildDeferredAnotherBuilding (269.94s) === RUN TestMultipleBucketsDeferredBuild 2016/03/24 08:39:24 In TestMultipleBucketsDeferredBuild() 2016/03/24 08:39:24 In DropAllSecondaryIndexes() 2016/03/24 08:39:24 Dropped index id_company 2016/03/24 08:39:24 Dropped index id_age 2016/03/24 08:39:49 Flushed the bucket default 2016/03/24 08:39:52 Modified parameters of bucket default 2016/03/24 08:39:52 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 2016/03/24 08:39:52 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 08:39:52 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Date:[Thu, 24 Mar 2016 03:09:52 GMT] Content-Type:[text/plain] Content-Length:[31] Cache-Control:[no-cache] Server:[Couchbase Server] Pragma:[no-cache]] 0xc8698b6180 31 [] false map[] 0xc84159e1c0 } 2016/03/24 08:39:52 DeleteBucket failed for bucket defertest_buck2 2016/03/24 08:39:52 Deleted bucket defertest_buck2 2016/03/24 08:39:52 Created bucket defertest_buck2 2016/03/24 08:40:22 Setting JSON docs in KV 2016/03/24 08:42:06 Created the secondary index buck1_id1 2016/03/24 08:42:06 Created the secondary index buck1_id2 2016/03/24 08:42:07 Created the secondary index buck2_id3 2016/03/24 08:42:07 Build command issued for the deferred indexes [69425610291159984] 2016/03/24 08:42:10 Build command issued for the deferred indexes [8447814846676300043 9004287011391172500] 2016/03/24 08:42:15 Index state of 8447814846676300043 is INDEX_STATE_READY and error is Build Already In Progress. Bucket default 2016/03/24 08:42:15 Build index failed as expected: Build Already In Progress. Bucket default 2016/03/24 08:42:15 Index state of 9004287011391172500 is INDEX_STATE_INITIAL 2016/03/24 08:42:15 Index state is INDEX_STATE_INITIAL 2016/03/24 08:42:16 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:42:16 Index is now active 2016/03/24 08:42:19 Build the deferred index buck1_id2. Waiting for the index to become active 2016/03/24 08:42:19 Index state is INDEX_STATE_INITIAL 2016/03/24 08:42:20 Index state is INDEX_STATE_INITIAL 2016/03/24 08:42:21 Index state is INDEX_STATE_INITIAL 2016/03/24 08:42:22 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:42:22 Index is now active 2016/03/24 08:42:22 PERFSTAT BuildIndex 5.0394 seconds 2016/03/24 08:42:23 PERFSTAT Range 0.2777 seconds 2016/03/24 08:42:23 Expected and Actual scan responses are the same 2016/03/24 08:42:23 PERFSTAT Range 0.0035 seconds 2016/03/24 08:42:23 Expected and Actual scan responses are the same 2016/03/24 08:42:23 PERFSTAT Range 0.3636 seconds 2016/03/24 08:42:23 Expected and Actual scan responses are the same 2016/03/24 08:42:23 http://127.0.0.1:9000/pools/default/buckets/default 2016/03/24 08:42:23 &{POST http://127.0.0.1:9000/pools/default/buckets/default HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc829cd6900} 28 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 08:42:23 &{400 Bad Request 400 HTTP/1.1 1 1 map[Content-Length:[390] Cache-Control:[no-cache] Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:12:23 GMT] Content-Type:[application/json]] 0xc84757bbc0 390 [] false map[] 0xc84afba8c0 } 2016/03/24 08:42:23 EditBucket failed for bucket default 2016/03/24 08:42:26 Modified parameters of bucket default 2016/03/24 08:42:28 Deleted bucket defertest_buck2 --- PASS: TestMultipleBucketsDeferredBuild (188.38s) === RUN TestCreateDropCreateDeferredIndex 2016/03/24 08:42:33 In TestCreateDropCreateDeferredIndex() 2016/03/24 08:42:33 In DropAllSecondaryIndexes() 2016/03/24 08:42:33 Dropped index buck1_id1 2016/03/24 08:42:33 Dropped index buck1_id2 2016/03/24 08:42:36 Setting JSON docs in KV 2016/03/24 08:42:50 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:42:50 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:42:50 Index is now active 2016/03/24 08:42:50 PERFSTAT CreateAndBuildIndex 7.2573 seconds 2016/03/24 08:42:51 Created the secondary index id_age 2016/03/24 08:42:51 Dropping the secondary index id_age 2016/03/24 08:42:51 Index dropped 2016/03/24 08:42:51 PERFSTAT DropIndex 0.0546 seconds 2016/03/24 08:42:54 Setting JSON docs in KV 2016/03/24 08:43:04 PERFSTAT Range 0.3718 seconds 2016/03/24 08:43:04 Expected and Actual scan responses are the same --- PASS: TestCreateDropCreateDeferredIndex (31.02s) === RUN TestMultipleDeferredIndexes_BuildTogether 2016/03/24 08:43:04 In TestMultipleDeferredIndexes_BuildTogether() 2016/03/24 08:43:04 In DropAllSecondaryIndexes() 2016/03/24 08:43:04 Dropped index id_company 2016/03/24 08:43:07 Setting JSON docs in KV 2016/03/24 08:43:23 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:43:23 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:43:23 Index is now active 2016/03/24 08:43:23 PERFSTAT CreateAndBuildIndex 9.9777 seconds 2016/03/24 08:43:24 Created the secondary index id_age 2016/03/24 08:43:25 Created the secondary index id_gender 2016/03/24 08:43:25 Created the secondary index id_isActive 2016/03/24 08:43:25 Build command issued for the deferred indexes [id_age id_gender id_isActive] 2016/03/24 08:43:25 Waiting for the index id_age to become active 2016/03/24 08:43:25 Index state is INDEX_STATE_READY 2016/03/24 08:43:26 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:27 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:28 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:29 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:30 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:31 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:32 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:33 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:34 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:35 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:36 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:37 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:40 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:41 Index state is INDEX_STATE_INITIAL 2016/03/24 08:43:42 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:43:42 Index is now active 2016/03/24 08:43:42 Waiting for the index id_gender to become active 2016/03/24 08:43:42 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:43:42 Index is now active 2016/03/24 08:43:42 Waiting for the index id_isActive to become active 2016/03/24 08:43:42 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:43:42 Index is now active 2016/03/24 08:43:42 PERFSTAT Range 0.3410 seconds 2016/03/24 08:43:42 Expected and Actual scan responses are the same 2016/03/24 08:43:46 Setting JSON docs in KV 2016/03/24 08:44:01 PERFSTAT Range 5.8000 seconds 2016/03/24 08:44:01 Expected and Actual scan responses are the same 2016/03/24 08:44:02 PERFSTAT Range 0.6117 seconds 2016/03/24 08:44:02 Expected and Actual scan responses are the same --- PASS: TestMultipleDeferredIndexes_BuildTogether (58.28s) === RUN TestMultipleDeferredIndexes_BuildOneByOne 2016/03/24 08:44:02 In TestMultipleDeferredIndexes_BuildOneByOne() 2016/03/24 08:44:02 In DropAllSecondaryIndexes() 2016/03/24 08:44:02 Dropped index id_age 2016/03/24 08:44:02 Dropped index id_company 2016/03/24 08:44:02 Dropped index id_gender 2016/03/24 08:44:02 Dropped index id_isActive 2016/03/24 08:44:06 Setting JSON docs in KV 2016/03/24 08:44:24 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:44:24 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:44:24 Index is now active 2016/03/24 08:44:24 PERFSTAT CreateAndBuildIndex 11.8450 seconds 2016/03/24 08:44:25 Created the secondary index id_age 2016/03/24 08:44:26 Created the secondary index id_gender 2016/03/24 08:44:26 Created the secondary index id_isActive 2016/03/24 08:44:26 Build command issued for the deferred indexes [id_age] 2016/03/24 08:44:26 Waiting for the index id_age to become active 2016/03/24 08:44:26 Index state is INDEX_STATE_READY 2016/03/24 08:44:27 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:28 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:29 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:30 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:31 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:32 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:33 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:34 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:35 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:36 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:37 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:40 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:44:40 Index is now active 2016/03/24 08:44:40 Build command issued for the deferred indexes [id_gender] 2016/03/24 08:44:40 Waiting for the index id_gender to become active 2016/03/24 08:44:40 Index state is INDEX_STATE_READY 2016/03/24 08:44:41 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:42 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:43 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:44 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:45 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:46 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:47 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:48 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:49 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:50 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:52 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:44:52 Index is now active 2016/03/24 08:44:52 Build command issued for the deferred indexes [id_isActive] 2016/03/24 08:44:52 Waiting for the index id_isActive to become active 2016/03/24 08:44:52 Index state is INDEX_STATE_READY 2016/03/24 08:44:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:58 Index state is INDEX_STATE_INITIAL 2016/03/24 08:44:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:00 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:01 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:04 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:45:04 Index is now active 2016/03/24 08:45:04 PERFSTAT Range 0.4036 seconds 2016/03/24 08:45:04 Expected and Actual scan responses are the same 2016/03/24 08:45:07 Setting JSON docs in KV 2016/03/24 08:45:23 PERFSTAT Range 5.9091 seconds 2016/03/24 08:45:23 Expected and Actual scan responses are the same 2016/03/24 08:45:24 PERFSTAT Range 0.7198 seconds 2016/03/24 08:45:24 Expected and Actual scan responses are the same --- PASS: TestMultipleDeferredIndexes_BuildOneByOne (82.36s) === RUN TestDropDeferredIndexWhileOthersBuilding 2016/03/24 08:45:24 In TestDropDeferredIndexWhileOthersBuilding() 2016/03/24 08:45:24 In DropAllSecondaryIndexes() 2016/03/24 08:45:24 Dropped index id_isActive 2016/03/24 08:45:24 Dropped index id_age 2016/03/24 08:45:25 Dropped index id_gender 2016/03/24 08:45:25 Dropped index id_company 2016/03/24 08:45:28 Setting JSON docs in KV 2016/03/24 08:45:51 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:45:51 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:45:51 Index is now active 2016/03/24 08:45:51 PERFSTAT CreateAndBuildIndex 15.0210 seconds 2016/03/24 08:45:52 Created the secondary index id_age 2016/03/24 08:45:52 Created the secondary index id_gender 2016/03/24 08:45:52 Created the secondary index id_isActive 2016/03/24 08:45:52 Build command issued for the deferred indexes [5679293574301186630 7872700448263180767] 2016/03/24 08:45:54 Dropping the secondary index id_isActive 2016/03/24 08:45:58 Index dropped 2016/03/24 08:45:58 PERFSTAT DropIndex 3.5050 seconds 2016/03/24 08:45:58 Index state is INDEX_STATE_INITIAL 2016/03/24 08:45:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:00 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:01 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:04 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:05 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:06 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:07 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:08 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:09 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:10 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:11 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:46:12 Index is now active 2016/03/24 08:46:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:46:12 Index is now active 2016/03/24 08:46:13 PERFSTAT Range 0.2718 seconds 2016/03/24 08:46:13 Expected and Actual scan responses are the same 2016/03/24 08:46:14 PERFSTAT Range 0.0306 seconds 2016/03/24 08:46:14 Expected and Actual scan responses are the same 2016/03/24 08:46:17 Setting JSON docs in KV 2016/03/24 08:46:28 PERFSTAT Range 1.0017 seconds 2016/03/24 08:46:28 Expected and Actual scan responses are the same --- PASS: TestDropDeferredIndexWhileOthersBuilding (63.44s) === RUN TestDropBuildingDeferredIndex 2016/03/24 08:46:28 In TestDropBuildingDeferredIndex() 2016/03/24 08:46:28 In DropAllSecondaryIndexes() 2016/03/24 08:46:28 Dropped index id_age 2016/03/24 08:46:28 Dropped index id_gender 2016/03/24 08:46:28 Dropped index id_company 2016/03/24 08:46:31 Setting JSON docs in KV 2016/03/24 08:46:39 Created the secondary index id_company 2016/03/24 08:46:39 Created the secondary index id_age 2016/03/24 08:46:39 Created the secondary index id_gender 2016/03/24 08:46:40 Build command issued for the deferred indexes [12522130574649018342 15676820939096698734] 2016/03/24 08:46:41 Dropping the secondary index id_age 2016/03/24 08:46:44 Index dropped 2016/03/24 08:46:44 PERFSTAT DropIndex 2.9289 seconds 2016/03/24 08:46:44 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:45 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:46 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:47 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:48 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:49 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:50 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:52 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:46:58 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:46:58 Index is now active 2016/03/24 08:46:58 Build command issued for the deferred indexes [id_gender] 2016/03/24 08:46:58 Waiting for the index id_gender to become active 2016/03/24 08:46:58 Index state is INDEX_STATE_READY 2016/03/24 08:46:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:00 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:01 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:04 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:05 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:06 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:07 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:08 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:09 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:10 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:11 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:12 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:13 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:14 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:15 Index state is INDEX_STATE_INITIAL 2016/03/24 08:47:16 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:47:16 Index is now active 2016/03/24 08:47:17 PERFSTAT Range 0.2748 seconds 2016/03/24 08:47:17 Expected and Actual scan responses are the same 2016/03/24 08:47:18 PERFSTAT Range 0.9453 seconds 2016/03/24 08:47:18 Expected and Actual scan responses are the same 2016/03/24 08:47:22 Setting JSON docs in KV 2016/03/24 08:47:38 PERFSTAT ScanAll 7.7640 seconds 2016/03/24 08:47:39 Expected and Actual scan responses are the same --- PASS: TestDropBuildingDeferredIndex (70.91s) === RUN TestDropMultipleBuildingDeferredIndexes 2016/03/24 08:47:39 In TestDropMultipleBuildingDeferredIndexes() 2016/03/24 08:47:39 In DropAllSecondaryIndexes() 2016/03/24 08:47:39 Dropped index id_company 2016/03/24 08:47:39 Dropped index id_gender 2016/03/24 08:47:48 Setting JSON docs in KV 2016/03/24 08:48:34 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:48:34 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:48:34 Index is now active 2016/03/24 08:48:34 PERFSTAT CreateAndBuildIndex 22.9055 seconds 2016/03/24 08:48:35 Created the secondary index id_age 2016/03/24 08:48:35 Created the secondary index id_gender 2016/03/24 08:48:35 Created the secondary index id_isActive 2016/03/24 08:48:36 Build command issued for the deferred indexes [8586603619034498578 749441389033348621] 2016/03/24 08:48:37 Dropping the secondary index id_age 2016/03/24 08:48:50 Index dropped 2016/03/24 08:48:50 PERFSTAT DropIndex 12.9121 seconds 2016/03/24 08:48:50 Dropping the secondary index id_gender 2016/03/24 08:48:50 Index dropped 2016/03/24 08:48:50 PERFSTAT DropIndex 0.1633 seconds 2016/03/24 08:48:50 Build command issued for the deferred indexes [id_isActive] 2016/03/24 08:48:50 Waiting for the index id_isActive to become active 2016/03/24 08:48:50 Index state is INDEX_STATE_READY 2016/03/24 08:48:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:52 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:58 Index state is INDEX_STATE_INITIAL 2016/03/24 08:48:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:00 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:01 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:04 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:05 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:06 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:07 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:08 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:09 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:10 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:11 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:49:11 Index is now active 2016/03/24 08:49:23 PERFSTAT ScanAll 2.2872 seconds 2016/03/24 08:49:24 Expected and Actual scan responses are the same 2016/03/24 08:49:24 Number of docScanResults and scanResults = 180000 and 180000 2016/03/24 08:49:27 PERFSTAT ScanAll 3.2145 seconds 2016/03/24 08:49:27 Expected and Actual scan responses are the same 2016/03/24 08:49:27 Number of docScanResults and scanResults = 180000 and 180000 --- PASS: TestDropMultipleBuildingDeferredIndexes (108.62s) === RUN TestDropOneIndexSecondDeferBuilding 2016/03/24 08:49:27 In TestDropOneIndexSecondDeferBuilding() 2016/03/24 08:49:27 In DropAllSecondaryIndexes() 2016/03/24 08:49:27 Dropped index id_isActive 2016/03/24 08:49:27 Dropped index id_company 2016/03/24 08:49:30 Setting JSON docs in KV 2016/03/24 08:49:37 Created the secondary index id_company 2016/03/24 08:49:37 Created the secondary index id_age 2016/03/24 08:49:37 Created the secondary index id_gender 2016/03/24 08:49:37 Build command issued for the deferred indexes [id_company] 2016/03/24 08:49:37 Waiting for the index id_company to become active 2016/03/24 08:49:37 Index state is INDEX_STATE_READY 2016/03/24 08:49:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:40 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:41 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:42 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:43 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:44 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:45 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:46 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:47 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:48 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:49 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:50 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:52 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:58 Index state is INDEX_STATE_INITIAL 2016/03/24 08:49:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:00 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:50:00 Index is now active 2016/03/24 08:50:00 Build command issued for the deferred indexes [2226870933810210452] 2016/03/24 08:50:01 Dropping the secondary index id_company 2016/03/24 08:50:04 Index dropped 2016/03/24 08:50:04 PERFSTAT DropIndex 2.9682 seconds 2016/03/24 08:50:13 Setting JSON docs in KV 2016/03/24 08:50:25 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:26 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:27 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:28 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:29 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:30 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:31 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:32 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:33 Index state is INDEX_STATE_CATCHUP 2016/03/24 08:50:34 Index state is INDEX_STATE_CATCHUP 2016/03/24 08:50:35 Index state is INDEX_STATE_CATCHUP 2016/03/24 08:50:36 Index state is INDEX_STATE_CATCHUP 2016/03/24 08:50:37 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:50:37 Index is now active 2016/03/24 08:50:37 Build command issued for the deferred indexes [id_gender] 2016/03/24 08:50:37 Waiting for the index id_gender to become active 2016/03/24 08:50:37 Index state is INDEX_STATE_READY 2016/03/24 08:50:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:40 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:41 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:42 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:43 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:44 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:45 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:46 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:47 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:48 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:49 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:50 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:51 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:52 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:53 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:54 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:55 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:56 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:57 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:58 Index state is INDEX_STATE_INITIAL 2016/03/24 08:50:59 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:00 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:51:00 Index is now active 2016/03/24 08:51:01 PERFSTAT Range 0.4517 seconds 2016/03/24 08:51:01 Expected and Actual scan responses are the same 2016/03/24 08:51:05 PERFSTAT ScanAll 3.6650 seconds 2016/03/24 08:51:05 Expected and Actual scan responses are the same --- PASS: TestDropOneIndexSecondDeferBuilding (97.55s) === RUN TestDropSecondIndexSecondDeferBuilding 2016/03/24 08:51:05 In TestDropSecondIndexSecondDeferBuilding() 2016/03/24 08:51:05 In DropAllSecondaryIndexes() 2016/03/24 08:51:05 Dropped index id_gender 2016/03/24 08:51:05 Dropped index id_age 2016/03/24 08:51:08 Setting JSON docs in KV 2016/03/24 08:51:15 Created the secondary index id_company 2016/03/24 08:51:15 Created the secondary index id_age 2016/03/24 08:51:15 Created the secondary index id_gender 2016/03/24 08:51:16 Build command issued for the deferred indexes [id_company] 2016/03/24 08:51:16 Waiting for the index id_company to become active 2016/03/24 08:51:16 Index state is INDEX_STATE_READY 2016/03/24 08:51:17 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:18 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:19 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:20 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:21 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:22 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:23 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:24 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:25 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:26 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:27 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:28 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:29 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:30 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:31 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:32 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:33 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:34 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:35 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:36 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:37 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:38 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:39 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:40 Index state is INDEX_STATE_INITIAL 2016/03/24 08:51:41 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:51:41 Index is now active 2016/03/24 08:51:41 Build command issued for the deferred indexes [15487197711723197154] 2016/03/24 08:51:42 Dropping the secondary index id_age 2016/03/24 08:51:48 Index dropped 2016/03/24 08:51:48 PERFSTAT DropIndex 6.6934 seconds 2016/03/24 08:51:52 Setting JSON docs in KV 2016/03/24 08:52:01 Build command issued for the deferred indexes [id_gender] 2016/03/24 08:52:01 Waiting for the index id_gender to become active 2016/03/24 08:52:01 Index state is INDEX_STATE_READY 2016/03/24 08:52:02 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:03 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:04 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:05 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:06 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:07 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:08 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:09 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:10 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:11 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:12 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:13 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:14 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:15 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:16 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:17 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:18 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:19 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:20 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:21 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:22 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:23 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:24 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:25 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:26 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:27 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:28 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:29 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:30 Index state is INDEX_STATE_INITIAL 2016/03/24 08:52:31 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:52:31 Index is now active 2016/03/24 08:52:32 PERFSTAT Range 0.4698 seconds 2016/03/24 08:52:32 Expected and Actual scan responses are the same 2016/03/24 08:52:35 PERFSTAT ScanAll 2.9509 seconds 2016/03/24 08:52:35 Expected and Actual scan responses are the same --- PASS: TestDropSecondIndexSecondDeferBuilding (90.43s) === RUN TestDropBuildingIndex1 2016/03/24 08:52:35 In TestDropBuildingIndex1() 2016/03/24 08:52:35 In DropAllSecondaryIndexes() 2016/03/24 08:52:35 Dropped index id_company 2016/03/24 08:52:35 Dropped index id_gender 2016/03/24 08:52:43 Setting JSON docs in KV 2016/03/24 08:53:32 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:53:32 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:53:32 Index is now active 2016/03/24 08:53:32 PERFSTAT CreateAndBuildIndex 34.4026 seconds 2016/03/24 08:54:00 Created the secondary index id_age 2016/03/24 08:54:01 Dropping the secondary index id_age 2016/03/24 08:54:01 Index dropped 2016/03/24 08:54:01 PERFSTAT DropIndex 0.0858 seconds 2016/03/24 08:54:29 Created the secondary index id_age. Waiting for it become active 2016/03/24 08:54:29 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:54:29 Index is now active 2016/03/24 08:54:29 PERFSTAT CreateAndBuildIndex 27.6482 seconds 2016/03/24 08:54:31 Setting JSON docs in KV 2016/03/24 08:54:46 PERFSTAT Range 5.7485 seconds 2016/03/24 08:54:46 Expected and Actual scan responses are the same 2016/03/24 08:54:47 PERFSTAT Range 0.7971 seconds 2016/03/24 08:54:47 Expected and Actual scan responses are the same --- PASS: TestDropBuildingIndex1 (131.96s) === RUN TestDropBuildingIndex2 2016/03/24 08:54:47 In TestDropBuildingIndex2() 2016/03/24 08:54:47 In DropAllSecondaryIndexes() 2016/03/24 08:54:47 Dropped index id_company 2016/03/24 08:54:47 Dropped index id_age 2016/03/24 08:54:54 Setting JSON docs in KV 2016/03/24 08:55:44 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:55:44 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:55:44 Index is now active 2016/03/24 08:55:44 PERFSTAT CreateAndBuildIndex 34.6737 seconds 2016/03/24 08:56:16 Created the secondary index id_age 2016/03/24 08:56:17 Dropping the secondary index id_company 2016/03/24 08:56:17 Index dropped 2016/03/24 08:56:17 PERFSTAT DropIndex 0.0886 seconds 2016/03/24 08:56:17 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:56:17 Index is now active 2016/03/24 08:56:49 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:56:49 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:56:49 Index is now active 2016/03/24 08:56:49 PERFSTAT CreateAndBuildIndex 31.7644 seconds 2016/03/24 08:56:51 Setting JSON docs in KV 2016/03/24 08:57:03 PERFSTAT Range 0.6585 seconds 2016/03/24 08:57:03 Expected and Actual scan responses are the same 2016/03/24 08:57:04 PERFSTAT Range 0.8757 seconds 2016/03/24 08:57:04 Expected and Actual scan responses are the same --- PASS: TestDropBuildingIndex2 (137.13s) === RUN TestDropIndexWithDataLoad 2016/03/24 08:57:04 In TestDropIndexWithDataLoad() 2016/03/24 08:57:04 In DropAllSecondaryIndexes() 2016/03/24 08:57:04 Dropped index id_company 2016/03/24 08:57:05 Dropped index id_age 2016/03/24 08:57:07 Setting JSON docs in KV 2016/03/24 08:57:48 Created the secondary index id_company. Waiting for it become active 2016/03/24 08:57:48 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:57:48 Index is now active 2016/03/24 08:57:48 PERFSTAT CreateAndBuildIndex 33.1358 seconds 2016/03/24 08:58:23 Created the secondary index id_age. Waiting for it become active 2016/03/24 08:58:23 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:58:23 Index is now active 2016/03/24 08:58:23 PERFSTAT CreateAndBuildIndex 34.1960 seconds 2016/03/24 08:58:58 Created the secondary index id_gender. Waiting for it become active 2016/03/24 08:58:58 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:58:58 Index is now active 2016/03/24 08:58:58 PERFSTAT CreateAndBuildIndex 33.9945 seconds 2016/03/24 08:59:32 Created the secondary index id_isActive. Waiting for it become active 2016/03/24 08:59:32 Index state is INDEX_STATE_ACTIVE 2016/03/24 08:59:32 Index is now active 2016/03/24 08:59:32 PERFSTAT CreateAndBuildIndex 33.1503 seconds 2016/03/24 08:59:42 Setting JSON docs in KV 2016/03/24 08:59:42 In DropIndexWhileKVLoad 2016/03/24 08:59:42 In LoadKVBucket 2016/03/24 08:59:42 Bucket name = default 2016/03/24 08:59:43 Dropping the secondary index id_company 2016/03/24 08:59:44 Index dropped 2016/03/24 08:59:44 PERFSTAT DropIndex 0.5208 seconds 2016/03/24 09:00:17 PERFSTAT Range 1.1817 seconds 2016/03/24 09:00:17 Expected and Actual scan responses are the same 2016/03/24 09:00:17 Number of docScanResults and scanResults = 73504 and 73504 2016/03/24 09:00:22 PERFSTAT ScanAll 4.4802 seconds 2016/03/24 09:00:22 Expected and Actual scan responses are the same 2016/03/24 09:00:22 Number of docScanResults and scanResults = 320000 and 320000 --- PASS: TestDropIndexWithDataLoad (197.80s) === RUN TestDropAllIndexesWithDataLoad 2016/03/24 09:00:22 In TestDropAllIndexesWithDataLoad() 2016/03/24 09:00:22 In DropAllSecondaryIndexes() 2016/03/24 09:00:22 Dropped index id_isActive 2016/03/24 09:00:22 Dropped index id_gender 2016/03/24 09:00:23 Dropped index id_age 2016/03/24 09:00:27 Setting JSON docs in KV 2016/03/24 09:01:13 Created the secondary index id_company. Waiting for it become active 2016/03/24 09:01:13 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:01:13 Index is now active 2016/03/24 09:01:13 PERFSTAT CreateAndBuildIndex 39.5616 seconds 2016/03/24 09:01:53 Created the secondary index id_age. Waiting for it become active 2016/03/24 09:01:53 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:01:53 Index is now active 2016/03/24 09:01:53 PERFSTAT CreateAndBuildIndex 39.5071 seconds 2016/03/24 09:02:36 Created the secondary index id_gender. Waiting for it become active 2016/03/24 09:02:36 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:02:36 Index is now active 2016/03/24 09:02:36 PERFSTAT CreateAndBuildIndex 41.3134 seconds 2016/03/24 09:03:14 Created the secondary index id_isActive. Waiting for it become active 2016/03/24 09:03:14 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:03:14 Index is now active 2016/03/24 09:03:14 PERFSTAT CreateAndBuildIndex 37.6460 seconds 2016/03/24 09:03:25 Setting JSON docs in KV 2016/03/24 09:03:25 In LoadKVBucket 2016/03/24 09:03:25 In DropIndexWhileKVLoad 2016/03/24 09:03:25 Bucket name = default 2016/03/24 09:03:25 In DropIndexWhileKVLoad 2016/03/24 09:03:25 In DropIndexWhileKVLoad 2016/03/24 09:03:25 In DropIndexWhileKVLoad 2016/03/24 09:03:26 Dropping the secondary index id_company 2016/03/24 09:03:26 Dropping the secondary index id_gender 2016/03/24 09:03:26 Dropping the secondary index id_age 2016/03/24 09:03:26 Dropping the secondary index id_isActive 2016/03/24 09:03:26 Index dropped 2016/03/24 09:03:26 PERFSTAT DropIndex 0.4551 seconds 2016/03/24 09:03:27 Index dropped 2016/03/24 09:03:27 PERFSTAT DropIndex 0.4004 seconds 2016/03/24 09:03:27 Index dropped 2016/03/24 09:03:27 PERFSTAT DropIndex 0.8473 seconds 2016/03/24 09:03:28 Index dropped 2016/03/24 09:03:28 PERFSTAT DropIndex 1.6649 seconds 2016/03/24 09:03:48 Connection error in Scan occured: queryport.indexNotFound 2016/03/24 09:03:48 Scan failed as expected with error: queryport.indexNotFound --- PASS: TestDropAllIndexesWithDataLoad (205.68s) === RUN TestCreateBucket_AnotherIndexBuilding 2016/03/24 09:03:48 In TestCreateBucket_AnotherIndexBuilding() 2016/03/24 09:03:48 In DropAllSecondaryIndexes() 2016/03/24 09:04:14 Flushed the bucket default 2016/03/24 09:04:17 Modified parameters of bucket default 2016/03/24 09:04:17 http://127.0.0.1:9000/pools/default/buckets/multi_buck2 2016/03/24 09:04:17 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:04:17 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache] Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:34:17 GMT] Content-Type:[text/plain] Content-Length:[31]] 0xc8b8ebcc40 31 [] false map[] 0xc8b7517420 } 2016/03/24 09:04:17 DeleteBucket failed for bucket multi_buck2 2016/03/24 09:04:17 Deleted bucket multi_buck2 2016/03/24 09:04:47 Setting JSON docs in KV 2016/03/24 09:07:07 Created the secondary index buck1_idx 2016/03/24 09:07:07 Created bucket multi_buck2 2016/03/24 09:07:25 Created the secondary index buck2_idx 2016/03/24 09:07:25 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:07:25 Index is now active 2016/03/24 09:07:25 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:07:25 Index is now active 2016/03/24 09:07:25 PERFSTAT ScanAll 0.1386 seconds 2016/03/24 09:07:25 Expected and Actual scan responses are the same 2016/03/24 09:07:25 Number of docScanResults and scanResults = 10000 and 10000 2016/03/24 09:07:28 PERFSTAT ScanAll 3.1287 seconds 2016/03/24 09:07:29 Expected and Actual scan responses are the same 2016/03/24 09:07:29 Number of docScanResults and scanResults = 200000 and 200000 2016/03/24 09:07:30 Deleted bucket multi_buck2 2016/03/24 09:07:55 Flushed the bucket default --- PASS: TestCreateBucket_AnotherIndexBuilding (247.29s) === RUN TestDropBucket2Index_Bucket1IndexBuilding 2016/03/24 09:07:55 In TestDropBucket2Index_Bucket1IndexBuilding() 2016/03/24 09:07:55 In DropAllSecondaryIndexes() 2016/03/24 09:07:55 Dropped index buck1_idx 2016/03/24 09:08:20 Flushed the bucket default 2016/03/24 09:08:23 Modified parameters of bucket default 2016/03/24 09:08:23 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 2016/03/24 09:08:23 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:08:23 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:38:23 GMT] Content-Type:[text/plain] Content-Length:[31] Cache-Control:[no-cache]] 0xc8c176ec00 31 [] false map[] 0xc85f40a620 } 2016/03/24 09:08:23 DeleteBucket failed for bucket multibucket_test3 2016/03/24 09:08:23 Deleted bucket multibucket_test3 2016/03/24 09:08:23 Created bucket multibucket_test3 2016/03/24 09:08:53 Setting JSON docs in KV 2016/03/24 09:10:12 Created the secondary index buck2_idx. Waiting for it become active 2016/03/24 09:10:12 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:10:12 Index is now active 2016/03/24 09:10:12 PERFSTAT CreateAndBuildIndex 3.0610 seconds 2016/03/24 09:10:25 Created the secondary index buck1_idx 2016/03/24 09:10:27 Dropping the secondary index buck2_idx 2016/03/24 09:10:27 Index dropped 2016/03/24 09:10:27 PERFSTAT DropIndex 0.1032 seconds 2016/03/24 09:10:27 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:10:27 Index is now active 2016/03/24 09:10:29 PERFSTAT ScanAll 1.2910 seconds 2016/03/24 09:10:29 Expected and Actual scan responses are the same 2016/03/24 09:10:29 Number of docScanResults and scanResults = 100000 and 100000 2016/03/24 09:10:30 Deleted bucket multibucket_test3 2016/03/24 09:10:55 Flushed the bucket default --- PASS: TestDropBucket2Index_Bucket1IndexBuilding (180.02s) === RUN TestDeleteBucketWhileInitialIndexBuild 2016/03/24 09:10:55 In TestDeleteBucketWithDataLoad() 2016/03/24 09:10:55 In DropAllSecondaryIndexes() 2016/03/24 09:10:55 Dropped index buck1_idx 2016/03/24 09:11:20 Flushed the bucket default 2016/03/24 09:11:23 Modified parameters of bucket default 2016/03/24 09:11:23 http://127.0.0.1:9000/pools/default/buckets/testbucket2 2016/03/24 09:11:23 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:11:23 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:41:23 GMT] Content-Type:[text/plain] Content-Length:[31] Cache-Control:[no-cache]] 0xc8c176e980 31 [] false map[] 0xc84ce2ce00 } 2016/03/24 09:11:23 DeleteBucket failed for bucket testbucket2 2016/03/24 09:11:23 Deleted bucket testbucket2 2016/03/24 09:11:23 Created bucket testbucket2 2016/03/24 09:11:23 http://127.0.0.1:9000/pools/default/buckets/testbucket3 2016/03/24 09:11:23 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:11:23 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:41:23 GMT] Content-Type:[text/plain] Content-Length:[31] Cache-Control:[no-cache] Server:[Couchbase Server]] 0xc8badb4980 31 [] false map[] 0xc84cf84540 } 2016/03/24 09:11:23 DeleteBucket failed for bucket testbucket3 2016/03/24 09:11:23 Deleted bucket testbucket3 2016/03/24 09:11:23 Created bucket testbucket3 2016/03/24 09:11:23 http://127.0.0.1:9000/pools/default/buckets/testbucket4 2016/03/24 09:11:23 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:11:23 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache] Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:41:23 GMT] Content-Type:[text/plain] Content-Length:[31]] 0xc84cd60500 31 [] false map[] 0xc84cf84620 } 2016/03/24 09:11:23 DeleteBucket failed for bucket testbucket4 2016/03/24 09:11:23 Deleted bucket testbucket4 2016/03/24 09:11:23 Created bucket testbucket4 2016/03/24 09:11:53 Generating docs and Populating all the buckets 2016/03/24 09:11:57 Created the secondary index bucket1_age. Waiting for it become active 2016/03/24 09:11:57 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:11:57 Index is now active 2016/03/24 09:11:57 PERFSTAT CreateAndBuildIndex 2.9409 seconds 2016/03/24 09:12:01 Created the secondary index bucket1_gender. Waiting for it become active 2016/03/24 09:12:01 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:12:01 Index is now active 2016/03/24 09:12:01 PERFSTAT CreateAndBuildIndex 3.6044 seconds 2016/03/24 09:12:05 Created the secondary index bucket2_city. Waiting for it become active 2016/03/24 09:12:05 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:12:05 Index is now active 2016/03/24 09:12:05 PERFSTAT CreateAndBuildIndex 2.9472 seconds 2016/03/24 09:12:09 Created the secondary index bucket2_company. Waiting for it become active 2016/03/24 09:12:09 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:12:09 Index is now active 2016/03/24 09:12:09 PERFSTAT CreateAndBuildIndex 3.6476 seconds 2016/03/24 09:12:13 Created the secondary index bucket3_gender. Waiting for it become active 2016/03/24 09:12:13 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:12:13 Index is now active 2016/03/24 09:12:13 PERFSTAT CreateAndBuildIndex 2.9147 seconds 2016/03/24 09:12:16 Created the secondary index bucket3_address. Waiting for it become active 2016/03/24 09:12:16 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:12:16 Index is now active 2016/03/24 09:12:16 PERFSTAT CreateAndBuildIndex 3.6570 seconds 2016/03/24 09:12:17 PERFSTAT Range 0.0102 seconds 2016/03/24 09:12:17 Expected and Actual scan responses are the same 2016/03/24 09:13:18 Created the secondary index bucket4_balance 2016/03/24 09:13:22 Deleted bucket testbucket4 2016/03/24 09:13:22 PERFSTAT Range 0.0096 seconds 2016/03/24 09:13:22 Expected and Actual scan responses are the same 2016/03/24 09:13:22 PERFSTAT Range 0.0096 seconds 2016/03/24 09:13:22 Expected and Actual scan responses are the same 2016/03/24 09:13:22 PERFSTAT Range 0.0141 seconds 2016/03/24 09:13:22 Expected and Actual scan responses are the same 2016/03/24 09:13:24 Deleted bucket testbucket2 2016/03/24 09:13:25 Deleted bucket testbucket3 2016/03/24 09:13:25 http://127.0.0.1:9000/pools/default/buckets/testbucket4 2016/03/24 09:13:25 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] } 2016/03/24 09:13:25 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Content-Length:[31] Cache-Control:[no-cache] Server:[Couchbase Server] Pragma:[no-cache] Date:[Thu, 24 Mar 2016 03:43:25 GMT] Content-Type:[text/plain]] 0xc8a47a9fc0 31 [] false map[] 0xc85f40ab60 } 2016/03/24 09:13:25 DeleteBucket failed for bucket testbucket4 2016/03/24 09:13:25 Deleted bucket testbucket4 2016/03/24 09:13:28 Modified parameters of bucket default --- PASS: TestDeleteBucketWhileInitialIndexBuild (182.83s) === RUN TestWherClause_UpdateDocument 2016/03/24 09:13:58 In TestWherClause_UpdateDocument() 2016/03/24 09:13:58 In DropAllSecondaryIndexes() 2016/03/24 09:13:58 Dropped index bucket1_gender 2016/03/24 09:13:58 Dropped index bucket1_age 2016/03/24 09:14:23 Flushed the bucket default 2016/03/24 09:14:26 Setting JSON docs in KV 2016/03/24 09:14:35 Created the secondary index id_ageGreaterThan40. Waiting for it become active 2016/03/24 09:14:35 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:14:35 Index is now active 2016/03/24 09:14:35 PERFSTAT CreateAndBuildIndex 2.8011 seconds 2016/03/24 09:14:35 PERFSTAT ScanAll 0.0823 seconds 2016/03/24 09:14:35 Expected and Actual scan responses are the same 2016/03/24 09:14:35 Number of docScanResults and scanResults = 6013 and 6013 2016/03/24 09:14:39 PERFSTAT ScanAll 0.1912 seconds 2016/03/24 09:14:39 Expected and Actual scan responses are the same 2016/03/24 09:14:39 Number of docScanResults and scanResults = 2013 and 2013 --- PASS: TestWherClause_UpdateDocument (41.39s) === RUN TestDeferFalse 2016/03/24 09:14:39 In TestDeferFalse() 2016/03/24 09:14:43 Setting JSON docs in KV 2016/03/24 09:14:55 Created the secondary index index_deferfalse1. Waiting for it become active 2016/03/24 09:14:55 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:14:55 Index is now active 2016/03/24 09:14:55 PERFSTAT CreateAndBuildIndex 4.0157 seconds 2016/03/24 09:14:55 PERFSTAT Range 0.0512 seconds 2016/03/24 09:14:55 Expected and Actual scan responses are the same --- PASS: TestDeferFalse (15.64s) === RUN TestDeferFalse_CloseClientConnection 2016/03/24 09:14:55 In TestDeferFalse_CloseClientConnection() 2016/03/24 09:14:55 In CloseClientThread 2016/03/24 09:14:55 In CreateIndexThread 2016/03/24 09:14:57 Create Index call failed as expected due to error : Terminate Request due to client termination 2016/03/24 09:14:57 Index state is INDEX_STATE_INITIAL 2016/03/24 09:14:58 Index state is INDEX_STATE_INITIAL 2016/03/24 09:14:59 Index state is INDEX_STATE_CATCHUP 2016/03/24 09:15:00 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:15:00 Index is now active 2016/03/24 09:15:00 PERFSTAT Range 0.0031 seconds 2016/03/24 09:15:00 Expected and Actual scan responses are the same --- PASS: TestDeferFalse_CloseClientConnection (5.13s) === RUN TestIndexerSettings 2016/03/24 09:15:00 In TestIndexerSettings() 2016/03/24 09:15:00 Changing config key indexer.settings.max_cpu_percent to value 300 2016/03/24 09:15:00 Type of settings value is float64 2016/03/24 09:15:00 Type of config value that was updated is float64 2016/03/24 09:15:00 After updation, Setting is indexer.settings.max_cpu_percent = 300 2016/03/24 09:15:00 Settings updated indexer.settings.max_cpu_percent = 300 2016/03/24 09:15:00 Changing config key indexer.settings.inmemory_snapshot.interval to value 300 2016/03/24 09:15:00 Type of settings value is float64 2016/03/24 09:15:00 Type of config value that was updated is float64 2016/03/24 09:15:00 After updation, Setting is indexer.settings.inmemory_snapshot.interval = 300 2016/03/24 09:15:00 Settings updated indexer.settings.inmemory_snapshot.interval = 300 2016/03/24 09:15:00 Changing config key indexer.settings.persisted_snapshot.interval to value 20000 2016/03/24 09:15:00 Type of settings value is float64 2016/03/24 09:15:00 Type of config value that was updated is float64 2016/03/24 09:15:00 After updation, Setting is indexer.settings.persisted_snapshot.interval = 20000 2016/03/24 09:15:00 Settings updated indexer.settings.persisted_snapshot.interval = 20000 2016/03/24 09:15:00 Changing config key indexer.settings.recovery.max_rollbacks to value 3 2016/03/24 09:15:00 Type of settings value is float64 2016/03/24 09:15:00 Type of config value that was updated is float64 2016/03/24 09:15:00 After updation, Setting is indexer.settings.recovery.max_rollbacks = 3 2016/03/24 09:15:00 Settings updated indexer.settings.recovery.max_rollbacks = 3 2016/03/24 09:15:00 Changing config key indexer.settings.log_level to value error 2016/03/24 09:15:01 Type of settings value is string 2016/03/24 09:15:01 Type of config value that was updated is string 2016/03/24 09:15:01 After updation, Setting is indexer.settings.log_level = error 2016/03/24 09:15:01 Settings updated indexer.settings.log_level = error --- PASS: TestIndexerSettings (0.43s) === RUN TestRestoreDefaultSettings 2016/03/24 09:15:01 In TestIndexerSettings_RestoreDefault() 2016/03/24 09:15:01 Changing config key indexer.settings.max_cpu_percent to value 400 2016/03/24 09:15:01 Type of settings value is float64 2016/03/24 09:15:01 Type of config value that was updated is float64 2016/03/24 09:15:01 After updation, Setting is indexer.settings.max_cpu_percent = 400 2016/03/24 09:15:01 Settings updated indexer.settings.max_cpu_percent = 400 2016/03/24 09:15:01 Changing config key indexer.settings.inmemory_snapshot.interval to value 200 2016/03/24 09:15:01 Type of settings value is float64 2016/03/24 09:15:01 Type of config value that was updated is float64 2016/03/24 09:15:01 After updation, Setting is indexer.settings.inmemory_snapshot.interval = 200 2016/03/24 09:15:01 Settings updated indexer.settings.inmemory_snapshot.interval = 200 2016/03/24 09:15:01 Changing config key indexer.settings.persisted_snapshot.interval to value 30000 2016/03/24 09:15:01 Type of settings value is float64 2016/03/24 09:15:01 Type of config value that was updated is float64 2016/03/24 09:15:01 After updation, Setting is indexer.settings.persisted_snapshot.interval = 30000 2016/03/24 09:15:01 Settings updated indexer.settings.persisted_snapshot.interval = 30000 2016/03/24 09:15:01 Changing config key indexer.settings.recovery.max_rollbacks to value 5 2016/03/24 09:15:01 Type of settings value is float64 2016/03/24 09:15:01 Type of config value that was updated is float64 2016/03/24 09:15:01 After updation, Setting is indexer.settings.recovery.max_rollbacks = 5 2016/03/24 09:15:01 Settings updated indexer.settings.recovery.max_rollbacks = 5 2016/03/24 09:15:01 Changing config key indexer.settings.log_level to value debug 2016/03/24 09:15:01 Type of settings value is string 2016/03/24 09:15:01 Type of config value that was updated is string 2016/03/24 09:15:01 After updation, Setting is indexer.settings.log_level = debug 2016/03/24 09:15:01 Settings updated indexer.settings.log_level = debug --- PASS: TestRestoreDefaultSettings (0.43s) === RUN TestStat_ItemsCount 2016/03/24 09:15:01 In TestStat_ItemsCount() 2016/03/24 09:15:01 In DropAllSecondaryIndexes() 2016/03/24 09:15:01 Dropped index index_deferfalse1 2016/03/24 09:15:01 Dropped index id_ageGreaterThan40 2016/03/24 09:15:01 Dropped index index_deferfalse2 2016/03/24 09:15:01 Emptying the default bucket 2016/03/24 09:15:04 Flush Enabled on bucket default 2016/03/24 09:15:29 Flushed the bucket default 2016/03/24 09:15:34 Generating JSON docs 2016/03/24 09:15:35 Setting initial JSON docs in KV 2016/03/24 09:15:39 Creating a 2i 2016/03/24 09:15:42 Created the secondary index index_test1. Waiting for it become active 2016/03/24 09:15:42 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:15:42 Index is now active 2016/03/24 09:15:42 PERFSTAT CreateAndBuildIndex 2.9665 seconds 2016/03/24 09:15:52 items_count stat is 10000 --- PASS: TestStat_ItemsCount (51.26s) === RUN TestRangeArrayIndex_Distinct 2016/03/24 09:15:52 In TestRangeArrayIndex_Distinct() 2016/03/24 09:15:52 In DropAllSecondaryIndexes() 2016/03/24 09:15:52 Dropped index index_test1 2016/03/24 09:16:17 Flushed the bucket default 2016/03/24 09:16:21 Created the secondary index arridx_friends. Waiting for it become active 2016/03/24 09:16:21 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:16:21 Index is now active 2016/03/24 09:16:21 PERFSTAT CreateAndBuildIndex 2.5213 seconds 2016/03/24 09:16:21 PERFSTAT Range 0.0563 seconds 2016/03/24 09:16:21 Expected and Actual scan responses are the same --- PASS: TestRangeArrayIndex_Distinct (28.38s) === RUN TestUpdateArrayIndex_Distinct 2016/03/24 09:16:21 In TestUpdateArrayIndex_Distinct() 2016/03/24 09:16:21 In DropAllSecondaryIndexes() 2016/03/24 09:16:21 Dropped index arridx_friends 2016/03/24 09:16:45 Flushed the bucket default 2016/03/24 09:16:49 Created the secondary index arridx_friends. Waiting for it become active 2016/03/24 09:16:49 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:16:49 Index is now active 2016/03/24 09:16:49 PERFSTAT CreateAndBuildIndex 2.5270 seconds 2016/03/24 09:16:49 PERFSTAT Range 0.0531 seconds 2016/03/24 09:16:49 Expected and Actual scan responses are the same 2016/03/24 09:16:51 PERFSTAT Range 0.2504 seconds 2016/03/24 09:16:51 Expected and Actual scan responses are the same --- PASS: TestUpdateArrayIndex_Distinct (30.09s) === RUN TestRangeArrayIndex_Duplicate 2016/03/24 09:16:51 In TestRangeArrayIndex_Duplicate() 2016/03/24 09:16:51 In DropAllSecondaryIndexes() 2016/03/24 09:16:51 Dropped index arridx_friends 2016/03/24 09:17:15 Flushed the bucket default 2016/03/24 09:17:19 Created the secondary index arridx_friends. Waiting for it become active 2016/03/24 09:17:19 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:17:19 Index is now active 2016/03/24 09:17:19 PERFSTAT CreateAndBuildIndex 2.5288 seconds 2016/03/24 09:17:19 PERFSTAT Range 0.0554 seconds 2016/03/24 09:17:19 Expected and Actual scan responses are the same --- PASS: TestRangeArrayIndex_Duplicate (28.22s) === RUN TestUpdateArrayIndex_Duplicate 2016/03/24 09:17:19 In TestUpdateArrayIndex_Duplicate() 2016/03/24 09:17:19 In DropAllSecondaryIndexes() 2016/03/24 09:17:19 Dropped index arridx_friends 2016/03/24 09:17:44 Flushed the bucket default 2016/03/24 09:17:47 Created the secondary index arridx_friends. Waiting for it become active 2016/03/24 09:17:47 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:17:47 Index is now active 2016/03/24 09:17:47 PERFSTAT CreateAndBuildIndex 2.5174 seconds 2016/03/24 09:17:47 PERFSTAT Range 0.0898 seconds 2016/03/24 09:17:47 Expected and Actual scan responses are the same 2016/03/24 09:17:49 PERFSTAT Range 0.2270 seconds 2016/03/24 09:17:49 Expected and Actual scan responses are the same --- PASS: TestUpdateArrayIndex_Duplicate (30.04s) === RUN TestBufferedScan_BackfillDisabled 2016/03/24 09:17:49 In TestBufferedScan_BackfillDisabled() 2016/03/24 09:17:49 In DropAllSecondaryIndexes() 2016/03/24 09:17:49 Dropped index arridx_friends 2016/03/24 09:18:13 Flushed the bucket default 2016/03/24 09:18:52 Created the secondary index companyidx. Waiting for it become active 2016/03/24 09:18:52 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:18:52 Index is now active 2016/03/24 09:18:52 PERFSTAT CreateAndBuildIndex 6.4977 seconds 2016-03-24T09:18:52.368+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh. 2016-03-24T09:18:52.368+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106] 2016-03-24T09:18:52.372+05:30 [Info] WatchMetadata(): successfully reach indexer at 127.0.0.1:9106. 2016-03-24T09:18:52.372+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] started ... 2016-03-24T09:18:52.372+05:30 [Info] [GsiScanClient:"127.0.0.1:9107"] started ... 2016-03-24T09:18:52.372+05:30 [Info] GSIC[default/default-1458791332338425565] started ... 2016-03-24T09:18:52.373+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ... 2016/03/24 09:18:52 limit=1,chsize=256; received 1 items; took 5.615517ms 2016-03-24T09:18:54.262+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification 2016-03-24T09:18:54.282+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh. 2016-03-24T09:18:54.282+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106] 2016/03/24 09:18:54 limit=1000,chsize=256; received 1000 items; took 1.172215608s --- PASS: TestBufferedScan_BackfillDisabled (66.09s) === RUN TestBufferedScan_BackfillEnabled 2016/03/24 09:18:55 In TestBufferedScan_BackfillEnabled() 2016-03-24T09:18:55.553+05:30 [Info] GSIC[default/default-1458791335551472059] started ... 2016/03/24 09:18:55 limit=1,chsize=256; received 1 items; took 13.261949ms 2016/03/24 09:18:56 limit=1000,chsize=256; received 1000 items; took 64.370459ms 2016-03-24T09:18:59.263+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification 2016-03-24T09:18:59.281+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh. 2016-03-24T09:18:59.281+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106] 2016/03/24 09:18:59 limit=1000,chsize=256; received 1000 items; took 1.151895249s 2016-03-24T09:19:00.786+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ... 2016-03-24T09:19:04.264+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification 2016-03-24T09:19:04.287+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh. 2016-03-24T09:19:04.287+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106] Scan error: backfill exceeded limit 1, 4 - cause: backfill exceeded limit 1, 4 Scan error: backfill exceeded limit 1, 4 - cause: backfill exceeded limit 1, 4 2016/03/24 09:19:14 limit=1000,chsize=256; received 685 items; took 13.846502968s 2016/03/24 09:19:14 limit=1000,chsize=256; received 685 items; took 13.896327415s --- PASS: TestBufferedScan_BackfillEnabled (20.13s) FAIL exit status 1 FAIL github.com/couchbase/indexing/secondary/tests/functionaltests 3745.065s 2016/03/24 09:19:19 In init() 2016/03/24 09:19:19 Using forestdb for creating indexes 2016/03/24 09:19:19 Changing config key indexer.settings.storage_mode to value forestdb 2016/03/24 09:19:19 Type of settings value is string 2016/03/24 09:19:19 Type of config value that was updated is string 2016/03/24 09:19:19 After updation, Setting is indexer.settings.storage_mode = forestdb 2016/03/24 09:19:19 Settings updated indexer.settings.storage_mode = forestdb === RUN TestRangeWithConcurrentAddMuts 2016/03/24 09:19:24 In TestRangeWithConcurrentAddMuts() 2016/03/24 09:19:24 In DropAllSecondaryIndexes() 2016/03/24 09:19:25 Dropped index companyidx 2016/03/24 09:19:25 Generating JSON docs 2016/03/24 09:19:25 Setting initial JSON docs in KV 2016/03/24 09:19:26 All indexers are active 2016/03/24 09:19:26 Creating a 2i 2016/03/24 09:19:32 Created the secondary index index_company. Waiting for it become active 2016/03/24 09:19:32 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:19:32 Index is now active 2016/03/24 09:19:32 PERFSTAT CreateAndBuildIndex 6.4235 seconds 2016/03/24 09:19:32 In Range Scan 2016/03/24 09:19:32 CreateDocs:: Creating mutations 2016/03/24 09:19:32 PERFSTAT Range 0.0204 seconds 2016/03/24 09:19:32 Range Scan of 1000 user documents took 20.461849ms 2016/03/24 09:19:32 PERFSTAT Range 0.0046 seconds 2016/03/24 09:19:32 Range Scan of 1000 user documents took 4.674072ms 2016/03/24 09:19:34 PERFSTAT Range 1.4768 seconds 2016/03/24 09:19:34 Range Scan of 1900 user documents took 1.478237769s 2016/03/24 09:19:34 PERFSTAT Range 0.0046 seconds 2016/03/24 09:19:34 Range Scan of 1900 user documents took 4.699108ms 2016/03/24 09:19:35 PERFSTAT Range 1.2803 seconds 2016/03/24 09:19:35 Range Scan of 2700 user documents took 1.280445911s 2016/03/24 09:19:37 PERFSTAT Range 1.8342 seconds 2016/03/24 09:19:37 Range Scan of 3900 user documents took 1.834209741s 2016/03/24 09:19:37 PERFSTAT Range 0.6601 seconds 2016/03/24 09:19:37 Range Scan of 4300 user documents took 660.116101ms 2016/03/24 09:19:37 PERFSTAT Range 0.0038 seconds 2016/03/24 09:19:37 Range Scan of 4300 user documents took 3.797025ms 2016/03/24 09:19:39 PERFSTAT Range 1.7291 seconds 2016/03/24 09:19:39 Range Scan of 5400 user documents took 1.729158734s 2016/03/24 09:19:39 PERFSTAT Range 0.1274 seconds 2016/03/24 09:19:39 Range Scan of 5500 user documents took 127.438591ms 2016/03/24 09:19:39 PERFSTAT Range 0.0159 seconds 2016/03/24 09:19:39 Range Scan of 5500 user documents took 15.908034ms 2016/03/24 09:19:41 PERFSTAT Range 1.5686 seconds 2016/03/24 09:19:41 Range Scan of 6500 user documents took 1.568721346s 2016/03/24 09:19:42 PERFSTAT Range 1.1962 seconds 2016/03/24 09:19:42 Range Scan of 7300 user documents took 1.196235352s 2016/03/24 09:19:44 PERFSTAT Range 1.5275 seconds 2016/03/24 09:19:44 Range Scan of 8300 user documents took 1.527876849s 2016/03/24 09:19:47 PERFSTAT Range 3.0908 seconds 2016/03/24 09:19:47 Range Scan of 10300 user documents took 3.090909739s 2016/03/24 09:19:49 PERFSTAT Range 2.6756 seconds 2016/03/24 09:19:49 Range Scan of 11900 user documents took 2.675731102s 2016/03/24 09:19:49 PERFSTAT Range 0.0048 seconds 2016/03/24 09:19:49 Range Scan of 11900 user documents took 4.785489ms 2016/03/24 09:19:51 PERFSTAT Range 1.2526 seconds 2016/03/24 09:19:51 Range Scan of 12700 user documents took 1.252900639s 2016/03/24 09:19:51 PERFSTAT Range 0.0256 seconds 2016/03/24 09:19:51 Range Scan of 12700 user documents took 25.614503ms 2016/03/24 09:19:51 PERFSTAT Range 0.0043 seconds 2016/03/24 09:19:51 Range Scan of 12700 user documents took 4.378967ms 2016/03/24 09:19:51 PERFSTAT Range 0.0037 seconds 2016/03/24 09:19:51 Range Scan of 12700 user documents took 3.760181ms 2016/03/24 09:19:51 PERFSTAT Range 0.4205 seconds 2016/03/24 09:19:51 Range Scan of 13000 user documents took 420.543031ms 2016/03/24 09:19:51 PERFSTAT Range 0.0039 seconds 2016/03/24 09:19:51 Range Scan of 13000 user documents took 3.928983ms 2016/03/24 09:19:51 PERFSTAT Range 0.1920 seconds 2016/03/24 09:19:51 Range Scan of 13100 user documents took 192.034014ms 2016/03/24 09:19:51 PERFSTAT Range 0.1343 seconds 2016/03/24 09:19:51 Range Scan of 13200 user documents took 134.350441ms 2016/03/24 09:19:53 PERFSTAT Range 1.5229 seconds 2016/03/24 09:19:53 Range Scan of 14100 user documents took 1.522967536s 2016/03/24 09:19:55 PERFSTAT Range 2.2914 seconds 2016/03/24 09:19:55 Range Scan of 15700 user documents took 2.291483988s 2016/03/24 09:19:55 PERFSTAT Range 0.0038 seconds 2016/03/24 09:19:55 Range Scan of 15700 user documents took 3.858192ms 2016/03/24 09:19:55 PERFSTAT Range 0.0037 seconds 2016/03/24 09:19:55 Range Scan of 15700 user documents took 3.756549ms 2016/03/24 09:19:55 PERFSTAT Range 0.0184 seconds 2016/03/24 09:19:55 Range Scan of 15700 user documents took 18.467059ms 2016/03/24 09:19:56 PERFSTAT Range 0.9190 seconds 2016/03/24 09:19:56 Range Scan of 16300 user documents took 919.077611ms 2016/03/24 09:19:56 PERFSTAT Range 0.0043 seconds 2016/03/24 09:19:56 Range Scan of 16300 user documents took 4.282613ms 2016/03/24 09:19:58 PERFSTAT Range 1.9609 seconds 2016/03/24 09:19:58 Range Scan of 17400 user documents took 1.960982433s 2016/03/24 09:20:00 PERFSTAT Range 1.9735 seconds 2016/03/24 09:20:00 Range Scan of 18400 user documents took 1.973596275s 2016/03/24 09:20:05 PERFSTAT Range 4.5073 seconds 2016/03/24 09:20:05 Range Scan of 20900 user documents took 4.510965042s 2016/03/24 09:20:05 PERFSTAT Range 0.0040 seconds 2016/03/24 09:20:05 Range Scan of 20900 user documents took 4.035325ms 2016/03/24 09:20:06 PERFSTAT Range 1.0638 seconds 2016/03/24 09:20:06 Range Scan of 21600 user documents took 1.063811283s 2016/03/24 09:20:09 PERFSTAT Range 3.2186 seconds 2016/03/24 09:20:09 Range Scan of 23500 user documents took 3.218684867s 2016/03/24 09:20:09 PERFSTAT Range 0.0051 seconds 2016/03/24 09:20:09 Range Scan of 23500 user documents took 5.20214ms 2016/03/24 09:20:09 PERFSTAT Range 0.0045 seconds 2016/03/24 09:20:09 Range Scan of 23500 user documents took 4.517941ms 2016/03/24 09:20:10 PERFSTAT Range 0.9329 seconds 2016/03/24 09:20:10 Range Scan of 24100 user documents took 932.977784ms 2016/03/24 09:20:10 PERFSTAT Range 0.0038 seconds 2016/03/24 09:20:10 Range Scan of 24100 user documents took 3.844054ms 2016/03/24 09:20:10 PERFSTAT Range 0.0068 seconds 2016/03/24 09:20:10 Range Scan of 24100 user documents took 6.829154ms 2016/03/24 09:20:14 PERFSTAT Range 4.4430 seconds 2016/03/24 09:20:14 Range Scan of 26800 user documents took 4.44300644s 2016/03/24 09:20:14 PERFSTAT Range 0.0041 seconds 2016/03/24 09:20:14 Range Scan of 26800 user documents took 4.118118ms 2016/03/24 09:20:14 PERFSTAT Range 0.0065 seconds 2016/03/24 09:20:14 Range Scan of 26800 user documents took 6.547555ms 2016/03/24 09:20:15 PERFSTAT Range 0.4962 seconds 2016/03/24 09:20:15 Range Scan of 27100 user documents took 496.206213ms 2016/03/24 09:20:17 PERFSTAT Range 2.1997 seconds 2016/03/24 09:20:17 Range Scan of 28300 user documents took 2.200007318s 2016/03/24 09:20:17 PERFSTAT Range 0.0038 seconds 2016/03/24 09:20:17 Range Scan of 28300 user documents took 3.826296ms 2016/03/24 09:20:19 PERFSTAT Range 1.6043 seconds 2016/03/24 09:20:19 Range Scan of 29200 user documents took 1.604377726s 2016/03/24 09:20:21 PERFSTAT Range 2.7249 seconds 2016/03/24 09:20:21 Range Scan of 31000 user documents took 2.725602459s 2016/03/24 09:20:22 PERFSTAT Range 0.9350 seconds 2016/03/24 09:20:22 Range Scan of 31600 user documents took 935.025957ms 2016/03/24 09:20:26 PERFSTAT Range 3.8285 seconds 2016/03/24 09:20:26 Range Scan of 34100 user documents took 3.828535563s 2016/03/24 09:20:26 PERFSTAT Range 0.0038 seconds 2016/03/24 09:20:26 Range Scan of 34100 user documents took 3.814031ms 2016/03/24 09:20:30 PERFSTAT Range 3.7716 seconds 2016/03/24 09:20:30 Range Scan of 36400 user documents took 3.771686728s 2016/03/24 09:20:30 PERFSTAT Range 0.0171 seconds 2016/03/24 09:20:30 Range Scan of 36400 user documents took 17.16335ms 2016/03/24 09:20:31 PERFSTAT Range 1.4286 seconds 2016/03/24 09:20:31 Range Scan of 37400 user documents took 1.428899746s 2016/03/24 09:20:33 PERFSTAT Range 2.1324 seconds 2016/03/24 09:20:33 Range Scan of 38700 user documents took 2.133287072s 2016/03/24 09:20:34 PERFSTAT Range 0.1532 seconds 2016/03/24 09:20:34 Range Scan of 38800 user documents took 153.22906ms 2016/03/24 09:20:34 PERFSTAT Range 0.0058 seconds 2016/03/24 09:20:34 Range Scan of 38800 user documents took 5.813218ms 2016/03/24 09:20:34 PERFSTAT Range 0.0192 seconds 2016/03/24 09:20:34 Range Scan of 38800 user documents took 19.217531ms 2016/03/24 09:20:34 PERFSTAT Range 0.8382 seconds 2016/03/24 09:20:34 Range Scan of 39400 user documents took 838.267765ms 2016/03/24 09:20:35 PERFSTAT Range 0.1538 seconds 2016/03/24 09:20:35 Range Scan of 39400 user documents took 153.808456ms 2016/03/24 09:20:35 PERFSTAT Range 0.0043 seconds 2016/03/24 09:20:35 Range Scan of 39400 user documents took 4.364839ms 2016/03/24 09:20:37 PERFSTAT Range 2.4921 seconds 2016/03/24 09:20:37 Range Scan of 41200 user documents took 2.492167292s 2016/03/24 09:20:37 PERFSTAT Range 0.0146 seconds 2016/03/24 09:20:37 Range Scan of 41200 user documents took 14.657307ms 2016/03/24 09:20:37 PERFSTAT Range 0.1003 seconds 2016/03/24 09:20:37 Range Scan of 41300 user documents took 100.356024ms 2016/03/24 09:20:37 PERFSTAT Range 0.0044 seconds 2016/03/24 09:20:37 Range Scan of 41300 user documents took 4.494648ms 2016/03/24 09:20:37 PERFSTAT Range 0.1430 seconds 2016/03/24 09:20:37 Range Scan of 41400 user documents took 143.051656ms 2016/03/24 09:20:37 PERFSTAT Range 0.0207 seconds 2016/03/24 09:20:37 Range Scan of 41400 user documents took 20.730005ms 2016/03/24 09:20:40 PERFSTAT Range 2.8927 seconds 2016/03/24 09:20:40 Range Scan of 43200 user documents took 2.892721536s 2016/03/24 09:20:42 PERFSTAT Range 1.2335 seconds 2016/03/24 09:20:42 Range Scan of 44000 user documents took 1.246675678s 2016/03/24 09:20:43 PERFSTAT Range 1.0141 seconds 2016/03/24 09:20:43 Range Scan of 44600 user documents took 1.014209117s 2016/03/24 09:20:43 PERFSTAT Range 0.1822 seconds 2016/03/24 09:20:43 Range Scan of 44700 user documents took 182.245155ms 2016/03/24 09:20:43 PERFSTAT Range 0.6506 seconds 2016/03/24 09:20:43 Range Scan of 45200 user documents took 650.727533ms 2016/03/24 09:20:43 PERFSTAT Range 0.0087 seconds 2016/03/24 09:20:43 Range Scan of 45200 user documents took 8.760038ms 2016/03/24 09:20:43 PERFSTAT Range 0.0041 seconds 2016/03/24 09:20:43 Range Scan of 45200 user documents took 4.170987ms 2016/03/24 09:20:43 PERFSTAT Range 0.0040 seconds 2016/03/24 09:20:43 Range Scan of 45200 user documents took 4.07777ms 2016/03/24 09:20:44 PERFSTAT Range 0.6935 seconds 2016/03/24 09:20:44 Range Scan of 45700 user documents took 693.571169ms 2016/03/24 09:20:46 PERFSTAT Range 1.6592 seconds 2016/03/24 09:20:46 Range Scan of 46700 user documents took 1.659283041s 2016/03/24 09:20:49 PERFSTAT Range 3.6962 seconds 2016/03/24 09:20:49 Range Scan of 49300 user documents took 3.696266432s 2016/03/24 09:20:49 PERFSTAT Range 0.0053 seconds 2016/03/24 09:20:49 Range Scan of 49300 user documents took 5.359455ms 2016/03/24 09:20:52 PERFSTAT Range 2.1068 seconds 2016/03/24 09:20:52 Range Scan of 50600 user documents took 2.106821253s 2016/03/24 09:20:55 PERFSTAT Range 3.7079 seconds 2016/03/24 09:20:55 Range Scan of 52900 user documents took 3.708236996s 2016/03/24 09:20:56 PERFSTAT Range 0.5512 seconds 2016/03/24 09:20:56 Range Scan of 53200 user documents took 551.333355ms 2016/03/24 09:20:56 PERFSTAT Range 0.0037 seconds 2016/03/24 09:20:56 Range Scan of 53200 user documents took 3.816639ms 2016/03/24 09:20:56 PERFSTAT Range 0.0086 seconds 2016/03/24 09:20:56 Range Scan of 53200 user documents took 8.67151ms 2016/03/24 09:20:58 PERFSTAT Range 2.1493 seconds 2016/03/24 09:20:58 Range Scan of 54400 user documents took 2.149310913s 2016/03/24 09:20:59 PERFSTAT Range 0.9491 seconds 2016/03/24 09:20:59 Range Scan of 55000 user documents took 949.140213ms 2016/03/24 09:20:59 PERFSTAT Range 0.0585 seconds 2016/03/24 09:20:59 Range Scan of 55000 user documents took 58.560654ms 2016/03/24 09:21:01 PERFSTAT Range 2.3823 seconds 2016/03/24 09:21:01 Range Scan of 56300 user documents took 2.382341415s 2016/03/24 09:21:03 PERFSTAT Range 2.0646 seconds 2016/03/24 09:21:03 Range Scan of 57500 user documents took 2.064704406s 2016/03/24 09:21:04 PERFSTAT Range 0.1457 seconds 2016/03/24 09:21:04 Range Scan of 57600 user documents took 145.782063ms 2016/03/24 09:21:04 PERFSTAT Range 0.0771 seconds 2016/03/24 09:21:04 Range Scan of 57600 user documents took 77.1118ms 2016/03/24 09:21:04 PERFSTAT Range 0.0061 seconds 2016/03/24 09:21:04 Range Scan of 57600 user documents took 6.144003ms 2016/03/24 09:21:04 PERFSTAT Range 0.0235 seconds 2016/03/24 09:21:04 Range Scan of 57700 user documents took 23.489023ms 2016/03/24 09:21:06 PERFSTAT Range 2.1490 seconds 2016/03/24 09:21:06 Range Scan of 58900 user documents took 2.149015211s 2016/03/24 09:21:06 PERFSTAT Range 0.0082 seconds 2016/03/24 09:21:06 Range Scan of 58900 user documents took 8.237123ms 2016/03/24 09:21:06 PERFSTAT Range 0.2251 seconds 2016/03/24 09:21:06 Range Scan of 59000 user documents took 225.190842ms 2016/03/24 09:21:06 PERFSTAT Range 0.0127 seconds 2016/03/24 09:21:06 Range Scan of 59100 user documents took 12.817784ms 2016/03/24 09:21:08 PERFSTAT Range 1.6235 seconds 2016/03/24 09:21:08 Range Scan of 60000 user documents took 1.6235105s 2016/03/24 09:21:08 PERFSTAT Range 0.0126 seconds 2016/03/24 09:21:08 Range Scan of 60000 user documents took 12.665849ms 2016/03/24 09:21:11 PERFSTAT Range 3.6265 seconds 2016/03/24 09:21:11 Range Scan of 62000 user documents took 3.626575127s 2016/03/24 09:21:12 PERFSTAT Range 0.8196 seconds 2016/03/24 09:21:12 Range Scan of 62400 user documents took 819.669773ms 2016/03/24 09:21:13 PERFSTAT Range 1.0183 seconds 2016/03/24 09:21:13 Range Scan of 63100 user documents took 1.018314055s 2016/03/24 09:21:17 PERFSTAT Range 3.8953 seconds 2016/03/24 09:21:17 Range Scan of 65300 user documents took 3.895363514s 2016/03/24 09:21:17 PERFSTAT Range 0.1635 seconds 2016/03/24 09:21:17 Range Scan of 65400 user documents took 163.572208ms 2016/03/24 09:21:20 PERFSTAT Range 2.8257 seconds 2016/03/24 09:21:20 Range Scan of 67200 user documents took 2.825714462s 2016/03/24 09:21:20 PERFSTAT Range 0.0079 seconds 2016/03/24 09:21:20 Range Scan of 67200 user documents took 7.962199ms 2016/03/24 09:21:20 PERFSTAT Range 0.0059 seconds 2016/03/24 09:21:20 Range Scan of 67200 user documents took 5.914507ms 2016/03/24 09:21:20 PERFSTAT Range 0.3765 seconds 2016/03/24 09:21:20 Range Scan of 67300 user documents took 376.551946ms 2016/03/24 09:21:23 PERFSTAT Range 2.7176 seconds 2016/03/24 09:21:23 Range Scan of 68800 user documents took 2.717650372s 2016/03/24 09:21:27 PERFSTAT Range 4.0981 seconds 2016/03/24 09:21:27 Range Scan of 71400 user documents took 4.098180446s 2016/03/24 09:21:32 PERFSTAT Range 4.8950 seconds 2016/03/24 09:21:32 Range Scan of 74500 user documents took 4.89508112s --- PASS: TestRangeWithConcurrentAddMuts (127.71s) === RUN TestRangeWithConcurrentDelMuts 2016/03/24 09:21:32 In TestRangeWithConcurrentDelMuts() 2016/03/24 09:21:32 Generating JSON docs 2016/03/24 09:21:35 Setting initial JSON docs in KV 2016/03/24 09:21:56 All indexers are active 2016/03/24 09:21:56 Creating a 2i 2016/03/24 09:21:56 Index found: index_company 2016/03/24 09:21:56 In Range Scan 2016/03/24 09:21:56 CreateDocs:: Delete mutations 2016/03/24 09:21:59 PERFSTAT Range 3.0302 seconds 2016/03/24 09:21:59 Range Scan of 29760 user documents took 3.030274264s 2016/03/24 09:21:59 PERFSTAT Range 0.5314 seconds 2016/03/24 09:21:59 Range Scan of 29715 user documents took 531.414405ms 2016/03/24 09:21:59 PERFSTAT Range 0.0233 seconds 2016/03/24 09:21:59 Range Scan of 29715 user documents took 23.445091ms 2016/03/24 09:21:59 PERFSTAT Range 0.1436 seconds 2016/03/24 09:21:59 Range Scan of 29700 user documents took 143.662656ms 2016/03/24 09:22:00 PERFSTAT Range 0.7605 seconds 2016/03/24 09:22:00 Range Scan of 29655 user documents took 760.506028ms 2016/03/24 09:22:03 PERFSTAT Range 2.5112 seconds 2016/03/24 09:22:03 Range Scan of 29455 user documents took 2.511315269s 2016/03/24 09:22:03 PERFSTAT Range 0.0087 seconds 2016/03/24 09:22:03 Range Scan of 29450 user documents took 8.697632ms 2016/03/24 09:22:07 PERFSTAT Range 4.6582 seconds 2016/03/24 09:22:07 Range Scan of 29115 user documents took 4.658293463s 2016/03/24 09:22:07 PERFSTAT Range 0.0092 seconds 2016/03/24 09:22:07 Range Scan of 29115 user documents took 9.208362ms 2016/03/24 09:22:07 PERFSTAT Range 0.0069 seconds 2016/03/24 09:22:07 Range Scan of 29115 user documents took 6.972794ms 2016/03/24 09:22:07 PERFSTAT Range 0.0050 seconds 2016/03/24 09:22:07 Range Scan of 29115 user documents took 5.079652ms 2016/03/24 09:22:07 PERFSTAT Range 0.0756 seconds 2016/03/24 09:22:07 Range Scan of 29105 user documents took 75.639148ms 2016/03/24 09:22:10 PERFSTAT Range 2.9281 seconds 2016/03/24 09:22:10 Range Scan of 28880 user documents took 2.928170982s 2016/03/24 09:22:10 PERFSTAT Range 0.0049 seconds 2016/03/24 09:22:10 Range Scan of 28875 user documents took 4.933372ms 2016/03/24 09:22:11 PERFSTAT Range 0.8255 seconds 2016/03/24 09:22:11 Range Scan of 28810 user documents took 825.523264ms 2016/03/24 09:22:11 PERFSTAT Range 0.0064 seconds 2016/03/24 09:22:11 Range Scan of 28810 user documents took 6.452069ms 2016/03/24 09:22:14 PERFSTAT Range 2.8674 seconds 2016/03/24 09:22:14 Range Scan of 28550 user documents took 2.86740449s 2016/03/24 09:22:17 PERFSTAT Range 2.6178 seconds 2016/03/24 09:22:17 Range Scan of 28335 user documents took 2.617826255s 2016/03/24 09:22:17 PERFSTAT Range 0.0043 seconds 2016/03/24 09:22:17 Range Scan of 28335 user documents took 4.352675ms 2016/03/24 09:22:17 PERFSTAT Range 0.0944 seconds 2016/03/24 09:22:17 Range Scan of 28330 user documents took 94.464623ms 2016/03/24 09:22:17 PERFSTAT Range 0.0041 seconds 2016/03/24 09:22:17 Range Scan of 28330 user documents took 4.131941ms 2016/03/24 09:22:17 PERFSTAT Range 0.0044 seconds 2016/03/24 09:22:17 Range Scan of 28330 user documents took 4.401643ms 2016/03/24 09:22:17 PERFSTAT Range 0.0046 seconds 2016/03/24 09:22:17 Range Scan of 28330 user documents took 4.650222ms 2016/03/24 09:22:18 PERFSTAT Range 1.5723 seconds 2016/03/24 09:22:18 Range Scan of 28225 user documents took 1.572332899s 2016/03/24 09:22:18 PERFSTAT Range 0.0038 seconds 2016/03/24 09:22:18 Range Scan of 28225 user documents took 3.841819ms 2016/03/24 09:22:22 PERFSTAT Range 3.6379 seconds 2016/03/24 09:22:22 Range Scan of 27910 user documents took 3.637918703s 2016/03/24 09:22:22 PERFSTAT Range 0.0079 seconds 2016/03/24 09:22:22 Range Scan of 27910 user documents took 7.972303ms 2016/03/24 09:22:26 PERFSTAT Range 3.5536 seconds 2016/03/24 09:22:26 Range Scan of 27565 user documents took 3.553674866s 2016/03/24 09:22:26 PERFSTAT Range 0.0040 seconds 2016/03/24 09:22:26 Range Scan of 27565 user documents took 4.003213ms 2016/03/24 09:22:27 PERFSTAT Range 1.2254 seconds 2016/03/24 09:22:27 Range Scan of 27450 user documents took 1.225457483s 2016/03/24 09:22:31 PERFSTAT Range 4.0490 seconds 2016/03/24 09:22:31 Range Scan of 27090 user documents took 4.049077609s 2016/03/24 09:22:34 PERFSTAT Range 3.5477 seconds 2016/03/24 09:22:34 Range Scan of 26760 user documents took 3.547726463s 2016/03/24 09:22:37 PERFSTAT Range 2.6781 seconds 2016/03/24 09:22:37 Range Scan of 26505 user documents took 2.678093576s 2016/03/24 09:22:37 PERFSTAT Range 0.0038 seconds 2016/03/24 09:22:37 Range Scan of 26505 user documents took 3.846055ms 2016/03/24 09:22:39 PERFSTAT Range 2.3352 seconds 2016/03/24 09:22:39 Range Scan of 26310 user documents took 2.335351211s 2016/03/24 09:22:40 PERFSTAT Range 0.0248 seconds 2016/03/24 09:22:40 Range Scan of 26305 user documents took 24.796966ms 2016/03/24 09:22:40 PERFSTAT Range 0.0043 seconds 2016/03/24 09:22:40 Range Scan of 26305 user documents took 4.336166ms 2016/03/24 09:22:40 PERFSTAT Range 0.7606 seconds 2016/03/24 09:22:40 Range Scan of 26260 user documents took 766.68444ms 2016/03/24 09:22:40 PERFSTAT Range 0.0043 seconds 2016/03/24 09:22:40 Range Scan of 26260 user documents took 4.366146ms 2016/03/24 09:22:42 PERFSTAT Range 2.1214 seconds 2016/03/24 09:22:42 Range Scan of 26080 user documents took 2.121487126s 2016/03/24 09:22:42 PERFSTAT Range 0.0059 seconds 2016/03/24 09:22:42 Range Scan of 26080 user documents took 5.922164ms 2016/03/24 09:22:42 PERFSTAT Range 0.0065 seconds 2016/03/24 09:22:42 Range Scan of 26075 user documents took 6.554747ms 2016/03/24 09:22:42 PERFSTAT Range 0.0050 seconds 2016/03/24 09:22:42 Range Scan of 26075 user documents took 5.078419ms 2016/03/24 09:22:42 PERFSTAT Range 0.0054 seconds 2016/03/24 09:22:42 Range Scan of 26075 user documents took 5.474045ms 2016/03/24 09:22:42 PERFSTAT Range 0.0077 seconds 2016/03/24 09:22:42 Range Scan of 26075 user documents took 7.75049ms 2016/03/24 09:22:45 PERFSTAT Range 2.4545 seconds 2016/03/24 09:22:45 Range Scan of 25860 user documents took 2.454549857s 2016/03/24 09:22:47 PERFSTAT Range 2.3879 seconds 2016/03/24 09:22:47 Range Scan of 25645 user documents took 2.38794584s 2016/03/24 09:22:51 PERFSTAT Range 3.5564 seconds 2016/03/24 09:22:51 Range Scan of 25335 user documents took 3.556527067s 2016/03/24 09:22:53 PERFSTAT Range 2.1054 seconds 2016/03/24 09:22:53 Range Scan of 25140 user documents took 2.10542408s 2016/03/24 09:22:56 PERFSTAT Range 2.9540 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 2.954065203s 2016/03/24 09:22:56 PERFSTAT Range 0.0042 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 4.228703ms 2016/03/24 09:22:56 PERFSTAT Range 0.0076 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 7.589272ms 2016/03/24 09:22:56 PERFSTAT Range 0.0091 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 9.174573ms 2016/03/24 09:22:56 PERFSTAT Range 0.0096 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 9.655131ms 2016/03/24 09:22:56 PERFSTAT Range 0.0045 seconds 2016/03/24 09:22:56 Range Scan of 24870 user documents took 4.495703ms 2016/03/24 09:22:58 PERFSTAT Range 2.0629 seconds 2016/03/24 09:22:58 Range Scan of 24700 user documents took 2.063217985s 2016/03/24 09:22:58 PERFSTAT Range 0.0374 seconds 2016/03/24 09:22:58 Range Scan of 24695 user documents took 37.459082ms 2016/03/24 09:22:58 PERFSTAT Range 0.3864 seconds 2016/03/24 09:22:58 Range Scan of 24665 user documents took 386.40174ms 2016/03/24 09:22:58 PERFSTAT Range 0.0040 seconds 2016/03/24 09:22:58 Range Scan of 24665 user documents took 4.06037ms 2016/03/24 09:23:00 PERFSTAT Range 1.7066 seconds 2016/03/24 09:23:00 Range Scan of 24535 user documents took 1.706630343s 2016/03/24 09:23:00 PERFSTAT Range 0.0072 seconds 2016/03/24 09:23:00 Range Scan of 24530 user documents took 7.194585ms 2016/03/24 09:23:00 PERFSTAT Range 0.0039 seconds 2016/03/24 09:23:00 Range Scan of 24530 user documents took 3.977651ms 2016/03/24 09:23:04 PERFSTAT Range 3.3924 seconds 2016/03/24 09:23:04 Range Scan of 24245 user documents took 3.392650884s 2016/03/24 09:23:04 PERFSTAT Range 0.0046 seconds 2016/03/24 09:23:04 Range Scan of 24245 user documents took 4.687292ms 2016/03/24 09:23:04 PERFSTAT Range 0.1442 seconds 2016/03/24 09:23:04 Range Scan of 24230 user documents took 144.23267ms 2016/03/24 09:23:04 PERFSTAT Range 0.0080 seconds 2016/03/24 09:23:04 Range Scan of 24230 user documents took 8.021064ms 2016/03/24 09:23:06 PERFSTAT Range 2.6813 seconds 2016/03/24 09:23:06 Range Scan of 23995 user documents took 2.681339942s 2016/03/24 09:23:12 PERFSTAT Range 6.1093 seconds 2016/03/24 09:23:12 Range Scan of 23425 user documents took 6.109365459s 2016/03/24 09:23:16 PERFSTAT Range 3.2964 seconds 2016/03/24 09:23:16 Range Scan of 23170 user documents took 3.296450323s 2016/03/24 09:23:18 PERFSTAT Range 2.1868 seconds 2016/03/24 09:23:18 Range Scan of 22980 user documents took 2.186870513s 2016/03/24 09:23:18 PERFSTAT Range 0.1184 seconds 2016/03/24 09:23:18 Range Scan of 22975 user documents took 118.44502ms 2016/03/24 09:23:20 PERFSTAT Range 1.8524 seconds 2016/03/24 09:23:20 Range Scan of 22805 user documents took 1.852511473s 2016/03/24 09:23:25 PERFSTAT Range 5.1850 seconds 2016/03/24 09:23:25 Range Scan of 22400 user documents took 5.185001844s 2016/03/24 09:23:31 PERFSTAT Range 5.8295 seconds 2016/03/24 09:23:31 Range Scan of 21920 user documents took 5.829553529s 2016/03/24 09:23:32 PERFSTAT Range 1.0187 seconds 2016/03/24 09:23:32 Range Scan of 21830 user documents took 1.018765379s 2016/03/24 09:23:36 PERFSTAT Range 3.6309 seconds 2016/03/24 09:23:36 Range Scan of 21510 user documents took 3.630951397s 2016/03/24 09:23:36 PERFSTAT Range 0.0067 seconds 2016/03/24 09:23:36 Range Scan of 21510 user documents took 6.785951ms 2016/03/24 09:23:36 PERFSTAT Range 0.0092 seconds 2016/03/24 09:23:36 Range Scan of 21510 user documents took 9.250728ms 2016/03/24 09:23:41 PERFSTAT Range 5.3658 seconds 2016/03/24 09:23:41 Range Scan of 21015 user documents took 5.366028818s 2016/03/24 09:23:41 PERFSTAT Range 0.0629 seconds 2016/03/24 09:23:41 Range Scan of 21010 user documents took 62.939363ms 2016/03/24 09:23:41 PERFSTAT Range 0.0057 seconds 2016/03/24 09:23:41 Range Scan of 21010 user documents took 5.709244ms 2016/03/24 09:23:41 PERFSTAT Range 0.0069 seconds 2016/03/24 09:23:41 Range Scan of 21010 user documents took 6.947747ms 2016/03/24 09:23:43 PERFSTAT Range 2.1809 seconds 2016/03/24 09:23:43 Range Scan of 20820 user documents took 2.18093428s 2016/03/24 09:23:43 PERFSTAT Range 0.0037 seconds 2016/03/24 09:23:43 Range Scan of 20820 user documents took 3.699274ms 2016/03/24 09:23:43 PERFSTAT Range 0.0091 seconds 2016/03/24 09:23:43 Range Scan of 20815 user documents took 9.125292ms 2016/03/24 09:23:45 PERFSTAT Range 1.3023 seconds 2016/03/24 09:23:45 Range Scan of 20700 user documents took 1.302339569s 2016/03/24 09:23:45 PERFSTAT Range 0.0073 seconds 2016/03/24 09:23:45 Range Scan of 20700 user documents took 7.341602ms 2016/03/24 09:23:45 PERFSTAT Range 0.0119 seconds 2016/03/24 09:23:45 Range Scan of 20700 user documents took 11.965673ms 2016/03/24 09:23:45 PERFSTAT Range 0.0094 seconds 2016/03/24 09:23:45 Range Scan of 20700 user documents took 9.437579ms 2016/03/24 09:23:45 PERFSTAT Range 0.8687 seconds 2016/03/24 09:23:45 Range Scan of 20630 user documents took 868.788914ms 2016/03/24 09:23:45 PERFSTAT Range 0.0042 seconds 2016/03/24 09:23:45 Range Scan of 20630 user documents took 4.209812ms 2016/03/24 09:23:51 PERFSTAT Range 5.6197 seconds 2016/03/24 09:23:51 Range Scan of 20145 user documents took 5.619696158s 2016/03/24 09:23:53 PERFSTAT Range 1.8004 seconds 2016/03/24 09:23:53 Range Scan of 19965 user documents took 1.800456945s 2016/03/24 09:23:53 PERFSTAT Range 0.0044 seconds 2016/03/24 09:23:53 Range Scan of 19965 user documents took 4.452198ms 2016/03/24 09:23:53 PERFSTAT Range 0.0050 seconds 2016/03/24 09:23:53 Range Scan of 19965 user documents took 5.074633ms 2016/03/24 09:23:53 PERFSTAT Range 0.0111 seconds 2016/03/24 09:23:53 Range Scan of 19965 user documents took 11.113693ms 2016/03/24 09:23:56 PERFSTAT Range 3.0053 seconds 2016/03/24 09:23:56 Range Scan of 19700 user documents took 3.005438693s --- PASS: TestRangeWithConcurrentDelMuts (143.70s) === RUN TestScanWithConcurrentIndexOps 2016/03/24 09:23:56 In TestScanWithConcurrentIndexOps() 2016/03/24 09:23:56 Generating JSON docs 2016/03/24 09:24:04 Setting initial JSON docs in KV 2016/03/24 09:25:18 All indexers are active 2016/03/24 09:25:18 Creating a 2i 2016/03/24 09:25:18 Index found: index_company 2016/03/24 09:25:18 In Range Scan 2016/03/24 09:25:18 Create and Drop index operations 2016/03/24 09:25:18 PERFSTAT Range 0.0065 seconds 2016/03/24 09:25:18 Range Scan of 100000 user documents took 6.557326ms 2016/03/24 09:25:18 PERFSTAT Range 0.0042 seconds 2016/03/24 09:25:18 Range Scan of 100000 user documents took 4.257579ms 2016/03/24 09:25:20 PERFSTAT Range 2.0855 seconds 2016/03/24 09:25:20 Range Scan of 100000 user documents took 2.085558789s 2016/03/24 09:25:20 PERFSTAT Range 0.0187 seconds 2016/03/24 09:25:20 Range Scan of 100000 user documents took 18.764478ms 2016/03/24 09:25:31 PERFSTAT Range 11.0502 seconds 2016/03/24 09:25:31 Range Scan of 100000 user documents took 11.054377608s 2016/03/24 09:25:31 PERFSTAT Range 0.0115 seconds 2016/03/24 09:25:31 Range Scan of 100000 user documents took 11.56561ms 2016/03/24 09:25:36 PERFSTAT Range 4.9127 seconds 2016/03/24 09:25:36 Range Scan of 100000 user documents took 4.912809033s 2016/03/24 09:25:38 PERFSTAT Range 1.4108 seconds 2016/03/24 09:25:38 Range Scan of 100000 user documents took 1.410941062s 2016/03/24 09:25:38 PERFSTAT Range 0.0406 seconds 2016/03/24 09:25:38 Range Scan of 100000 user documents took 40.659508ms 2016/03/24 09:25:38 PERFSTAT Range 0.0212 seconds 2016/03/24 09:25:38 Range Scan of 100000 user documents took 21.302607ms 2016/03/24 09:25:38 PERFSTAT Range 0.0685 seconds 2016/03/24 09:25:38 Range Scan of 100000 user documents took 68.531992ms 2016/03/24 09:25:38 PERFSTAT Range 0.6755 seconds 2016/03/24 09:25:38 Range Scan of 100000 user documents took 675.629177ms 2016/03/24 09:25:40 PERFSTAT Range 1.5957 seconds 2016/03/24 09:25:40 Range Scan of 100000 user documents took 1.595801518s 2016/03/24 09:25:40 PERFSTAT Range 0.0107 seconds 2016/03/24 09:25:40 Range Scan of 100000 user documents took 10.753236ms 2016/03/24 09:25:43 PERFSTAT Range 2.4395 seconds 2016/03/24 09:25:43 Range Scan of 100000 user documents took 2.442329183s 2016/03/24 09:25:43 PERFSTAT Range 0.0044 seconds 2016/03/24 09:25:43 Range Scan of 100000 user documents took 4.457826ms 2016/03/24 09:25:43 PERFSTAT Range 0.0034 seconds 2016/03/24 09:25:43 Range Scan of 100000 user documents took 3.47068ms 2016/03/24 09:25:43 PERFSTAT Range 0.0033 seconds 2016/03/24 09:25:43 Range Scan of 100000 user documents took 3.315244ms 2016/03/24 09:25:43 PERFSTAT Range 0.3542 seconds 2016/03/24 09:25:43 Range Scan of 100000 user documents took 354.229865ms 2016/03/24 09:25:46 PERFSTAT Range 2.8672 seconds 2016/03/24 09:25:46 Range Scan of 100000 user documents took 2.867283871s 2016/03/24 09:25:46 PERFSTAT Range 0.0043 seconds 2016/03/24 09:25:46 Range Scan of 100000 user documents took 4.380027ms 2016/03/24 09:25:48 PERFSTAT Range 2.4483 seconds 2016/03/24 09:25:48 Range Scan of 100000 user documents took 2.448314197s 2016/03/24 09:25:49 PERFSTAT Range 0.3823 seconds 2016/03/24 09:25:49 Range Scan of 100000 user documents took 382.366551ms 2016/03/24 09:25:51 PERFSTAT Range 2.5056 seconds 2016/03/24 09:25:51 Range Scan of 100000 user documents took 2.505701027s 2016/03/24 09:25:51 PERFSTAT Range 0.0045 seconds 2016/03/24 09:25:51 Range Scan of 100000 user documents took 4.53391ms 2016/03/24 09:25:51 PERFSTAT Range 0.0031 seconds 2016/03/24 09:25:51 Range Scan of 100000 user documents took 3.203466ms 2016/03/24 09:25:53 PERFSTAT Range 2.1962 seconds 2016/03/24 09:25:53 Range Scan of 100000 user documents took 2.196268683s 2016/03/24 09:25:53 PERFSTAT Range 0.0033 seconds 2016/03/24 09:25:53 Range Scan of 100000 user documents took 3.348782ms 2016/03/24 09:25:57 PERFSTAT Range 3.9061 seconds 2016/03/24 09:25:57 Range Scan of 100000 user documents took 3.9061532s 2016/03/24 09:25:57 PERFSTAT Range 0.0031 seconds 2016/03/24 09:25:57 Range Scan of 100000 user documents took 3.182226ms 2016/03/24 09:25:57 PERFSTAT Range 0.0044 seconds 2016/03/24 09:25:57 Range Scan of 100000 user documents took 4.40898ms 2016/03/24 09:25:57 PERFSTAT Range 0.0862 seconds 2016/03/24 09:25:57 Range Scan of 100000 user documents took 86.238ms 2016/03/24 09:26:00 PERFSTAT Range 2.4700 seconds 2016/03/24 09:26:00 Range Scan of 100000 user documents took 2.470077024s 2016/03/24 09:26:00 PERFSTAT Range 0.5255 seconds 2016/03/24 09:26:00 Range Scan of 100000 user documents took 525.536632ms 2016/03/24 09:26:02 PERFSTAT Range 1.3824 seconds 2016/03/24 09:26:02 Range Scan of 100000 user documents took 1.382473402s 2016/03/24 09:26:02 Created the secondary index index_age. Waiting for it become active 2016/03/24 09:26:02 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:26:02 Index is now active 2016/03/24 09:26:02 PERFSTAT CreateAndBuildIndex 43.8097 seconds 2016/03/24 09:26:02 PERFSTAT Range 0.7803 seconds 2016/03/24 09:26:02 Range Scan of 100000 user documents took 780.363968ms 2016/03/24 09:26:02 PERFSTAT Range 0.0033 seconds 2016/03/24 09:26:02 Range Scan of 100000 user documents took 3.364334ms 2016/03/24 09:26:02 PERFSTAT Range 0.0031 seconds 2016/03/24 09:26:02 Range Scan of 100000 user documents took 3.100652ms 2016/03/24 09:26:03 PERFSTAT Range 0.0049 seconds 2016/03/24 09:26:04 PERFSTAT Range 1.4120 seconds 2016/03/24 09:26:04 Range Scan of 100000 user documents took 1.412029746s 2016/03/24 09:26:04 PERFSTAT Range 0.0038 seconds 2016/03/24 09:26:04 Range Scan of 100000 user documents took 3.845898ms 2016/03/24 09:26:04 PERFSTAT Range 0.0036 seconds 2016/03/24 09:26:04 Range Scan of 100000 user documents took 3.591791ms 2016/03/24 09:26:04 PERFSTAT Range 0.0029 seconds 2016/03/24 09:26:04 Range Scan of 100000 user documents took 2.97526ms 2016/03/24 09:26:08 PERFSTAT Range 3.6574 seconds 2016/03/24 09:26:08 Range Scan of 100000 user documents took 3.657491257s 2016/03/24 09:26:08 PERFSTAT Range 0.4914 seconds 2016/03/24 09:26:08 Range Scan of 100000 user documents took 491.461221ms 2016/03/24 09:26:08 PERFSTAT Range 0.0040 seconds 2016/03/24 09:26:08 Range Scan of 100000 user documents took 4.057133ms 2016/03/24 09:26:11 PERFSTAT Range 2.4736 seconds 2016/03/24 09:26:11 Range Scan of 100000 user documents took 2.473767068s 2016/03/24 09:26:11 PERFSTAT Range 0.0097 seconds 2016/03/24 09:26:11 Range Scan of 100000 user documents took 9.736806ms 2016/03/24 09:26:11 PERFSTAT Range 0.0168 seconds 2016/03/24 09:26:11 Range Scan of 100000 user documents took 16.817624ms 2016/03/24 09:26:11 PERFSTAT Range 0.0088 seconds 2016/03/24 09:26:11 Range Scan of 100000 user documents took 8.835714ms 2016/03/24 09:26:13 PERFSTAT Range 2.2180 seconds 2016/03/24 09:26:13 Range Scan of 100000 user documents took 2.218022536s 2016/03/24 09:26:16 PERFSTAT Range 2.7682 seconds 2016/03/24 09:26:16 Range Scan of 100000 user documents took 2.768633585s 2016/03/24 09:26:18 PERFSTAT Range 2.7629 seconds 2016/03/24 09:26:18 Range Scan of 100000 user documents took 2.762938232s 2016/03/24 09:26:18 PERFSTAT Range 0.0046 seconds 2016/03/24 09:26:18 Range Scan of 100000 user documents took 4.667553ms 2016/03/24 09:26:18 PERFSTAT Range 0.0045 seconds 2016/03/24 09:26:18 Range Scan of 100000 user documents took 4.582113ms 2016/03/24 09:26:18 PERFSTAT Range 0.0030 seconds 2016/03/24 09:26:18 Range Scan of 100000 user documents took 3.027239ms 2016/03/24 09:26:21 PERFSTAT Range 2.8176 seconds 2016/03/24 09:26:21 Range Scan of 100000 user documents took 2.817660075s 2016/03/24 09:26:23 PERFSTAT Range 1.4393 seconds 2016/03/24 09:26:23 Range Scan of 100000 user documents took 1.439416981s 2016/03/24 09:26:23 PERFSTAT Range 0.0042 seconds 2016/03/24 09:26:23 Range Scan of 100000 user documents took 4.24443ms 2016/03/24 09:26:25 PERFSTAT Range 2.8690 seconds 2016/03/24 09:26:25 Range Scan of 100000 user documents took 2.869096593s 2016/03/24 09:26:28 PERFSTAT Range 2.7161 seconds 2016/03/24 09:26:28 Range Scan of 100000 user documents took 2.716164392s 2016/03/24 09:26:28 PERFSTAT Range 0.0033 seconds 2016/03/24 09:26:28 Range Scan of 100000 user documents took 3.377039ms 2016/03/24 09:26:29 PERFSTAT Range 0.7610 seconds 2016/03/24 09:26:29 Range Scan of 100000 user documents took 761.06271ms 2016/03/24 09:26:31 PERFSTAT Range 2.4797 seconds 2016/03/24 09:26:31 Range Scan of 100000 user documents took 2.479905343s 2016/03/24 09:26:31 PERFSTAT Range 0.0046 seconds 2016/03/24 09:26:31 Range Scan of 100000 user documents took 4.71746ms 2016/03/24 09:26:31 PERFSTAT Range 0.0051 seconds 2016/03/24 09:26:31 Range Scan of 100000 user documents took 5.25366ms 2016/03/24 09:26:31 PERFSTAT Range 0.0070 seconds 2016/03/24 09:26:31 Range Scan of 100000 user documents took 7.019023ms 2016/03/24 09:26:33 PERFSTAT Range 1.3401 seconds 2016/03/24 09:26:33 Range Scan of 100000 user documents took 1.340098326s 2016/03/24 09:26:33 PERFSTAT Range 0.0045 seconds 2016/03/24 09:26:33 Range Scan of 100000 user documents took 4.549286ms 2016/03/24 09:26:33 PERFSTAT Range 0.0585 seconds 2016/03/24 09:26:33 Range Scan of 100000 user documents took 58.507614ms 2016/03/24 09:26:36 PERFSTAT Range 3.1751 seconds 2016/03/24 09:26:36 Range Scan of 100000 user documents took 3.175177311s 2016/03/24 09:26:36 PERFSTAT Range 0.0032 seconds 2016/03/24 09:26:36 Range Scan of 100000 user documents took 3.219961ms 2016/03/24 09:26:36 PERFSTAT Range 0.0040 seconds 2016/03/24 09:26:36 Range Scan of 100000 user documents took 4.069448ms 2016/03/24 09:26:36 PERFSTAT Range 0.0734 seconds 2016/03/24 09:26:36 Range Scan of 100000 user documents took 73.438677ms 2016/03/24 09:26:39 PERFSTAT Range 2.4678 seconds 2016/03/24 09:26:39 Range Scan of 100000 user documents took 2.467851799s 2016/03/24 09:26:39 PERFSTAT Range 0.0042 seconds 2016/03/24 09:26:39 Range Scan of 100000 user documents took 13.740107ms 2016/03/24 09:26:39 PERFSTAT Range 0.0151 seconds 2016/03/24 09:26:39 Range Scan of 100000 user documents took 15.198894ms 2016/03/24 09:26:39 PERFSTAT Range 0.0048 seconds 2016/03/24 09:26:39 Range Scan of 100000 user documents took 4.859134ms 2016/03/24 09:26:40 PERFSTAT Range 1.8117 seconds 2016/03/24 09:26:40 Range Scan of 100000 user documents took 1.811770756s 2016/03/24 09:26:41 Created the secondary index index_firstname. Waiting for it become active 2016/03/24 09:26:41 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:26:41 Index is now active 2016/03/24 09:26:41 PERFSTAT CreateAndBuildIndex 37.6364 seconds 2016/03/24 09:26:42 PERFSTAT Range 2.0830 seconds 2016/03/24 09:26:42 Range Scan of 100000 user documents took 2.083051826s 2016/03/24 09:26:44 PERFSTAT Range 2.4215 seconds 2016/03/24 09:26:44 Dropping the secondary index index_age 2016/03/24 09:26:44 PERFSTAT Range 1.6800 seconds 2016/03/24 09:26:44 Range Scan of 100000 user documents took 1.680080404s 2016/03/24 09:26:44 Index dropped 2016/03/24 09:26:44 PERFSTAT DropIndex 0.2170 seconds 2016/03/24 09:26:45 PERFSTAT Range 0.5710 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 571.039109ms 2016/03/24 09:26:45 PERFSTAT Range 0.0034 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 3.404023ms 2016/03/24 09:26:45 PERFSTAT Range 0.0029 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 2.896571ms 2016/03/24 09:26:45 PERFSTAT Range 0.0509 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 50.971247ms 2016/03/24 09:26:45 Dropping the secondary index index_firstname 2016/03/24 09:26:45 PERFSTAT Range 0.5548 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 554.855979ms 2016/03/24 09:26:45 PERFSTAT Range 0.0040 seconds 2016/03/24 09:26:45 Range Scan of 100000 user documents took 4.028219ms 2016/03/24 09:26:45 Index dropped 2016/03/24 09:26:45 PERFSTAT DropIndex 0.1463 seconds 2016/03/24 09:26:48 PERFSTAT Range 2.2220 seconds 2016/03/24 09:26:48 Range Scan of 100000 user documents took 2.222040351s 2016/03/24 09:26:51 PERFSTAT Range 3.6940 seconds 2016/03/24 09:26:51 Range Scan of 100000 user documents took 3.694022076s 2016/03/24 09:27:01 PERFSTAT Range 9.3260 seconds 2016/03/24 09:27:01 Range Scan of 100000 user documents took 9.326101192s 2016/03/24 09:27:01 PERFSTAT Range 0.0033 seconds 2016/03/24 09:27:01 Range Scan of 100000 user documents took 3.320834ms 2016/03/24 09:27:02 PERFSTAT Range 1.0936 seconds 2016/03/24 09:27:02 Range Scan of 100000 user documents took 1.093639859s 2016/03/24 09:27:02 PERFSTAT Range 0.1164 seconds 2016/03/24 09:27:02 Range Scan of 100000 user documents took 116.502178ms 2016/03/24 09:27:02 PERFSTAT Range 0.0109 seconds 2016/03/24 09:27:02 Range Scan of 100000 user documents took 10.950735ms 2016/03/24 09:27:04 PERFSTAT Range 1.7084 seconds 2016/03/24 09:27:04 Range Scan of 100000 user documents took 1.708448255s 2016/03/24 09:27:04 PERFSTAT Range 0.0046 seconds 2016/03/24 09:27:04 Range Scan of 100000 user documents took 4.704041ms 2016/03/24 09:27:07 PERFSTAT Range 3.1575 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 3.157563342s 2016/03/24 09:27:07 PERFSTAT Range 0.0932 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 93.266129ms 2016/03/24 09:27:07 PERFSTAT Range 0.0114 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 11.416898ms 2016/03/24 09:27:07 PERFSTAT Range 0.0089 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 8.959565ms 2016/03/24 09:27:07 PERFSTAT Range 0.0101 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 10.146725ms 2016/03/24 09:27:07 PERFSTAT Range 0.0140 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 14.077414ms 2016/03/24 09:27:07 PERFSTAT Range 0.0047 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 4.720792ms 2016/03/24 09:27:07 PERFSTAT Range 0.0042 seconds 2016/03/24 09:27:07 Range Scan of 100000 user documents took 4.226359ms 2016/03/24 09:27:09 PERFSTAT Range 2.1564 seconds 2016/03/24 09:27:09 Range Scan of 100000 user documents took 2.156452139s 2016/03/24 09:27:09 PERFSTAT Range 0.0821 seconds 2016/03/24 09:27:09 Range Scan of 100000 user documents took 82.159431ms 2016/03/24 09:27:10 PERFSTAT Range 1.3298 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 1.329846004s 2016/03/24 09:27:10 PERFSTAT Range 0.0031 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 3.176688ms 2016/03/24 09:27:10 PERFSTAT Range 0.0044 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 4.438523ms 2016/03/24 09:27:10 PERFSTAT Range 0.0031 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 3.136204ms 2016/03/24 09:27:10 PERFSTAT Range 0.0031 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 3.149244ms 2016/03/24 09:27:10 PERFSTAT Range 0.0036 seconds 2016/03/24 09:27:10 Range Scan of 100000 user documents took 3.927535ms 2016/03/24 09:27:13 PERFSTAT Range 2.2230 seconds 2016/03/24 09:27:13 Range Scan of 100000 user documents took 2.223073357s 2016/03/24 09:27:13 PERFSTAT Range 0.0819 seconds 2016/03/24 09:27:13 Range Scan of 100000 user documents took 81.949685ms 2016/03/24 09:27:14 PERFSTAT Range 0.9357 seconds 2016/03/24 09:27:14 Range Scan of 100000 user documents took 935.740516ms 2016/03/24 09:27:15 PERFSTAT Range 1.2596 seconds 2016/03/24 09:27:15 Range Scan of 100000 user documents took 1.259683299s 2016/03/24 09:27:15 PERFSTAT Range 0.0044 seconds 2016/03/24 09:27:15 Range Scan of 100000 user documents took 4.421627ms 2016/03/24 09:27:15 PERFSTAT Range 0.0034 seconds 2016/03/24 09:27:15 Range Scan of 100000 user documents took 3.500774ms 2016/03/24 09:27:17 PERFSTAT Range 1.9041 seconds 2016/03/24 09:27:17 Range Scan of 100000 user documents took 1.904420066s 2016/03/24 09:27:17 PERFSTAT Range 0.0038 seconds 2016/03/24 09:27:17 Range Scan of 100000 user documents took 3.842899ms 2016/03/24 09:27:19 PERFSTAT Range 1.8709 seconds 2016/03/24 09:27:19 Range Scan of 100000 user documents took 1.870965624s 2016/03/24 09:27:22 Created the secondary index index_age. Waiting for it become active 2016/03/24 09:27:22 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:27:22 Index is now active 2016/03/24 09:27:22 PERFSTAT CreateAndBuildIndex 35.9135 seconds 2016/03/24 09:27:26 PERFSTAT Range 3.0679 seconds 2016/03/24 09:27:55 Created the secondary index index_firstname. Waiting for it become active 2016/03/24 09:27:55 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:27:55 Index is now active 2016/03/24 09:27:55 PERFSTAT CreateAndBuildIndex 29.0115 seconds 2016/03/24 09:27:58 PERFSTAT Range 1.7804 seconds 2016/03/24 09:27:58 Dropping the secondary index index_age 2016/03/24 09:27:58 Index dropped 2016/03/24 09:27:58 PERFSTAT DropIndex 0.1278 seconds 2016/03/24 09:27:59 Dropping the secondary index index_firstname 2016/03/24 09:27:59 Index dropped 2016/03/24 09:27:59 PERFSTAT DropIndex 0.1070 seconds --- PASS: TestScanWithConcurrentIndexOps (244.49s) === RUN TestConcurrentScans_SameIndex 2016/03/24 09:28:00 In TestConcurrentScans_SameIndex() 2016/03/24 09:28:00 Generating JSON docs 2016/03/24 09:28:08 Setting initial JSON docs in KV 2016/03/24 09:29:34 All indexers are active 2016/03/24 09:29:34 Creating a 2i 2016/03/24 09:29:34 Index found: index_company 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:34 In Range Scan 2016/03/24 09:29:35 PERFSTAT Range 0.0075 seconds 2016/03/24 09:29:35 Range Scan of 100000 user documents took 7.570877ms 2016/03/24 09:29:35 PERFSTAT Range 0.0083 seconds 2016/03/24 09:29:35 Range Scan of 100000 user documents took 8.360517ms 2016/03/24 09:29:35 PERFSTAT Range 0.0362 seconds 2016/03/24 09:29:35 Range Scan of 100000 user documents took 36.224487ms 2016/03/24 09:29:35 PERFSTAT Range 0.0808 seconds 2016/03/24 09:29:35 Range Scan of 100000 user documents took 80.791622ms 2016/03/24 09:29:38 PERFSTAT Range 3.4864 seconds 2016/03/24 09:29:38 Range Scan of 100000 user documents took 3.486539429s 2016/03/24 09:29:38 PERFSTAT Range 0.0046 seconds 2016/03/24 09:29:38 Range Scan of 100000 user documents took 4.760892ms 2016/03/24 09:29:39 PERFSTAT Range 4.1937 seconds 2016/03/24 09:29:39 Range Scan of 100000 user documents took 4.193786391s 2016/03/24 09:29:46 PERFSTAT Range 11.1059 seconds 2016/03/24 09:29:46 Range Scan of 100000 user documents took 11.1059479s 2016/03/24 09:29:47 PERFSTAT Range 12.0281 seconds 2016/03/24 09:29:47 Range Scan of 100000 user documents took 12.028139455s 2016/03/24 09:29:47 PERFSTAT Range 1.2920 seconds 2016/03/24 09:29:47 Range Scan of 100000 user documents took 1.292015935s 2016/03/24 09:29:49 PERFSTAT Range 14.4473 seconds 2016/03/24 09:29:49 Range Scan of 100000 user documents took 14.447373199s 2016/03/24 09:29:52 PERFSTAT Range 2.4303 seconds 2016/03/24 09:29:52 Range Scan of 100000 user documents took 2.430333791s 2016/03/24 09:29:52 PERFSTAT Range 0.0562 seconds 2016/03/24 09:29:52 Range Scan of 100000 user documents took 56.352769ms 2016/03/24 09:29:52 PERFSTAT Range 13.5403 seconds 2016/03/24 09:29:52 Range Scan of 100000 user documents took 13.542290512s 2016/03/24 09:29:52 PERFSTAT Range 0.0582 seconds 2016/03/24 09:29:52 Range Scan of 100000 user documents took 58.250873ms 2016/03/24 09:29:53 PERFSTAT Range 15.2132 seconds 2016/03/24 09:29:53 Range Scan of 100000 user documents took 15.213998645s 2016/03/24 09:29:53 PERFSTAT Range 0.0666 seconds 2016/03/24 09:29:53 Range Scan of 100000 user documents took 66.681284ms 2016/03/24 09:29:54 PERFSTAT Range 0.0313 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 31.410372ms 2016/03/24 09:29:54 PERFSTAT Range 7.2656 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 7.265611584s 2016/03/24 09:29:54 PERFSTAT Range 19.3530 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 19.354406061s 2016/03/24 09:29:54 PERFSTAT Range 0.0117 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 11.768534ms 2016/03/24 09:29:54 PERFSTAT Range 0.1110 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 111.006835ms 2016/03/24 09:29:54 PERFSTAT Range 0.6892 seconds 2016/03/24 09:29:54 Range Scan of 100000 user documents took 692.436328ms 2016/03/24 09:29:56 PERFSTAT Range 1.8396 seconds 2016/03/24 09:29:56 Range Scan of 100000 user documents took 1.839709063s 2016/03/24 09:29:56 PERFSTAT Range 0.0050 seconds 2016/03/24 09:29:56 Range Scan of 100000 user documents took 5.046245ms 2016/03/24 09:29:56 PERFSTAT Range 0.0162 seconds 2016/03/24 09:29:56 Range Scan of 100000 user documents took 16.21415ms 2016/03/24 09:29:56 PERFSTAT Range 0.0185 seconds 2016/03/24 09:29:56 Range Scan of 100000 user documents took 18.63348ms 2016/03/24 09:29:57 PERFSTAT Range 9.8723 seconds 2016/03/24 09:29:57 Range Scan of 100000 user documents took 9.872392864s 2016/03/24 09:29:57 PERFSTAT Range 4.6510 seconds 2016/03/24 09:29:57 Range Scan of 100000 user documents took 4.651092941s 2016/03/24 09:29:59 PERFSTAT Range 2.6871 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 2.688404495s 2016/03/24 09:29:59 PERFSTAT Range 7.1445 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 7.145500567s 2016/03/24 09:29:59 PERFSTAT Range 0.0288 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 28.864349ms 2016/03/24 09:29:59 PERFSTAT Range 0.0184 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 18.483776ms 2016/03/24 09:29:59 PERFSTAT Range 2.0561 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 2.056169565s 2016/03/24 09:29:59 PERFSTAT Range 0.0141 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 19.753878ms 2016/03/24 09:29:59 PERFSTAT Range 0.0142 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 14.240011ms 2016/03/24 09:29:59 PERFSTAT Range 0.0873 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 87.358693ms 2016/03/24 09:29:59 PERFSTAT Range 0.0097 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 9.725734ms 2016/03/24 09:29:59 PERFSTAT Range 0.0654 seconds 2016/03/24 09:29:59 Range Scan of 100000 user documents took 65.476302ms 2016/03/24 09:30:00 PERFSTAT Range 5.3213 seconds 2016/03/24 09:30:00 Range Scan of 100000 user documents took 5.321376618s 2016/03/24 09:30:00 PERFSTAT Range 0.0986 seconds 2016/03/24 09:30:00 Range Scan of 100000 user documents took 98.65565ms 2016/03/24 09:30:00 PERFSTAT Range 1.1157 seconds 2016/03/24 09:30:00 Range Scan of 100000 user documents took 1.115794903s 2016/03/24 09:30:00 PERFSTAT Range 5.8769 seconds 2016/03/24 09:30:00 Range Scan of 100000 user documents took 5.877000412s 2016/03/24 09:30:02 PERFSTAT Range 2.0527 seconds 2016/03/24 09:30:02 Range Scan of 100000 user documents took 2.052810908s 2016/03/24 09:30:03 PERFSTAT Range 5.5584 seconds 2016/03/24 09:30:03 Range Scan of 100000 user documents took 5.558748945s 2016/03/24 09:30:03 PERFSTAT Range 3.1129 seconds 2016/03/24 09:30:03 Range Scan of 100000 user documents took 3.112951608s 2016/03/24 09:30:04 PERFSTAT Range 4.0130 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 4.013044434s 2016/03/24 09:30:04 PERFSTAT Range 5.4579 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 5.457933504s 2016/03/24 09:30:04 PERFSTAT Range 0.0048 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 4.846556ms 2016/03/24 09:30:04 PERFSTAT Range 0.0055 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 5.727848ms 2016/03/24 09:30:04 PERFSTAT Range 0.0062 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 6.276391ms 2016/03/24 09:30:04 PERFSTAT Range 0.0897 seconds 2016/03/24 09:30:04 Range Scan of 100000 user documents took 89.78432ms 2016/03/24 09:30:06 PERFSTAT Range 1.4723 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 1.472411288s 2016/03/24 09:30:06 PERFSTAT Range 0.0231 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 23.208022ms 2016/03/24 09:30:06 PERFSTAT Range 2.3770 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 2.377157021s 2016/03/24 09:30:06 PERFSTAT Range 0.0196 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 19.652971ms 2016/03/24 09:30:06 PERFSTAT Range 0.0199 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 19.981467ms 2016/03/24 09:30:06 PERFSTAT Range 0.3648 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 364.87715ms 2016/03/24 09:30:06 PERFSTAT Range 0.0190 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 19.071183ms 2016/03/24 09:30:06 PERFSTAT Range 0.0248 seconds 2016/03/24 09:30:06 Range Scan of 100000 user documents took 24.919504ms 2016/03/24 09:30:07 PERFSTAT Range 7.1950 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 7.195042857s 2016/03/24 09:30:07 PERFSTAT Range 0.1290 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 129.032882ms 2016/03/24 09:30:07 PERFSTAT Range 0.0340 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 34.195935ms 2016/03/24 09:30:07 PERFSTAT Range 0.0211 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 21.1844ms 2016/03/24 09:30:07 PERFSTAT Range 0.0245 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 24.589603ms 2016/03/24 09:30:07 PERFSTAT Range 0.0810 seconds 2016/03/24 09:30:07 Range Scan of 100000 user documents took 81.14233ms 2016/03/24 09:30:08 PERFSTAT Range 1.1508 seconds 2016/03/24 09:30:08 Range Scan of 100000 user documents took 1.15088343s 2016/03/24 09:30:09 PERFSTAT Range 1.0443 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 1.044394946s 2016/03/24 09:30:09 PERFSTAT Range 6.3452 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 6.345350478s 2016/03/24 09:30:09 PERFSTAT Range 0.1128 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 112.886967ms 2016/03/24 09:30:09 PERFSTAT Range 0.0905 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 90.595469ms 2016/03/24 09:30:09 PERFSTAT Range 0.0762 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 76.220242ms 2016/03/24 09:30:09 PERFSTAT Range 0.0422 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 42.19975ms 2016/03/24 09:30:09 PERFSTAT Range 7.4585 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 7.458818631s 2016/03/24 09:30:09 PERFSTAT Range 0.0470 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 47.128361ms 2016/03/24 09:30:09 PERFSTAT Range 0.1011 seconds 2016/03/24 09:30:09 Range Scan of 100000 user documents took 101.136669ms 2016/03/24 09:30:10 PERFSTAT Range 2.8600 seconds 2016/03/24 09:30:10 Range Scan of 100000 user documents took 2.86672831s 2016/03/24 09:30:12 PERFSTAT Range 8.6453 seconds 2016/03/24 09:30:12 Range Scan of 100000 user documents took 8.645466488s 2016/03/24 09:30:12 PERFSTAT Range 2.3416 seconds 2016/03/24 09:30:12 Range Scan of 100000 user documents took 2.341744723s 2016/03/24 09:30:12 PERFSTAT Range 0.0080 seconds 2016/03/24 09:30:12 Range Scan of 100000 user documents took 8.074216ms 2016/03/24 09:30:12 PERFSTAT Range 0.0188 seconds 2016/03/24 09:30:12 Range Scan of 100000 user documents took 19.117909ms 2016/03/24 09:30:12 PERFSTAT Range 3.4157 seconds 2016/03/24 09:30:12 Range Scan of 100000 user documents took 3.415760113s 2016/03/24 09:30:14 PERFSTAT Range 2.2413 seconds 2016/03/24 09:30:14 Range Scan of 100000 user documents took 2.241405236s 2016/03/24 09:30:14 PERFSTAT Range 0.0179 seconds 2016/03/24 09:30:14 Range Scan of 100000 user documents took 18.04712ms 2016/03/24 09:30:15 PERFSTAT Range 5.6497 seconds 2016/03/24 09:30:15 Range Scan of 100000 user documents took 5.655826027s 2016/03/24 09:30:15 PERFSTAT Range 9.4665 seconds 2016/03/24 09:30:15 Range Scan of 100000 user documents took 9.466535822s 2016/03/24 09:30:15 PERFSTAT Range 0.1128 seconds 2016/03/24 09:30:15 Range Scan of 100000 user documents took 112.850295ms 2016/03/24 09:30:15 PERFSTAT Range 6.1578 seconds 2016/03/24 09:30:15 Range Scan of 100000 user documents took 6.157885403s 2016/03/24 09:30:15 PERFSTAT Range 0.0786 seconds 2016/03/24 09:30:15 Range Scan of 100000 user documents took 78.684372ms 2016/03/24 09:30:16 PERFSTAT Range 0.0389 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 38.890854ms 2016/03/24 09:30:16 PERFSTAT Range 0.0827 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 82.703303ms 2016/03/24 09:30:16 PERFSTAT Range 0.0043 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 4.351215ms 2016/03/24 09:30:16 PERFSTAT Range 0.8768 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 877.217978ms 2016/03/24 09:30:16 PERFSTAT Range 0.0709 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 70.921237ms 2016/03/24 09:30:16 PERFSTAT Range 0.0678 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 67.805729ms 2016/03/24 09:30:16 PERFSTAT Range 4.0497 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 4.049751844s 2016/03/24 09:30:16 PERFSTAT Range 0.0158 seconds 2016/03/24 09:30:16 Range Scan of 100000 user documents took 15.887918ms 2016/03/24 09:30:17 PERFSTAT Range 1.4998 seconds 2016/03/24 09:30:17 Range Scan of 100000 user documents took 1.499899582s 2016/03/24 09:30:18 PERFSTAT Range 3.9211 seconds 2016/03/24 09:30:18 Range Scan of 100000 user documents took 3.928794577s 2016/03/24 09:30:19 PERFSTAT Range 6.8008 seconds 2016/03/24 09:30:19 Range Scan of 100000 user documents took 6.800884183s 2016/03/24 09:30:19 PERFSTAT Range 0.0223 seconds 2016/03/24 09:30:19 Range Scan of 100000 user documents took 22.383362ms 2016/03/24 09:30:21 PERFSTAT Range 5.4260 seconds 2016/03/24 09:30:21 Range Scan of 100000 user documents took 5.426105002s 2016/03/24 09:30:23 PERFSTAT Range 4.8478 seconds 2016/03/24 09:30:23 Range Scan of 100000 user documents took 4.847817255s 2016/03/24 09:30:23 PERFSTAT Range 0.2725 seconds 2016/03/24 09:30:23 Range Scan of 100000 user documents took 273.2192ms 2016/03/24 09:30:23 PERFSTAT Range 0.0037 seconds 2016/03/24 09:30:23 Range Scan of 100000 user documents took 3.756806ms 2016/03/24 09:30:23 PERFSTAT Range 0.0139 seconds 2016/03/24 09:30:23 Range Scan of 100000 user documents took 13.953958ms 2016/03/24 09:30:24 PERFSTAT Range 8.7082 seconds 2016/03/24 09:30:24 Range Scan of 100000 user documents took 8.708470639s 2016/03/24 09:30:24 PERFSTAT Range 0.0088 seconds 2016/03/24 09:30:24 Range Scan of 100000 user documents took 8.867381ms 2016/03/24 09:30:24 PERFSTAT Range 0.0208 seconds 2016/03/24 09:30:24 Range Scan of 100000 user documents took 20.862907ms 2016/03/24 09:30:25 PERFSTAT Range 8.3050 seconds 2016/03/24 09:30:25 Range Scan of 100000 user documents took 8.305031592s 2016/03/24 09:30:25 PERFSTAT Range 0.2201 seconds 2016/03/24 09:30:25 Range Scan of 100000 user documents took 220.195964ms 2016/03/24 09:30:25 PERFSTAT Range 4.4092 seconds 2016/03/24 09:30:26 Range Scan of 100000 user documents took 4.421111088s 2016/03/24 09:30:28 PERFSTAT Range 9.1108 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 9.116053696s 2016/03/24 09:30:28 PERFSTAT Range 2.9925 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 2.994476187s 2016/03/24 09:30:28 PERFSTAT Range 0.0045 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 4.541435ms 2016/03/24 09:30:28 PERFSTAT Range 0.0833 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 83.308118ms 2016/03/24 09:30:28 PERFSTAT Range 0.0685 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 68.52952ms 2016/03/24 09:30:28 PERFSTAT Range 0.0230 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 23.077985ms 2016/03/24 09:30:28 PERFSTAT Range 0.0038 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 3.84744ms 2016/03/24 09:30:28 PERFSTAT Range 0.0207 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 20.828868ms 2016/03/24 09:30:28 PERFSTAT Range 5.2421 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 5.242195961s 2016/03/24 09:30:28 PERFSTAT Range 0.0172 seconds 2016/03/24 09:30:28 Range Scan of 100000 user documents took 17.269073ms 2016/03/24 09:30:29 PERFSTAT Range 0.9208 seconds 2016/03/24 09:30:29 Range Scan of 100000 user documents took 920.96629ms 2016/03/24 09:30:30 PERFSTAT Range 13.2805 seconds 2016/03/24 09:30:30 Range Scan of 100000 user documents took 13.280611038s 2016/03/24 09:30:30 PERFSTAT Range 0.0444 seconds 2016/03/24 09:30:30 Range Scan of 100000 user documents took 44.439059ms 2016/03/24 09:30:32 PERFSTAT Range 3.8260 seconds 2016/03/24 09:30:32 Range Scan of 100000 user documents took 3.826037949s 2016/03/24 09:30:32 PERFSTAT Range 1.9298 seconds 2016/03/24 09:30:32 Range Scan of 100000 user documents took 1.929931948s 2016/03/24 09:30:33 PERFSTAT Range 0.1087 seconds 2016/03/24 09:30:33 Range Scan of 100000 user documents took 108.748175ms 2016/03/24 09:30:33 PERFSTAT Range 0.0271 seconds 2016/03/24 09:30:33 Range Scan of 100000 user documents took 27.188143ms 2016/03/24 09:30:33 PERFSTAT Range 0.0262 seconds 2016/03/24 09:30:33 Range Scan of 100000 user documents took 26.236108ms 2016/03/24 09:30:33 PERFSTAT Range 0.0911 seconds 2016/03/24 09:30:33 Range Scan of 100000 user documents took 91.191477ms 2016/03/24 09:30:33 PERFSTAT Range 0.0524 seconds 2016/03/24 09:30:33 Range Scan of 100000 user documents took 52.483653ms 2016/03/24 09:30:34 PERFSTAT Range 9.4812 seconds 2016/03/24 09:30:34 Range Scan of 100000 user documents took 9.48134322s 2016/03/24 09:30:34 PERFSTAT Range 0.0531 seconds 2016/03/24 09:30:34 Range Scan of 100000 user documents took 53.128828ms 2016/03/24 09:30:34 PERFSTAT Range 6.2254 seconds 2016/03/24 09:30:34 Range Scan of 100000 user documents took 6.225456035s 2016/03/24 09:30:34 PERFSTAT Range 0.0124 seconds 2016/03/24 09:30:34 Range Scan of 100000 user documents took 12.494374ms 2016/03/24 09:30:35 PERFSTAT Range 9.5199 seconds 2016/03/24 09:30:35 Range Scan of 100000 user documents took 9.519902252s 2016/03/24 09:30:35 PERFSTAT Range 0.0958 seconds 2016/03/24 09:30:35 Range Scan of 100000 user documents took 95.848044ms 2016/03/24 09:30:36 PERFSTAT Range 7.5828 seconds 2016/03/24 09:30:36 Range Scan of 100000 user documents took 7.582848421s 2016/03/24 09:30:36 PERFSTAT Range 0.0393 seconds 2016/03/24 09:30:36 Range Scan of 100000 user documents took 39.383444ms 2016/03/24 09:30:37 PERFSTAT Range 0.1055 seconds 2016/03/24 09:30:37 Range Scan of 100000 user documents took 105.572406ms 2016/03/24 09:30:37 PERFSTAT Range 0.7420 seconds 2016/03/24 09:30:37 Range Scan of 100000 user documents took 742.019452ms 2016/03/24 09:30:38 PERFSTAT Range 5.3566 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 5.356659655s 2016/03/24 09:30:38 PERFSTAT Range 0.0838 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 83.827792ms 2016/03/24 09:30:38 PERFSTAT Range 0.0105 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 10.567355ms 2016/03/24 09:30:38 PERFSTAT Range 0.0878 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 87.899573ms 2016/03/24 09:30:38 PERFSTAT Range 4.0530 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 4.053116152s 2016/03/24 09:30:38 PERFSTAT Range 3.5566 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 3.556662938s 2016/03/24 09:30:38 PERFSTAT Range 0.0151 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 15.114273ms 2016/03/24 09:30:38 PERFSTAT Range 0.0225 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 22.531765ms 2016/03/24 09:30:38 PERFSTAT Range 0.0390 seconds 2016/03/24 09:30:38 Range Scan of 100000 user documents took 39.005265ms 2016/03/24 09:30:39 PERFSTAT Range 1.1862 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 1.186353326s 2016/03/24 09:30:39 PERFSTAT Range 0.0210 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 21.039318ms 2016/03/24 09:30:39 PERFSTAT Range 0.0623 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 62.309866ms 2016/03/24 09:30:39 PERFSTAT Range 0.0217 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 21.716796ms 2016/03/24 09:30:39 PERFSTAT Range 0.0353 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 35.326784ms 2016/03/24 09:30:39 PERFSTAT Range 0.0060 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 6.07221ms 2016/03/24 09:30:39 PERFSTAT Range 0.0211 seconds 2016/03/24 09:30:39 Range Scan of 100000 user documents took 21.143998ms 2016/03/24 09:30:41 PERFSTAT Range 5.7143 seconds 2016/03/24 09:30:41 Range Scan of 100000 user documents took 5.714673428s 2016/03/24 09:30:41 PERFSTAT Range 0.0814 seconds 2016/03/24 09:30:41 Range Scan of 100000 user documents took 81.503362ms 2016/03/24 09:30:42 PERFSTAT Range 9.1585 seconds 2016/03/24 09:30:42 Range Scan of 100000 user documents took 9.158571448s 2016/03/24 09:30:42 PERFSTAT Range 4.1891 seconds 2016/03/24 09:30:42 Range Scan of 100000 user documents took 4.189200389s 2016/03/24 09:30:42 PERFSTAT Range 0.0118 seconds 2016/03/24 09:30:42 Range Scan of 100000 user documents took 11.803223ms 2016/03/24 09:30:43 PERFSTAT Range 1.1155 seconds 2016/03/24 09:30:43 Range Scan of 100000 user documents took 1.115618798s 2016/03/24 09:30:43 PERFSTAT Range 0.0100 seconds 2016/03/24 09:30:43 Range Scan of 100000 user documents took 10.041525ms 2016/03/24 09:30:43 PERFSTAT Range 4.2829 seconds 2016/03/24 09:30:43 Range Scan of 100000 user documents took 4.282995744s 2016/03/24 09:30:43 PERFSTAT Range 0.1127 seconds 2016/03/24 09:30:43 Range Scan of 100000 user documents took 112.788828ms 2016/03/24 09:30:47 PERFSTAT Range 4.5002 seconds 2016/03/24 09:30:47 Range Scan of 100000 user documents took 4.500233915s 2016/03/24 09:30:47 PERFSTAT Range 8.5981 seconds 2016/03/24 09:30:47 Range Scan of 100000 user documents took 8.598213043s 2016/03/24 09:30:47 PERFSTAT Range 0.0567 seconds 2016/03/24 09:30:47 Range Scan of 100000 user documents took 56.875645ms 2016/03/24 09:30:50 PERFSTAT Range 2.9119 seconds 2016/03/24 09:30:50 Range Scan of 100000 user documents took 2.916673474s 2016/03/24 09:30:51 PERFSTAT Range 10.1145 seconds 2016/03/24 09:30:51 Range Scan of 100000 user documents took 10.114869166s 2016/03/24 09:30:51 PERFSTAT Range 1.5030 seconds 2016/03/24 09:30:51 Range Scan of 100000 user documents took 1.503100339s 2016/03/24 09:30:51 PERFSTAT Range 0.0526 seconds 2016/03/24 09:30:51 Range Scan of 100000 user documents took 52.647138ms 2016/03/24 09:30:51 PERFSTAT Range 14.0477 seconds 2016/03/24 09:30:51 Range Scan of 100000 user documents took 14.047824683s 2016/03/24 09:30:51 PERFSTAT Range 0.0486 seconds 2016/03/24 09:30:51 Range Scan of 100000 user documents took 48.672386ms 2016/03/24 09:30:52 PERFSTAT Range 0.0952 seconds 2016/03/24 09:30:52 Range Scan of 100000 user documents took 95.297256ms 2016/03/24 09:30:52 PERFSTAT Range 1.0631 seconds 2016/03/24 09:30:52 Range Scan of 100000 user documents took 1.063177231s 2016/03/24 09:30:52 PERFSTAT Range 0.0723 seconds 2016/03/24 09:30:52 Range Scan of 100000 user documents took 76.922052ms 2016/03/24 09:30:56 PERFSTAT Range 12.9626 seconds 2016/03/24 09:30:56 Range Scan of 100000 user documents took 12.966747758s 2016/03/24 09:30:56 PERFSTAT Range 0.0043 seconds 2016/03/24 09:30:56 Range Scan of 100000 user documents took 4.416585ms 2016/03/24 09:30:56 PERFSTAT Range 5.4126 seconds 2016/03/24 09:30:56 Range Scan of 100000 user documents took 5.412621354s 2016/03/24 09:30:58 PERFSTAT Range 5.3853 seconds 2016/03/24 09:30:58 Range Scan of 100000 user documents took 5.385436263s 2016/03/24 09:30:58 PERFSTAT Range 6.3988 seconds 2016/03/24 09:30:58 Range Scan of 100000 user documents took 6.398942736s 2016/03/24 09:30:58 PERFSTAT Range 0.0188 seconds 2016/03/24 09:30:58 Range Scan of 100000 user documents took 18.928726ms 2016/03/24 09:30:58 PERFSTAT Range 15.2964 seconds 2016/03/24 09:30:58 Range Scan of 100000 user documents took 15.29645942s 2016/03/24 09:30:58 PERFSTAT Range 0.0051 seconds 2016/03/24 09:30:58 Range Scan of 100000 user documents took 5.151562ms 2016/03/24 09:31:02 PERFSTAT Range 15.5959 seconds 2016/03/24 09:31:02 Range Scan of 100000 user documents took 15.59596503s 2016/03/24 09:31:02 PERFSTAT Range 0.0925 seconds 2016/03/24 09:31:02 Range Scan of 100000 user documents took 92.528136ms 2016/03/24 09:31:02 PERFSTAT Range 0.0546 seconds 2016/03/24 09:31:02 Range Scan of 100000 user documents took 54.610762ms 2016/03/24 09:31:02 PERFSTAT Range 0.0471 seconds 2016/03/24 09:31:02 Range Scan of 100000 user documents took 47.130259ms 2016/03/24 09:31:04 PERFSTAT Range 7.3176 seconds 2016/03/24 09:31:04 Range Scan of 100000 user documents took 7.31771708s 2016/03/24 09:31:04 PERFSTAT Range 0.0163 seconds 2016/03/24 09:31:04 Range Scan of 100000 user documents took 16.344111ms 2016/03/24 09:31:04 PERFSTAT Range 6.3790 seconds 2016/03/24 09:31:04 Range Scan of 100000 user documents took 6.379117371s 2016/03/24 09:31:04 PERFSTAT Range 0.0289 seconds 2016/03/24 09:31:04 Range Scan of 100000 user documents took 28.997766ms 2016/03/24 09:31:04 PERFSTAT Range 2.1407 seconds 2016/03/24 09:31:04 Range Scan of 100000 user documents took 2.141413195s 2016/03/24 09:31:05 PERFSTAT Range 8.0386 seconds 2016/03/24 09:31:05 Range Scan of 100000 user documents took 8.038692686s 2016/03/24 09:31:06 PERFSTAT Range 1.1328 seconds 2016/03/24 09:31:06 Range Scan of 100000 user documents took 1.13291364s 2016/03/24 09:31:06 PERFSTAT Range 0.1600 seconds 2016/03/24 09:31:06 Range Scan of 100000 user documents took 160.085731ms 2016/03/24 09:31:06 PERFSTAT Range 2.2403 seconds 2016/03/24 09:31:06 Range Scan of 100000 user documents took 2.240443639s 2016/03/24 09:31:06 PERFSTAT Range 0.6349 seconds 2016/03/24 09:31:06 Range Scan of 100000 user documents took 635.019869ms 2016/03/24 09:31:06 PERFSTAT Range 0.4537 seconds 2016/03/24 09:31:06 Range Scan of 100000 user documents took 453.820348ms 2016/03/24 09:31:07 PERFSTAT Range 0.0985 seconds 2016/03/24 09:31:07 Range Scan of 100000 user documents took 98.533965ms 2016/03/24 09:31:07 PERFSTAT Range 0.6473 seconds 2016/03/24 09:31:07 Range Scan of 100000 user documents took 647.374099ms 2016/03/24 09:31:08 PERFSTAT Range 10.3712 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 10.371221982s 2016/03/24 09:31:08 PERFSTAT Range 0.0302 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 30.225201ms 2016/03/24 09:31:08 PERFSTAT Range 0.1156 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 115.741878ms 2016/03/24 09:31:08 PERFSTAT Range 0.0259 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 25.970663ms 2016/03/24 09:31:08 PERFSTAT Range 3.9380 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 3.938129541s 2016/03/24 09:31:08 PERFSTAT Range 0.0059 seconds 2016/03/24 09:31:08 Range Scan of 100000 user documents took 6.018198ms 2016/03/24 09:31:09 PERFSTAT Range 10.6753 seconds 2016/03/24 09:31:09 Range Scan of 100000 user documents took 10.678057289s 2016/03/24 09:31:10 PERFSTAT Range 3.9013 seconds 2016/03/24 09:31:10 Range Scan of 100000 user documents took 3.901379511s 2016/03/24 09:31:10 PERFSTAT Range 0.0070 seconds 2016/03/24 09:31:10 Range Scan of 100000 user documents took 7.084722ms 2016/03/24 09:31:11 PERFSTAT Range 1.5244 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 1.52454037s 2016/03/24 09:31:11 PERFSTAT Range 2.1207 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 2.120744481s 2016/03/24 09:31:11 PERFSTAT Range 0.1190 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 119.020211ms 2016/03/24 09:31:11 PERFSTAT Range 0.1002 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 100.280801ms 2016/03/24 09:31:11 PERFSTAT Range 0.0096 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 9.647092ms 2016/03/24 09:31:11 PERFSTAT Range 0.0141 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 14.102138ms 2016/03/24 09:31:11 PERFSTAT Range 3.5405 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 3.541454366s 2016/03/24 09:31:11 PERFSTAT Range 0.0115 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 13.755372ms 2016/03/24 09:31:11 PERFSTAT Range 0.0176 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 17.614703ms 2016/03/24 09:31:11 PERFSTAT Range 0.0216 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 21.64247ms 2016/03/24 09:31:11 PERFSTAT Range 0.0235 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 23.685385ms 2016/03/24 09:31:11 PERFSTAT Range 0.5893 seconds 2016/03/24 09:31:11 Range Scan of 100000 user documents took 589.377747ms 2016/03/24 09:31:12 PERFSTAT Range 7.9303 seconds 2016/03/24 09:31:12 Range Scan of 100000 user documents took 7.930330524s 2016/03/24 09:31:14 PERFSTAT Range 3.0501 seconds 2016/03/24 09:31:14 Range Scan of 100000 user documents took 3.050127954s 2016/03/24 09:31:15 PERFSTAT Range 2.8202 seconds 2016/03/24 09:31:15 Range Scan of 100000 user documents took 2.822505293s 2016/03/24 09:31:15 PERFSTAT Range 0.0045 seconds 2016/03/24 09:31:15 Range Scan of 100000 user documents took 4.557486ms 2016/03/24 09:31:15 PERFSTAT Range 0.0073 seconds 2016/03/24 09:31:15 Range Scan of 100000 user documents took 7.359813ms 2016/03/24 09:31:15 PERFSTAT Range 0.0380 seconds 2016/03/24 09:31:15 Range Scan of 100000 user documents took 38.070085ms 2016/03/24 09:31:15 PERFSTAT Range 0.1092 seconds 2016/03/24 09:31:15 Range Scan of 100000 user documents took 109.277775ms 2016/03/24 09:31:16 PERFSTAT Range 8.3275 seconds 2016/03/24 09:31:16 Range Scan of 100000 user documents took 8.327745391s 2016/03/24 09:31:17 PERFSTAT Range 0.0319 seconds 2016/03/24 09:31:17 Range Scan of 100000 user documents took 31.92747ms 2016/03/24 09:31:18 PERFSTAT Range 4.6718 seconds 2016/03/24 09:31:18 Range Scan of 100000 user documents took 4.671928617s 2016/03/24 09:31:20 PERFSTAT Range 3.4910 seconds 2016/03/24 09:31:20 Range Scan of 100000 user documents took 3.491139837s 2016/03/24 09:31:21 PERFSTAT Range 10.2575 seconds 2016/03/24 09:31:21 Range Scan of 100000 user documents took 10.257688401s 2016/03/24 09:31:24 PERFSTAT Range 13.0472 seconds 2016/03/24 09:31:24 Range Scan of 100000 user documents took 13.047352171s 2016/03/24 09:31:27 PERFSTAT Range 5.8235 seconds 2016/03/24 09:31:27 Range Scan of 100000 user documents took 5.823558236s 2016/03/24 09:31:28 PERFSTAT Range 16.7575 seconds 2016/03/24 09:31:28 Range Scan of 100000 user documents took 16.757631174s 2016/03/24 09:31:31 PERFSTAT Range 15.3099 seconds 2016/03/24 09:31:31 Range Scan of 100000 user documents took 15.309963962s 2016/03/24 09:31:31 PERFSTAT Range 6.9458 seconds 2016/03/24 09:31:31 Range Scan of 100000 user documents took 6.945905374s 2016/03/24 09:31:31 PERFSTAT Range 0.0104 seconds 2016/03/24 09:31:31 Range Scan of 100000 user documents took 10.424155ms 2016/03/24 09:31:31 PERFSTAT Range 0.0068 seconds 2016/03/24 09:31:31 Range Scan of 100000 user documents took 6.811272ms 2016/03/24 09:31:32 PERFSTAT Range 11.5056 seconds 2016/03/24 09:31:32 Range Scan of 100000 user documents took 11.505742233s 2016/03/24 09:31:32 PERFSTAT Range 13.4957 seconds 2016/03/24 09:31:32 Range Scan of 100000 user documents took 13.495830585s 2016/03/24 09:31:32 PERFSTAT Range 0.0379 seconds 2016/03/24 09:31:32 Range Scan of 100000 user documents took 37.956246ms 2016/03/24 09:31:33 PERFSTAT Range 0.6033 seconds 2016/03/24 09:31:33 Range Scan of 100000 user documents took 603.443609ms 2016/03/24 09:31:33 PERFSTAT Range 0.0168 seconds 2016/03/24 09:31:33 Range Scan of 100000 user documents took 16.871934ms 2016/03/24 09:31:33 PERFSTAT Range 0.0089 seconds 2016/03/24 09:31:33 Range Scan of 100000 user documents took 8.973844ms 2016/03/24 09:31:33 PERFSTAT Range 0.0305 seconds 2016/03/24 09:31:33 Range Scan of 100000 user documents took 30.531586ms 2016/03/24 09:31:35 PERFSTAT Range 7.9019 seconds 2016/03/24 09:31:35 Range Scan of 100000 user documents took 7.901955049s 2016/03/24 09:31:36 PERFSTAT Range 5.9155 seconds 2016/03/24 09:31:36 Range Scan of 100000 user documents took 5.915569989s 2016/03/24 09:31:38 PERFSTAT Range 9.7167 seconds 2016/03/24 09:31:38 Range Scan of 100000 user documents took 9.716788655s 2016/03/24 09:31:38 PERFSTAT Range 5.1031 seconds 2016/03/24 09:31:38 Range Scan of 100000 user documents took 5.103279277s 2016/03/24 09:31:39 PERFSTAT Range 7.5430 seconds 2016/03/24 09:31:39 Range Scan of 100000 user documents took 7.543058246s 2016/03/24 09:31:39 PERFSTAT Range 8.5681 seconds 2016/03/24 09:31:39 Range Scan of 100000 user documents took 8.568191304s --- PASS: TestConcurrentScans_SameIndex (218.87s) === RUN TestConcurrentScans_MultipleIndexes 2016/03/24 09:31:39 In TestConcurrentScans_MultipleIndexes() 2016/03/24 09:31:39 Generating JSON docs 2016/03/24 09:31:47 Setting initial JSON docs in KV 2016-03-24T09:32:54.549+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly. 2016-03-24T09:32:54.551+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly. 2016-03-24T09:32:54.552+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly. 2016-03-24T09:32:54.552+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly. 2016-03-24T09:32:55.55+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:55.552+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:55.552+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:55.552+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:57.551+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:57.553+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:57.553+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:32:57.554+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:01.552+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:01.554+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:01.555+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:01.58+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:09.554+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:09.554+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:09.556+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:09.581+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:25.555+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:25.555+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:25.556+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:25.582+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:27.544+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016/03/24 09:33:28 All indexers are active 2016/03/24 09:33:28 Creating multiple indexes 2016-03-24T09:33:28.545+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:28.586+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: getsockopt: connection refused 2016-03-24T09:33:29.946+05:30 [Error] updateIndexerList(): Cannot locate cluster node. --- FAIL: TestConcurrentScans_MultipleIndexes (110.34s) common_test.go:61: Error in creating the index: Index default.index_company already exist === RUN TestMutationsWithMultipleIndexBuilds 2016/03/24 09:33:30 In TestMutationsWithMultipleIndexBuilds() 2016/03/24 09:33:30 In DropAllSecondaryIndexes() 2016/03/24 09:33:30 Dropped index index_company 2016/03/24 09:33:30 Generating JSON docs 2016/03/24 09:33:39 Setting initial JSON docs in KV 2016/03/24 09:35:26 Created the secondary index index_primary. Waiting for it become active 2016/03/24 09:35:26 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:35:26 Index is now active 2016/03/24 09:35:26 PERFSTAT CreateAndBuildIndex 52.4226 seconds 2016/03/24 09:35:26 Creating multiple indexes in deferred mode 2016/03/24 09:35:27 Created the secondary index index_company 2016/03/24 09:35:27 Created the secondary index index_age 2016/03/24 09:35:27 Created the secondary index index_firstname 2016/03/24 09:35:27 Created the secondary index index_lastname 2016/03/24 09:35:27 Build Indexes and wait for indexes to become active: [index_company index_age index_firstname index_lastname] 2016/03/24 09:35:27 Build command issued for the deferred indexes [index_company index_age index_firstname index_lastname] 2016/03/24 09:35:27 Waiting for the index index_company to become active 2016/03/24 09:35:27 Index state is INDEX_STATE_READY 2016/03/24 09:35:28 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:29 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:30 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:31 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:32 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:33 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:34 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:35 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:36 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:37 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:38 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:39 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:40 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:41 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:42 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:43 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:44 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:45 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:46 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:47 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:48 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:49 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:50 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:51 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:52 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:53 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:54 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:55 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:56 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:57 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:58 Index state is INDEX_STATE_INITIAL 2016/03/24 09:35:59 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:00 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:01 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:02 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:03 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:04 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:05 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:06 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:07 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:08 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:09 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:10 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:11 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:12 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:13 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:14 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:15 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:16 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:17 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:18 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:19 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:20 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:21 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:22 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:23 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:24 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:25 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:26 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:27 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:28 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:29 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:30 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:31 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:32 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:33 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:34 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:35 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:36 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:37 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:38 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:39 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:40 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:41 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:42 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:43 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:44 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:45 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:46 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:47 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:48 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:49 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:50 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:51 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:52 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:53 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:54 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:55 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:56 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:57 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:58 Index state is INDEX_STATE_INITIAL 2016/03/24 09:36:59 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:00 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:01 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:02 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:03 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:04 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:05 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:06 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:07 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:08 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:09 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:10 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:11 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:12 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:13 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:14 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:15 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:16 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:17 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:18 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:19 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:20 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:21 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:22 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:23 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:24 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:25 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:26 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:27 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:28 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:29 Index state is INDEX_STATE_INITIAL 2016/03/24 09:37:30 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:37:30 Index is now active 2016/03/24 09:37:30 Waiting for the index index_age to become active 2016/03/24 09:37:30 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:37:30 Index is now active 2016/03/24 09:37:30 Waiting for the index index_firstname to become active 2016/03/24 09:37:30 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:37:30 Index is now active 2016/03/24 09:37:30 Waiting for the index index_lastname to become active 2016/03/24 09:37:30 Index state is INDEX_STATE_ACTIVE 2016/03/24 09:37:30 Index is now active --- PASS: TestMutationsWithMultipleIndexBuilds (240.60s) FAIL exit status 1 FAIL github.com/couchbase/indexing/secondary/tests/largedatatests 1090.812s Integration tests echo "Running 2i integration tests with 4 node cluster" Running 2i integration tests with 4 node cluster scripts/start_cluster_and_run_tests.sh b/resources/dev-4-nodes-xdcr_n1ql_2i.ini conf/simple_2i_n1ql.conf /opt/build/testrunner /opt/build/testrunner make[1]: Entering directory '/opt/build/ns_server' cd build && make --no-print-directory ns_dataclean Built target ns_dataclean make[1]: Leaving directory '/opt/build/ns_server' make[1]: Entering directory '/opt/build/ns_server' cd build && make --no-print-directory all Built target all_images Building Go target vbmap using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" vbmap Built target vbmap Building Go target ns_gozip using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" gozip Built target ns_gozip Building Go target ns_goport using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" goport Built target ns_goport Building Go target ns_generate_cert using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" generate_cert Built target ns_generate_cert Building Go target ns_godu using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" godu Built target ns_godu Building Go target ns_minify using Go 1.5.2 -- Executing: /home/buildbot/.cbdepscache/exploded/x86_64/go-1.5.2/go/bin/go install -pkgdir /opt/build/build/gopkg/go-1.5.2 -tags="" -gcflags="" -ldflags="" minify Built target ns_minify -- Building app.min.js and index.min.html ... Built target minify Built target ale-cfg ==> ale (compile) Built target ale ==> ns_couchdb (compile) Built target ns_couchdb ==> gen_smtp (compile) Built target gen_smtp Built target ns_cfg ==> mlockall (compile) Built target mlockall ==> ns_babysitter (compile) Built target ns_babysitter ==> ns_ssl_proxy (compile) Built target ns_ssl_proxy ==> ns_server (compile) Built target ns_server make[1]: Leaving directory '/opt/build/ns_server' /opt/build/testrunner filename: conf/simple_2i_n1ql.conf prefix: 2i.indexscans_2i.SecondaryIndexingScanTests prefix: 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests prefix: 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests Global Test input params: {'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'conf_file': 'conf/simple_2i_n1ql.conf', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'makefile': 'True', 'num_nodes': 4, 'spec': 'simple_2i_n1ql'} Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_1 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 1, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_1', 'spec': 'simple_2i_n1ql'} Run before suite setup for 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index 2016-03-24 09:38:02 | WARNING | MainProcess | MainThread | [data_helper.] Can not import concurrent module. Data for each server will be loaded/retrieved sequentially test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... 2016-03-24 09:38:02 | ERROR | MainProcess | test_thread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 2016-03-24 09:38:05 | ERROR | MainProcess | test_thread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 2016-03-24 09:38:08 | ERROR | MainProcess | test_thread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 2016-03-24 09:38:12 | ERROR | MainProcess | test_thread | [rest_client._http_request] http://127.0.0.1:9000/pools/default error 404 reason: unknown "unknown pool" 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster [] 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [basetestcase.setUp] ============== basetestcase setup was started for test #1 test_multi_create_query_explain_drop_index============== 2016-03-24 09:38:12 | ERROR | MainProcess | test_thread | [rest_client._http_request] http://127.0.0.1:9000/pools/default/ error 404 reason: unknown "unknown pool" 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:12 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs. ... 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 test_multi_create_query_explain_drop_index ============== 2016-03-24 09:38:22 | ERROR | MainProcess | test_thread | [rest_client._http_request] http://127.0.0.1:9000/pools/default/ error 404 reason: unknown "unknown pool" 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 test_multi_create_query_explain_drop_index ============== Cluster instance shutdown with force 2016-03-24 09:38:22 | INFO | MainProcess | test_thread | [basetestcase.setUp] initializing cluster 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=8041 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=8041 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=8041 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=8041 2016-03-24 09:38:23 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb 2016-03-24 09:38:23 | INFO | MainProcess | test_thread | [basetestcase.setUp] done initializing cluster 2016-03-24 09:38:24 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None 2016-03-24 09:38:24 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket default 2016-03-24 09:38:24 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops 2016-03-24 09:38:25 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default 2016-03-24 09:38:26 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default 2016-03-24 09:38:26 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'default' was created with per node RAM quota: 8041 2016-03-24 09:38:26 | INFO | MainProcess | test_thread | [basetestcase.setUp] ============== basetestcase setup was finished for test #1 test_multi_create_query_explain_drop_index ============== 2016-03-24 09:38:26 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs. ... 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1 is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1 is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1 is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1 is healthy 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: 2016-03-24 09:38:36 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 127.0.0.1 2016-03-24 09:38:37 | INFO | MainProcess | test_thread | [basetestcase.load] create 2016 to default documents... 2016-03-24 09:38:37 | INFO | MainProcess | test_thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [basetestcase.load] LOAD IS FINISHED 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [newtuq.setUp] ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.create_primary_index] CREATE PRIMARY INDEX ON default USING GSI 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary' 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 26.045195ms 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY CREATE PRIMARY INDEX ON default USING GSI 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 494.625569ms 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary' 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 16.128298ms 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [base_2i.setUp] {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] 2016-03-24 09:38:39 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] 2016-03-24 09:38:40 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY CREATE INDEX employeed8d10d2edafc41acb65555b6e88f7998job_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} 2016-03-24 09:38:40 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=CREATE+INDEX+employeed8d10d2edafc41acb65555b6e88f7998job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D 2016-03-24 09:38:40 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 24.098916ms 2016-03-24 09:38:40 | INFO | MainProcess | test_thread | [base_2i.async_build_index] BUILD INDEX on default(employeed8d10d2edafc41acb65555b6e88f7998job_title) USING GSI 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY BUILD INDEX on default(employeed8d10d2edafc41acb65555b6e88f7998job_title) USING GSI 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=BUILD+INDEX+on+default%28employeed8d10d2edafc41acb65555b6e88f7998job_title%29+USING+GSI 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 9.563198ms 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employeed8d10d2edafc41acb65555b6e88f7998job_title' 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeed8d10d2edafc41acb65555b6e88f7998job_title%27 2016-03-24 09:38:41 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 16.741562ms 2016-03-24 09:38:42 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employeed8d10d2edafc41acb65555b6e88f7998job_title' 2016-03-24 09:38:42 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeed8d10d2edafc41acb65555b6e88f7998job_title%27 2016-03-24 09:38:42 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 20.032492ms 2016-03-24 09:38:43 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employeed8d10d2edafc41acb65555b6e88f7998job_title' 2016-03-24 09:38:43 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeed8d10d2edafc41acb65555b6e88f7998job_title%27 2016-03-24 09:38:43 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 13.518318ms 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [task.execute] <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 2.910103ms 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [task.execute] {u'status': u'success', u'metrics': {u'elapsedTime': u'2.910103ms', u'executionTime': u'2.851334ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employeed8d10d2edafc41acb65555b6e88f7998job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'd95227c5-1c98-442d-9fd7-9da8ce26704c', u'signature': u'json'} 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [task.execute] <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:44 | INFO | MainProcess | Cluster_Thread | [task.check] <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:44 | INFO | MainProcess | test_thread | [base_2i.async_query_using_index] Query : SELECT * FROM default WHERE job_title = "Sales" 2016-03-24 09:38:44 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] FROM clause ===== is default 2016-03-24 09:38:44 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] WHERE clause ===== is doc["job_title"] == "Sales" 2016-03-24 09:38:44 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] UNNEST clause ===== is None 2016-03-24 09:38:44 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] SELECT clause ===== is {"*" : doc,} 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [task.execute] <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM default WHERE job_title = "Sales" 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 146.194249ms 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [tuq_helper._verify_results] Analyzing Actual Result 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [tuq_helper._verify_results] Analyzing Expected Result 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [task.execute] <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:45 | INFO | MainProcess | Cluster_Thread | [task.check] <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employeed8d10d2edafc41acb65555b6e88f7998job_title' 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeed8d10d2edafc41acb65555b6e88f7998job_title%27 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 14.558408ms 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY DROP INDEX default.employeed8d10d2edafc41acb65555b6e88f7998job_title USING GSI 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=DROP+INDEX+default.employeed8d10d2edafc41acb65555b6e88f7998job_title+USING+GSI 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 15.755004ms 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employeed8d10d2edafc41acb65555b6e88f7998job_title' 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeed8d10d2edafc41acb65555b6e88f7998job_title%27 2016-03-24 09:38:46 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 18.473904ms 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.drop_primary_index] CHECK FOR PRIMARY INDEXES 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.drop_primary_index] DROP PRIMARY INDEX ON default USING GSI 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary' 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 11.768882ms 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY DROP PRIMARY INDEX ON default USING GSI 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 11.96605ms 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: killall cbq-engine 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: killall tuqtng 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: killall indexer 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 test_multi_create_query_explain_drop_index ============== 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [u'default'] on 127.0.0.1 2016-03-24 09:38:46 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ... 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 127.0.0.1 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete.... 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [rest_client.bucket_exists] node 127.0.0.1 existing buckets : [] 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 127.0.0.1 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running 2016-03-24 09:38:47 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 44.326s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 1 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_1 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_2 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=False Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'False', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 2, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_2', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:38:47,191] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:38:47,192] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #2 test_multi_create_query_explain_drop_index============== [2016-03-24 09:38:47,203] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:38:47,207] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:38:47,212] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:38:47,216] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:38:47,226] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:38:57,234] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:38:57,237] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:38:57,239] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:38:57,242] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:38:57,245] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:38:57,248] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:38:57,250] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:38:57,253] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:38:57,253] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:38:58,203] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:38:58,205] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:38:58,205] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:38:58,205] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:38:58,215] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:38:58,217] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:38:58,245] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:38:58,255] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:38:58,262] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:38:58,271] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:38:58,280] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:38:58,286] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:38:58,297] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:38:58,314] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:38:58,318] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:38:58,327] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:38:59,338] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:38:59,342] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:38:59,344] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:39:00,415] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:00,444] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:00,469] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:39:00,502] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #2 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:39:00,507] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:39:10,521] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:10,522] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:10,528] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:10,528] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:10,534] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:10,534] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:10,540] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:10,540] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:10,550] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:10,550] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:39:10,550] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:39:11,510] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:39:11,533] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:13,664] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:39:13,675] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:13,675] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:39:13,675] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:39:13,675] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:13,678] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:13,707] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 27.20441ms [2016-03-24 09:39:13,707] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:39:13,710] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:39:14,205] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 492.59391ms [2016-03-24 09:39:14,205] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:14,208] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:14,223] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.696108ms [2016-03-24 09:39:14,224] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:39:14,240] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:14,247] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:14,490] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee62489f8d2947461a8f2112821723a1e7job_title ON default(job_title) USING VIEW [2016-03-24 09:39:14,493] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee62489f8d2947461a8f2112821723a1e7job_title+ON+default%28job_title%29+USING+VIEW+ [2016-03-24 09:39:14,855] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 361.050899ms [2016-03-24 09:39:14,856] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee62489f8d2947461a8f2112821723a1e7job_title' [2016-03-24 09:39:14,859] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee62489f8d2947461a8f2112821723a1e7job_title%27 [2016-03-24 09:39:14,886] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 25.46709ms [2016-03-24 09:39:15,887] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:15,887] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:15,890] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:39:15,894] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 2.746415ms [2016-03-24 09:39:15,895] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'2.746415ms', u'executionTime': u'2.690029ms', u'resultSize': 2354, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee62489f8d2947461a8f2112821723a1e7job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'view'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'cfb97b03-1963-48d9-951f-1eeef81da937', u'signature': u'json'} [2016-03-24 09:39:15,895] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:15,895] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:15,895] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:15,896] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:39:15,896] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:39:15,896] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:39:15,896] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:39:16,896] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:16,897] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:16,900] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:39:17,087] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 172.085187ms [2016-03-24 09:39:17,109] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:39:17,110] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:39:17,113] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:17,114] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:18,115] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee62489f8d2947461a8f2112821723a1e7job_title' [2016-03-24 09:39:18,118] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee62489f8d2947461a8f2112821723a1e7job_title%27 [2016-03-24 09:39:18,136] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.868448ms [2016-03-24 09:39:18,137] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee62489f8d2947461a8f2112821723a1e7job_title USING VIEW [2016-03-24 09:39:18,139] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee62489f8d2947461a8f2112821723a1e7job_title+USING+VIEW+ [2016-03-24 09:39:18,145] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 4.076371ms [2016-03-24 09:39:18,145] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee62489f8d2947461a8f2112821723a1e7job_title' [2016-03-24 09:39:18,150] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee62489f8d2947461a8f2112821723a1e7job_title%27 [2016-03-24 09:39:18,163] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 12.210568ms [2016-03-24 09:39:18,168] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:18,168] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:39:18,168] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:39:18,169] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:18,171] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:18,193] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.322558ms [2016-03-24 09:39:18,193] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:39:18,196] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:39:18,211] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.556837ms [2016-03-24 09:39:18,363] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:39:18,384] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:18,385] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:39:18,410] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:18,411] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:39:18,446] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:18,446] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:39:18,476] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:18,477] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #2 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:39:18,496] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:39:18,496] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:39:18,797] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:39:18,798] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:39:18,800] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:39:18,805] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,812] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,818] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,831] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:39:18,834] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:39:18,836] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:39:18,839] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:39:18,842] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:39:18,845] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:39:18,848] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:39:18,850] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:39:18,851] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #2 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 31.670s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 2 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_2 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_3 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=False,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'False', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 3, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_3', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:39:18,874] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:39:18,874] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #3 test_multi_create_query_explain_drop_index============== [2016-03-24 09:39:18,886] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,890] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,895] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,899] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:18,909] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:39:28,914] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:39:28,916] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:39:28,919] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:39:28,921] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:39:28,924] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:39:28,926] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:39:28,929] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:39:28,932] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:39:28,932] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:39:29,887] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:39:29,889] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:39:29,889] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:39:29,889] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:39:29,901] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:39:29,904] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:39:29,927] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:39:29,939] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:39:29,942] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:39:29,953] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:39:29,968] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:39:29,971] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:39:29,981] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:39:29,991] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:39:29,994] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:39:29,998] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:39:31,007] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:39:31,012] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:39:31,012] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:39:32,080] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:32,112] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:32,136] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:39:32,173] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #3 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:39:32,177] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:39:42,185] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:42,185] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:42,191] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:42,191] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:42,197] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:42,197] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:42,207] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:39:42,207] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:39:42,212] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:42,212] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:39:42,212] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:39:43,145] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:39:43,163] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:39:45,338] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:39:45,349] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:45,349] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:39:45,349] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:39:45,349] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:45,352] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:45,386] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 32.317385ms [2016-03-24 09:39:45,386] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:39:45,390] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+VIEW+ [2016-03-24 09:39:45,751] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 359.452728ms [2016-03-24 09:39:45,751] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:45,754] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:45,777] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 21.67291ms [2016-03-24 09:39:45,778] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:39:45,787] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:45,792] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:46,154] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee68e9a4ceec0847e99cd920b2f156b43bjob_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:39:46,157] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee68e9a4ceec0847e99cd920b2f156b43bjob_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:39:46,199] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 39.697014ms [2016-03-24 09:39:46,199] - [base_2i:102] INFO - BUILD INDEX on default(employee68e9a4ceec0847e99cd920b2f156b43bjob_title) USING GSI [2016-03-24 09:39:47,200] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee68e9a4ceec0847e99cd920b2f156b43bjob_title) USING GSI [2016-03-24 09:39:47,203] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee68e9a4ceec0847e99cd920b2f156b43bjob_title%29+USING+GSI [2016-03-24 09:39:47,216] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 10.348172ms [2016-03-24 09:39:47,216] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee68e9a4ceec0847e99cd920b2f156b43bjob_title' [2016-03-24 09:39:47,221] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee68e9a4ceec0847e99cd920b2f156b43bjob_title%27 [2016-03-24 09:39:47,241] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.097276ms [2016-03-24 09:39:48,242] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee68e9a4ceec0847e99cd920b2f156b43bjob_title' [2016-03-24 09:39:48,246] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee68e9a4ceec0847e99cd920b2f156b43bjob_title%27 [2016-03-24 09:39:48,264] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.644595ms [2016-03-24 09:39:49,265] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:49,266] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:49,269] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:39:49,273] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.187509ms [2016-03-24 09:39:49,274] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.187509ms', u'executionTime': u'3.131241ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee68e9a4ceec0847e99cd920b2f156b43bjob_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'7183d900-6faa-4cb1-9c55-ae80d548ae6a', u'signature': u'json'} [2016-03-24 09:39:49,274] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:49,274] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:49,274] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:49,274] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:39:49,275] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:39:49,275] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:39:49,275] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:39:50,275] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:50,276] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:39:50,279] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:39:50,462] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 168.562425ms [2016-03-24 09:39:50,481] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:39:50,481] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:39:50,483] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:50,484] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:39:51,485] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee68e9a4ceec0847e99cd920b2f156b43bjob_title' [2016-03-24 09:39:51,488] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee68e9a4ceec0847e99cd920b2f156b43bjob_title%27 [2016-03-24 09:39:51,510] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.032277ms [2016-03-24 09:39:51,510] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee68e9a4ceec0847e99cd920b2f156b43bjob_title USING GSI [2016-03-24 09:39:51,514] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee68e9a4ceec0847e99cd920b2f156b43bjob_title+USING+GSI [2016-03-24 09:39:51,530] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.144934ms [2016-03-24 09:39:51,531] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee68e9a4ceec0847e99cd920b2f156b43bjob_title' [2016-03-24 09:39:51,534] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee68e9a4ceec0847e99cd920b2f156b43bjob_title%27 [2016-03-24 09:39:51,561] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 25.176011ms [2016-03-24 09:39:51,566] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:39:51,566] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:39:51,567] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:39:51,567] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:39:51,569] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:39:51,585] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.419837ms [2016-03-24 09:39:51,585] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:39:51,588] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+VIEW+ [2016-03-24 09:39:51,595] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 5.595886ms [2016-03-24 09:39:51,775] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:39:51,802] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:51,803] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:39:51,832] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:51,832] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:39:51,868] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:51,868] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:39:51,901] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:39:51,902] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #3 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:39:51,929] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:39:51,929] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:39:52,281] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:39:52,281] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:39:52,283] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:39:52,289] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,294] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,299] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,311] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:39:52,317] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:39:52,320] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:39:52,323] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:39:52,325] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:39:52,328] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:39:52,331] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:39:52,333] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:39:52,334] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #3 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 33.470s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 3 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_3 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_4 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=False,use_gsi_for_secondary=False Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'False', 'use_gsi_for_secondary': 'False', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 4, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_4', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:39:52,359] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:39:52,359] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #4 test_multi_create_query_explain_drop_index============== [2016-03-24 09:39:52,377] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,381] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,386] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,391] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:39:52,400] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:40:02,413] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:40:02,416] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:40:02,419] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:40:02,422] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:40:02,424] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:40:02,427] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:40:02,430] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:40:02,437] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:40:02,437] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:40:03,371] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:40:03,377] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:40:03,377] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:40:03,377] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:40:03,388] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:03,391] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:03,412] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:40:03,432] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:03,438] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:03,449] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:40:03,460] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:03,463] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:03,474] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:40:03,485] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:03,489] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:03,496] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:40:04,510] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:40:04,515] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:40:04,515] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:40:05,587] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:05,622] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:05,651] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:40:05,672] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #4 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:40:05,677] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:40:15,693] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:15,694] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:15,699] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:15,699] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:15,705] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:15,706] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:15,711] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:15,712] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:15,717] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:15,717] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:40:15,717] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:40:16,665] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:40:16,681] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:18,848] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:40:18,859] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:18,859] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:40:18,859] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:40:18,859] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:40:18,862] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:40:18,897] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.39406ms [2016-03-24 09:40:18,898] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:40:18,901] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+VIEW+ [2016-03-24 09:40:23,926] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 5.023055954s [2016-03-24 09:40:23,926] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:40:23,929] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:40:23,950] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.315518ms [2016-03-24 09:40:23,951] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:40:23,961] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:23,969] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:24,674] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee9f96caf70bb245dcb599127a341a5923job_title ON default(job_title) USING VIEW [2016-03-24 09:40:24,677] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee9f96caf70bb245dcb599127a341a5923job_title+ON+default%28job_title%29+USING+VIEW+ [2016-03-24 09:40:25,013] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 335.13186ms [2016-03-24 09:40:25,014] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee9f96caf70bb245dcb599127a341a5923job_title' [2016-03-24 09:40:25,017] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee9f96caf70bb245dcb599127a341a5923job_title%27 [2016-03-24 09:40:25,050] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 31.931992ms [2016-03-24 09:40:26,051] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:26,052] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:40:26,055] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:40:26,058] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 1.67074ms [2016-03-24 09:40:26,058] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'1.67074ms', u'executionTime': u'1.619583ms', u'resultSize': 2354, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee9f96caf70bb245dcb599127a341a5923job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'view'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'90031ffa-9936-46f7-82d3-3d23bebf601f', u'signature': u'json'} [2016-03-24 09:40:26,059] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:26,059] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:26,059] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:40:26,059] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:40:26,059] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:40:26,060] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:40:26,060] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:40:27,060] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:27,060] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:40:27,064] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:40:27,243] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 164.303775ms [2016-03-24 09:40:27,261] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:40:27,262] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:40:27,264] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:27,264] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:40:28,266] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee9f96caf70bb245dcb599127a341a5923job_title' [2016-03-24 09:40:28,269] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee9f96caf70bb245dcb599127a341a5923job_title%27 [2016-03-24 09:40:28,295] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 24.567221ms [2016-03-24 09:40:28,295] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee9f96caf70bb245dcb599127a341a5923job_title USING VIEW [2016-03-24 09:40:28,298] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee9f96caf70bb245dcb599127a341a5923job_title+USING+VIEW+ [2016-03-24 09:40:28,304] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 2.745396ms [2016-03-24 09:40:28,304] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee9f96caf70bb245dcb599127a341a5923job_title' [2016-03-24 09:40:28,307] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee9f96caf70bb245dcb599127a341a5923job_title%27 [2016-03-24 09:40:28,368] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 59.963842ms [2016-03-24 09:40:28,374] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:28,374] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:40:28,375] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:40:28,375] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:40:28,378] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:40:28,441] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 61.267843ms [2016-03-24 09:40:28,441] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:40:28,444] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+VIEW+ [2016-03-24 09:40:28,450] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 4.330821ms [2016-03-24 09:40:28,596] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:40:28,617] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:40:28,617] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:40:28,642] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:40:28,643] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:40:28,679] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:40:28,679] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:40:28,713] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:40:28,713] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #4 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:40:28,733] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:40:28,733] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:40:30,026] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:40:30,026] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:40:30,028] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:40:30,033] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,038] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,043] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,066] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:40:30,069] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:40:30,072] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:40:30,074] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:40:30,077] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:40:30,080] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:40:30,083] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:40:30,085] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:40:30,085] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #4 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 37.741s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 4 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_4 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_5 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,delete_ops_per=.5,run_async=True,scan_consistency=request_plus Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'makefile': 'True', 'delete_ops_per': '.5', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'num_nodes': 4, 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 5, 'scan_consistency': 'request_plus', 'run_async': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_5', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:40:30,117] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:40:30,117] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #5 test_multi_create_query_explain_drop_index============== [2016-03-24 09:40:30,128] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,133] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,138] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,143] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:40:30,156] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:40:40,169] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:40:40,172] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:40:40,174] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:40:40,177] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:40:40,180] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:40:40,185] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:40:40,188] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:40:40,191] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:40:40,191] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:40:41,127] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:40:41,129] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:40:41,129] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:40:41,129] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:40:41,139] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:41,142] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:41,165] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:40:41,178] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:41,182] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:41,193] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:40:41,203] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:41,206] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:41,215] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:40:41,226] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:40:41,230] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:40:41,234] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:40:42,243] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:40:42,247] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:40:42,248] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:40:43,310] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:43,343] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:43,370] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:40:43,414] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #5 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:40:43,421] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:40:53,437] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:53,437] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:53,443] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:53,443] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:53,449] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:53,449] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:53,455] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:40:53,455] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:40:53,460] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:53,460] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:40:53,460] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:40:54,404] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:40:54,427] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:40:56,577] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:40:56,581] - [newtuq:82] INFO - {'remaining': {'start': 0, 'end': 1}, 'delete': {'start': 0, 'end': 0}} [2016-03-24 09:40:57,164] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:57,165] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:40:57,165] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:40:57,165] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:40:57,169] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:40:57,209] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 37.923219ms [2016-03-24 09:40:57,209] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:40:57,212] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:40:57,718] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 504.309439ms [2016-03-24 09:40:57,718] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:40:57,721] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:40:57,739] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.771513ms [2016-03-24 09:40:57,740] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:40:57,750] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:57,755] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:40:58,392] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee130039b6bef4483db72e8d20418b8515job_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:40:58,395] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee130039b6bef4483db72e8d20418b8515job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:40:58,425] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 27.62431ms [2016-03-24 09:40:58,425] - [base_2i:102] INFO - BUILD INDEX on default(employee130039b6bef4483db72e8d20418b8515job_title) USING GSI [2016-03-24 09:40:59,426] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee130039b6bef4483db72e8d20418b8515job_title) USING GSI [2016-03-24 09:40:59,429] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee130039b6bef4483db72e8d20418b8515job_title%29+USING+GSI [2016-03-24 09:40:59,442] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.501672ms [2016-03-24 09:41:00,443] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee130039b6bef4483db72e8d20418b8515job_title' [2016-03-24 09:41:00,447] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee130039b6bef4483db72e8d20418b8515job_title%27 [2016-03-24 09:41:00,463] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.756933ms [2016-03-24 09:41:01,464] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee130039b6bef4483db72e8d20418b8515job_title' [2016-03-24 09:41:01,467] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee130039b6bef4483db72e8d20418b8515job_title%27 [2016-03-24 09:41:01,482] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.156538ms [2016-03-24 09:41:01,947] - [basetestcase:2084] INFO - delete 0 to default documents... [2016-03-24 09:41:01,964] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:02,486] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:41:03,489] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:03,489] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:03,492] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:41:03,498] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.472636ms [2016-03-24 09:41:03,498] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.472636ms', u'executionTime': u'3.40699ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee130039b6bef4483db72e8d20418b8515job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'0d5229dd-eb70-40e8-ac16-d7e1bdfb1efc', u'signature': u'json'} [2016-03-24 09:41:03,498] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:03,498] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:03,498] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:03,499] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:41:03,499] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:41:03,499] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:41:03,499] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:41:04,499] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:04,499] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:04,502] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:41:04,700] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 182.088298ms [2016-03-24 09:41:04,718] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:41:04,718] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:41:04,721] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:04,721] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:05,723] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee130039b6bef4483db72e8d20418b8515job_title' [2016-03-24 09:41:05,726] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee130039b6bef4483db72e8d20418b8515job_title%27 [2016-03-24 09:41:05,745] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.564821ms [2016-03-24 09:41:05,745] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee130039b6bef4483db72e8d20418b8515job_title USING GSI [2016-03-24 09:41:05,748] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee130039b6bef4483db72e8d20418b8515job_title+USING+GSI [2016-03-24 09:41:05,768] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.940489ms [2016-03-24 09:41:05,768] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee130039b6bef4483db72e8d20418b8515job_title' [2016-03-24 09:41:05,771] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee130039b6bef4483db72e8d20418b8515job_title%27 [2016-03-24 09:41:05,784] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 12.107613ms [2016-03-24 09:41:05,789] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:05,790] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:41:05,790] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:05,790] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:41:05,792] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:41:05,815] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 21.105407ms [2016-03-24 09:41:05,815] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:05,818] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:41:05,833] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.89832ms [2016-03-24 09:41:06,033] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:41:06,065] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:06,065] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:41:06,098] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:06,099] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:41:06,140] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:06,141] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:41:06,184] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:06,185] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #5 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:41:06,210] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:41:06,210] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:41:06,530] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:41:06,530] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:41:06,533] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:41:06,541] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,549] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,555] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,568] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:41:06,574] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:41:06,577] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:41:06,580] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:41:06,583] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:41:06,586] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:41:06,590] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:41:06,593] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:41:06,593] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #5 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 36.489s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 5 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_5 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_6 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,update_ops_per=.5,run_async=True,scan_consistency=request_plus Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'num_nodes': 4, 'update_ops_per': '.5', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 6, 'scan_consistency': 'request_plus', 'run_async': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_6', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:41:06,642] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:41:06,642] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #6 test_multi_create_query_explain_drop_index============== [2016-03-24 09:41:06,655] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,660] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,664] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,668] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:06,678] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:41:16,689] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:41:16,692] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:41:16,694] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:41:16,697] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:41:16,699] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:41:16,702] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:41:16,705] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:41:16,708] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:41:16,708] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:41:17,649] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:41:17,652] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:41:17,652] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:41:17,652] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:41:17,661] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:17,664] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:17,687] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:41:17,701] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:17,708] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:17,717] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:41:17,728] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:17,731] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:17,741] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:41:17,750] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:17,753] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:17,758] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:41:18,767] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:41:18,777] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:41:18,778] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:41:19,846] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:19,881] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:19,907] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:41:19,933] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #6 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:41:19,937] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:41:29,954] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:41:29,954] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:41:29,959] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:41:29,959] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:41:29,966] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:41:29,966] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:41:29,972] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:41:29,972] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:41:29,982] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:29,982] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:41:29,982] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:41:30,912] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:41:30,932] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:33,110] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:41:33,114] - [newtuq:82] INFO - {'update': {'start': 0, 'end': 0}, 'remaining': {'start': 0, 'end': 1}} [2016-03-24 09:41:33,905] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:33,905] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:41:33,905] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:33,906] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:41:33,908] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:41:33,936] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 26.350423ms [2016-03-24 09:41:33,937] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:33,940] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:41:34,458] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 515.680299ms [2016-03-24 09:41:34,458] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:41:34,461] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:41:34,476] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.728208ms [2016-03-24 09:41:34,477] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:41:34,487] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:34,492] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:34,926] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee7654639f7d5642aa930464f530a4fc33job_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:41:34,929] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee7654639f7d5642aa930464f530a4fc33job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:41:34,965] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.826889ms [2016-03-24 09:41:34,965] - [base_2i:102] INFO - BUILD INDEX on default(employee7654639f7d5642aa930464f530a4fc33job_title) USING GSI [2016-03-24 09:41:35,966] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee7654639f7d5642aa930464f530a4fc33job_title) USING GSI [2016-03-24 09:41:35,969] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee7654639f7d5642aa930464f530a4fc33job_title%29+USING+GSI [2016-03-24 09:41:35,984] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 12.821836ms [2016-03-24 09:41:36,985] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7654639f7d5642aa930464f530a4fc33job_title' [2016-03-24 09:41:36,988] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7654639f7d5642aa930464f530a4fc33job_title%27 [2016-03-24 09:41:37,011] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.704821ms [2016-03-24 09:41:38,012] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7654639f7d5642aa930464f530a4fc33job_title' [2016-03-24 09:41:38,015] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7654639f7d5642aa930464f530a4fc33job_title%27 [2016-03-24 09:41:38,031] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.410462ms [2016-03-24 09:41:38,487] - [basetestcase:2084] INFO - update 0 to default documents... [2016-03-24 09:41:38,505] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:39,034] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:41:40,038] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:40,038] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:40,041] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:41:40,046] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.036407ms [2016-03-24 09:41:40,046] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.036407ms', u'executionTime': u'2.978418ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee7654639f7d5642aa930464f530a4fc33job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'76307b3c-b2fd-427a-9639-c4233ba2f117', u'signature': u'json'} [2016-03-24 09:41:40,046] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:40,046] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:40,047] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:40,047] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:41:40,047] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:41:40,047] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:41:40,047] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:41:41,048] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:41,048] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:41:41,053] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:41:41,231] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 161.757131ms [2016-03-24 09:41:41,250] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:41:41,250] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:41:41,253] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:41,253] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:41:42,255] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7654639f7d5642aa930464f530a4fc33job_title' [2016-03-24 09:41:42,258] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7654639f7d5642aa930464f530a4fc33job_title%27 [2016-03-24 09:41:42,272] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.358758ms [2016-03-24 09:41:42,273] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee7654639f7d5642aa930464f530a4fc33job_title USING GSI [2016-03-24 09:41:42,275] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee7654639f7d5642aa930464f530a4fc33job_title+USING+GSI [2016-03-24 09:41:42,292] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.335269ms [2016-03-24 09:41:42,292] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7654639f7d5642aa930464f530a4fc33job_title' [2016-03-24 09:41:42,296] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7654639f7d5642aa930464f530a4fc33job_title%27 [2016-03-24 09:41:42,318] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.750955ms [2016-03-24 09:41:42,325] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:41:42,325] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:41:42,326] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:42,326] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:41:42,328] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:41:42,342] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.678714ms [2016-03-24 09:41:42,342] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:41:42,344] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:41:42,363] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.831337ms [2016-03-24 09:41:42,574] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:41:42,602] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:42,602] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:41:42,634] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:42,635] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:41:42,676] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:42,677] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:41:42,724] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:41:42,725] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #6 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:41:42,746] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:41:42,746] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:41:44,045] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:41:44,045] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:41:44,048] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:41:44,054] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,064] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,071] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,084] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:41:44,086] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:41:44,089] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:41:44,092] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:41:44,095] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:41:44,097] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:41:44,100] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:41:44,102] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:41:44,102] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #6 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 37.479s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 6 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_6 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_7 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,expiry_ops_per=.5,run_async=True,scan_consistency=request_plus Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'case_number': 7, 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'expiry_ops_per': '.5', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:equals:no_orderby_groupby:range', 'num_nodes': 4, 'scan_consistency': 'request_plus', 'run_async': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_7', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:41:44,157] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:41:44,157] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #7 test_multi_create_query_explain_drop_index============== [2016-03-24 09:41:44,169] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,173] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,178] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,182] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:41:44,192] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:41:54,205] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:41:54,208] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:41:54,211] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:41:54,213] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:41:54,216] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:41:54,218] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:41:54,221] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:41:54,224] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:41:54,224] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:41:55,166] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:41:55,168] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:41:55,168] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:41:55,168] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:41:55,178] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:55,184] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:55,208] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:41:55,226] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:55,230] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:55,239] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:41:55,252] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:55,260] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:55,270] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:41:55,281] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:41:55,284] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:41:55,288] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:41:56,297] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:41:56,302] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:41:56,302] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:41:57,367] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:57,405] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:41:57,434] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:41:57,466] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #7 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:41:57,473] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:42:07,492] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:07,492] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:07,498] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:07,498] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:07,504] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:07,504] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:07,510] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:07,510] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:07,517] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:07,517] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:42:07,517] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:42:08,442] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:42:08,461] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:10,629] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:42:10,634] - [newtuq:82] INFO - {'remaining': {'start': 0, 'end': 1}, 'expiry': {'start': 0, 'end': 0}} [2016-03-24 09:42:11,206] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:11,207] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:42:11,207] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:11,207] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:42:11,210] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:42:11,249] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 37.572827ms [2016-03-24 09:42:11,249] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:11,253] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:42:11,783] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 527.083362ms [2016-03-24 09:42:11,783] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:42:11,786] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:42:11,806] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.686707ms [2016-03-24 09:42:11,807] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:42:11,818] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:11,824] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:12,453] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee10d29461a6b948b395370a7b757d4e8bjob_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:42:12,456] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee10d29461a6b948b395370a7b757d4e8bjob_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:42:12,493] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 34.688261ms [2016-03-24 09:42:12,493] - [base_2i:102] INFO - BUILD INDEX on default(employee10d29461a6b948b395370a7b757d4e8bjob_title) USING GSI [2016-03-24 09:42:13,494] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee10d29461a6b948b395370a7b757d4e8bjob_title) USING GSI [2016-03-24 09:42:13,498] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee10d29461a6b948b395370a7b757d4e8bjob_title%29+USING+GSI [2016-03-24 09:42:13,512] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.997106ms [2016-03-24 09:42:14,513] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee10d29461a6b948b395370a7b757d4e8bjob_title' [2016-03-24 09:42:14,516] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee10d29461a6b948b395370a7b757d4e8bjob_title%27 [2016-03-24 09:42:14,539] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 21.212079ms [2016-03-24 09:42:15,540] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee10d29461a6b948b395370a7b757d4e8bjob_title' [2016-03-24 09:42:15,544] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee10d29461a6b948b395370a7b757d4e8bjob_title%27 [2016-03-24 09:42:15,560] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.4743ms [2016-03-24 09:42:16,003] - [basetestcase:2084] INFO - update 0 to default documents... [2016-03-24 09:42:16,020] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:16,563] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:42:16,583] - [data_helper:292] INFO - dict:{'username': 'Administrator', 'ip': '127.0.0.1', 'password': 'asdasd', 'port': u'9000'} [2016-03-24 09:42:16,583] - [data_helper:293] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:16,600] - [cluster_helper:341] INFO - Setting flush param on server {'username': 'Administrator', 'ip': '127.0.0.1', 'password': 'asdasd', 'port': u'9000'}, exp_pager_stime to 10 on default setting param: exp_pager_stime 10 [2016-03-24 09:42:16,600] - [cluster_helper:355] INFO - Setting flush param on server {'username': 'Administrator', 'ip': '127.0.0.1', 'password': 'asdasd', 'port': u'9000'}, exp_pager_stime to 10, result: (2181820141, 0, '') [2016-03-24 09:42:17,567] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:17,567] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:17,570] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:42:17,574] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.15634ms [2016-03-24 09:42:17,575] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.15634ms', u'executionTime': u'3.100093ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employee10d29461a6b948b395370a7b757d4e8bjob_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'ca49fb09-b535-4b06-b8c8-8da0710551bf', u'signature': u'json'} [2016-03-24 09:42:17,575] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:17,575] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:17,575] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:17,575] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:42:17,576] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:42:17,576] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:42:17,576] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:42:18,576] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:18,577] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:18,580] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:42:18,748] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 154.19326ms [2016-03-24 09:42:18,767] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:42:18,767] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:42:18,769] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:18,770] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:19,771] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee10d29461a6b948b395370a7b757d4e8bjob_title' [2016-03-24 09:42:19,774] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee10d29461a6b948b395370a7b757d4e8bjob_title%27 [2016-03-24 09:42:19,791] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.550904ms [2016-03-24 09:42:19,791] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee10d29461a6b948b395370a7b757d4e8bjob_title USING GSI [2016-03-24 09:42:19,794] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee10d29461a6b948b395370a7b757d4e8bjob_title+USING+GSI [2016-03-24 09:42:19,812] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.514675ms [2016-03-24 09:42:19,812] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee10d29461a6b948b395370a7b757d4e8bjob_title' [2016-03-24 09:42:19,817] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee10d29461a6b948b395370a7b757d4e8bjob_title%27 [2016-03-24 09:42:19,837] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.199813ms [2016-03-24 09:42:19,841] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:19,842] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:42:19,842] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:19,842] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:42:19,844] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:42:19,859] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 12.800872ms [2016-03-24 09:42:19,859] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:19,862] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:42:19,880] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.77725ms [2016-03-24 09:42:20,088] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:42:20,116] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:42:20,116] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:42:20,148] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:42:20,149] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:42:20,191] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:42:20,192] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:42:20,230] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:42:20,231] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #7 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:42:20,252] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:42:20,252] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:42:20,580] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:42:20,581] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:42:20,585] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:42:20,590] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,595] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,600] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,613] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:42:20,616] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:42:20,619] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:42:20,621] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:42:20,624] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:42:20,627] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:42:20,629] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:42:20,632] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:42:20,632] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #7 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 36.488s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 7 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_7 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_8 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,create_ops_per=.5,run_async=True,scan_consistency=request_plus Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'num_nodes': 4, 'run_async': 'True', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 8, 'scan_consistency': 'request_plus', 'create_ops_per': '.5', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_8', 'spec': 'simple_2i_n1ql', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini'} [2016-03-24 09:42:20,681] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:42:20,681] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #8 test_multi_create_query_explain_drop_index============== [2016-03-24 09:42:20,697] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,701] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,706] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,712] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:42:20,722] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:42:30,735] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:42:30,738] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:42:30,741] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:42:30,745] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:42:30,748] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:42:30,753] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:42:30,756] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:42:30,758] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:42:30,759] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:42:31,691] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:42:31,693] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:42:31,693] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:42:31,694] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:42:31,708] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:42:31,711] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:42:31,727] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:42:31,749] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:42:31,754] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:42:31,763] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:42:31,773] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:42:31,780] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:42:31,790] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:42:31,799] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:42:31,802] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:42:31,807] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:42:32,816] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:42:32,824] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:42:32,824] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:42:33,897] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:33,926] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:33,953] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:42:33,981] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #8 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:42:33,986] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:42:44,002] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:44,002] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:44,007] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:44,007] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:44,013] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:44,013] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:44,019] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:42:44,019] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:42:44,029] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:44,029] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:42:44,029] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:42:44,953] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:42:44,973] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:47,170] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:42:47,174] - [newtuq:82] INFO - {'create': {'start': 1, 'end': 2.5}, 'remaining': {'start': 0, 'end': 1}} [2016-03-24 09:42:48,405] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:48,405] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:42:48,405] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:48,405] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:42:48,408] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:42:48,443] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.77573ms [2016-03-24 09:42:48,443] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:42:48,447] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:42:48,951] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 502.42218ms [2016-03-24 09:42:48,951] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:42:48,954] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:42:48,967] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 12.115842ms [2016-03-24 09:42:48,968] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:42:48,977] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:48,982] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:42:49,975] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employeeebe8a1e6699f41349238225302f32976job_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:42:49,978] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employeeebe8a1e6699f41349238225302f32976job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:42:50,010] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 29.704888ms [2016-03-24 09:42:50,010] - [base_2i:102] INFO - BUILD INDEX on default(employeeebe8a1e6699f41349238225302f32976job_title) USING GSI [2016-03-24 09:42:51,012] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employeeebe8a1e6699f41349238225302f32976job_title) USING GSI [2016-03-24 09:42:51,015] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employeeebe8a1e6699f41349238225302f32976job_title%29+USING+GSI [2016-03-24 09:42:51,031] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.589579ms [2016-03-24 09:42:52,031] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeebe8a1e6699f41349238225302f32976job_title' [2016-03-24 09:42:52,034] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeebe8a1e6699f41349238225302f32976job_title%27 [2016-03-24 09:42:52,050] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.995847ms [2016-03-24 09:42:53,051] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeebe8a1e6699f41349238225302f32976job_title' [2016-03-24 09:42:53,055] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeebe8a1e6699f41349238225302f32976job_title%27 [2016-03-24 09:42:53,073] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.766171ms [2016-03-24 09:42:53,523] - [basetestcase:2084] INFO - create 3024.0 to default documents... [2016-03-24 09:42:53,544] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:42:57,453] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:42:58,083] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:58,083] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:58,086] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:42:58,091] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.034894ms [2016-03-24 09:42:58,091] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.034894ms', u'executionTime': u'2.979632ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employeeebe8a1e6699f41349238225302f32976job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'd092c817-d042-4f27-8e07-153d1e23a686', u'signature': u'json'} [2016-03-24 09:42:58,091] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:58,091] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:58,091] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:58,092] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:42:58,092] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:42:58,092] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:42:58,092] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:42:59,092] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:59,092] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:42:59,095] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:42:59,628] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 445.023227ms [2016-03-24 09:42:59,683] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:42:59,684] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:42:59,695] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:42:59,696] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:00,697] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeebe8a1e6699f41349238225302f32976job_title' [2016-03-24 09:43:00,701] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeebe8a1e6699f41349238225302f32976job_title%27 [2016-03-24 09:43:00,719] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.672116ms [2016-03-24 09:43:00,719] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employeeebe8a1e6699f41349238225302f32976job_title USING GSI [2016-03-24 09:43:00,722] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employeeebe8a1e6699f41349238225302f32976job_title+USING+GSI [2016-03-24 09:43:00,746] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 22.221987ms [2016-03-24 09:43:00,746] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeebe8a1e6699f41349238225302f32976job_title' [2016-03-24 09:43:00,750] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeebe8a1e6699f41349238225302f32976job_title%27 [2016-03-24 09:43:00,766] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.573457ms [2016-03-24 09:43:00,771] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:00,772] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:43:00,772] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:00,772] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:43:00,781] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:43:00,796] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.059938ms [2016-03-24 09:43:00,796] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:00,799] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:43:00,820] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.985294ms [2016-03-24 09:43:01,104] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:43:01,143] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:01,144] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:43:01,187] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:01,188] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:43:01,242] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:01,243] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:43:01,294] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:01,295] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #8 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:43:01,322] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:43:01,322] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:43:01,537] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:43:01,537] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:43:01,539] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:43:01,544] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,550] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,555] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,568] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:43:01,570] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:43:01,574] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:43:01,577] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:43:01,579] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:43:01,582] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:43:01,585] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:43:01,587] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:43:01,587] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #8 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 40.929s OK test_multi_create_query_explain_drop_index (2i.indexscans_2i.SecondaryIndexingScanTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 8 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_8 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_9 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,create_ops_per=.5,delete_ops_per=.2,update_ops_per=.2,run_async=True,scan_consistency=request_plus Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'makefile': 'True', 'delete_ops_per': '.2', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'num_nodes': 4, 'update_ops_per': '.2', 'run_async': 'True', 'groups': 'simple:equals:no_orderby_groupby:range', 'case_number': 9, 'scan_consistency': 'request_plus', 'create_ops_per': '.5', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_9', 'spec': 'simple_2i_n1ql', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini'} [2016-03-24 09:43:01,647] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:43:01,647] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #9 test_multi_create_query_explain_drop_index============== [2016-03-24 09:43:01,659] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,664] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,668] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,673] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:01,682] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:43:11,694] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:43:11,697] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:43:11,700] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:43:11,703] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:43:11,705] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:43:11,708] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:43:11,711] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:43:11,717] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:43:11,717] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:43:12,654] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:43:12,656] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:43:12,656] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:43:12,656] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:43:12,666] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:12,669] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:12,696] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:43:12,708] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:12,712] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:12,728] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:43:12,738] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:12,741] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:12,750] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:43:12,760] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:12,763] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:12,767] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:43:13,776] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:43:13,781] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:43:13,782] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:43:14,858] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:14,890] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:14,919] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:43:14,943] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #9 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:43:14,947] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:43:24,962] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:43:24,962] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:43:24,969] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:43:24,969] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:43:24,974] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:43:24,974] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:43:24,982] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:43:24,982] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:43:24,987] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:24,987] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:43:24,987] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:43:25,926] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:43:25,948] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:28,048] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:43:28,054] - [newtuq:82] INFO - {'remaining': {'start': 0, 'end': 1}, 'create': {'start': 1, 'end': 2.5}, 'update': {'start': 0, 'end': 0}, 'delete': {'start': 0, 'end': 0}} [2016-03-24 09:43:29,646] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:29,646] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:43:29,646] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:29,647] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:43:29,649] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:43:29,683] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 31.718919ms [2016-03-24 09:43:29,683] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:29,686] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:43:30,210] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 521.683249ms [2016-03-24 09:43:30,210] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:43:30,213] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:43:30,226] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.80202ms [2016-03-24 09:43:30,227] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:43:30,240] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:30,244] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:30,940] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employeef43d567a3f0943aebcd6db1ed28de8d1job_title ON default(job_title) USING GSI WITH {'nodes': ['127.0.0.1:9000'], 'defer_build': True} [2016-03-24 09:43:30,943] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employeef43d567a3f0943aebcd6db1ed28de8d1job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27nodes%27%3A+%5B%27127.0.0.1%3A9000%27%5D%2C+%27defer_build%27%3A+True%7D [2016-03-24 09:43:30,981] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 35.954571ms [2016-03-24 09:43:30,981] - [base_2i:102] INFO - BUILD INDEX on default(employeef43d567a3f0943aebcd6db1ed28de8d1job_title) USING GSI [2016-03-24 09:43:31,981] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employeef43d567a3f0943aebcd6db1ed28de8d1job_title) USING GSI [2016-03-24 09:43:31,984] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employeef43d567a3f0943aebcd6db1ed28de8d1job_title%29+USING+GSI [2016-03-24 09:43:31,997] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 10.727518ms [2016-03-24 09:43:32,998] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef43d567a3f0943aebcd6db1ed28de8d1job_title' [2016-03-24 09:43:33,001] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef43d567a3f0943aebcd6db1ed28de8d1job_title%27 [2016-03-24 09:43:33,021] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.110962ms [2016-03-24 09:43:34,022] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef43d567a3f0943aebcd6db1ed28de8d1job_title' [2016-03-24 09:43:34,025] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef43d567a3f0943aebcd6db1ed28de8d1job_title%27 [2016-03-24 09:43:34,045] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.516303ms [2016-03-24 09:43:34,532] - [basetestcase:2084] INFO - create 3024.0 to default documents... [2016-03-24 09:43:34,549] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:38,510] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:43:38,948] - [basetestcase:2084] INFO - delete 0 to default documents... [2016-03-24 09:43:38,966] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:39,059] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:43:39,527] - [basetestcase:2084] INFO - update 0 to default documents... [2016-03-24 09:43:39,544] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:40,065] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:43:41,071] - [task:2218] INFO - <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:41,072] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:43:41,081] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:43:41,086] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 1.998872ms [2016-03-24 09:43:41,086] - [task:2227] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'1.998872ms', u'executionTime': u'1.942088ms', u'resultSize': 2353, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE job_title = "Sales"', u'plan': {u'#operator': u'Sequence', u'~children': [{u'index': u'employeef43d567a3f0943aebcd6db1ed28de8d1job_title', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'"Sales"'], u'Low': [u'"Sales"'], u'Inclusion': 3}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((`default`.`job_title`) = "Sales")'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}, {u'#operator': u'FinalProject'}]}}]}}], u'requestID': u'bc15fdb2-b51a-4894-a992-94d3385810f0', u'signature': u'json'} [2016-03-24 09:43:41,087] - [task:2228] INFO - <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:41,087] - [task:2257] INFO - <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:41,088] - [base_2i:294] INFO - Query : SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:43:41,088] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:43:41,088] - [tuq_generators:68] INFO - WHERE clause ===== is doc["job_title"] == "Sales" [2016-03-24 09:43:41,088] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:43:41,089] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:43:42,089] - [task:2218] INFO - <<<<< START Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:42,089] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE job_title = "Sales" [2016-03-24 09:43:42,092] - [rest_client:2508] INFO - query params : scan_consistency=request_plus&statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+ [2016-03-24 09:43:42,578] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 442.084169ms [2016-03-24 09:43:42,636] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:43:42,637] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:43:42,650] - [task:2228] INFO - <<<<< Done Executing Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:42,650] - [task:2257] INFO - <<<<< Done VERIFYING Query SELECT * FROM default WHERE job_title = "Sales" >>>>>> [2016-03-24 09:43:43,652] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef43d567a3f0943aebcd6db1ed28de8d1job_title' [2016-03-24 09:43:43,655] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef43d567a3f0943aebcd6db1ed28de8d1job_title%27 [2016-03-24 09:43:43,673] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.340844ms [2016-03-24 09:43:43,673] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employeef43d567a3f0943aebcd6db1ed28de8d1job_title USING GSI [2016-03-24 09:43:43,676] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employeef43d567a3f0943aebcd6db1ed28de8d1job_title+USING+GSI [2016-03-24 09:43:43,698] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.721174ms [2016-03-24 09:43:43,698] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef43d567a3f0943aebcd6db1ed28de8d1job_title' [2016-03-24 09:43:43,701] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef43d567a3f0943aebcd6db1ed28de8d1job_title%27 [2016-03-24 09:43:43,721] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.175295ms [2016-03-24 09:43:43,726] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:43:43,726] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:43:43,727] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:43,727] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:43:43,729] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:43:43,745] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.815394ms [2016-03-24 09:43:43,745] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:43:43,747] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:43:43,769] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.200555ms [2016-03-24 09:43:44,076] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:43:44,117] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:44,118] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:43:44,161] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:44,162] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:43:44,217] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:44,218] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:43:44,274] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:43:44,275] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #9 test_multi_create_query_explain_drop_index ============== [2016-03-24 09:43:44,300] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:43:44,301] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:43:44,625] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:43:44,625] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:43:44,628] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:43:44,633] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,638] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,644] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,657] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:43:44,661] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:43:44,664] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:43:44,667] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:43:44,669] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:43:44,672] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:43:44,675] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:43:44,678] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:43:44,678] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #9 test_multi_create_query_explain_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 43.045s OK test_multi_create_drop_index (2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_9 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_10 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests.test_multi_create_drop_index,groups=simple,dataset=default,doc-per-day=1,cbq_version=sherlock,skip_build_tuq=True Test Input params: {'doc-per-day': '1', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_10', 'makefile': 'True', 'skip_build_tuq': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple', 'case_number': 10, 'num_nodes': 4, 'spec': 'simple_2i_n1ql', 'cbq_version': 'sherlock'} [2016-03-24 09:43:44,817] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:43:44,818] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #10 test_multi_create_drop_index============== [2016-03-24 09:43:44,833] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,837] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,842] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,847] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:43:44,857] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:43:54,870] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:43:54,874] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:43:54,877] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:43:54,879] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:43:54,882] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:43:54,885] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:43:54,887] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:43:54,890] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:43:54,890] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:43:55,823] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:43:55,825] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:43:55,825] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:43:55,826] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:43:55,835] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:55,838] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:55,855] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:43:55,871] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:55,875] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:55,888] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:43:55,898] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:55,902] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:55,917] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:43:55,927] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:43:55,929] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:43:55,933] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:43:56,943] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:43:56,948] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:43:56,948] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:43:58,020] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:58,056] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:43:58,083] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:43:58,107] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #10 test_multi_create_drop_index ============== [2016-03-24 09:43:58,112] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:44:08,117] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:08,117] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:08,123] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:08,123] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:08,130] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:08,130] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:08,136] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:08,136] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:08,145] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:08,145] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:44:08,146] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:44:09,075] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:44:09,101] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:44:11,273] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:44:11,285] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:11,285] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:44:11,286] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:11,286] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:11,288] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:11,324] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.609218ms [2016-03-24 09:44:11,324] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:11,327] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+VIEW+ [2016-03-24 09:44:16,356] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 5.026780533s [2016-03-24 09:44:16,356] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:16,359] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:16,382] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 22.02951ms [2016-03-24 09:44:16,383] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:44:16,394] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:16,394] - [base_2i:134] INFO - [] [2016-03-24 09:44:16,394] - [basetestcase:365] INFO - sleep for 3 secs. ... [2016-03-24 09:44:17,106] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee60e621b180c941d2b7c1c7041806be7ajoin_yr ON default(join_yr) USING GSI WITH {'defer_build': True} [2016-03-24 09:44:17,108] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee60e621b180c941d2b7c1c7041806be7ajoin_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:44:17,152] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 42.248933ms [2016-03-24 09:44:19,398] - [basetestcase:365] INFO - sleep for 3 secs. ... [2016-03-24 09:44:20,156] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee60e621b180c941d2b7c1c7041806be7ajob_title ON default(job_title) USING GSI WITH {'defer_build': True} [2016-03-24 09:44:20,159] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee60e621b180c941d2b7c1c7041806be7ajob_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:44:20,200] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 39.424075ms [2016-03-24 09:44:22,401] - [base_2i:102] INFO - BUILD INDEX on default(employee60e621b180c941d2b7c1c7041806be7ajoin_yr,employee60e621b180c941d2b7c1c7041806be7ajob_title) USING GSI [2016-03-24 09:44:23,204] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee60e621b180c941d2b7c1c7041806be7ajoin_yr,employee60e621b180c941d2b7c1c7041806be7ajob_title) USING GSI [2016-03-24 09:44:23,207] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee60e621b180c941d2b7c1c7041806be7ajoin_yr%2Cemployee60e621b180c941d2b7c1c7041806be7ajob_title%29+USING+GSI [2016-03-24 09:44:23,218] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 9.287214ms [2016-03-24 09:44:24,220] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajoin_yr' [2016-03-24 09:44:24,223] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajoin_yr%27 [2016-03-24 09:44:24,244] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.228766ms [2016-03-24 09:44:24,244] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajob_title' [2016-03-24 09:44:24,247] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajob_title%27 [2016-03-24 09:44:24,264] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.145366ms [2016-03-24 09:44:25,266] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajoin_yr' [2016-03-24 09:44:25,270] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajoin_yr%27 [2016-03-24 09:44:25,291] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.228774ms [2016-03-24 09:44:25,292] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee60e621b180c941d2b7c1c7041806be7ajoin_yr USING GSI [2016-03-24 09:44:25,295] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee60e621b180c941d2b7c1c7041806be7ajoin_yr+USING+GSI [2016-03-24 09:44:25,319] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 22.626674ms [2016-03-24 09:44:25,319] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajob_title' [2016-03-24 09:44:25,323] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajob_title%27 [2016-03-24 09:44:25,341] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.630347ms [2016-03-24 09:44:25,341] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee60e621b180c941d2b7c1c7041806be7ajob_title USING GSI [2016-03-24 09:44:25,344] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee60e621b180c941d2b7c1c7041806be7ajob_title+USING+GSI [2016-03-24 09:44:25,373] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 27.074642ms [2016-03-24 09:44:25,373] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajoin_yr' [2016-03-24 09:44:25,376] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajoin_yr%27 [2016-03-24 09:44:25,399] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 21.042789ms [2016-03-24 09:44:25,399] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee60e621b180c941d2b7c1c7041806be7ajob_title' [2016-03-24 09:44:25,402] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee60e621b180c941d2b7c1c7041806be7ajob_title%27 [2016-03-24 09:44:25,419] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.872222ms [2016-03-24 09:44:25,425] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:25,425] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:44:25,425] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:25,425] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:25,428] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:25,450] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.128087ms [2016-03-24 09:44:25,450] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:25,452] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+VIEW+ [2016-03-24 09:44:25,461] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 7.808647ms [2016-03-24 09:44:25,639] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:44:25,664] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:25,665] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:44:25,694] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:25,694] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:44:25,731] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:25,732] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:44:25,769] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:25,770] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #10 test_multi_create_drop_index ============== [2016-03-24 09:44:25,795] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:44:25,796] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:44:26,136] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:44:26,136] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:44:26,144] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:44:26,150] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,155] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,161] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,173] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:44:26,176] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:44:26,179] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:44:26,181] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:44:26,184] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:44:26,187] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:44:26,189] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:44:26,192] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:44:26,192] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #10 test_multi_create_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 41.453s OK test_multi_create_drop_index (2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 1 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_10 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_11 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests.test_multi_create_drop_index,groups=composite,dataset=default,doc-per-day=1,cbq_version=sherlock,skip_build_tuq=True Test Input params: {'doc-per-day': '1', 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_11', 'makefile': 'True', 'skip_build_tuq': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'composite', 'case_number': 11, 'num_nodes': 4, 'spec': 'simple_2i_n1ql', 'cbq_version': 'sherlock'} [2016-03-24 09:44:26,217] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:44:26,217] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #11 test_multi_create_drop_index============== [2016-03-24 09:44:26,228] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,234] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,238] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,243] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:26,256] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:44:36,266] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:44:36,270] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:44:36,272] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:44:36,275] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:44:36,278] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:44:36,280] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:44:36,283] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:44:36,285] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:44:36,285] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:44:37,230] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:44:37,232] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:44:37,232] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:44:37,232] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:44:37,241] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:44:37,246] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:44:37,268] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:44:37,281] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:44:37,285] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:44:37,300] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:44:37,312] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:44:37,315] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:44:37,325] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:44:37,335] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:44:37,338] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:44:37,342] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:44:38,351] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:44:38,355] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:44:38,355] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:44:39,417] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:44:39,448] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:44:39,473] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:44:39,517] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #11 test_multi_create_drop_index ============== [2016-03-24 09:44:39,522] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:44:49,537] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:49,537] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:49,543] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:49,543] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:49,548] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:49,549] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:49,554] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:44:49,554] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:44:49,561] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:49,562] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:44:49,562] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:44:50,482] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:44:50,506] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:44:52,611] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:44:52,622] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:52,622] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:44:52,622] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:52,622] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:52,625] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:52,656] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 29.368557ms [2016-03-24 09:44:52,656] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:52,659] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+VIEW+ [2016-03-24 09:44:53,129] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 467.917594ms [2016-03-24 09:44:53,129] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:53,132] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:53,151] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.207846ms [2016-03-24 09:44:53,152] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:44:53,168] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:53,168] - [base_2i:134] INFO - [] [2016-03-24 09:44:53,168] - [basetestcase:365] INFO - sleep for 3 secs. ... [2016-03-24 09:44:53,494] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr ON default(join_yr,job_title) USING GSI WITH {'defer_build': True} [2016-03-24 09:44:53,497] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr+ON+default%28join_yr%2Cjob_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:44:53,532] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.591526ms [2016-03-24 09:44:56,171] - [base_2i:102] INFO - BUILD INDEX on default(employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr) USING GSI [2016-03-24 09:44:56,536] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr) USING GSI [2016-03-24 09:44:56,539] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr%29+USING+GSI [2016-03-24 09:44:56,581] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 40.114782ms [2016-03-24 09:44:56,581] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr' [2016-03-24 09:44:56,603] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr%27 [2016-03-24 09:44:56,623] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.800357ms [2016-03-24 09:44:57,623] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr' [2016-03-24 09:44:57,626] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr%27 [2016-03-24 09:44:57,647] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.053104ms [2016-03-24 09:44:58,648] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr' [2016-03-24 09:44:58,651] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr%27 [2016-03-24 09:44:58,677] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 23.323049ms [2016-03-24 09:44:58,677] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr USING GSI [2016-03-24 09:44:58,679] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr+USING+GSI [2016-03-24 09:44:58,708] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 26.7436ms [2016-03-24 09:44:58,708] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr' [2016-03-24 09:44:58,718] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee09e3b4b777c34a09842e26896ea93b73job_title_join_yr%27 [2016-03-24 09:44:58,734] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.495085ms [2016-03-24 09:44:58,741] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:44:58,741] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:44:58,742] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:58,742] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:44:58,745] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:44:58,762] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 16.041414ms [2016-03-24 09:44:58,762] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING VIEW [2016-03-24 09:44:58,765] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+VIEW+ [2016-03-24 09:44:58,770] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.234036ms [2016-03-24 09:44:58,949] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:44:58,975] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:58,975] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:44:59,004] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:59,005] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:44:59,047] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:59,048] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:44:59,090] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:44:59,091] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #11 test_multi_create_drop_index ============== [2016-03-24 09:44:59,120] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:44:59,120] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:44:59,445] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:44:59,445] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:44:59,448] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:44:59,453] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,458] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,464] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,476] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:44:59,479] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:44:59,482] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:44:59,485] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:44:59,488] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:44:59,490] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:44:59,493] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:44:59,496] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:44:59,496] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #11 test_multi_create_drop_index ============== ok ---------------------------------------------------------------------- Ran 1 test in 33.290s OK test_remove_bucket_and_query (2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 2 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_11 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_12 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_remove_bucket_and_query,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:and:no_orderby_groupby:range', 'case_number': 12, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_12', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:44:59,525] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:44:59,525] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #12 test_remove_bucket_and_query============== [2016-03-24 09:44:59,541] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,545] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,549] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,554] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:44:59,564] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:45:09,577] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:45:09,580] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:45:09,583] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:45:09,585] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:45:09,588] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:45:09,591] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:45:09,594] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:45:09,596] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:45:09,596] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:45:10,536] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:45:10,539] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:45:10,539] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:45:10,539] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:45:10,548] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:10,551] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:10,579] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:45:10,592] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:10,596] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:10,610] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:45:10,619] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:10,623] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:10,632] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:45:10,642] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:10,645] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:10,648] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:45:11,657] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:45:11,663] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:45:11,663] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:45:12,726] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:12,758] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:12,781] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:45:12,823] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #12 test_remove_bucket_and_query ============== [2016-03-24 09:45:12,827] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:45:22,843] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:22,843] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:22,849] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:22,849] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:22,855] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:22,855] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:22,861] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:22,861] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:22,866] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:22,867] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:45:22,867] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:45:23,788] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:45:23,806] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:25,975] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:45:25,986] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:25,986] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:45:25,986] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:45:25,987] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:45:25,989] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:45:26,021] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 30.122684ms [2016-03-24 09:45:26,022] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:45:26,026] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:45:26,557] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 528.704627ms [2016-03-24 09:45:26,557] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:45:26,560] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:45:26,583] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.875624ms [2016-03-24 09:45:26,584] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:45:26,603] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:26,613] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:26,616] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employeec4df6532f2de4c47a7b2b8394fad9898join_yr ON default(join_yr) USING GSI WITH {'defer_build': True} [2016-03-24 09:45:26,619] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employeec4df6532f2de4c47a7b2b8394fad9898join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:45:26,659] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 39.134274ms [2016-03-24 09:45:26,659] - [base_2i:102] INFO - BUILD INDEX on default(employeec4df6532f2de4c47a7b2b8394fad9898join_yr) USING GSI [2016-03-24 09:45:26,799] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employeec4df6532f2de4c47a7b2b8394fad9898join_yr) USING GSI [2016-03-24 09:45:26,802] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employeec4df6532f2de4c47a7b2b8394fad9898join_yr%29+USING+GSI [2016-03-24 09:45:26,813] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 8.517341ms [2016-03-24 09:45:26,815] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeec4df6532f2de4c47a7b2b8394fad9898join_yr' [2016-03-24 09:45:26,826] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeec4df6532f2de4c47a7b2b8394fad9898join_yr%27 [2016-03-24 09:45:26,847] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.72301ms [2016-03-24 09:45:27,847] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeec4df6532f2de4c47a7b2b8394fad9898join_yr' [2016-03-24 09:45:27,854] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeec4df6532f2de4c47a7b2b8394fad9898join_yr%27 [2016-03-24 09:45:27,870] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.24747ms [2016-03-24 09:45:28,871] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeec4df6532f2de4c47a7b2b8394fad9898join_yr' [2016-03-24 09:45:28,874] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeec4df6532f2de4c47a7b2b8394fad9898join_yr%27 [2016-03-24 09:45:28,889] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.446508ms [2016-03-24 09:45:28,889] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:28,892] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:45:28,896] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 2.327549ms [2016-03-24 09:45:28,896] - [base_2i:241] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'2.327549ms', u'executionTime': u'2.278878ms', u'resultSize': 3183, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id', u'plan': {u'#operator': u'Sequence', u'~children': [{u'#operator': u'Sequence', u'~children': [{u'index': u'employeec4df6532f2de4c47a7b2b8394fad9898join_yr', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'2014'], u'Low': [u'2010'], u'Inclusion': 0}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}]}}]}, {u'#operator': u'Order', u'sort_terms': [{u'expr': u'(`default`.`_id`)'}]}, {u'#operator': u'FinalProject'}]}}], u'requestID': u'ecc1dc59-bb02-46d2-ae92-c0cebc82943f', u'signature': u'json'} [2016-03-24 09:45:28,897] - [base_2i:284] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:28,897] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:45:28,897] - [tuq_generators:68] INFO - WHERE clause ===== is doc["join_yr"] > 2010 and doc["join_yr"] < 2014 [2016-03-24 09:45:28,897] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:45:28,897] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:45:28,898] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:28,898] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:28,947] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:28,958] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:28,961] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:45:29,320] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 323.50488ms [2016-03-24 09:45:29,369] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:45:29,370] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:45:29,695] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:29,695] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeec4df6532f2de4c47a7b2b8394fad9898join_yr' [2016-03-24 09:45:29,698] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeec4df6532f2de4c47a7b2b8394fad9898join_yr%27 [2016-03-24 09:45:29,711] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.860189ms [2016-03-24 09:45:29,716] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:29,716] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:45:29,716] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:45:29,716] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:45:29,719] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:45:29,727] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 6.434179ms [2016-03-24 09:45:29,921] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:45:29,949] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:45:29,950] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:45:29,982] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:45:29,983] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:45:30,025] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:45:30,025] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:45:30,071] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:45:30,072] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #12 test_remove_bucket_and_query ============== [2016-03-24 09:45:30,093] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,099] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,105] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,113] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,138] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:45:30,150] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:45:30,154] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:45:30,157] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:45:30,161] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:45:30,164] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:45:30,174] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:45:30,177] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:45:30,177] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #12 test_remove_bucket_and_query ============== ok ---------------------------------------------------------------------- Ran 1 test in 30.665s OK test_change_bucket_properties (2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 2 , fail 0 summary so far suite 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests , pass 1 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_12 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_13 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_change_bucket_properties,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:and:no_orderby_groupby:range', 'case_number': 13, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_13', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:45:30,210] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:45:30,210] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #13 test_change_bucket_properties============== [2016-03-24 09:45:30,226] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,231] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,237] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,243] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:45:30,255] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:45:40,260] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:45:40,262] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:45:40,265] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:45:40,268] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:45:40,270] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:45:40,273] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:45:40,276] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:45:40,285] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:45:40,286] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:45:41,221] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:45:41,223] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:45:41,224] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:45:41,224] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:45:41,242] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:41,246] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:41,266] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:45:41,285] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:41,289] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:41,302] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:45:41,312] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:41,315] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:41,325] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:45:41,336] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:45:41,341] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:45:41,344] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:45:42,353] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:45:42,358] - [rest_client:1794] INFO - 0.00 seconds to create bucket default [2016-03-24 09:45:42,359] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:45:43,433] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:43,465] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:43,490] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:45:43,519] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #13 test_change_bucket_properties ============== [2016-03-24 09:45:43,524] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:45:53,537] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:53,537] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:53,543] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:53,543] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:53,549] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:53,549] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:53,555] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:45:53,555] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:45:53,561] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:53,561] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:45:53,561] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:45:54,491] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:45:54,509] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:45:56,693] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:45:56,704] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:56,704] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:45:56,705] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:45:56,705] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:45:56,708] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:45:56,737] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 27.610773ms [2016-03-24 09:45:56,737] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:45:56,742] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:45:57,252] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 507.702098ms [2016-03-24 09:45:57,252] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:45:57,255] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:45:57,271] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.553775ms [2016-03-24 09:45:57,272] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:45:57,289] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:57,296] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:45:57,299] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee8b027d3561c741c39a4370f3181c0292join_yr ON default(join_yr) USING GSI WITH {'defer_build': True} [2016-03-24 09:45:57,302] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee8b027d3561c741c39a4370f3181c0292join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:45:57,338] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 34.850961ms [2016-03-24 09:45:57,338] - [base_2i:102] INFO - BUILD INDEX on default(employee8b027d3561c741c39a4370f3181c0292join_yr) USING GSI [2016-03-24 09:45:57,509] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee8b027d3561c741c39a4370f3181c0292join_yr) USING GSI [2016-03-24 09:45:57,513] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee8b027d3561c741c39a4370f3181c0292join_yr%29+USING+GSI [2016-03-24 09:45:57,524] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 9.068171ms [2016-03-24 09:45:57,524] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee8b027d3561c741c39a4370f3181c0292join_yr' [2016-03-24 09:45:57,528] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee8b027d3561c741c39a4370f3181c0292join_yr%27 [2016-03-24 09:45:57,548] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.324597ms [2016-03-24 09:45:58,550] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee8b027d3561c741c39a4370f3181c0292join_yr' [2016-03-24 09:45:58,553] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee8b027d3561c741c39a4370f3181c0292join_yr%27 [2016-03-24 09:45:58,569] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.515322ms [2016-03-24 09:45:59,571] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee8b027d3561c741c39a4370f3181c0292join_yr' [2016-03-24 09:45:59,574] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee8b027d3561c741c39a4370f3181c0292join_yr%27 [2016-03-24 09:45:59,593] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.44269ms [2016-03-24 09:45:59,593] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:59,596] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:45:59,601] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.443908ms [2016-03-24 09:45:59,601] - [base_2i:241] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.443908ms', u'executionTime': u'3.397199ms', u'resultSize': 3183, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id', u'plan': {u'#operator': u'Sequence', u'~children': [{u'#operator': u'Sequence', u'~children': [{u'index': u'employee8b027d3561c741c39a4370f3181c0292join_yr', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'2014'], u'Low': [u'2010'], u'Inclusion': 0}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}]}}]}, {u'#operator': u'Order', u'sort_terms': [{u'expr': u'(`default`.`_id`)'}]}, {u'#operator': u'FinalProject'}]}}], u'requestID': u'f246e181-af31-487a-b821-8edaf7e99caf', u'signature': u'json'} [2016-03-24 09:45:59,601] - [base_2i:284] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:59,602] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:45:59,602] - [tuq_generators:68] INFO - WHERE clause ===== is doc["join_yr"] > 2010 and doc["join_yr"] < 2014 [2016-03-24 09:45:59,602] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:45:59,602] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:45:59,602] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:59,603] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:59,651] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:45:59,662] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:45:59,665] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:45:59,976] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 287.709969ms [2016-03-24 09:46:00,024] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:46:00,025] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:46:00,034] - [rest_client:1828] INFO - http://127.0.0.1:9000/pools/default/buckets/default with param: [2016-03-24 09:46:00,039] - [rest_client:1832] INFO - bucket default updated [2016-03-24 09:46:00,039] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:00,042] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:46:00,052] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 6.539125ms [2016-03-24 09:46:00,052] - [base_2i:241] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'6.539125ms', u'executionTime': u'6.478353ms', u'resultSize': 3183, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id', u'plan': {u'#operator': u'Sequence', u'~children': [{u'#operator': u'Sequence', u'~children': [{u'index': u'employee8b027d3561c741c39a4370f3181c0292join_yr', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'2014'], u'Low': [u'2010'], u'Inclusion': 0}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}]}}]}, {u'#operator': u'Order', u'sort_terms': [{u'expr': u'(`default`.`_id`)'}]}, {u'#operator': u'FinalProject'}]}}], u'requestID': u'aa55d79a-c9d7-48e6-915d-a5b26b29f1a6', u'signature': u'json'} [2016-03-24 09:46:00,053] - [base_2i:284] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:00,053] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:46:00,053] - [tuq_generators:68] INFO - WHERE clause ===== is doc["join_yr"] > 2010 and doc["join_yr"] < 2014 [2016-03-24 09:46:00,054] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:46:00,054] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:46:00,054] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:00,054] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:00,105] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:00,116] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:00,119] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:46:00,423] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 281.778257ms [2016-03-24 09:46:00,470] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:46:00,471] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:46:00,476] - [tuq_helper:75] INFO - RUN QUERY DROP INDEX default.employee8b027d3561c741c39a4370f3181c0292join_yr USING GSI [2016-03-24 09:46:00,479] - [rest_client:2508] INFO - query params : statement=DROP+INDEX+default.employee8b027d3561c741c39a4370f3181c0292join_yr+USING+GSI [2016-03-24 09:46:00,504] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 23.167359ms [2016-03-24 09:46:00,505] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee8b027d3561c741c39a4370f3181c0292join_yr' [2016-03-24 09:46:00,510] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee8b027d3561c741c39a4370f3181c0292join_yr%27 [2016-03-24 09:46:00,532] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.28451ms [2016-03-24 09:46:00,538] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:00,538] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:46:00,538] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:00,538] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:46:00,541] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:46:00,554] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 11.895305ms [2016-03-24 09:46:00,554] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:00,557] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:46:00,588] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 28.694674ms [2016-03-24 09:46:00,773] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:46:00,798] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:00,799] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:46:00,835] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:00,836] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:46:00,877] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:00,878] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:46:00,920] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:00,921] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #13 test_change_bucket_properties ============== [2016-03-24 09:46:00,946] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:46:00,946] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:46:01,312] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:46:01,313] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:46:01,315] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:46:01,320] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,333] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,337] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,354] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:46:01,356] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:46:01,359] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:46:01,362] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:46:01,364] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:46:01,367] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:46:01,370] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:46:01,372] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:46:01,372] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #13 test_change_bucket_properties ============== ok ---------------------------------------------------------------------- Ran 1 test in 31.174s OK test_flush_bucket_and_query (2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 2 , fail 0 summary so far suite 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests , pass 2 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_13 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_14 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_flush_bucket_and_query,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:and:no_orderby_groupby:range', 'case_number': 14, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_14', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:46:01,398] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:46:01,398] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #14 test_flush_bucket_and_query============== [2016-03-24 09:46:01,409] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,414] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,419] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,423] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:01,435] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:46:11,446] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:46:11,448] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:46:11,451] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:46:11,454] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:46:11,456] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:46:11,462] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:46:11,465] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:46:11,467] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:46:11,468] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:46:12,409] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:46:12,411] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:46:12,411] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:46:12,411] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:46:12,421] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:12,424] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:12,448] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:46:12,459] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:12,462] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:12,473] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:46:12,482] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:12,485] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:12,495] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:46:12,512] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:12,515] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:12,519] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:46:13,529] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:46:13,535] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:46:13,535] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:46:14,606] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:46:14,636] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:46:14,664] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:46:14,694] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #14 test_flush_bucket_and_query ============== [2016-03-24 09:46:14,701] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:46:24,710] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:24,710] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:24,716] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:24,716] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:24,722] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:24,722] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:24,728] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:24,728] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:24,733] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:24,733] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:46:24,733] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:46:25,658] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:46:25,678] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:46:27,864] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:46:27,876] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:27,877] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:46:27,877] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:27,877] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:46:27,880] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:46:27,915] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.87618ms [2016-03-24 09:46:27,915] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:27,919] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:46:28,426] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 504.539323ms [2016-03-24 09:46:28,426] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:46:28,429] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:46:28,445] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.986144ms [2016-03-24 09:46:28,446] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:46:28,456] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:28,461] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:28,464] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employeebefc694145824701acd43a0cb272e0b1join_yr ON default(join_yr) USING GSI WITH {'defer_build': True} [2016-03-24 09:46:28,467] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employeebefc694145824701acd43a0cb272e0b1join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:46:28,514] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 45.960683ms [2016-03-24 09:46:28,515] - [base_2i:102] INFO - BUILD INDEX on default(employeebefc694145824701acd43a0cb272e0b1join_yr) USING GSI [2016-03-24 09:46:28,682] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employeebefc694145824701acd43a0cb272e0b1join_yr) USING GSI [2016-03-24 09:46:28,686] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employeebefc694145824701acd43a0cb272e0b1join_yr%29+USING+GSI [2016-03-24 09:46:28,696] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 8.658739ms [2016-03-24 09:46:28,696] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeebefc694145824701acd43a0cb272e0b1join_yr' [2016-03-24 09:46:28,701] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeebefc694145824701acd43a0cb272e0b1join_yr%27 [2016-03-24 09:46:28,727] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 23.777348ms [2016-03-24 09:46:29,728] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeebefc694145824701acd43a0cb272e0b1join_yr' [2016-03-24 09:46:29,731] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeebefc694145824701acd43a0cb272e0b1join_yr%27 [2016-03-24 09:46:29,752] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.019969ms [2016-03-24 09:46:30,753] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeebefc694145824701acd43a0cb272e0b1join_yr' [2016-03-24 09:46:30,757] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeebefc694145824701acd43a0cb272e0b1join_yr%27 [2016-03-24 09:46:30,773] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 15.074165ms [2016-03-24 09:46:30,773] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:30,776] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:46:30,781] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 3.350169ms [2016-03-24 09:46:30,781] - [base_2i:241] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'3.350169ms', u'executionTime': u'3.304933ms', u'resultSize': 3183, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id', u'plan': {u'#operator': u'Sequence', u'~children': [{u'#operator': u'Sequence', u'~children': [{u'index': u'employeebefc694145824701acd43a0cb272e0b1join_yr', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'2014'], u'Low': [u'2010'], u'Inclusion': 0}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}]}}]}, {u'#operator': u'Order', u'sort_terms': [{u'expr': u'(`default`.`_id`)'}]}, {u'#operator': u'FinalProject'}]}}], u'requestID': u'53d7decb-8ccb-4ce8-b851-5fdc4c1b2406', u'signature': u'json'} [2016-03-24 09:46:30,781] - [base_2i:284] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:30,782] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:46:30,782] - [tuq_generators:68] INFO - WHERE clause ===== is doc["join_yr"] > 2010 and doc["join_yr"] < 2014 [2016-03-24 09:46:30,782] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:46:30,782] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:46:30,782] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:30,782] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:30,830] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:46:30,841] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:30,844] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:46:31,166] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 298.66532ms [2016-03-24 09:46:31,213] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:46:31,214] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:46:31,400] - [rest_client:2411] INFO - Flush for bucket 'default' was triggered [2016-03-24 09:46:31,400] - [basetestcase:365] INFO - sleep for 2 secs. ... [2016-03-24 09:46:33,403] - [base_2i:319] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:33,403] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:46:33,406] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:46:33,412] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 4.134809ms [2016-03-24 09:46:33,418] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:33,418] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:46:33,418] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:33,418] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:46:33,421] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:46:33,436] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.42295ms [2016-03-24 09:46:33,437] - [tuq_helper:75] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:46:33,440] - [rest_client:2508] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI [2016-03-24 09:46:33,467] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 25.812252ms [2016-03-24 09:46:33,644] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:46:33,669] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:33,669] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:46:33,698] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:33,699] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:46:33,738] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:33,739] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:46:33,775] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:46:33,776] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #14 test_flush_bucket_and_query ============== [2016-03-24 09:46:33,798] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:46:33,799] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:46:35,115] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:46:35,115] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:46:35,121] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:46:35,127] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,133] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,138] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,153] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:46:35,156] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:46:35,159] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:46:35,162] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:46:35,165] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:46:35,168] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:46:35,170] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:46:35,172] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:46:35,173] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #14 test_flush_bucket_and_query ============== ok ---------------------------------------------------------------------- Ran 1 test in 33.787s OK test_delete_create_bucket_and_query (2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests) ... Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 2 , fail 0 summary so far suite 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests , pass 3 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_14 Logs will be stored at /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_15 ./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_2i.ini makefile=True -t 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True Test Input params: {'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'makefile': 'True', 'conf_file': 'conf/simple_2i_n1ql.conf', 'dataset': 'default', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_2i', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_2i.ini', 'groups': 'simple:and:no_orderby_groupby:range', 'case_number': 15, 'num_nodes': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_15', 'spec': 'simple_2i_n1ql'} [2016-03-24 09:46:35,198] - [rest_client:1636] INFO - Node versions in cluster [u'4.5.35007-1458785423-rel-enterprise'] [2016-03-24 09:46:35,199] - [basetestcase:146] INFO - ============== basetestcase setup was started for test #15 test_delete_create_bucket_and_query============== [2016-03-24 09:46:35,211] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,217] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,221] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,226] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:46:35,240] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:46:45,243] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:46:45,246] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:46:45,249] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:46:45,251] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:46:45,254] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:46:45,257] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:46:45,259] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:46:45,262] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:46:45,262] - [basetestcase:167] INFO - initializing cluster [2016-03-24 09:46:46,211] - [rest_client:789] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:services=kv%2Cindex%2Cn1ql&password=asdasd&hostname=127.0.0.1%3A9000&user=Administrator [2016-03-24 09:46:46,213] - [rest_client:757] ERROR - http://127.0.0.1:9000//node/controller/setupServices error 400 reason: unknown ["cannot change node services after cluster is provisioned"] [2016-03-24 09:46:46,214] - [rest_client:794] INFO - This node is already provisioned with services, we do not consider this as failure for test case [2016-03-24 09:46:46,214] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-03-24 09:46:46,224] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:46,226] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:46,255] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-03-24 09:46:46,265] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:46,274] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:46,283] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-03-24 09:46:46,293] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:46,296] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:46,305] - [rest_client:774] INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-03-24 09:46:46,317] - [rest_client:811] INFO - pools/default params : memoryQuota=8041 [2016-03-24 09:46:46,320] - [rest_client:830] INFO - settings/indexes params : storageMode=forestdb [2016-03-24 09:46:46,324] - [basetestcase:187] INFO - done initializing cluster [2016-03-24 09:46:47,334] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:46:47,342] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:46:47,343] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:46:48,417] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:46:48,465] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:46:48,496] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:46:48,499] - [basetestcase:257] INFO - ============== basetestcase setup was finished for test #15 test_delete_create_bucket_and_query ============== [2016-03-24 09:46:48,504] - [basetestcase:365] INFO - sleep for 10 secs. ... [2016-03-24 09:46:58,516] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:58,516] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:58,521] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:58,521] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:58,527] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:58,527] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:58,533] - [newtuq:34] INFO - Initial status of 127.0.0.1 cluster is healthy [2016-03-24 09:46:58,533] - [newtuq:39] INFO - current status of 127.0.0.1 is healthy [2016-03-24 09:46:58,546] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:46:58,546] - [remote_util:166] INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-03-24 09:46:58,546] - [remote_util:199] INFO - Connected to 127.0.0.1 [2016-03-24 09:46:59,471] - [basetestcase:2084] INFO - create 2016 to default documents... [2016-03-24 09:46:59,489] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:47:01,692] - [basetestcase:2095] INFO - LOAD IS FINISHED [2016-03-24 09:47:01,703] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:01,703] - [newtuq:92] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator number of buckets 1 [2016-03-24 09:47:01,703] - [tuq_helper:420] INFO - CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:47:01,703] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:47:01,706] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:47:01,741] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 33.365493ms [2016-03-24 09:47:01,741] - [tuq_helper:75] INFO - RUN QUERY CREATE PRIMARY INDEX ON default USING GSI [2016-03-24 09:47:01,744] - [rest_client:2508] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI [2016-03-24 09:47:02,253] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 507.30104ms [2016-03-24 09:47:02,253] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:47:02,256] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:47:02,277] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 18.627933ms [2016-03-24 09:47:02,277] - [base_2i:48] INFO - {'in_between': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'initial': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'after': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}, 'before': {'query_explain_ops': False, 'create_index': False, 'drop_index': False, 'query_ops': False}} [2016-03-24 09:47:02,287] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:02,292] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:02,297] - [tuq_helper:75] INFO - RUN QUERY CREATE INDEX employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr ON default(join_yr) USING GSI WITH {'defer_build': True} [2016-03-24 09:47:02,301] - [rest_client:2508] INFO - query params : statement=CREATE+INDEX+employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D [2016-03-24 09:47:02,340] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 37.461466ms [2016-03-24 09:47:02,340] - [base_2i:102] INFO - BUILD INDEX on default(employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr) USING GSI [2016-03-24 09:47:02,516] - [tuq_helper:75] INFO - RUN QUERY BUILD INDEX on default(employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr) USING GSI [2016-03-24 09:47:02,519] - [rest_client:2508] INFO - query params : statement=BUILD+INDEX+on+default%28employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%29+USING+GSI [2016-03-24 09:47:02,536] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.841549ms [2016-03-24 09:47:02,536] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr' [2016-03-24 09:47:02,544] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%27 [2016-03-24 09:47:02,564] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.942557ms [2016-03-24 09:47:03,565] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr' [2016-03-24 09:47:03,569] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%27 [2016-03-24 09:47:03,584] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 14.127032ms [2016-03-24 09:47:04,586] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr' [2016-03-24 09:47:04,590] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%27 [2016-03-24 09:47:04,612] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 20.617654ms [2016-03-24 09:47:04,612] - [tuq_helper:75] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:47:04,615] - [rest_client:2508] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:47:04,620] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 2.862836ms [2016-03-24 09:47:04,620] - [base_2i:241] INFO - {u'status': u'success', u'metrics': {u'elapsedTime': u'2.862836ms', u'executionTime': u'2.814903ms', u'resultSize': 3183, u'resultCount': 1}, u'results': [{u'text': u'SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id', u'plan': {u'#operator': u'Sequence', u'~children': [{u'#operator': u'Sequence', u'~children': [{u'index': u'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr', u'namespace': u'default', u'keyspace': u'default', u'#operator': u'IndexScan', u'spans': [{u'Range': {u'High': [u'2014'], u'Low': [u'2010'], u'Inclusion': 0}}], u'using': u'gsi'}, {u'#operator': u'Parallel', u'~child': {u'#operator': u'Sequence', u'~children': [{u'keyspace': u'default', u'#operator': u'Fetch', u'namespace': u'default'}, {u'#operator': u'Filter', u'condition': u'((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {u'#operator': u'InitialProject', u'result_terms': [{u'expr': u'self', u'star': True}]}]}}]}, {u'#operator': u'Order', u'sort_terms': [{u'expr': u'(`default`.`_id`)'}]}, {u'#operator': u'FinalProject'}]}}], u'requestID': u'41b2c8ff-a297-4d46-ad07-5ac9e48aa04b', u'signature': u'json'} [2016-03-24 09:47:04,620] - [base_2i:284] INFO - Query : SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:47:04,621] - [tuq_generators:66] INFO - FROM clause ===== is default [2016-03-24 09:47:04,621] - [tuq_generators:68] INFO - WHERE clause ===== is doc["join_yr"] > 2010 and doc["join_yr"] < 2014 [2016-03-24 09:47:04,621] - [tuq_generators:70] INFO - UNNEST clause ===== is None [2016-03-24 09:47:04,621] - [tuq_generators:72] INFO - SELECT clause ===== is {"*" : doc,} [2016-03-24 09:47:04,621] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:47:04,622] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:47:04,672] - [tuq_generators:401] INFO - ORDER clause ========= is doc["_id"], [2016-03-24 09:47:04,682] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM default WHERE join_yr > 2010 and join_yr < 2014 ORDER BY _id [2016-03-24 09:47:04,686] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+ [2016-03-24 09:47:05,021] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 311.959443ms [2016-03-24 09:47:05,097] - [tuq_helper:109] INFO - Analyzing Actual Result [2016-03-24 09:47:05,098] - [tuq_helper:111] INFO - Analyzing Expected Result [2016-03-24 09:47:05,473] - [basetestcase:365] INFO - sleep for 2 secs. ... [2016-03-24 09:47:07,549] - [rest_client:1772] INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8041&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-03-24 09:47:07,556] - [rest_client:1794] INFO - 0.01 seconds to create bucket default [2016-03-24 09:47:07,557] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-03-24 09:47:08,640] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:47:08,668] - [data_helper:295] INFO - creating direct client 127.0.0.1:12000 default [2016-03-24 09:47:08,693] - [task:256] INFO - bucket 'default' was created with per node RAM quota: 8041 [2016-03-24 09:47:08,742] - [basetestcase:365] INFO - sleep for 2 secs. ... [2016-03-24 09:47:10,748] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:47:10,754] - [rest_client:43] WARNING - server 127.0.0.1:9000 status is warmup [2016-03-24 09:47:11,758] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:47:11,760] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:47:11,766] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:47:11,769] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:47:11,774] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:47:11,776] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:47:11,779] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:47:11,784] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:11,784] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr' [2016-03-24 09:47:11,787] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%27 [2016-03-24 09:47:11,812] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 23.804999ms [2016-03-24 09:47:11,812] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr' [2016-03-24 09:47:11,815] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee93b8cd85acab4f12bd9ea1a248e5ec54join_yr%27 [2016-03-24 09:47:11,834] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 17.4878ms [2016-03-24 09:47:11,839] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:11,849] - [basetestcase:1981] INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator] [2016-03-24 09:47:11,849] - [tuq_helper:393] INFO - CHECK FOR PRIMARY INDEXES [2016-03-24 09:47:11,849] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:47:11,850] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:47:11,852] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:47:11,868] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 13.902945ms [2016-03-24 09:47:11,868] - [tuq_helper:400] INFO - DROP PRIMARY INDEX ON default USING GSI [2016-03-24 09:47:11,868] - [tuq_helper:75] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary' [2016-03-24 09:47:11,871] - [rest_client:2508] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27 [2016-03-24 09:47:11,891] - [tuq_helper:105] INFO - TOTAL ELAPSED TIME: 19.245698ms [2016-03-24 09:47:12,075] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: rm -f /opt/couchbase/var/lib/couchbase/meta;rm -f /tmp/log_upr_client.sock [2016-03-24 09:47:12,100] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:47:12,101] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall cbq-engine [2016-03-24 09:47:12,131] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:47:12,132] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall tuqtng [2016-03-24 09:47:12,174] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:47:12,175] - [remote_util:2277] INFO - running command.raw on 127.0.0.1: killall indexer [2016-03-24 09:47:12,213] - [remote_util:2314] INFO - command executed successfully [2016-03-24 09:47:12,214] - [basetestcase:297] INFO - ============== basetestcase cleanup was started for test #15 test_delete_create_bucket_and_query ============== [2016-03-24 09:47:12,237] - [bucket_helper:137] INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-03-24 09:47:12,237] - [bucket_helper:139] INFO - remove bucket default ... [2016-03-24 09:47:12,553] - [bucket_helper:153] INFO - deleted bucket : default from 127.0.0.1 [2016-03-24 09:47:12,553] - [bucket_helper:226] INFO - waiting for bucket deletion to complete.... [2016-03-24 09:47:12,556] - [rest_client:127] INFO - node 127.0.0.1 existing buckets : [] [2016-03-24 09:47:12,561] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:47:12,567] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:47:12,573] - [bucket_helper:137] INFO - deleting existing buckets [] on 127.0.0.1 [2016-03-24 09:47:12,589] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-03-24 09:47:12,594] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9000 is running [2016-03-24 09:47:12,596] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-03-24 09:47:12,599] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9001 is running [2016-03-24 09:47:12,602] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-03-24 09:47:12,605] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9002 is running [2016-03-24 09:47:12,607] - [cluster_helper:78] INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-03-24 09:47:12,610] - [cluster_helper:80] INFO - ns_server @ 127.0.0.1:9003 is running [2016-03-24 09:47:12,610] - [basetestcase:315] INFO - ============== basetestcase cleanup was finished for test #15 test_delete_create_bucket_and_query ============== ok ---------------------------------------------------------------------- Ran 1 test in 37.423s OK Cluster instance shutdown with force summary so far suite 2i.indexscans_2i.SecondaryIndexingScanTests , pass 9 , fail 0 summary so far suite 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests , pass 2 , fail 0 summary so far suite 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests , pass 4 , fail 0 testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-16-Mar-24_09-38-02/test_15 Run after suite setup for 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexscans_2i.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index pass 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests.test_multi_create_drop_index pass 2i.indexcreatedrop_2i.SecondaryIndexingCreateDropTests.test_multi_create_drop_index pass 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_remove_bucket_and_query pass 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_change_bucket_properties pass 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_flush_bucket_and_query pass 2i.cluster_ops_2i.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query pass Thread Cluster_Thread was not properly terminated, will be terminated now. scripts/start_cluster_and_run_tests.sh: line 81: 12636 Terminated COUCHBASE_NUM_VBUCKETS=64 python ./cluster_run --nodes=$servers_count &> $wd/cluster_run.log (wd: /opt/build/ns_server) Testing Failed: Required test failed FAIL github.com/couchbase/indexing/secondary/tests/functionaltests 3745.065s FAIL github.com/couchbase/indexing/secondary/tests/largedatatests 1090.812s --- FAIL: TestLargeMutations (243.04s) --- FAIL: TestConcurrentScans_MultipleIndexes (110.34s) Version: versions-24.03.2016-07.40.cfg Build Log: make-24.03.2016-07.40.log Server Log: logs-24.03.2016-07.40.tar.gz Collect Info: collects-24.03.2016-07.40.tar Install: installer-24.03.2016-07.40.tar Finished