http://ci2i-unstable.northscale.in/gsi-19.12.2020-20.37.fail.html

Building
Started building at 2020/12/19 20:37:35
Using pegged server, 3874 build
Calculating base
Updating mirror
Basing run on 7.0.0-3874 b7ed9be08
Updating tree for run 19.12.2020-20.37
query is at 9504975, changes since last good build: none
gometa is at b0e38b7, changes since last good build: none
ns_server is at 132187d, changes since last good build: none
couchstore is at a230f9c, changes since last good build: none
forestdb is at 9a5b9b0, changes since last good build: none
kv_engine is at 465f125, changes since last good build: none
Switching indexing to unstable
indexing is at 48c0808, changes since last good build: none
Switching plasma to unstable
plasma is at c155940, changes since last good build: none
Switching nitro to unstable
nitro is at 8c1952a, changes since last good build: none
Switching gometa to master
gometa is at b0e38b7, changes since last good build: none
Switching testrunner to master
testrunner is at a37a8d5, changes since last good build: none
Building cmakefiles and deps
Building main product
Testing
Started testing at 2020/12/19 20:54:24
Testing mode: sanity,unit,functional,integration
Using storage type: fdb
Setting ulimit to 200000
Simple Test
Dec 19 20:55:30 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Dec 19 21:02:43 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Dec 19 21:03:26 do_warmup_100k (memcapable.WarmUpMemcachedTest) ... ok
Dec 19 21:04:12 test_view_ops (view.createdeleteview.CreateDeleteViewTests) ... ok
Dec 19 21:14:16 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Dec 19 21:14:34 b'-->result: '
Dec 19 21:14:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 1'
Dec 19 21:14:34 b'failures so far...'
Dec 19 21:14:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:14:34 b'failures so far...'
Dec 19 21:14:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:14:34 b'failures so far...'
Dec 19 21:14:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:14:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:14:34 b'failures so far...'
Dec 19 21:14:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:14:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 19 21:14:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:14:34 b'failures so far...'
Dec 19 21:14:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:14:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 19 21:14:34 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Dec 19 21:14:50 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'ok
Dec 19 21:17:34 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Dec 19 21:20:29 load_with_failover (xdcr.uniXDCR.unidirectional) ... ok
Dec 19 21:22:26 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Dec 19 21:22:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:22:26 b'failures so far...'
Dec 19 21:22:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 19 21:22:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:22:26 b'failures so far...'
Dec 19 21:22:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 19 21:22:26 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Dec 19 21:22:26 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Dec 19 21:22:26 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_20-54-47/test_8'}"
Dec 19 21:22:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 1'
Dec 19 21:22:26 b'failures so far...'
Dec 19 21:22:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 19 21:22:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 19 21:22:26 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Dec 19 21:22:26 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Dec 19 21:22:26 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' fail ')"
Dec 19 21:22:26 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Dec 19 21:22:26 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' pass')"
Dec 19 21:22:26 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Dec 19 21:22:26 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Dec 19 21:22:26 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Dec 19 21:22:26 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Dec 19 21:22:26 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Dec 19 21:22:26 Makefile:28: recipe for target 'simple-test' failed
Unit tests
=== RUN   TestInteger
--- PASS: TestInteger (0.00s)
=== RUN   TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN   TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN   TestFloat
--- PASS: TestFloat (0.00s)
=== RUN   TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN   TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN   TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN   TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN   TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN   TestReference
--- PASS: TestReference (0.00s)
=== RUN   TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN   TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN   TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN   TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN   TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN   TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN   TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN   TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN   TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618] 
PASS 
TESTING [0] 
PASS 
TESTING [0.0] 
PASS 
TESTING [0.0000] 
PASS 
TESTING [0.0000000] 
PASS 
TESTING [-0] 
PASS 
TESTING [-0.0] 
PASS 
TESTING [-0.0000] 
PASS 
TESTING [-0.0000000] 
PASS 
TESTING [1] 
PASS 
TESTING [20] 
PASS 
TESTING [3456] 
PASS 
TESTING [7645000] 
PASS 
TESTING [9223372036854775807] 
PASS 
TESTING [9223372036854775806] 
PASS 
TESTING [9223372036854775808] 
PASS 
TESTING [92233720368547758071234000] 
PASS 
TESTING [92233720368547758071234987437653] 
PASS 
TESTING [12300000000000000000000000000000056] 
PASS 
TESTING [12300000000000000000000000000000000] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [210690] 
PASS 
TESTING [90000] 
PASS 
TESTING [123000000] 
PASS 
TESTING [3.60e2] 
PASS 
TESTING [36e2] 
PASS 
TESTING [1.9999999999e10] 
PASS 
TESTING [1.99999e10] 
PASS 
TESTING [1.99999e5] 
PASS 
TESTING [0.00000000000012e15] 
PASS 
TESTING [7.64507352e8] 
PASS 
TESTING [9.2233720368547758071234987437653e31] 
PASS 
TESTING [2650e-1] 
PASS 
TESTING [26500e-1] 
PASS 
TESTING [-1] 
PASS 
TESTING [-20] 
PASS 
TESTING [-3456] 
PASS 
TESTING [-7645000] 
PASS 
TESTING [-9223372036854775808] 
PASS 
TESTING [-9223372036854775807] 
PASS 
TESTING [-9223372036854775806] 
PASS 
TESTING [-9223372036854775809] 
PASS 
TESTING [-92233720368547758071234000] 
PASS 
TESTING [-92233720368547758071234987437653] 
PASS 
TESTING [-12300000000000000000000000000000056] 
PASS 
TESTING [-12300000000000000000000000000000000] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [-210690] 
PASS 
TESTING [-90000] 
PASS 
TESTING [-123000000] 
PASS 
TESTING [-3.60e2] 
PASS 
TESTING [-36e2] 
PASS 
TESTING [-1.9999999999e10] 
PASS 
TESTING [-1.99999e10] 
PASS 
TESTING [-1.99999e5] 
PASS 
TESTING [-0.00000000000012e15] 
PASS 
TESTING [-2650e-1] 
PASS 
TESTING [-26500e-1] 
PASS 
TESTING [0.03] 
PASS 
TESTING [198.60] 
PASS 
TESTING [2000045.178] 
PASS 
TESTING [1.7976931348623157e+308] 
PASS 
TESTING [0.000000000000000000890] 
PASS 
TESTING [257953786.9864236576] 
PASS 
TESTING [257953786.9864236576e8] 
PASS 
TESTING [36.912e3] 
PASS 
TESTING [2761.67e0] 
PASS 
TESTING [2761.67e00] 
PASS 
TESTING [2761.67e000] 
PASS 
TESTING [7676546.67e-3] 
PASS 
TESTING [-0.03] 
PASS 
TESTING [-198.60] 
PASS 
TESTING [-2000045.178] 
PASS 
TESTING [-1.7976931348623157e+308] 
PASS 
TESTING [-0.000000000000000000890] 
PASS 
TESTING [-257953786.9864236576] 
PASS 
TESTING [-257953786.9864236576e8] 
PASS 
TESTING [-36.912e3] 
PASS 
TESTING [-2761.67e0] 
PASS 
TESTING [-2761.67e00] 
PASS 
TESTING [-2761.67e000] 
PASS 
TESTING [-7676546.67e-3] 
PASS 
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN   TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN   TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN   TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/collatejson	0.035s
=== RUN   TestForestDBIterator
2020-12-19T21:22:42.680+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5626 us

2020-12-19T21:22:42.681+05:30 [INFO][FDB] Forestdb opened database file test
2020-12-19T21:22:42.685+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN   TestForestDBIteratorSeek
2020-12-19T21:22:42.685+05:30 [INFO][FDB] Forestdb opened database file test
2020-12-19T21:22:42.688+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN   TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN   TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN   TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN   TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN   TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN   TestMemDBInsertionPerf
Initial build: 10000000 items took 1m57.077115092s -> 85413.78895561214 items/s
Incr build: 10000000 items took 1m51.443917331s -> 89731.2319908763 items/s
Main Index: {
"node_count":             18000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       2,
"next_pointers_per_node": 1.3333,
"memory_used":            1695887692,
"node_allocs":            18000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 13500190,
"level1": 3375550,
"level2": 843073,
"level3": 210794,
"level4": 52734,
"level5": 13348,
"level6": 3246,
"level7": 782,
"level8": 220,
"level9": 42,
"level10": 17,
"level11": 3,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (228.52s)
=== RUN   TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN   TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN   TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN   TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN   TestDequeueA
--- PASS: TestDequeueA (1.20s)
=== RUN   TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN   TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN   TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.00s)
=== RUN   TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN   TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/indexer	252.652s
=== RUN   TestConnPoolBasicSanity
2020-12-19T21:26:59.088+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2020-12-19T21:26:59.294+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:27:00.089+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN   TestConnRelease
2020-12-19T21:27:04.090+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2020-12-19T21:27:43.822+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:27:44.103+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.73s)
=== RUN   TestLongevity
2020-12-19T21:27:47.823+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Releasing 1 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
2020-12-19T21:28:26.278+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:28:26.834+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.46s)
=== RUN   TestSustainedHighConns
2020-12-19T21:28:30.279+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
cp.curActConns = 0
Allocating 16 Connections
Returning 3 Connections
cp.curActConns = 12
Returning 2 Connections
cp.curActConns = 11
Allocating 6 Connections
Returning 4 Connections
cp.curActConns = 13
Returning 2 Connections
Allocating 6 Connections
cp.curActConns = 17
Returning 1 Connections
Allocating 10 Connections
cp.curActConns = 24
Returning 1 Connections
cp.curActConns = 25
Returning 3 Connections
Allocating 15 Connections
cp.curActConns = 36
Returning 4 Connections
cp.curActConns = 33
Allocating 13 Connections
Returning 3 Connections
cp.curActConns = 43
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 44
Returning 4 Connections
Allocating 9 Connections
cp.curActConns = 48
Returning 3 Connections
cp.curActConns = 46
Allocating 7 Connections
Returning 1 Connections
cp.curActConns = 52
Returning 4 Connections
Allocating 24 Connections
cp.curActConns = 60
Returning 0 Connections
cp.curActConns = 72
Returning 0 Connections
Allocating 13 Connections
cp.curActConns = 72
Returning 3 Connections
cp.curActConns = 82
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 84
Returning 1 Connections
Allocating 10 Connections
cp.curActConns = 84
Returning 0 Connections
cp.curActConns = 93
Returning 1 Connections
Allocating 16 Connections
cp.curActConns = 96
Returning 3 Connections
cp.curActConns = 105
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 106
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 108
Returning 3 Connections
cp.curActConns = 119
Returning 1 Connections
cp.curActConns = 120
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 119
Allocating 22 Connections
Returning 4 Connections
cp.curActConns = 130
Returning 2 Connections
cp.curActConns = 135
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 141
Returning 0 Connections
cp.curActConns = 153
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 153
Returning 2 Connections
Allocating 8 Connections
cp.curActConns = 153
Returning 1 Connections
cp.curActConns = 158
Returning 4 Connections
Allocating 8 Connections
cp.curActConns = 162
Returning 3 Connections
Allocating 16 Connections
cp.curActConns = 164
Returning 2 Connections
cp.curActConns = 173
Returning 3 Connections
Allocating 11 Connections
cp.curActConns = 175
Returning 1 Connections
cp.curActConns = 180
Returning 2 Connections
Allocating 15 Connections
cp.curActConns = 186
Returning 3 Connections
cp.curActConns = 190
Returning 2 Connections
Allocating 18 Connections
cp.curActConns = 197
Returning 0 Connections
cp.curActConns = 206
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 202
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 202
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 202
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 201
Returning 2 Connections
Allocating 9 Connections
cp.curActConns = 208
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 208
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 207
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 203
Returning 4 Connections
Allocating 16 Connections
cp.curActConns = 209
Returning 0 Connections
cp.curActConns = 215
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 213
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 210
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 209
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 207
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 211
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 211
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 212
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 212
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 216
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 216
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 216
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 214
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 212
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 218
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 221
Returning 0 Connections
cp.curActConns = 222
Allocating 3 Connections
Returning 0 Connections
cp.curActConns = 225
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 223
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 223
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 225
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 228
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 227
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 226
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 229
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 228
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 227
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 231
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 231
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2020-12-19T21:29:25.316+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:29:26.295+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.04s)
=== RUN   TestLowWM
2020-12-19T21:29:29.317+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2020-12-19T21:30:29.333+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2020-12-19T21:31:29.350+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2020-12-19T21:31:34.829+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:31:35.352+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.51s)
=== RUN   TestTotalConns
2020-12-19T21:31:38.830+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2020-12-19T21:31:52.894+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:31:53.835+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.07s)
=== RUN   TestUpdateTickRate
2020-12-19T21:31:56.895+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2020-12-19T21:32:17.715+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2020-12-19T21:32:17.901+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.82s)
PASS
ok  	github.com/couchbase/indexing/secondary/queryport/client	322.663s
Starting server: attempt 1
Functional tests
2020/12/19 21:35:06 In TestMain()
2020/12/19 21:35:06 Changing config key queryport.client.settings.backfillLimit to value 0
2020/12/19 21:35:06 Changing config key indexer.api.enableTestServer to value true
2020/12/19 21:35:06 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2020/12/19 21:35:06 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2020/12/19 21:35:06 Changing config key indexer.settings.log_level to value info
2020/12/19 21:35:06 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2020/12/19 21:35:06 Using forestdb for creating indexes
2020/12/19 21:35:06 Changing config key indexer.settings.storage_mode to value forestdb
2020-12-19T21:35:06.773+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T21:35:06.774+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 21:35:11 Data file exists. Skipping download
2020/12/19 21:35:11 Data file exists. Skipping download
2020/12/19 21:35:12 In DropAllSecondaryIndexes()
2020/12/19 21:35:12 Emptying the default bucket
2020/12/19 21:35:15 Flush Enabled on bucket default, responseBody: 
2020/12/19 21:35:54 Flushed the bucket default, Response body: 
2020/12/19 21:35:54 Create Index On the empty default Bucket()
2020/12/19 21:35:57 Created the secondary index index_eyeColor. Waiting for it become active
2020/12/19 21:35:57 Index is now active
2020/12/19 21:35:57 Populating the default bucket
=== RUN   TestScanAfterBucketPopulate
2020/12/19 21:36:06 In TestScanAfterBucketPopulate()
2020/12/19 21:36:06 Create an index on empty bucket, populate the bucket and Run a scan on the index
2020/12/19 21:36:06 Using n1ql client
2020-12-19T21:36:06.724+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2020-12-19T21:36:06.731+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":120000,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T21:36:06.782+05:30 [Info] MetadataProvider.SetClusterStatus(): healthy nodes 1 failed node 0 unhealthy node 0 add node 0
2020-12-19T21:36:06.782+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:36:06.782+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:36:06.782+05:30 [Info] MetadataProvider.WatchMetadata(): indexer 127.0.0.1:9106
2020-12-19T21:36:06.824+05:30 [Info] WatchMetadata(): successfully reach indexer at 127.0.0.1:9106.
2020-12-19T21:36:06.826+05:30 [Info] MetadataProvider: Updating indexer version to 5
2020-12-19T21:36:06.826+05:30 [Info] initialized currmeta 3 force true 
2020-12-19T21:36:06.826+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] started poolsize 5000 overflow 30 low WM 1000 relConn batch size 100 ...
2020-12-19T21:36:06.826+05:30 [Info] [GsiScanClient:"127.0.0.1:9107"] started ...
2020-12-19T21:36:06.828+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2020-12-19T21:36:06.829+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:36:06.829+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:36:06.829+05:30 [Info] GSIC[default/default-_default-_default-1608393966721578259] started ...
2020/12/19 21:36:07 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.36s)
=== RUN   TestRestartNilSnapshot
2020/12/19 21:36:07 In TestRestartNilSnapshot()
2020/12/19 21:36:11 Created the secondary index idx_age. Waiting for it become active
2020/12/19 21:36:11 Index is now active
2020/12/19 21:36:11 Restarting indexer process ...
2020/12/19 21:36:11 []
2020-12-19T21:36:11.657+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T21:36:11.657+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T21:36:11.660+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T21:36:11.660+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 21:39:31 Using n1ql client
2020-12-19T21:39:31.608+05:30 [Error] transport error between 127.0.0.1:39730->127.0.0.1:9107: write tcp 127.0.0.1:39730->127.0.0.1:9107: write: broken pipe
2020-12-19T21:39:31.608+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 5033973093090036739 request transport failed `write tcp 127.0.0.1:39730->127.0.0.1:9107: write: broken pipe`
2020-12-19T21:39:31.608+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 21:39:31 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.69s)
=== RUN   TestThreeIndexCreates
2020/12/19 21:39:31 In TestThreeIndexCreates()
2020/12/19 21:39:36 Created the secondary index index_balance. Waiting for it become active
2020/12/19 21:39:36 Index is now active
2020/12/19 21:39:36 Create docs mutations
2020/12/19 21:39:36 Using n1ql client
2020/12/19 21:39:36 Expected and Actual scan responses are the same
2020/12/19 21:39:40 Created the secondary index index_email. Waiting for it become active
2020/12/19 21:39:40 Index is now active
2020/12/19 21:39:40 Create docs mutations
2020/12/19 21:39:40 Using n1ql client
2020/12/19 21:39:40 Expected and Actual scan responses are the same
2020/12/19 21:39:45 Created the secondary index index_pin. Waiting for it become active
2020/12/19 21:39:45 Index is now active
2020/12/19 21:39:45 Delete docs mutations
2020/12/19 21:39:45 Using n1ql client
2020/12/19 21:39:45 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (14.05s)
=== RUN   TestMultipleIndexCreatesDropsWithMutations
2020/12/19 21:39:45 In TestThreeIndexCreates()
2020/12/19 21:39:49 Created the secondary index index_state. Waiting for it become active
2020/12/19 21:39:49 Index is now active
2020/12/19 21:39:49 Create docs mutations
2020/12/19 21:39:50 Using n1ql client
2020/12/19 21:39:50 Expected and Actual scan responses are the same
2020/12/19 21:39:54 Created the secondary index index_registered. Waiting for it become active
2020/12/19 21:39:54 Index is now active
2020/12/19 21:39:54 Create docs mutations
2020/12/19 21:39:54 Using n1ql client
2020/12/19 21:39:55 Expected and Actual scan responses are the same
2020/12/19 21:39:59 Created the secondary index index_gender. Waiting for it become active
2020/12/19 21:39:59 Index is now active
2020/12/19 21:39:59 Create docs mutations
2020/12/19 21:39:59 Using n1ql client
2020/12/19 21:40:00 Expected and Actual scan responses are the same
2020/12/19 21:40:00 Dropping the secondary index index_registered
2020/12/19 21:40:00 Index dropped
2020/12/19 21:40:00 Create docs mutations
2020/12/19 21:40:00 Delete docs mutations
2020/12/19 21:40:00 Using n1ql client
2020/12/19 21:40:00 Expected and Actual scan responses are the same
2020/12/19 21:40:04 Created the secondary index index_longitude. Waiting for it become active
2020/12/19 21:40:04 Index is now active
2020/12/19 21:40:04 Create docs mutations
2020/12/19 21:40:05 Using n1ql client
2020/12/19 21:40:05 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (19.69s)
=== RUN   TestCreateDropScan
2020/12/19 21:40:05 In TestCreateDropScan()
2020/12/19 21:40:09 Created the secondary index index_cd. Waiting for it become active
2020/12/19 21:40:09 Index is now active
2020/12/19 21:40:09 Using n1ql client
2020/12/19 21:40:09 Expected and Actual scan responses are the same
2020/12/19 21:40:09 Dropping the secondary index index_cd
2020/12/19 21:40:09 Index dropped
2020/12/19 21:40:10 Using n1ql client
2020/12/19 21:40:10 Scan failed as expected with error: GSI index index_cd not found.
--- PASS: TestCreateDropScan (4.51s)
=== RUN   TestCreateDropCreate
2020/12/19 21:40:10 In TestCreateDropCreate()
2020/12/19 21:40:14 Created the secondary index index_cdc. Waiting for it become active
2020/12/19 21:40:14 Index is now active
2020/12/19 21:40:14 Using n1ql client
2020/12/19 21:40:14 Expected and Actual scan responses are the same
2020/12/19 21:40:14 Dropping the secondary index index_cdc
2020/12/19 21:40:14 Index dropped
2020/12/19 21:40:14 Using n1ql client
2020/12/19 21:40:14 Scan 2 failed as expected with error: GSI index index_cdc not found.
2020/12/19 21:40:18 Created the secondary index index_cdc. Waiting for it become active
2020/12/19 21:40:18 Index is now active
2020/12/19 21:40:18 Using n1ql client
2020/12/19 21:40:19 Expected and Actual scan responses are the same
2020/12/19 21:40:19 (Inclusion 1) Lengths of expected and actual scan results are 5034 and 5034. Num of docs in bucket = 10402
2020/12/19 21:40:19 Using n1ql client
2020/12/19 21:40:19 Expected and Actual scan responses are the same
2020/12/19 21:40:19 (Inclusion 3) Lengths of expected and actual scan results are 5034 and 5034. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (9.20s)
=== RUN   TestCreate2Drop1Scan2
2020/12/19 21:40:19 In TestCreate2Drop1Scan2()
2020/12/19 21:40:23 Created the secondary index index_i1. Waiting for it become active
2020/12/19 21:40:23 Index is now active
2020/12/19 21:40:27 Created the secondary index index_i2. Waiting for it become active
2020/12/19 21:40:27 Index is now active
2020/12/19 21:40:27 Using n1ql client
2020/12/19 21:40:28 Expected and Actual scan responses are the same
2020/12/19 21:40:28 Using n1ql client
2020/12/19 21:40:28 Expected and Actual scan responses are the same
2020/12/19 21:40:28 Dropping the secondary index index_i1
2020/12/19 21:40:28 Index dropped
2020/12/19 21:40:28 Using n1ql client
2020/12/19 21:40:28 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (9.37s)
=== RUN   TestIndexNameCaseSensitivity
2020/12/19 21:40:28 In TestIndexNameCaseSensitivity()
2020/12/19 21:40:32 Created the secondary index index_age. Waiting for it become active
2020/12/19 21:40:32 Index is now active
2020/12/19 21:40:32 Using n1ql client
2020/12/19 21:40:32 Expected and Actual scan responses are the same
2020/12/19 21:40:32 Using n1ql client
2020/12/19 21:40:32 Scan failed as expected with error: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (4.31s)
=== RUN   TestCreateDuplicateIndex
2020/12/19 21:40:32 In TestCreateDuplicateIndex()
2020/12/19 21:40:37 Created the secondary index index_di1. Waiting for it become active
2020/12/19 21:40:37 Index is now active
2020/12/19 21:40:37 Index found:  index_di1
2020/12/19 21:40:37 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (4.36s)
=== RUN   TestDropNonExistingIndex
2020/12/19 21:40:37 In TestDropNonExistingIndex()
2020/12/19 21:40:37 Dropping the secondary index 123456
2020/12/19 21:40:37 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.13s)
=== RUN   TestCreateIndexNonExistentBucket
2020/12/19 21:40:37 In TestCreateIndexNonExistentBucket()
2020-12-19T21:40:38.206+05:30 [Error] Encountered error during create index.  Error: Bucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time (err=Bucket Not Found).
2020-12-19T21:40:48.209+05:30 [Error] Fail to create index: Bucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time (err=Bucket Not Found).
2020/12/19 21:40:48 Index create failed as expected with error: Bucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time (err=Bucket Not Found).
--- PASS: TestCreateIndexNonExistentBucket (10.83s)
=== RUN   TestScanWithNoTimeout
2020/12/19 21:40:48 Create an index on empty bucket, populate the bucket and Run a scan on the index
2020/12/19 21:40:48 Changing config key indexer.settings.scan_timeout to value 0
2020/12/19 21:40:48 Using n1ql client
2020-12-19T21:40:48.385+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020/12/19 21:40:48 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.55s)
=== RUN   TestIndexingOnBinaryBucketMeta
2020/12/19 21:40:48 In TestIndexingOnBinaryBucketMeta()
2020/12/19 21:40:48 	 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2020/12/19 21:40:48 	 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2020/12/19 21:40:51 Modified parameters of bucket default, responseBody: 
2020/12/19 21:40:51 Created bucket binaryBucket, responseBody: 
2020/12/19 21:41:10 Created the secondary index index_binary_meta_id. Waiting for it become active
2020/12/19 21:41:10 Index is now active
2020/12/19 21:41:15 items_count stat is 10 for index index_binary_meta_id
2020/12/19 21:41:15 Dropping the secondary index index_binary_meta_id
2020/12/19 21:41:15 Index dropped
2020/12/19 21:41:18 Created the secondary index index_binary_meta_cas. Waiting for it become active
2020/12/19 21:41:18 Index is now active
2020/12/19 21:41:23 items_count stat is 10 for index index_binary_meta_cas
2020/12/19 21:41:23 Dropping the secondary index index_binary_meta_cas
2020/12/19 21:41:23 Index dropped
2020/12/19 21:41:26 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2020/12/19 21:41:26 Index is now active
2020/12/19 21:41:31 items_count stat is 10 for index index_binary_meta_expiration
2020/12/19 21:41:31 Dropping the secondary index index_binary_meta_expiration
2020/12/19 21:41:31 Index dropped
2020/12/19 21:41:33 Deleted bucket binaryBucket, responseBody: 
2020/12/19 21:41:36 Modified parameters of bucket default, responseBody: 
--- PASS: TestIndexingOnBinaryBucketMeta (62.94s)
=== RUN   TestRetainDeleteXATTRBinaryDocs
2020/12/19 21:41:51 In TestRetainDeleteXATTRBinaryDocs()
2020/12/19 21:41:51 	 1. Populate a bucket with binary docs having system XATTRS
2020/12/19 21:41:51 	 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2020/12/19 21:41:51 	 3. Delete the documents in the bucket
2020/12/19 21:41:51 	 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2020/12/19 21:41:54 Modified parameters of bucket default, responseBody: 
2020/12/19 21:41:54 Created bucket binaryBucket, responseBody: 
2020/12/19 21:42:12 Created the secondary index index_system_xattr. Waiting for it become active
2020/12/19 21:42:12 Index is now active
2020/12/19 21:42:17 Deleted all the documents in the bucket: binaryBucket successfully
2020/12/19 21:42:20 Deleted bucket binaryBucket, responseBody: 
2020/12/19 21:42:23 Modified parameters of bucket default, responseBody: 
--- PASS: TestRetainDeleteXATTRBinaryDocs (46.59s)
=== RUN   TestSimpleIndex_FloatDataType
2020/12/19 21:42:38 In TestSimpleIndex_FloatDataType()
2020/12/19 21:42:38 Index found:  index_age
2020/12/19 21:42:38 Using n1ql client
2020/12/19 21:42:38 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.13s)
=== RUN   TestSimpleIndex_StringDataType
2020/12/19 21:42:38 In TestSimpleIndex_StringDataType()
2020/12/19 21:42:42 Created the secondary index index_company. Waiting for it become active
2020/12/19 21:42:42 Index is now active
2020/12/19 21:42:42 Using n1ql client
2020/12/19 21:42:42 Expected and Actual scan responses are the same
2020/12/19 21:42:42 Using n1ql client
2020/12/19 21:42:43 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.70s)
=== RUN   TestSimpleIndex_FieldValueCaseSensitivity
2020/12/19 21:42:43 In TestSimpleIndex_StringCaseSensitivity()
2020/12/19 21:42:43 Index found:  index_company
2020/12/19 21:42:43 Using n1ql client
2020/12/19 21:42:43 Expected and Actual scan responses are the same
2020/12/19 21:42:43 Using n1ql client
2020/12/19 21:42:43 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.27s)
=== RUN   TestSimpleIndex_BoolDataType
2020/12/19 21:42:43 In TestSimpleIndex_BoolDataType()
2020/12/19 21:42:47 Created the secondary index index_isActive. Waiting for it become active
2020/12/19 21:42:47 Index is now active
2020/12/19 21:42:47 Using n1ql client
2020/12/19 21:42:48 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (4.64s)
=== RUN   TestBasicLookup
2020/12/19 21:42:48 In TestBasicLookup()
2020/12/19 21:42:48 Index found:  index_company
2020/12/19 21:42:48 Using n1ql client
2020/12/19 21:42:48 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN   TestIndexOnNonExistentField
2020/12/19 21:42:48 In TestIndexOnNonExistentField()
2020/12/19 21:42:52 Created the secondary index index_height. Waiting for it become active
2020/12/19 21:42:52 Index is now active
2020/12/19 21:42:52 Using n1ql client
2020/12/19 21:42:52 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (4.18s)
=== RUN   TestIndexPartiallyMissingField
2020/12/19 21:42:52 In TestIndexPartiallyMissingField()
2020/12/19 21:42:56 Created the secondary index index_nationality. Waiting for it become active
2020/12/19 21:42:56 Index is now active
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (4.32s)
=== RUN   TestScanNonMatchingDatatype
2020/12/19 21:42:56 In TestScanNonMatchingDatatype()
2020/12/19 21:42:56 Index found:  index_age
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN   TestInclusionNeither
2020/12/19 21:42:56 In TestInclusionNeither()
2020/12/19 21:42:56 Index found:  index_age
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.12s)
=== RUN   TestInclusionLow
2020/12/19 21:42:56 In TestInclusionLow()
2020/12/19 21:42:56 Index found:  index_age
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.06s)
=== RUN   TestInclusionHigh
2020/12/19 21:42:56 In TestInclusionHigh()
2020/12/19 21:42:56 Index found:  index_age
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.06s)
=== RUN   TestInclusionBoth
2020/12/19 21:42:56 In TestInclusionBoth()
2020/12/19 21:42:56 Index found:  index_age
2020/12/19 21:42:56 Using n1ql client
2020/12/19 21:42:56 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.12s)
=== RUN   TestNestedIndex_String
2020/12/19 21:42:56 In TestNestedIndex_String()
2020/12/19 21:43:01 Created the secondary index index_streetname. Waiting for it become active
2020/12/19 21:43:01 Index is now active
2020/12/19 21:43:01 Using n1ql client
2020/12/19 21:43:01 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (4.16s)
=== RUN   TestNestedIndex_Float
2020/12/19 21:43:01 In TestNestedIndex_Float()
2020/12/19 21:43:05 Created the secondary index index_floor. Waiting for it become active
2020/12/19 21:43:05 Index is now active
2020/12/19 21:43:05 Using n1ql client
2020/12/19 21:43:05 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (4.26s)
=== RUN   TestNestedIndex_Bool
2020/12/19 21:43:05 In TestNestedIndex_Bool()
2020/12/19 21:43:09 Created the secondary index index_isresidential. Waiting for it become active
2020/12/19 21:43:09 Index is now active
2020/12/19 21:43:09 Using n1ql client
2020/12/19 21:43:09 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (4.31s)
=== RUN   TestLookupJsonObject
2020/12/19 21:43:09 In TestLookupJsonObject()
2020/12/19 21:43:15 Created the secondary index index_streetaddress. Waiting for it become active
2020/12/19 21:43:15 Index is now active
2020/12/19 21:43:15 Using n1ql client
2020/12/19 21:43:15 Count of docScanResults is 1
2020/12/19 21:43:15 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2020/12/19 21:43:15 Count of scanResults is 1
2020/12/19 21:43:15 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2020/12/19 21:43:15 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.33s)
=== RUN   TestLookupObjDifferentOrdering
2020/12/19 21:43:15 In TestLookupObjDifferentOrdering()
2020/12/19 21:43:15 Index found:  index_streetaddress
2020/12/19 21:43:15 Using n1ql client
2020/12/19 21:43:15 Count of docScanResults is 1
2020/12/19 21:43:15 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2020/12/19 21:43:15 Count of scanResults is 1
2020/12/19 21:43:15 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2020/12/19 21:43:15 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.01s)
=== RUN   TestRangeJsonObject
2020/12/19 21:43:15 In TestRangeJsonObject()
2020/12/19 21:43:15 Index found:  index_streetaddress
2020/12/19 21:43:15 Using n1ql client
2020/12/19 21:43:15 Count of scanResults is 2
2020/12/19 21:43:15 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2020/12/19 21:43:15 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2020/12/19 21:43:15 Count of docScanResults is 2
2020/12/19 21:43:15 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2020/12/19 21:43:15 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2020/12/19 21:43:15 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN   TestLookupFloatDiffForms
2020/12/19 21:43:15 In TestLookupFloatDiffForms()
2020/12/19 21:43:20 Created the secondary index index_latitude. Waiting for it become active
2020/12/19 21:43:20 Index is now active
2020/12/19 21:43:20 Scan 1
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 2
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 3
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 4
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 5
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 6
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (4.82s)
=== RUN   TestRangeFloatInclVariations
2020/12/19 21:43:20 In TestRangeFloatInclVariations()
2020/12/19 21:43:20 Index found:  index_latitude
2020/12/19 21:43:20 Scan 1
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 2
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 3
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 4
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 5
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
2020/12/19 21:43:20 Scan 6
2020/12/19 21:43:20 Using n1ql client
2020/12/19 21:43:20 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.03s)
=== RUN   TestScanAll
2020/12/19 21:43:20 In TestScanAll()
2020/12/19 21:43:25 Created the secondary index index_name. Waiting for it become active
2020/12/19 21:43:25 Index is now active
2020/12/19 21:43:25 Length of docScanResults = 10502
2020/12/19 21:43:25 Using n1ql client
2020/12/19 21:43:25 Length of scanResults = 10502
2020/12/19 21:43:25 Expected and Actual scan responses are the same
--- PASS: TestScanAll (4.73s)
=== RUN   TestScanAllNestedField
2020/12/19 21:43:25 In TestScanAllNestedField()
2020/12/19 21:43:25 Index found:  index_streetname
2020/12/19 21:43:25 Length of docScanResults = 2
2020/12/19 21:43:25 Using n1ql client
2020/12/19 21:43:25 Length of scanResults = 2
2020/12/19 21:43:25 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN   TestBasicPrimaryIndex
2020/12/19 21:43:25 In TestBasicPrimaryIndex()
2020/12/19 21:43:30 Created the secondary index index_p1. Waiting for it become active
2020/12/19 21:43:30 Index is now active
2020-12-19T21:43:30.625+05:30 [Error] transport error between 127.0.0.1:39300->127.0.0.1:9107: write tcp 127.0.0.1:39300->127.0.0.1:9107: write: broken pipe
2020-12-19T21:43:30.625+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:39300->127.0.0.1:9107: write: broken pipe`
2020-12-19T21:43:30.626+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 21:43:31 Expected and Actual scan responses are the same
2020/12/19 21:43:31 CountRange() expected and actual is:  1876 and 1876
2020/12/19 21:43:31 lookupkey for CountLookup() = Userae1098eb-d0ac-4b30-8341-fbcb33791c54
2020/12/19 21:43:31 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (5.69s)
=== RUN   TestBasicNullDataType
2020/12/19 21:43:31 In TestBasicNullDataType()
2020/12/19 21:43:31 Index found:  index_email
2020/12/19 21:43:31 Using n1ql client
2020/12/19 21:43:31 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.01s)
=== RUN   TestBasicArrayDataType_ScanAll
2020/12/19 21:43:31 In TestBasicArrayDataType_ScanAll()
2020/12/19 21:43:35 Created the secondary index index_tags. Waiting for it become active
2020/12/19 21:43:35 Index is now active
2020/12/19 21:43:35 Using n1ql client
2020/12/19 21:43:36 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (4.78s)
=== RUN   TestBasicArrayDataType_Lookup
2020/12/19 21:43:36 In TestBasicArrayDataType_Lookup()
2020/12/19 21:43:38 Index found:  index_tags
2020/12/19 21:43:38 Count of scanResults is 1
2020/12/19 21:43:38 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75  Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN   TestArrayDataType_LookupMissingArrayValue
2020/12/19 21:43:38 In TestArrayDataType_LookupMissingArrayValue()
2020/12/19 21:43:38 Index found:  index_tags
2020/12/19 21:43:38 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN   TestArrayDataType_LookupWrongOrder
2020/12/19 21:43:38 In TestArrayDataType_LookupWrongOrder()
2020/12/19 21:43:38 Index found:  index_tags
2020/12/19 21:43:38 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN   TestArrayDataType_LookupSubset
2020/12/19 21:43:38 In TestArrayDataType_LookupSubset()
2020/12/19 21:43:38 Index found:  index_tags
2020/12/19 21:43:38 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN   TestScanLimitParameter
2020/12/19 21:43:38 In TestScanLimitParameter()
2020/12/19 21:43:38 Index found:  index_age
2020/12/19 21:43:38 Using n1ql client
2020/12/19 21:43:38 Using n1ql client
--- PASS: TestScanLimitParameter (0.04s)
=== RUN   TestCountRange
2020/12/19 21:43:38 In TestRangeCount()
2020/12/19 21:43:38 Index found:  index_age
2020/12/19 21:43:38 Count of expected and actual Range is:  2384 and 2384
2020/12/19 21:43:38 Count of expected and actual Range is: 10002 and 10002
2020/12/19 21:43:38 Count of expected and actual Range are: 0 and 0
2020/12/19 21:43:38 Count of expected and actual Range are: 483 and 483
2020/12/19 21:43:38 Testing CountRange() for key <= val
2020/12/19 21:43:38 Count of expected and actual CountRange for key <= 30 are: 5254 and 5254
2020/12/19 21:43:38 Testing CountRange() for key >= val
2020/12/19 21:43:38 Count of expected and actual CountRange for key >= 25 are: 7677 and 7677
2020/12/19 21:43:38 Testing CountRange() for null < key <= val
2020/12/19 21:43:38 Count of expected and actual CountRange for key > null && key <= 30 are: 5254 and 5254
2020/12/19 21:43:38 Testing CountRange() for val <= key < null 
2020/12/19 21:43:38 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2020/12/19 21:43:38 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.67s)
=== RUN   TestCountLookup
2020/12/19 21:43:38 In TestCountLookup()
2020/12/19 21:43:38 Index found:  index_age
2020/12/19 21:43:38 Count of expected and actual Range are: 504 and 504
2020/12/19 21:43:38 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.03s)
=== RUN   TestRangeStatistics
2020/12/19 21:43:38 In TestRangeCount()
2020/12/19 21:43:38 Index found:  index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN   TestIndexCreateWithWhere
2020/12/19 21:43:38 In TestIndexCreateWithWhere()
2020/12/19 21:43:43 Created the secondary index index_ageabove30. Waiting for it become active
2020/12/19 21:43:43 Index is now active
2020/12/19 21:43:43 Using n1ql client
2020/12/19 21:43:43 Expected and Actual scan responses are the same
2020/12/19 21:43:43 Lengths of expected and actual scanReuslts are:  4265 and 4265
2020/12/19 21:43:47 Created the secondary index index_ageteens. Waiting for it become active
2020/12/19 21:43:47 Index is now active
2020/12/19 21:43:47 Using n1ql client
2020/12/19 21:43:47 Expected and Actual scan responses are the same
2020/12/19 21:43:47 Lengths of expected and actual scanReuslts are:  0 and 0
2020/12/19 21:43:52 Created the secondary index index_age35to45. Waiting for it become active
2020/12/19 21:43:52 Index is now active
2020/12/19 21:43:52 Using n1ql client
2020/12/19 21:43:52 Expected and Actual scan responses are the same
2020/12/19 21:43:52 Lengths of expected and actual scanReuslts are:  2867 and 2867
--- PASS: TestIndexCreateWithWhere (13.74s)
=== RUN   TestDeferredIndexCreate
2020/12/19 21:43:52 In TestDeferredIndexCreate()
2020/12/19 21:43:52 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2020/12/19 21:43:54 Build the deferred index index_deferred. Waiting for the index to become active
2020/12/19 21:43:54 Waiting for index to go active ...
2020/12/19 21:43:55 Waiting for index to go active ...
2020/12/19 21:43:56 Index is now active
2020/12/19 21:43:56 Using n1ql client
2020/12/19 21:43:56 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (4.41s)
=== RUN   TestCompositeIndex_NumAndString
2020/12/19 21:43:56 In TestCompositeIndex()
2020/12/19 21:44:01 Created the secondary index index_composite1. Waiting for it become active
2020/12/19 21:44:01 Index is now active
2020/12/19 21:44:01 Using n1ql client
2020/12/19 21:44:01 Using n1ql client
2020/12/19 21:44:01 Using n1ql client
2020/12/19 21:44:01 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (4.98s)
=== RUN   TestCompositeIndex_TwoNumberFields
2020/12/19 21:44:01 In TestCompositeIndex()
2020/12/19 21:44:06 Created the secondary index index_composite2. Waiting for it become active
2020/12/19 21:44:06 Index is now active
2020/12/19 21:44:06 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (5.07s)
=== RUN   TestNumbers_Int64_Float64
2020/12/19 21:44:07 In TestNumbers_Int64_Float64()
2020/12/19 21:44:11 Created the secondary index idx_numbertest. Waiting for it become active
2020/12/19 21:44:11 Index is now active
2020/12/19 21:44:11 
 ==== Int64 test #0
2020/12/19 21:44:11 Using n1ql client
2020/12/19 21:44:11 Expected and Actual scan responses are the same
2020/12/19 21:44:11 
 ==== Int64 test #1
2020/12/19 21:44:11 Using n1ql client
2020/12/19 21:44:11 Expected and Actual scan responses are the same
2020/12/19 21:44:11 
 ==== Int64 test #2
2020/12/19 21:44:11 Using n1ql client
2020/12/19 21:44:12 Expected and Actual scan responses are the same
2020/12/19 21:44:12 
 ==== Int64 test #3
2020/12/19 21:44:12 Using n1ql client
2020/12/19 21:44:12 Expected and Actual scan responses are the same
2020/12/19 21:44:12 
 ==== Int64 test #4
2020/12/19 21:44:12 Using n1ql client
2020/12/19 21:44:12 Expected and Actual scan responses are the same
2020/12/19 21:44:12 
 ==== Int64 test #5
2020/12/19 21:44:12 Using n1ql client
2020/12/19 21:44:12 Expected and Actual scan responses are the same
2020/12/19 21:44:12 
 ==== Int64 test #6
2020/12/19 21:44:12 Using n1ql client
2020/12/19 21:44:12 Expected and Actual scan responses are the same
2020/12/19 21:44:12 
 ==== Int64 test #7
2020/12/19 21:44:12 Using n1ql client
2020/12/19 21:44:13 Expected and Actual scan responses are the same
2020/12/19 21:44:13 
 ==== Int64 test #8
2020/12/19 21:44:13 Using n1ql client
2020/12/19 21:44:13 Expected and Actual scan responses are the same
2020/12/19 21:44:13 
 ==== Float64 test #0
2020/12/19 21:44:13 Using n1ql client
2020/12/19 21:44:13 Expected and Actual scan responses are the same
2020/12/19 21:44:13 
 ==== Float64 test #1
2020/12/19 21:44:13 Using n1ql client
2020/12/19 21:44:13 Expected and Actual scan responses are the same
2020/12/19 21:44:13 
 ==== Float64 test #2
2020/12/19 21:44:13 Using n1ql client
2020/12/19 21:44:13 Expected and Actual scan responses are the same
2020/12/19 21:44:13 
 ==== Float64 test #3
2020/12/19 21:44:13 Using n1ql client
2020/12/19 21:44:14 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.09s)
=== RUN   TestRestartIndexer
2020/12/19 21:44:14 In TestRestartIndexer()
2020/12/19 21:44:14 []
2020-12-19T21:44:14.173+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T21:44:14.173+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T21:44:14.173+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T21:44:14.173+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 21:44:34 Using n1ql client
2020-12-19T21:44:34.126+05:30 [Error] transport error between 127.0.0.1:40354->127.0.0.1:9107: write tcp 127.0.0.1:40354->127.0.0.1:9107: write: broken pipe
2020-12-19T21:44:34.126+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -7706813519501276282 request transport failed `write tcp 127.0.0.1:40354->127.0.0.1:9107: write: broken pipe`
2020/12/19 21:44:34 Len of expected and actual scan results are :  10002 and 10002
2020/12/19 21:44:34 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.25s)
=== RUN   TestCreateDocsMutation
2020/12/19 21:44:34 In TestCreateDocsMutation()
2020/12/19 21:44:34 Index found:  index_age
2020/12/19 21:44:34 Using n1ql client
2020/12/19 21:44:34 Len of expected and actual scan results are :  10002 and 10002
2020/12/19 21:44:34 Expected and Actual scan responses are the same
2020/12/19 21:44:34 Using n1ql client
2020/12/19 21:44:35 Index Scan after mutations took 545.727268ms
2020/12/19 21:44:35 Len of expected and actual scan results are :  10102 and 10102
2020/12/19 21:44:35 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.91s)
=== RUN   TestRestartProjector
2020/12/19 21:44:35 In TestRestartProjector()
2020/12/19 21:44:35 []
2020/12/19 21:44:55 Using n1ql client
2020/12/19 21:44:55 Len of expected and actual scan results are :  10102 and 10102
2020/12/19 21:44:55 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.36s)
=== RUN   TestDeleteDocsMutation
2020/12/19 21:44:55 In TestDeleteDocsMutation()
2020/12/19 21:44:55 Index found:  index_age
2020/12/19 21:44:55 Using n1ql client
2020/12/19 21:44:55 Len of expected and actual scan results are :  10102 and 10102
2020/12/19 21:44:55 Expected and Actual scan responses are the same
2020/12/19 21:44:56 Using n1ql client
2020/12/19 21:44:56 Index Scan after mutations took 586.048628ms
2020/12/19 21:44:56 Len of expected and actual scan results are :  9902 and 9902
2020/12/19 21:44:56 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (1.00s)
=== RUN   TestUpdateDocsMutation
2020/12/19 21:44:56 In TestUpdateDocsMutation()
2020/12/19 21:44:56 Index found:  index_age
2020/12/19 21:44:56 Using n1ql client
2020/12/19 21:44:56 Len of expected and actual scan results are :  9418 and 9418
2020/12/19 21:44:56 Expected and Actual scan responses are the same
2020/12/19 21:44:56 Num of keysFromMutDocs: 100
2020/12/19 21:44:56 Updating number of documents: 100
2020/12/19 21:44:57 Using n1ql client
2020/12/19 21:44:57 Index Scan after mutations took 437.850599ms
2020/12/19 21:44:57 Len of expected and actual scan results are :  9418 and 9418
2020/12/19 21:44:57 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.86s)
=== RUN   TestLargeMutations
2020/12/19 21:44:57 In TestLargeMutations()
2020/12/19 21:44:57 In DropAllSecondaryIndexes()
2020/12/19 21:44:57 Index found:  index_i2
2020/12/19 21:44:57 Dropped index index_i2
2020/12/19 21:44:57 Index found:  index_p1
2020/12/19 21:44:57 Dropped index index_p1
2020/12/19 21:44:57 Index found:  index_ageabove30
2020/12/19 21:44:57 Dropped index index_ageabove30
2020/12/19 21:44:57 Index found:  index_state
2020/12/19 21:44:57 Dropped index index_state
2020/12/19 21:44:57 Index found:  index_nationality
2020/12/19 21:44:57 Dropped index index_nationality
2020/12/19 21:44:57 Index found:  index_tags
2020/12/19 21:44:57 Dropped index index_tags
2020/12/19 21:44:57 Index found:  index_isActive
2020/12/19 21:44:58 Dropped index index_isActive
2020/12/19 21:44:58 Index found:  index_deferred
2020/12/19 21:44:58 Dropped index index_deferred
2020/12/19 21:44:58 Index found:  index_cdc
2020/12/19 21:44:58 Dropped index index_cdc
2020/12/19 21:44:58 Index found:  index_age35to45
2020/12/19 21:44:58 Dropped index index_age35to45
2020/12/19 21:44:58 Index found:  index_eyeColor
2020/12/19 21:44:58 Dropped index index_eyeColor
2020/12/19 21:44:58 Index found:  index_height
2020/12/19 21:44:58 Dropped index index_height
2020/12/19 21:44:58 Index found:  index_name
2020/12/19 21:44:58 Dropped index index_name
2020/12/19 21:44:58 Index found:  index_age
2020/12/19 21:44:58 Dropped index index_age
2020/12/19 21:44:58 Index found:  index_streetname
2020/12/19 21:44:58 Dropped index index_streetname
2020/12/19 21:44:58 Index found:  index_floor
2020/12/19 21:44:58 Dropped index index_floor
2020/12/19 21:44:58 Index found:  index_isresidential
2020/12/19 21:44:58 Dropped index index_isresidential
2020/12/19 21:44:58 Index found:  index_ageteens
2020/12/19 21:44:59 Dropped index index_ageteens
2020/12/19 21:44:59 Index found:  idx_age
2020/12/19 21:44:59 Dropped index idx_age
2020/12/19 21:44:59 Index found:  index_gender
2020/12/19 21:44:59 Dropped index index_gender
2020/12/19 21:44:59 Index found:  index_company
2020/12/19 21:44:59 Dropped index index_company
2020/12/19 21:44:59 Index found:  index_balance
2020/12/19 21:44:59 Dropped index index_balance
2020/12/19 21:44:59 Index found:  index_longitude
2020/12/19 21:44:59 Dropped index index_longitude
2020/12/19 21:44:59 Index found:  idx_numbertest
2020/12/19 21:44:59 Dropped index idx_numbertest
2020/12/19 21:44:59 Index found:  index_composite2
2020/12/19 21:44:59 Dropped index index_composite2
2020/12/19 21:44:59 Index found:  index_latitude
2020/12/19 21:44:59 Dropped index index_latitude
2020/12/19 21:44:59 Index found:  index_email
2020/12/19 21:44:59 Dropped index index_email
2020/12/19 21:44:59 Index found:  index_di1
2020/12/19 21:44:59 Dropped index index_di1
2020/12/19 21:44:59 Index found:  index_composite1
2020/12/19 21:45:00 Dropped index index_composite1
2020/12/19 21:45:00 Index found:  index_pin
2020/12/19 21:45:00 Dropped index index_pin
2020/12/19 21:45:00 Index found:  index_streetaddress
2020/12/19 21:45:00 Dropped index index_streetaddress
2020/12/19 21:45:24 Created the secondary index indexmut_1. Waiting for it become active
2020/12/19 21:45:24 Index is now active
2020/12/19 21:45:24 Using n1ql client
2020/12/19 21:45:25 Expected and Actual scan responses are the same
2020/12/19 21:45:25 Len of expected and actual scan results are :  29902 and 29902
2020/12/19 21:45:25 ITERATION 0
2020/12/19 21:45:44 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:45:44 Index is now active
2020/12/19 21:45:44 Using n1ql client
2020/12/19 21:45:45 Expected and Actual scan responses are the same
2020/12/19 21:45:45 Len of expected and actual scan results are :  39902 and 39902
2020/12/19 21:45:45 Using n1ql client
2020/12/19 21:45:46 Expected and Actual scan responses are the same
2020/12/19 21:45:46 Len of expected and actual scan results are :  39902 and 39902
2020/12/19 21:45:46 Dropping the secondary index indexmut_2
2020/12/19 21:45:46 Index dropped
2020/12/19 21:45:46 ITERATION 1
2020/12/19 21:46:06 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:46:06 Index is now active
2020/12/19 21:46:06 Using n1ql client
2020/12/19 21:46:07 Expected and Actual scan responses are the same
2020/12/19 21:46:07 Len of expected and actual scan results are :  49902 and 49902
2020/12/19 21:46:07 Using n1ql client
2020/12/19 21:46:08 Expected and Actual scan responses are the same
2020/12/19 21:46:08 Len of expected and actual scan results are :  49902 and 49902
2020/12/19 21:46:08 Dropping the secondary index indexmut_2
2020/12/19 21:46:09 Index dropped
2020/12/19 21:46:09 ITERATION 2
2020/12/19 21:46:29 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:46:29 Index is now active
2020/12/19 21:46:29 Using n1ql client
2020/12/19 21:46:31 Expected and Actual scan responses are the same
2020/12/19 21:46:31 Len of expected and actual scan results are :  59902 and 59902
2020/12/19 21:46:31 Using n1ql client
2020/12/19 21:46:32 Expected and Actual scan responses are the same
2020/12/19 21:46:32 Len of expected and actual scan results are :  59902 and 59902
2020/12/19 21:46:32 Dropping the secondary index indexmut_2
2020/12/19 21:46:32 Index dropped
2020/12/19 21:46:32 ITERATION 3
2020/12/19 21:46:54 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:46:54 Index is now active
2020/12/19 21:46:54 Using n1ql client
2020/12/19 21:46:56 Expected and Actual scan responses are the same
2020/12/19 21:46:56 Len of expected and actual scan results are :  69902 and 69902
2020/12/19 21:46:56 Using n1ql client
2020/12/19 21:46:58 Expected and Actual scan responses are the same
2020/12/19 21:46:58 Len of expected and actual scan results are :  69902 and 69902
2020/12/19 21:46:58 Dropping the secondary index indexmut_2
2020/12/19 21:46:58 Index dropped
2020/12/19 21:46:58 ITERATION 4
2020/12/19 21:47:22 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:47:22 Index is now active
2020/12/19 21:47:22 Using n1ql client
2020/12/19 21:47:24 Expected and Actual scan responses are the same
2020/12/19 21:47:24 Len of expected and actual scan results are :  79902 and 79902
2020/12/19 21:47:24 Using n1ql client
2020/12/19 21:47:27 Expected and Actual scan responses are the same
2020/12/19 21:47:27 Len of expected and actual scan results are :  79902 and 79902
2020/12/19 21:47:27 Dropping the secondary index indexmut_2
2020/12/19 21:47:27 Index dropped
2020/12/19 21:47:27 ITERATION 5
2020/12/19 21:47:53 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:47:53 Index is now active
2020/12/19 21:47:53 Using n1ql client
2020/12/19 21:47:56 Expected and Actual scan responses are the same
2020/12/19 21:47:56 Len of expected and actual scan results are :  89902 and 89902
2020/12/19 21:47:56 Using n1ql client
2020/12/19 21:47:58 Expected and Actual scan responses are the same
2020/12/19 21:47:58 Len of expected and actual scan results are :  89902 and 89902
2020/12/19 21:47:58 Dropping the secondary index indexmut_2
2020/12/19 21:47:58 Index dropped
2020/12/19 21:47:58 ITERATION 6
2020/12/19 21:48:24 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:48:24 Index is now active
2020/12/19 21:48:24 Using n1ql client
2020/12/19 21:48:26 Expected and Actual scan responses are the same
2020/12/19 21:48:26 Len of expected and actual scan results are :  99902 and 99902
2020/12/19 21:48:26 Using n1ql client
2020/12/19 21:48:29 Expected and Actual scan responses are the same
2020/12/19 21:48:29 Len of expected and actual scan results are :  99902 and 99902
2020/12/19 21:48:29 Dropping the secondary index indexmut_2
2020/12/19 21:48:29 Index dropped
2020/12/19 21:48:29 ITERATION 7
2020/12/19 21:48:56 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:48:56 Index is now active
2020/12/19 21:48:56 Using n1ql client
2020/12/19 21:48:59 Expected and Actual scan responses are the same
2020/12/19 21:48:59 Len of expected and actual scan results are :  109902 and 109902
2020/12/19 21:48:59 Using n1ql client
2020/12/19 21:49:01 Expected and Actual scan responses are the same
2020/12/19 21:49:01 Len of expected and actual scan results are :  109902 and 109902
2020/12/19 21:49:01 Dropping the secondary index indexmut_2
2020/12/19 21:49:01 Index dropped
2020/12/19 21:49:01 ITERATION 8
2020/12/19 21:49:31 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:49:31 Index is now active
2020/12/19 21:49:32 Using n1ql client
2020/12/19 21:49:35 Expected and Actual scan responses are the same
2020/12/19 21:49:35 Len of expected and actual scan results are :  119902 and 119902
2020/12/19 21:49:35 Using n1ql client
2020/12/19 21:49:38 Expected and Actual scan responses are the same
2020/12/19 21:49:38 Len of expected and actual scan results are :  119902 and 119902
2020/12/19 21:49:38 Dropping the secondary index indexmut_2
2020/12/19 21:49:38 Index dropped
2020/12/19 21:49:38 ITERATION 9
2020/12/19 21:50:08 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:50:08 Index is now active
2020/12/19 21:50:08 Using n1ql client
2020/12/19 21:50:12 Expected and Actual scan responses are the same
2020/12/19 21:50:12 Len of expected and actual scan results are :  129902 and 129902
2020/12/19 21:50:12 Using n1ql client
2020/12/19 21:50:15 Expected and Actual scan responses are the same
2020/12/19 21:50:15 Len of expected and actual scan results are :  129902 and 129902
2020/12/19 21:50:15 Dropping the secondary index indexmut_2
2020/12/19 21:50:15 Index dropped
2020/12/19 21:50:15 ITERATION 10
2020/12/19 21:50:46 Created the secondary index indexmut_2. Waiting for it become active
2020/12/19 21:50:46 Index is now active
2020/12/19 21:50:46 Using n1ql client
2020/12/19 21:50:50 Expected and Actual scan responses are the same
2020/12/19 21:50:50 Len of expected and actual scan results are :  139902 and 139902
2020/12/19 21:50:50 Using n1ql client
2020/12/19 21:50:54 Expected and Actual scan responses are the same
2020/12/19 21:50:54 Len of expected and actual scan results are :  139902 and 139902
2020/12/19 21:50:54 Dropping the secondary index indexmut_2
2020/12/19 21:50:54 Index dropped
--- PASS: TestLargeMutations (357.03s)
=== RUN   TestPlanner
2020/12/19 21:50:54 In TestPlanner()
2020/12/19 21:50:54 -------------------------------------------
2020/12/19 21:50:54 initial placement - 20-50M, 10 index, 3 replica, 2x
2020-12-19T21:50:54.554+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:54.554+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:54.562+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:54.562+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:54.566+05:30 [Info] switched currmeta from 455 -> 455 force true 
2020-12-19T21:50:54.572+05:30 [Info] switched currmeta from 449 -> 451 force true 
2020-12-19T21:50:54.639+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:54.639+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:54.641+05:30 [Info] switched currmeta from 455 -> 455 force true 
2020-12-19T21:50:54.644+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:54.644+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:54.646+05:30 [Info] switched currmeta from 451 -> 451 force true 
2020-12-19T21:50:54.879+05:30 [Info] Score: 0.04717179221710427
2020-12-19T21:50:54.879+05:30 [Info] Memory Quota: 54489692182 (50.7475G)
2020-12-19T21:50:54.879+05:30 [Info] CPU Quota: 12
2020-12-19T21:50:54.879+05:30 [Info] Indexer Memory Mean 32231356689 (30.0178G)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Memory Deviation 1520410860 (1.41599G) (4.72%)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Memory Utilization 0.5915
2020-12-19T21:50:54.879+05:30 [Info] Indexer CPU Mean 8.8447
2020-12-19T21:50:54.879+05:30 [Info] Indexer CPU Deviation 2.67 (30.24%)
2020-12-19T21:50:54.879+05:30 [Info] Indexer CPU Utilization 0.7371
2020-12-19T21:50:54.879+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:50:54.879+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:50:54.879+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:50:54.879+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Data Size Mean 32231356689 (30.0178G)
2020-12-19T21:50:54.879+05:30 [Info] Indexer Data Size Deviation 1520410860 (1.41599G) (4.72%)
2020-12-19T21:50:54.879+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:50:54.879+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:50:54.879+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:50:54.879+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:50:54 -------------------------------------------
2020/12/19 21:50:54 initial placement - 20-50M, 30 index, 3 replica, 2x
2020-12-19T21:50:56.786+05:30 [Info] Score: 0.05674240583622082
2020-12-19T21:50:56.786+05:30 [Info] Memory Quota: 65192909108 (60.7156G)
2020-12-19T21:50:56.786+05:30 [Info] CPU Quota: 12
2020-12-19T21:50:56.786+05:30 [Info] Indexer Memory Mean 41179442368 (38.3513G)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Memory Deviation 2336620630 (2.17615G) (5.67%)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Memory Utilization 0.6317
2020-12-19T21:50:56.786+05:30 [Info] Indexer CPU Mean 11.3249
2020-12-19T21:50:56.786+05:30 [Info] Indexer CPU Deviation 2.37 (20.91%)
2020-12-19T21:50:56.786+05:30 [Info] Indexer CPU Utilization 0.9437
2020-12-19T21:50:56.786+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:50:56.786+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:50:56.786+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:50:56.786+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Data Size Mean 41179442368 (38.3513G)
2020-12-19T21:50:56.786+05:30 [Info] Indexer Data Size Deviation 2336620630 (2.17615G) (5.67%)
2020-12-19T21:50:56.786+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:50:56.786+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:50:56.786+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:50:56.786+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:50:56 -------------------------------------------
2020/12/19 21:50:56 initial placement - 20-50M, 30 index, 3 replica, 4x
2020-12-19T21:50:57.014+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T21:50:57.116+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:57.116+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:57.123+05:30 [Info] switched currmeta from 451 -> 451 force true 
2020-12-19T21:50:57.134+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:50:57.134+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:50:57.140+05:30 [Info] switched currmeta from 455 -> 455 force true 
2020-12-19T21:50:57.580+05:30 [Info] Score: 0.017165077652140516
2020-12-19T21:50:57.580+05:30 [Info] Memory Quota: 131109279004 (122.105G)
2020-12-19T21:50:57.580+05:30 [Info] CPU Quota: 24
2020-12-19T21:50:57.580+05:30 [Info] Indexer Memory Mean 88097454878 (82.0471G)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Memory Deviation 1512199653 (1.40835G) (1.72%)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Memory Utilization 0.6719
2020-12-19T21:50:57.580+05:30 [Info] Indexer CPU Mean 24.1486
2020-12-19T21:50:57.580+05:30 [Info] Indexer CPU Deviation 2.24 (9.27%)
2020-12-19T21:50:57.580+05:30 [Info] Indexer CPU Utilization 1.0062
2020-12-19T21:50:57.580+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:50:57.580+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:50:57.580+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:50:57.580+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Data Size Mean 88097454878 (82.0471G)
2020-12-19T21:50:57.580+05:30 [Info] Indexer Data Size Deviation 1512199653 (1.40835G) (1.72%)
2020-12-19T21:50:57.580+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:50:57.580+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:50:57.580+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:50:57.580+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:50:57 -------------------------------------------
2020/12/19 21:50:57 initial placement - 200-500M, 10 index, 3 replica, 2x
2020-12-19T21:50:57.889+05:30 [Info] Score: 0.06534968424981769
2020-12-19T21:50:57.889+05:30 [Info] Memory Quota: 455590356374 (424.302G)
2020-12-19T21:50:57.889+05:30 [Info] CPU Quota: 12
2020-12-19T21:50:57.890+05:30 [Info] Indexer Memory Mean 346253062008 (322.473G)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Memory Deviation 22627528272 (21.0735G) (6.53%)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Memory Utilization 0.7600
2020-12-19T21:50:57.890+05:30 [Info] Indexer CPU Mean 10.1138
2020-12-19T21:50:57.890+05:30 [Info] Indexer CPU Deviation 2.97 (29.38%)
2020-12-19T21:50:57.890+05:30 [Info] Indexer CPU Utilization 0.8428
2020-12-19T21:50:57.890+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:50:57.890+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:50:57.890+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:50:57.890+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Data Size Mean 346253062008 (322.473G)
2020-12-19T21:50:57.890+05:30 [Info] Indexer Data Size Deviation 22627528272 (21.0735G) (6.53%)
2020-12-19T21:50:57.890+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:50:57.890+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:50:57.890+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:50:57.890+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:50:57 -------------------------------------------
2020/12/19 21:50:57 initial placement - 200-500M, 30 index, 3 replica, 2x
2020-12-19T21:50:59.381+05:30 [Info] Score: 0.03781815865862087
2020-12-19T21:50:59.381+05:30 [Info] Memory Quota: 530102863494 (493.697G)
2020-12-19T21:50:59.381+05:30 [Info] CPU Quota: 12
2020-12-19T21:50:59.381+05:30 [Info] Indexer Memory Mean 414517769818 (386.05G)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Memory Deviation 15676298785 (14.5997G) (3.78%)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Memory Utilization 0.7820
2020-12-19T21:50:59.381+05:30 [Info] Indexer CPU Mean 12.1908
2020-12-19T21:50:59.381+05:30 [Info] Indexer CPU Deviation 2.50 (20.50%)
2020-12-19T21:50:59.381+05:30 [Info] Indexer CPU Utilization 1.0159
2020-12-19T21:50:59.381+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:50:59.381+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:50:59.381+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:50:59.381+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Data Size Mean 414517769818 (386.05G)
2020-12-19T21:50:59.381+05:30 [Info] Indexer Data Size Deviation 15676298785 (14.5997G) (3.78%)
2020-12-19T21:50:59.381+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:50:59.381+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:50:59.381+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:50:59.381+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:50:59 -------------------------------------------
2020/12/19 21:50:59 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2020-12-19T21:51:00.091+05:30 [Info] Score: 0.014560584071482472
2020-12-19T21:51:00.091+05:30 [Info] Memory Quota: 371677525867 (346.152G)
2020-12-19T21:51:00.091+05:30 [Info] CPU Quota: 16
2020-12-19T21:51:00.091+05:30 [Info] Indexer Memory Mean 296563734968 (276.197G)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Memory Deviation 4318141195 (4.02158G) (1.46%)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Memory Utilization 0.7979
2020-12-19T21:51:00.091+05:30 [Info] Indexer CPU Mean 8.4214
2020-12-19T21:51:00.091+05:30 [Info] Indexer CPU Deviation 3.78 (44.84%)
2020-12-19T21:51:00.091+05:30 [Info] Indexer CPU Utilization 0.5263
2020-12-19T21:51:00.091+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:00.091+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:00.091+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:00.091+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Data Size Mean 296563734968 (276.197G)
2020-12-19T21:51:00.091+05:30 [Info] Indexer Data Size Deviation 4318141195 (4.02158G) (1.46%)
2020-12-19T21:51:00.091+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:00.091+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:00.092+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:00.092+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:00 -------------------------------------------
2020/12/19 21:51:00 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2020-12-19T21:51:00.827+05:30 [Info] Score: 0.02726399814331757
2020-12-19T21:51:00.827+05:30 [Info] Memory Quota: 325001983233 (302.682G)
2020-12-19T21:51:00.827+05:30 [Info] CPU Quota: 20
2020-12-19T21:51:00.828+05:30 [Info] Indexer Memory Mean 253115716988 (235.732G)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Memory Deviation 6900946438 (6.42701G) (2.73%)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Memory Utilization 0.7788
2020-12-19T21:51:00.828+05:30 [Info] Indexer CPU Mean 8.5408
2020-12-19T21:51:00.828+05:30 [Info] Indexer CPU Deviation 4.32 (50.63%)
2020-12-19T21:51:00.828+05:30 [Info] Indexer CPU Utilization 0.4270
2020-12-19T21:51:00.828+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:00.828+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:00.828+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:00.828+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Data Size Mean 253115716988 (235.732G)
2020-12-19T21:51:00.828+05:30 [Info] Indexer Data Size Deviation 6900946438 (6.42701G) (2.73%)
2020-12-19T21:51:00.828+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:00.828+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:00.828+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:00.828+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:00 -------------------------------------------
2020/12/19 21:51:00 initial placement - 6 2M index, 1 replica, 2x
2020-12-19T21:51:01.028+05:30 [Info] Score: 0
2020-12-19T21:51:01.028+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2020-12-19T21:51:01.028+05:30 [Info] CPU Quota: 2
2020-12-19T21:51:01.028+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Memory Utilization 0.4290
2020-12-19T21:51:01.028+05:30 [Info] Indexer CPU Mean 1.2000
2020-12-19T21:51:01.028+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Indexer CPU Utilization 0.6000
2020-12-19T21:51:01.028+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:01.028+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:01.028+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:01.028+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2020-12-19T21:51:01.028+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:01.028+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:01.028+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:01.028+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:01 -------------------------------------------
2020/12/19 21:51:01 initial placement - 5 20M primary index, 2 replica, 2x
2020-12-19T21:51:01.464+05:30 [Info] Score: 0
2020-12-19T21:51:01.464+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2020-12-19T21:51:01.464+05:30 [Info] CPU Quota: 2
2020-12-19T21:51:01.464+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Memory Utilization 0.7659
2020-12-19T21:51:01.464+05:30 [Info] Indexer CPU Mean 1.2000
2020-12-19T21:51:01.464+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Indexer CPU Utilization 0.6000
2020-12-19T21:51:01.464+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:01.464+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:01.464+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:01.464+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2020-12-19T21:51:01.464+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:01.464+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:01.464+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:01.464+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:01 -------------------------------------------
2020/12/19 21:51:01 initial placement - 5 20M array index, 2 replica, 2x
2020-12-19T21:51:01.684+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T21:51:01.739+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:51:01.739+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:51:01.742+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T21:51:01.742+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T21:51:01.742+05:30 [Info] switched currmeta from 455 -> 455 force true 
2020-12-19T21:51:01.744+05:30 [Info] switched currmeta from 451 -> 451 force true 
2020-12-19T21:51:01.908+05:30 [Info] Score: 0
2020-12-19T21:51:01.908+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2020-12-19T21:51:01.908+05:30 [Info] CPU Quota: 2
2020-12-19T21:51:01.908+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Memory Utilization 0.8063
2020-12-19T21:51:01.908+05:30 [Info] Indexer CPU Mean 1.2000
2020-12-19T21:51:01.908+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Indexer CPU Utilization 0.6000
2020-12-19T21:51:01.908+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:01.908+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:01.908+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:01.908+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2020-12-19T21:51:01.908+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:01.908+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:01.908+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:01.908+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:01 -------------------------------------------
2020/12/19 21:51:01 initial placement - 3 replica constraint, 2 index, 2x
2020-12-19T21:51:02.386+05:30 [Info] Score: 0
2020-12-19T21:51:02.386+05:30 [Info] Memory Quota: 530294000 (505.728M)
2020-12-19T21:51:02.386+05:30 [Info] CPU Quota: 2
2020-12-19T21:51:02.386+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Memory Utilization 0.0049
2020-12-19T21:51:02.386+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:02.386+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:02.386+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:02.386+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:02.386+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:02.386+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2020-12-19T21:51:02.386+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:02.386+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:02.386+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:02.386+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:02 -------------------------------------------
2020/12/19 21:51:02 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2020-12-19T21:51:04.703+05:30 [Info] Score: 0.014379877136943393
2020-12-19T21:51:04.703+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2020-12-19T21:51:04.703+05:30 [Info] CPU Quota: 27
2020-12-19T21:51:04.703+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Memory Utilization 0.5679
2020-12-19T21:51:04.703+05:30 [Info] Indexer CPU Mean 20.1734
2020-12-19T21:51:04.703+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2020-12-19T21:51:04.703+05:30 [Info] Indexer CPU Utilization 0.7472
2020-12-19T21:51:04.703+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:04.703+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:04.703+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:04.703+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2020-12-19T21:51:04.703+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2020-12-19T21:51:04.703+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:04.703+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:04.703+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:04.703+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:04 -------------------------------------------
2020/12/19 21:51:04 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2020-12-19T21:51:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T21:51:06.279+05:30 [Info] index 15596240821230611494 has replicas [3658575264484939930]: 
2020-12-19T21:51:06.279+05:30 [Info] index 15596240821230611494 has equivalents [15596240821230611494]: 
2020-12-19T21:51:06.279+05:30 [Info] client load stats {"3658575264484939930": 0}
2020-12-19T21:51:06.279+05:30 [Info] client hit stats {"3658575264484939930": 0}
2020-12-19T21:51:06.279+05:30 [Info] client pending item stats {"3658575264484939930": 9223372036854775807}
2020-12-19T21:51:06.279+05:30 [Info] client stats current {"3658575264484939930": true}
2020-12-19T21:51:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T21:51:06.284+05:30 [Info] average scan response {11 ms}
2020-12-19T21:51:06.612+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T21:51:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T21:51:06.827+05:30 [Info] index 15596240821230611494 has replicas [3658575264484939930]: 
2020-12-19T21:51:06.827+05:30 [Info] index 15596240821230611494 has equivalents [15596240821230611494]: 
2020-12-19T21:51:06.827+05:30 [Info] client load stats {"3658575264484939930": 2.940107548352783e+09}
2020-12-19T21:51:06.827+05:30 [Info] client hit stats {"3658575264484939930": 12}
2020-12-19T21:51:06.827+05:30 [Info] client pending item stats {"3658575264484939930": 9223372036854775807}
2020-12-19T21:51:06.827+05:30 [Info] client stats current {"3658575264484939930": true}
2020-12-19T21:51:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T21:51:06.830+05:30 [Info] average scan response {3025 ms}
2020-12-19T21:51:06.830+05:30 [Info] GSIC[default/default-_default-_default-1608393966721578259] logstats "default" {"gsi_scan_count":109,"gsi_scan_duration":55559536162,"gsi_throttle_duration":798998087,"gsi_prime_duration":5689037538,"gsi_blocked_duration":527062831,"gsi_total_temp_files":0}
2020-12-19T21:51:07.195+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T21:51:08.760+05:30 [Info] Score: 0.0008743719299104943
2020-12-19T21:51:08.760+05:30 [Info] Memory Quota: 536870912000 (500G)
2020-12-19T21:51:08.760+05:30 [Info] CPU Quota: 20
2020-12-19T21:51:08.760+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Memory Utilization 0.7321
2020-12-19T21:51:08.760+05:30 [Info] Indexer CPU Mean 14.2305
2020-12-19T21:51:08.760+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2020-12-19T21:51:08.760+05:30 [Info] Indexer CPU Utilization 0.7115
2020-12-19T21:51:08.760+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:08.760+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:08.760+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:08.760+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2020-12-19T21:51:08.760+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2020-12-19T21:51:08.760+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:08.760+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:08.760+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:08.760+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:08 -------------------------------------------
2020/12/19 21:51:08 incr placement - 3 server group, 3 replica, 1x
2020-12-19T21:51:08.923+05:30 [Info] Score: 0
2020-12-19T21:51:08.923+05:30 [Info] Memory Quota: 530294000 (505.728M)
2020-12-19T21:51:08.923+05:30 [Info] CPU Quota: 16
2020-12-19T21:51:08.923+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2020-12-19T21:51:08.923+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:08.923+05:30 [Info] Indexer Memory Utilization 0.0049
2020-12-19T21:51:08.923+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:08.923+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:08.923+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:08.924+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:08.924+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:08.924+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:08.924+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:08.924+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:08.924+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:08.924+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2020-12-19T21:51:08.924+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:08.924+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:08.924+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:08.924+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:08.924+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:08 -------------------------------------------
2020/12/19 21:51:08 incr placement - 2 server group, 3 replica, 1x
2020-12-19T21:51:08.927+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2020-12-19T21:51:08.927+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2020-12-19T21:51:08.927+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2020-12-19T21:51:09.089+05:30 [Info] Score: 0
2020-12-19T21:51:09.089+05:30 [Info] Memory Quota: 530294000 (505.728M)
2020-12-19T21:51:09.089+05:30 [Info] CPU Quota: 16
2020-12-19T21:51:09.089+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Memory Utilization 0.0049
2020-12-19T21:51:09.089+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:09.089+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:09.089+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:09.089+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:09.089+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:09.089+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2020-12-19T21:51:09.089+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:09.089+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:09.089+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:09.089+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:09 -------------------------------------------
2020/12/19 21:51:09 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2020-12-19T21:51:11.127+05:30 [Info] Score: 0.11049957825112526
2020-12-19T21:51:11.127+05:30 [Info] Memory Quota: 139586437120 (130G)
2020-12-19T21:51:11.127+05:30 [Info] CPU Quota: 30
2020-12-19T21:51:11.127+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Memory Deviation 2433026258 (2.26593G) (2.74%)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Memory Utilization 0.6367
2020-12-19T21:51:11.127+05:30 [Info] Indexer CPU Mean 24.0538
2020-12-19T21:51:11.127+05:30 [Info] Indexer CPU Deviation 2.13 (8.87%)
2020-12-19T21:51:11.127+05:30 [Info] Indexer CPU Utilization 0.8018
2020-12-19T21:51:11.127+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:11.127+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:11.127+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:11.127+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2020-12-19T21:51:11.127+05:30 [Info] Indexer Data Size Deviation 2433026258 (2.26593G) (2.74%)
2020-12-19T21:51:11.127+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2020-12-19T21:51:11.127+05:30 [Info] Index Data Moved (exclude new node) 196.814G (19.81%)
2020-12-19T21:51:11.127+05:30 [Info] No. Index (from non-deleted node) 90
2020-12-19T21:51:11.127+05:30 [Info] No. Index Moved (exclude new node) 18 (20.00%)
2020/12/19 21:51:11 -------------------------------------------
2020/12/19 21:51:11 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2020-12-19T21:51:14.061+05:30 [Info] Score: 0.1279498267208424
2020-12-19T21:51:14.061+05:30 [Info] Memory Quota: 536870912000 (500G)
2020-12-19T21:51:14.061+05:30 [Info] CPU Quota: 20
2020-12-19T21:51:14.061+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Memory Deviation 33170784546 (30.8927G) (8.45%)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Memory Utilization 0.7311
2020-12-19T21:51:14.061+05:30 [Info] Indexer CPU Mean 13.9305
2020-12-19T21:51:14.061+05:30 [Info] Indexer CPU Deviation 3.00 (21.53%)
2020-12-19T21:51:14.061+05:30 [Info] Indexer CPU Utilization 0.6965
2020-12-19T21:51:14.061+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:14.061+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:14.061+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:14.061+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2020-12-19T21:51:14.061+05:30 [Info] Indexer Data Size Deviation 33170784546 (30.8927G) (8.45%)
2020-12-19T21:51:14.061+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2020-12-19T21:51:14.061+05:30 [Info] Index Data Moved (exclude new node) 1.03277T (24.11%)
2020-12-19T21:51:14.061+05:30 [Info] No. Index (from non-deleted node) 90
2020-12-19T21:51:14.061+05:30 [Info] No. Index Moved (exclude new node) 12 (13.33%)
2020/12/19 21:51:14 -------------------------------------------
2020/12/19 21:51:14 rebalance - travel sample, 10% shuffle, 1x
2020-12-19T21:51:14.087+05:30 [Info] Score: 0.027546516871817018
2020-12-19T21:51:14.087+05:30 [Info] Memory Quota: 536870912 (512M)
2020-12-19T21:51:14.087+05:30 [Info] CPU Quota: 8
2020-12-19T21:51:14.087+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Memory Deviation 1446451 (1.37944M) (8.26%)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Memory Utilization 0.0326
2020-12-19T21:51:14.088+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:14.088+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:14.088+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:14.088+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:14.088+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:14.088+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Data Size Mean 0 (0)
2020-12-19T21:51:14.088+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:14.088+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:14.088+05:30 [Info] No. Index (from non-deleted node) 10
2020-12-19T21:51:14.088+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:14 -------------------------------------------
2020/12/19 21:51:14 rebalance - 20-50M, 90 index, swap 2, 1x
2020-12-19T21:51:16.328+05:30 [Info] Score: 0.029047840099825514
2020-12-19T21:51:16.328+05:30 [Info] Memory Quota: 139586437120 (130G)
2020-12-19T21:51:16.328+05:30 [Info] CPU Quota: 30
2020-12-19T21:51:16.328+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2020-12-19T21:51:16.328+05:30 [Info] Indexer Memory Deviation 2581672356 (2.40437G) (2.90%)
2020-12-19T21:51:16.328+05:30 [Info] Indexer Memory Utilization 0.6367
2020-12-19T21:51:16.328+05:30 [Info] Indexer CPU Mean 24.0538
2020-12-19T21:51:16.328+05:30 [Info] Indexer CPU Deviation 0.60 (2.48%)
2020-12-19T21:51:16.328+05:30 [Info] Indexer CPU Utilization 0.8018
2020-12-19T21:51:16.328+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:16.328+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:16.328+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:16.328+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:16.328+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:16.328+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:16.329+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2020-12-19T21:51:16.329+05:30 [Info] Indexer Data Size Deviation 2581672356 (2.40437G) (2.90%)
2020-12-19T21:51:16.329+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:16.329+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:16.329+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:16.329+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:16 -------------------------------------------
2020/12/19 21:51:16 rebalance - mixed small/medium, 90 index, swap 2, 1x
2020-12-19T21:51:18.259+05:30 [Info] Score: 0.002544355872765726
2020-12-19T21:51:18.259+05:30 [Info] Memory Quota: 536870912000 (500G)
2020-12-19T21:51:18.259+05:30 [Info] CPU Quota: 20
2020-12-19T21:51:18.259+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Memory Deviation 998673934 (952.41M) (0.25%)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Memory Utilization 0.7311
2020-12-19T21:51:18.259+05:30 [Info] Indexer CPU Mean 13.9305
2020-12-19T21:51:18.259+05:30 [Info] Indexer CPU Deviation 1.38 (9.91%)
2020-12-19T21:51:18.259+05:30 [Info] Indexer CPU Utilization 0.6965
2020-12-19T21:51:18.259+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:18.259+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:18.259+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:18.259+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2020-12-19T21:51:18.259+05:30 [Info] Indexer Data Size Deviation 998673934 (952.41M) (0.25%)
2020-12-19T21:51:18.259+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:18.259+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:18.259+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:18.259+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:18 -------------------------------------------
2020/12/19 21:51:18 rebalance - travel sample, swap 2, 1x
2020-12-19T21:51:20.151+05:30 [Info] Score: 0.0006385854742565169
2020-12-19T21:51:20.151+05:30 [Info] Memory Quota: 536870912 (512M)
2020-12-19T21:51:20.151+05:30 [Info] CPU Quota: 8
2020-12-19T21:51:20.151+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Memory Utilization 0.0326
2020-12-19T21:51:20.151+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:20.151+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:20.151+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:20.151+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:20.151+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:20.151+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:20.151+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Data Size Mean 0 (0)
2020-12-19T21:51:20.151+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:20.151+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:20.151+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:20.152+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:20.152+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:20 -------------------------------------------
2020/12/19 21:51:20 rebalance - 8 identical index, add 4, 1x
2020-12-19T21:51:20.750+05:30 [Info] Score: 0
2020-12-19T21:51:20.750+05:30 [Info] Memory Quota: 530294000 (505.728M)
2020-12-19T21:51:20.750+05:30 [Info] CPU Quota: 2
2020-12-19T21:51:20.750+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2020-12-19T21:51:20.750+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:20.750+05:30 [Info] Indexer Memory Utilization 0.0049
2020-12-19T21:51:20.750+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:20.750+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:20.750+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:20.750+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:20.750+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:20.750+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:20.750+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:20.751+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:20.751+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:20.751+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2020-12-19T21:51:20.751+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:20.751+05:30 [Info] Total Index Data (from non-deleted node) 19.8364M
2020-12-19T21:51:20.751+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:20.751+05:30 [Info] No. Index (from non-deleted node) 8
2020-12-19T21:51:20.751+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:20 -------------------------------------------
2020/12/19 21:51:20 rebalance - 8 identical index, delete 2, 2x
2020-12-19T21:51:21.216+05:30 [Info] Score: 0
2020-12-19T21:51:21.216+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2020-12-19T21:51:21.216+05:30 [Info] CPU Quota: 4
2020-12-19T21:51:21.216+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Memory Utilization 0.0098
2020-12-19T21:51:21.216+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:21.216+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:21.216+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:21.216+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:21.216+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:21.216+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2020-12-19T21:51:21.216+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:21.216+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:21.216+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:21.216+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:21 -------------------------------------------
2020/12/19 21:51:21 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2020-12-19T21:51:21.217+05:30 [Warn] There is more replia than available nodes.  Will not move index replica (default,,,country) from ejected node 127.0.0.1:9001
2020-12-19T21:51:21.217+05:30 [Info] Score: 0
2020-12-19T21:51:21.217+05:30 [Info] Memory Quota: 536870912 (512M)
2020-12-19T21:51:21.217+05:30 [Info] CPU Quota: 16
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Mean 0 (0)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Utilization 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Data Size Mean 0 (0)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:21.217+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:21.217+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:21 -------------------------------------------
2020/12/19 21:51:21 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2020-12-19T21:51:21.217+05:30 [Info] Score: 0
2020-12-19T21:51:21.217+05:30 [Info] Memory Quota: 268435456 (256M)
2020-12-19T21:51:21.217+05:30 [Info] CPU Quota: 8
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Mean 0 (0)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Memory Utilization 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T21:51:21.217+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Data Size Mean 0 (0)
2020-12-19T21:51:21.217+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T21:51:21.217+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T21:51:21.217+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T21:51:21.218+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T21:51:21.218+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020/12/19 21:51:21 -------------------------------------------
2020/12/19 21:51:21 Minimum memory test 1: min memory = 0
2020/12/19 21:51:21 -------------------------------------------
2020/12/19 21:51:21 Minimum memory test 2: min memory > quota
2020-12-19T21:51:21.255+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=7us
2020-12-19T21:51:21.255+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=7us
2020-12-19T21:51:21.255+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=6us
2020/12/19 21:51:32 -------------------------------------------
2020/12/19 21:51:32 Minimum memory test 3: min memory < quota
2020/12/19 21:51:43 -------------------------------------------
2020/12/19 21:51:43 Minimum memory test 4: replica repair with min memory > quota
2020-12-19T21:51:43.508+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2020-12-19T21:51:43.508+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=12us
2020-12-19T21:51:43.508+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=10us
2020-12-19T21:51:43.508+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=7us
2020-12-19T21:51:43.508+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=4.  Elapsed Time=139us
2020-12-19T21:51:43.509+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=5.  Elapsed Time=110us
2020-12-19T21:51:43.509+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster.  Will not rebuild lost replica.
2020-12-19T21:51:43.509+05:30 [Warn] 
MemoryQuota: 200
CpuQuota: 8
--- Violations for index  (mem 130, cpu 0) at node 127.0.0.1:9003 
	Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
	Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 5: replica repair with min memory < quota
2020-12-19T21:51:48.053+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 6: rebalance with min memory > quota
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=7us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=4.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=5.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=6.  Elapsed Time=7us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=7.  Elapsed Time=7us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=8.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=9.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=10.  Elapsed Time=7us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=11.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=12.  Elapsed Time=6us
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 7: rebalance-out with min memory > quota
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=4.  Elapsed Time=7us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=5.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=6.  Elapsed Time=6us
2020-12-19T21:51:48.138+05:30 [Warn] Unable to find a solution with rersource costraint.  Relax resource constraint check.
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 8: plan with min memory > quota
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=1ms
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=9us
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=7us
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=4.  Elapsed Time=6us
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=5.  Elapsed Time=6us
2020-12-19T21:51:48.148+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=6.  Elapsed Time=6us
2020-12-19T21:51:48.148+05:30 [Warn] Unable to find a solution with rersource costraint.  Relax resource constraint check.
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 9: single node rebalance with min memory > quota
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=2.  Elapsed Time=7us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=3.  Elapsed Time=7us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=4.  Elapsed Time=6us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=5.  Elapsed Time=6us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=6.  Elapsed Time=5us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=7.  Elapsed Time=6us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=8.  Elapsed Time=8us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=9.  Elapsed Time=7us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=10.  Elapsed Time=6us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=11.  Elapsed Time=7us
2020-12-19T21:51:48.149+05:30 [Info] Planner::Fail to create plan satisyfig constraint. Re-planning. Num of Try=12.  Elapsed Time=6us
2020/12/19 21:51:48 -------------------------------------------
2020/12/19 21:51:48 Minimum memory test 10: plan with partitioned index on empty cluster
--- PASS: TestPlanner (54.56s)
=== RUN   TestRestfulAPI
2020/12/19 21:51:49 In TestRestfulAPI()
2020/12/19 21:51:49 In DropAllSecondaryIndexes()
2020/12/19 21:51:49 Index found:  indexmut_1
2020/12/19 21:51:49 Dropped index indexmut_1
2020/12/19 21:51:49 Setting JSON docs in KV
2020/12/19 21:51:50 GET all indexes
2020/12/19 21:51:50 200 OK
2020/12/19 21:51:50 FOUND indexes: []
2020/12/19 21:51:50 DROP index: badindexid
2020/12/19 21:51:50 status: 400 Bad Request
2020/12/19 21:51:50 DROP index: 23544142
2020/12/19 21:51:50 status: 500 Internal Server Error
2020/12/19 21:51:50 TEST: malformed body
2020/12/19 21:51:50 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"

2020/12/19 21:51:50 TEST: missing field ``name``
2020/12/19 21:51:50 400 Bad Request "missing field name"
2020/12/19 21:51:50 TEST: empty field ``name``
2020/12/19 21:51:50 400 Bad Request "empty field name"
2020/12/19 21:51:50 TEST: missing field ``bucket``
2020/12/19 21:51:50 400 Bad Request "missing field bucket"
2020/12/19 21:51:50 TEST: empty field ``bucket``
2020/12/19 21:51:50 400 Bad Request "empty field bucket"
2020/12/19 21:51:50 TEST: missing field ``secExprs``
2020/12/19 21:51:50 400 Bad Request "missing field secExprs"
2020/12/19 21:51:50 TEST: empty field ``secExprs``
2020/12/19 21:51:50 400 Bad Request "empty field secExprs"
2020/12/19 21:51:50 TEST: incomplete field ``desc``
2020/12/19 21:51:50 400 Bad Request "incomplete desc information [true]"
2020/12/19 21:51:50 TEST: invalid field ``desc``
2020/12/19 21:51:50 400 Bad Request "incomplete desc information [1]"
2020/12/19 21:51:50 
2020/12/19 21:51:50 CREATE INDEX: idx1
2020/12/19 21:52:09 status : 201 Created
2020/12/19 21:52:09 {"id": "14788676246618628759"} 
2020/12/19 21:52:09 CREATE INDEX: idx2 (defer)
2020/12/19 21:52:10 status : 201 Created
2020/12/19 21:52:10 {"id": "1509427091060560559"} 
2020/12/19 21:52:10 CREATE INDEX: idx3 (defer)
2020/12/19 21:52:11 status : 201 Created
2020/12/19 21:52:11 {"id": "4291529716410081448"} 
2020/12/19 21:52:11 CREATE INDEX: idx4 (defer)
2020/12/19 21:52:11 status : 201 Created
2020/12/19 21:52:11 {"id": "14552044025639092442"} 
2020/12/19 21:52:11 CREATE INDEX: idx5
2020/12/19 21:52:23 status : 201 Created
2020/12/19 21:52:23 {"id": "9081355730823363680"} 
2020/12/19 21:52:23 BUILD single deferred index
2020/12/19 21:52:23 202 Accepted
2020/12/19 21:52:23 GET all indexes
2020/12/19 21:52:23 200 OK
2020/12/19 21:52:23 index idx1 in INDEX_STATE_ACTIVE
2020/12/19 21:52:23 GET all indexes
2020/12/19 21:52:23 200 OK
2020/12/19 21:52:23 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:24 GET all indexes
2020/12/19 21:52:24 200 OK
2020/12/19 21:52:24 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:25 GET all indexes
2020/12/19 21:52:25 200 OK
2020/12/19 21:52:25 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:26 GET all indexes
2020/12/19 21:52:26 200 OK
2020/12/19 21:52:26 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:27 GET all indexes
2020/12/19 21:52:27 200 OK
2020/12/19 21:52:27 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:28 GET all indexes
2020/12/19 21:52:28 200 OK
2020/12/19 21:52:28 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:29 GET all indexes
2020/12/19 21:52:29 200 OK
2020/12/19 21:52:29 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:31 GET all indexes
2020/12/19 21:52:31 200 OK
2020/12/19 21:52:31 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:32 GET all indexes
2020/12/19 21:52:32 200 OK
2020/12/19 21:52:32 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:33 GET all indexes
2020/12/19 21:52:33 200 OK
2020/12/19 21:52:33 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:34 GET all indexes
2020/12/19 21:52:34 200 OK
2020/12/19 21:52:34 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:35 GET all indexes
2020/12/19 21:52:35 200 OK
2020/12/19 21:52:35 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:36 GET all indexes
2020/12/19 21:52:36 200 OK
2020/12/19 21:52:36 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:37 GET all indexes
2020/12/19 21:52:37 200 OK
2020/12/19 21:52:37 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:38 GET all indexes
2020/12/19 21:52:38 200 OK
2020/12/19 21:52:38 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:39 GET all indexes
2020/12/19 21:52:39 200 OK
2020/12/19 21:52:39 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:40 GET all indexes
2020/12/19 21:52:40 200 OK
2020/12/19 21:52:40 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:41 GET all indexes
2020/12/19 21:52:41 200 OK
2020/12/19 21:52:41 index idx2 in INDEX_STATE_INITIAL
2020/12/19 21:52:42 GET all indexes
2020/12/19 21:52:42 200 OK
2020/12/19 21:52:42 index idx2 in INDEX_STATE_ACTIVE
2020/12/19 21:52:42 BUILD many deferred index
2020/12/19 21:52:42 202 Accepted 
2020/12/19 21:52:42 GET all indexes
2020/12/19 21:52:42 200 OK
2020/12/19 21:52:42 index idx1 in INDEX_STATE_ACTIVE
2020/12/19 21:52:42 GET all indexes
2020/12/19 21:52:42 200 OK
2020/12/19 21:52:42 index idx2 in INDEX_STATE_ACTIVE
2020/12/19 21:52:42 GET all indexes
2020/12/19 21:52:42 200 OK
2020/12/19 21:52:42 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:43 GET all indexes
2020/12/19 21:52:43 200 OK
2020/12/19 21:52:43 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:44 GET all indexes
2020/12/19 21:52:44 200 OK
2020/12/19 21:52:44 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:45 GET all indexes
2020/12/19 21:52:45 200 OK
2020/12/19 21:52:45 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:47 GET all indexes
2020/12/19 21:52:47 200 OK
2020/12/19 21:52:47 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:48 GET all indexes
2020/12/19 21:52:48 200 OK
2020/12/19 21:52:48 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:49 GET all indexes
2020/12/19 21:52:49 200 OK
2020/12/19 21:52:49 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:50 GET all indexes
2020/12/19 21:52:50 200 OK
2020/12/19 21:52:50 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:51 GET all indexes
2020/12/19 21:52:51 200 OK
2020/12/19 21:52:51 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:52 GET all indexes
2020/12/19 21:52:52 200 OK
2020/12/19 21:52:52 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:53 GET all indexes
2020/12/19 21:52:53 200 OK
2020/12/19 21:52:53 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:54 GET all indexes
2020/12/19 21:52:54 200 OK
2020/12/19 21:52:54 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:55 GET all indexes
2020/12/19 21:52:55 200 OK
2020/12/19 21:52:55 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:56 GET all indexes
2020/12/19 21:52:56 200 OK
2020/12/19 21:52:56 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:57 GET all indexes
2020/12/19 21:52:57 200 OK
2020/12/19 21:52:57 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:58 GET all indexes
2020/12/19 21:52:58 200 OK
2020/12/19 21:52:58 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:52:59 GET all indexes
2020/12/19 21:52:59 200 OK
2020/12/19 21:52:59 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:53:00 GET all indexes
2020/12/19 21:53:00 200 OK
2020/12/19 21:53:00 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:53:01 GET all indexes
2020/12/19 21:53:01 200 OK
2020/12/19 21:53:01 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:53:02 GET all indexes
2020/12/19 21:53:02 200 OK
2020/12/19 21:53:02 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:53:03 GET all indexes
2020/12/19 21:53:03 200 OK
2020/12/19 21:53:03 index idx3 in INDEX_STATE_INITIAL
2020/12/19 21:53:04 GET all indexes
2020/12/19 21:53:04 200 OK
2020/12/19 21:53:04 index idx3 in INDEX_STATE_ACTIVE
2020/12/19 21:53:04 GET all indexes
2020/12/19 21:53:04 200 OK
2020/12/19 21:53:04 index idx4 in INDEX_STATE_ACTIVE
2020/12/19 21:53:04 GET all indexes
2020/12/19 21:53:04 200 OK
2020/12/19 21:53:04 index idx5 in INDEX_STATE_ACTIVE
2020/12/19 21:53:04 GET all indexes
2020/12/19 21:53:04 200 OK
2020/12/19 21:53:04 CREATED indexes: [14788676246618628759 1509427091060560559 4291529716410081448 14552044025639092442 9081355730823363680]
2020/12/19 21:53:04 
2020/12/19 21:53:04 LOOKUP missing index
2020/12/19 21:53:04 status : 404 Not Found
2020/12/19 21:53:04 LOOKUP Pyongyang
2020/12/19 21:53:04 status : 200 OK
2020/12/19 21:53:04 number of entries 579
2020/12/19 21:53:05 Expected and Actual scan responses are the same
2020/12/19 21:53:05 LOOKUP with stale as false
2020/12/19 21:53:05 status : 200 OK
2020/12/19 21:53:05 number of entries 579
2020/12/19 21:53:05 Expected and Actual scan responses are the same
2020/12/19 21:53:05 LOOKUP with Rome
2020/12/19 21:53:05 status : 200 OK
2020/12/19 21:53:05 number of entries 552
2020/12/19 21:53:05 Expected and Actual scan responses are the same
2020/12/19 21:53:05 RANGE missing index
2020/12/19 21:53:05 Status : 404 Not Found
2020/12/19 21:53:05 RANGE cities - none
2020/12/19 21:53:05 Status : 200 OK
2020/12/19 21:53:11 number of entries 140902
2020/12/19 21:53:12 Expected and Actual scan responses are the same
2020/12/19 21:53:12 RANGE cities -low
2020/12/19 21:53:12 Status : 200 OK
2020/12/19 21:53:18 number of entries 140902
2020/12/19 21:53:19 Expected and Actual scan responses are the same
2020/12/19 21:53:19 RANGE cities -high
2020/12/19 21:53:19 Status : 200 OK
2020/12/19 21:53:25 number of entries 140902
2020/12/19 21:53:26 Expected and Actual scan responses are the same
2020/12/19 21:53:26 RANGE cities - both
2020/12/19 21:53:26 Status : 200 OK
2020/12/19 21:53:31 number of entries 140902
2020/12/19 21:53:32 Expected and Actual scan responses are the same
2020/12/19 21:53:32 RANGE missing cities
2020/12/19 21:53:32 Status : 200 OK
2020/12/19 21:53:32 number of entries 0
2020/12/19 21:53:32 Expected and Actual scan responses are the same
2020/12/19 21:53:32 
2020/12/19 21:53:32 SCANALL missing index
2020/12/19 21:53:32 {"limit":1000000,"stale":"ok"}
2020/12/19 21:53:32 Status : 404 Not Found
2020/12/19 21:53:32 SCANALL stale ok
2020/12/19 21:53:32 {"limit":1000000,"stale":"ok"}
2020/12/19 21:53:32 Status : 200 OK
2020/12/19 21:53:38 number of entries 140902
2020/12/19 21:53:39 Expected and Actual scan responses are the same
2020/12/19 21:53:39 SCANALL stale false
2020/12/19 21:53:39 {"limit":1000000,"stale":"false"}
2020/12/19 21:53:39 Status : 200 OK
2020/12/19 21:53:45 number of entries 140902
2020/12/19 21:53:46 Expected and Actual scan responses are the same
2020/12/19 21:53:46 
2020/12/19 21:53:46 COUNT missing index
2020/12/19 21:53:46 Status : 404 Not Found
2020/12/19 21:53:46 COUNT cities - none
2020/12/19 21:53:49 Status : 200 OK
2020/12/19 21:53:49 number of entries 140902
2020/12/19 21:53:49 COUNT cities -low
2020/12/19 21:53:51 Status : 200 OK
2020/12/19 21:53:51 number of entries 140902
2020/12/19 21:53:52 COUNT cities -high
2020/12/19 21:53:54 Status : 200 OK
2020/12/19 21:53:54 number of entries 140902
2020/12/19 21:53:54 COUNT cities - both
2020/12/19 21:53:57 Status : 200 OK
2020/12/19 21:53:57 number of entries 140902
2020/12/19 21:53:57 COUNT missing cities
2020/12/19 21:53:57 Status : 200 OK
2020/12/19 21:53:57 number of entries 0
2020/12/19 21:53:57 
2020/12/19 21:53:59 STATS: Testing URLs with valid authentication
2020/12/19 21:53:59 STATS: Testing URLs with invalid authentication
2020/12/19 21:53:59 STATS: Testing invalid URLs
2020/12/19 21:53:59 STATS: Testing unsupported methods
2020/12/19 21:53:59 
--- PASS: TestRestfulAPI (130.31s)
=== RUN   TestStatIndexInstFilter
2020/12/19 21:53:59 CREATE INDEX: statIdx1
2020/12/19 21:54:18 status : 201 Created
2020/12/19 21:54:18 {"id": "9747263775358944514"} 
2020/12/19 21:54:18 CREATE INDEX: statIdx2
2020/12/19 21:54:38 status : 201 Created
2020/12/19 21:54:38 {"id": "10999776762651345298"} 
2020/12/19 21:54:38 Instance Id for statIdx2 is 12507312268836743482, common.IndexInstId
--- PASS: TestStatIndexInstFilter (39.09s)
=== RUN   TestBucketDefaultDelete
2020-12-19T21:54:38.554+05:30 [Warn] servicesChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query-cbauth@127.0.0.1:9000, default, bucket: default, (invalid byte in chunk length)
2020-12-19T21:54:38.588+05:30 [Warn] servicesChangeNotifier: Connection terminated for pool notifier instance of http://%40query-cbauth@127.0.0.1:9000, default (Notifier invalidated due to internal error)
2020/12/19 21:54:40 Deleted bucket default, responseBody: 
2020/12/19 21:54:55 Created bucket default, responseBody: 
2020-12-19T21:54:56.025+05:30 [Warn] servicesChangeNotifier: Connection terminated for buckets notifier instance of http://%40query-cbauth@127.0.0.1:9000, default (Notifier invalidated due to internal error)
2020/12/19 21:55:12 Populating the default bucket
2020/12/19 21:55:20 Using n1ql client
2020-12-19T21:55:20.309+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:55:20.309+05:30 [Info] GSIC[default/default-_default-_default-1608395120306371430] started ...
2020/12/19 21:55:20 Scan failed as expected with error: GSI index index_isActive not found.
2020/12/19 21:55:20 Populating the default bucket after it was deleted
2020/12/19 21:55:30 Created the secondary index index_isActive. Waiting for it become active
2020/12/19 21:55:30 Index is now active
2020/12/19 21:55:30 Using n1ql client
2020/12/19 21:55:31 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (52.58s)
=== RUN   TestMixedDatatypesScanAll
2020/12/19 21:55:31 In TestMixedDatatypesScanAll()
2020/12/19 21:55:31 Before test begin: Length of kv docs is 10002
2020/12/19 21:55:31 In DropAllSecondaryIndexes()
2020/12/19 21:55:31 Index found:  index_isActive
2020/12/19 21:55:31 Dropped index index_isActive
2020/12/19 21:55:31 Number of number fields is: 275
2020/12/19 21:55:31 Number of string fields is: 244
2020/12/19 21:55:31 Number of json fields is: 249
2020/12/19 21:55:31 Number of true bool fields is: 115
2020/12/19 21:55:31 Number of false bool fields is: 117
2020/12/19 21:55:31 After generate docs: Length of kv docs is 11002
2020/12/19 21:55:31 Setting mixed datatypes JSON docs in KV
2020/12/19 21:55:37 Created the secondary index index_mixeddt. Waiting for it become active
2020/12/19 21:55:37 Index is now active
2020/12/19 21:55:37 Using n1ql client
2020/12/19 21:55:37 Expected and Actual scan responses are the same
2020/12/19 21:55:37 Lengths of expected and actual scan results are:  1000 and 1000
2020/12/19 21:55:37 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (6.26s)
=== RUN   TestMixedDatatypesRange_Float
2020/12/19 21:55:37 In TestMixedDatatypesRange_Float()
2020/12/19 21:55:37 In DropAllSecondaryIndexes()
2020/12/19 21:55:37 Index found:  index_mixeddt
2020/12/19 21:55:37 Dropped index index_mixeddt
2020/12/19 21:55:37 Number of number fields is: 257
2020/12/19 21:55:37 Number of string fields is: 248
2020/12/19 21:55:37 Number of json fields is: 233
2020/12/19 21:55:37 Number of true bool fields is: 117
2020/12/19 21:55:37 Number of false bool fields is: 145
2020/12/19 21:55:37 Setting mixed datatypes JSON docs in KV
2020/12/19 21:55:43 Created the secondary index index_mixeddt. Waiting for it become active
2020/12/19 21:55:43 Index is now active
2020/12/19 21:55:43 Using n1ql client
2020/12/19 21:55:43 Expected and Actual scan responses are the same
2020/12/19 21:55:43 Lengths of expected and actual scan results are:  28 and 28
2020/12/19 21:55:43 Using n1ql client
2020/12/19 21:55:43 Expected and Actual scan responses are the same
2020/12/19 21:55:43 Lengths of expected and actual scan results are:  2 and 2
2020/12/19 21:55:43 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.87s)
=== RUN   TestMixedDatatypesRange_String
2020/12/19 21:55:43 In TestMixedDatatypesRange_String()
2020/12/19 21:55:43 In DropAllSecondaryIndexes()
2020/12/19 21:55:43 Index found:  index_mixeddt
2020/12/19 21:55:43 Dropped index index_mixeddt
2020/12/19 21:55:43 Number of number fields is: 254
2020/12/19 21:55:43 Number of string fields is: 252
2020/12/19 21:55:43 Number of json fields is: 256
2020/12/19 21:55:43 Number of true bool fields is: 140
2020/12/19 21:55:43 Number of false bool fields is: 98
2020/12/19 21:55:43 Setting mixed datatypes JSON docs in KV
2020/12/19 21:55:48 Created the secondary index index_mixeddt. Waiting for it become active
2020/12/19 21:55:48 Index is now active
2020/12/19 21:55:48 Using n1ql client
2020/12/19 21:55:48 Expected and Actual scan responses are the same
2020/12/19 21:55:48 Lengths of expected and actual scan results are:  202 and 202
2020/12/19 21:55:48 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (5.04s)
=== RUN   TestMixedDatatypesRange_Json
2020/12/19 21:55:48 In TestMixedDatatypesRange_Json()
2020/12/19 21:55:48 In DropAllSecondaryIndexes()
2020/12/19 21:55:48 Index found:  index_mixeddt
2020/12/19 21:55:48 Dropped index index_mixeddt
2020/12/19 21:55:48 Number of number fields is: 265
2020/12/19 21:55:48 Number of string fields is: 236
2020/12/19 21:55:48 Number of json fields is: 263
2020/12/19 21:55:48 Number of true bool fields is: 119
2020/12/19 21:55:48 Number of false bool fields is: 117
2020/12/19 21:55:48 Setting mixed datatypes JSON docs in KV
2020/12/19 21:55:53 Created the secondary index index_mixeddt. Waiting for it become active
2020/12/19 21:55:53 Index is now active
2020/12/19 21:55:53 Using n1ql client
2020/12/19 21:55:53 Expected and Actual scan responses are the same
2020/12/19 21:55:53 Lengths of expected and actual scan results are:  752 and 752
2020/12/19 21:55:53 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.19s)
=== RUN   TestMixedDatatypesScan_Bool
2020/12/19 21:55:53 In TestMixedDatatypesScan_Bool()
2020/12/19 21:55:53 In DropAllSecondaryIndexes()
2020/12/19 21:55:53 Index found:  index_mixeddt
2020/12/19 21:55:53 Dropped index index_mixeddt
2020/12/19 21:55:53 Number of number fields is: 223
2020/12/19 21:55:53 Number of string fields is: 261
2020/12/19 21:55:53 Number of json fields is: 230
2020/12/19 21:55:53 Number of true bool fields is: 129
2020/12/19 21:55:53 Number of false bool fields is: 157
2020/12/19 21:55:53 Setting mixed datatypes JSON docs in KV
2020/12/19 21:55:59 Created the secondary index index_mixeddt. Waiting for it become active
2020/12/19 21:55:59 Index is now active
2020/12/19 21:55:59 Using n1ql client
2020/12/19 21:55:59 Expected and Actual scan responses are the same
2020/12/19 21:55:59 Lengths of expected and actual scan results are:  505 and 505
2020/12/19 21:55:59 Using n1ql client
2020/12/19 21:55:59 Expected and Actual scan responses are the same
2020/12/19 21:55:59 Lengths of expected and actual scan results are:  517 and 517
2020/12/19 21:55:59 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.31s)
=== RUN   TestLargeSecondaryKeyLength
2020/12/19 21:55:59 In TestLargeSecondaryKeyLength()
2020/12/19 21:55:59 In DropAllSecondaryIndexes()
2020/12/19 21:55:59 Index found:  index_mixeddt
2020/12/19 21:55:59 Dropped index index_mixeddt
2020/12/19 21:56:00 Setting JSON docs in KV
2020/12/19 21:56:04 Created the secondary index index_LongSecField. Waiting for it become active
2020/12/19 21:56:04 Index is now active
2020/12/19 21:56:04 Using n1ql client
2020/12/19 21:56:04 ScanAll: Lengths of expected and actual scan results are:  1000 and 1000
2020/12/19 21:56:04 Expected and Actual scan responses are the same
2020/12/19 21:56:04 Using n1ql client
2020/12/19 21:56:04 Range: Lengths of expected and actual scan results are:  810 and 810
2020/12/19 21:56:04 Expected and Actual scan responses are the same
2020/12/19 21:56:04 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (5.18s)
=== RUN   TestLargePrimaryKeyLength
2020/12/19 21:56:04 In TestLargePrimaryKeyLength()
2020/12/19 21:56:04 In DropAllSecondaryIndexes()
2020/12/19 21:56:04 Index found:  index_LongSecField
2020/12/19 21:56:04 Dropped index index_LongSecField
2020/12/19 21:56:05 Setting JSON docs in KV
2020/12/19 21:56:10 Created the secondary index index_LongPrimaryField. Waiting for it become active
2020/12/19 21:56:10 Index is now active
2020/12/19 21:56:10 Using n1ql client
2020/12/19 21:56:11 Lengths of num of docs and scanResults are:  17002 and 17002
2020/12/19 21:56:11 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (6.39s)
=== RUN   TestUpdateMutations_DeleteField
2020/12/19 21:56:11 In TestUpdateMutations_DeleteField()
2020/12/19 21:56:11 Setting JSON docs in KV
2020/12/19 21:56:18 Created the secondary index index_bal. Waiting for it become active
2020/12/19 21:56:18 Index is now active
2020/12/19 21:56:18 Using n1ql client
2020/12/19 21:56:18 Expected and Actual scan responses are the same
2020/12/19 21:56:19 Using n1ql client
2020/12/19 21:56:19 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (8.18s)
=== RUN   TestUpdateMutations_AddField
2020/12/19 21:56:19 In TestUpdateMutations_AddField()
2020/12/19 21:56:19 Setting JSON docs in KV
2020/12/19 21:56:25 Created the secondary index index_newField. Waiting for it become active
2020/12/19 21:56:25 Index is now active
2020/12/19 21:56:25 Using n1ql client
2020/12/19 21:56:25 Count of scan results before add field mutations:  0
2020/12/19 21:56:25 Expected and Actual scan responses are the same
2020/12/19 21:56:26 Using n1ql client
2020/12/19 21:56:26 Count of scan results after add field mutations:  300
2020/12/19 21:56:26 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (6.91s)
=== RUN   TestUpdateMutations_DataTypeChange
2020/12/19 21:56:26 In TestUpdateMutations_DataTypeChange()
2020/12/19 21:56:26 Setting JSON docs in KV
2020/12/19 21:56:34 Created the secondary index index_isUserActive. Waiting for it become active
2020/12/19 21:56:34 Index is now active
2020/12/19 21:56:34 Using n1ql client
2020/12/19 21:56:34 Expected and Actual scan responses are the same
2020/12/19 21:56:34 Using n1ql client
2020/12/19 21:56:35 Expected and Actual scan responses are the same
2020/12/19 21:56:35 Using n1ql client
2020/12/19 21:56:35 Expected and Actual scan responses are the same
2020/12/19 21:56:35 Using n1ql client
2020/12/19 21:56:35 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (9.11s)
=== RUN   TestMultipleBuckets
2020/12/19 21:56:35 In TestMultipleBuckets()
2020/12/19 21:56:35 In DropAllSecondaryIndexes()
2020/12/19 21:56:35 Index found:  index_isUserActive
2020/12/19 21:56:35 Dropped index index_isUserActive
2020/12/19 21:56:35 Index found:  index_LongPrimaryField
2020/12/19 21:56:35 Dropped index index_LongPrimaryField
2020/12/19 21:56:35 Index found:  index_newField
2020/12/19 21:56:35 Dropped index index_newField
2020/12/19 21:56:35 Index found:  index_bal
2020/12/19 21:56:35 Dropped index index_bal
2020/12/19 21:57:15 Flushed the bucket default, Response body: 
2020/12/19 21:57:18 Modified parameters of bucket default, responseBody: 
2020/12/19 21:57:18 Created bucket testbucket2, responseBody: 
2020/12/19 21:57:18 Created bucket testbucket3, responseBody: 
2020/12/19 21:57:18 Created bucket testbucket4, responseBody: 
2020/12/19 21:57:33 Generating docs and Populating all the buckets
2020/12/19 21:57:40 Created the secondary index bucket1_age. Waiting for it become active
2020/12/19 21:57:40 Index is now active
2020/12/19 21:57:48 Created the secondary index bucket2_city. Waiting for it become active
2020/12/19 21:57:48 Index is now active
2020/12/19 21:57:55 Created the secondary index bucket3_gender. Waiting for it become active
2020/12/19 21:57:55 Index is now active
2020/12/19 21:58:04 Created the secondary index bucket4_balance. Waiting for it become active
2020/12/19 21:58:04 Index is now active
2020/12/19 21:58:07 Using n1ql client
2020/12/19 21:58:07 Expected and Actual scan responses are the same
2020/12/19 21:58:07 Using n1ql client
2020-12-19T21:58:07.590+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:58:07.590+05:30 [Info] GSIC[default/testbucket2-_default-_default-1608395287575903297] started ...
2020/12/19 21:58:07 Expected and Actual scan responses are the same
2020/12/19 21:58:07 Using n1ql client
2020-12-19T21:58:07.646+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:58:07.646+05:30 [Info] GSIC[default/testbucket3-_default-_default-1608395287632809927] started ...
2020/12/19 21:58:07 Expected and Actual scan responses are the same
2020/12/19 21:58:07 Using n1ql client
2020-12-19T21:58:07.721+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T21:58:07.721+05:30 [Info] GSIC[default/testbucket4-_default-_default-1608395287703417657] started ...
2020/12/19 21:58:07 Expected and Actual scan responses are the same
2020/12/19 21:58:11 Deleted bucket testbucket2, responseBody: 
2020/12/19 21:58:14 Deleted bucket testbucket3, responseBody: 
2020/12/19 21:58:16 Deleted bucket testbucket4, responseBody: 
2020/12/19 21:58:19 Modified parameters of bucket default, responseBody: 
--- PASS: TestMultipleBuckets (119.50s)
=== RUN   TestBucketFlush
2020/12/19 21:58:34 In TestBucketFlush()
2020/12/19 21:58:34 In DropAllSecondaryIndexes()
2020/12/19 21:58:34 Index found:  bucket1_age
2020/12/19 21:58:35 Dropped index bucket1_age
2020/12/19 21:59:14 Flushed the bucket default, Response body: 
2020/12/19 21:59:18 Created the secondary index index_age. Waiting for it become active
2020/12/19 21:59:18 Index is now active
2020/12/19 21:59:18 Using n1ql client
2020/12/19 21:59:19 Expected and Actual scan responses are the same
2020/12/19 21:59:23 Created the secondary index index_gender. Waiting for it become active
2020/12/19 21:59:23 Index is now active
2020/12/19 21:59:23 Using n1ql client
2020/12/19 21:59:24 Expected and Actual scan responses are the same
2020/12/19 21:59:27 Created the secondary index index_city. Waiting for it become active
2020/12/19 21:59:27 Index is now active
2020/12/19 21:59:27 Using n1ql client
2020/12/19 21:59:28 Expected and Actual scan responses are the same
2020/12/19 22:00:07 Flushed the bucket default, Response body: 
2020/12/19 22:00:07 TestBucketFlush:: Flushed the bucket
2020/12/19 22:00:07 Using n1ql client
2020/12/19 22:00:07 Using n1ql client
2020/12/19 22:00:07 Using n1ql client
--- PASS: TestBucketFlush (92.49s)
=== RUN   TestLargeDocumentSize
2020/12/19 22:00:07 In TestLargeDocumentSize()
2020/12/19 22:00:07 Data file exists. Skipping download
2020/12/19 22:00:07 Length of docs and largeDocs = 200 and 200
2020/12/19 22:00:11 Created the secondary index index_userscreenname. Waiting for it become active
2020/12/19 22:00:11 Index is now active
2020/12/19 22:00:11 Using n1ql client
2020/12/19 22:00:12 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.38s)
=== RUN   TestFieldsWithSpecialCharacters
2020/12/19 22:00:12 In TestFieldsWithSpecialCharacters()
2020/12/19 22:00:18 Created the secondary index index_specialchar. Waiting for it become active
2020/12/19 22:00:18 Index is now active
2020/12/19 22:00:18 Looking up for value Â¶Â§Â®Å¡3Æ’Âµ
2020/12/19 22:00:18 Using n1ql client
2020/12/19 22:00:19 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (6.25s)
=== RUN   TestIndexNameValidation
2020/12/19 22:00:19 In TestIndexNameValidation()
2020/12/19 22:00:19 Setting JSON docs in KV
2020/12/19 22:00:20 Creation of index with invalid name ÃŒÃ±ÃÃ‰x&(abc_% failed as expected
2020/12/19 22:00:24 Created the secondary index #primary-Index_test. Waiting for it become active
2020/12/19 22:00:24 Index is now active
2020/12/19 22:00:24 Using n1ql client
2020/12/19 22:00:24 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (5.80s)
=== RUN   TestSameFieldNameAtDifferentLevels
2020/12/19 22:00:24 In TestSameFieldNameAtDifferentLevels()
2020/12/19 22:00:25 Setting JSON docs in KV
2020/12/19 22:00:30 Created the secondary index cityindex. Waiting for it become active
2020/12/19 22:00:30 Index is now active
2020/12/19 22:00:30 Using n1ql client
2020/12/19 22:00:31 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.40s)
=== RUN   TestSameIndexNameInTwoBuckets
2020/12/19 22:00:31 In TestSameIndexNameInTwoBuckets()
2020/12/19 22:00:31 In DropAllSecondaryIndexes()
2020/12/19 22:00:31 Index found:  index_gender
2020/12/19 22:00:31 Dropped index index_gender
2020/12/19 22:00:31 Index found:  index_userscreenname
2020/12/19 22:00:31 Dropped index index_userscreenname
2020/12/19 22:00:31 Index found:  cityindex
2020/12/19 22:00:31 Dropped index cityindex
2020/12/19 22:00:31 Index found:  index_age
2020/12/19 22:00:31 Dropped index index_age
2020/12/19 22:00:31 Index found:  index_city
2020/12/19 22:00:31 Dropped index index_city
2020/12/19 22:00:31 Index found:  #primary-Index_test
2020/12/19 22:00:31 Dropped index #primary-Index_test
2020/12/19 22:00:31 Index found:  index_specialchar
2020/12/19 22:00:31 Dropped index index_specialchar
2020/12/19 22:01:11 Flushed the bucket default, Response body: 
2020/12/19 22:01:14 Modified parameters of bucket default, responseBody: 
2020/12/19 22:01:14 Created bucket buck2, responseBody: 
2020/12/19 22:01:29 Generating docs and Populating all the buckets
2020/12/19 22:01:33 Created the secondary index b_idx. Waiting for it become active
2020/12/19 22:01:33 Index is now active
2020/12/19 22:01:40 Created the secondary index b_idx. Waiting for it become active
2020/12/19 22:01:40 Index is now active
2020/12/19 22:01:43 Using n1ql client
2020/12/19 22:01:43 Expected and Actual scan responses are the same
2020/12/19 22:01:43 Using n1ql client
2020-12-19T22:01:43.335+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:01:43.336+05:30 [Info] GSIC[default/buck2-_default-_default-1608395503332933005] started ...
2020/12/19 22:01:43 Expected and Actual scan responses are the same
2020/12/19 22:01:46 Modified parameters of bucket default, responseBody: 
2020/12/19 22:01:48 Deleted bucket buck2, responseBody: 
--- PASS: TestSameIndexNameInTwoBuckets (92.49s)
=== RUN   TestLargeKeysSplChars
2020/12/19 22:02:03 Skipping test TestLargeKeysSplChars() for forestdb
--- PASS: TestLargeKeysSplChars (0.00s)
=== RUN   TestVeryLargeIndexKey
2020/12/19 22:02:03 Skipping test TestVeryLargeIndexKey() for forestdb
--- PASS: TestVeryLargeIndexKey (0.00s)
=== RUN   TestTempBufScanResult
2020/12/19 22:02:03 Skipping test TestTempBufScanResult() for forestdb
--- PASS: TestTempBufScanResult (0.00s)
=== RUN   TestBuildDeferredAnotherBuilding
2020/12/19 22:02:03 In TestBuildDeferredAnotherBuilding()
2020/12/19 22:02:03 In DropAllSecondaryIndexes()
2020/12/19 22:02:03 Index found:  b_idx
2020/12/19 22:02:03 Dropped index b_idx
2020/12/19 22:02:54 Setting JSON docs in KV
2020/12/19 22:05:02 Build the deferred index id_age1. Waiting for the index to become active
2020/12/19 22:05:02 Waiting for index to go active ...
2020/12/19 22:05:03 Waiting for index to go active ...
2020/12/19 22:05:04 Waiting for index to go active ...
2020/12/19 22:05:05 Waiting for index to go active ...
2020/12/19 22:05:06 Waiting for index to go active ...
2020/12/19 22:05:07 Waiting for index to go active ...
2020/12/19 22:05:08 Waiting for index to go active ...
2020/12/19 22:05:09 Waiting for index to go active ...
2020/12/19 22:05:10 Waiting for index to go active ...
2020/12/19 22:05:11 Waiting for index to go active ...
2020/12/19 22:05:12 Waiting for index to go active ...
2020/12/19 22:05:13 Waiting for index to go active ...
2020/12/19 22:05:14 Waiting for index to go active ...
2020/12/19 22:05:15 Waiting for index to go active ...
2020/12/19 22:05:16 Waiting for index to go active ...
2020/12/19 22:05:17 Waiting for index to go active ...
2020/12/19 22:05:18 Waiting for index to go active ...
2020/12/19 22:05:19 Waiting for index to go active ...
2020/12/19 22:05:20 Waiting for index to go active ...
2020/12/19 22:05:21 Waiting for index to go active ...
2020/12/19 22:05:22 Waiting for index to go active ...
2020/12/19 22:05:23 Waiting for index to go active ...
2020/12/19 22:05:24 Waiting for index to go active ...
2020/12/19 22:05:25 Waiting for index to go active ...
2020/12/19 22:05:26 Waiting for index to go active ...
2020/12/19 22:05:27 Waiting for index to go active ...
2020/12/19 22:05:28 Waiting for index to go active ...
2020/12/19 22:05:29 Waiting for index to go active ...
2020/12/19 22:05:30 Index is now active
2020/12/19 22:05:30 Build command issued for the deferred indexes [5536618980368264957]
2020/12/19 22:05:32 Build index failed as expected: Build index fails. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2020/12/19 22:05:32 Waiting for index to go active ...
2020/12/19 22:05:33 Waiting for index to go active ...
2020/12/19 22:05:34 Waiting for index to go active ...
2020/12/19 22:05:35 Waiting for index to go active ...
2020/12/19 22:05:36 Waiting for index to go active ...
2020/12/19 22:05:37 Waiting for index to go active ...
2020/12/19 22:05:38 Waiting for index to go active ...
2020/12/19 22:05:39 Waiting for index to go active ...
2020/12/19 22:05:40 Waiting for index to go active ...
2020/12/19 22:05:41 Waiting for index to go active ...
2020/12/19 22:05:42 Waiting for index to go active ...
2020/12/19 22:05:43 Waiting for index to go active ...
2020/12/19 22:05:44 Waiting for index to go active ...
2020/12/19 22:05:45 Waiting for index to go active ...
2020/12/19 22:05:46 Waiting for index to go active ...
2020/12/19 22:05:47 Waiting for index to go active ...
2020/12/19 22:05:49 Waiting for index to go active ...
2020/12/19 22:05:50 Waiting for index to go active ...
2020/12/19 22:05:51 Waiting for index to go active ...
2020/12/19 22:05:52 Waiting for index to go active ...
2020/12/19 22:05:53 Waiting for index to go active ...
2020/12/19 22:05:54 Waiting for index to go active ...
2020/12/19 22:05:55 Waiting for index to go active ...
2020/12/19 22:05:56 Waiting for index to go active ...
2020/12/19 22:05:57 Waiting for index to go active ...
2020/12/19 22:05:58 Waiting for index to go active ...
2020/12/19 22:05:59 Index is now active
2020/12/19 22:05:59 Waiting for index to go active ...
2020/12/19 22:06:00 Waiting for index to go active ...
2020/12/19 22:06:01 Waiting for index to go active ...
2020/12/19 22:06:02 Waiting for index to go active ...
2020/12/19 22:06:03 Waiting for index to go active ...
2020/12/19 22:06:04 Waiting for index to go active ...
2020/12/19 22:06:05 Waiting for index to go active ...
2020/12/19 22:06:06 Waiting for index to go active ...
2020/12/19 22:06:07 Waiting for index to go active ...
2020/12/19 22:06:08 Waiting for index to go active ...
2020/12/19 22:06:09 Waiting for index to go active ...
2020/12/19 22:06:10 Waiting for index to go active ...
2020/12/19 22:06:11 Waiting for index to go active ...
2020/12/19 22:06:12 Waiting for index to go active ...
2020/12/19 22:06:13 Waiting for index to go active ...
2020/12/19 22:06:14 Waiting for index to go active ...
2020/12/19 22:06:15 Waiting for index to go active ...
2020/12/19 22:06:16 Waiting for index to go active ...
2020/12/19 22:06:17 Waiting for index to go active ...
2020/12/19 22:06:18 Waiting for index to go active ...
2020/12/19 22:06:19 Waiting for index to go active ...
2020/12/19 22:06:20 Waiting for index to go active ...
2020/12/19 22:06:21 Waiting for index to go active ...
2020/12/19 22:06:22 Waiting for index to go active ...
2020/12/19 22:06:23 Waiting for index to go active ...
2020/12/19 22:06:24 Waiting for index to go active ...
2020/12/19 22:06:25 Waiting for index to go active ...
2020/12/19 22:06:26 Index is now active
2020/12/19 22:06:26 Using n1ql client
2020/12/19 22:06:27 Expected and Actual scan responses are the same
2020/12/19 22:06:28 Using n1ql client
2020/12/19 22:06:29 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (265.69s)
=== RUN   TestMultipleBucketsDeferredBuild
2020/12/19 22:06:29 In TestMultipleBucketsDeferredBuild()
2020/12/19 22:06:29 In DropAllSecondaryIndexes()
2020/12/19 22:06:29 Index found:  id_company
2020/12/19 22:06:29 Dropped index id_company
2020/12/19 22:06:29 Index found:  id_age1
2020/12/19 22:06:29 Dropped index id_age1
2020/12/19 22:06:29 Index found:  id_age
2020/12/19 22:06:29 Dropped index id_age
2020/12/19 22:07:08 Flushed the bucket default, Response body: 
2020/12/19 22:07:11 Modified parameters of bucket default, responseBody: 
2020/12/19 22:07:11 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2020/12/19 22:07:11 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:07:11 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 16:37:10 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00dea34c0 31 [] false false map[] 0xc01c87ee00 }
2020/12/19 22:07:11 DeleteBucket failed for bucket defertest_buck2 
2020/12/19 22:07:11 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2020/12/19 22:07:11 Created bucket defertest_buck2, responseBody: 
2020/12/19 22:07:26 Setting JSON docs in KV
2020/12/19 22:08:49 Build command issued for the deferred indexes [3042197137399889139]
2020/12/19 22:08:50 Build command issued for the deferred indexes [18291547321086060699 4754682908218410294]
2020/12/19 22:08:50 Index state of 4754682908218410294 is INDEX_STATE_READY
2020/12/19 22:08:50 Waiting for index to go active ...
2020/12/19 22:08:51 Waiting for index to go active ...
2020/12/19 22:08:52 Waiting for index to go active ...
2020/12/19 22:08:53 Waiting for index to go active ...
2020/12/19 22:08:54 Waiting for index to go active ...
2020/12/19 22:08:55 Waiting for index to go active ...
2020/12/19 22:08:56 Waiting for index to go active ...
2020/12/19 22:08:57 Waiting for index to go active ...
2020/12/19 22:08:58 Waiting for index to go active ...
2020/12/19 22:08:59 Waiting for index to go active ...
2020/12/19 22:09:00 Waiting for index to go active ...
2020/12/19 22:09:01 Waiting for index to go active ...
2020/12/19 22:09:02 Waiting for index to go active ...
2020/12/19 22:09:03 Waiting for index to go active ...
2020/12/19 22:09:04 Waiting for index to go active ...
2020/12/19 22:09:05 Index is now active
2020/12/19 22:09:05 Waiting for index to go active ...
2020/12/19 22:09:06 Waiting for index to go active ...
2020/12/19 22:09:07 Waiting for index to go active ...
2020/12/19 22:09:08 Waiting for index to go active ...
2020/12/19 22:09:09 Waiting for index to go active ...
2020/12/19 22:09:10 Waiting for index to go active ...
2020/12/19 22:09:11 Waiting for index to go active ...
2020/12/19 22:09:12 Waiting for index to go active ...
2020/12/19 22:09:13 Waiting for index to go active ...
2020/12/19 22:09:14 Waiting for index to go active ...
2020/12/19 22:09:15 Waiting for index to go active ...
2020/12/19 22:09:16 Waiting for index to go active ...
2020/12/19 22:09:17 Waiting for index to go active ...
2020/12/19 22:09:18 Waiting for index to go active ...
2020/12/19 22:09:19 Waiting for index to go active ...
2020/12/19 22:09:20 Waiting for index to go active ...
2020/12/19 22:09:21 Waiting for index to go active ...
2020/12/19 22:09:22 Waiting for index to go active ...
2020/12/19 22:09:23 Waiting for index to go active ...
2020/12/19 22:09:24 Waiting for index to go active ...
2020/12/19 22:09:25 Waiting for index to go active ...
2020/12/19 22:09:26 Index is now active
2020/12/19 22:09:26 Using n1ql client
2020/12/19 22:09:27 Expected and Actual scan responses are the same
2020/12/19 22:09:27 Using n1ql client
2020/12/19 22:09:27 Expected and Actual scan responses are the same
2020/12/19 22:09:27 Using n1ql client
2020-12-19T22:09:27.213+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:09:27.213+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1608395967210418387] started ...
2020/12/19 22:09:27 Expected and Actual scan responses are the same
2020/12/19 22:09:30 Modified parameters of bucket default, responseBody: 
2020/12/19 22:09:33 Deleted bucket defertest_buck2, responseBody: 
--- PASS: TestMultipleBucketsDeferredBuild (188.95s)
=== RUN   TestCreateDropCreateDeferredIndex
2020/12/19 22:09:38 In TestCreateDropCreateDeferredIndex()
2020/12/19 22:09:38 In DropAllSecondaryIndexes()
2020/12/19 22:09:38 Index found:  buck1_id1
2020/12/19 22:09:38 Dropped index buck1_id1
2020/12/19 22:09:38 Index found:  buck1_id2
2020/12/19 22:09:38 Dropped index buck1_id2
2020/12/19 22:09:41 Setting JSON docs in KV
2020/12/19 22:09:58 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:09:58 Index is now active
2020/12/19 22:10:00 Dropping the secondary index id_age
2020/12/19 22:10:01 Index dropped
2020/12/19 22:10:04 Setting JSON docs in KV
2020/12/19 22:10:12 Using n1ql client
2020/12/19 22:10:13 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (35.29s)
=== RUN   TestMultipleDeferredIndexes_BuildTogether
2020/12/19 22:10:13 In TestMultipleDeferredIndexes_BuildTogether()
2020/12/19 22:10:13 In DropAllSecondaryIndexes()
2020/12/19 22:10:13 Index found:  id_company
2020/12/19 22:10:14 Dropped index id_company
2020/12/19 22:10:17 Setting JSON docs in KV
2020/12/19 22:10:36 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:10:36 Index is now active
2020/12/19 22:10:40 Build command issued for the deferred indexes [id_age id_gender id_isActive]
2020/12/19 22:10:40 Waiting for the index id_age to become active
2020/12/19 22:10:40 Waiting for index to go active ...
2020/12/19 22:10:41 Waiting for index to go active ...
2020/12/19 22:10:42 Waiting for index to go active ...
2020/12/19 22:10:43 Waiting for index to go active ...
2020/12/19 22:10:44 Waiting for index to go active ...
2020/12/19 22:10:45 Waiting for index to go active ...
2020/12/19 22:10:46 Waiting for index to go active ...
2020/12/19 22:10:47 Waiting for index to go active ...
2020/12/19 22:10:48 Waiting for index to go active ...
2020/12/19 22:10:49 Waiting for index to go active ...
2020/12/19 22:10:50 Waiting for index to go active ...
2020/12/19 22:10:51 Waiting for index to go active ...
2020/12/19 22:10:52 Waiting for index to go active ...
2020/12/19 22:10:53 Waiting for index to go active ...
2020/12/19 22:10:54 Waiting for index to go active ...
2020/12/19 22:10:55 Waiting for index to go active ...
2020/12/19 22:10:56 Waiting for index to go active ...
2020/12/19 22:10:57 Index is now active
2020/12/19 22:10:57 Waiting for the index id_gender to become active
2020/12/19 22:10:57 Index is now active
2020/12/19 22:10:57 Waiting for the index id_isActive to become active
2020/12/19 22:10:57 Index is now active
2020/12/19 22:10:57 Using n1ql client
2020/12/19 22:10:58 Expected and Actual scan responses are the same
2020/12/19 22:11:01 Setting JSON docs in KV
2020/12/19 22:11:11 Using n1ql client
2020/12/19 22:11:13 Expected and Actual scan responses are the same
2020/12/19 22:11:13 Using n1ql client
2020/12/19 22:11:14 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (60.71s)
=== RUN   TestMultipleDeferredIndexes_BuildOneByOne
2020/12/19 22:11:14 In TestMultipleDeferredIndexes_BuildOneByOne()
2020/12/19 22:11:14 In DropAllSecondaryIndexes()
2020/12/19 22:11:14 Index found:  id_company
2020/12/19 22:11:14 Dropped index id_company
2020/12/19 22:11:14 Index found:  id_age
2020/12/19 22:11:14 Dropped index id_age
2020/12/19 22:11:14 Index found:  id_isActive
2020/12/19 22:11:14 Dropped index id_isActive
2020/12/19 22:11:14 Index found:  id_gender
2020/12/19 22:11:14 Dropped index id_gender
2020/12/19 22:11:17 Setting JSON docs in KV
2020/12/19 22:11:40 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:11:40 Index is now active
2020/12/19 22:11:44 Build command issued for the deferred indexes [id_age]
2020/12/19 22:11:44 Waiting for the index id_age to become active
2020/12/19 22:11:44 Waiting for index to go active ...
2020/12/19 22:11:45 Waiting for index to go active ...
2020/12/19 22:11:46 Waiting for index to go active ...
2020/12/19 22:11:47 Waiting for index to go active ...
2020/12/19 22:11:48 Waiting for index to go active ...
2020/12/19 22:11:49 Waiting for index to go active ...
2020/12/19 22:11:50 Waiting for index to go active ...
2020/12/19 22:11:51 Waiting for index to go active ...
2020/12/19 22:11:52 Waiting for index to go active ...
2020/12/19 22:11:53 Waiting for index to go active ...
2020/12/19 22:11:54 Waiting for index to go active ...
2020/12/19 22:11:55 Waiting for index to go active ...
2020/12/19 22:11:56 Waiting for index to go active ...
2020/12/19 22:11:57 Waiting for index to go active ...
2020/12/19 22:11:58 Waiting for index to go active ...
2020/12/19 22:11:59 Waiting for index to go active ...
2020/12/19 22:12:00 Waiting for index to go active ...
2020/12/19 22:12:01 Index is now active
2020/12/19 22:12:01 Build command issued for the deferred indexes [id_gender]
2020/12/19 22:12:01 Waiting for the index id_gender to become active
2020/12/19 22:12:01 Waiting for index to go active ...
2020/12/19 22:12:02 Waiting for index to go active ...
2020/12/19 22:12:03 Waiting for index to go active ...
2020/12/19 22:12:04 Waiting for index to go active ...
2020/12/19 22:12:05 Waiting for index to go active ...
2020/12/19 22:12:06 Waiting for index to go active ...
2020/12/19 22:12:07 Waiting for index to go active ...
2020/12/19 22:12:08 Waiting for index to go active ...
2020/12/19 22:12:09 Waiting for index to go active ...
2020/12/19 22:12:10 Waiting for index to go active ...
2020/12/19 22:12:11 Waiting for index to go active ...
2020/12/19 22:12:12 Waiting for index to go active ...
2020/12/19 22:12:13 Waiting for index to go active ...
2020/12/19 22:12:14 Waiting for index to go active ...
2020/12/19 22:12:15 Waiting for index to go active ...
2020/12/19 22:12:16 Index is now active
2020/12/19 22:12:16 Build command issued for the deferred indexes [id_isActive]
2020/12/19 22:12:16 Waiting for the index id_isActive to become active
2020/12/19 22:12:16 Waiting for index to go active ...
2020/12/19 22:12:17 Waiting for index to go active ...
2020/12/19 22:12:18 Waiting for index to go active ...
2020/12/19 22:12:19 Waiting for index to go active ...
2020/12/19 22:12:20 Waiting for index to go active ...
2020/12/19 22:12:21 Waiting for index to go active ...
2020/12/19 22:12:22 Waiting for index to go active ...
2020/12/19 22:12:23 Waiting for index to go active ...
2020/12/19 22:12:24 Waiting for index to go active ...
2020/12/19 22:12:25 Waiting for index to go active ...
2020/12/19 22:12:26 Waiting for index to go active ...
2020/12/19 22:12:27 Waiting for index to go active ...
2020/12/19 22:12:28 Waiting for index to go active ...
2020/12/19 22:12:29 Waiting for index to go active ...
2020/12/19 22:12:30 Waiting for index to go active ...
2020/12/19 22:12:31 Index is now active
2020/12/19 22:12:31 Using n1ql client
2020/12/19 22:12:32 Expected and Actual scan responses are the same
2020/12/19 22:12:34 Setting JSON docs in KV
2020/12/19 22:12:44 Using n1ql client
2020/12/19 22:12:46 Expected and Actual scan responses are the same
2020/12/19 22:12:46 Using n1ql client
2020/12/19 22:12:48 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (93.72s)
=== RUN   TestDropDeferredIndexWhileOthersBuilding
2020/12/19 22:12:48 In TestDropDeferredIndexWhileOthersBuilding()
2020/12/19 22:12:48 In DropAllSecondaryIndexes()
2020/12/19 22:12:48 Index found:  id_company
2020/12/19 22:12:48 Dropped index id_company
2020/12/19 22:12:48 Index found:  id_isActive
2020/12/19 22:12:48 Dropped index id_isActive
2020/12/19 22:12:48 Index found:  id_gender
2020/12/19 22:12:48 Dropped index id_gender
2020/12/19 22:12:48 Index found:  id_age
2020/12/19 22:12:48 Dropped index id_age
2020/12/19 22:12:51 Setting JSON docs in KV
2020/12/19 22:13:15 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:13:15 Index is now active
2020/12/19 22:13:19 Build command issued for the deferred indexes [3188114750801246674 5662233674575190890]
2020/12/19 22:13:21 Dropping the secondary index id_isActive
2020/12/19 22:13:21 Index dropped
2020/12/19 22:13:21 Waiting for index to go active ...
2020/12/19 22:13:22 Waiting for index to go active ...
2020/12/19 22:13:23 Waiting for index to go active ...
2020/12/19 22:13:24 Waiting for index to go active ...
2020/12/19 22:13:25 Waiting for index to go active ...
2020/12/19 22:13:26 Waiting for index to go active ...
2020/12/19 22:13:27 Waiting for index to go active ...
2020/12/19 22:13:28 Waiting for index to go active ...
2020/12/19 22:13:29 Waiting for index to go active ...
2020/12/19 22:13:30 Waiting for index to go active ...
2020/12/19 22:13:31 Waiting for index to go active ...
2020/12/19 22:13:32 Waiting for index to go active ...
2020/12/19 22:13:33 Waiting for index to go active ...
2020/12/19 22:13:34 Waiting for index to go active ...
2020/12/19 22:13:35 Waiting for index to go active ...
2020/12/19 22:13:36 Waiting for index to go active ...
2020/12/19 22:13:37 Waiting for index to go active ...
2020/12/19 22:13:38 Waiting for index to go active ...
2020/12/19 22:13:39 Index is now active
2020/12/19 22:13:39 Index is now active
2020/12/19 22:13:40 Using n1ql client
2020/12/19 22:13:41 Expected and Actual scan responses are the same
2020/12/19 22:13:41 Using n1ql client
2020/12/19 22:13:41 Expected and Actual scan responses are the same
2020/12/19 22:13:43 Setting JSON docs in KV
2020/12/19 22:13:53 Using n1ql client
2020/12/19 22:13:55 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (67.24s)
=== RUN   TestDropBuildingDeferredIndex
2020/12/19 22:13:55 In TestDropBuildingDeferredIndex()
2020/12/19 22:13:55 In DropAllSecondaryIndexes()
2020/12/19 22:13:55 Index found:  id_company
2020/12/19 22:13:55 Dropped index id_company
2020/12/19 22:13:55 Index found:  id_gender
2020/12/19 22:13:55 Dropped index id_gender
2020/12/19 22:13:55 Index found:  id_age
2020/12/19 22:13:55 Dropped index id_age
2020/12/19 22:13:58 Setting JSON docs in KV
2020/12/19 22:14:07 Build command issued for the deferred indexes [4552745815326564029 12306511574017754]
2020/12/19 22:14:08 Dropping the secondary index id_age
2020/12/19 22:14:08 Index dropped
2020/12/19 22:14:08 Waiting for index to go active ...
2020/12/19 22:14:09 Waiting for index to go active ...
2020/12/19 22:14:10 Waiting for index to go active ...
2020/12/19 22:14:11 Waiting for index to go active ...
2020/12/19 22:14:12 Waiting for index to go active ...
2020/12/19 22:14:13 Waiting for index to go active ...
2020/12/19 22:14:14 Waiting for index to go active ...
2020/12/19 22:14:15 Waiting for index to go active ...
2020/12/19 22:14:16 Waiting for index to go active ...
2020/12/19 22:14:17 Waiting for index to go active ...
2020/12/19 22:14:18 Waiting for index to go active ...
2020/12/19 22:14:19 Waiting for index to go active ...
2020/12/19 22:14:20 Waiting for index to go active ...
2020/12/19 22:14:21 Waiting for index to go active ...
2020/12/19 22:14:22 Waiting for index to go active ...
2020/12/19 22:14:23 Waiting for index to go active ...
2020/12/19 22:14:24 Waiting for index to go active ...
2020/12/19 22:14:25 Waiting for index to go active ...
2020/12/19 22:14:26 Waiting for index to go active ...
2020/12/19 22:14:27 Waiting for index to go active ...
2020/12/19 22:14:28 Waiting for index to go active ...
2020/12/19 22:14:29 Index is now active
2020/12/19 22:14:29 Build command issued for the deferred indexes [id_gender]
2020/12/19 22:14:29 Waiting for the index id_gender to become active
2020/12/19 22:14:29 Waiting for index to go active ...
2020/12/19 22:14:30 Waiting for index to go active ...
2020/12/19 22:14:31 Waiting for index to go active ...
2020/12/19 22:14:32 Waiting for index to go active ...
2020/12/19 22:14:33 Waiting for index to go active ...
2020/12/19 22:14:34 Waiting for index to go active ...
2020/12/19 22:14:35 Waiting for index to go active ...
2020/12/19 22:14:36 Waiting for index to go active ...
2020/12/19 22:14:37 Waiting for index to go active ...
2020/12/19 22:14:38 Waiting for index to go active ...
2020/12/19 22:14:39 Waiting for index to go active ...
2020/12/19 22:14:40 Waiting for index to go active ...
2020/12/19 22:14:41 Waiting for index to go active ...
2020/12/19 22:14:42 Waiting for index to go active ...
2020/12/19 22:14:43 Waiting for index to go active ...
2020/12/19 22:14:44 Waiting for index to go active ...
2020/12/19 22:14:45 Waiting for index to go active ...
2020/12/19 22:14:46 Waiting for index to go active ...
2020/12/19 22:14:47 Waiting for index to go active ...
2020/12/19 22:14:48 Waiting for index to go active ...
2020/12/19 22:14:49 Waiting for index to go active ...
2020/12/19 22:14:50 Waiting for index to go active ...
2020/12/19 22:14:51 Waiting for index to go active ...
2020/12/19 22:14:52 Index is now active
2020/12/19 22:14:54 Using n1ql client
2020/12/19 22:14:54 Expected and Actual scan responses are the same
2020/12/19 22:14:54 Using n1ql client
2020/12/19 22:14:56 Expected and Actual scan responses are the same
2020/12/19 22:14:59 Setting JSON docs in KV
2020/12/19 22:15:09 Using n1ql client
2020/12/19 22:15:13 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (77.83s)
=== RUN   TestDropMultipleBuildingDeferredIndexes
2020/12/19 22:15:13 In TestDropMultipleBuildingDeferredIndexes()
2020/12/19 22:15:13 In DropAllSecondaryIndexes()
2020/12/19 22:15:13 Index found:  id_company
2020/12/19 22:15:13 Dropped index id_company
2020/12/19 22:15:13 Index found:  id_gender
2020/12/19 22:15:13 Dropped index id_gender
2020/12/19 22:15:21 Setting JSON docs in KV
2020/12/19 22:16:09 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:16:09 Index is now active
2020/12/19 22:16:12 Build command issued for the deferred indexes [17277823179428140783 18231039456818848959]
2020/12/19 22:16:13 Dropping the secondary index id_age
2020/12/19 22:16:15 Index dropped
2020/12/19 22:16:15 Dropping the secondary index id_gender
2020/12/19 22:16:18 Index dropped
2020/12/19 22:16:19 Build command issued for the deferred indexes [id_isActive]
2020/12/19 22:16:19 Waiting for the index id_isActive to become active
2020/12/19 22:16:19 Waiting for index to go active ...
2020/12/19 22:16:20 Waiting for index to go active ...
2020/12/19 22:16:21 Waiting for index to go active ...
2020/12/19 22:16:22 Waiting for index to go active ...
2020/12/19 22:16:23 Waiting for index to go active ...
2020/12/19 22:16:24 Waiting for index to go active ...
2020/12/19 22:16:25 Waiting for index to go active ...
2020/12/19 22:16:26 Waiting for index to go active ...
2020/12/19 22:16:27 Waiting for index to go active ...
2020/12/19 22:16:28 Waiting for index to go active ...
2020/12/19 22:16:29 Waiting for index to go active ...
2020/12/19 22:16:30 Waiting for index to go active ...
2020/12/19 22:16:31 Waiting for index to go active ...
2020/12/19 22:16:32 Waiting for index to go active ...
2020/12/19 22:16:33 Waiting for index to go active ...
2020/12/19 22:16:34 Waiting for index to go active ...
2020/12/19 22:16:35 Waiting for index to go active ...
2020/12/19 22:16:36 Waiting for index to go active ...
2020/12/19 22:16:37 Waiting for index to go active ...
2020/12/19 22:16:38 Waiting for index to go active ...
2020/12/19 22:16:39 Waiting for index to go active ...
2020/12/19 22:16:40 Waiting for index to go active ...
2020/12/19 22:16:41 Waiting for index to go active ...
2020/12/19 22:16:42 Waiting for index to go active ...
2020/12/19 22:16:43 Waiting for index to go active ...
2020/12/19 22:16:44 Index is now active
2020/12/19 22:16:54 Using n1ql client
2020/12/19 22:16:58 Expected and Actual scan responses are the same
2020/12/19 22:16:58 Number of docScanResults and scanResults = 180000 and 180000
2020/12/19 22:16:59 Using n1ql client
2020/12/19 22:17:03 Expected and Actual scan responses are the same
2020/12/19 22:17:03 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (109.98s)
=== RUN   TestDropOneIndexSecondDeferBuilding
2020/12/19 22:17:03 In TestDropOneIndexSecondDeferBuilding()
2020/12/19 22:17:03 In DropAllSecondaryIndexes()
2020/12/19 22:17:03 Index found:  id_isActive
2020/12/19 22:17:03 Dropped index id_isActive
2020/12/19 22:17:03 Index found:  id_company
2020/12/19 22:17:03 Dropped index id_company
2020/12/19 22:17:05 Setting JSON docs in KV
2020/12/19 22:17:14 Build command issued for the deferred indexes [id_company]
2020/12/19 22:17:14 Waiting for the index id_company to become active
2020/12/19 22:17:14 Waiting for index to go active ...
2020/12/19 22:17:15 Waiting for index to go active ...
2020/12/19 22:17:16 Waiting for index to go active ...
2020/12/19 22:17:17 Waiting for index to go active ...
2020/12/19 22:17:18 Waiting for index to go active ...
2020/12/19 22:17:19 Waiting for index to go active ...
2020/12/19 22:17:20 Waiting for index to go active ...
2020/12/19 22:17:21 Waiting for index to go active ...
2020/12/19 22:17:22 Waiting for index to go active ...
2020/12/19 22:17:23 Waiting for index to go active ...
2020/12/19 22:17:24 Waiting for index to go active ...
2020/12/19 22:17:25 Waiting for index to go active ...
2020/12/19 22:17:26 Waiting for index to go active ...
2020/12/19 22:17:27 Waiting for index to go active ...
2020/12/19 22:17:28 Waiting for index to go active ...
2020/12/19 22:17:29 Waiting for index to go active ...
2020/12/19 22:17:30 Waiting for index to go active ...
2020/12/19 22:17:31 Waiting for index to go active ...
2020/12/19 22:17:32 Waiting for index to go active ...
2020/12/19 22:17:33 Waiting for index to go active ...
2020/12/19 22:17:34 Waiting for index to go active ...
2020/12/19 22:17:35 Waiting for index to go active ...
2020/12/19 22:17:36 Waiting for index to go active ...
2020/12/19 22:17:37 Waiting for index to go active ...
2020/12/19 22:17:38 Waiting for index to go active ...
2020/12/19 22:17:39 Waiting for index to go active ...
2020/12/19 22:17:40 Index is now active
2020/12/19 22:17:40 Build command issued for the deferred indexes [13567585483023289556]
2020/12/19 22:17:41 Dropping the secondary index id_company
2020/12/19 22:17:41 Index dropped
2020/12/19 22:17:53 Setting JSON docs in KV
2020/12/19 22:18:02 Waiting for index to go active ...
2020/12/19 22:18:03 Waiting for index to go active ...
2020/12/19 22:18:04 Waiting for index to go active ...
2020/12/19 22:18:05 Waiting for index to go active ...
2020/12/19 22:18:06 Waiting for index to go active ...
2020/12/19 22:18:07 Waiting for index to go active ...
2020/12/19 22:18:08 Waiting for index to go active ...
2020/12/19 22:18:09 Waiting for index to go active ...
2020/12/19 22:18:10 Waiting for index to go active ...
2020/12/19 22:18:11 Waiting for index to go active ...
2020/12/19 22:18:12 Waiting for index to go active ...
2020/12/19 22:18:13 Index is now active
2020/12/19 22:18:13 Build command issued for the deferred indexes [id_gender]
2020/12/19 22:18:13 Waiting for the index id_gender to become active
2020/12/19 22:18:13 Waiting for index to go active ...
2020/12/19 22:18:14 Waiting for index to go active ...
2020/12/19 22:18:15 Waiting for index to go active ...
2020/12/19 22:18:16 Waiting for index to go active ...
2020/12/19 22:18:17 Waiting for index to go active ...
2020/12/19 22:18:18 Waiting for index to go active ...
2020/12/19 22:18:19 Waiting for index to go active ...
2020/12/19 22:18:20 Waiting for index to go active ...
2020/12/19 22:18:21 Waiting for index to go active ...
2020/12/19 22:18:22 Waiting for index to go active ...
2020/12/19 22:18:23 Waiting for index to go active ...
2020/12/19 22:18:24 Waiting for index to go active ...
2020/12/19 22:18:25 Waiting for index to go active ...
2020/12/19 22:18:26 Waiting for index to go active ...
2020/12/19 22:18:27 Waiting for index to go active ...
2020/12/19 22:18:28 Waiting for index to go active ...
2020/12/19 22:18:29 Waiting for index to go active ...
2020/12/19 22:18:30 Waiting for index to go active ...
2020/12/19 22:18:31 Waiting for index to go active ...
2020/12/19 22:18:32 Waiting for index to go active ...
2020/12/19 22:18:33 Waiting for index to go active ...
2020/12/19 22:18:34 Waiting for index to go active ...
2020/12/19 22:18:35 Waiting for index to go active ...
2020/12/19 22:18:36 Waiting for index to go active ...
2020/12/19 22:18:37 Waiting for index to go active ...
2020/12/19 22:18:38 Waiting for index to go active ...
2020/12/19 22:18:39 Waiting for index to go active ...
2020/12/19 22:18:40 Waiting for index to go active ...
2020/12/19 22:18:41 Waiting for index to go active ...
2020/12/19 22:18:42 Waiting for index to go active ...
2020/12/19 22:18:43 Waiting for index to go active ...
2020/12/19 22:18:44 Index is now active
2020/12/19 22:18:44 Using n1ql client
2020/12/19 22:18:45 Expected and Actual scan responses are the same
2020/12/19 22:18:45 Using n1ql client
2020/12/19 22:18:51 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (108.09s)
=== RUN   TestDropSecondIndexSecondDeferBuilding
2020/12/19 22:18:51 In TestDropSecondIndexSecondDeferBuilding()
2020/12/19 22:18:51 In DropAllSecondaryIndexes()
2020/12/19 22:18:51 Index found:  id_age
2020/12/19 22:18:51 Dropped index id_age
2020/12/19 22:18:51 Index found:  id_gender
2020/12/19 22:18:51 Dropped index id_gender
2020/12/19 22:18:53 Setting JSON docs in KV
2020/12/19 22:19:02 Build command issued for the deferred indexes [id_company]
2020/12/19 22:19:02 Waiting for the index id_company to become active
2020/12/19 22:19:02 Waiting for index to go active ...
2020/12/19 22:19:03 Waiting for index to go active ...
2020/12/19 22:19:04 Waiting for index to go active ...
2020/12/19 22:19:05 Waiting for index to go active ...
2020/12/19 22:19:06 Waiting for index to go active ...
2020/12/19 22:19:07 Waiting for index to go active ...
2020/12/19 22:19:08 Waiting for index to go active ...
2020/12/19 22:19:09 Waiting for index to go active ...
2020/12/19 22:19:10 Waiting for index to go active ...
2020/12/19 22:19:11 Waiting for index to go active ...
2020/12/19 22:19:12 Waiting for index to go active ...
2020/12/19 22:19:13 Waiting for index to go active ...
2020/12/19 22:19:14 Waiting for index to go active ...
2020/12/19 22:19:15 Waiting for index to go active ...
2020/12/19 22:19:16 Waiting for index to go active ...
2020/12/19 22:19:17 Waiting for index to go active ...
2020/12/19 22:19:18 Waiting for index to go active ...
2020/12/19 22:19:19 Waiting for index to go active ...
2020/12/19 22:19:20 Waiting for index to go active ...
2020/12/19 22:19:21 Waiting for index to go active ...
2020/12/19 22:19:22 Waiting for index to go active ...
2020/12/19 22:19:23 Waiting for index to go active ...
2020/12/19 22:19:24 Waiting for index to go active ...
2020/12/19 22:19:25 Waiting for index to go active ...
2020/12/19 22:19:26 Waiting for index to go active ...
2020/12/19 22:19:27 Waiting for index to go active ...
2020/12/19 22:19:28 Waiting for index to go active ...
2020/12/19 22:19:29 Waiting for index to go active ...
2020/12/19 22:19:30 Waiting for index to go active ...
2020/12/19 22:19:31 Index is now active
2020/12/19 22:19:31 Build command issued for the deferred indexes [8546209708291232168]
2020/12/19 22:19:32 Dropping the secondary index id_age
2020/12/19 22:19:32 Index dropped
2020/12/19 22:19:39 Setting JSON docs in KV
2020/12/19 22:19:48 Build command issued for the deferred indexes [id_gender]
2020/12/19 22:19:48 Waiting for the index id_gender to become active
2020/12/19 22:19:48 Waiting for index to go active ...
2020/12/19 22:19:49 Waiting for index to go active ...
2020/12/19 22:19:50 Waiting for index to go active ...
2020/12/19 22:19:51 Waiting for index to go active ...
2020/12/19 22:19:52 Waiting for index to go active ...
2020/12/19 22:19:53 Waiting for index to go active ...
2020/12/19 22:19:54 Waiting for index to go active ...
2020/12/19 22:19:55 Waiting for index to go active ...
2020/12/19 22:19:56 Waiting for index to go active ...
2020/12/19 22:19:57 Waiting for index to go active ...
2020/12/19 22:19:58 Waiting for index to go active ...
2020/12/19 22:19:59 Waiting for index to go active ...
2020/12/19 22:20:00 Waiting for index to go active ...
2020/12/19 22:20:01 Waiting for index to go active ...
2020/12/19 22:20:02 Waiting for index to go active ...
2020/12/19 22:20:03 Waiting for index to go active ...
2020/12/19 22:20:04 Waiting for index to go active ...
2020/12/19 22:20:05 Waiting for index to go active ...
2020/12/19 22:20:06 Waiting for index to go active ...
2020/12/19 22:20:07 Waiting for index to go active ...
2020/12/19 22:20:08 Waiting for index to go active ...
2020/12/19 22:20:09 Waiting for index to go active ...
2020/12/19 22:20:10 Waiting for index to go active ...
2020/12/19 22:20:11 Waiting for index to go active ...
2020/12/19 22:20:12 Waiting for index to go active ...
2020/12/19 22:20:13 Waiting for index to go active ...
2020/12/19 22:20:14 Waiting for index to go active ...
2020/12/19 22:20:15 Waiting for index to go active ...
2020/12/19 22:20:16 Waiting for index to go active ...
2020/12/19 22:20:17 Waiting for index to go active ...
2020/12/19 22:20:18 Waiting for index to go active ...
2020/12/19 22:20:19 Waiting for index to go active ...
2020/12/19 22:20:20 Waiting for index to go active ...
2020/12/19 22:20:21 Index is now active
2020/12/19 22:20:21 Using n1ql client
2020/12/19 22:20:22 Expected and Actual scan responses are the same
2020/12/19 22:20:22 Using n1ql client
2020/12/19 22:20:28 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (96.72s)
=== RUN   TestCreateAfterDropWhileIndexBuilding
2020/12/19 22:20:28 In TestCreateAfterDropWhileIndexBuilding()
2020/12/19 22:20:28 In DropAllSecondaryIndexes()
2020/12/19 22:20:28 Index found:  id_gender
2020/12/19 22:20:28 Dropped index id_gender
2020/12/19 22:20:28 Index found:  id_company
2020/12/19 22:20:28 Dropped index id_company
2020/12/19 22:20:56 Setting JSON docs in KV
2020/12/19 22:21:59 Build command issued for the deferred indexes [5542816021199978290]
2020/12/19 22:22:00 Waiting for index to go active ...
2020/12/19 22:22:01 Waiting for index to go active ...
2020/12/19 22:22:02 Waiting for index to go active ...
2020/12/19 22:22:03 Waiting for index to go active ...
2020/12/19 22:22:04 Waiting for index to go active ...
2020/12/19 22:22:05 Waiting for index to go active ...
2020/12/19 22:22:06 Waiting for index to go active ...
2020/12/19 22:22:07 Waiting for index to go active ...
2020/12/19 22:22:08 Waiting for index to go active ...
2020/12/19 22:22:09 Waiting for index to go active ...
2020/12/19 22:22:10 Waiting for index to go active ...
2020/12/19 22:22:11 Waiting for index to go active ...
2020/12/19 22:22:12 Waiting for index to go active ...
2020/12/19 22:22:13 Waiting for index to go active ...
2020/12/19 22:22:14 Waiting for index to go active ...
2020/12/19 22:22:15 Waiting for index to go active ...
2020/12/19 22:22:16 Waiting for index to go active ...
2020/12/19 22:22:17 Waiting for index to go active ...
2020/12/19 22:22:18 Waiting for index to go active ...
2020/12/19 22:22:19 Waiting for index to go active ...
2020/12/19 22:22:20 Waiting for index to go active ...
2020/12/19 22:22:21 Waiting for index to go active ...
2020/12/19 22:22:22 Waiting for index to go active ...
2020/12/19 22:22:23 Waiting for index to go active ...
2020/12/19 22:22:24 Waiting for index to go active ...
2020/12/19 22:22:25 Waiting for index to go active ...
2020/12/19 22:22:26 Waiting for index to go active ...
2020/12/19 22:22:27 Waiting for index to go active ...
2020/12/19 22:22:28 Waiting for index to go active ...
2020/12/19 22:22:29 Waiting for index to go active ...
2020/12/19 22:22:30 Waiting for index to go active ...
2020/12/19 22:22:31 Waiting for index to go active ...
2020/12/19 22:22:32 Waiting for index to go active ...
2020/12/19 22:22:33 Waiting for index to go active ...
2020/12/19 22:22:34 Waiting for index to go active ...
2020/12/19 22:22:35 Waiting for index to go active ...
2020/12/19 22:22:36 Waiting for index to go active ...
2020/12/19 22:22:37 Waiting for index to go active ...
2020/12/19 22:22:38 Waiting for index to go active ...
2020/12/19 22:22:39 Waiting for index to go active ...
2020/12/19 22:22:40 Waiting for index to go active ...
2020/12/19 22:22:41 Waiting for index to go active ...
2020/12/19 22:22:42 Waiting for index to go active ...
2020/12/19 22:22:43 Index is now active
2020/12/19 22:22:44 Build command issued for the deferred indexes [4387227083788760261]
2020/12/19 22:22:45 Dropping the secondary index id_company
2020/12/19 22:22:46 Index dropped
2020/12/19 22:22:46 Dropping the secondary index id_age
2020/12/19 22:22:46 Index dropped
2020/12/19 22:22:52 Build command issued for the deferred indexes [id_gender]
2020/12/19 22:22:52 Waiting for the index id_gender to become active
2020/12/19 22:22:52 Waiting for index to go active ...
2020/12/19 22:22:53 Waiting for index to go active ...
2020/12/19 22:22:54 Waiting for index to go active ...
2020/12/19 22:22:55 Waiting for index to go active ...
2020/12/19 22:22:56 Waiting for index to go active ...
2020/12/19 22:22:57 Waiting for index to go active ...
2020/12/19 22:22:58 Waiting for index to go active ...
2020/12/19 22:22:59 Waiting for index to go active ...
2020/12/19 22:23:00 Waiting for index to go active ...
2020/12/19 22:23:01 Waiting for index to go active ...
2020/12/19 22:23:02 Waiting for index to go active ...
2020/12/19 22:23:03 Waiting for index to go active ...
2020/12/19 22:23:04 Waiting for index to go active ...
2020/12/19 22:23:05 Waiting for index to go active ...
2020/12/19 22:23:06 Waiting for index to go active ...
2020/12/19 22:23:07 Waiting for index to go active ...
2020/12/19 22:23:08 Waiting for index to go active ...
2020/12/19 22:23:09 Waiting for index to go active ...
2020/12/19 22:23:10 Waiting for index to go active ...
2020/12/19 22:23:11 Waiting for index to go active ...
2020/12/19 22:23:12 Waiting for index to go active ...
2020/12/19 22:23:13 Waiting for index to go active ...
2020/12/19 22:23:14 Waiting for index to go active ...
2020/12/19 22:23:15 Waiting for index to go active ...
2020/12/19 22:23:16 Waiting for index to go active ...
2020/12/19 22:23:17 Waiting for index to go active ...
2020/12/19 22:23:18 Waiting for index to go active ...
2020/12/19 22:23:19 Waiting for index to go active ...
2020/12/19 22:23:20 Waiting for index to go active ...
2020/12/19 22:23:21 Waiting for index to go active ...
2020/12/19 22:23:22 Waiting for index to go active ...
2020/12/19 22:23:23 Waiting for index to go active ...
2020/12/19 22:23:24 Waiting for index to go active ...
2020/12/19 22:23:25 Waiting for index to go active ...
2020/12/19 22:23:26 Waiting for index to go active ...
2020/12/19 22:23:27 Waiting for index to go active ...
2020/12/19 22:23:28 Waiting for index to go active ...
2020/12/19 22:23:29 Waiting for index to go active ...
2020/12/19 22:23:30 Waiting for index to go active ...
2020/12/19 22:23:31 Waiting for index to go active ...
2020/12/19 22:23:32 Waiting for index to go active ...
2020/12/19 22:23:33 Waiting for index to go active ...
2020/12/19 22:23:34 Index is now active
2020/12/19 22:23:35 Index is now active
2020/12/19 22:23:35 Using n1ql client
2020/12/19 22:23:40 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (192.38s)
=== RUN   TestDropBuildingIndex1
2020/12/19 22:23:40 In TestDropBuildingIndex1()
2020/12/19 22:23:40 In DropAllSecondaryIndexes()
2020/12/19 22:23:40 Index found:  id_gender
2020/12/19 22:23:40 Dropped index id_gender
2020/12/19 22:23:45 Setting JSON docs in KV
2020/12/19 22:24:44 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:24:44 Index is now active
2020/12/19 22:25:33 Dropping the secondary index id_age
2020/12/19 22:25:33 Index dropped
2020/12/19 22:26:19 Created the secondary index id_age. Waiting for it become active
2020/12/19 22:26:19 Index is now active
2020/12/19 22:26:22 Setting JSON docs in KV
2020/12/19 22:26:30 Using n1ql client
2020/12/19 22:26:32 Expected and Actual scan responses are the same
2020/12/19 22:26:32 Using n1ql client
2020/12/19 22:26:35 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (174.64s)
=== RUN   TestDropBuildingIndex2
2020/12/19 22:26:35 In TestDropBuildingIndex2()
2020/12/19 22:26:35 In DropAllSecondaryIndexes()
2020/12/19 22:26:35 Index found:  id_company
2020/12/19 22:26:35 Dropped index id_company
2020/12/19 22:26:35 Index found:  id_age
2020/12/19 22:26:35 Dropped index id_age
2020/12/19 22:26:42 Setting JSON docs in KV
2020/12/19 22:27:45 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:27:45 Index is now active
2020/12/19 22:28:39 Dropping the secondary index id_company
2020/12/19 22:28:39 Index dropped
2020/12/19 22:28:39 Index is now active
2020/12/19 22:29:30 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:29:30 Index is now active
2020/12/19 22:29:33 Setting JSON docs in KV
2020/12/19 22:29:42 Using n1ql client
2020/12/19 22:29:44 Expected and Actual scan responses are the same
2020/12/19 22:29:44 Using n1ql client
2020/12/19 22:29:47 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (191.98s)
=== RUN   TestDropIndexWithDataLoad
2020/12/19 22:29:47 In TestDropIndexWithDataLoad()
2020/12/19 22:29:47 In DropAllSecondaryIndexes()
2020/12/19 22:29:47 Index found:  id_age
2020/12/19 22:29:47 Dropped index id_age
2020/12/19 22:29:47 Index found:  id_company
2020/12/19 22:29:47 Dropped index id_company
2020/12/19 22:29:49 Setting JSON docs in KV
2020/12/19 22:30:51 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:30:51 Index is now active
2020/12/19 22:31:46 Created the secondary index id_age. Waiting for it become active
2020/12/19 22:31:46 Index is now active
2020/12/19 22:32:39 Created the secondary index id_gender. Waiting for it become active
2020/12/19 22:32:39 Index is now active
2020/12/19 22:33:32 Created the secondary index id_isActive. Waiting for it become active
2020/12/19 22:33:32 Index is now active
2020/12/19 22:33:41 Setting JSON docs in KV
2020/12/19 22:33:41 In LoadKVBucket
2020/12/19 22:33:41 In DropIndexWhileKVLoad
2020/12/19 22:33:41 Bucket name = default
2020/12/19 22:33:42 Dropping the secondary index id_company
2020/12/19 22:33:43 Index dropped
2020/12/19 22:34:13 Using n1ql client
2020/12/19 22:34:16 Expected and Actual scan responses are the same
2020/12/19 22:34:16 Number of docScanResults and scanResults = 96752 and 96752
2020/12/19 22:34:17 Using n1ql client
2020/12/19 22:34:26 Expected and Actual scan responses are the same
2020/12/19 22:34:26 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (279.95s)
=== RUN   TestDropAllIndexesWithDataLoad
2020/12/19 22:34:26 In TestDropAllIndexesWithDataLoad()
2020/12/19 22:34:26 In DropAllSecondaryIndexes()
2020/12/19 22:34:26 Index found:  id_gender
2020/12/19 22:34:27 Dropped index id_gender
2020/12/19 22:34:27 Index found:  id_isActive
2020/12/19 22:34:27 Dropped index id_isActive
2020/12/19 22:34:27 Index found:  id_age
2020/12/19 22:34:27 Dropped index id_age
2020/12/19 22:34:29 Setting JSON docs in KV
2020/12/19 22:35:34 Created the secondary index id_company. Waiting for it become active
2020/12/19 22:35:34 Index is now active
2020/12/19 22:36:35 Created the secondary index id_age. Waiting for it become active
2020/12/19 22:36:35 Index is now active
2020/12/19 22:37:32 Created the secondary index id_gender. Waiting for it become active
2020/12/19 22:37:32 Index is now active
2020/12/19 22:38:30 Created the secondary index id_isActive. Waiting for it become active
2020/12/19 22:38:30 Index is now active
2020/12/19 22:38:38 Setting JSON docs in KV
2020/12/19 22:38:38 In LoadKVBucket
2020/12/19 22:38:38 Bucket name = default
2020/12/19 22:38:38 In DropIndexWhileKVLoad
2020/12/19 22:38:38 In DropIndexWhileKVLoad
2020/12/19 22:38:38 In DropIndexWhileKVLoad
2020/12/19 22:38:38 In DropIndexWhileKVLoad
2020/12/19 22:38:39 Dropping the secondary index id_gender
2020/12/19 22:38:39 Dropping the secondary index id_company
2020/12/19 22:38:39 Dropping the secondary index id_isActive
2020/12/19 22:38:39 Dropping the secondary index id_age
2020/12/19 22:38:40 Index dropped
2020/12/19 22:38:40 Index dropped
2020/12/19 22:38:40 Index dropped
2020/12/19 22:38:41 Index dropped
2020/12/19 22:38:59 Using n1ql client
2020/12/19 22:38:59 Scan failed as expected with error: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (272.96s)
=== RUN   TestCreateBucket_AnotherIndexBuilding
2020/12/19 22:38:59 In TestCreateBucket_AnotherIndexBuilding()
2020/12/19 22:38:59 In DropAllSecondaryIndexes()
2020/12/19 22:39:38 Flushed the bucket default, Response body: 
2020/12/19 22:39:38 http://127.0.0.1:9000/pools/default/buckets/default
2020/12/19 22:39:38 &{POST http://127.0.0.1:9000/pools/default/buckets/default HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc026b58460} 0x75d010 27 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:39:38 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[346] Content-Type:[application/json] Date:[Sat, 19 Dec 2020 17:09:37 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0b33cd2c0 346 [] false false map[] 0xc01dd5bc00 }
2020/12/19 22:39:38 EditBucket failed for bucket default 
2020/12/19 22:39:41 Modified parameters of bucket default, responseBody: {"errors":{"ramQuotaMB":"RAM quota cannot be set below current usage."},"summaries":{"ramSummary":{"total":3145728000,"otherBuckets":0,"nodesCount":2,"perNodeMegs":256,"thisAlloc":536870912,"thisUsed":842971356,"free":2608857088},"hddSummary":{"total":78981824512,"otherData":58813805819,"otherBuckets":0,"thisUsed":27653442,"free":20168018693}}}
2020/12/19 22:39:41 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2020/12/19 22:39:41 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:39:41 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:09:40 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0b342e580 31 [] false false map[] 0xc0b3302900 }
2020/12/19 22:39:41 DeleteBucket failed for bucket multi_buck2 
2020/12/19 22:39:41 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2020/12/19 22:39:56 Setting JSON docs in KV
2020/12/19 22:42:14 Created bucket multi_buck2, responseBody: 
2020/12/19 22:42:39 Index is now active
2020/12/19 22:42:39 Index is now active
2020/12/19 22:42:39 Using n1ql client
2020-12-19T22:42:39.674+05:30 [Info] metadata provider version changed 1154 -> 1155
2020-12-19T22:42:39.674+05:30 [Info] switched currmeta from 1154 -> 1155 force false 
2020-12-19T22:42:39.674+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:42:39.674+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1608397959666925563] started ...
2020/12/19 22:42:40 Expected and Actual scan responses are the same
2020/12/19 22:42:40 Number of docScanResults and scanResults = 10000 and 10000
2020/12/19 22:42:40 Using n1ql client
2020/12/19 22:42:46 Expected and Actual scan responses are the same
2020/12/19 22:42:46 Number of docScanResults and scanResults = 200000 and 200000
2020/12/19 22:42:49 Deleted bucket multi_buck2, responseBody: 
2020/12/19 22:43:28 Flushed the bucket default, Response body: 
--- PASS: TestCreateBucket_AnotherIndexBuilding (268.21s)
=== RUN   TestDropBucket2Index_Bucket1IndexBuilding
2020/12/19 22:43:28 In TestDropBucket2Index_Bucket1IndexBuilding()
2020/12/19 22:43:28 In DropAllSecondaryIndexes()
2020/12/19 22:43:28 Index found:  buck1_idx
2020/12/19 22:43:28 Dropped index buck1_idx
2020/12/19 22:44:07 Flushed the bucket default, Response body: 
2020/12/19 22:44:07 http://127.0.0.1:9000/pools/default/buckets/default
2020/12/19 22:44:07 &{POST http://127.0.0.1:9000/pools/default/buckets/default HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc004c2f540} 0x75d010 27 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:44:07 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[346] Content-Type:[application/json] Date:[Sat, 19 Dec 2020 17:14:06 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0262c26c0 346 [] false false map[] 0xc0049a2200 }
2020/12/19 22:44:07 EditBucket failed for bucket default 
2020/12/19 22:44:10 Modified parameters of bucket default, responseBody: {"errors":{"ramQuotaMB":"RAM quota cannot be set below current usage."},"summaries":{"ramSummary":{"total":3145728000,"otherBuckets":0,"nodesCount":2,"perNodeMegs":256,"thisAlloc":536870912,"thisUsed":924559840,"free":2608857088},"hddSummary":{"total":78981824512,"otherData":58425085992,"otherBuckets":0,"thisUsed":21464146,"free":20556738520}}}
2020/12/19 22:44:10 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2020/12/19 22:44:10 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:44:10 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:14:09 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc03b7f4e40 31 [] false false map[] 0xc0049a2300 }
2020/12/19 22:44:10 DeleteBucket failed for bucket multibucket_test3 
2020/12/19 22:44:10 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2020/12/19 22:44:10 Created bucket multibucket_test3, responseBody: 
2020/12/19 22:44:25 Setting JSON docs in KV
2020/12/19 22:45:29 Created the secondary index buck2_idx. Waiting for it become active
2020/12/19 22:45:29 Index is now active
2020/12/19 22:45:50 Dropping the secondary index buck2_idx
2020/12/19 22:45:50 Index dropped
2020/12/19 22:45:50 Index is now active
2020/12/19 22:45:51 Using n1ql client
2020/12/19 22:45:54 Expected and Actual scan responses are the same
2020/12/19 22:45:54 Number of docScanResults and scanResults = 100000 and 100000
2020/12/19 22:45:56 Deleted bucket multibucket_test3, responseBody: 
2020/12/19 22:46:35 Flushed the bucket default, Response body: 
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (187.28s)
=== RUN   TestDeleteBucketWhileInitialIndexBuild
2020/12/19 22:46:35 In TestDeleteBucketWhileInitialIndexBuild()
2020/12/19 22:46:35 ============== DBG: Drop all indexes in all buckets
2020/12/19 22:46:35 In DropAllSecondaryIndexes()
2020/12/19 22:46:35 Index found:  buck1_idx
2020/12/19 22:46:35 Dropped index buck1_idx
2020/12/19 22:46:35 ============== DBG: Delete bucket default
2020/12/19 22:46:37 Deleted bucket default, responseBody: 
2020/12/19 22:46:37 ============== DBG: Create bucket default
2020/12/19 22:46:37 Created bucket default, responseBody: 
2020/12/19 22:46:40 Flush Enabled on bucket default, responseBody: 
2020/12/19 22:47:12 Flushed the bucket default, Response body: 
2020/12/19 22:47:12 ============== DBG: Delete bucket testbucket2
2020/12/19 22:47:12 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2020/12/19 22:47:12 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:47:12 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:17:11 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc024f6e440 31 [] false false map[] 0xc01ae52200 }
2020/12/19 22:47:12 DeleteBucket failed for bucket testbucket2 
2020/12/19 22:47:12 Deleted bucket testbucket2, responseBody: Requested resource not found.
2020/12/19 22:47:12 ============== DBG: Create bucket testbucket2
2020/12/19 22:47:12 Created bucket testbucket2, responseBody: 
2020/12/19 22:47:15 Flush Enabled on bucket testbucket2, responseBody: 
2020/12/19 22:47:48 Flushed the bucket testbucket2, Response body: 
2020/12/19 22:47:48 ============== DBG: Delete bucket testbucket3
2020/12/19 22:47:48 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2020/12/19 22:47:48 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:47:48 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:17:48 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc03ec6f380 31 [] false false map[] 0xc0032da500 }
2020/12/19 22:47:48 DeleteBucket failed for bucket testbucket3 
2020/12/19 22:47:48 Deleted bucket testbucket3, responseBody: Requested resource not found.
2020/12/19 22:47:48 ============== DBG: Create bucket testbucket3
2020/12/19 22:47:48 Created bucket testbucket3, responseBody: 
2020/12/19 22:47:52 Flush Enabled on bucket testbucket3, responseBody: 
2020/12/19 22:48:26 Flushed the bucket testbucket3, Response body: 
2020/12/19 22:48:26 ============== DBG: Delete bucket testbucket4
2020/12/19 22:48:26 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2020/12/19 22:48:26 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:48:26 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:18:25 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc036dd4280 31 [] false false map[] 0xc0096da000 }
2020/12/19 22:48:26 DeleteBucket failed for bucket testbucket4 
2020/12/19 22:48:26 Deleted bucket testbucket4, responseBody: Requested resource not found.
2020/12/19 22:48:26 ============== DBG: Create bucket testbucket4
2020/12/19 22:48:26 Created bucket testbucket4, responseBody: 
2020/12/19 22:48:29 Flush Enabled on bucket testbucket4, responseBody: 
2020/12/19 22:49:04 Flushed the bucket testbucket4, Response body: 
2020/12/19 22:49:19 Generating docs and Populating all the buckets
2020/12/19 22:49:20 ============== DBG: Creating docs in bucket default
2020/12/19 22:49:20 ============== DBG: Creating index bucket1_age in bucket default
2020/12/19 22:49:26 Created the secondary index bucket1_age. Waiting for it become active
2020/12/19 22:49:26 Index is now active
2020/12/19 22:49:26 ============== DBG: Creating index bucket1_gender in bucket default
2020/12/19 22:49:33 Created the secondary index bucket1_gender. Waiting for it become active
2020/12/19 22:49:33 Index is now active
2020/12/19 22:49:34 ============== DBG: Creating docs in bucket testbucket2
2020/12/19 22:49:35 ============== DBG: Creating index bucket2_city in bucket testbucket2
2020/12/19 22:49:41 Created the secondary index bucket2_city. Waiting for it become active
2020/12/19 22:49:41 Index is now active
2020/12/19 22:49:41 ============== DBG: Creating index bucket2_company in bucket testbucket2
2020/12/19 22:49:48 Created the secondary index bucket2_company. Waiting for it become active
2020/12/19 22:49:48 Index is now active
2020/12/19 22:49:49 ============== DBG: Creating docs in bucket testbucket3
2020/12/19 22:49:50 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2020/12/19 22:49:56 Created the secondary index bucket3_gender. Waiting for it become active
2020/12/19 22:49:56 Index is now active
2020/12/19 22:49:56 ============== DBG: Creating index bucket3_address in bucket testbucket3
2020/12/19 22:50:03 Created the secondary index bucket3_address. Waiting for it become active
2020/12/19 22:50:03 Index is now active
2020/12/19 22:50:03 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2020/12/19 22:50:03 Using n1ql client
2020-12-19T22:50:03.602+05:30 [Info] metadata provider version changed 1219 -> 1220
2020-12-19T22:50:03.602+05:30 [Info] switched currmeta from 1219 -> 1220 force false 
2020-12-19T22:50:03.602+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:50:03.602+05:30 [Info] GSIC[default/default-_default-_default-1608398403528136132] started ...
2020/12/19 22:50:03 ============== DBG: First bucket scan:: Expected results = 310 Actual results = 310
2020/12/19 22:50:03 Expected and Actual scan responses are the same
2020/12/19 22:50:17 ============== DBG: Creating 50K docs in bucket testbucket4
2020/12/19 22:50:51 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2020/12/19 22:51:05 ============== DBG: Deleting bucket testbucket4
2020/12/19 22:51:08 Deleted bucket testbucket4, responseBody: 
2020/12/19 22:51:08 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2020/12/19 22:51:08 Using n1ql client
2020/12/19 22:51:08 ============== DBG: First bucket scan:: Expected results = 310 Actual results = 310
2020/12/19 22:51:08 Expected and Actual scan responses are the same
2020/12/19 22:51:08 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2020/12/19 22:51:08 Using n1ql client
2020-12-19T22:51:08.787+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:51:08.788+05:30 [Info] GSIC[default/testbucket2-_default-_default-1608398468779202112] started ...
2020/12/19 22:51:08 ============== DBG: Second bucket scan:: Expected results = 423 Actual results = 423
2020/12/19 22:51:08 Expected and Actual scan responses are the same
2020/12/19 22:51:08 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2020/12/19 22:51:08 Using n1ql client
2020-12-19T22:51:08.819+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:51:08.819+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:51:08.828+05:30 [Info] switched currmeta from 1232 -> 1232 force true 
2020-12-19T22:51:08.829+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T22:51:08.829+05:30 [Info] GSIC[default/testbucket3-_default-_default-1608398468815613844] started ...
2020/12/19 22:51:08 ============== DBG: Third bucket scan:: Expected results = 521 Actual results = 521
2020/12/19 22:51:08 Expected and Actual scan responses are the same
2020/12/19 22:51:08 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2020/12/19 22:51:11 Deleted bucket testbucket2, responseBody: 
2020/12/19 22:51:14 Deleted bucket testbucket3, responseBody: 
2020/12/19 22:51:14 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2020/12/19 22:51:14 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003a0d8}
2020/12/19 22:51:14 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sat, 19 Dec 2020 17:21:13 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc016f007c0 31 [] false false map[] 0xc016d77f00 }
2020/12/19 22:51:14 DeleteBucket failed for bucket testbucket4 
2020/12/19 22:51:14 Deleted bucket testbucket4, responseBody: Requested resource not found.
2020/12/19 22:51:17 Modified parameters of bucket default, responseBody: 
--- PASS: TestDeleteBucketWhileInitialIndexBuild (296.66s)
=== RUN   TestWherClause_UpdateDocument
2020/12/19 22:51:32 In TestWherClause_UpdateDocument()
2020/12/19 22:51:32 In DropAllSecondaryIndexes()
2020/12/19 22:51:32 Index found:  bucket1_gender
2020/12/19 22:51:32 Dropped index bucket1_gender
2020/12/19 22:51:32 Index found:  bucket1_age
2020/12/19 22:51:32 Dropped index bucket1_age
2020/12/19 22:52:11 Flushed the bucket default, Response body: 
2020/12/19 22:52:13 Setting JSON docs in KV
2020/12/19 22:52:23 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2020/12/19 22:52:23 Index is now active
2020/12/19 22:52:23 Using n1ql client
2020/12/19 22:52:24 Expected and Actual scan responses are the same
2020/12/19 22:52:24 Number of docScanResults and scanResults = 6008 and 6008
2020/12/19 22:52:28 Using n1ql client
2020/12/19 22:52:29 Expected and Actual scan responses are the same
2020/12/19 22:52:29 Number of docScanResults and scanResults = 2008 and 2008
--- PASS: TestWherClause_UpdateDocument (57.12s)
=== RUN   TestDeferFalse
2020/12/19 22:52:29 In TestDeferFalse()
2020/12/19 22:52:32 Setting JSON docs in KV
2020/12/19 22:52:46 Created the secondary index index_deferfalse1. Waiting for it become active
2020/12/19 22:52:46 Index is now active
2020/12/19 22:52:46 Using n1ql client
2020/12/19 22:52:46 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (17.26s)
=== RUN   TestDeferFalse_CloseClientConnection
2020/12/19 22:52:46 In TestDeferFalse_CloseClientConnection()
2020/12/19 22:52:46 In CloseClientThread
2020/12/19 22:52:46 In CreateIndexThread
2020-12-19T22:52:48.651+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:44992->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 22:52:48 Create Index call failed as expected due to error : Terminate Request due to client termination
2020/12/19 22:52:48 Waiting for index to go active ...
2020/12/19 22:52:49 Waiting for index to go active ...
2020/12/19 22:52:50 Waiting for index to go active ...
2020/12/19 22:52:51 Waiting for index to go active ...
2020/12/19 22:52:52 Index is now active
2020/12/19 22:52:52 Using n1ql client
2020/12/19 22:52:52 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (6.46s)
=== RUN   TestOrphanIndexCleanup
2020-12-19T22:52:52.924+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:45052->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 22:52:52 In DropAllSecondaryIndexes()
2020/12/19 22:52:52 Index found:  id_ageGreaterThan40
2020/12/19 22:52:53 Dropped index id_ageGreaterThan40
2020/12/19 22:52:53 Index found:  index_deferfalse1
2020/12/19 22:52:53 Dropped index index_deferfalse1
2020/12/19 22:52:53 Index found:  index_deferfalse2
2020/12/19 22:52:53 Dropped index index_deferfalse2
2020/12/19 22:53:08 Created the secondary index idx1_age_regular. Waiting for it become active
2020/12/19 22:53:08 Index is now active
2020/12/19 22:53:15 Created the secondary index idx2_company_regular. Waiting for it become active
2020/12/19 22:53:15 Index is now active
2020/12/19 22:53:25 Using n1ql client
2020/12/19 22:53:25 Query on idx1_age_regular is successful
2020/12/19 22:53:25 Using n1ql client
2020/12/19 22:53:25 Query on idx2_company_regular is successful
Restarting indexer process ...
2020/12/19 22:53:25 []
2020-12-19T22:53:25.389+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T22:53:25.389+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T22:53:25.390+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T22:53:25.390+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 22:53:45 Using n1ql client
2020-12-19T22:53:45.189+05:30 [Error] transport error between 127.0.0.1:46780->127.0.0.1:9107: write tcp 127.0.0.1:46780->127.0.0.1:9107: write: broken pipe
2020-12-19T22:53:45.189+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 1857605199727432857 request transport failed `write tcp 127.0.0.1:46780->127.0.0.1:9107: write: broken pipe`
2020-12-19T22:53:45.189+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 22:53:45 Query on idx1_age_regular is successful - after indexer restart.
2020/12/19 22:53:45 Using n1ql client
2020/12/19 22:53:45 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (52.39s)
=== RUN   TestOrphanPartitionCleanup
Not running TestOrphanPartitionCleanup for forestdb
--- PASS: TestOrphanPartitionCleanup (0.00s)
=== RUN   TestIndexerSettings
2020/12/19 22:53:45 In TestIndexerSettings()
2020/12/19 22:53:45 Changing config key indexer.settings.max_cpu_percent to value 300
2020/12/19 22:53:45 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2020/12/19 22:53:45 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2020-12-19T22:53:45.381+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.398+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2020-12-19T22:53:45.417+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.431+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.log_level to value error
2020-12-19T22:53:45.441+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
--- PASS: TestIndexerSettings (0.15s)
=== RUN   TestRestoreDefaultSettings
2020/12/19 22:53:45 In TestIndexerSettings_RestoreDefault()
2020-12-19T22:53:45.470+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.max_cpu_percent to value 0
2020-12-19T22:53:45.477+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.496+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2020-12-19T22:53:45.500+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.520+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2020-12-19T22:53:45.535+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.564+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2020-12-19T22:53:45.581+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.610+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:53:45 Changing config key indexer.settings.log_level to value info
2020-12-19T22:53:45.631+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
--- PASS: TestRestoreDefaultSettings (0.17s)
=== RUN   TestStat_ItemsCount
2020/12/19 22:53:45 In TestStat_ItemsCount()
2020/12/19 22:53:45 In DropAllSecondaryIndexes()
2020/12/19 22:53:45 Index found:  idx1_age_regular
2020-12-19T22:53:45.641+05:30 [Info] DropIndex 3647788255550531293 ...
2020-12-19T22:53:45.651+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:53:45.721+05:30 [Info] metadata provider version changed 1292 -> 1294
2020-12-19T22:53:45.721+05:30 [Info] switched currmeta from 1292 -> 1294 force false 
2020-12-19T22:53:45.721+05:30 [Info] DropIndex 3647788255550531293 - elapsed(80.190339ms), err()
2020/12/19 22:53:45 Dropped index idx1_age_regular
2020/12/19 22:53:45 Index found:  idx2_company_regular
2020-12-19T22:53:45.721+05:30 [Info] DropIndex 10146478539678815893 ...
2020-12-19T22:53:45.844+05:30 [Info] metadata provider version changed 1294 -> 1296
2020-12-19T22:53:45.845+05:30 [Info] switched currmeta from 1294 -> 1296 force false 
2020-12-19T22:53:45.845+05:30 [Info] DropIndex 10146478539678815893 - elapsed(123.10003ms), err()
2020/12/19 22:53:45 Dropped index idx2_company_regular
2020/12/19 22:53:45 Emptying the default bucket
2020-12-19T22:53:45.913+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:45.913+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:45.936+05:30 [Info] switched currmeta from 1288 -> 1292 force true 
2020-12-19T22:53:45.946+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:45.946+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:45.951+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:45.976+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:53:46.068+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:46.068+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:46.073+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:46.073+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:46.087+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:46.087+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:46.149+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:46.149+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:46.150+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:46.150+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:46.152+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:46.155+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:46.645+05:30 [Info] connected with 1 indexers
2020-12-19T22:53:46.645+05:30 [Info] index 6586295070240367245 has replicas [11644093124633183611]: 
2020-12-19T22:53:46.646+05:30 [Info] index 18097166404445147568 has replicas [8252677090771670185]: 
2020-12-19T22:53:46.646+05:30 [Info] index 2437670701397006397 has replicas [3699186301996534827]: 
2020-12-19T22:53:46.646+05:30 [Info] index 6586295070240367245 has equivalents [6586295070240367245]: 
2020-12-19T22:53:46.646+05:30 [Info] index 18097166404445147568 has equivalents [18097166404445147568]: 
2020-12-19T22:53:46.646+05:30 [Info] index 2437670701397006397 has equivalents [2437670701397006397]: 
2020-12-19T22:53:46.646+05:30 [Info] client load stats {"11644093124633183611": 0,"8252677090771670185": 0,"3699186301996534827": 0}
2020-12-19T22:53:46.646+05:30 [Info] client hit stats {"11644093124633183611": 0,"8252677090771670185": 0,"3699186301996534827": 0}
2020-12-19T22:53:46.646+05:30 [Info] client pending item stats {"11644093124633183611": -2,"8252677090771670185": -2,"3699186301996534827": -2}
2020-12-19T22:53:46.646+05:30 [Info] client stats current {"11644093124633183611": true,"8252677090771670185": true,"3699186301996534827": true}
2020-12-19T22:53:48.441+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:53:48.483+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:48.484+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:48.484+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:48.484+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:48.486+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:48.487+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:48.887+05:30 [Info] connected with 1 indexers
2020-12-19T22:53:48.887+05:30 [Info] index 6586295070240367245 has replicas [11644093124633183611]: 
2020-12-19T22:53:48.887+05:30 [Info] index 18097166404445147568 has replicas [8252677090771670185]: 
2020-12-19T22:53:48.887+05:30 [Info] index 2437670701397006397 has replicas [3699186301996534827]: 
2020-12-19T22:53:48.887+05:30 [Info] index 2437670701397006397 has equivalents [2437670701397006397]: 
2020-12-19T22:53:48.887+05:30 [Info] index 6586295070240367245 has equivalents [6586295070240367245]: 
2020-12-19T22:53:48.887+05:30 [Info] index 18097166404445147568 has equivalents [18097166404445147568]: 
2020-12-19T22:53:48.887+05:30 [Info] client load stats {"8252677090771670185": 0,"3699186301996534827": 0,"11644093124633183611": 0}
2020-12-19T22:53:48.887+05:30 [Info] client hit stats {"8252677090771670185": 0,"3699186301996534827": 0,"11644093124633183611": 0}
2020-12-19T22:53:48.887+05:30 [Info] client pending item stats {"3699186301996534827": 9223372036854775807,"11644093124633183611": 9223372036854775807,"8252677090771670185": -2}
2020-12-19T22:53:48.887+05:30 [Info] client stats current {"8252677090771670185": true,"3699186301996534827": true,"11644093124633183611": true}
2020/12/19 22:53:48 Flush Enabled on bucket default, responseBody: 
2020-12-19T22:53:48.998+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:53:49.156+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.156+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.168+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.168+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.183+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:49.184+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:49.638+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:53:49.688+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:53:49.749+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.749+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.760+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.760+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.775+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:49.776+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:49.831+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.831+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.834+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:49.834+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:49.834+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:49.836+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:53:58.153+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:53:58.221+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:58.221+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:58.257+05:30 [Info] switched currmeta from 1292 -> 1292 force true 
2020-12-19T22:53:58.260+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:53:58.260+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:53:58.266+05:30 [Info] switched currmeta from 1296 -> 1296 force true 
2020-12-19T22:54:03.603+05:30 [Info] GSIC[default/default-_default-_default-1608398403528136132] logstats "default" {"gsi_scan_count":10,"gsi_scan_duration":1122470903,"gsi_throttle_duration":17247896,"gsi_prime_duration":457669453,"gsi_blocked_duration":33893744,"gsi_total_temp_files":0}
2020-12-19T22:54:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:54:06.279+05:30 [Info] client load stats {}
2020-12-19T22:54:06.279+05:30 [Info] client hit stats {}
2020-12-19T22:54:06.279+05:30 [Info] client pending item stats {}
2020-12-19T22:54:06.279+05:30 [Info] client stats current {}
2020-12-19T22:54:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:54:06.284+05:30 [Info] average scan response {11 ms}
2020-12-19T22:54:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:54:06.827+05:30 [Info] client load stats {}
2020-12-19T22:54:06.827+05:30 [Info] client hit stats {}
2020-12-19T22:54:06.827+05:30 [Info] client pending item stats {}
2020-12-19T22:54:06.827+05:30 [Info] client stats current {}
2020-12-19T22:54:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:54:06.830+05:30 [Info] average scan response {66 ms}
2020-12-19T22:54:08.351+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:54:08.942+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020/12/19 22:54:27 Flushed the bucket default, Response body: 
2020/12/19 22:54:27 Generating JSON docs
2020/12/19 22:54:28 Setting initial JSON docs in KV
2020/12/19 22:54:33 Creating a 2i
2020-12-19T22:54:33.352+05:30 [Info] CreateIndex default _default _default index_test1 ...
2020-12-19T22:54:33.352+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:54:33.354+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_test1)
2020-12-19T22:54:33.403+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:54:33.799+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:54:33.871+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:54:33.872+05:30 [Info] Score: 0
2020-12-19T22:54:33.872+05:30 [Info] variation: 0
2020-12-19T22:54:33.872+05:30 [Info] ElapsedTime: 54ms
2020-12-19T22:54:33.872+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:54:33.872+05:30 [Info] Iteration: 0
2020-12-19T22:54:33.872+05:30 [Info] Move: 0
2020-12-19T22:54:33.872+05:30 [Info] ----------------------------------------
2020-12-19T22:54:33.872+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:54:33.872+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:54:33.872+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:54:33.872+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:54:33.872+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:54:33.873+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:54:33.873+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:54:33.873+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:54:33.873+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:54:33.873+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:54:33.873+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:54:33.873+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:54:33.873+05:30 [Info] ----------------------------------------
2020-12-19T22:54:33.874+05:30 [Info] Number of indexes: 1
2020-12-19T22:54:33.874+05:30 [Info] Number of indexers: 1
2020-12-19T22:54:33.874+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:54:33.874+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:54:33.874+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:54:33.874+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:54:33.874+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:54:33.874+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:54:33.874+05:30 [Info] ----------------------------------------
2020-12-19T22:54:33.874+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:54:33.875+05:30 [Info] CPU Quota 4
2020-12-19T22:54:33.875+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:54:33.875+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:54:33.875+05:30 [Info] ----------------------------------------
2020-12-19T22:54:33.875+05:30 [Info] Total iteration: 0
2020-12-19T22:54:33.875+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:54:33.875+05:30 [Info] RandomSwap call: 0
2020-12-19T22:54:33.875+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:54:33.875+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:54:33.875+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:54:33.875+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:54:33.875+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:54:33.875+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:54:33.875+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:54:33.875+05:30 [Info] ----------------------------------------
2020-12-19T22:54:33.875+05:30 [Info] 
2020-12-19T22:54:33.875+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:54:33.875+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:54:33.875+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:54:33.875+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:54:33.875+05:30 [Info] 		Index name:index_test1 0, bucket:default, scope:_default, collection:_default, defnId:818374142137535635, instId:3959100902116147115, Partition: 0, new/moved:true
2020-12-19T22:54:33.875+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:54:33.875+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:54:33.875+05:30 [Info] ****************************************
2020-12-19T22:54:33.877+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:54:33.989+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:33.989+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:33.992+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:33.992+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:33.994+05:30 [Info] switched currmeta from 1292 -> 1296 force true 
2020-12-19T22:54:33.995+05:30 [Info] switched currmeta from 1296 -> 1300 force true 
2020-12-19T22:54:34.062+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:34.062+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:34.065+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:34.065+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:34.067+05:30 [Info] switched currmeta from 1296 -> 1297 force true 
2020-12-19T22:54:34.069+05:30 [Info] switched currmeta from 1300 -> 1301 force true 
2020-12-19T22:54:34.211+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:34.211+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:34.216+05:30 [Info] switched currmeta from 1297 -> 1297 force true 
2020-12-19T22:54:34.220+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:34.220+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:34.225+05:30 [Info] switched currmeta from 1301 -> 1301 force true 
2020-12-19T22:54:37.669+05:30 [Info] CreateIndex 818374142137535635 default _default _default/index_test1 using:forestdb exprType:N1QL whereExpr:() secExprs:([`company`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.317261901s) err()
2020/12/19 22:54:37 Created the secondary index index_test1. Waiting for it become active
2020-12-19T22:54:37.669+05:30 [Info] metadata provider version changed 1301 -> 1302
2020-12-19T22:54:37.669+05:30 [Info] switched currmeta from 1301 -> 1302 force false 
2020/12/19 22:54:37 Index is now active
2020-12-19T22:54:37.773+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:37.773+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:37.774+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:37.774+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:37.779+05:30 [Info] switched currmeta from 1302 -> 1302 force true 
2020-12-19T22:54:37.782+05:30 [Info] switched currmeta from 1297 -> 1298 force true 
2020-12-19T22:54:38.511+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:38.690+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:38.691+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:38.700+05:30 [Info] switched currmeta from 1298 -> 1298 force true 
2020-12-19T22:54:38.712+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:38.712+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:38.720+05:30 [Info] switched currmeta from 1302 -> 1302 force true 
2020-12-19T22:54:41.953+05:30 [Info] Rollback time has changed for index inst 2678158626568321743. New rollback time 1608398606173477505
2020-12-19T22:54:41.953+05:30 [Info] Rollback time has changed for index inst 2678158626568321743. New rollback time 1608398606173477505
2020/12/19 22:54:42 items_count stat is 10000
--- PASS: TestStat_ItemsCount (57.06s)
=== RUN   TestRangeArrayIndex_Distinct
2020/12/19 22:54:42 In TestRangeArrayIndex_Distinct()
2020/12/19 22:54:42 In DropAllSecondaryIndexes()
2020/12/19 22:54:42 Index found:  index_test1
2020-12-19T22:54:42.700+05:30 [Info] DropIndex 818374142137535635 ...
2020-12-19T22:54:42.778+05:30 [Info] metadata provider version changed 1302 -> 1304
2020-12-19T22:54:42.778+05:30 [Info] switched currmeta from 1302 -> 1304 force false 
2020-12-19T22:54:42.778+05:30 [Info] DropIndex 818374142137535635 - elapsed(77.758334ms), err()
2020/12/19 22:54:42 Dropped index index_test1
2020-12-19T22:54:42.874+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:54:43.028+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.028+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.035+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:43.044+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.044+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.060+05:30 [Info] switched currmeta from 1298 -> 1300 force true 
2020-12-19T22:54:43.142+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.142+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.149+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:43.173+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.173+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.183+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:43.235+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.235+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.243+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:43.265+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.266+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.274+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:43.481+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:43.554+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.554+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.563+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:43.566+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:43.566+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:43.576+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:43.912+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:44.024+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:44.024+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:44.025+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:44.030+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:44.044+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:44.044+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:44.063+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:44.108+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:44.108+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:44.114+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:44.135+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:44.135+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:44.137+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:48.459+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:48.523+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:48.523+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:48.525+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:48.525+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:48.525+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:48.528+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:54:52.355+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:54:52.455+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:52.455+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:52.461+05:30 [Info] switched currmeta from 1304 -> 1304 force true 
2020-12-19T22:54:52.463+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:54:52.463+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:54:52.467+05:30 [Info] switched currmeta from 1300 -> 1300 force true 
2020-12-19T22:55:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:55:06.279+05:30 [Info] client load stats {}
2020-12-19T22:55:06.279+05:30 [Info] client hit stats {}
2020-12-19T22:55:06.279+05:30 [Info] client pending item stats {}
2020-12-19T22:55:06.279+05:30 [Info] client stats current {}
2020-12-19T22:55:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:55:06.284+05:30 [Info] average scan response {11 ms}
2020-12-19T22:55:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:55:06.827+05:30 [Info] client load stats {}
2020-12-19T22:55:06.827+05:30 [Info] client hit stats {}
2020-12-19T22:55:06.827+05:30 [Info] client pending item stats {}
2020-12-19T22:55:06.827+05:30 [Info] client stats current {}
2020-12-19T22:55:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:55:06.830+05:30 [Info] average scan response {66 ms}
2020-12-19T22:55:08.371+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:55:08.960+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020/12/19 22:55:21 Flushed the bucket default, Response body: 
2020-12-19T22:55:22.857+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2020-12-19T22:55:22.858+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:55:22.859+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends)
2020-12-19T22:55:22.889+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:55:23.290+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:55:23.312+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:55:23.312+05:30 [Info] Score: 0
2020-12-19T22:55:23.312+05:30 [Info] variation: 0
2020-12-19T22:55:23.312+05:30 [Info] ElapsedTime: 5ms
2020-12-19T22:55:23.312+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:55:23.312+05:30 [Info] Iteration: 0
2020-12-19T22:55:23.312+05:30 [Info] Move: 0
2020-12-19T22:55:23.312+05:30 [Info] ----------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:55:23.312+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:55:23.312+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:55:23.312+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:55:23.312+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:55:23.312+05:30 [Info] ----------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] Number of indexes: 1
2020-12-19T22:55:23.312+05:30 [Info] Number of indexers: 1
2020-12-19T22:55:23.312+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:55:23.312+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:55:23.312+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:55:23.312+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:55:23.312+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:55:23.312+05:30 [Info] ----------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:55:23.312+05:30 [Info] CPU Quota 4
2020-12-19T22:55:23.312+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:55:23.312+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:55:23.312+05:30 [Info] ----------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] Total iteration: 0
2020-12-19T22:55:23.312+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:55:23.312+05:30 [Info] RandomSwap call: 0
2020-12-19T22:55:23.312+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:55:23.312+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:55:23.312+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:55:23.312+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:55:23.312+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:55:23.312+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:55:23.312+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:55:23.312+05:30 [Info] ----------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] 
2020-12-19T22:55:23.312+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:55:23.312+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:55:23.312+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:55:23.312+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:55:23.312+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:12271738312728652801, instId:3816906731776507710, Partition: 0, new/moved:true
2020-12-19T22:55:23.312+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:55:23.313+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:55:23.313+05:30 [Info] ****************************************
2020-12-19T22:55:23.313+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:55:23.463+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:23.463+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:23.468+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:23.468+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:23.472+05:30 [Info] switched currmeta from 1300 -> 1305 force true 
2020-12-19T22:55:23.479+05:30 [Info] switched currmeta from 1304 -> 1309 force true 
2020-12-19T22:55:23.548+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:23.548+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:23.551+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:23.551+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:23.553+05:30 [Info] switched currmeta from 1309 -> 1309 force true 
2020-12-19T22:55:23.557+05:30 [Info] switched currmeta from 1305 -> 1305 force true 
2020-12-19T22:55:26.301+05:30 [Info] CreateIndex 12271738312728652801 default _default _default/arridx_friends using:forestdb exprType:N1QL whereExpr:() secExprs:([(distinct (`friends`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.44351896s) err()
2020/12/19 22:55:26 Created the secondary index arridx_friends. Waiting for it become active
2020-12-19T22:55:26.301+05:30 [Info] metadata provider version changed 1309 -> 1310
2020-12-19T22:55:26.301+05:30 [Info] switched currmeta from 1309 -> 1310 force false 
2020/12/19 22:55:26 Index is now active
2020-12-19T22:55:26.317+05:30 [Error] transport error between 127.0.0.1:44952->127.0.0.1:9107: write tcp 127.0.0.1:44952->127.0.0.1:9107: write: broken pipe
2020-12-19T22:55:26.317+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:44952->127.0.0.1:9107: write: broken pipe`
2020-12-19T22:55:26.317+05:30 [Warn] scan failed: requestId  queryport 127.0.0.1:9107 inst 16855177741667866179 partition [0]
2020-12-19T22:55:26.317+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] closing unhealthy connection "127.0.0.1:44952"
2020-12-19T22:55:26.318+05:30 [Warn] Scan failed with error for index 12271738312728652801.  Trying scan again with replica, reqId: :  write tcp 127.0.0.1:44952->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2020-12-19T22:55:26.318+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020-12-19T22:55:26.318+05:30 [Warn] Fail to find indexers to satisfy query request.  Trying scan again for index 12271738312728652801, reqId: :  write tcp 127.0.0.1:44952->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2020-12-19T22:55:26.333+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2020-12-19T22:55:26.377+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:26.377+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:26.382+05:30 [Info] switched currmeta from 1310 -> 1310 force true 
2020-12-19T22:55:26.435+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:26.435+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:26.440+05:30 [Info] switched currmeta from 1305 -> 1306 force true 
2020/12/19 22:55:26 Expected and Actual scan responses are the same
2020-12-19T22:55:28.501+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:55:28.611+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:28.611+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:28.622+05:30 [Info] switched currmeta from 1306 -> 1306 force true 
2020-12-19T22:55:28.625+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:28.625+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:28.631+05:30 [Info] switched currmeta from 1310 -> 1310 force true 
2020/12/19 22:55:28 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (46.12s)
=== RUN   TestUpdateArrayIndex_Distinct
2020/12/19 22:55:28 In TestUpdateArrayIndex_Distinct()
2020/12/19 22:55:28 In DropAllSecondaryIndexes()
2020/12/19 22:55:28 Index found:  arridx_friends
2020-12-19T22:55:28.824+05:30 [Info] DropIndex 12271738312728652801 ...
2020-12-19T22:55:28.914+05:30 [Info] metadata provider version changed 1310 -> 1312
2020-12-19T22:55:28.914+05:30 [Info] switched currmeta from 1310 -> 1312 force false 
2020-12-19T22:55:28.914+05:30 [Info] DropIndex 12271738312728652801 - elapsed(90.163166ms), err()
2020/12/19 22:55:28 Dropped index arridx_friends
2020-12-19T22:55:29.070+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:55:29.099+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.099+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.108+05:30 [Info] switched currmeta from 1306 -> 1308 force true 
2020-12-19T22:55:29.143+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.143+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.174+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:29.290+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.290+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.299+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:55:29.303+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.303+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.319+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:29.376+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.376+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.386+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:55:29.416+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:29.416+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:29.419+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:33.000+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:55:33.107+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:33.107+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:33.110+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:33.110+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:33.114+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:55:33.114+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:33.469+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:55:33.527+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:33.527+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:33.528+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:33.528+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:33.530+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:33.531+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:55:38.209+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:55:38.276+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:38.276+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:38.279+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:38.297+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:38.297+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:38.300+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:55:38.454+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:55:38.546+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:38.546+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:38.547+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:55:38.548+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:55:38.553+05:30 [Info] switched currmeta from 1312 -> 1312 force true 
2020-12-19T22:55:38.559+05:30 [Info] switched currmeta from 1308 -> 1308 force true 
2020-12-19T22:56:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:56:06.279+05:30 [Info] client load stats {}
2020-12-19T22:56:06.279+05:30 [Info] client hit stats {}
2020-12-19T22:56:06.279+05:30 [Info] client pending item stats {}
2020-12-19T22:56:06.279+05:30 [Info] client stats current {}
2020-12-19T22:56:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:56:06.284+05:30 [Info] average scan response {1141 ms}
2020-12-19T22:56:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:56:06.827+05:30 [Info] client load stats {}
2020-12-19T22:56:06.827+05:30 [Info] client hit stats {}
2020-12-19T22:56:06.827+05:30 [Info] client pending item stats {}
2020-12-19T22:56:06.827+05:30 [Info] client stats current {}
2020-12-19T22:56:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:56:06.830+05:30 [Info] average scan response {66 ms}
2020/12/19 22:56:07 Flushed the bucket default, Response body: 
2020-12-19T22:56:08.391+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:56:08.831+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2020-12-19T22:56:08.831+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:56:08.832+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends)
2020-12-19T22:56:08.865+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:56:08.981+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:56:09.222+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:56:09.244+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:56:09.244+05:30 [Info] Score: 0
2020-12-19T22:56:09.245+05:30 [Info] variation: 0
2020-12-19T22:56:09.245+05:30 [Info] ElapsedTime: 4ms
2020-12-19T22:56:09.245+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:56:09.245+05:30 [Info] Iteration: 0
2020-12-19T22:56:09.245+05:30 [Info] Move: 0
2020-12-19T22:56:09.245+05:30 [Info] ----------------------------------------
2020-12-19T22:56:09.245+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:56:09.245+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:56:09.245+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:56:09.245+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:56:09.245+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:56:09.245+05:30 [Info] ----------------------------------------
2020-12-19T22:56:09.245+05:30 [Info] Number of indexes: 1
2020-12-19T22:56:09.245+05:30 [Info] Number of indexers: 1
2020-12-19T22:56:09.245+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:56:09.245+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:56:09.245+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:56:09.245+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:56:09.245+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:56:09.245+05:30 [Info] ----------------------------------------
2020-12-19T22:56:09.245+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:56:09.245+05:30 [Info] CPU Quota 4
2020-12-19T22:56:09.245+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:56:09.245+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:56:09.245+05:30 [Info] ----------------------------------------
2020-12-19T22:56:09.245+05:30 [Info] Total iteration: 0
2020-12-19T22:56:09.245+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:56:09.245+05:30 [Info] RandomSwap call: 0
2020-12-19T22:56:09.245+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:56:09.245+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:56:09.245+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:56:09.245+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:56:09.245+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:56:09.245+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:56:09.245+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:56:09.245+05:30 [Info] ----------------------------------------
2020-12-19T22:56:09.245+05:30 [Info] 
2020-12-19T22:56:09.245+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:56:09.245+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:56:09.246+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:56:09.246+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:56:09.246+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:16292938884451310787, instId:11950060105343046068, Partition: 0, new/moved:true
2020-12-19T22:56:09.246+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:56:09.246+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:56:09.246+05:30 [Info] ****************************************
2020-12-19T22:56:09.246+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:56:09.414+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:09.414+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:09.419+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:09.419+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:09.421+05:30 [Info] switched currmeta from 1308 -> 1313 force true 
2020-12-19T22:56:09.445+05:30 [Info] switched currmeta from 1312 -> 1317 force true 
2020-12-19T22:56:09.508+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:09.508+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:09.512+05:30 [Info] switched currmeta from 1313 -> 1313 force true 
2020-12-19T22:56:09.514+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:09.514+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:09.517+05:30 [Info] switched currmeta from 1317 -> 1317 force true 
2020-12-19T22:56:12.228+05:30 [Info] CreateIndex 16292938884451310787 default _default _default/arridx_friends using:forestdb exprType:N1QL whereExpr:() secExprs:([(distinct (`friends`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.39745199s) err()
2020/12/19 22:56:12 Created the secondary index arridx_friends. Waiting for it become active
2020-12-19T22:56:12.228+05:30 [Info] metadata provider version changed 1317 -> 1318
2020-12-19T22:56:12.228+05:30 [Info] switched currmeta from 1317 -> 1318 force false 
2020/12/19 22:56:12 Index is now active
2020-12-19T22:56:12.340+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:12.340+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:12.344+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:12.344+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:12.346+05:30 [Info] switched currmeta from 1313 -> 1314 force true 
2020-12-19T22:56:12.350+05:30 [Info] switched currmeta from 1318 -> 1318 force true 
2020/12/19 22:56:12 Expected and Actual scan responses are the same
2020-12-19T22:56:13.505+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:13.598+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:13.598+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:13.605+05:30 [Info] switched currmeta from 1318 -> 1318 force true 
2020-12-19T22:56:13.609+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:13.609+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:13.614+05:30 [Info] switched currmeta from 1314 -> 1314 force true 
2020/12/19 22:56:15 Expected and Actual scan responses are the same
2020/12/19 22:56:15 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (46.68s)
=== RUN   TestRangeArrayIndex_Duplicate
2020/12/19 22:56:15 In TestRangeArrayIndex_Duplicate()
2020/12/19 22:56:15 In DropAllSecondaryIndexes()
2020/12/19 22:56:15 Index found:  arridx_friends
2020-12-19T22:56:15.504+05:30 [Info] DropIndex 16292938884451310787 ...
2020-12-19T22:56:15.635+05:30 [Info] metadata provider version changed 1318 -> 1320
2020-12-19T22:56:15.636+05:30 [Info] switched currmeta from 1318 -> 1320 force false 
2020-12-19T22:56:15.636+05:30 [Info] DropIndex 16292938884451310787 - elapsed(131.374437ms), err()
2020/12/19 22:56:15 Dropped index arridx_friends
2020-12-19T22:56:15.683+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:15.684+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:15.684+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:15.685+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:15.722+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:15.731+05:30 [Info] switched currmeta from 1314 -> 1316 force true 
2020-12-19T22:56:15.769+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:56:15.875+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:15.875+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:15.887+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020-12-19T22:56:15.901+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:15.901+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:15.936+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:16.069+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:16.069+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:16.076+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020-12-19T22:56:16.087+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:16.087+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:16.093+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:18.488+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:18.535+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:18.535+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:18.539+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020-12-19T22:56:18.545+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:18.545+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:18.548+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:18.948+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:19.048+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:19.048+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:19.057+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:19.057+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:19.058+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:19.062+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020-12-19T22:56:19.184+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:19.284+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:19.284+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:19.288+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:19.295+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:19.295+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:19.300+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020-12-19T22:56:24.019+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:24.088+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:24.088+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:24.094+05:30 [Info] switched currmeta from 1320 -> 1320 force true 
2020-12-19T22:56:24.105+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:24.105+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:24.118+05:30 [Info] switched currmeta from 1316 -> 1316 force true 
2020/12/19 22:56:53 Flushed the bucket default, Response body: 
2020-12-19T22:56:54.604+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2020-12-19T22:56:54.605+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:56:54.605+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends)
2020-12-19T22:56:54.637+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:56:54.993+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:56:55.013+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:56:55.013+05:30 [Info] Score: 0
2020-12-19T22:56:55.013+05:30 [Info] variation: 0
2020-12-19T22:56:55.013+05:30 [Info] ElapsedTime: 4ms
2020-12-19T22:56:55.013+05:30 [Info] ConvergenceTime: 3us
2020-12-19T22:56:55.013+05:30 [Info] Iteration: 0
2020-12-19T22:56:55.013+05:30 [Info] Move: 0
2020-12-19T22:56:55.013+05:30 [Info] ----------------------------------------
2020-12-19T22:56:55.013+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:56:55.013+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:56:55.013+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:56:55.013+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:56:55.013+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:56:55.013+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:56:55.013+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:56:55.013+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:56:55.013+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:56:55.014+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:56:55.014+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:56:55.014+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:56:55.014+05:30 [Info] ----------------------------------------
2020-12-19T22:56:55.014+05:30 [Info] Number of indexes: 1
2020-12-19T22:56:55.014+05:30 [Info] Number of indexers: 1
2020-12-19T22:56:55.014+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:56:55.014+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:56:55.014+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:56:55.014+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:56:55.014+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:56:55.014+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:56:55.014+05:30 [Info] ----------------------------------------
2020-12-19T22:56:55.014+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:56:55.014+05:30 [Info] CPU Quota 4
2020-12-19T22:56:55.014+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:56:55.014+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:56:55.014+05:30 [Info] ----------------------------------------
2020-12-19T22:56:55.014+05:30 [Info] Total iteration: 0
2020-12-19T22:56:55.014+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:56:55.014+05:30 [Info] RandomSwap call: 0
2020-12-19T22:56:55.014+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:56:55.014+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:56:55.014+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:56:55.014+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:56:55.014+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:56:55.014+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:56:55.014+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:56:55.014+05:30 [Info] ----------------------------------------
2020-12-19T22:56:55.014+05:30 [Info] 
2020-12-19T22:56:55.014+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:56:55.014+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:56:55.014+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:56:55.014+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:56:55.014+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:7300836582240857966, instId:9887611884855768787, Partition: 0, new/moved:true
2020-12-19T22:56:55.014+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:56:55.014+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:56:55.014+05:30 [Info] ****************************************
2020-12-19T22:56:55.014+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:56:55.142+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:55.142+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:55.150+05:30 [Info] switched currmeta from 1320 -> 1324 force true 
2020-12-19T22:56:55.161+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:55.161+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:55.180+05:30 [Info] switched currmeta from 1316 -> 1321 force true 
2020-12-19T22:56:55.283+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:55.283+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:55.288+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:55.288+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:55.290+05:30 [Info] switched currmeta from 1324 -> 1325 force true 
2020-12-19T22:56:55.292+05:30 [Info] switched currmeta from 1321 -> 1321 force true 
2020-12-19T22:56:55.326+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:55.326+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:55.331+05:30 [Info] switched currmeta from 1325 -> 1325 force true 
2020-12-19T22:56:58.025+05:30 [Info] CreateIndex 7300836582240857966 default _default _default/arridx_friends using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`friends`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.421001281s) err()
2020/12/19 22:56:58 Created the secondary index arridx_friends. Waiting for it become active
2020-12-19T22:56:58.025+05:30 [Info] metadata provider version changed 1325 -> 1326
2020-12-19T22:56:58.025+05:30 [Info] switched currmeta from 1325 -> 1326 force false 
2020/12/19 22:56:58 Index is now active
2020-12-19T22:56:58.140+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:58.140+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:58.144+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:58.144+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:58.146+05:30 [Info] switched currmeta from 1321 -> 1322 force true 
2020-12-19T22:56:58.148+05:30 [Info] switched currmeta from 1326 -> 1326 force true 
2020/12/19 22:56:58 Expected and Actual scan responses are the same
2020-12-19T22:56:58.499+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:56:58.552+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:58.552+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:58.557+05:30 [Info] switched currmeta from 1322 -> 1322 force true 
2020-12-19T22:56:58.563+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:56:58.563+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:56:58.565+05:30 [Info] switched currmeta from 1326 -> 1326 force true 
2020/12/19 22:57:00 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (45.04s)
=== RUN   TestUpdateArrayIndex_Duplicate
2020/12/19 22:57:00 In TestUpdateArrayIndex_Duplicate()
2020/12/19 22:57:00 In DropAllSecondaryIndexes()
2020/12/19 22:57:00 Index found:  arridx_friends
2020-12-19T22:57:00.544+05:30 [Info] DropIndex 7300836582240857966 ...
2020-12-19T22:57:00.606+05:30 [Info] metadata provider version changed 1326 -> 1328
2020-12-19T22:57:00.606+05:30 [Info] switched currmeta from 1326 -> 1328 force false 
2020-12-19T22:57:00.606+05:30 [Info] DropIndex 7300836582240857966 - elapsed(62.746849ms), err()
2020/12/19 22:57:00 Dropped index arridx_friends
2020-12-19T22:57:00.746+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:57:00.875+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:00.875+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:00.885+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020-12-19T22:57:00.902+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:00.902+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:00.909+05:30 [Info] switched currmeta from 1322 -> 1324 force true 
2020-12-19T22:57:01.016+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:01.017+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:01.026+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020-12-19T22:57:01.056+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:01.056+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:01.066+05:30 [Info] switched currmeta from 1324 -> 1324 force true 
2020-12-19T22:57:01.104+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:01.104+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:01.113+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020-12-19T22:57:01.135+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:01.135+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:01.146+05:30 [Info] switched currmeta from 1324 -> 1324 force true 
2020-12-19T22:57:03.498+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:03.557+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:03.557+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:03.560+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:03.560+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:03.560+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020-12-19T22:57:03.563+05:30 [Info] switched currmeta from 1324 -> 1324 force true 
2020-12-19T22:57:04.621+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:04.707+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:04.707+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:04.709+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:04.709+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:04.712+05:30 [Info] switched currmeta from 1324 -> 1324 force true 
2020-12-19T22:57:04.713+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020-12-19T22:57:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:57:06.279+05:30 [Info] client load stats {}
2020-12-19T22:57:06.279+05:30 [Info] client hit stats {}
2020-12-19T22:57:06.279+05:30 [Info] client pending item stats {}
2020-12-19T22:57:06.279+05:30 [Info] client stats current {}
2020-12-19T22:57:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:57:06.284+05:30 [Info] average scan response {1282 ms}
2020-12-19T22:57:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:57:06.827+05:30 [Info] client load stats {}
2020-12-19T22:57:06.827+05:30 [Info] client hit stats {}
2020-12-19T22:57:06.827+05:30 [Info] client pending item stats {}
2020-12-19T22:57:06.827+05:30 [Info] client stats current {}
2020-12-19T22:57:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:57:06.830+05:30 [Info] average scan response {66 ms}
2020-12-19T22:57:08.409+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:57:09.001+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:57:09.830+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:09.902+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:09.902+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:09.906+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:09.906+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:09.907+05:30 [Info] switched currmeta from 1324 -> 1324 force true 
2020-12-19T22:57:09.934+05:30 [Info] switched currmeta from 1328 -> 1328 force true 
2020/12/19 22:57:39 Flushed the bucket default, Response body: 
2020-12-19T22:57:40.372+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2020-12-19T22:57:40.372+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:57:40.373+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends)
2020-12-19T22:57:40.415+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:57:40.780+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:57:40.806+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:57:40.806+05:30 [Info] Score: 0
2020-12-19T22:57:40.806+05:30 [Info] variation: 0
2020-12-19T22:57:40.806+05:30 [Info] ElapsedTime: 5ms
2020-12-19T22:57:40.806+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:57:40.806+05:30 [Info] Iteration: 0
2020-12-19T22:57:40.806+05:30 [Info] Move: 0
2020-12-19T22:57:40.806+05:30 [Info] ----------------------------------------
2020-12-19T22:57:40.806+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:57:40.806+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:57:40.806+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:57:40.806+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:57:40.806+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:40.806+05:30 [Info] ----------------------------------------
2020-12-19T22:57:40.806+05:30 [Info] Number of indexes: 1
2020-12-19T22:57:40.806+05:30 [Info] Number of indexers: 1
2020-12-19T22:57:40.806+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:57:40.806+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:57:40.806+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:57:40.806+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:57:40.806+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:57:40.806+05:30 [Info] ----------------------------------------
2020-12-19T22:57:40.806+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:57:40.806+05:30 [Info] CPU Quota 4
2020-12-19T22:57:40.806+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:57:40.806+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:57:40.806+05:30 [Info] ----------------------------------------
2020-12-19T22:57:40.806+05:30 [Info] Total iteration: 0
2020-12-19T22:57:40.806+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:57:40.806+05:30 [Info] RandomSwap call: 0
2020-12-19T22:57:40.807+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:57:40.807+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:57:40.807+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:57:40.807+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:57:40.807+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:57:40.807+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:57:40.807+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:57:40.807+05:30 [Info] ----------------------------------------
2020-12-19T22:57:40.807+05:30 [Info] 
2020-12-19T22:57:40.807+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:57:40.807+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:57:40.807+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:57:40.807+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:40.807+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:15672085431222022279, instId:15425460334175455924, Partition: 0, new/moved:true
2020-12-19T22:57:40.807+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:40.807+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:40.807+05:30 [Info] ****************************************
2020-12-19T22:57:40.807+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:57:40.906+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:40.906+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:40.910+05:30 [Info] switched currmeta from 1324 -> 1328 force true 
2020-12-19T22:57:40.916+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:40.917+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:40.920+05:30 [Info] switched currmeta from 1328 -> 1332 force true 
2020-12-19T22:57:40.996+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:40.996+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:41.001+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:41.001+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:41.003+05:30 [Info] switched currmeta from 1328 -> 1329 force true 
2020-12-19T22:57:41.005+05:30 [Info] switched currmeta from 1332 -> 1333 force true 
2020-12-19T22:57:41.088+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:41.088+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:41.089+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:41.089+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:41.093+05:30 [Info] switched currmeta from 1333 -> 1333 force true 
2020-12-19T22:57:41.093+05:30 [Info] switched currmeta from 1329 -> 1329 force true 
2020-12-19T22:57:43.514+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:43.620+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:43.620+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:43.625+05:30 [Info] switched currmeta from 1333 -> 1333 force true 
2020-12-19T22:57:43.639+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:43.639+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:43.642+05:30 [Info] switched currmeta from 1329 -> 1329 force true 
2020-12-19T22:57:43.808+05:30 [Info] CreateIndex 15672085431222022279 default _default _default/arridx_friends using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`friends`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.436812171s) err()
2020/12/19 22:57:43 Created the secondary index arridx_friends. Waiting for it become active
2020-12-19T22:57:43.809+05:30 [Info] metadata provider version changed 1333 -> 1334
2020-12-19T22:57:43.809+05:30 [Info] switched currmeta from 1333 -> 1334 force false 
2020/12/19 22:57:43 Index is now active
2020-12-19T22:57:43.887+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:43.887+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:43.902+05:30 [Info] switched currmeta from 1329 -> 1330 force true 
2020-12-19T22:57:43.907+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:43.907+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:43.913+05:30 [Info] switched currmeta from 1334 -> 1334 force true 
2020/12/19 22:57:43 Expected and Actual scan responses are the same
2020/12/19 22:57:46 Expected and Actual scan responses are the same
2020-12-19T22:57:46.953+05:30 [Info] Rollback time has changed for index inst 14457290168276994881. New rollback time 1608398606173477505
2020-12-19T22:57:46.953+05:30 [Info] Rollback time has changed for index inst 14457290168276994881. New rollback time 1608398606173477505
2020/12/19 22:57:47 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (46.69s)
=== RUN   TestArrayIndexCornerCases
2020/12/19 22:57:47 In TestArrayIndexCornerCases()
2020-12-19T22:57:47.230+05:30 [Info] CreateIndex default _default _default arr_single ...
2020-12-19T22:57:47.230+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:57:47.231+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arr_single)
2020-12-19T22:57:47.269+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:57:47.664+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:57:47.688+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:57:47.688+05:30 [Info] Score: 0
2020-12-19T22:57:47.688+05:30 [Info] variation: 0
2020-12-19T22:57:47.688+05:30 [Info] ElapsedTime: 6ms
2020-12-19T22:57:47.688+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:57:47.688+05:30 [Info] Iteration: 0
2020-12-19T22:57:47.688+05:30 [Info] Move: 0
2020-12-19T22:57:47.688+05:30 [Info] ----------------------------------------
2020-12-19T22:57:47.688+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:57:47.688+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:57:47.688+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:57:47.688+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:57:47.688+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:57:47.688+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:57:47.688+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Data Size Mean 1259066236 (1.1726G)
2020-12-19T22:57:47.688+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:57:47.688+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:57:47.688+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:47.688+05:30 [Info] ----------------------------------------
2020-12-19T22:57:47.688+05:30 [Info] Number of indexes: 2
2020-12-19T22:57:47.688+05:30 [Info] Number of indexers: 1
2020-12-19T22:57:47.688+05:30 [Info] Avg Index Size: 629145600 (600M)
2020-12-19T22:57:47.689+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:57:47.689+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:57:47.689+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:57:47.689+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:57:47.689+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:57:47.689+05:30 [Info] ----------------------------------------
2020-12-19T22:57:47.689+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:57:47.689+05:30 [Info] CPU Quota 4
2020-12-19T22:57:47.689+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:57:47.689+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:57:47.689+05:30 [Info] ----------------------------------------
2020-12-19T22:57:47.689+05:30 [Info] Total iteration: 0
2020-12-19T22:57:47.689+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:57:47.689+05:30 [Info] RandomSwap call: 0
2020-12-19T22:57:47.689+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:57:47.689+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:57:47.689+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:57:47.689+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:57:47.689+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:57:47.689+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:57:47.689+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:57:47.689+05:30 [Info] ----------------------------------------
2020-12-19T22:57:47.689+05:30 [Info] 
2020-12-19T22:57:47.689+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:57:47.689+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258446207 (1.17202G), data:1259066236 (1.1726G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2020-12-19T22:57:47.689+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:57:47.689+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:47.689+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:15672085431222022279, instId:14457290168276994881, Partition: 0, new/moved:false
2020-12-19T22:57:47.689+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:155007 (151.374K), data:775036 (756.871K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:47.689+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:47.689+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:47.689+05:30 [Info] 		Index name:arr_single 0, bucket:default, scope:_default, collection:_default, defnId:13220774823671077312, instId:3117760063441349646, Partition: 0, new/moved:true
2020-12-19T22:57:47.689+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:47.689+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:47.689+05:30 [Info] ****************************************
2020-12-19T22:57:47.689+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:57:47.765+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.765+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.769+05:30 [Info] switched currmeta from 1330 -> 1334 force true 
2020-12-19T22:57:47.787+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.787+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.798+05:30 [Info] switched currmeta from 1334 -> 1338 force true 
2020-12-19T22:57:47.851+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.851+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.868+05:30 [Info] switched currmeta from 1334 -> 1335 force true 
2020-12-19T22:57:47.924+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.924+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.926+05:30 [Info] switched currmeta from 1338 -> 1339 force true 
2020-12-19T22:57:47.936+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.936+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.942+05:30 [Info] switched currmeta from 1335 -> 1335 force true 
2020-12-19T22:57:47.964+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:47.964+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:47.966+05:30 [Info] switched currmeta from 1339 -> 1339 force true 
2020-12-19T22:57:48.582+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:48.702+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:48.702+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:48.712+05:30 [Info] switched currmeta from 1335 -> 1335 force true 
2020-12-19T22:57:48.719+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:48.719+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:48.725+05:30 [Info] switched currmeta from 1339 -> 1339 force true 
2020-12-19T22:57:50.506+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:50.506+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:50.510+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:50.510+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:50.513+05:30 [Info] switched currmeta from 1339 -> 1340 force true 
2020-12-19T22:57:50.515+05:30 [Info] switched currmeta from 1335 -> 1336 force true 
2020-12-19T22:57:51.327+05:30 [Info] CreateIndex 13220774823671077312 default _default _default/arr_single using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`arr_tags`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.097277473s) err()
2020/12/19 22:57:51 Created the secondary index arr_single. Waiting for it become active
2020-12-19T22:57:51.327+05:30 [Info] metadata provider version changed 1340 -> 1341
2020-12-19T22:57:51.327+05:30 [Info] switched currmeta from 1340 -> 1341 force false 
2020/12/19 22:57:51 Index is now active
2020-12-19T22:57:51.328+05:30 [Info] CreateIndex default _default _default arr_leading ...
2020-12-19T22:57:51.329+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:57:51.335+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arr_leading)
2020-12-19T22:57:51.410+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:51.410+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:51.423+05:30 [Info] switched currmeta from 1341 -> 1341 force true 
2020-12-19T22:57:51.442+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:51.443+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:51.449+05:30 [Info] switched currmeta from 1336 -> 1337 force true 
2020-12-19T22:57:51.461+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:57:51.938+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:57:51.952+05:30 [Info] Rollback time has changed for index inst 15739457497072586650. New rollback time 1608398606173477505
2020-12-19T22:57:51.952+05:30 [Info] Rollback time has changed for index inst 15739457497072586650. New rollback time 1608398606173477505
2020-12-19T22:57:51.961+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:57:51.961+05:30 [Info] Score: 0
2020-12-19T22:57:51.961+05:30 [Info] variation: 0
2020-12-19T22:57:51.961+05:30 [Info] ElapsedTime: 5ms
2020-12-19T22:57:51.961+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:57:51.961+05:30 [Info] Iteration: 0
2020-12-19T22:57:51.961+05:30 [Info] Move: 0
2020-12-19T22:57:51.961+05:30 [Info] ----------------------------------------
2020-12-19T22:57:51.961+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:57:51.961+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:57:51.961+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:57:51.961+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:57:51.961+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:57:51.961+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:57:51.961+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Data Size Mean 1258992037 (1.17253G)
2020-12-19T22:57:51.961+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:57:51.961+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:57:51.961+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:51.961+05:30 [Info] ----------------------------------------
2020-12-19T22:57:51.962+05:30 [Info] Number of indexes: 3
2020-12-19T22:57:51.962+05:30 [Info] Number of indexers: 1
2020-12-19T22:57:51.962+05:30 [Info] Avg Index Size: 419430400 (400M)
2020-12-19T22:57:51.962+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:57:51.962+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:57:51.962+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:57:51.962+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:57:51.962+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:57:51.962+05:30 [Info] ----------------------------------------
2020-12-19T22:57:51.962+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:57:51.962+05:30 [Info] CPU Quota 4
2020-12-19T22:57:51.962+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:57:51.962+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:57:51.962+05:30 [Info] ----------------------------------------
2020-12-19T22:57:51.962+05:30 [Info] Total iteration: 0
2020-12-19T22:57:51.962+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:57:51.962+05:30 [Info] RandomSwap call: 0
2020-12-19T22:57:51.962+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:57:51.962+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:57:51.962+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:57:51.962+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:57:51.962+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:57:51.962+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:57:51.962+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:57:51.962+05:30 [Info] ----------------------------------------
2020-12-19T22:57:51.962+05:30 [Info] 
2020-12-19T22:57:51.962+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:57:51.962+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258424842 (1.172G), data:1258992037 (1.17253G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:3
2020-12-19T22:57:51.962+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:57:51.962+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:51.962+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:15672085431222022279, instId:14457290168276994881, Partition: 0, new/moved:false
2020-12-19T22:57:51.962+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:133642 (130.51K), data:668211 (652.55K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:51.962+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:51.962+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:51.963+05:30 [Info] 		Index name:arr_single 0, bucket:default, scope:_default, collection:_default, defnId:13220774823671077312, instId:15739457497072586650, Partition: 0, new/moved:false
2020-12-19T22:57:51.963+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:32626 (31.8613K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:51.963+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:51.963+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:51.963+05:30 [Info] 		Index name:arr_leading 0, bucket:default, scope:_default, collection:_default, defnId:17222877853755111150, instId:14145036928211986776, Partition: 0, new/moved:true
2020-12-19T22:57:51.963+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:51.963+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:51.963+05:30 [Info] ****************************************
2020-12-19T22:57:51.963+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:57:52.068+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:52.068+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:52.074+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:52.074+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:52.090+05:30 [Info] switched currmeta from 1341 -> 1345 force true 
2020-12-19T22:57:52.097+05:30 [Info] switched currmeta from 1337 -> 1342 force true 
2020-12-19T22:57:52.194+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:52.194+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:52.199+05:30 [Info] switched currmeta from 1345 -> 1346 force true 
2020-12-19T22:57:52.205+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:52.205+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:52.211+05:30 [Info] switched currmeta from 1342 -> 1342 force true 
2020-12-19T22:57:52.255+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:52.255+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:52.267+05:30 [Info] switched currmeta from 1346 -> 1346 force true 
2020-12-19T22:57:53.515+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:53.570+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:53.570+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:53.571+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:53.571+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:53.573+05:30 [Info] switched currmeta from 1346 -> 1346 force true 
2020-12-19T22:57:53.574+05:30 [Info] switched currmeta from 1342 -> 1342 force true 
2020-12-19T22:57:54.708+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:54.708+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:54.724+05:30 [Info] switched currmeta from 1346 -> 1347 force true 
2020-12-19T22:57:54.734+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:54.734+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:54.738+05:30 [Info] switched currmeta from 1342 -> 1343 force true 
2020-12-19T22:57:55.588+05:30 [Info] CreateIndex 17222877853755111150 default _default _default/arr_leading using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`arr_tags`)) `arr_name`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.260682721s) err()
2020/12/19 22:57:55 Created the secondary index arr_leading. Waiting for it become active
2020-12-19T22:57:55.589+05:30 [Info] metadata provider version changed 1347 -> 1348
2020-12-19T22:57:55.589+05:30 [Info] switched currmeta from 1347 -> 1348 force false 
2020/12/19 22:57:55 Index is now active
2020-12-19T22:57:55.589+05:30 [Info] CreateIndex default _default _default arr_nonleading ...
2020-12-19T22:57:55.590+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:57:55.591+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arr_nonleading)
2020-12-19T22:57:55.700+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:55.700+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:55.711+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:55.711+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:55.711+05:30 [Info] switched currmeta from 1343 -> 1344 force true 
2020-12-19T22:57:55.725+05:30 [Info] switched currmeta from 1348 -> 1348 force true 
2020-12-19T22:57:55.740+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:57:56.144+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:57:56.165+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:57:56.165+05:30 [Info] Score: 0
2020-12-19T22:57:56.165+05:30 [Info] variation: 0
2020-12-19T22:57:56.165+05:30 [Info] ElapsedTime: 4ms
2020-12-19T22:57:56.165+05:30 [Info] ConvergenceTime: 3us
2020-12-19T22:57:56.165+05:30 [Info] Iteration: 0
2020-12-19T22:57:56.165+05:30 [Info] Move: 0
2020-12-19T22:57:56.165+05:30 [Info] ----------------------------------------
2020-12-19T22:57:56.165+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:57:56.165+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Data Size Mean 1259024727 (1.17256G)
2020-12-19T22:57:56.165+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:57:56.165+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:57:56.165+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:57:56.165+05:30 [Info] ----------------------------------------
2020-12-19T22:57:56.165+05:30 [Info] Number of indexes: 4
2020-12-19T22:57:56.165+05:30 [Info] Number of indexers: 1
2020-12-19T22:57:56.165+05:30 [Info] Avg Index Size: 314572800 (300M)
2020-12-19T22:57:56.165+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:57:56.165+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:57:56.165+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:57:56.165+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:57:56.165+05:30 [Info] ----------------------------------------
2020-12-19T22:57:56.165+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:57:56.165+05:30 [Info] CPU Quota 4
2020-12-19T22:57:56.165+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:57:56.165+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:57:56.165+05:30 [Info] ----------------------------------------
2020-12-19T22:57:56.165+05:30 [Info] Total iteration: 0
2020-12-19T22:57:56.165+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:57:56.165+05:30 [Info] RandomSwap call: 0
2020-12-19T22:57:56.165+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:57:56.165+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:57:56.165+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:57:56.165+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:57:56.165+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:57:56.165+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:57:56.165+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:57:56.165+05:30 [Info] ----------------------------------------
2020-12-19T22:57:56.165+05:30 [Info] 
2020-12-19T22:57:56.166+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:57:56.166+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258424842 (1.172G), data:1259024727 (1.17256G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2020-12-19T22:57:56.166+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:57:56.166+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:56.166+05:30 [Info] 		Index name:arr_single 0, bucket:default, scope:_default, collection:_default, defnId:13220774823671077312, instId:15739457497072586650, Partition: 0, new/moved:false
2020-12-19T22:57:56.166+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:32626 (31.8613K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:56.166+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:56.166+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:56.166+05:30 [Info] 		Index name:arr_leading 0, bucket:default, scope:_default, collection:_default, defnId:17222877853755111150, instId:7362971479032513711, Partition: 0, new/moved:false
2020-12-19T22:57:56.166+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:32690 (31.9238K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:56.166+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:56.166+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:56.166+05:30 [Info] 		Index name:arridx_friends 0, bucket:default, scope:_default, collection:_default, defnId:15672085431222022279, instId:14457290168276994881, Partition: 0, new/moved:false
2020-12-19T22:57:56.166+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:133642 (130.51K), data:668211 (652.55K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:56.166+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:56.166+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:57:56.166+05:30 [Info] 		Index name:arr_nonleading 0, bucket:default, scope:_default, collection:_default, defnId:4162949770900554765, instId:3018395582869303590, Partition: 0, new/moved:true
2020-12-19T22:57:56.166+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:57:56.166+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:57:56.166+05:30 [Info] ****************************************
2020-12-19T22:57:56.166+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:57:56.266+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:56.266+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:56.278+05:30 [Info] switched currmeta from 1348 -> 1353 force true 
2020-12-19T22:57:56.290+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:56.290+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:56.293+05:30 [Info] switched currmeta from 1344 -> 1349 force true 
2020-12-19T22:57:56.422+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:56.422+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:56.441+05:30 [Info] switched currmeta from 1353 -> 1353 force true 
2020-12-19T22:57:56.468+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:56.468+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:56.472+05:30 [Info] switched currmeta from 1349 -> 1349 force true 
2020-12-19T22:57:56.953+05:30 [Info] Rollback time has changed for index inst 7362971479032513711. New rollback time 1608398606173477505
2020-12-19T22:57:56.953+05:30 [Info] Rollback time has changed for index inst 7362971479032513711. New rollback time 1608398606173477505
2020-12-19T22:57:58.540+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:57:58.654+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:58.654+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:58.654+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:58.654+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:58.667+05:30 [Info] switched currmeta from 1349 -> 1349 force true 
2020-12-19T22:57:58.670+05:30 [Info] switched currmeta from 1353 -> 1353 force true 
2020-12-19T22:57:58.897+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:58.897+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:58.902+05:30 [Info] switched currmeta from 1349 -> 1350 force true 
2020-12-19T22:57:58.906+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:58.906+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:58.909+05:30 [Info] switched currmeta from 1353 -> 1354 force true 
2020-12-19T22:57:59.723+05:30 [Info] CreateIndex 4162949770900554765 default _default _default/arr_nonleading using:forestdb exprType:N1QL whereExpr:() secExprs:([`arr_name` (all (`arr_tags`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.133500417s) err()
2020/12/19 22:57:59 Created the secondary index arr_nonleading. Waiting for it become active
2020-12-19T22:57:59.723+05:30 [Info] metadata provider version changed 1354 -> 1355
2020-12-19T22:57:59.723+05:30 [Info] switched currmeta from 1354 -> 1355 force false 
2020/12/19 22:57:59 Index is now active
2020/12/19 22:57:59 

--------ScanAll for EMPTY array--------
2020-12-19T22:57:59.835+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:59.835+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:59.844+05:30 [Info] switched currmeta from 1355 -> 1355 force true 
2020-12-19T22:57:59.851+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:57:59.851+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:57:59.853+05:30 [Info] switched currmeta from 1350 -> 1351 force true 
2020/12/19 22:57:59 Count of scanResults is 0
2020/12/19 22:57:59 Count of scanResults is 0
2020/12/19 22:57:59 Count of scanResults is 1
2020/12/19 22:57:59 Key: string -9146972445409639521  Value: value.Values ["KZcTz" Missing field or index.] false
2020/12/19 22:57:59 Expected and Actual scan responses are the same
2020/12/19 22:57:59 

--------ScanAll for MISSING array--------
2020/12/19 22:58:00 Count of scanResults is 0
2020/12/19 22:58:00 Count of scanResults is 0
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["v6XKna" Missing field or index.] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 

--------ScanAll for NULL array--------
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values [null] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values [null "RIOvT"] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["RIOvT" null] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 

--------ScanAll for SCALARVALUE array--------
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["IamScalar"] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["IamScalar" "oQAl3"] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["oQAl3" "IamScalar"] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 

--------ScanAll for SCALAROBJECT array--------
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values [{"1":"abc","2":"def"}] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values [{"1":"abc","2":"def"} "6PSNo"] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
2020/12/19 22:58:00 Count of scanResults is 1
2020/12/19 22:58:00 Key: string -9146972445409639521  Value: value.Values ["6PSNo" {"1":"abc","2":"def"}] false
2020/12/19 22:58:00 Expected and Actual scan responses are the same
--- PASS: TestArrayIndexCornerCases (13.48s)
=== RUN   TestArraySizeIncreaseDecrease1
2020/12/19 22:58:00 In TestArraySizeIncreaseDecrease1()
2020/12/19 22:58:00 In DropAllSecondaryIndexes()
2020/12/19 22:58:00 Index found:  arr_single
2020-12-19T22:58:00.707+05:30 [Info] DropIndex 13220774823671077312 ...
2020-12-19T22:58:00.761+05:30 [Info] metadata provider version changed 1355 -> 1357
2020-12-19T22:58:00.761+05:30 [Info] switched currmeta from 1355 -> 1357 force false 
2020-12-19T22:58:00.761+05:30 [Info] DropIndex 13220774823671077312 - elapsed(54.619234ms), err()
2020/12/19 22:58:00 Dropped index arr_single
2020/12/19 22:58:00 Index found:  arr_nonleading
2020-12-19T22:58:00.761+05:30 [Info] DropIndex 4162949770900554765 ...
2020-12-19T22:58:00.909+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:00.909+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:00.913+05:30 [Info] metadata provider version changed 1357 -> 1359
2020-12-19T22:58:00.913+05:30 [Info] switched currmeta from 1357 -> 1359 force false 
2020-12-19T22:58:00.913+05:30 [Info] DropIndex 4162949770900554765 - elapsed(152.108754ms), err()
2020/12/19 22:58:00 Dropped index arr_nonleading
2020/12/19 22:58:00 Index found:  arr_leading
2020-12-19T22:58:00.913+05:30 [Info] DropIndex 17222877853755111150 ...
2020-12-19T22:58:00.920+05:30 [Info] switched currmeta from 1351 -> 1355 force true 
2020-12-19T22:58:00.927+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:00.927+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:00.947+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:01.007+05:30 [Info] metadata provider version changed 1359 -> 1361
2020-12-19T22:58:01.007+05:30 [Info] switched currmeta from 1359 -> 1361 force false 
2020-12-19T22:58:01.007+05:30 [Info] DropIndex 17222877853755111150 - elapsed(93.175176ms), err()
2020/12/19 22:58:01 Dropped index arr_leading
2020/12/19 22:58:01 Index found:  arridx_friends
2020-12-19T22:58:01.007+05:30 [Info] DropIndex 15672085431222022279 ...
2020-12-19T22:58:01.058+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.058+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.060+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.060+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.067+05:30 [Info] switched currmeta from 1361 -> 1361 force true 
2020-12-19T22:58:01.073+05:30 [Info] switched currmeta from 1355 -> 1357 force true 
2020-12-19T22:58:01.116+05:30 [Info] metadata provider version changed 1361 -> 1363
2020-12-19T22:58:01.117+05:30 [Info] switched currmeta from 1361 -> 1363 force false 
2020-12-19T22:58:01.117+05:30 [Info] DropIndex 15672085431222022279 - elapsed(109.867485ms), err()
2020/12/19 22:58:01 Dropped index arridx_friends
2020-12-19T22:58:01.247+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:58:01.297+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.297+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.312+05:30 [Info] switched currmeta from 1357 -> 1359 force true 
2020-12-19T22:58:01.329+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.329+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.358+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:01.506+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.506+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.516+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:01.604+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.604+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.627+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:01.678+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.678+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.692+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:01.721+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:01.721+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:01.728+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:03.516+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:58:03.568+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:03.568+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:03.572+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:03.572+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:03.573+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:03.575+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:05.817+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:58:05.945+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:05.945+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:05.956+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:05.962+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:05.962+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:05.965+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:06.082+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:58:06.152+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:06.152+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:06.156+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:06.158+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:06.158+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:06.160+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020-12-19T22:58:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:58:06.279+05:30 [Info] client load stats {}
2020-12-19T22:58:06.279+05:30 [Info] client hit stats {}
2020-12-19T22:58:06.279+05:30 [Info] client pending item stats {}
2020-12-19T22:58:06.279+05:30 [Info] client stats current {}
2020-12-19T22:58:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:58:06.284+05:30 [Info] average scan response {26 ms}
2020-12-19T22:58:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:58:06.827+05:30 [Info] client load stats {}
2020-12-19T22:58:06.827+05:30 [Info] client hit stats {}
2020-12-19T22:58:06.827+05:30 [Info] client pending item stats {}
2020-12-19T22:58:06.827+05:30 [Info] client stats current {}
2020-12-19T22:58:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:58:06.830+05:30 [Info] average scan response {66 ms}
2020-12-19T22:58:08.433+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:58:09.019+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:58:10.536+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:58:10.627+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:10.627+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:10.629+05:30 [Info] switched currmeta from 1363 -> 1363 force true 
2020-12-19T22:58:10.637+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:58:10.637+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:58:10.648+05:30 [Info] switched currmeta from 1359 -> 1359 force true 
2020/12/19 22:58:40 Flushed the bucket default, Response body: 
2020-12-19T22:58:40.183+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:58:40 Changing config key indexer.settings.allow_large_keys to value false
2020-12-19T22:58:40.212+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:58:41.196+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:58:41 Changing config key indexer.settings.max_seckey_size to value 100
2020-12-19T22:58:41.208+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 22:58:41 Changing config key indexer.settings.max_array_seckey_size to value 2000
2020-12-19T22:58:41.221+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":100,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:58:41.254+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":2000,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":100,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020/12/19 22:58:42 Start of createArrayDocs()
2020/12/19 22:58:59 End of createArrayDocs()
2020/12/19 22:58:59 Start of createArrayDocs()
2020/12/19 22:58:59 End of createArrayDocs()
2020-12-19T22:58:59.935+05:30 [Info] CreateIndex default _default _default arr1 ...
2020-12-19T22:58:59.936+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:58:59.936+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arr1)
2020-12-19T22:58:59.968+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:59:00.348+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:59:00.367+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:59:00.367+05:30 [Info] Score: 0
2020-12-19T22:59:00.367+05:30 [Info] variation: 0
2020-12-19T22:59:00.367+05:30 [Info] ElapsedTime: 4ms
2020-12-19T22:59:00.367+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:59:00.367+05:30 [Info] Iteration: 0
2020-12-19T22:59:00.367+05:30 [Info] Move: 0
2020-12-19T22:59:00.367+05:30 [Info] ----------------------------------------
2020-12-19T22:59:00.367+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:59:00.367+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:59:00.367+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:59:00.367+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:59:00.367+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:59:00.367+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:59:00.367+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:59:00.367+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:59:00.367+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:59:00.367+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:00.368+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:59:00.368+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:00.368+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T22:59:00.368+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:59:00.368+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:59:00.368+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:00.368+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:59:00.368+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:00.368+05:30 [Info] ----------------------------------------
2020-12-19T22:59:00.368+05:30 [Info] Number of indexes: 1
2020-12-19T22:59:00.368+05:30 [Info] Number of indexers: 1
2020-12-19T22:59:00.368+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T22:59:00.368+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:59:00.368+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:59:00.368+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:59:00.368+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:59:00.368+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:59:00.368+05:30 [Info] ----------------------------------------
2020-12-19T22:59:00.368+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:59:00.368+05:30 [Info] CPU Quota 4
2020-12-19T22:59:00.368+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:59:00.368+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:59:00.368+05:30 [Info] ----------------------------------------
2020-12-19T22:59:00.368+05:30 [Info] Total iteration: 0
2020-12-19T22:59:00.368+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:59:00.368+05:30 [Info] RandomSwap call: 0
2020-12-19T22:59:00.368+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:59:00.368+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:59:00.368+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:59:00.368+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:59:00.368+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:59:00.368+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:59:00.368+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:59:00.368+05:30 [Info] ----------------------------------------
2020-12-19T22:59:00.368+05:30 [Info] 
2020-12-19T22:59:00.368+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:59:00.368+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T22:59:00.368+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:59:00.368+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:00.368+05:30 [Info] 		Index name:arr1 0, bucket:default, scope:_default, collection:_default, defnId:5191755230842055607, instId:1326614793273071980, Partition: 0, new/moved:true
2020-12-19T22:59:00.368+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:00.368+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:00.368+05:30 [Info] ****************************************
2020-12-19T22:59:00.368+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:59:00.414+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.414+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.417+05:30 [Info] switched currmeta from 1363 -> 1366 force true 
2020-12-19T22:59:00.417+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.417+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.427+05:30 [Info] switched currmeta from 1359 -> 1363 force true 
2020-12-19T22:59:00.523+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.523+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.534+05:30 [Info] switched currmeta from 1366 -> 1368 force true 
2020-12-19T22:59:00.564+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.564+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.572+05:30 [Info] switched currmeta from 1363 -> 1364 force true 
2020-12-19T22:59:00.605+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.605+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.610+05:30 [Info] switched currmeta from 1368 -> 1368 force true 
2020-12-19T22:59:00.629+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:00.629+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:00.632+05:30 [Info] switched currmeta from 1364 -> 1364 force true 
2020-12-19T22:59:03.484+05:30 [Info] CreateIndex 5191755230842055607 default _default _default/arr1 using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`friends`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.54887157s) err()
2020/12/19 22:59:03 Created the secondary index arr1. Waiting for it become active
2020-12-19T22:59:03.484+05:30 [Info] metadata provider version changed 1368 -> 1369
2020-12-19T22:59:03.484+05:30 [Info] switched currmeta from 1368 -> 1369 force false 
2020/12/19 22:59:03 Index is now active
2020-12-19T22:59:03.484+05:30 [Info] CreateIndex default _default _default arr2 ...
2020-12-19T22:59:03.485+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:59:03.487+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arr2)
2020-12-19T22:59:03.652+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:59:03.657+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:03.657+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:03.659+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:03.659+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:03.663+05:30 [Info] switched currmeta from 1369 -> 1369 force true 
2020-12-19T22:59:03.664+05:30 [Info] switched currmeta from 1364 -> 1365 force true 
2020-12-19T22:59:03.726+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:03.726+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:03.727+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:03.727+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:03.732+05:30 [Info] switched currmeta from 1369 -> 1369 force true 
2020-12-19T22:59:03.734+05:30 [Info] switched currmeta from 1365 -> 1365 force true 
2020-12-19T22:59:03.743+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:59:04.293+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:59:04.337+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:59:04.338+05:30 [Info] Score: 0
2020-12-19T22:59:04.338+05:30 [Info] variation: 0
2020-12-19T22:59:04.338+05:30 [Info] ElapsedTime: 9ms
2020-12-19T22:59:04.338+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:59:04.338+05:30 [Info] Iteration: 0
2020-12-19T22:59:04.338+05:30 [Info] Move: 0
2020-12-19T22:59:04.338+05:30 [Info] ----------------------------------------
2020-12-19T22:59:04.338+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:59:04.338+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Data Size Mean 1258336971 (1.17192G)
2020-12-19T22:59:04.338+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:59:04.338+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:59:04.338+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:04.338+05:30 [Info] ----------------------------------------
2020-12-19T22:59:04.338+05:30 [Info] Number of indexes: 2
2020-12-19T22:59:04.338+05:30 [Info] Number of indexers: 1
2020-12-19T22:59:04.338+05:30 [Info] Avg Index Size: 629145600 (600M)
2020-12-19T22:59:04.338+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:59:04.338+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:59:04.338+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:59:04.338+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:59:04.338+05:30 [Info] ----------------------------------------
2020-12-19T22:59:04.338+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:59:04.338+05:30 [Info] CPU Quota 4
2020-12-19T22:59:04.338+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:59:04.338+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:59:04.338+05:30 [Info] ----------------------------------------
2020-12-19T22:59:04.338+05:30 [Info] Total iteration: 0
2020-12-19T22:59:04.338+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:59:04.338+05:30 [Info] RandomSwap call: 0
2020-12-19T22:59:04.338+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:59:04.339+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:59:04.339+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:59:04.339+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:59:04.339+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:59:04.339+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:59:04.339+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:59:04.339+05:30 [Info] ----------------------------------------
2020-12-19T22:59:04.339+05:30 [Info] 
2020-12-19T22:59:04.339+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:59:04.339+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258300354 (1.17188G), data:1258336971 (1.17192G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2020-12-19T22:59:04.339+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:59:04.339+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:04.339+05:30 [Info] 		Index name:arr1 0, bucket:default, scope:_default, collection:_default, defnId:5191755230842055607, instId:7785089493680078741, Partition: 0, new/moved:false
2020-12-19T22:59:04.339+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:9154 (8.93945K), data:45771 (44.6982K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:04.339+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:04.339+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:04.339+05:30 [Info] 		Index name:arr2 0, bucket:default, scope:_default, collection:_default, defnId:1662358138505789051, instId:13079679080688229744, Partition: 0, new/moved:true
2020-12-19T22:59:04.339+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:04.339+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:04.339+05:30 [Info] ****************************************
2020-12-19T22:59:04.339+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:59:04.526+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:04.526+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:04.534+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:04.534+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:04.542+05:30 [Info] switched currmeta from 1365 -> 1370 force true 
2020-12-19T22:59:04.568+05:30 [Info] switched currmeta from 1369 -> 1374 force true 
2020-12-19T22:59:04.722+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:04.722+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:04.756+05:30 [Info] switched currmeta from 1374 -> 1374 force true 
2020-12-19T22:59:04.790+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:04.790+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:04.820+05:30 [Info] switched currmeta from 1370 -> 1370 force true 
2020-12-19T22:59:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T22:59:06.279+05:30 [Info] index 5191755230842055607 has replicas [7785089493680078741]: 
2020-12-19T22:59:06.279+05:30 [Info] index 1662358138505789051 has replicas [14097694996948129524]: 
2020-12-19T22:59:06.279+05:30 [Info] index 5191755230842055607 has equivalents [5191755230842055607]: 
2020-12-19T22:59:06.279+05:30 [Info] index 1662358138505789051 has equivalents [1662358138505789051]: 
2020-12-19T22:59:06.279+05:30 [Info] client load stats {"7785089493680078741": 0,"14097694996948129524": 0}
2020-12-19T22:59:06.279+05:30 [Info] client hit stats {"7785089493680078741": 0,"14097694996948129524": 0}
2020-12-19T22:59:06.279+05:30 [Info] client pending item stats {"7785089493680078741": -2,"14097694996948129524": -2}
2020-12-19T22:59:06.279+05:30 [Info] client stats current {"7785089493680078741": true,"14097694996948129524": true}
2020-12-19T22:59:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T22:59:06.284+05:30 [Info] average scan response {26 ms}
2020-12-19T22:59:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T22:59:06.827+05:30 [Info] index 1662358138505789051 has replicas [14097694996948129524]: 
2020-12-19T22:59:06.827+05:30 [Info] index 5191755230842055607 has replicas [7785089493680078741]: 
2020-12-19T22:59:06.827+05:30 [Info] index 1662358138505789051 has equivalents [1662358138505789051]: 
2020-12-19T22:59:06.827+05:30 [Info] index 5191755230842055607 has equivalents [5191755230842055607]: 
2020-12-19T22:59:06.827+05:30 [Info] client load stats {"14097694996948129524": 0,"7785089493680078741": 0}
2020-12-19T22:59:06.827+05:30 [Info] client hit stats {"14097694996948129524": 0,"7785089493680078741": 0}
2020-12-19T22:59:06.827+05:30 [Info] client pending item stats {"14097694996948129524": -2,"7785089493680078741": -2}
2020-12-19T22:59:06.827+05:30 [Info] client stats current {"14097694996948129524": true,"7785089493680078741": true}
2020-12-19T22:59:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T22:59:06.830+05:30 [Info] average scan response {66 ms}
2020-12-19T22:59:06.953+05:30 [Info] Rollback time has changed for index inst 7785089493680078741. New rollback time 1608398606173477505
2020-12-19T22:59:06.953+05:30 [Info] Rollback time has changed for index inst 7785089493680078741. New rollback time 1608398606173477505
2020-12-19T22:59:07.934+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:07.934+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:07.937+05:30 [Info] switched currmeta from 1374 -> 1375 force true 
2020-12-19T22:59:07.942+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:07.942+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:07.944+05:30 [Info] switched currmeta from 1370 -> 1371 force true 
2020-12-19T22:59:08.449+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:59:08.567+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:59:08.610+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:08.610+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:08.613+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:08.613+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:08.614+05:30 [Info] switched currmeta from 1371 -> 1371 force true 
2020-12-19T22:59:08.616+05:30 [Info] switched currmeta from 1375 -> 1375 force true 
2020-12-19T22:59:08.736+05:30 [Info] CreateIndex 1662358138505789051 default _default _default/arr2 using:forestdb exprType:N1QL whereExpr:() secExprs:([(all (`name`))]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(5.251758429s) err()
2020/12/19 22:59:08 Created the secondary index arr2. Waiting for it become active
2020-12-19T22:59:08.736+05:30 [Info] metadata provider version changed 1375 -> 1376
2020-12-19T22:59:08.736+05:30 [Info] switched currmeta from 1375 -> 1376 force false 
2020/12/19 22:59:08 Index is now active
2020-12-19T22:59:08.737+05:30 [Info] CreateIndex default _default _default idx3 ...
2020-12-19T22:59:08.737+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T22:59:08.739+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, idx3)
2020-12-19T22:59:08.844+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:08.845+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:08.848+05:30 [Info] switched currmeta from 1376 -> 1376 force true 
2020-12-19T22:59:08.861+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:08.861+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:08.864+05:30 [Info] switched currmeta from 1371 -> 1372 force true 
2020-12-19T22:59:08.876+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T22:59:09.036+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T22:59:09.286+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T22:59:09.342+05:30 [Info] ************ Indexer Layout *************
2020-12-19T22:59:09.342+05:30 [Info] Score: 0
2020-12-19T22:59:09.342+05:30 [Info] variation: 0
2020-12-19T22:59:09.342+05:30 [Info] ElapsedTime: 25ms
2020-12-19T22:59:09.342+05:30 [Info] ConvergenceTime: 2us
2020-12-19T22:59:09.342+05:30 [Info] Iteration: 0
2020-12-19T22:59:09.342+05:30 [Info] Move: 0
2020-12-19T22:59:09.342+05:30 [Info] ----------------------------------------
2020-12-19T22:59:09.342+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T22:59:09.342+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T22:59:09.342+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T22:59:09.342+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T22:59:09.342+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T22:59:09.342+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T22:59:09.342+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T22:59:09.342+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Data Size Mean 1258375862 (1.17195G)
2020-12-19T22:59:09.342+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T22:59:09.343+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T22:59:09.343+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:09.343+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T22:59:09.343+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T22:59:09.343+05:30 [Info] ----------------------------------------
2020-12-19T22:59:09.343+05:30 [Info] Number of indexes: 3
2020-12-19T22:59:09.343+05:30 [Info] Number of indexers: 1
2020-12-19T22:59:09.343+05:30 [Info] Avg Index Size: 419430400 (400M)
2020-12-19T22:59:09.343+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T22:59:09.343+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T22:59:09.343+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T22:59:09.343+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T22:59:09.343+05:30 [Info] Num Estimation Run: 1
2020-12-19T22:59:09.343+05:30 [Info] ----------------------------------------
2020-12-19T22:59:09.343+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T22:59:09.343+05:30 [Info] CPU Quota 4
2020-12-19T22:59:09.343+05:30 [Info] Max Cpu Utilization -1
2020-12-19T22:59:09.343+05:30 [Info] Max Memory Utilization -1
2020-12-19T22:59:09.343+05:30 [Info] ----------------------------------------
2020-12-19T22:59:09.343+05:30 [Info] Total iteration: 0
2020-12-19T22:59:09.343+05:30 [Info] RandomSwap time: 0ns
2020-12-19T22:59:09.343+05:30 [Info] RandomSwap call: 0
2020-12-19T22:59:09.343+05:30 [Info] RandomSwap iteration: 0
2020-12-19T22:59:09.343+05:30 [Info] RandomMove time: 0ns
2020-12-19T22:59:09.343+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T22:59:09.343+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T22:59:09.343+05:30 [Info] ExhaustMove call: 0
2020-12-19T22:59:09.343+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T22:59:09.343+05:30 [Info] ExhaustSwap call: 0
2020-12-19T22:59:09.343+05:30 [Info] ----------------------------------------
2020-12-19T22:59:09.343+05:30 [Info] 
2020-12-19T22:59:09.343+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T22:59:09.343+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258308132 (1.17189G), data:1258375862 (1.17195G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:3
2020-12-19T22:59:09.343+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T22:59:09.343+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:09.353+05:30 [Info] 		Index name:arr1 0, bucket:default, scope:_default, collection:_default, defnId:5191755230842055607, instId:7785089493680078741, Partition: 0, new/moved:false
2020-12-19T22:59:09.353+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:9154 (8.93945K), data:45771 (44.6982K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:09.354+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:09.354+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:09.354+05:30 [Info] 		Index name:arr2 0, bucket:default, scope:_default, collection:_default, defnId:1662358138505789051, instId:14097694996948129524, Partition: 0, new/moved:false
2020-12-19T22:59:09.354+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:7778 (7.5957K), data:38891 (37.9795K) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:09.354+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:09.354+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T22:59:09.354+05:30 [Info] 		Index name:idx3 0, bucket:default, scope:_default, collection:_default, defnId:273477261269237224, instId:622984018561469264, Partition: 0, new/moved:true
2020-12-19T22:59:09.354+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T22:59:09.354+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T22:59:09.368+05:30 [Info] ****************************************
2020-12-19T22:59:09.369+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T22:59:09.461+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:09.461+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:09.469+05:30 [Info] switched currmeta from 1376 -> 1381 force true 
2020-12-19T22:59:09.470+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:09.470+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:09.492+05:30 [Info] switched currmeta from 1372 -> 1377 force true 
2020-12-19T22:59:09.586+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:09.586+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:09.586+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:09.586+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:09.590+05:30 [Info] switched currmeta from 1381 -> 1381 force true 
2020-12-19T22:59:09.591+05:30 [Info] switched currmeta from 1377 -> 1377 force true 
2020-12-19T22:59:11.913+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:11.913+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:11.917+05:30 [Info] switched currmeta from 1381 -> 1382 force true 
2020-12-19T22:59:11.918+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:11.918+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:11.921+05:30 [Info] switched currmeta from 1377 -> 1378 force true 
2020-12-19T22:59:11.952+05:30 [Info] Rollback time has changed for index inst 14097694996948129524. New rollback time 1608398606173477505
2020-12-19T22:59:11.952+05:30 [Info] Rollback time has changed for index inst 14097694996948129524. New rollback time 1608398606173477505
2020-12-19T22:59:12.817+05:30 [Info] CreateIndex 273477261269237224 default _default _default/idx3 using:forestdb exprType:N1QL whereExpr:() secExprs:([`name`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.080052625s) err()
2020/12/19 22:59:12 Created the secondary index idx3. Waiting for it become active
2020-12-19T22:59:12.817+05:30 [Info] metadata provider version changed 1382 -> 1383
2020-12-19T22:59:12.817+05:30 [Info] switched currmeta from 1382 -> 1383 force false 
2020/12/19 22:59:12 Index is now active
2020/12/19 22:59:12 Using n1ql client
2020-12-19T22:59:12.832+05:30 [Info] metadata provider version changed 1378 -> 1379
2020-12-19T22:59:12.832+05:30 [Info] switched currmeta from 1378 -> 1379 force false 
2020-12-19T22:59:12.833+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020/12/19 22:59:12 Length of scanResults = 10
2020/12/19 22:59:12 Changing config key indexer.settings.max_seckey_size to value 4096
2020/12/19 22:59:12 Changing config key indexer.settings.max_array_seckey_size to value 51200
2020-12-19T22:59:12.950+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:12.950+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:12.962+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":51200,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4096,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T22:59:12.970+05:30 [Info] switched currmeta from 1383 -> 1383 force true 
2020-12-19T22:59:12.972+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:12.972+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:12.975+05:30 [Info] switched currmeta from 1379 -> 1379 force true 
2020-12-19T22:59:13.570+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:59:13.611+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:13.611+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:13.617+05:30 [Info] switched currmeta from 1379 -> 1379 force true 
2020-12-19T22:59:13.619+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:13.619+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:13.621+05:30 [Info] switched currmeta from 1383 -> 1383 force true 
2020-12-19T22:59:16.952+05:30 [Info] Rollback time has changed for index inst 18151614652600561455. New rollback time 1608398606173477505
2020-12-19T22:59:16.953+05:30 [Info] Rollback time has changed for index inst 18151614652600561455. New rollback time 1608398606173477505
2020-12-19T22:59:18.576+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T22:59:18.652+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:18.652+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:18.655+05:30 [Info] switched currmeta from 1383 -> 1383 force true 
2020-12-19T22:59:18.661+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:18.661+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:18.667+05:30 [Info] switched currmeta from 1379 -> 1379 force true 
2020/12/19 22:59:32 Expected and Actual scan responses are the same
2020/12/19 22:59:32 Using n1ql client
2020-12-19T22:59:32.048+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020/12/19 22:59:32 Expected and Actual scan responses are the same
2020/12/19 22:59:32 Using n1ql client
2020/12/19 22:59:32 Expected and Actual scan responses are the same
2020/12/19 22:59:32 Changing config key indexer.settings.max_seckey_size to value 100
2020/12/19 22:59:32 Changing config key indexer.settings.max_array_seckey_size to value 2200
2020-12-19T22:59:32.116+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":2200,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":100,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020/12/19 22:59:56 Using n1ql client
2020/12/19 22:59:56 Length of scanResults = 10
2020/12/19 22:59:56 Changing config key indexer.settings.max_seckey_size to value 4608
2020/12/19 22:59:56 Changing config key indexer.settings.max_array_seckey_size to value 10240
2020-12-19T22:59:56.746+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
--- PASS: TestArraySizeIncreaseDecrease1 (117.02s)
=== RUN   TestArraySizeIncreaseDecrease2
2020/12/19 22:59:57 In TestArraySizeIncreaseDecrease2()
Skip test as allow_large_keys = true is not supported for forestdb
--- PASS: TestArraySizeIncreaseDecrease2 (0.00s)
=== RUN   TestBufferedScan_BackfillDisabled
2020/12/19 22:59:57 In TestBufferedScan_BackfillDisabled()
2020/12/19 22:59:57 In DropAllSecondaryIndexes()
2020/12/19 22:59:57 Index found:  idx3
2020-12-19T22:59:57.723+05:30 [Info] DropIndex 273477261269237224 ...
2020-12-19T22:59:57.766+05:30 [Info] metadata provider version changed 1383 -> 1385
2020-12-19T22:59:57.766+05:30 [Info] switched currmeta from 1383 -> 1385 force false 
2020-12-19T22:59:57.766+05:30 [Info] DropIndex 273477261269237224 - elapsed(42.899647ms), err()
2020/12/19 22:59:57 Dropped index idx3
2020/12/19 22:59:57 Index found:  arr2
2020-12-19T22:59:57.766+05:30 [Info] DropIndex 1662358138505789051 ...
2020-12-19T22:59:57.876+05:30 [Info] metadata provider version changed 1385 -> 1387
2020-12-19T22:59:57.876+05:30 [Info] switched currmeta from 1385 -> 1387 force false 
2020-12-19T22:59:57.876+05:30 [Info] DropIndex 1662358138505789051 - elapsed(110.212695ms), err()
2020/12/19 22:59:57 Dropped index arr2
2020/12/19 22:59:57 Index found:  arr1
2020-12-19T22:59:57.876+05:30 [Info] DropIndex 5191755230842055607 ...
2020-12-19T22:59:57.884+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:57.884+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:57.889+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:57.889+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:57.891+05:30 [Info] switched currmeta from 1379 -> 1383 force true 
2020-12-19T22:59:57.901+05:30 [Info] switched currmeta from 1387 -> 1387 force true 
2020-12-19T22:59:58.005+05:30 [Info] metadata provider version changed 1387 -> 1389
2020-12-19T22:59:58.005+05:30 [Info] switched currmeta from 1387 -> 1389 force false 
2020-12-19T22:59:58.005+05:30 [Info] DropIndex 5191755230842055607 - elapsed(129.063705ms), err()
2020/12/19 22:59:58 Dropped index arr1
2020-12-19T22:59:58.026+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.026+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.028+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.028+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.053+05:30 [Info] switched currmeta from 1383 -> 1385 force true 
2020-12-19T22:59:58.074+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T22:59:58.267+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T22:59:58.367+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.367+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.384+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T22:59:58.390+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.390+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.400+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T22:59:58.521+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.521+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.543+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T22:59:58.562+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T22:59:58.562+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T22:59:58.570+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:00:02.438+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:00:02.534+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:02.534+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:02.536+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:02.536+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:02.540+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T23:00:02.546+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:00:02.721+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:00:02.845+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:02.845+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:02.849+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:00:02.852+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:02.852+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:02.857+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T23:00:03.603+05:30 [Info] GSIC[default/default-_default-_default-1608398403528136132] logstats "default" {"gsi_scan_count":14,"gsi_scan_duration":1131829591,"gsi_throttle_duration":17357617,"gsi_prime_duration":466111222,"gsi_blocked_duration":33893744,"gsi_total_temp_files":0}
2020-12-19T23:00:03.613+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:00:03.663+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:03.663+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:03.665+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T23:00:03.665+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:03.665+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:03.668+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:00:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T23:00:06.279+05:30 [Info] client load stats {}
2020-12-19T23:00:06.279+05:30 [Info] client hit stats {}
2020-12-19T23:00:06.279+05:30 [Info] client pending item stats {}
2020-12-19T23:00:06.279+05:30 [Info] client stats current {}
2020-12-19T23:00:06.285+05:30 [Info] num concurrent scans {0}
2020-12-19T23:00:06.285+05:30 [Info] average scan response {7178 ms}
2020-12-19T23:00:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T23:00:06.827+05:30 [Info] client load stats {}
2020-12-19T23:00:06.827+05:30 [Info] client hit stats {}
2020-12-19T23:00:06.827+05:30 [Info] client pending item stats {}
2020-12-19T23:00:06.827+05:30 [Info] client stats current {}
2020-12-19T23:00:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T23:00:06.830+05:30 [Info] average scan response {6 ms}
2020-12-19T23:00:07.596+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:00:07.740+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:07.740+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:07.743+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:00:07.743+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:00:07.746+05:30 [Info] switched currmeta from 1385 -> 1385 force true 
2020-12-19T23:00:07.746+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:00:08.465+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T23:00:09.058+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020/12/19 23:00:37 Flushed the bucket default, Response body: 
2020-12-19T23:01:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T23:01:06.279+05:30 [Info] client load stats {}
2020-12-19T23:01:06.279+05:30 [Info] client hit stats {}
2020-12-19T23:01:06.279+05:30 [Info] client pending item stats {}
2020-12-19T23:01:06.279+05:30 [Info] client stats current {}
2020-12-19T23:01:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T23:01:06.284+05:30 [Info] average scan response {7178 ms}
2020-12-19T23:01:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T23:01:06.827+05:30 [Info] client load stats {}
2020-12-19T23:01:06.827+05:30 [Info] client hit stats {}
2020-12-19T23:01:06.827+05:30 [Info] client pending item stats {}
2020-12-19T23:01:06.827+05:30 [Info] client stats current {}
2020-12-19T23:01:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T23:01:06.830+05:30 [Info] average scan response {6 ms}
2020-12-19T23:01:08.485+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T23:01:09.077+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T23:01:18.784+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 23:01:18 Changing config key queryport.client.settings.backfillLimit to value 0
2020-12-19T23:01:18.799+05:30 [Info] CreateIndex default _default _default addressidx ...
2020-12-19T23:01:18.799+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:01:18.805+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, addressidx)
2020-12-19T23:01:18.886+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:01:19.421+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:01:19.449+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:01:19.449+05:30 [Info] Score: 0
2020-12-19T23:01:19.450+05:30 [Info] variation: 0
2020-12-19T23:01:19.450+05:30 [Info] ElapsedTime: 4ms
2020-12-19T23:01:19.450+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:01:19.450+05:30 [Info] Iteration: 0
2020-12-19T23:01:19.450+05:30 [Info] Move: 0
2020-12-19T23:01:19.450+05:30 [Info] ----------------------------------------
2020-12-19T23:01:19.450+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:01:19.450+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:01:19.450+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:01:19.450+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:01:19.450+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:01:19.450+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:01:19.450+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:01:19.450+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:01:19.451+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:01:19.451+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T23:01:19.451+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:01:19.451+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:01:19.451+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:01:19.451+05:30 [Info] ----------------------------------------
2020-12-19T23:01:19.451+05:30 [Info] Number of indexes: 1
2020-12-19T23:01:19.452+05:30 [Info] Number of indexers: 1
2020-12-19T23:01:19.452+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T23:01:19.452+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:01:19.452+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:01:19.452+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:01:19.452+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:01:19.452+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:01:19.452+05:30 [Info] ----------------------------------------
2020-12-19T23:01:19.452+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:01:19.452+05:30 [Info] CPU Quota 4
2020-12-19T23:01:19.452+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:01:19.452+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:01:19.452+05:30 [Info] ----------------------------------------
2020-12-19T23:01:19.452+05:30 [Info] Total iteration: 0
2020-12-19T23:01:19.452+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:01:19.452+05:30 [Info] RandomSwap call: 0
2020-12-19T23:01:19.452+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:01:19.452+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:01:19.452+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:01:19.452+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:01:19.452+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:01:19.452+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:01:19.452+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:01:19.452+05:30 [Info] ----------------------------------------
2020-12-19T23:01:19.452+05:30 [Info] 
2020-12-19T23:01:19.452+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:01:19.452+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T23:01:19.452+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:01:19.452+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:01:19.452+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:3188043960084879458, Partition: 0, new/moved:true
2020-12-19T23:01:19.452+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:01:19.452+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:01:19.452+05:30 [Info] ****************************************
2020-12-19T23:01:19.452+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:01:19.534+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.534+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.541+05:30 [Info] switched currmeta from 1385 -> 1389 force true 
2020-12-19T23:01:19.556+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.556+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.560+05:30 [Info] switched currmeta from 1389 -> 1393 force true 
2020-12-19T23:01:19.644+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.644+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.650+05:30 [Info] switched currmeta from 1393 -> 1393 force true 
2020-12-19T23:01:19.652+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.652+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.655+05:30 [Info] switched currmeta from 1389 -> 1389 force true 
2020-12-19T23:01:19.789+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.789+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.797+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:19.797+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:19.797+05:30 [Info] switched currmeta from 1389 -> 1390 force true 
2020-12-19T23:01:19.804+05:30 [Info] switched currmeta from 1393 -> 1394 force true 
2020-12-19T23:01:23.699+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:01:23.831+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:23.831+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:23.834+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:23.834+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:23.839+05:30 [Info] switched currmeta from 1394 -> 1394 force true 
2020-12-19T23:01:23.843+05:30 [Info] switched currmeta from 1390 -> 1390 force true 
2020-12-19T23:01:28.209+05:30 [Info] CreateIndex 8780330031282456093 default _default _default/addressidx using:forestdb exprType:N1QL whereExpr:() secExprs:([`address`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(9.409712193s) err()
2020/12/19 23:01:28 Created the secondary index addressidx. Waiting for it become active
2020-12-19T23:01:28.209+05:30 [Info] metadata provider version changed 1394 -> 1395
2020-12-19T23:01:28.209+05:30 [Info] switched currmeta from 1394 -> 1395 force false 
2020/12/19 23:01:28 Index is now active
2020-12-19T23:01:28.224+05:30 [Info] metadata provider version changed 1390 -> 1391
2020-12-19T23:01:28.224+05:30 [Info] switched currmeta from 1390 -> 1391 force false 
2020-12-19T23:01:28.224+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:01:28.224+05:30 [Info] GSIC[default/default-_default-_default-1608399088209499712] started ...
2020/12/19 23:01:28 Non-backfill file found: /tmp/.ICE-unix
2020/12/19 23:01:28 Non-backfill file found: /tmp/.Test-unix
2020/12/19 23:01:28 Non-backfill file found: /tmp/.X11-unix
2020/12/19 23:01:28 Non-backfill file found: /tmp/.XIM-unix
2020/12/19 23:01:28 Non-backfill file found: /tmp/.font-unix
2020/12/19 23:01:28 Non-backfill file found: /tmp/fail.log
2020/12/19 23:01:28 Non-backfill file found: /tmp/go-build367575012
2020/12/19 23:01:28 Non-backfill file found: /tmp/go-build594025049
2020/12/19 23:01:28 Non-backfill file found: /tmp/mdbslice
2020/12/19 23:01:28 Non-backfill file found: /tmp/systemd-private-cc1646c6df884e0f90559d3abdd9085a-apache2.service-suQDZs
2020/12/19 23:01:28 Non-backfill file found: /tmp/systemd-private-cc1646c6df884e0f90559d3abdd9085a-systemd-timesyncd.service-XAKsG4
2020/12/19 23:01:28 limit=1,chsize=256; received 1 items; took 2.408712ms
2020-12-19T23:01:28.281+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:28.281+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:28.283+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:28.283+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:28.285+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:01:28.286+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020/12/19 23:01:30 limit=1000,chsize=256; received 1000 items; took 1.322607749s
--- PASS: TestBufferedScan_BackfillDisabled (93.83s)
=== RUN   TestBufferedScan_BackfillEnabled
2020/12/19 23:01:31 In TestBufferedScan_BackfillEnabled()
2020-12-19T23:01:31.552+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 23:01:31 Changing config key queryport.client.settings.backfillLimit to value 1
2020-12-19T23:01:31.579+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:01:31.579+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] started ...
2020-12-19T23:01:31.580+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":1,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020/12/19 23:01:31 limit=1,chsize=256; received 1 items; took 16.107261ms
2020-12-19T23:01:31.953+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608398606173477505
2020-12-19T23:01:31.953+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608398606173477505
2020/12/19 23:01:32 limit=1000,chsize=256; received 1000 items; took 25.643059ms
2020-12-19T23:01:33.628+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:01:33.645+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] bufferedscan new temp file ... /tmp/scan-results30426599830745
2020-12-19T23:01:33.699+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:33.699+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:33.704+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:01:33.704+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:01:33.704+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:01:33.706+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020-12-19T23:01:39.618+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] request(bufferedscan) removing temp file /tmp/scan-results30426599830745 ...
2020/12/19 23:01:44 limit=1000,chsize=256; received 1000 items; took 10.253517894s
2020-12-19T23:01:45.880+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2020-12-19T23:01:45.899+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] bufferedscan new temp file ... /tmp/scan-results30426961205900
2020-12-19T23:01:45.901+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] bufferedscan new temp file ... /tmp/scan-results30426171739038
Scan error: "bufferedscan" temp file size exceeded limit 1, 7 - cause: "bufferedscan" temp file size exceeded limit 1, 7
Scan error: "bufferedscan" temp file size exceeded limit 1, 7 - cause: "bufferedscan" temp file size exceeded limit 1, 7
Scan error:  "bufferedscan" temp file size exceeded limit 1, 7 - cause:  "bufferedscan" temp file size exceeded limit 1, 7
2020-12-19T23:01:47.324+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] request(bufferedscan) removing temp file /tmp/scan-results30426171739038 ...
Scan error:  "bufferedscan" temp file size exceeded limit 1, 7 - cause:  "bufferedscan" temp file size exceeded limit 1, 7
2020-12-19T23:01:47.327+05:30 [Info] GSIC[default/default-_default-_default-1608399091564268379] request(bufferedscan) removing temp file /tmp/scan-results30426961205900 ...
2020/12/19 23:01:57 limit=1000,chsize=256; received 584 items; took 11.839224876s
2020/12/19 23:01:57 limit=1000,chsize=256; received 584 items; took 11.84165295s
2020-12-19T23:01:58.721+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 23:01:58 Changing config key queryport.client.settings.backfillLimit to value 0
--- PASS: TestBufferedScan_BackfillEnabled (27.19s)
=== RUN   TestMultiScanSetup
2020/12/19 23:01:58 In TestMultiScanSetup()
2020-12-19T23:01:58.765+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020/12/19 23:01:59 Emptying the default bucket
2020/12/19 23:02:02 Flush Enabled on bucket default, responseBody: 
2020-12-19T23:02:03.073+05:30 [Info] serviceChangeNotifier: received CollectionManifestChangeNotification for bucket: default
2020-12-19T23:02:03.231+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:03.231+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:03.233+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:03.233+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:03.237+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020-12-19T23:02:03.239+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:02:04.842+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:02:04.939+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:04.939+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:04.943+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:02:04.954+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:04.954+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:04.961+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020-12-19T23:02:05.019+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:02:05.078+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:05.078+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:05.082+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020-12-19T23:02:05.087+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:05.087+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:05.097+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:02:06.280+05:30 [Info] connected with 1 indexers
2020-12-19T23:02:06.280+05:30 [Info] index 8780330031282456093 has replicas [2222117509277422615]: 
2020-12-19T23:02:06.280+05:30 [Info] index 8780330031282456093 has equivalents [8780330031282456093]: 
2020-12-19T23:02:06.280+05:30 [Info] client load stats {"2222117509277422615": 0}
2020-12-19T23:02:06.280+05:30 [Info] client hit stats {"2222117509277422615": 0}
2020-12-19T23:02:06.280+05:30 [Info] client pending item stats {"2222117509277422615": 9223372036854775807}
2020-12-19T23:02:06.280+05:30 [Info] client stats current {"2222117509277422615": true}
2020-12-19T23:02:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T23:02:06.284+05:30 [Info] average scan response {7178 ms}
2020-12-19T23:02:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T23:02:06.827+05:30 [Info] index 8780330031282456093 has replicas [2222117509277422615]: 
2020-12-19T23:02:06.827+05:30 [Info] index 8780330031282456093 has equivalents [8780330031282456093]: 
2020-12-19T23:02:06.827+05:30 [Info] client load stats {"2222117509277422615": 5.432603815078125e+08}
2020-12-19T23:02:06.827+05:30 [Info] client hit stats {"2222117509277422615": 7}
2020-12-19T23:02:06.827+05:30 [Info] client pending item stats {"2222117509277422615": 9223372036854775807}
2020-12-19T23:02:06.827+05:30 [Info] client stats current {"2222117509277422615": true}
2020-12-19T23:02:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T23:02:06.830+05:30 [Info] average scan response {3045 ms}
2020-12-19T23:02:08.502+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T23:02:09.094+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 2
2020-12-19T23:02:11.725+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:02:11.849+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:11.849+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:11.858+05:30 [Info] switched currmeta from 1395 -> 1395 force true 
2020-12-19T23:02:11.862+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:11.862+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:11.864+05:30 [Info] switched currmeta from 1391 -> 1391 force true 
2020-12-19T23:02:21.953+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608399139707808006
2020-12-19T23:02:21.953+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608399139707808006
2020-12-19T23:02:23.527+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:23.527+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:23.534+05:30 [Info] switched currmeta from 1391 -> 1392 force true 
2020-12-19T23:02:23.537+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:23.537+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:23.539+05:30 [Info] switched currmeta from 1395 -> 1396 force true 
2020-12-19T23:02:23.637+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:23.637+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:23.641+05:30 [Info] switched currmeta from 1396 -> 1397 force true 
2020-12-19T23:02:23.642+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:23.642+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:23.644+05:30 [Info] switched currmeta from 1392 -> 1393 force true 
2020-12-19T23:02:25.916+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:25.916+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:25.921+05:30 [Info] switched currmeta from 1397 -> 1398 force true 
2020-12-19T23:02:25.923+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:25.923+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:25.925+05:30 [Info] switched currmeta from 1393 -> 1394 force true 
2020-12-19T23:02:31.952+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608399143439404872
2020-12-19T23:02:31.952+05:30 [Info] Rollback time has changed for index inst 2222117509277422615. New rollback time 1608399143439404872
2020/12/19 23:02:41 Flushed the bucket default, Response body: 
2020/12/19 23:02:41 Populating the default bucket
2020-12-19T23:02:49.118+05:30 [Info] CreateIndex default _default _default index_companyname ...
2020-12-19T23:02:49.118+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:02:49.119+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_companyname)
2020-12-19T23:02:49.175+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:02:49.639+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:02:49.663+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:02:49.663+05:30 [Info] Score: 0
2020-12-19T23:02:49.663+05:30 [Info] variation: 0
2020-12-19T23:02:49.663+05:30 [Info] ElapsedTime: 5ms
2020-12-19T23:02:49.663+05:30 [Info] ConvergenceTime: 3us
2020-12-19T23:02:49.663+05:30 [Info] Iteration: 0
2020-12-19T23:02:49.663+05:30 [Info] Move: 0
2020-12-19T23:02:49.663+05:30 [Info] ----------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:02:49.663+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Data Size Mean 1263235328 (1.17648G)
2020-12-19T23:02:49.663+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:02:49.663+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:02:49.663+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:49.663+05:30 [Info] ----------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] Number of indexes: 2
2020-12-19T23:02:49.663+05:30 [Info] Number of indexers: 1
2020-12-19T23:02:49.663+05:30 [Info] Avg Index Size: 629145600 (600M)
2020-12-19T23:02:49.663+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:02:49.663+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:02:49.663+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:02:49.663+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:02:49.663+05:30 [Info] ----------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:02:49.663+05:30 [Info] CPU Quota 4
2020-12-19T23:02:49.663+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:02:49.663+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:02:49.663+05:30 [Info] ----------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] Total iteration: 0
2020-12-19T23:02:49.663+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:02:49.663+05:30 [Info] RandomSwap call: 0
2020-12-19T23:02:49.663+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:02:49.663+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:02:49.663+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:02:49.663+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:02:49.663+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:02:49.663+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:02:49.663+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:02:49.663+05:30 [Info] ----------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] 
2020-12-19T23:02:49.663+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:02:49.663+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1259280025 (1.1728G), data:1263235328 (1.17648G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2020-12-19T23:02:49.663+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:02:49.663+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:49.663+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:02:49.664+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:988825 (965.649K), data:4944128 (4.71509M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:49.664+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:49.664+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:49.664+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:2301985302125690557, Partition: 0, new/moved:true
2020-12-19T23:02:49.664+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:49.664+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:49.664+05:30 [Info] ****************************************
2020-12-19T23:02:49.664+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:02:49.785+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:49.785+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:49.791+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:49.791+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:49.793+05:30 [Info] switched currmeta from 1398 -> 1403 force true 
2020-12-19T23:02:49.798+05:30 [Info] switched currmeta from 1394 -> 1399 force true 
2020-12-19T23:02:49.877+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:49.877+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:49.884+05:30 [Info] switched currmeta from 1399 -> 1399 force true 
2020-12-19T23:02:49.886+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:49.886+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:49.889+05:30 [Info] switched currmeta from 1403 -> 1403 force true 
2020-12-19T23:02:53.664+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:02:53.715+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:53.715+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:53.717+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:53.717+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:53.721+05:30 [Info] switched currmeta from 1399 -> 1400 force true 
2020-12-19T23:02:53.724+05:30 [Info] switched currmeta from 1403 -> 1404 force true 
2020-12-19T23:02:53.755+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:53.755+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:53.756+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:53.756+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:53.760+05:30 [Info] switched currmeta from 1400 -> 1400 force true 
2020-12-19T23:02:53.762+05:30 [Info] switched currmeta from 1404 -> 1404 force true 
2020-12-19T23:02:54.369+05:30 [Info] CreateIndex 15853951420629628285 default _default _default/index_companyname using:forestdb exprType:N1QL whereExpr:() secExprs:([`company` `name`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(5.25174631s) err()
2020/12/19 23:02:54 Created the secondary index index_companyname. Waiting for it become active
2020-12-19T23:02:54.369+05:30 [Info] metadata provider version changed 1404 -> 1405
2020-12-19T23:02:54.369+05:30 [Info] switched currmeta from 1404 -> 1405 force false 
2020/12/19 23:02:54 Index is now active
2020-12-19T23:02:54.370+05:30 [Info] CreateIndex default _default _default index_company ...
2020-12-19T23:02:54.370+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:02:54.375+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company)
2020-12-19T23:02:54.461+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:54.461+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:54.466+05:30 [Info] switched currmeta from 1400 -> 1401 force true 
2020-12-19T23:02:54.468+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:54.468+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:54.470+05:30 [Info] switched currmeta from 1405 -> 1405 force true 
2020-12-19T23:02:54.490+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:02:54.980+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:02:55.002+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:02:55.002+05:30 [Info] Score: 0
2020-12-19T23:02:55.002+05:30 [Info] variation: 0
2020-12-19T23:02:55.002+05:30 [Info] ElapsedTime: 5ms
2020-12-19T23:02:55.002+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:02:55.002+05:30 [Info] Iteration: 0
2020-12-19T23:02:55.002+05:30 [Info] Move: 0
2020-12-19T23:02:55.002+05:30 [Info] ----------------------------------------
2020-12-19T23:02:55.002+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:02:55.002+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:02:55.002+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:02:55.002+05:30 [Info] Indexer CPU Mean 0.1957
2020-12-19T23:02:55.003+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] Indexer CPU Utilization 0.0489
2020-12-19T23:02:55.003+05:30 [Info] Indexer IO Mean 25688.0000
2020-12-19T23:02:55.003+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] Indexer Drain Rate Mean 76.0000
2020-12-19T23:02:55.003+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:02:55.003+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] Indexer Data Size Mean 1266732093 (1.17974G)
2020-12-19T23:02:55.003+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:02:55.003+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:02:55.003+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:55.003+05:30 [Info] ----------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] Number of indexes: 3
2020-12-19T23:02:55.003+05:30 [Info] Number of indexers: 1
2020-12-19T23:02:55.003+05:30 [Info] Avg Index Size: 419430400 (400M)
2020-12-19T23:02:55.003+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:02:55.003+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:02:55.003+05:30 [Info] Avg Index Cpu: 0.0652
2020-12-19T23:02:55.003+05:30 [Info] Max Index Cpu: 0.1957
2020-12-19T23:02:55.003+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:02:55.003+05:30 [Info] ----------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:02:55.003+05:30 [Info] CPU Quota 4
2020-12-19T23:02:55.003+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:02:55.003+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:02:55.003+05:30 [Info] ----------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] Total iteration: 0
2020-12-19T23:02:55.003+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:02:55.003+05:30 [Info] RandomSwap call: 0
2020-12-19T23:02:55.003+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:02:55.003+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:02:55.003+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:02:55.003+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:02:55.003+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:02:55.003+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:02:55.003+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:02:55.003+05:30 [Info] ----------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] 
2020-12-19T23:02:55.003+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:02:55.003+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1259979378 (1.17345G), data:1266732093 (1.17974G) cpu:0.1957, io:25688 (25.0859K), scan:0 drain:76 numIndexes:3
2020-12-19T23:02:55.003+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:02:55.003+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:02:55.003+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1007949 (984.325K), data:5039747 (4.80628M) cpu:0.1957 io:25688 (25.0859K) scan:0 drain:76
2020-12-19T23:02:55.003+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:55.003+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:12537410122124782069, Partition: 0, new/moved:false
2020-12-19T23:02:55.003+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:680229 (664.286K), data:3401146 (3.24359M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:55.003+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:55.003+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:55.003+05:30 [Info] 		Index name:index_company 0, bucket:default, scope:_default, collection:_default, defnId:2050097040540024436, instId:707972177727430599, Partition: 0, new/moved:true
2020-12-19T23:02:55.003+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:55.003+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:55.003+05:30 [Info] ****************************************
2020-12-19T23:02:55.004+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:02:55.077+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:55.077+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:55.083+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:55.083+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:55.088+05:30 [Info] switched currmeta from 1405 -> 1410 force true 
2020-12-19T23:02:55.092+05:30 [Info] switched currmeta from 1401 -> 1406 force true 
2020-12-19T23:02:55.189+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:55.189+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:55.193+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:55.193+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:55.198+05:30 [Info] switched currmeta from 1410 -> 1410 force true 
2020-12-19T23:02:55.200+05:30 [Info] switched currmeta from 1406 -> 1406 force true 
2020-12-19T23:02:56.952+05:30 [Info] Rollback time has changed for index inst 12537410122124782069. New rollback time 1608399143439404872
2020-12-19T23:02:56.953+05:30 [Info] Rollback time has changed for index inst 12537410122124782069. New rollback time 1608399143439404872
2020-12-19T23:02:58.475+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:58.475+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:58.475+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:58.475+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:58.478+05:30 [Info] switched currmeta from 1410 -> 1411 force true 
2020-12-19T23:02:58.478+05:30 [Info] switched currmeta from 1406 -> 1407 force true 
2020-12-19T23:02:58.651+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:02:58.698+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:58.698+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:58.702+05:30 [Info] switched currmeta from 1407 -> 1407 force true 
2020-12-19T23:02:58.704+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:58.704+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:58.706+05:30 [Info] switched currmeta from 1411 -> 1411 force true 
2020-12-19T23:02:59.190+05:30 [Info] CreateIndex 2050097040540024436 default _default _default/index_company using:forestdb exprType:N1QL whereExpr:() secExprs:([`company`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.820411282s) err()
2020/12/19 23:02:59 Created the secondary index index_company. Waiting for it become active
2020-12-19T23:02:59.190+05:30 [Info] metadata provider version changed 1411 -> 1412
2020-12-19T23:02:59.190+05:30 [Info] switched currmeta from 1411 -> 1412 force false 
2020/12/19 23:02:59 Index is now active
2020-12-19T23:02:59.191+05:30 [Info] CreateIndex default _default _default index_company_name_age ...
2020-12-19T23:02:59.192+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:02:59.192+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age)
2020-12-19T23:02:59.314+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:59.314+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:59.332+05:30 [Info] switched currmeta from 1412 -> 1412 force true 
2020-12-19T23:02:59.334+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:59.334+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:59.341+05:30 [Info] switched currmeta from 1407 -> 1408 force true 
2020-12-19T23:02:59.353+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:02:59.788+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:02:59.820+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:02:59.820+05:30 [Info] Score: 0
2020-12-19T23:02:59.820+05:30 [Info] variation: 0
2020-12-19T23:02:59.820+05:30 [Info] ElapsedTime: 4ms
2020-12-19T23:02:59.820+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:02:59.820+05:30 [Info] Iteration: 0
2020-12-19T23:02:59.820+05:30 [Info] Move: 0
2020-12-19T23:02:59.821+05:30 [Info] ----------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:02:59.821+05:30 [Info] Indexer CPU Mean 0.2120
2020-12-19T23:02:59.821+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Indexer CPU Utilization 0.0530
2020-12-19T23:02:59.821+05:30 [Info] Indexer IO Mean 25688.0000
2020-12-19T23:02:59.821+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Drain Rate Mean 76.0000
2020-12-19T23:02:59.821+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:02:59.821+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Data Size Mean 1269822418 (1.18261G)
2020-12-19T23:02:59.821+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:02:59.821+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:02:59.821+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:02:59.821+05:30 [Info] ----------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] Number of indexes: 4
2020-12-19T23:02:59.821+05:30 [Info] Number of indexers: 1
2020-12-19T23:02:59.821+05:30 [Info] Avg Index Size: 314572800 (300M)
2020-12-19T23:02:59.821+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:02:59.821+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:02:59.821+05:30 [Info] Avg Index Cpu: 0.0530
2020-12-19T23:02:59.821+05:30 [Info] Max Index Cpu: 0.2120
2020-12-19T23:02:59.821+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:02:59.821+05:30 [Info] ----------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:02:59.821+05:30 [Info] CPU Quota 4
2020-12-19T23:02:59.821+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:02:59.821+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:02:59.821+05:30 [Info] ----------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] Total iteration: 0
2020-12-19T23:02:59.821+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:02:59.821+05:30 [Info] RandomSwap call: 0
2020-12-19T23:02:59.821+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:02:59.821+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:02:59.821+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:02:59.821+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:02:59.821+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:02:59.821+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:02:59.821+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:02:59.821+05:30 [Info] ----------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] 
2020-12-19T23:02:59.821+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:02:59.821+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1260597443 (1.17402G), data:1269822418 (1.18261G) cpu:0.2120, io:25688 (25.0859K), scan:0 drain:76 numIndexes:4
2020-12-19T23:02:59.821+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:02:59.821+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:02:59.821+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1007949 (984.325K), data:5039747 (4.80628M) cpu:0.2120 io:25688 (25.0859K) scan:0 drain:76
2020-12-19T23:02:59.821+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:59.821+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:12537410122124782069, Partition: 0, new/moved:false
2020-12-19T23:02:59.821+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:680229 (664.286K), data:3401146 (3.24359M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:59.821+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:59.821+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] 		Index name:index_company 0, bucket:default, scope:_default, collection:_default, defnId:2050097040540024436, instId:9740468495484545929, Partition: 0, new/moved:false
2020-12-19T23:02:59.821+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:618065 (603.579K), data:3090325 (2.94716M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:59.821+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:59.821+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:02:59.821+05:30 [Info] 		Index name:index_company_name_age 0, bucket:default, scope:_default, collection:_default, defnId:7111658774384919555, instId:9423469251979457783, Partition: 0, new/moved:true
2020-12-19T23:02:59.821+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:02:59.821+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:02:59.821+05:30 [Info] ****************************************
2020-12-19T23:02:59.822+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:02:59.942+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:59.942+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:59.947+05:30 [Info] switched currmeta from 1408 -> 1413 force true 
2020-12-19T23:02:59.954+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:02:59.954+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:02:59.972+05:30 [Info] switched currmeta from 1412 -> 1417 force true 
2020-12-19T23:03:00.036+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:00.036+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:00.044+05:30 [Info] switched currmeta from 1413 -> 1413 force true 
2020-12-19T23:03:00.049+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:00.049+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:00.055+05:30 [Info] switched currmeta from 1417 -> 1417 force true 
2020-12-19T23:03:01.954+05:30 [Info] Rollback time has changed for index inst 9740468495484545929. New rollback time 1608399143439404872
2020-12-19T23:03:01.954+05:30 [Info] Rollback time has changed for index inst 9740468495484545929. New rollback time 1608399143439404872
2020-12-19T23:03:03.409+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:03.409+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:03.412+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:03.412+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:03.413+05:30 [Info] switched currmeta from 1417 -> 1418 force true 
2020-12-19T23:03:03.415+05:30 [Info] switched currmeta from 1413 -> 1414 force true 
2020-12-19T23:03:03.649+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:03:03.692+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:03.692+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:03.694+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:03.694+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:03.695+05:30 [Info] switched currmeta from 1418 -> 1418 force true 
2020-12-19T23:03:03.697+05:30 [Info] switched currmeta from 1414 -> 1414 force true 
2020-12-19T23:03:04.120+05:30 [Info] CreateIndex 7111658774384919555 default _default _default/index_company_name_age using:forestdb exprType:N1QL whereExpr:() secExprs:([`company` `name` `age`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.928700267s) err()
2020/12/19 23:03:04 Created the secondary index index_company_name_age. Waiting for it become active
2020-12-19T23:03:04.120+05:30 [Info] metadata provider version changed 1418 -> 1419
2020-12-19T23:03:04.120+05:30 [Info] switched currmeta from 1418 -> 1419 force false 
2020/12/19 23:03:04 Index is now active
2020-12-19T23:03:04.120+05:30 [Info] CreateIndex default _default _default index_primary ...
2020-12-19T23:03:04.120+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:03:04.122+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_primary)
2020-12-19T23:03:04.243+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.243+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.243+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.243+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.251+05:30 [Info] switched currmeta from 1419 -> 1419 force true 
2020-12-19T23:03:04.252+05:30 [Info] switched currmeta from 1414 -> 1415 force true 
2020-12-19T23:03:04.284+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:03:04.675+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:03:04.696+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:03:04.696+05:30 [Info] Score: 0
2020-12-19T23:03:04.696+05:30 [Info] variation: 0
2020-12-19T23:03:04.696+05:30 [Info] ElapsedTime: 4ms
2020-12-19T23:03:04.696+05:30 [Info] ConvergenceTime: 3us
2020-12-19T23:03:04.696+05:30 [Info] Iteration: 0
2020-12-19T23:03:04.696+05:30 [Info] Move: 0
2020-12-19T23:03:04.696+05:30 [Info] ----------------------------------------
2020-12-19T23:03:04.696+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:03:04.696+05:30 [Info] Indexer CPU Mean 0.2120
2020-12-19T23:03:04.696+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Indexer CPU Utilization 0.0530
2020-12-19T23:03:04.696+05:30 [Info] Indexer IO Mean 25688.0000
2020-12-19T23:03:04.696+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Drain Rate Mean 76.0000
2020-12-19T23:03:04.696+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:03:04.696+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Data Size Mean 1273396973 (1.18594G)
2020-12-19T23:03:04.696+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:03:04.696+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:03:04.696+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:04.696+05:30 [Info] ----------------------------------------
2020-12-19T23:03:04.696+05:30 [Info] Number of indexes: 5
2020-12-19T23:03:04.696+05:30 [Info] Number of indexers: 1
2020-12-19T23:03:04.696+05:30 [Info] Avg Index Size: 251658240 (240M)
2020-12-19T23:03:04.696+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:03:04.696+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:03:04.696+05:30 [Info] Avg Index Cpu: 0.0424
2020-12-19T23:03:04.697+05:30 [Info] Max Index Cpu: 0.2120
2020-12-19T23:03:04.697+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:03:04.697+05:30 [Info] ----------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:03:04.697+05:30 [Info] CPU Quota 4
2020-12-19T23:03:04.697+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:03:04.697+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:03:04.697+05:30 [Info] ----------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] Total iteration: 0
2020-12-19T23:03:04.697+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:03:04.697+05:30 [Info] RandomSwap call: 0
2020-12-19T23:03:04.697+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:03:04.697+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:03:04.697+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:03:04.697+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:03:04.697+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:03:04.697+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:03:04.697+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:03:04.697+05:30 [Info] ----------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 
2020-12-19T23:03:04.697+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:03:04.697+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1261312354 (1.17469G), data:1273396973 (1.18594G) cpu:0.2120, io:25688 (25.0859K), scan:0 drain:76 numIndexes:5
2020-12-19T23:03:04.697+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:03:04.697+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:03:04.697+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1007949 (984.325K), data:5039747 (4.80628M) cpu:0.2120 io:25688 (25.0859K) scan:0 drain:76
2020-12-19T23:03:04.697+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:04.697+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:12537410122124782069, Partition: 0, new/moved:false
2020-12-19T23:03:04.697+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:680229 (664.286K), data:3401146 (3.24359M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:04.697+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:04.697+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 		Index name:index_company 0, bucket:default, scope:_default, collection:_default, defnId:2050097040540024436, instId:9740468495484545929, Partition: 0, new/moved:false
2020-12-19T23:03:04.697+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:618065 (603.579K), data:3090325 (2.94716M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:04.697+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:04.697+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 		Index name:index_company_name_age 0, bucket:default, scope:_default, collection:_default, defnId:7111658774384919555, instId:254055817519369773, Partition: 0, new/moved:false
2020-12-19T23:03:04.697+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:714911 (698.155K), data:3574555 (3.40896M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:04.697+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:04.697+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:04.697+05:30 [Info] 		Index name:index_primary 0, bucket:default, scope:_default, collection:_default, defnId:4206478167778138938, instId:3735826480296220913, Partition: 0, new/moved:true
2020-12-19T23:03:04.697+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:04.697+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:04.697+05:30 [Info] ****************************************
2020-12-19T23:03:04.697+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:03:04.806+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.806+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.808+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.808+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.817+05:30 [Info] switched currmeta from 1419 -> 1424 force true 
2020-12-19T23:03:04.827+05:30 [Info] switched currmeta from 1415 -> 1420 force true 
2020-12-19T23:03:04.915+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.915+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.920+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:04.920+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:04.923+05:30 [Info] switched currmeta from 1420 -> 1420 force true 
2020-12-19T23:03:04.925+05:30 [Info] switched currmeta from 1424 -> 1424 force true 
2020-12-19T23:03:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T23:03:06.279+05:30 [Info] index 15853951420629628285 has replicas [12537410122124782069]: 
2020-12-19T23:03:06.279+05:30 [Info] index 4206478167778138938 has replicas [3532283846338399242]: 
2020-12-19T23:03:06.279+05:30 [Info] index 7111658774384919555 has replicas [254055817519369773]: 
2020-12-19T23:03:06.279+05:30 [Info] index 8780330031282456093 has replicas [2222117509277422615]: 
2020-12-19T23:03:06.279+05:30 [Info] index 2050097040540024436 has replicas [9740468495484545929]: 
2020-12-19T23:03:06.279+05:30 [Info] index 4206478167778138938 has equivalents [4206478167778138938]: 
2020-12-19T23:03:06.279+05:30 [Info] index 7111658774384919555 has equivalents [7111658774384919555]: 
2020-12-19T23:03:06.279+05:30 [Info] index 8780330031282456093 has equivalents [8780330031282456093]: 
2020-12-19T23:03:06.279+05:30 [Info] index 2050097040540024436 has equivalents [2050097040540024436]: 
2020-12-19T23:03:06.279+05:30 [Info] index 15853951420629628285 has equivalents [15853951420629628285]: 
2020-12-19T23:03:06.279+05:30 [Info] client load stats {"3532283846338399242": 0,"254055817519369773": 0,"2222117509277422615": 0,"9740468495484545929": 0,"12537410122124782069": 0}
2020-12-19T23:03:06.279+05:30 [Info] client hit stats {"3532283846338399242": 0,"254055817519369773": 0,"2222117509277422615": 0,"9740468495484545929": 0,"12537410122124782069": 0}
2020-12-19T23:03:06.279+05:30 [Info] client pending item stats {"9740468495484545929": 9223372036854775807,"12537410122124782069": 9223372036854775807,"3532283846338399242": -2,"254055817519369773": -2,"2222117509277422615": 9223372036854775807}
2020-12-19T23:03:06.279+05:30 [Info] client stats current {"9740468495484545929": true,"12537410122124782069": true,"3532283846338399242": true,"254055817519369773": true,"2222117509277422615": true}
2020-12-19T23:03:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T23:03:06.284+05:30 [Info] average scan response {7178 ms}
2020-12-19T23:03:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T23:03:06.827+05:30 [Info] index 7111658774384919555 has replicas [254055817519369773]: 
2020-12-19T23:03:06.827+05:30 [Info] index 8780330031282456093 has replicas [2222117509277422615]: 
2020-12-19T23:03:06.827+05:30 [Info] index 4206478167778138938 has replicas [3532283846338399242]: 
2020-12-19T23:03:06.827+05:30 [Info] index 15853951420629628285 has replicas [12537410122124782069]: 
2020-12-19T23:03:06.827+05:30 [Info] index 2050097040540024436 has replicas [9740468495484545929]: 
2020-12-19T23:03:06.827+05:30 [Info] index 2050097040540024436 has equivalents [2050097040540024436]: 
2020-12-19T23:03:06.827+05:30 [Info] index 7111658774384919555 has equivalents [7111658774384919555]: 
2020-12-19T23:03:06.827+05:30 [Info] index 8780330031282456093 has equivalents [8780330031282456093]: 
2020-12-19T23:03:06.827+05:30 [Info] index 4206478167778138938 has equivalents [4206478167778138938]: 
2020-12-19T23:03:06.827+05:30 [Info] index 15853951420629628285 has equivalents [15853951420629628285]: 
2020-12-19T23:03:06.827+05:30 [Info] client load stats {"2222117509277422615": 5.432603815078125e+08,"3532283846338399242": 0,"12537410122124782069": 0,"9740468495484545929": 0,"254055817519369773": 0}
2020-12-19T23:03:06.827+05:30 [Info] client hit stats {"3532283846338399242": 0,"12537410122124782069": 0,"9740468495484545929": 0,"254055817519369773": 0,"2222117509277422615": 7}
2020-12-19T23:03:06.827+05:30 [Info] client pending item stats {"9740468495484545929": 9223372036854775807,"254055817519369773": -2,"2222117509277422615": 9223372036854775807,"3532283846338399242": -2,"12537410122124782069": 9223372036854775807}
2020-12-19T23:03:06.827+05:30 [Info] client stats current {"254055817519369773": true,"2222117509277422615": true,"3532283846338399242": true,"12537410122124782069": true,"9740468495484545929": true}
2020-12-19T23:03:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T23:03:06.830+05:30 [Info] average scan response {3045 ms}
2020-12-19T23:03:06.957+05:30 [Info] Rollback time has changed for index inst 254055817519369773. New rollback time 1608399143439404872
2020-12-19T23:03:06.957+05:30 [Info] Rollback time has changed for index inst 254055817519369773. New rollback time 1608399143439404872
2020-12-19T23:03:07.857+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:07.857+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:07.860+05:30 [Info] switched currmeta from 1424 -> 1425 force true 
2020-12-19T23:03:07.865+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:07.865+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:07.867+05:30 [Info] switched currmeta from 1420 -> 1421 force true 
2020-12-19T23:03:08.533+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2020-12-19T23:03:08.595+05:30 [Info] CreateIndex 4206478167778138938 default _default _default/index_primary using:forestdb exprType:N1QL whereExpr:() secExprs:([]) desc:[] isPrimary:true scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.475128782s) err()
2020/12/19 23:03:08 Created the secondary index index_primary. Waiting for it become active
2020-12-19T23:03:08.595+05:30 [Info] metadata provider version changed 1425 -> 1426
2020-12-19T23:03:08.595+05:30 [Info] switched currmeta from 1425 -> 1426 force false 
2020/12/19 23:03:08 Index is now active
2020-12-19T23:03:08.596+05:30 [Info] CreateIndex default _default _default index_company_name_age_address ...
2020-12-19T23:03:08.597+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:03:08.597+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age_address)
2020-12-19T23:03:08.719+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:08.719+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:08.721+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:03:08.724+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:08.724+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:08.729+05:30 [Info] switched currmeta from 1421 -> 1422 force true 
2020-12-19T23:03:08.731+05:30 [Info] switched currmeta from 1426 -> 1426 force true 
2020-12-19T23:03:08.810+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:08.810+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:08.820+05:30 [Info] switched currmeta from 1426 -> 1426 force true 
2020-12-19T23:03:08.824+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:08.824+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:08.828+05:30 [Info] switched currmeta from 1422 -> 1422 force true 
2020-12-19T23:03:08.859+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:03:09.117+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 2
2020-12-19T23:03:09.244+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:03:09.322+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:03:09.323+05:30 [Info] Score: 0
2020-12-19T23:03:09.323+05:30 [Info] variation: 0
2020-12-19T23:03:09.323+05:30 [Info] ElapsedTime: 61ms
2020-12-19T23:03:09.323+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:03:09.323+05:30 [Info] Iteration: 0
2020-12-19T23:03:09.323+05:30 [Info] Move: 0
2020-12-19T23:03:09.323+05:30 [Info] ----------------------------------------
2020-12-19T23:03:09.323+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:03:09.323+05:30 [Info] Indexer CPU Mean 0.2120
2020-12-19T23:03:09.323+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Indexer CPU Utilization 0.0530
2020-12-19T23:03:09.323+05:30 [Info] Indexer IO Mean 25688.0000
2020-12-19T23:03:09.323+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Drain Rate Mean 76.0000
2020-12-19T23:03:09.323+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:03:09.323+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Data Size Mean 1274538042 (1.18701G)
2020-12-19T23:03:09.323+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:03:09.323+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:03:09.323+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:09.323+05:30 [Info] ----------------------------------------
2020-12-19T23:03:09.323+05:30 [Info] Number of indexes: 6
2020-12-19T23:03:09.323+05:30 [Info] Number of indexers: 1
2020-12-19T23:03:09.323+05:30 [Info] Avg Index Size: 209715200 (200M)
2020-12-19T23:03:09.323+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:03:09.323+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:03:09.323+05:30 [Info] Avg Index Cpu: 0.0353
2020-12-19T23:03:09.323+05:30 [Info] Max Index Cpu: 0.2120
2020-12-19T23:03:09.323+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:03:09.323+05:30 [Info] ----------------------------------------
2020-12-19T23:03:09.323+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:03:09.323+05:30 [Info] CPU Quota 4
2020-12-19T23:03:09.323+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:03:09.323+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:03:09.323+05:30 [Info] ----------------------------------------
2020-12-19T23:03:09.323+05:30 [Info] Total iteration: 0
2020-12-19T23:03:09.323+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:03:09.323+05:30 [Info] RandomSwap call: 0
2020-12-19T23:03:09.323+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:03:09.323+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:03:09.323+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:03:09.323+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:03:09.323+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:03:09.323+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:03:09.323+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:03:09.323+05:30 [Info] ----------------------------------------
2020-12-19T23:03:09.323+05:30 [Info] 
2020-12-19T23:03:09.323+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:03:09.323+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1261540567 (1.1749G), data:1274538042 (1.18701G) cpu:0.2120, io:25688 (25.0859K), scan:0 drain:76 numIndexes:6
2020-12-19T23:03:09.324+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:index_company 0, bucket:default, scope:_default, collection:_default, defnId:2050097040540024436, instId:9740468495484545929, Partition: 0, new/moved:false
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:618065 (603.579K), data:3090325 (2.94716M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:index_company_name_age 0, bucket:default, scope:_default, collection:_default, defnId:7111658774384919555, instId:254055817519369773, Partition: 0, new/moved:false
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:714911 (698.155K), data:3574555 (3.40896M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:index_primary 0, bucket:default, scope:_default, collection:_default, defnId:4206478167778138938, instId:3532283846338399242, Partition: 0, new/moved:false
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:228213 (222.864K), data:1141069 (1.08821M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1007949 (984.325K), data:5039747 (4.80628M) cpu:0.2120 io:25688 (25.0859K) scan:0 drain:76
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:12537410122124782069, Partition: 0, new/moved:false
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:680229 (664.286K), data:3401146 (3.24359M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:09.324+05:30 [Info] 		Index name:index_company_name_age_address 0, bucket:default, scope:_default, collection:_default, defnId:2488735839005813691, instId:9774049747190793678, Partition: 0, new/moved:true
2020-12-19T23:03:09.324+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:09.324+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:09.324+05:30 [Info] ****************************************
2020-12-19T23:03:09.324+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:03:09.440+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:09.440+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:09.442+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:09.442+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:09.449+05:30 [Info] switched currmeta from 1426 -> 1431 force true 
2020-12-19T23:03:09.452+05:30 [Info] switched currmeta from 1422 -> 1427 force true 
2020-12-19T23:03:09.523+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:09.523+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:09.531+05:30 [Info] switched currmeta from 1431 -> 1431 force true 
2020-12-19T23:03:09.535+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:09.535+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:09.549+05:30 [Info] switched currmeta from 1427 -> 1427 force true 
2020-12-19T23:03:11.954+05:30 [Info] Rollback time has changed for index inst 3532283846338399242. New rollback time 1608399143439404872
2020-12-19T23:03:11.954+05:30 [Info] Rollback time has changed for index inst 3532283846338399242. New rollback time 1608399143439404872
2020-12-19T23:03:12.917+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:12.917+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:12.918+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:12.918+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:12.919+05:30 [Info] switched currmeta from 1427 -> 1428 force true 
2020-12-19T23:03:12.921+05:30 [Info] switched currmeta from 1431 -> 1432 force true 
2020-12-19T23:03:13.653+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:03:13.694+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:13.694+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:13.699+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:13.699+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:13.705+05:30 [Info] switched currmeta from 1428 -> 1428 force true 
2020-12-19T23:03:13.710+05:30 [Info] CreateIndex 2488735839005813691 default _default _default/index_company_name_age_address using:forestdb exprType:N1QL whereExpr:() secExprs:([`company` `name` `age` `address`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(5.113640996s) err()
2020/12/19 23:03:13 Created the secondary index index_company_name_age_address. Waiting for it become active
2020-12-19T23:03:13.710+05:30 [Info] metadata provider version changed 1432 -> 1433
2020-12-19T23:03:13.710+05:30 [Info] switched currmeta from 1432 -> 1433 force false 
2020/12/19 23:03:13 Index is now active
2020-12-19T23:03:13.710+05:30 [Info] CreateIndex default _default _default index_company_name_age_address_friends ...
2020-12-19T23:03:13.711+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:03:13.712+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age_address_friends)
2020-12-19T23:03:13.723+05:30 [Info] switched currmeta from 1433 -> 1433 force true 
2020-12-19T23:03:13.868+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:13.868+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:13.877+05:30 [Info] switched currmeta from 1428 -> 1429 force true 
2020-12-19T23:03:13.883+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:13.883+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:13.886+05:30 [Info] switched currmeta from 1433 -> 1433 force true 
2020-12-19T23:03:13.940+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:03:14.280+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:03:14.303+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:03:14.303+05:30 [Info] Score: 0
2020-12-19T23:03:14.303+05:30 [Info] variation: 0
2020-12-19T23:03:14.303+05:30 [Info] ElapsedTime: 5ms
2020-12-19T23:03:14.303+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:03:14.303+05:30 [Info] Iteration: 0
2020-12-19T23:03:14.303+05:30 [Info] Move: 0
2020-12-19T23:03:14.303+05:30 [Info] ----------------------------------------
2020-12-19T23:03:14.303+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:03:14.303+05:30 [Info] Indexer CPU Mean 0.2120
2020-12-19T23:03:14.303+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Indexer CPU Utilization 0.0530
2020-12-19T23:03:14.303+05:30 [Info] Indexer IO Mean 25688.0000
2020-12-19T23:03:14.303+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Drain Rate Mean 76.0000
2020-12-19T23:03:14.303+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:03:14.303+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Data Size Mean 1280165189 (1.19225G)
2020-12-19T23:03:14.303+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:03:14.303+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:03:14.303+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:03:14.303+05:30 [Info] ----------------------------------------
2020-12-19T23:03:14.303+05:30 [Info] Number of indexes: 7
2020-12-19T23:03:14.303+05:30 [Info] Number of indexers: 1
2020-12-19T23:03:14.303+05:30 [Info] Avg Index Size: 179755885 (171.429M)
2020-12-19T23:03:14.303+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:03:14.303+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:03:14.303+05:30 [Info] Avg Index Cpu: 0.0303
2020-12-19T23:03:14.303+05:30 [Info] Max Index Cpu: 0.2120
2020-12-19T23:03:14.303+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:03:14.303+05:30 [Info] ----------------------------------------
2020-12-19T23:03:14.303+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:03:14.303+05:30 [Info] CPU Quota 4
2020-12-19T23:03:14.303+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:03:14.303+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:03:14.303+05:30 [Info] ----------------------------------------
2020-12-19T23:03:14.303+05:30 [Info] Total iteration: 0
2020-12-19T23:03:14.303+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:03:14.303+05:30 [Info] RandomSwap call: 0
2020-12-19T23:03:14.303+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:03:14.303+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:03:14.303+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:03:14.303+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:03:14.303+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:03:14.303+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:03:14.303+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:03:14.304+05:30 [Info] ----------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 
2020-12-19T23:03:14.304+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:95859b656856b6b544ba14566bcdc5f6, useLiveData:true
2020-12-19T23:03:14.304+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1262665996 (1.17595G), data:1280165189 (1.19225G) cpu:0.2120, io:25688 (25.0859K), scan:0 drain:76 numIndexes:7
2020-12-19T23:03:14.304+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:addressidx 0, bucket:default, scope:_default, collection:_default, defnId:8780330031282456093, instId:2222117509277422615, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1007949 (984.325K), data:5039747 (4.80628M) cpu:0.2120 io:25688 (25.0859K) scan:0 drain:76
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_companyname 0, bucket:default, scope:_default, collection:_default, defnId:15853951420629628285, instId:12537410122124782069, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:680229 (664.286K), data:3401146 (3.24359M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_company 0, bucket:default, scope:_default, collection:_default, defnId:2050097040540024436, instId:9740468495484545929, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:618065 (603.579K), data:3090325 (2.94716M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_company_name_age 0, bucket:default, scope:_default, collection:_default, defnId:7111658774384919555, instId:254055817519369773, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:714911 (698.155K), data:3574555 (3.40896M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_primary 0, bucket:default, scope:_default, collection:_default, defnId:4206478167778138938, instId:3532283846338399242, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:228213 (222.864K), data:1141069 (1.08821M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_company_name_age_address 0, bucket:default, scope:_default, collection:_default, defnId:2488735839005813691, instId:11781613617869600133, Partition: 0, new/moved:false
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:1125429 (1.07329M), data:5627147 (5.36647M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:03:14.304+05:30 [Info] 		Index name:index_company_name_age_address_friends 0, bucket:default, scope:_default, collection:_default, defnId:8779397216206759025, instId:3155164327952921805, Partition: 0, new/moved:true
2020-12-19T23:03:14.304+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:03:14.304+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:03:14.304+05:30 [Info] ****************************************
2020-12-19T23:03:14.304+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:03:14.392+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:14.392+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:14.393+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:14.393+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:14.398+05:30 [Info] switched currmeta from 1433 -> 1438 force true 
2020-12-19T23:03:14.399+05:30 [Info] switched currmeta from 1429 -> 1434 force true 
2020-12-19T23:03:14.478+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:14.478+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:14.481+05:30 [Info] switched currmeta from 1438 -> 1438 force true 
2020-12-19T23:03:14.484+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:14.484+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:14.487+05:30 [Info] switched currmeta from 1434 -> 1434 force true 
2020-12-19T23:03:16.958+05:30 [Info] Rollback time has changed for index inst 11781613617869600133. New rollback time 1608399143439404872
2020-12-19T23:03:16.958+05:30 [Info] Rollback time has changed for index inst 11781613617869600133. New rollback time 1608399143439404872
2020-12-19T23:03:18.265+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.265+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.266+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.266+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.269+05:30 [Info] switched currmeta from 1438 -> 1439 force true 
2020-12-19T23:03:18.270+05:30 [Info] switched currmeta from 1434 -> 1435 force true 
2020-12-19T23:03:18.657+05:30 [Info] CreateIndex 8779397216206759025 default _default _default/index_company_name_age_address_friends using:forestdb exprType:N1QL whereExpr:() secExprs:([`company` `name` `age` `address` `friends`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.946368048s) err()
2020/12/19 23:03:18 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2020-12-19T23:03:18.657+05:30 [Info] metadata provider version changed 1439 -> 1440
2020-12-19T23:03:18.657+05:30 [Info] switched currmeta from 1439 -> 1440 force false 
2020/12/19 23:03:18 Index is now active
--- PASS: TestMultiScanSetup (79.92s)
=== RUN   TestMultiScanCount
2020/12/19 23:03:18 In TestMultiScanCount()
2020/12/19 23:03:18 

--------- Composite Index with 2 fields ---------
2020/12/19 23:03:18 
--- ScanAllNoFilter ---
2020/12/19 23:03:18 distinct = false
2020-12-19T23:03:18.716+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:03:18.849+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.850+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.853+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.853+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.857+05:30 [Info] switched currmeta from 1435 -> 1436 force true 
2020-12-19T23:03:18.868+05:30 [Info] switched currmeta from 1440 -> 1440 force true 
2020-12-19T23:03:18.938+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.938+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.941+05:30 [Info] switched currmeta from 1436 -> 1436 force true 
2020-12-19T23:03:18.942+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:03:18.942+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:03:18.944+05:30 [Info] switched currmeta from 1440 -> 1440 force true 
2020/12/19 23:03:19 Using n1ql client
2020-12-19T23:03:19.286+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020/12/19 23:03:19 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:19 
--- ScanAllFilterNil ---
2020/12/19 23:03:19 distinct = false
2020/12/19 23:03:19 Using n1ql client
2020/12/19 23:03:20 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:20 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:03:20 distinct = false
2020/12/19 23:03:20 Using n1ql client
2020/12/19 23:03:20 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:20 
--- SingleSeek ---
2020/12/19 23:03:20 distinct = false
2020/12/19 23:03:21 Using n1ql client
2020/12/19 23:03:21 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:03:21 
--- MultipleSeek ---
2020/12/19 23:03:21 distinct = false
2020/12/19 23:03:21 Using n1ql client
2020/12/19 23:03:21 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:03:21 
--- SimpleRange ---
2020/12/19 23:03:21 distinct = false
2020/12/19 23:03:22 Using n1ql client
2020/12/19 23:03:22 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2020/12/19 23:03:22 
--- NonOverlappingRanges ---
2020/12/19 23:03:22 distinct = false
2020/12/19 23:03:22 Using n1ql client
2020/12/19 23:03:22 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2020/12/19 23:03:22 
--- OverlappingRanges ---
2020/12/19 23:03:22 distinct = false
2020/12/19 23:03:23 Using n1ql client
2020/12/19 23:03:23 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2020/12/19 23:03:23 
--- NonOverlappingFilters ---
2020/12/19 23:03:23 distinct = false
2020/12/19 23:03:24 Using n1ql client
2020/12/19 23:03:24 MultiScanCount = 337 ExpectedMultiScanCount = 337
2020/12/19 23:03:24 
--- OverlappingFilters ---
2020/12/19 23:03:24 distinct = false
2020/12/19 23:03:24 Using n1ql client
2020/12/19 23:03:24 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2020/12/19 23:03:24 
--- BoundaryFilters ---
2020/12/19 23:03:24 distinct = false
2020/12/19 23:03:25 Using n1ql client
2020/12/19 23:03:25 MultiScanCount = 499 ExpectedMultiScanCount = 499
2020/12/19 23:03:25 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:03:25 distinct = false
2020/12/19 23:03:25 Using n1ql client
2020/12/19 23:03:25 MultiScanCount = 256 ExpectedMultiScanCount = 256
2020/12/19 23:03:25 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:03:25 distinct = false
2020/12/19 23:03:26 Using n1ql client
2020/12/19 23:03:26 MultiScanCount = 255 ExpectedMultiScanCount = 255
2020/12/19 23:03:26 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:03:26 distinct = false
2020/12/19 23:03:26 Using n1ql client
2020/12/19 23:03:26 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2020/12/19 23:03:26 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:03:26 distinct = false
2020/12/19 23:03:27 Using n1ql client
2020/12/19 23:03:27 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2020/12/19 23:03:27 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:03:27 distinct = false
2020/12/19 23:03:27 Using n1ql client
2020/12/19 23:03:28 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:28 
--- FiltersWithUnbounded ---
2020/12/19 23:03:28 distinct = false
2020/12/19 23:03:28 Using n1ql client
2020/12/19 23:03:28 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2020/12/19 23:03:28 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:03:28 distinct = false
2020/12/19 23:03:29 Using n1ql client
2020/12/19 23:03:29 MultiScanCount = 418 ExpectedMultiScanCount = 418
2020/12/19 23:03:29 

--------- Simple Index with 1 field ---------
2020/12/19 23:03:29 
--- SingleIndexSimpleRange ---
2020/12/19 23:03:29 distinct = false
2020/12/19 23:03:29 Using n1ql client
2020/12/19 23:03:29 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2020/12/19 23:03:29 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:03:29 distinct = false
2020/12/19 23:03:30 Using n1ql client
2020/12/19 23:03:30 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2020/12/19 23:03:30 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:03:30 distinct = false
2020/12/19 23:03:30 Using n1ql client
2020/12/19 23:03:30 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2020/12/19 23:03:30 

--------- Composite Index with 3 fields ---------
2020/12/19 23:03:30 
--- ScanAllNoFilter ---
2020/12/19 23:03:30 distinct = false
2020/12/19 23:03:31 Using n1ql client
2020/12/19 23:03:31 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:31 
--- ScanAllFilterNil ---
2020/12/19 23:03:31 distinct = false
2020/12/19 23:03:32 Using n1ql client
2020/12/19 23:03:32 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:32 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:03:32 distinct = false
2020/12/19 23:03:32 Using n1ql client
2020/12/19 23:03:33 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:33 
--- 3FieldsSingleSeek ---
2020/12/19 23:03:33 distinct = false
2020/12/19 23:03:33 Using n1ql client
2020/12/19 23:03:33 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:03:33 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:03:33 distinct = false
2020/12/19 23:03:34 Using n1ql client
2020/12/19 23:03:34 MultiScanCount = 3 ExpectedMultiScanCount = 3
2020/12/19 23:03:34 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:03:34 distinct = false
2020/12/19 23:03:34 Using n1ql client
2020/12/19 23:03:34 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:03:34 

--------- New scenarios ---------
2020/12/19 23:03:34 
--- CompIndexHighUnbounded1 ---
2020/12/19 23:03:34 
--- Multi Scan 0 ---
2020/12/19 23:03:34 distinct = false
2020/12/19 23:03:34 Using n1ql client
2020/12/19 23:03:34 Using n1ql client
2020/12/19 23:03:35 len(scanResults) = 8 MultiScanCount = 8
2020/12/19 23:03:35 Expected and Actual scan responses are the same
2020/12/19 23:03:35 
--- Multi Scan 1 ---
2020/12/19 23:03:35 distinct = false
2020/12/19 23:03:35 Using n1ql client
2020/12/19 23:03:35 Using n1ql client
2020/12/19 23:03:35 len(scanResults) = 0 MultiScanCount = 0
2020/12/19 23:03:35 Expected and Actual scan responses are the same
2020/12/19 23:03:35 
--- Multi Scan 2 ---
2020/12/19 23:03:35 distinct = false
2020/12/19 23:03:35 Using n1ql client
2020/12/19 23:03:35 Using n1ql client
2020/12/19 23:03:35 len(scanResults) = 9 MultiScanCount = 9
2020/12/19 23:03:35 Expected and Actual scan responses are the same
2020/12/19 23:03:35 
--- CompIndexHighUnbounded2 ---
2020/12/19 23:03:35 
--- Multi Scan 0 ---
2020/12/19 23:03:35 distinct = false
2020/12/19 23:03:36 Using n1ql client
2020/12/19 23:03:36 Using n1ql client
2020/12/19 23:03:36 len(scanResults) = 4138 MultiScanCount = 4138
2020/12/19 23:03:36 Expected and Actual scan responses are the same
2020/12/19 23:03:36 
--- Multi Scan 1 ---
2020/12/19 23:03:36 distinct = false
2020/12/19 23:03:37 Using n1ql client
2020/12/19 23:03:37 Using n1ql client
2020/12/19 23:03:37 len(scanResults) = 2746 MultiScanCount = 2746
2020/12/19 23:03:37 Expected and Actual scan responses are the same
2020/12/19 23:03:37 
--- Multi Scan 2 ---
2020/12/19 23:03:37 distinct = false
2020/12/19 23:03:37 Using n1ql client
2020/12/19 23:03:37 Using n1ql client
2020/12/19 23:03:38 len(scanResults) = 4691 MultiScanCount = 4691
2020/12/19 23:03:38 Expected and Actual scan responses are the same
2020/12/19 23:03:38 
--- CompIndexHighUnbounded3 ---
2020/12/19 23:03:38 
--- Multi Scan 0 ---
2020/12/19 23:03:38 distinct = false
2020/12/19 23:03:38 Using n1ql client
2020/12/19 23:03:38 Using n1ql client
2020/12/19 23:03:38 len(scanResults) = 1329 MultiScanCount = 1329
2020/12/19 23:03:38 Expected and Actual scan responses are the same
2020/12/19 23:03:38 
--- CompIndexHighUnbounded4 ---
2020/12/19 23:03:38 
--- Multi Scan 0 ---
2020/12/19 23:03:38 distinct = false
2020/12/19 23:03:39 Using n1ql client
2020/12/19 23:03:39 Using n1ql client
2020/12/19 23:03:39 len(scanResults) = 5349 MultiScanCount = 5349
2020/12/19 23:03:39 Expected and Actual scan responses are the same
2020/12/19 23:03:39 
--- CompIndexHighUnbounded5 ---
2020/12/19 23:03:39 
--- Multi Scan 0 ---
2020/12/19 23:03:39 distinct = false
2020/12/19 23:03:39 Using n1ql client
2020/12/19 23:03:40 Using n1ql client
2020/12/19 23:03:40 len(scanResults) = 8210 MultiScanCount = 8210
2020/12/19 23:03:40 Expected and Actual scan responses are the same
2020/12/19 23:03:40 
--- SeekBoundaries ---
2020/12/19 23:03:40 
--- Multi Scan 0 ---
2020/12/19 23:03:40 distinct = false
2020/12/19 23:03:40 Using n1ql client
2020/12/19 23:03:40 Using n1ql client
2020/12/19 23:03:41 len(scanResults) = 175 MultiScanCount = 175
2020/12/19 23:03:41 Expected and Actual scan responses are the same
2020/12/19 23:03:41 
--- Multi Scan 1 ---
2020/12/19 23:03:41 distinct = false
2020/12/19 23:03:41 Using n1ql client
2020/12/19 23:03:41 Using n1ql client
2020/12/19 23:03:41 len(scanResults) = 1 MultiScanCount = 1
2020/12/19 23:03:41 Expected and Actual scan responses are the same
2020/12/19 23:03:41 
--- Multi Scan 2 ---
2020/12/19 23:03:41 distinct = false
2020/12/19 23:03:41 Using n1ql client
2020/12/19 23:03:41 Using n1ql client
2020/12/19 23:03:42 len(scanResults) = 555 MultiScanCount = 555
2020/12/19 23:03:42 Expected and Actual scan responses are the same
2020/12/19 23:03:42 
--- Multi Scan 3 ---
2020/12/19 23:03:42 distinct = false
2020/12/19 23:03:42 Using n1ql client
2020/12/19 23:03:42 Using n1ql client
2020/12/19 23:03:42 len(scanResults) = 872 MultiScanCount = 872
2020/12/19 23:03:42 Expected and Actual scan responses are the same
2020/12/19 23:03:42 
--- Multi Scan 4 ---
2020/12/19 23:03:42 distinct = false
2020/12/19 23:03:43 Using n1ql client
2020/12/19 23:03:43 Using n1ql client
2020/12/19 23:03:43 len(scanResults) = 287 MultiScanCount = 287
2020/12/19 23:03:43 Expected and Actual scan responses are the same
2020/12/19 23:03:43 
--- Multi Scan 5 ---
2020/12/19 23:03:43 distinct = false
2020/12/19 23:03:43 Using n1ql client
2020/12/19 23:03:43 Using n1ql client
2020/12/19 23:03:43 len(scanResults) = 5254 MultiScanCount = 5254
2020/12/19 23:03:44 Expected and Actual scan responses are the same
2020/12/19 23:03:44 
--- Multi Scan 6 ---
2020/12/19 23:03:44 distinct = false
2020/12/19 23:03:44 Using n1ql client
2020/12/19 23:03:44 Using n1ql client
2020/12/19 23:03:44 len(scanResults) = 5566 MultiScanCount = 5566
2020/12/19 23:03:44 Expected and Actual scan responses are the same
2020/12/19 23:03:44 
--- Multi Scan 7 ---
2020/12/19 23:03:44 distinct = false
2020/12/19 23:03:45 Using n1ql client
2020/12/19 23:03:45 Using n1ql client
2020/12/19 23:03:45 len(scanResults) = 8 MultiScanCount = 8
2020/12/19 23:03:45 Expected and Actual scan responses are the same
2020/12/19 23:03:45 

--------- With DISTINCT True ---------
2020/12/19 23:03:45 
--- ScanAllNoFilter ---
2020/12/19 23:03:45 distinct = true
2020/12/19 23:03:45 Using n1ql client
2020/12/19 23:03:45 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:45 
--- ScanAllFilterNil ---
2020/12/19 23:03:45 distinct = true
2020/12/19 23:03:46 Using n1ql client
2020/12/19 23:03:46 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:46 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:03:46 distinct = true
2020/12/19 23:03:46 Using n1ql client
2020/12/19 23:03:47 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:47 
--- SingleSeek ---
2020/12/19 23:03:47 distinct = true
2020/12/19 23:03:47 Using n1ql client
2020/12/19 23:03:47 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:03:47 
--- MultipleSeek ---
2020/12/19 23:03:47 distinct = true
2020/12/19 23:03:48 Using n1ql client
2020/12/19 23:03:48 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:03:48 
--- SimpleRange ---
2020/12/19 23:03:48 distinct = true
2020/12/19 23:03:48 Using n1ql client
2020/12/19 23:03:48 MultiScanCount = 227 ExpectedMultiScanCount = 227
2020/12/19 23:03:48 
--- NonOverlappingRanges ---
2020/12/19 23:03:48 distinct = true
2020/12/19 23:03:49 Using n1ql client
2020/12/19 23:03:49 MultiScanCount = 428 ExpectedMultiScanCount = 428
2020/12/19 23:03:49 
--- OverlappingRanges ---
2020/12/19 23:03:49 distinct = true
2020/12/19 23:03:49 Using n1ql client
2020/12/19 23:03:49 MultiScanCount = 575 ExpectedMultiScanCount = 575
2020/12/19 23:03:49 
--- NonOverlappingFilters ---
2020/12/19 23:03:49 distinct = true
2020/12/19 23:03:50 Using n1ql client
2020/12/19 23:03:50 MultiScanCount = 186 ExpectedMultiScanCount = 186
2020/12/19 23:03:50 
--- NonOverlappingFilters2 ---
2020/12/19 23:03:50 distinct = true
2020/12/19 23:03:50 Using n1ql client
2020/12/19 23:03:50 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:03:50 
--- OverlappingFilters ---
2020/12/19 23:03:50 distinct = true
2020/12/19 23:03:51 Using n1ql client
2020/12/19 23:03:51 MultiScanCount = 543 ExpectedMultiScanCount = 543
2020/12/19 23:03:51 
--- BoundaryFilters ---
2020/12/19 23:03:51 distinct = true
2020/12/19 23:03:51 Using n1ql client
2020/12/19 23:03:51 MultiScanCount = 172 ExpectedMultiScanCount = 172
2020/12/19 23:03:51 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:03:51 distinct = true
2020/12/19 23:03:52 Using n1ql client
2020/12/19 23:03:52 MultiScanCount = 135 ExpectedMultiScanCount = 135
2020/12/19 23:03:52 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:03:52 distinct = true
2020/12/19 23:03:52 Using n1ql client
2020/12/19 23:03:52 MultiScanCount = 134 ExpectedMultiScanCount = 134
2020/12/19 23:03:52 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:03:52 distinct = false
2020/12/19 23:03:53 Using n1ql client
2020/12/19 23:03:53 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2020/12/19 23:03:53 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:03:53 distinct = false
2020/12/19 23:03:53 Using n1ql client
2020/12/19 23:03:53 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2020/12/19 23:03:53 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:03:53 distinct = false
2020/12/19 23:03:54 Using n1ql client
2020/12/19 23:03:54 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:03:54 
--- FiltersWithUnbounded ---
2020/12/19 23:03:54 distinct = false
2020/12/19 23:03:54 Using n1ql client
2020/12/19 23:03:54 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2020/12/19 23:03:54 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:03:54 distinct = false
2020/12/19 23:03:55 Using n1ql client
2020/12/19 23:03:55 MultiScanCount = 418 ExpectedMultiScanCount = 418
2020/12/19 23:03:55 

--------- Simple Index with 1 field ---------
2020/12/19 23:03:55 
--- SingleIndexSimpleRange ---
2020/12/19 23:03:55 distinct = true
2020/12/19 23:03:55 Using n1ql client
2020/12/19 23:03:55 MultiScanCount = 227 ExpectedMultiScanCount = 227
2020/12/19 23:03:55 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:03:55 distinct = true
2020/12/19 23:03:56 Using n1ql client
2020/12/19 23:03:56 MultiScanCount = 713 ExpectedMultiScanCount = 713
2020/12/19 23:03:56 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:03:56 distinct = true
2020/12/19 23:03:56 Using n1ql client
2020/12/19 23:03:56 MultiScanCount = 869 ExpectedMultiScanCount = 869
2020/12/19 23:03:56 

--------- Composite Index with 3 fields ---------
2020/12/19 23:03:56 
--- ScanAllNoFilter ---
2020/12/19 23:03:56 distinct = true
2020/12/19 23:03:57 Using n1ql client
2020/12/19 23:03:57 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:57 
--- ScanAllFilterNil ---
2020/12/19 23:03:57 distinct = true
2020/12/19 23:03:58 Using n1ql client
2020/12/19 23:03:58 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:58 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:03:58 distinct = true
2020/12/19 23:03:58 Using n1ql client
2020/12/19 23:03:58 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:03:58 
--- 3FieldsSingleSeek ---
2020/12/19 23:03:58 distinct = true
2020/12/19 23:03:59 Using n1ql client
2020/12/19 23:03:59 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:03:59 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:03:59 distinct = true
2020/12/19 23:03:59 Using n1ql client
2020/12/19 23:03:59 MultiScanCount = 3 ExpectedMultiScanCount = 3
2020/12/19 23:03:59 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:03:59 distinct = true
2020/12/19 23:04:00 Using n1ql client
2020/12/19 23:04:00 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (41.79s)
=== RUN   TestMultiScanScenarios
2020/12/19 23:04:00 In TestMultiScanScenarios()
2020/12/19 23:04:00 

--------- Composite Index with 2 fields ---------
2020/12/19 23:04:00 
--- ScanAllNoFilter ---
2020/12/19 23:04:00 distinct = false
2020/12/19 23:04:00 Using n1ql client
2020/12/19 23:04:01 Expected and Actual scan responses are the same
2020/12/19 23:04:01 
--- ScanAllFilterNil ---
2020/12/19 23:04:01 distinct = false
2020/12/19 23:04:01 Using n1ql client
2020/12/19 23:04:01 Expected and Actual scan responses are the same
2020/12/19 23:04:01 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:01 distinct = false
2020/12/19 23:04:02 Using n1ql client
2020/12/19 23:04:02 Expected and Actual scan responses are the same
2020/12/19 23:04:02 
--- SingleSeek ---
2020/12/19 23:04:02 distinct = false
2020/12/19 23:04:02 Using n1ql client
2020/12/19 23:04:02 Expected and Actual scan responses are the same
2020/12/19 23:04:02 
--- MultipleSeek ---
2020/12/19 23:04:02 distinct = false
2020/12/19 23:04:03 Using n1ql client
2020/12/19 23:04:03 Expected and Actual scan responses are the same
2020/12/19 23:04:03 
--- SimpleRange ---
2020/12/19 23:04:03 distinct = false
2020/12/19 23:04:03 Using n1ql client
2020/12/19 23:04:03 Expected and Actual scan responses are the same
2020/12/19 23:04:03 
--- NonOverlappingRanges ---
2020/12/19 23:04:03 distinct = false
2020/12/19 23:04:04 Using n1ql client
2020/12/19 23:04:04 Expected and Actual scan responses are the same
2020/12/19 23:04:04 
--- OverlappingRanges ---
2020/12/19 23:04:04 distinct = false
2020/12/19 23:04:04 Using n1ql client
2020/12/19 23:04:04 Expected and Actual scan responses are the same
2020/12/19 23:04:04 
--- NonOverlappingFilters ---
2020/12/19 23:04:04 distinct = false
2020/12/19 23:04:05 Using n1ql client
2020/12/19 23:04:05 Expected and Actual scan responses are the same
2020/12/19 23:04:05 
--- OverlappingFilters ---
2020/12/19 23:04:05 distinct = false
2020/12/19 23:04:05 Using n1ql client
2020/12/19 23:04:05 Expected and Actual scan responses are the same
2020/12/19 23:04:05 
--- BoundaryFilters ---
2020/12/19 23:04:05 distinct = false
2020/12/19 23:04:06 Using n1ql client
2020/12/19 23:04:06 Expected and Actual scan responses are the same
2020/12/19 23:04:06 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:04:06 distinct = false
2020/12/19 23:04:06 Using n1ql client
2020/12/19 23:04:07 Expected and Actual scan responses are the same
2020/12/19 23:04:07 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:04:07 distinct = false
2020/12/19 23:04:07 Using n1ql client
2020/12/19 23:04:07 Expected and Actual scan responses are the same
2020/12/19 23:04:07 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:04:07 distinct = false
2020/12/19 23:04:07 Using n1ql client
2020/12/19 23:04:08 Expected and Actual scan responses are the same
2020/12/19 23:04:08 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:04:08 distinct = false
2020/12/19 23:04:08 Using n1ql client
2020/12/19 23:04:08 Expected and Actual scan responses are the same
2020/12/19 23:04:08 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:04:08 distinct = false
2020/12/19 23:04:08 Using n1ql client
2020/12/19 23:04:09 Expected and Actual scan responses are the same
2020/12/19 23:04:09 
--- FiltersWithUnbounded ---
2020/12/19 23:04:09 distinct = false
2020/12/19 23:04:09 Using n1ql client
2020/12/19 23:04:09 Expected and Actual scan responses are the same
2020/12/19 23:04:09 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:04:09 distinct = false
2020/12/19 23:04:10 Using n1ql client
2020/12/19 23:04:10 Expected and Actual scan responses are the same
2020/12/19 23:04:10 

--------- Simple Index with 1 field ---------
2020/12/19 23:04:10 
--- SingleIndexSimpleRange ---
2020/12/19 23:04:10 distinct = false
2020/12/19 23:04:10 Using n1ql client
2020/12/19 23:04:10 Expected and Actual scan responses are the same
2020/12/19 23:04:10 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:04:10 distinct = false
2020/12/19 23:04:11 Using n1ql client
2020/12/19 23:04:11 Expected and Actual scan responses are the same
2020/12/19 23:04:11 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:04:11 distinct = false
2020/12/19 23:04:11 Using n1ql client
2020/12/19 23:04:11 Expected and Actual scan responses are the same
2020/12/19 23:04:11 

--------- Composite Index with 3 fields ---------
2020/12/19 23:04:11 
--- ScanAllNoFilter ---
2020/12/19 23:04:11 distinct = false
2020/12/19 23:04:12 Using n1ql client
2020/12/19 23:04:12 Expected and Actual scan responses are the same
2020/12/19 23:04:12 
--- ScanAllFilterNil ---
2020/12/19 23:04:12 distinct = false
2020/12/19 23:04:13 Using n1ql client
2020/12/19 23:04:13 Expected and Actual scan responses are the same
2020/12/19 23:04:13 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:13 distinct = false
2020/12/19 23:04:13 Using n1ql client
2020/12/19 23:04:14 Expected and Actual scan responses are the same
2020/12/19 23:04:14 
--- 3FieldsSingleSeek ---
2020/12/19 23:04:14 distinct = false
2020/12/19 23:04:14 Using n1ql client
2020/12/19 23:04:14 Expected and Actual scan responses are the same
2020/12/19 23:04:14 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:04:14 distinct = false
2020/12/19 23:04:15 Using n1ql client
2020/12/19 23:04:15 Expected and Actual scan responses are the same
2020/12/19 23:04:15 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:04:15 distinct = false
2020/12/19 23:04:15 Using n1ql client
2020/12/19 23:04:15 Expected and Actual scan responses are the same
2020/12/19 23:04:15 

--------- New scenarios ---------
2020/12/19 23:04:15 
--- CompIndexHighUnbounded1 ---
2020/12/19 23:04:15 
--- Multi Scan 0 ---
2020/12/19 23:04:15 distinct = false
2020/12/19 23:04:16 Using n1ql client
2020/12/19 23:04:16 Expected and Actual scan responses are the same
2020/12/19 23:04:16 
--- Multi Scan 1 ---
2020/12/19 23:04:16 distinct = false
2020/12/19 23:04:16 Using n1ql client
2020/12/19 23:04:16 Expected and Actual scan responses are the same
2020/12/19 23:04:16 
--- Multi Scan 2 ---
2020/12/19 23:04:16 distinct = false
2020/12/19 23:04:16 Using n1ql client
2020/12/19 23:04:16 Expected and Actual scan responses are the same
2020/12/19 23:04:16 
--- CompIndexHighUnbounded2 ---
2020/12/19 23:04:16 
--- Multi Scan 0 ---
2020/12/19 23:04:16 distinct = false
2020/12/19 23:04:17 Using n1ql client
2020/12/19 23:04:17 Expected and Actual scan responses are the same
2020/12/19 23:04:17 
--- Multi Scan 1 ---
2020/12/19 23:04:17 distinct = false
2020/12/19 23:04:17 Using n1ql client
2020/12/19 23:04:17 Expected and Actual scan responses are the same
2020/12/19 23:04:17 
--- Multi Scan 2 ---
2020/12/19 23:04:17 distinct = false
2020/12/19 23:04:18 Using n1ql client
2020/12/19 23:04:18 Expected and Actual scan responses are the same
2020/12/19 23:04:18 
--- CompIndexHighUnbounded3 ---
2020/12/19 23:04:18 
--- Multi Scan 0 ---
2020/12/19 23:04:18 distinct = false
2020/12/19 23:04:19 Using n1ql client
2020/12/19 23:04:19 Expected and Actual scan responses are the same
2020/12/19 23:04:19 
--- CompIndexHighUnbounded4 ---
2020/12/19 23:04:19 
--- Multi Scan 0 ---
2020/12/19 23:04:19 distinct = false
2020/12/19 23:04:19 Using n1ql client
2020/12/19 23:04:19 Expected and Actual scan responses are the same
2020/12/19 23:04:19 
--- CompIndexHighUnbounded5 ---
2020/12/19 23:04:19 
--- Multi Scan 0 ---
2020/12/19 23:04:19 distinct = false
2020/12/19 23:04:20 Using n1ql client
2020/12/19 23:04:20 Expected and Actual scan responses are the same
2020/12/19 23:04:20 
--- SeekBoundaries ---
2020/12/19 23:04:20 
--- Multi Scan 0 ---
2020/12/19 23:04:20 distinct = false
2020/12/19 23:04:20 Using n1ql client
2020/12/19 23:04:20 Expected and Actual scan responses are the same
2020/12/19 23:04:20 
--- Multi Scan 1 ---
2020/12/19 23:04:20 distinct = false
2020/12/19 23:04:21 Using n1ql client
2020/12/19 23:04:21 Expected and Actual scan responses are the same
2020/12/19 23:04:21 
--- Multi Scan 2 ---
2020/12/19 23:04:21 distinct = false
2020/12/19 23:04:21 Using n1ql client
2020/12/19 23:04:21 Expected and Actual scan responses are the same
2020/12/19 23:04:21 
--- Multi Scan 3 ---
2020/12/19 23:04:21 distinct = false
2020/12/19 23:04:22 Using n1ql client
2020/12/19 23:04:22 Expected and Actual scan responses are the same
2020/12/19 23:04:22 
--- Multi Scan 4 ---
2020/12/19 23:04:22 distinct = false
2020/12/19 23:04:22 Using n1ql client
2020/12/19 23:04:22 Expected and Actual scan responses are the same
2020/12/19 23:04:22 
--- Multi Scan 5 ---
2020/12/19 23:04:22 distinct = false
2020/12/19 23:04:23 Using n1ql client
2020/12/19 23:04:23 Expected and Actual scan responses are the same
2020/12/19 23:04:23 
--- Multi Scan 6 ---
2020/12/19 23:04:23 distinct = false
2020/12/19 23:04:23 Using n1ql client
2020/12/19 23:04:23 Expected and Actual scan responses are the same
2020/12/19 23:04:23 
--- Multi Scan 7 ---
2020/12/19 23:04:23 distinct = false
2020/12/19 23:04:24 Using n1ql client
2020/12/19 23:04:24 Expected and Actual scan responses are the same
2020/12/19 23:04:24 
--- PrefixSortVariations ---
2020/12/19 23:04:24 
--- Multi Scan 0 ---
2020/12/19 23:04:24 distinct = false
2020/12/19 23:04:24 Using n1ql client
2020/12/19 23:04:24 Expected and Actual scan responses are the same
2020/12/19 23:04:24 
--- Multi Scan 1 ---
2020/12/19 23:04:24 distinct = false
2020/12/19 23:04:25 Using n1ql client
2020/12/19 23:04:25 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (25.12s)
=== RUN   TestMultiScanOffset
2020/12/19 23:04:25 In TestMultiScanOffset()
2020/12/19 23:04:25 

--------- Composite Index with 2 fields ---------
2020/12/19 23:04:25 
--- ScanAllNoFilter ---
2020/12/19 23:04:25 distinct = false
2020/12/19 23:04:26 Using n1ql client
2020/12/19 23:04:26 
--- ScanAllFilterNil ---
2020/12/19 23:04:26 distinct = false
2020/12/19 23:04:26 Using n1ql client
2020/12/19 23:04:26 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:26 distinct = false
2020/12/19 23:04:27 Using n1ql client
2020/12/19 23:04:27 
--- SingleSeek ---
2020/12/19 23:04:27 distinct = false
2020/12/19 23:04:27 Using n1ql client
2020/12/19 23:04:27 
--- MultipleSeek ---
2020/12/19 23:04:27 distinct = false
2020/12/19 23:04:28 Using n1ql client
2020/12/19 23:04:28 
--- SimpleRange ---
2020/12/19 23:04:28 distinct = false
2020/12/19 23:04:28 Using n1ql client
2020/12/19 23:04:28 
--- NonOverlappingRanges ---
2020/12/19 23:04:28 distinct = false
2020/12/19 23:04:29 Using n1ql client
2020/12/19 23:04:29 
--- OverlappingRanges ---
2020/12/19 23:04:29 distinct = false
2020/12/19 23:04:29 Using n1ql client
2020/12/19 23:04:29 
--- NonOverlappingFilters ---
2020/12/19 23:04:29 distinct = false
2020/12/19 23:04:30 Using n1ql client
2020/12/19 23:04:30 
--- OverlappingFilters ---
2020/12/19 23:04:30 distinct = false
2020/12/19 23:04:30 Using n1ql client
2020/12/19 23:04:30 
--- BoundaryFilters ---
2020/12/19 23:04:30 distinct = false
2020/12/19 23:04:31 Using n1ql client
2020/12/19 23:04:31 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:04:31 distinct = false
2020/12/19 23:04:31 Using n1ql client
2020/12/19 23:04:31 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:04:31 distinct = false
2020/12/19 23:04:32 Using n1ql client
2020/12/19 23:04:32 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:04:32 distinct = false
2020/12/19 23:04:32 Using n1ql client
2020/12/19 23:04:32 Expected and Actual scan responses are the same
2020/12/19 23:04:32 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:04:32 distinct = false
2020/12/19 23:04:33 Using n1ql client
2020/12/19 23:04:33 Expected and Actual scan responses are the same
2020/12/19 23:04:33 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:04:33 distinct = false
2020/12/19 23:04:33 Using n1ql client
2020/12/19 23:04:34 Expected and Actual scan responses are the same
2020/12/19 23:04:34 
--- FiltersWithUnbounded ---
2020/12/19 23:04:34 distinct = false
2020/12/19 23:04:34 Using n1ql client
2020/12/19 23:04:34 Expected and Actual scan responses are the same
2020/12/19 23:04:34 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:04:34 distinct = false
2020/12/19 23:04:35 Using n1ql client
2020/12/19 23:04:35 Expected and Actual scan responses are the same
2020/12/19 23:04:35 

--------- Simple Index with 1 field ---------
2020/12/19 23:04:35 
--- SingleIndexSimpleRange ---
2020/12/19 23:04:35 distinct = false
2020/12/19 23:04:35 Using n1ql client
2020/12/19 23:04:35 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:04:35 distinct = false
2020/12/19 23:04:35 Using n1ql client
2020/12/19 23:04:36 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:04:36 distinct = false
2020/12/19 23:04:36 Using n1ql client
2020/12/19 23:04:36 

--------- Composite Index with 3 fields ---------
2020/12/19 23:04:36 
--- ScanAllNoFilter ---
2020/12/19 23:04:36 distinct = false
2020/12/19 23:04:37 Using n1ql client
2020/12/19 23:04:37 
--- ScanAllFilterNil ---
2020/12/19 23:04:37 distinct = false
2020/12/19 23:04:37 Using n1ql client
2020/12/19 23:04:37 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:37 distinct = false
2020/12/19 23:04:38 Using n1ql client
2020/12/19 23:04:38 
--- 3FieldsSingleSeek ---
2020/12/19 23:04:38 distinct = false
2020/12/19 23:04:39 Using n1ql client
2020/12/19 23:04:39 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:04:39 distinct = false
2020/12/19 23:04:39 Using n1ql client
2020/12/19 23:04:39 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:04:39 distinct = false
2020/12/19 23:04:40 Using n1ql client
--- PASS: TestMultiScanOffset (14.63s)
=== RUN   TestMultiScanPrimaryIndex
2020/12/19 23:04:40 In TestMultiScanPrimaryIndex()
2020/12/19 23:04:40 
--- PrimaryRange ---
2020/12/19 23:04:40 Using n1ql client
2020/12/19 23:04:40 Expected and Actual scan responses are the same
2020/12/19 23:04:40 
--- PrimaryScanAllNoFilter ---
2020/12/19 23:04:40 Using n1ql client
2020/12/19 23:04:40 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.37s)
=== RUN   TestMultiScanDistinct
2020/12/19 23:04:40 In TestScansDistinct()
2020/12/19 23:04:40 

--------- Composite Index with 2 fields ---------
2020/12/19 23:04:40 
--- ScanAllNoFilter ---
2020/12/19 23:04:40 distinct = true
2020/12/19 23:04:40 Using n1ql client
2020/12/19 23:04:41 Expected and Actual scan responses are the same
2020/12/19 23:04:41 
--- ScanAllFilterNil ---
2020/12/19 23:04:41 distinct = true
2020/12/19 23:04:41 Using n1ql client
2020/12/19 23:04:41 Expected and Actual scan responses are the same
2020/12/19 23:04:41 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:41 distinct = true
2020/12/19 23:04:42 Using n1ql client
2020/12/19 23:04:42 Expected and Actual scan responses are the same
2020/12/19 23:04:42 
--- SingleSeek ---
2020/12/19 23:04:42 distinct = true
2020/12/19 23:04:43 Using n1ql client
2020/12/19 23:04:43 Expected and Actual scan responses are the same
2020/12/19 23:04:43 
--- MultipleSeek ---
2020/12/19 23:04:43 distinct = true
2020/12/19 23:04:43 Using n1ql client
2020/12/19 23:04:43 Expected and Actual scan responses are the same
2020/12/19 23:04:43 
--- SimpleRange ---
2020/12/19 23:04:43 distinct = true
2020/12/19 23:04:43 Using n1ql client
2020/12/19 23:04:43 Expected and Actual scan responses are the same
2020/12/19 23:04:43 
--- NonOverlappingRanges ---
2020/12/19 23:04:43 distinct = true
2020/12/19 23:04:44 Using n1ql client
2020/12/19 23:04:44 Expected and Actual scan responses are the same
2020/12/19 23:04:44 
--- OverlappingRanges ---
2020/12/19 23:04:44 distinct = true
2020/12/19 23:04:44 Using n1ql client
2020/12/19 23:04:45 Expected and Actual scan responses are the same
2020/12/19 23:04:45 
--- NonOverlappingFilters ---
2020/12/19 23:04:45 distinct = true
2020/12/19 23:04:45 Using n1ql client
2020/12/19 23:04:45 Expected and Actual scan responses are the same
2020/12/19 23:04:45 
--- OverlappingFilters ---
2020/12/19 23:04:45 distinct = true
2020/12/19 23:04:46 Using n1ql client
2020/12/19 23:04:46 Expected and Actual scan responses are the same
2020/12/19 23:04:46 
--- BoundaryFilters ---
2020/12/19 23:04:46 distinct = true
2020/12/19 23:04:46 Using n1ql client
2020/12/19 23:04:46 Expected and Actual scan responses are the same
2020/12/19 23:04:46 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:04:46 distinct = true
2020/12/19 23:04:47 Using n1ql client
2020/12/19 23:04:47 Expected and Actual scan responses are the same
2020/12/19 23:04:47 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:04:47 distinct = true
2020/12/19 23:04:47 Using n1ql client
2020/12/19 23:04:47 Expected and Actual scan responses are the same
2020/12/19 23:04:47 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:04:47 distinct = false
2020/12/19 23:04:48 Using n1ql client
2020/12/19 23:04:48 Expected and Actual scan responses are the same
2020/12/19 23:04:48 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:04:48 distinct = false
2020/12/19 23:04:48 Using n1ql client
2020/12/19 23:04:48 Expected and Actual scan responses are the same
2020/12/19 23:04:48 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:04:48 distinct = false
2020/12/19 23:04:49 Using n1ql client
2020/12/19 23:04:49 Expected and Actual scan responses are the same
2020/12/19 23:04:49 
--- FiltersWithUnbounded ---
2020/12/19 23:04:49 distinct = false
2020/12/19 23:04:49 Using n1ql client
2020/12/19 23:04:50 Expected and Actual scan responses are the same
2020/12/19 23:04:50 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:04:50 distinct = false
2020/12/19 23:04:50 Using n1ql client
2020/12/19 23:04:50 Expected and Actual scan responses are the same
2020/12/19 23:04:50 

--------- Simple Index with 1 field ---------
2020/12/19 23:04:50 
--- SingleIndexSimpleRange ---
2020/12/19 23:04:50 distinct = true
2020/12/19 23:04:50 Using n1ql client
2020/12/19 23:04:50 Expected and Actual scan responses are the same
2020/12/19 23:04:50 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:04:50 distinct = true
2020/12/19 23:04:51 Using n1ql client
2020/12/19 23:04:51 Expected and Actual scan responses are the same
2020/12/19 23:04:51 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:04:51 distinct = true
2020/12/19 23:04:51 Using n1ql client
2020/12/19 23:04:52 Expected and Actual scan responses are the same
2020/12/19 23:04:52 

--------- Composite Index with 3 fields ---------
2020/12/19 23:04:52 
--- ScanAllNoFilter ---
2020/12/19 23:04:52 distinct = true
2020/12/19 23:04:52 Using n1ql client
2020/12/19 23:04:52 Expected and Actual scan responses are the same
2020/12/19 23:04:52 
--- ScanAllFilterNil ---
2020/12/19 23:04:52 distinct = true
2020/12/19 23:04:53 Using n1ql client
2020/12/19 23:04:53 Expected and Actual scan responses are the same
2020/12/19 23:04:53 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:53 distinct = true
2020/12/19 23:04:54 Using n1ql client
2020/12/19 23:04:54 Expected and Actual scan responses are the same
2020/12/19 23:04:54 
--- 3FieldsSingleSeek ---
2020/12/19 23:04:54 distinct = true
2020/12/19 23:04:54 Using n1ql client
2020/12/19 23:04:54 Expected and Actual scan responses are the same
2020/12/19 23:04:54 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:04:54 distinct = true
2020/12/19 23:04:55 Using n1ql client
2020/12/19 23:04:55 Expected and Actual scan responses are the same
2020/12/19 23:04:55 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:04:55 distinct = true
2020/12/19 23:04:55 Using n1ql client
2020/12/19 23:04:55 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (15.20s)
=== RUN   TestMultiScanProjection
2020/12/19 23:04:55 In TestMultiScanProjection()
2020/12/19 23:04:55 

--------- Composite Index with 2 fields ---------
2020/12/19 23:04:55 
--- ScanAllNoFilter ---
2020/12/19 23:04:55 distinct = true
2020/12/19 23:04:56 Using n1ql client
2020/12/19 23:04:56 Expected and Actual scan responses are the same
2020/12/19 23:04:56 
--- ScanAllFilterNil ---
2020/12/19 23:04:56 distinct = true
2020/12/19 23:04:56 Using n1ql client
2020/12/19 23:04:57 Expected and Actual scan responses are the same
2020/12/19 23:04:57 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:04:57 distinct = true
2020/12/19 23:04:57 Using n1ql client
2020/12/19 23:04:57 Expected and Actual scan responses are the same
2020/12/19 23:04:57 
--- SingleSeek ---
2020/12/19 23:04:57 distinct = true
2020/12/19 23:04:58 Using n1ql client
2020/12/19 23:04:58 Expected and Actual scan responses are the same
2020/12/19 23:04:58 
--- MultipleSeek ---
2020/12/19 23:04:58 distinct = true
2020/12/19 23:04:58 Using n1ql client
2020/12/19 23:04:58 Expected and Actual scan responses are the same
2020/12/19 23:04:58 
--- SimpleRange ---
2020/12/19 23:04:58 distinct = true
2020/12/19 23:04:59 Using n1ql client
2020/12/19 23:04:59 Expected and Actual scan responses are the same
2020/12/19 23:04:59 
--- NonOverlappingRanges ---
2020/12/19 23:04:59 distinct = true
2020/12/19 23:04:59 Using n1ql client
2020/12/19 23:04:59 Expected and Actual scan responses are the same
2020/12/19 23:04:59 
--- OverlappingRanges ---
2020/12/19 23:04:59 distinct = true
2020/12/19 23:05:00 Using n1ql client
2020/12/19 23:05:00 Expected and Actual scan responses are the same
2020/12/19 23:05:00 
--- NonOverlappingFilters ---
2020/12/19 23:05:00 distinct = true
2020/12/19 23:05:00 Using n1ql client
2020/12/19 23:05:00 Expected and Actual scan responses are the same
2020/12/19 23:05:00 
--- OverlappingFilters ---
2020/12/19 23:05:00 distinct = true
2020/12/19 23:05:01 Using n1ql client
2020/12/19 23:05:01 Expected and Actual scan responses are the same
2020/12/19 23:05:01 
--- BoundaryFilters ---
2020/12/19 23:05:01 distinct = true
2020/12/19 23:05:01 Using n1ql client
2020/12/19 23:05:01 Expected and Actual scan responses are the same
2020/12/19 23:05:01 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:05:01 distinct = true
2020/12/19 23:05:02 Using n1ql client
2020/12/19 23:05:02 Expected and Actual scan responses are the same
2020/12/19 23:05:02 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:05:02 distinct = true
2020/12/19 23:05:02 Using n1ql client
2020/12/19 23:05:02 Expected and Actual scan responses are the same
2020/12/19 23:05:02 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:05:02 distinct = false
2020/12/19 23:05:03 Using n1ql client
2020/12/19 23:05:03 Expected and Actual scan responses are the same
2020/12/19 23:05:03 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:05:03 distinct = false
2020/12/19 23:05:03 Using n1ql client
2020/12/19 23:05:03 Expected and Actual scan responses are the same
2020/12/19 23:05:03 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:05:03 distinct = false
2020/12/19 23:05:04 Using n1ql client
2020/12/19 23:05:04 Expected and Actual scan responses are the same
2020/12/19 23:05:04 
--- FiltersWithUnbounded ---
2020/12/19 23:05:04 distinct = false
2020/12/19 23:05:05 Using n1ql client
2020/12/19 23:05:05 Expected and Actual scan responses are the same
2020/12/19 23:05:05 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:05:05 distinct = false
2020/12/19 23:05:05 Using n1ql client
2020/12/19 23:05:05 Expected and Actual scan responses are the same
2020/12/19 23:05:05 

--------- Simple Index with 1 field ---------
2020/12/19 23:05:05 
--- SingleIndexSimpleRange ---
2020/12/19 23:05:05 distinct = true
2020/12/19 23:05:06 Using n1ql client
2020/12/19 23:05:06 Expected and Actual scan responses are the same
2020/12/19 23:05:06 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:05:06 distinct = true
2020/12/19 23:05:06 Using n1ql client
2020/12/19 23:05:06 Expected and Actual scan responses are the same
2020/12/19 23:05:06 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:05:06 distinct = true
2020/12/19 23:05:07 Using n1ql client
2020/12/19 23:05:07 Expected and Actual scan responses are the same
2020/12/19 23:05:07 

--------- Composite Index with 3 fields ---------
2020/12/19 23:05:07 
--- ScanAllNoFilter ---
2020/12/19 23:05:07 distinct = true
2020/12/19 23:05:07 Using n1ql client
2020/12/19 23:05:08 Expected and Actual scan responses are the same
2020/12/19 23:05:08 
--- ScanAllFilterNil ---
2020/12/19 23:05:08 distinct = true
2020/12/19 23:05:08 Using n1ql client
2020/12/19 23:05:08 Expected and Actual scan responses are the same
2020/12/19 23:05:08 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:05:08 distinct = true
2020/12/19 23:05:09 Using n1ql client
2020/12/19 23:05:09 Expected and Actual scan responses are the same
2020/12/19 23:05:09 
--- 3FieldsSingleSeek ---
2020/12/19 23:05:09 distinct = true
2020/12/19 23:05:10 Using n1ql client
2020/12/19 23:05:10 Expected and Actual scan responses are the same
2020/12/19 23:05:10 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:05:10 distinct = true
2020/12/19 23:05:10 Using n1ql client
2020/12/19 23:05:10 Expected and Actual scan responses are the same
2020/12/19 23:05:10 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:05:10 distinct = true
2020/12/19 23:05:11 Using n1ql client
2020/12/19 23:05:11 Expected and Actual scan responses are the same
2020/12/19 23:05:11 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2020/12/19 23:05:11 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2020/12/19 23:05:11 
--- SingleIndexProjectFirst ---
2020/12/19 23:05:11 distinct = true
2020/12/19 23:05:11 Using n1ql client
2020/12/19 23:05:11 Expected and Actual scan responses are the same
2020/12/19 23:05:11 
--- 2FieldIndexProjectSecond ---
2020/12/19 23:05:11 distinct = true
2020/12/19 23:05:11 Using n1ql client
2020/12/19 23:05:11 Expected and Actual scan responses are the same
2020/12/19 23:05:11 
--- 3FieldIndexProjectThird ---
2020/12/19 23:05:11 distinct = true
2020/12/19 23:05:12 Using n1ql client
2020/12/19 23:05:12 Expected and Actual scan responses are the same
2020/12/19 23:05:12 
--- 4FieldIndexProjectFourth ---
2020/12/19 23:05:12 distinct = true
2020/12/19 23:05:14 Using n1ql client
2020/12/19 23:05:14 Expected and Actual scan responses are the same
2020/12/19 23:05:14 
--- 5FieldIndexProjectFifth ---
2020/12/19 23:05:14 distinct = true
2020/12/19 23:05:18 Using n1ql client
2020/12/19 23:05:18 Expected and Actual scan responses are the same
2020/12/19 23:05:18 
--- 2FieldIndexProjectTwo ---
2020/12/19 23:05:18 distinct = true
2020/12/19 23:05:19 Using n1ql client
2020/12/19 23:05:19 Expected and Actual scan responses are the same
2020/12/19 23:05:19 
--- 3FieldIndexProjectTwo ---
2020/12/19 23:05:19 distinct = true
2020/12/19 23:05:19 Using n1ql client
2020/12/19 23:05:19 Expected and Actual scan responses are the same
2020/12/19 23:05:19 
--- 3FieldIndexProjectTwo ---
2020/12/19 23:05:19 distinct = true
2020/12/19 23:05:20 Using n1ql client
2020/12/19 23:05:20 Expected and Actual scan responses are the same
2020/12/19 23:05:20 
--- 3FieldIndexProjectTwo ---
2020/12/19 23:05:20 distinct = true
2020/12/19 23:05:21 Using n1ql client
2020/12/19 23:05:21 Expected and Actual scan responses are the same
2020/12/19 23:05:21 
--- 4FieldIndexProjectTwo ---
2020/12/19 23:05:21 distinct = true
2020/12/19 23:05:23 Using n1ql client
2020/12/19 23:05:23 Expected and Actual scan responses are the same
2020/12/19 23:05:23 
--- 4FieldIndexProjectTwo ---
2020/12/19 23:05:23 distinct = true
2020/12/19 23:05:24 Using n1ql client
2020/12/19 23:05:24 Expected and Actual scan responses are the same
2020/12/19 23:05:24 
--- 4FieldIndexProjectTwo ---
2020/12/19 23:05:24 distinct = true
2020/12/19 23:05:26 Using n1ql client
2020/12/19 23:05:26 Expected and Actual scan responses are the same
2020/12/19 23:05:26 
--- 4FieldIndexProjectTwo ---
2020/12/19 23:05:26 distinct = true
2020/12/19 23:05:28 Using n1ql client
2020/12/19 23:05:29 Expected and Actual scan responses are the same
2020/12/19 23:05:29 
--- 4FieldIndexProjectTwo ---
2020/12/19 23:05:29 distinct = true
2020/12/19 23:05:30 Using n1ql client
2020/12/19 23:05:30 Expected and Actual scan responses are the same
2020/12/19 23:05:30 
--- 5FieldIndexProjectTwo ---
2020/12/19 23:05:30 distinct = true
2020/12/19 23:05:34 Using n1ql client
2020/12/19 23:05:35 Expected and Actual scan responses are the same
2020/12/19 23:05:35 
--- 5FieldIndexProjectTwo ---
2020/12/19 23:05:35 distinct = true
2020/12/19 23:05:39 Using n1ql client
2020/12/19 23:05:39 Expected and Actual scan responses are the same
2020/12/19 23:05:39 
--- 5FieldIndexProjectTwo ---
2020/12/19 23:05:39 distinct = true
2020/12/19 23:05:43 Using n1ql client
2020/12/19 23:05:43 Expected and Actual scan responses are the same
2020/12/19 23:05:43 
--- 5FieldIndexProjectTwo ---
2020/12/19 23:05:43 distinct = true
2020/12/19 23:05:47 Using n1ql client
2020/12/19 23:05:47 Expected and Actual scan responses are the same
2020/12/19 23:05:47 
--- 5FieldIndexProjectThree ---
2020/12/19 23:05:47 distinct = true
2020/12/19 23:05:52 Using n1ql client
2020/12/19 23:05:52 Expected and Actual scan responses are the same
2020/12/19 23:05:52 
--- 5FieldIndexProjectFour ---
2020/12/19 23:05:52 distinct = true
2020/12/19 23:05:56 Using n1ql client
2020/12/19 23:05:56 Expected and Actual scan responses are the same
2020/12/19 23:05:56 
--- 5FieldIndexProjectAll ---
2020/12/19 23:05:56 distinct = true
2020/12/19 23:06:00 Using n1ql client
2020/12/19 23:06:00 Expected and Actual scan responses are the same
2020/12/19 23:06:00 
--- 5FieldIndexProjectAlternate ---
2020/12/19 23:06:00 distinct = true
2020/12/19 23:06:04 Using n1ql client
2020/12/19 23:06:04 Expected and Actual scan responses are the same
2020/12/19 23:06:04 
--- 5FieldIndexProjectEmptyEntryKeys ---
2020/12/19 23:06:04 distinct = true
2020/12/19 23:06:09 Using n1ql client
2020/12/19 23:06:09 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (73.36s)
=== RUN   TestMultiScanRestAPI
2020/12/19 23:06:09 In TestMultiScanRestAPI()
2020/12/19 23:06:09 In DropAllSecondaryIndexes()
2020/12/19 23:06:09 Index found:  index_companyname
2020/12/19 23:06:09 Dropped index index_companyname
2020/12/19 23:06:09 Index found:  index_primary
2020/12/19 23:06:09 Dropped index index_primary
2020/12/19 23:06:09 Index found:  index_company_name_age
2020/12/19 23:06:09 Dropped index index_company_name_age
2020/12/19 23:06:09 Index found:  index_company_name_age_address
2020/12/19 23:06:09 Dropped index index_company_name_age_address
2020/12/19 23:06:09 Index found:  addressidx
2020/12/19 23:06:09 Dropped index addressidx
2020/12/19 23:06:09 Index found:  index_company
2020/12/19 23:06:09 Dropped index index_company
2020/12/19 23:06:09 Index found:  index_company_name_age_address_friends
2020/12/19 23:06:09 Dropped index index_company_name_age_address_friends
2020/12/19 23:06:14 Created the secondary index index_companyname. Waiting for it become active
2020/12/19 23:06:14 Index is now active
2020/12/19 23:06:14 GET all indexes
2020/12/19 23:06:14 200 OK
2020/12/19 23:06:14 getscans status : 200 OK
2020/12/19 23:06:14 number of entries 337
2020/12/19 23:06:14 Status : 200 OK
2020/12/19 23:06:14 Result from multiscancount API = 337
--- PASS: TestMultiScanRestAPI (5.29s)
=== RUN   TestMultiScanPrimaryIndexVariations
2020/12/19 23:06:14 In TestMultiScanPrimaryIndexVariations()
2020/12/19 23:06:20 Created the secondary index index_pi. Waiting for it become active
2020/12/19 23:06:20 Index is now active
2020/12/19 23:06:20 
--- No Overlap ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Proper Overlap ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Low Boundary Overlap ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Complex Overlaps ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Multiple Equal Overlaps ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Boundary and Subset Overlaps ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Point Overlaps ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Boundary and Point Overlaps ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 
--- Primary index range null ---
2020/12/19 23:06:20 Using n1ql client
2020/12/19 23:06:20 Expected and Actual scan responses are the same
2020/12/19 23:06:20 Dropping the secondary index index_pi
2020/12/19 23:06:20 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (6.14s)
=== RUN   TestMultiScanDescSetup
2020/12/19 23:06:20 In TestMultiScanDescSetup()
2020/12/19 23:06:20 In DropAllSecondaryIndexes()
2020/12/19 23:06:20 Index found:  index_companyname
2020/12/19 23:06:20 Dropped index index_companyname
2020/12/19 23:06:24 Created the secondary index index_companyname_desc. Waiting for it become active
2020/12/19 23:06:24 Index is now active
2020/12/19 23:06:30 Created the secondary index index_company_desc. Waiting for it become active
2020/12/19 23:06:30 Index is now active
2020/12/19 23:06:35 Created the secondary index index_company_name_age_desc. Waiting for it become active
2020/12/19 23:06:35 Index is now active
--- PASS: TestMultiScanDescSetup (14.83s)
=== RUN   TestMultiScanDescScenarios
2020/12/19 23:06:35 In TestMultiScanDescScenarios()
2020/12/19 23:06:35 

--------- Composite Index with 2 fields ---------
2020/12/19 23:06:35 
--- ScanAllNoFilter ---
2020/12/19 23:06:35 distinct = false
2020/12/19 23:06:35 Using n1ql client
2020/12/19 23:06:36 Expected and Actual scan responses are the same
2020/12/19 23:06:36 
--- ScanAllFilterNil ---
2020/12/19 23:06:36 distinct = false
2020/12/19 23:06:36 Using n1ql client
2020/12/19 23:06:36 Expected and Actual scan responses are the same
2020/12/19 23:06:36 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:06:36 distinct = false
2020/12/19 23:06:37 Using n1ql client
2020/12/19 23:06:37 Expected and Actual scan responses are the same
2020/12/19 23:06:37 
--- SingleSeek ---
2020/12/19 23:06:37 distinct = false
2020/12/19 23:06:38 Using n1ql client
2020/12/19 23:06:38 Expected and Actual scan responses are the same
2020/12/19 23:06:38 
--- MultipleSeek ---
2020/12/19 23:06:38 distinct = false
2020/12/19 23:06:38 Using n1ql client
2020/12/19 23:06:38 Expected and Actual scan responses are the same
2020/12/19 23:06:38 
--- SimpleRange ---
2020/12/19 23:06:38 distinct = false
2020/12/19 23:06:39 Using n1ql client
2020/12/19 23:06:39 Expected and Actual scan responses are the same
2020/12/19 23:06:39 
--- NonOverlappingRanges ---
2020/12/19 23:06:39 distinct = false
2020/12/19 23:06:39 Using n1ql client
2020/12/19 23:06:39 Expected and Actual scan responses are the same
2020/12/19 23:06:39 
--- OverlappingRanges ---
2020/12/19 23:06:39 distinct = false
2020/12/19 23:06:40 Using n1ql client
2020/12/19 23:06:40 Expected and Actual scan responses are the same
2020/12/19 23:06:40 
--- NonOverlappingFilters ---
2020/12/19 23:06:40 distinct = false
2020/12/19 23:06:40 Using n1ql client
2020/12/19 23:06:40 Expected and Actual scan responses are the same
2020/12/19 23:06:40 
--- OverlappingFilters ---
2020/12/19 23:06:40 distinct = false
2020/12/19 23:06:41 Using n1ql client
2020/12/19 23:06:41 Expected and Actual scan responses are the same
2020/12/19 23:06:41 
--- BoundaryFilters ---
2020/12/19 23:06:41 distinct = false
2020/12/19 23:06:42 Using n1ql client
2020/12/19 23:06:42 Expected and Actual scan responses are the same
2020/12/19 23:06:42 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:06:42 distinct = false
2020/12/19 23:06:42 Using n1ql client
2020/12/19 23:06:42 Expected and Actual scan responses are the same
2020/12/19 23:06:42 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:06:42 distinct = false
2020/12/19 23:06:43 Using n1ql client
2020/12/19 23:06:43 Expected and Actual scan responses are the same
2020/12/19 23:06:43 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:06:43 distinct = false
2020/12/19 23:06:43 Using n1ql client
2020/12/19 23:06:43 Expected and Actual scan responses are the same
2020/12/19 23:06:43 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:06:43 distinct = false
2020/12/19 23:06:44 Using n1ql client
2020/12/19 23:06:44 Expected and Actual scan responses are the same
2020/12/19 23:06:44 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:06:44 distinct = false
2020/12/19 23:06:44 Using n1ql client
2020/12/19 23:06:45 Expected and Actual scan responses are the same
2020/12/19 23:06:45 
--- FiltersWithUnbounded ---
2020/12/19 23:06:45 distinct = false
2020/12/19 23:06:45 Using n1ql client
2020/12/19 23:06:45 Expected and Actual scan responses are the same
2020/12/19 23:06:45 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:06:45 distinct = false
2020/12/19 23:06:46 Using n1ql client
2020/12/19 23:06:46 Expected and Actual scan responses are the same
2020/12/19 23:06:46 

--------- Simple Index with 1 field ---------
2020/12/19 23:06:46 
--- SingleIndexSimpleRange ---
2020/12/19 23:06:46 distinct = false
2020/12/19 23:06:46 Using n1ql client
2020/12/19 23:06:46 Expected and Actual scan responses are the same
2020/12/19 23:06:46 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:06:46 distinct = false
2020/12/19 23:06:46 Using n1ql client
2020/12/19 23:06:47 Expected and Actual scan responses are the same
2020/12/19 23:06:47 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:06:47 distinct = false
2020/12/19 23:06:47 Using n1ql client
2020/12/19 23:06:47 Expected and Actual scan responses are the same
2020/12/19 23:06:47 

--------- Composite Index with 3 fields ---------
2020/12/19 23:06:47 
--- ScanAllNoFilter ---
2020/12/19 23:06:47 distinct = false
2020/12/19 23:06:48 Using n1ql client
2020/12/19 23:06:48 Expected and Actual scan responses are the same
2020/12/19 23:06:48 
--- ScanAllFilterNil ---
2020/12/19 23:06:48 distinct = false
2020/12/19 23:06:49 Using n1ql client
2020/12/19 23:06:49 Expected and Actual scan responses are the same
2020/12/19 23:06:49 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:06:49 distinct = false
2020/12/19 23:06:50 Using n1ql client
2020/12/19 23:06:50 Expected and Actual scan responses are the same
2020/12/19 23:06:50 
--- 3FieldsSingleSeek ---
2020/12/19 23:06:50 distinct = false
2020/12/19 23:06:50 Using n1ql client
2020/12/19 23:06:50 Expected and Actual scan responses are the same
2020/12/19 23:06:50 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:06:50 distinct = false
2020/12/19 23:06:51 Using n1ql client
2020/12/19 23:06:51 Expected and Actual scan responses are the same
2020/12/19 23:06:51 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:06:51 distinct = false
2020/12/19 23:06:51 Using n1ql client
2020/12/19 23:06:51 Expected and Actual scan responses are the same
2020/12/19 23:06:51 

--------- New scenarios ---------
2020/12/19 23:06:51 
--- CompIndexHighUnbounded1 ---
2020/12/19 23:06:51 
--- Multi Scan 0 ---
2020/12/19 23:06:51 distinct = false
2020/12/19 23:06:52 Using n1ql client
2020/12/19 23:06:52 Expected and Actual scan responses are the same
2020/12/19 23:06:52 
--- Multi Scan 1 ---
2020/12/19 23:06:52 distinct = false
2020/12/19 23:06:52 Using n1ql client
2020/12/19 23:06:52 Expected and Actual scan responses are the same
2020/12/19 23:06:52 
--- Multi Scan 2 ---
2020/12/19 23:06:52 distinct = false
2020/12/19 23:06:53 Using n1ql client
2020/12/19 23:06:53 Expected and Actual scan responses are the same
2020/12/19 23:06:53 
--- CompIndexHighUnbounded2 ---
2020/12/19 23:06:53 
--- Multi Scan 0 ---
2020/12/19 23:06:53 distinct = false
2020/12/19 23:06:53 Using n1ql client
2020/12/19 23:06:53 Expected and Actual scan responses are the same
2020/12/19 23:06:53 
--- Multi Scan 1 ---
2020/12/19 23:06:53 distinct = false
2020/12/19 23:06:54 Using n1ql client
2020/12/19 23:06:54 Expected and Actual scan responses are the same
2020/12/19 23:06:54 
--- Multi Scan 2 ---
2020/12/19 23:06:54 distinct = false
2020/12/19 23:06:54 Using n1ql client
2020/12/19 23:06:54 Expected and Actual scan responses are the same
2020/12/19 23:06:54 
--- CompIndexHighUnbounded3 ---
2020/12/19 23:06:54 
--- Multi Scan 0 ---
2020/12/19 23:06:54 distinct = false
2020/12/19 23:06:55 Using n1ql client
2020/12/19 23:06:55 Expected and Actual scan responses are the same
2020/12/19 23:06:55 
--- CompIndexHighUnbounded4 ---
2020/12/19 23:06:55 
--- Multi Scan 0 ---
2020/12/19 23:06:55 distinct = false
2020/12/19 23:06:56 Using n1ql client
2020/12/19 23:06:56 Expected and Actual scan responses are the same
2020/12/19 23:06:56 
--- CompIndexHighUnbounded5 ---
2020/12/19 23:06:56 
--- Multi Scan 0 ---
2020/12/19 23:06:56 distinct = false
2020/12/19 23:06:56 Using n1ql client
2020/12/19 23:06:56 Expected and Actual scan responses are the same
2020/12/19 23:06:56 
--- SeekBoundaries ---
2020/12/19 23:06:56 
--- Multi Scan 0 ---
2020/12/19 23:06:56 distinct = false
2020/12/19 23:06:57 Using n1ql client
2020/12/19 23:06:57 Expected and Actual scan responses are the same
2020/12/19 23:06:57 
--- Multi Scan 1 ---
2020/12/19 23:06:57 distinct = false
2020/12/19 23:06:57 Using n1ql client
2020/12/19 23:06:57 Expected and Actual scan responses are the same
2020/12/19 23:06:57 
--- Multi Scan 2 ---
2020/12/19 23:06:57 distinct = false
2020/12/19 23:06:58 Using n1ql client
2020/12/19 23:06:58 Expected and Actual scan responses are the same
2020/12/19 23:06:58 
--- Multi Scan 3 ---
2020/12/19 23:06:58 distinct = false
2020/12/19 23:06:58 Using n1ql client
2020/12/19 23:06:58 Expected and Actual scan responses are the same
2020/12/19 23:06:58 
--- Multi Scan 4 ---
2020/12/19 23:06:58 distinct = false
2020/12/19 23:06:59 Using n1ql client
2020/12/19 23:06:59 Expected and Actual scan responses are the same
2020/12/19 23:06:59 
--- Multi Scan 5 ---
2020/12/19 23:06:59 distinct = false
2020/12/19 23:06:59 Using n1ql client
2020/12/19 23:06:59 Expected and Actual scan responses are the same
2020/12/19 23:06:59 
--- Multi Scan 6 ---
2020/12/19 23:06:59 distinct = false
2020/12/19 23:07:00 Using n1ql client
2020/12/19 23:07:00 Expected and Actual scan responses are the same
2020/12/19 23:07:00 
--- Multi Scan 7 ---
2020/12/19 23:07:00 distinct = false
2020/12/19 23:07:01 Using n1ql client
2020/12/19 23:07:01 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (25.63s)
=== RUN   TestMultiScanDescCount
2020/12/19 23:07:01 In TestMultiScanDescCount()
2020/12/19 23:07:01 

--------- Composite Index with 2 fields ---------
2020/12/19 23:07:01 
--- ScanAllNoFilter ---
2020/12/19 23:07:01 distinct = false
2020/12/19 23:07:01 Using n1ql client
2020/12/19 23:07:01 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:01 
--- ScanAllFilterNil ---
2020/12/19 23:07:01 distinct = false
2020/12/19 23:07:02 Using n1ql client
2020/12/19 23:07:02 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:02 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:02 distinct = false
2020/12/19 23:07:02 Using n1ql client
2020/12/19 23:07:02 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:02 
--- SingleSeek ---
2020/12/19 23:07:02 distinct = false
2020/12/19 23:07:03 Using n1ql client
2020/12/19 23:07:03 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:07:03 
--- MultipleSeek ---
2020/12/19 23:07:03 distinct = false
2020/12/19 23:07:03 Using n1ql client
2020/12/19 23:07:03 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:07:03 
--- SimpleRange ---
2020/12/19 23:07:03 distinct = false
2020/12/19 23:07:04 Using n1ql client
2020/12/19 23:07:04 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2020/12/19 23:07:04 
--- NonOverlappingRanges ---
2020/12/19 23:07:04 distinct = false
2020/12/19 23:07:04 Using n1ql client
2020/12/19 23:07:04 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2020/12/19 23:07:04 
--- OverlappingRanges ---
2020/12/19 23:07:04 distinct = false
2020/12/19 23:07:05 Using n1ql client
2020/12/19 23:07:05 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2020/12/19 23:07:05 
--- NonOverlappingFilters ---
2020/12/19 23:07:05 distinct = false
2020/12/19 23:07:05 Using n1ql client
2020/12/19 23:07:05 MultiScanCount = 337 ExpectedMultiScanCount = 337
2020/12/19 23:07:05 
--- OverlappingFilters ---
2020/12/19 23:07:05 distinct = false
2020/12/19 23:07:06 Using n1ql client
2020/12/19 23:07:06 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2020/12/19 23:07:06 
--- BoundaryFilters ---
2020/12/19 23:07:06 distinct = false
2020/12/19 23:07:06 Using n1ql client
2020/12/19 23:07:06 MultiScanCount = 499 ExpectedMultiScanCount = 499
2020/12/19 23:07:06 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:07:06 distinct = false
2020/12/19 23:07:07 Using n1ql client
2020/12/19 23:07:07 MultiScanCount = 256 ExpectedMultiScanCount = 256
2020/12/19 23:07:07 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:07:07 distinct = false
2020/12/19 23:07:07 Using n1ql client
2020/12/19 23:07:07 MultiScanCount = 255 ExpectedMultiScanCount = 255
2020/12/19 23:07:07 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:07:07 distinct = false
2020/12/19 23:07:08 Using n1ql client
2020/12/19 23:07:08 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2020/12/19 23:07:08 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:07:08 distinct = false
2020/12/19 23:07:08 Using n1ql client
2020/12/19 23:07:08 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2020/12/19 23:07:08 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:07:08 distinct = false
2020/12/19 23:07:09 Using n1ql client
2020/12/19 23:07:09 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:09 
--- FiltersWithUnbounded ---
2020/12/19 23:07:09 distinct = false
2020/12/19 23:07:09 Using n1ql client
2020/12/19 23:07:09 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2020/12/19 23:07:09 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:07:09 distinct = false
2020/12/19 23:07:10 Using n1ql client
2020/12/19 23:07:10 MultiScanCount = 418 ExpectedMultiScanCount = 418
2020/12/19 23:07:10 

--------- Simple Index with 1 field ---------
2020/12/19 23:07:10 
--- SingleIndexSimpleRange ---
2020/12/19 23:07:10 distinct = false
2020/12/19 23:07:10 Using n1ql client
2020/12/19 23:07:10 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2020/12/19 23:07:10 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:07:10 distinct = false
2020/12/19 23:07:11 Using n1ql client
2020/12/19 23:07:11 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2020/12/19 23:07:11 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:07:11 distinct = false
2020/12/19 23:07:11 Using n1ql client
2020/12/19 23:07:11 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2020/12/19 23:07:11 

--------- Composite Index with 3 fields ---------
2020/12/19 23:07:11 
--- ScanAllNoFilter ---
2020/12/19 23:07:11 distinct = false
2020/12/19 23:07:12 Using n1ql client
2020/12/19 23:07:12 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:12 
--- ScanAllFilterNil ---
2020/12/19 23:07:12 distinct = false
2020/12/19 23:07:13 Using n1ql client
2020/12/19 23:07:13 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:13 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:13 distinct = false
2020/12/19 23:07:13 Using n1ql client
2020/12/19 23:07:14 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:14 
--- 3FieldsSingleSeek ---
2020/12/19 23:07:14 distinct = false
2020/12/19 23:07:14 Using n1ql client
2020/12/19 23:07:14 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:07:14 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:07:14 distinct = false
2020/12/19 23:07:14 Using n1ql client
2020/12/19 23:07:15 MultiScanCount = 3 ExpectedMultiScanCount = 3
2020/12/19 23:07:15 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:07:15 distinct = false
2020/12/19 23:07:15 Using n1ql client
2020/12/19 23:07:15 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:07:15 

--------- New scenarios ---------
2020/12/19 23:07:15 
--- CompIndexHighUnbounded1 ---
2020/12/19 23:07:15 
--- Multi Scan 0 ---
2020/12/19 23:07:15 distinct = false
2020/12/19 23:07:15 Using n1ql client
2020/12/19 23:07:15 Using n1ql client
2020/12/19 23:07:15 len(scanResults) = 8 MultiScanCount = 8
2020/12/19 23:07:15 Expected and Actual scan responses are the same
2020/12/19 23:07:15 
--- Multi Scan 1 ---
2020/12/19 23:07:15 distinct = false
2020/12/19 23:07:16 Using n1ql client
2020/12/19 23:07:16 Using n1ql client
2020/12/19 23:07:16 len(scanResults) = 0 MultiScanCount = 0
2020/12/19 23:07:16 Expected and Actual scan responses are the same
2020/12/19 23:07:16 
--- Multi Scan 2 ---
2020/12/19 23:07:16 distinct = false
2020/12/19 23:07:16 Using n1ql client
2020/12/19 23:07:16 Using n1ql client
2020/12/19 23:07:16 len(scanResults) = 9 MultiScanCount = 9
2020/12/19 23:07:16 Expected and Actual scan responses are the same
2020/12/19 23:07:16 
--- CompIndexHighUnbounded2 ---
2020/12/19 23:07:16 
--- Multi Scan 0 ---
2020/12/19 23:07:16 distinct = false
2020/12/19 23:07:17 Using n1ql client
2020/12/19 23:07:17 Using n1ql client
2020/12/19 23:07:17 len(scanResults) = 4138 MultiScanCount = 4138
2020/12/19 23:07:17 Expected and Actual scan responses are the same
2020/12/19 23:07:17 
--- Multi Scan 1 ---
2020/12/19 23:07:17 distinct = false
2020/12/19 23:07:17 Using n1ql client
2020/12/19 23:07:18 Using n1ql client
2020/12/19 23:07:18 len(scanResults) = 2746 MultiScanCount = 2746
2020/12/19 23:07:18 Expected and Actual scan responses are the same
2020/12/19 23:07:18 
--- Multi Scan 2 ---
2020/12/19 23:07:18 distinct = false
2020/12/19 23:07:18 Using n1ql client
2020/12/19 23:07:18 Using n1ql client
2020/12/19 23:07:18 len(scanResults) = 4691 MultiScanCount = 4691
2020/12/19 23:07:18 Expected and Actual scan responses are the same
2020/12/19 23:07:18 
--- CompIndexHighUnbounded3 ---
2020/12/19 23:07:18 
--- Multi Scan 0 ---
2020/12/19 23:07:18 distinct = false
2020/12/19 23:07:19 Using n1ql client
2020/12/19 23:07:19 Using n1ql client
2020/12/19 23:07:19 len(scanResults) = 1329 MultiScanCount = 1329
2020/12/19 23:07:19 Expected and Actual scan responses are the same
2020/12/19 23:07:19 
--- CompIndexHighUnbounded4 ---
2020/12/19 23:07:19 
--- Multi Scan 0 ---
2020/12/19 23:07:19 distinct = false
2020/12/19 23:07:19 Using n1ql client
2020/12/19 23:07:20 Using n1ql client
2020/12/19 23:07:20 len(scanResults) = 5349 MultiScanCount = 5349
2020/12/19 23:07:20 Expected and Actual scan responses are the same
2020/12/19 23:07:20 
--- CompIndexHighUnbounded5 ---
2020/12/19 23:07:20 
--- Multi Scan 0 ---
2020/12/19 23:07:20 distinct = false
2020/12/19 23:07:20 Using n1ql client
2020/12/19 23:07:20 Using n1ql client
2020/12/19 23:07:21 len(scanResults) = 8210 MultiScanCount = 8210
2020/12/19 23:07:21 Expected and Actual scan responses are the same
2020/12/19 23:07:21 
--- SeekBoundaries ---
2020/12/19 23:07:21 
--- Multi Scan 0 ---
2020/12/19 23:07:21 distinct = false
2020/12/19 23:07:21 Using n1ql client
2020/12/19 23:07:21 Using n1ql client
2020/12/19 23:07:21 len(scanResults) = 175 MultiScanCount = 175
2020/12/19 23:07:21 Expected and Actual scan responses are the same
2020/12/19 23:07:21 
--- Multi Scan 1 ---
2020/12/19 23:07:21 distinct = false
2020/12/19 23:07:22 Using n1ql client
2020/12/19 23:07:22 Using n1ql client
2020/12/19 23:07:22 len(scanResults) = 1 MultiScanCount = 1
2020/12/19 23:07:22 Expected and Actual scan responses are the same
2020/12/19 23:07:22 
--- Multi Scan 2 ---
2020/12/19 23:07:22 distinct = false
2020/12/19 23:07:22 Using n1ql client
2020/12/19 23:07:22 Using n1ql client
2020/12/19 23:07:22 len(scanResults) = 555 MultiScanCount = 555
2020/12/19 23:07:22 Expected and Actual scan responses are the same
2020/12/19 23:07:22 
--- Multi Scan 3 ---
2020/12/19 23:07:22 distinct = false
2020/12/19 23:07:22 Using n1ql client
2020/12/19 23:07:23 Using n1ql client
2020/12/19 23:07:23 len(scanResults) = 872 MultiScanCount = 872
2020/12/19 23:07:23 Expected and Actual scan responses are the same
2020/12/19 23:07:23 
--- Multi Scan 4 ---
2020/12/19 23:07:23 distinct = false
2020/12/19 23:07:23 Using n1ql client
2020/12/19 23:07:23 Using n1ql client
2020/12/19 23:07:23 len(scanResults) = 287 MultiScanCount = 287
2020/12/19 23:07:23 Expected and Actual scan responses are the same
2020/12/19 23:07:23 
--- Multi Scan 5 ---
2020/12/19 23:07:23 distinct = false
2020/12/19 23:07:24 Using n1ql client
2020/12/19 23:07:24 Using n1ql client
2020/12/19 23:07:24 len(scanResults) = 5254 MultiScanCount = 5254
2020/12/19 23:07:24 Expected and Actual scan responses are the same
2020/12/19 23:07:24 
--- Multi Scan 6 ---
2020/12/19 23:07:24 distinct = false
2020/12/19 23:07:24 Using n1ql client
2020/12/19 23:07:25 Using n1ql client
2020/12/19 23:07:25 len(scanResults) = 5566 MultiScanCount = 5566
2020/12/19 23:07:25 Expected and Actual scan responses are the same
2020/12/19 23:07:25 
--- Multi Scan 7 ---
2020/12/19 23:07:25 distinct = false
2020/12/19 23:07:25 Using n1ql client
2020/12/19 23:07:25 Using n1ql client
2020/12/19 23:07:25 len(scanResults) = 8 MultiScanCount = 8
2020/12/19 23:07:25 Expected and Actual scan responses are the same
2020/12/19 23:07:25 

--------- With DISTINCT True ---------
2020/12/19 23:07:25 
--- ScanAllNoFilter ---
2020/12/19 23:07:25 distinct = true
2020/12/19 23:07:26 Using n1ql client
2020/12/19 23:07:26 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:26 
--- ScanAllFilterNil ---
2020/12/19 23:07:26 distinct = true
2020/12/19 23:07:26 Using n1ql client
2020/12/19 23:07:26 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:26 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:26 distinct = true
2020/12/19 23:07:27 Using n1ql client
2020/12/19 23:07:27 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:27 
--- SingleSeek ---
2020/12/19 23:07:27 distinct = true
2020/12/19 23:07:28 Using n1ql client
2020/12/19 23:07:28 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:07:28 
--- MultipleSeek ---
2020/12/19 23:07:28 distinct = true
2020/12/19 23:07:28 Using n1ql client
2020/12/19 23:07:28 MultiScanCount = 2 ExpectedMultiScanCount = 2
2020/12/19 23:07:28 
--- SimpleRange ---
2020/12/19 23:07:28 distinct = true
2020/12/19 23:07:28 Using n1ql client
2020/12/19 23:07:28 MultiScanCount = 227 ExpectedMultiScanCount = 227
2020/12/19 23:07:28 
--- NonOverlappingRanges ---
2020/12/19 23:07:28 distinct = true
2020/12/19 23:07:29 Using n1ql client
2020/12/19 23:07:29 MultiScanCount = 428 ExpectedMultiScanCount = 428
2020/12/19 23:07:29 
--- NonOverlappingFilters2 ---
2020/12/19 23:07:29 distinct = true
2020/12/19 23:07:29 Using n1ql client
2020/12/19 23:07:29 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:07:29 
--- OverlappingRanges ---
2020/12/19 23:07:29 distinct = true
2020/12/19 23:07:30 Using n1ql client
2020/12/19 23:07:30 MultiScanCount = 575 ExpectedMultiScanCount = 575
2020/12/19 23:07:30 
--- NonOverlappingFilters ---
2020/12/19 23:07:30 distinct = true
2020/12/19 23:07:30 Using n1ql client
2020/12/19 23:07:30 MultiScanCount = 186 ExpectedMultiScanCount = 186
2020/12/19 23:07:30 
--- OverlappingFilters ---
2020/12/19 23:07:30 distinct = true
2020/12/19 23:07:31 Using n1ql client
2020/12/19 23:07:31 MultiScanCount = 543 ExpectedMultiScanCount = 543
2020/12/19 23:07:31 
--- BoundaryFilters ---
2020/12/19 23:07:31 distinct = true
2020/12/19 23:07:31 Using n1ql client
2020/12/19 23:07:31 MultiScanCount = 172 ExpectedMultiScanCount = 172
2020/12/19 23:07:31 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:07:31 distinct = true
2020/12/19 23:07:32 Using n1ql client
2020/12/19 23:07:32 MultiScanCount = 135 ExpectedMultiScanCount = 135
2020/12/19 23:07:32 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:07:32 distinct = true
2020/12/19 23:07:32 Using n1ql client
2020/12/19 23:07:32 MultiScanCount = 134 ExpectedMultiScanCount = 134
2020/12/19 23:07:32 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:07:32 distinct = false
2020/12/19 23:07:33 Using n1ql client
2020/12/19 23:07:33 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2020/12/19 23:07:33 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:07:33 distinct = false
2020/12/19 23:07:33 Using n1ql client
2020/12/19 23:07:33 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2020/12/19 23:07:33 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:07:33 distinct = false
2020/12/19 23:07:34 Using n1ql client
2020/12/19 23:07:34 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2020/12/19 23:07:34 
--- FiltersWithUnbounded ---
2020/12/19 23:07:34 distinct = false
2020/12/19 23:07:35 Using n1ql client
2020/12/19 23:07:35 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2020/12/19 23:07:35 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:07:35 distinct = false
2020/12/19 23:07:35 Using n1ql client
2020/12/19 23:07:35 MultiScanCount = 418 ExpectedMultiScanCount = 418
2020/12/19 23:07:35 

--------- Simple Index with 1 field ---------
2020/12/19 23:07:35 
--- SingleIndexSimpleRange ---
2020/12/19 23:07:35 distinct = true
2020/12/19 23:07:36 Using n1ql client
2020/12/19 23:07:36 MultiScanCount = 227 ExpectedMultiScanCount = 227
2020/12/19 23:07:36 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:07:36 distinct = true
2020/12/19 23:07:36 Using n1ql client
2020/12/19 23:07:36 MultiScanCount = 713 ExpectedMultiScanCount = 713
2020/12/19 23:07:36 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:07:36 distinct = true
2020/12/19 23:07:36 Using n1ql client
2020/12/19 23:07:37 MultiScanCount = 869 ExpectedMultiScanCount = 869
2020/12/19 23:07:37 

--------- Composite Index with 3 fields ---------
2020/12/19 23:07:37 
--- ScanAllNoFilter ---
2020/12/19 23:07:37 distinct = true
2020/12/19 23:07:37 Using n1ql client
2020/12/19 23:07:37 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:37 
--- ScanAllFilterNil ---
2020/12/19 23:07:37 distinct = true
2020/12/19 23:07:38 Using n1ql client
2020/12/19 23:07:38 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:38 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:38 distinct = true
2020/12/19 23:07:39 Using n1ql client
2020/12/19 23:07:39 MultiScanCount = 999 ExpectedMultiScanCount = 999
2020/12/19 23:07:39 
--- 3FieldsSingleSeek ---
2020/12/19 23:07:39 distinct = true
2020/12/19 23:07:39 Using n1ql client
2020/12/19 23:07:39 MultiScanCount = 1 ExpectedMultiScanCount = 1
2020/12/19 23:07:39 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:07:39 distinct = true
2020/12/19 23:07:40 Using n1ql client
2020/12/19 23:07:40 MultiScanCount = 3 ExpectedMultiScanCount = 3
2020/12/19 23:07:40 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:07:40 distinct = true
2020/12/19 23:07:40 Using n1ql client
2020/12/19 23:07:40 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanDescCount (39.69s)
=== RUN   TestMultiScanDescOffset
2020/12/19 23:07:40 In SkipTestMultiScanDescOffset()
2020/12/19 23:07:40 

--------- Composite Index with 2 fields ---------
2020/12/19 23:07:40 
--- ScanAllNoFilter ---
2020/12/19 23:07:40 distinct = false
2020/12/19 23:07:41 Using n1ql client
2020/12/19 23:07:41 
--- ScanAllFilterNil ---
2020/12/19 23:07:41 distinct = false
2020/12/19 23:07:41 Using n1ql client
2020/12/19 23:07:41 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:41 distinct = false
2020/12/19 23:07:42 Using n1ql client
2020/12/19 23:07:42 
--- SingleSeek ---
2020/12/19 23:07:42 distinct = false
2020/12/19 23:07:42 Using n1ql client
2020/12/19 23:07:42 
--- MultipleSeek ---
2020/12/19 23:07:42 distinct = false
2020/12/19 23:07:43 Using n1ql client
2020/12/19 23:07:43 
--- SimpleRange ---
2020/12/19 23:07:43 distinct = false
2020/12/19 23:07:43 Using n1ql client
2020/12/19 23:07:43 
--- NonOverlappingRanges ---
2020/12/19 23:07:43 distinct = false
2020/12/19 23:07:44 Using n1ql client
2020/12/19 23:07:44 
--- OverlappingRanges ---
2020/12/19 23:07:44 distinct = false
2020/12/19 23:07:44 Using n1ql client
2020/12/19 23:07:44 
--- NonOverlappingFilters ---
2020/12/19 23:07:44 distinct = false
2020/12/19 23:07:45 Using n1ql client
2020/12/19 23:07:45 
--- OverlappingFilters ---
2020/12/19 23:07:45 distinct = false
2020/12/19 23:07:45 Using n1ql client
2020/12/19 23:07:46 
--- BoundaryFilters ---
2020/12/19 23:07:46 distinct = false
2020/12/19 23:07:46 Using n1ql client
2020/12/19 23:07:46 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:07:46 distinct = false
2020/12/19 23:07:47 Using n1ql client
2020/12/19 23:07:47 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:07:47 distinct = false
2020/12/19 23:07:47 Using n1ql client
2020/12/19 23:07:47 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:07:47 distinct = false
2020/12/19 23:07:47 Using n1ql client
2020/12/19 23:07:48 Expected and Actual scan responses are the same
2020/12/19 23:07:48 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:07:48 distinct = false
2020/12/19 23:07:48 Using n1ql client
2020/12/19 23:07:48 Expected and Actual scan responses are the same
2020/12/19 23:07:48 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:07:48 distinct = false
2020/12/19 23:07:49 Using n1ql client
2020/12/19 23:07:49 Expected and Actual scan responses are the same
2020/12/19 23:07:49 
--- FiltersWithUnbounded ---
2020/12/19 23:07:49 distinct = false
2020/12/19 23:07:49 Using n1ql client
2020/12/19 23:07:49 Expected and Actual scan responses are the same
2020/12/19 23:07:49 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:07:49 distinct = false
2020/12/19 23:07:50 Using n1ql client
2020/12/19 23:07:50 Expected and Actual scan responses are the same
2020/12/19 23:07:50 

--------- Simple Index with 1 field ---------
2020/12/19 23:07:50 
--- SingleIndexSimpleRange ---
2020/12/19 23:07:50 distinct = false
2020/12/19 23:07:50 Using n1ql client
2020/12/19 23:07:50 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:07:50 distinct = false
2020/12/19 23:07:51 Using n1ql client
2020/12/19 23:07:51 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:07:51 distinct = false
2020/12/19 23:07:51 Using n1ql client
2020/12/19 23:07:51 

--------- Composite Index with 3 fields ---------
2020/12/19 23:07:51 
--- ScanAllNoFilter ---
2020/12/19 23:07:51 distinct = false
2020/12/19 23:07:52 Using n1ql client
2020/12/19 23:07:52 
--- ScanAllFilterNil ---
2020/12/19 23:07:52 distinct = false
2020/12/19 23:07:52 Using n1ql client
2020/12/19 23:07:53 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:53 distinct = false
2020/12/19 23:07:53 Using n1ql client
2020/12/19 23:07:53 
--- 3FieldsSingleSeek ---
2020/12/19 23:07:53 distinct = false
2020/12/19 23:07:54 Using n1ql client
2020/12/19 23:07:54 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:07:54 distinct = false
2020/12/19 23:07:54 Using n1ql client
2020/12/19 23:07:54 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:07:54 distinct = false
2020/12/19 23:07:55 Using n1ql client
--- PASS: TestMultiScanDescOffset (14.65s)
=== RUN   TestMultiScanDescDistinct
2020/12/19 23:07:55 In SkipTestMultiScanDescDistinct()
2020/12/19 23:07:55 

--------- Composite Index with 2 fields ---------
2020/12/19 23:07:55 
--- ScanAllNoFilter ---
2020/12/19 23:07:55 distinct = true
2020/12/19 23:07:55 Using n1ql client
2020/12/19 23:07:56 Expected and Actual scan responses are the same
2020/12/19 23:07:56 
--- ScanAllFilterNil ---
2020/12/19 23:07:56 distinct = true
2020/12/19 23:07:56 Using n1ql client
2020/12/19 23:07:56 Expected and Actual scan responses are the same
2020/12/19 23:07:56 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:07:56 distinct = true
2020/12/19 23:07:57 Using n1ql client
2020/12/19 23:07:57 Expected and Actual scan responses are the same
2020/12/19 23:07:57 
--- SingleSeek ---
2020/12/19 23:07:57 distinct = true
2020/12/19 23:07:57 Using n1ql client
2020/12/19 23:07:57 Expected and Actual scan responses are the same
2020/12/19 23:07:57 
--- MultipleSeek ---
2020/12/19 23:07:57 distinct = true
2020/12/19 23:07:58 Using n1ql client
2020/12/19 23:07:58 Expected and Actual scan responses are the same
2020/12/19 23:07:58 
--- SimpleRange ---
2020/12/19 23:07:58 distinct = true
2020/12/19 23:07:58 Using n1ql client
2020/12/19 23:07:58 Expected and Actual scan responses are the same
2020/12/19 23:07:58 
--- NonOverlappingRanges ---
2020/12/19 23:07:58 distinct = true
2020/12/19 23:07:59 Using n1ql client
2020/12/19 23:07:59 Expected and Actual scan responses are the same
2020/12/19 23:07:59 
--- OverlappingRanges ---
2020/12/19 23:07:59 distinct = true
2020/12/19 23:07:59 Using n1ql client
2020/12/19 23:07:59 Expected and Actual scan responses are the same
2020/12/19 23:07:59 
--- NonOverlappingFilters ---
2020/12/19 23:07:59 distinct = true
2020/12/19 23:08:00 Using n1ql client
2020/12/19 23:08:00 Expected and Actual scan responses are the same
2020/12/19 23:08:00 
--- OverlappingFilters ---
2020/12/19 23:08:00 distinct = true
2020/12/19 23:08:00 Using n1ql client
2020/12/19 23:08:01 Expected and Actual scan responses are the same
2020/12/19 23:08:01 
--- BoundaryFilters ---
2020/12/19 23:08:01 distinct = true
2020/12/19 23:08:01 Using n1ql client
2020/12/19 23:08:01 Expected and Actual scan responses are the same
2020/12/19 23:08:01 
--- SeekAndFilters_NonOverlapping ---
2020/12/19 23:08:01 distinct = true
2020/12/19 23:08:02 Using n1ql client
2020/12/19 23:08:02 Expected and Actual scan responses are the same
2020/12/19 23:08:02 
--- SeekAndFilters_Overlapping ---
2020/12/19 23:08:02 distinct = true
2020/12/19 23:08:02 Using n1ql client
2020/12/19 23:08:02 Expected and Actual scan responses are the same
2020/12/19 23:08:02 
--- SimpleRangeLowUnbounded ---
2020/12/19 23:08:02 distinct = false
2020/12/19 23:08:02 Using n1ql client
2020/12/19 23:08:03 Expected and Actual scan responses are the same
2020/12/19 23:08:03 
--- SimpleRangeHighUnbounded ---
2020/12/19 23:08:03 distinct = false
2020/12/19 23:08:03 Using n1ql client
2020/12/19 23:08:03 Expected and Actual scan responses are the same
2020/12/19 23:08:03 
--- SimpleRangeMultipleUnbounded ---
2020/12/19 23:08:03 distinct = false
2020/12/19 23:08:04 Using n1ql client
2020/12/19 23:08:04 Expected and Actual scan responses are the same
2020/12/19 23:08:04 
--- FiltersWithUnbounded ---
2020/12/19 23:08:04 distinct = false
2020/12/19 23:08:04 Using n1ql client
2020/12/19 23:08:04 Expected and Actual scan responses are the same
2020/12/19 23:08:04 
--- FiltersLowGreaterThanHigh ---
2020/12/19 23:08:04 distinct = false
2020/12/19 23:08:05 Using n1ql client
2020/12/19 23:08:05 Expected and Actual scan responses are the same
2020/12/19 23:08:05 

--------- Simple Index with 1 field ---------
2020/12/19 23:08:05 
--- SingleIndexSimpleRange ---
2020/12/19 23:08:05 distinct = true
2020/12/19 23:08:05 Using n1ql client
2020/12/19 23:08:05 Expected and Actual scan responses are the same
2020/12/19 23:08:05 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2020/12/19 23:08:05 distinct = true
2020/12/19 23:08:06 Using n1ql client
2020/12/19 23:08:06 Expected and Actual scan responses are the same
2020/12/19 23:08:06 
--- SingleIndex_SimpleRanges_Overlapping ---
2020/12/19 23:08:06 distinct = true
2020/12/19 23:08:06 Using n1ql client
2020/12/19 23:08:06 Expected and Actual scan responses are the same
2020/12/19 23:08:06 

--------- Composite Index with 3 fields ---------
2020/12/19 23:08:06 
--- ScanAllNoFilter ---
2020/12/19 23:08:06 distinct = true
2020/12/19 23:08:07 Using n1ql client
2020/12/19 23:08:07 Expected and Actual scan responses are the same
2020/12/19 23:08:07 
--- ScanAllFilterNil ---
2020/12/19 23:08:07 distinct = true
2020/12/19 23:08:08 Using n1ql client
2020/12/19 23:08:08 Expected and Actual scan responses are the same
2020/12/19 23:08:08 
--- ScanAll_AllFiltersNil ---
2020/12/19 23:08:08 distinct = true
2020/12/19 23:08:09 Using n1ql client
2020/12/19 23:08:09 Expected and Actual scan responses are the same
2020/12/19 23:08:09 
--- 3FieldsSingleSeek ---
2020/12/19 23:08:09 distinct = true
2020/12/19 23:08:09 Using n1ql client
2020/12/19 23:08:09 Expected and Actual scan responses are the same
2020/12/19 23:08:09 
--- 3FieldsMultipleSeeks ---
2020/12/19 23:08:09 distinct = true
2020/12/19 23:08:10 Using n1ql client
2020/12/19 23:08:10 Expected and Actual scan responses are the same
2020/12/19 23:08:10 
--- 3FieldsMultipleSeeks_Identical ---
2020/12/19 23:08:10 distinct = true
2020/12/19 23:08:10 Using n1ql client
2020/12/19 23:08:10 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescDistinct (15.47s)
=== RUN   TestGroupAggrSetup
2020/12/19 23:08:10 In TestGroupAggrSetup()
2020/12/19 23:08:10 Emptying the default bucket
2020/12/19 23:08:13 Flush Enabled on bucket default, responseBody: 
2020/12/19 23:08:52 Flushed the bucket default, Response body: 
2020/12/19 23:08:52 Dropping the secondary index index_agg
2020/12/19 23:08:52 Populating the default bucket
2020/12/19 23:08:56 Created the secondary index index_agg. Waiting for it become active
2020/12/19 23:08:56 Index is now active
--- PASS: TestGroupAggrSetup (49.75s)
=== RUN   TestGroupAggrLeading
2020/12/19 23:09:00 In TestGroupAggrLeading()
2020/12/19 23:09:00 Total Scanresults = 7
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 3
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLeading (0.09s)
=== RUN   TestGroupAggrNonLeading
2020/12/19 23:09:00 In TestGroupAggrNonLeading()
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNonLeading (0.01s)
=== RUN   TestGroupAggrNoGroup
2020/12/19 23:09:00 In TestGroupAggrNoGroup()
2020/12/19 23:09:00 Total Scanresults = 1
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroup (0.03s)
=== RUN   TestGroupAggrMinMax
2020/12/19 23:09:00 In TestGroupAggrMinMax()
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax (0.00s)
=== RUN   TestGroupAggrMinMax2
2020/12/19 23:09:00 In TestGroupAggrMinMax()
2020/12/19 23:09:00 Total Scanresults = 1
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax2 (0.02s)
=== RUN   TestGroupAggrLeading_N1QLExprs
2020/12/19 23:09:00 In TestGroupAggrLeading_N1QLExprs()
2020/12/19 23:09:00 Total Scanresults = 17
2020/12/19 23:09:00 basicGroupAggrN1QLExprs1: Scan validation passed
2020/12/19 23:09:00 Total Scanresults = 9
2020/12/19 23:09:00 basicGroupAggrN1QLExprs2: Scan validation passed
--- PASS: TestGroupAggrLeading_N1QLExprs (0.12s)
=== RUN   TestGroupAggrLimit
2020/12/19 23:09:00 In TestGroupAggrLimit()
2020/12/19 23:09:00 Total Scanresults = 3
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLimit (0.01s)
=== RUN   TestGroupAggrOffset
2020/12/19 23:09:00 In TestGroupAggrOffset()
2020/12/19 23:09:00 Total Scanresults = 3
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrOffset (0.00s)
=== RUN   TestGroupAggrCountN
2020/12/19 23:09:00 In TestGroupAggrCountN()
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrCountN (0.00s)
=== RUN   TestGroupAggrNoGroupNoMatch
2020/12/19 23:09:00 In TestGroupAggrNoGroupNoMatch()
2020/12/19 23:09:00 Total Scanresults = 1
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroupNoMatch (0.00s)
=== RUN   TestGroupAggrGroupNoMatch
2020/12/19 23:09:00 In TestGroupAggrGroupNoMatch()
2020/12/19 23:09:00 Total Scanresults = 0
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrGroupNoMatch (0.00s)
=== RUN   TestGroupAggrMultDataTypes
2020/12/19 23:09:00 In TestGroupAggrMultDataTypes()
2020/12/19 23:09:00 Total Scanresults = 8
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMultDataTypes (0.00s)
=== RUN   TestGroupAggrDistinct
2020/12/19 23:09:00 In TestGroupAggrDistinct()
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct (0.00s)
=== RUN   TestGroupAggrDistinct2
2020/12/19 23:09:00 In TestGroupAggrDistinct2()
2020/12/19 23:09:00 Total Scanresults = 1
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 4
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct2 (0.01s)
=== RUN   TestGroupAggrNull
2020/12/19 23:09:00 In TestGroupAggrNull()
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
2020/12/19 23:09:00 Total Scanresults = 2
2020/12/19 23:09:00 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNull (0.00s)
=== RUN   TestGroupAggrInt64
2020/12/19 23:09:00 In TestGroupAggrInt64()
2020/12/19 23:09:00 Updating the default bucket
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
2020/12/19 23:09:01 Total Scanresults = 2
2020/12/19 23:09:01 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrInt64 (0.35s)
=== RUN   TestGroupAggr1
2020/12/19 23:09:01 In TestGroupAggr1()
2020/12/19 23:09:01 In DropAllSecondaryIndexes()
2020/12/19 23:09:01 Index found:  index_company_name_age_desc
2020/12/19 23:09:01 Dropped index index_company_name_age_desc
2020/12/19 23:09:01 Index found:  #primary
2020/12/19 23:09:01 Dropped index #primary
2020/12/19 23:09:01 Index found:  index_companyname_desc
2020/12/19 23:09:01 Dropped index index_companyname_desc
2020/12/19 23:09:01 Index found:  index_company_desc
2020/12/19 23:09:01 Dropped index index_company_desc
2020/12/19 23:09:01 Index found:  index_agg
2020/12/19 23:09:01 Dropped index index_agg
2020/12/19 23:09:40 Flushed the bucket default, Response body: 
2020/12/19 23:09:50 Created the secondary index idx_aggrs. Waiting for it become active
2020/12/19 23:09:50 Index is now active
2020/12/19 23:09:50 Total Scanresults = 641
2020/12/19 23:09:51 Total Scanresults = 753
--- PASS: TestGroupAggr1 (50.28s)
=== RUN   TestGroupAggrArrayIndex
2020/12/19 23:09:51 In TestGroupAggrArrayIndex()
2020/12/19 23:09:55 Created the secondary index ga_arr1. Waiting for it become active
2020/12/19 23:09:55 Index is now active
2020/12/19 23:10:00 Created the secondary index ga_arr2. Waiting for it become active
2020/12/19 23:10:00 Index is now active
2020/12/19 23:10:00 Scenario 1
2020/12/19 23:10:00 Total Scanresults = 641
2020/12/19 23:10:00 Scenario 2
2020/12/19 23:10:00 Total Scanresults = 2835
2020/12/19 23:10:01 Scenario 3
2020/12/19 23:10:01 Total Scanresults = 1
2020/12/19 23:10:01 Scenario 4
2020/12/19 23:10:02 Total Scanresults = 991
2020/12/19 23:10:02 Scenario 5
2020/12/19 23:10:02 Total Scanresults = 2835
2020/12/19 23:10:03 Scenario 6
2020/12/19 23:10:03 Total Scanresults = 1
2020/12/19 23:10:03 Scenario 7
2020/12/19 23:10:04 Total Scanresults = 2931
2020/12/19 23:10:07 Scenario 8
2020/12/19 23:10:07 Total Scanresults = 1168
2020/12/19 23:10:08 Scenario 9
2020/12/19 23:10:08 Total Scanresults = 1
2020/12/19 23:10:08 Scenario 10
2020/12/19 23:10:08 Total Scanresults = 641
2020/12/19 23:10:09 Scenario 11
2020/12/19 23:10:09 Total Scanresults = 1168
2020/12/19 23:10:10 Scenario 12
2020/12/19 23:10:10 Total Scanresults = 1
2020/12/19 23:10:10 Scenario 13
2020/12/19 23:10:14 Total Scanresults = 1
2020/12/19 23:10:14 Count of scanResults is 1
2020/12/19 23:10:14 Value: [2 117]
--- PASS: TestGroupAggrArrayIndex (23.54s)
=== RUN   TestGroupAggr_FirstValidAggrOnly
2020/12/19 23:10:15 In TestGroupAggr_FirstValidAggrOnly()
2020/12/19 23:10:15 In DropAllSecondaryIndexes()
2020/12/19 23:10:15 Index found:  test_oneperprimarykey
2020/12/19 23:10:15 Dropped index test_oneperprimarykey
2020/12/19 23:10:15 Index found:  ga_arr2
2020/12/19 23:10:15 Dropped index ga_arr2
2020/12/19 23:10:15 Index found:  idx_aggrs
2020/12/19 23:10:15 Dropped index idx_aggrs
2020/12/19 23:10:15 Index found:  #primary
2020/12/19 23:10:15 Dropped index #primary
2020/12/19 23:10:15 Index found:  ga_arr1
2020/12/19 23:10:15 Dropped index ga_arr1
2020/12/19 23:10:29 Created the secondary index idx_asc_3field. Waiting for it become active
2020/12/19 23:10:29 Index is now active
2020/12/19 23:10:33 Created the secondary index idx_desc_3field. Waiting for it become active
2020/12/19 23:10:33 Index is now active
2020/12/19 23:10:33 === MIN no group by ===
2020/12/19 23:10:33 Total Scanresults = 1
2020/12/19 23:10:33 Count of scanResults is 1
2020/12/19 23:10:33 Value: ["ACCEL"]
2020/12/19 23:10:33 === MIN no group by, no row match ===
2020/12/19 23:10:33 Total Scanresults = 1
2020/12/19 23:10:33 Count of scanResults is 1
2020/12/19 23:10:33 Value: [null]
2020/12/19 23:10:33 === MIN with group by ===
2020/12/19 23:10:33 Total Scanresults = 641
2020/12/19 23:10:34 === MIN with group by, no row match ===
2020/12/19 23:10:34 Total Scanresults = 0
2020/12/19 23:10:34 === One Aggr, no group by ===
2020/12/19 23:10:34 Total Scanresults = 1
2020/12/19 23:10:34 Count of scanResults is 1
2020/12/19 23:10:34 Value: ["FANFARE"]
2020/12/19 23:10:34 === One Aggr, no group by, no row match ===
2020/12/19 23:10:34 Total Scanresults = 1
2020/12/19 23:10:34 Count of scanResults is 1
2020/12/19 23:10:34 Value: [null]
2020/12/19 23:10:34 === Multiple Aggr, no group by ===
2020/12/19 23:10:34 Total Scanresults = 1
2020/12/19 23:10:34 Count of scanResults is 1
2020/12/19 23:10:34 Value: ["FANFARE" 15]
2020/12/19 23:10:34 === Multiple Aggr, no group by, no row match ===
2020/12/19 23:10:34 Total Scanresults = 1
2020/12/19 23:10:34 Count of scanResults is 1
2020/12/19 23:10:34 Value: [null null]
2020/12/19 23:10:35 === No Aggr, 1 group by ===
2020/12/19 23:10:35 Total Scanresults = 211
2020/12/19 23:10:35 === Aggr on non-leading key, previous equality filter, no group ===
2020/12/19 23:10:35 Total Scanresults = 1
2020/12/19 23:10:35 Count of scanResults is 1
2020/12/19 23:10:35 Value: [59]
2020/12/19 23:10:35 === Aggr on non-leading key, previous equality filters, no group ===
2020/12/19 23:10:35 Total Scanresults = 1
2020/12/19 23:10:35 Count of scanResults is 1
2020/12/19 23:10:35 Value: [null]
2020/12/19 23:10:35 === Aggr on non-leading key, previous non-equality filters, no group ===
2020/12/19 23:10:35 Total Scanresults = 1
2020/12/19 23:10:35 Count of scanResults is 1
2020/12/19 23:10:35 Value: ["Adam"]
2020/12/19 23:10:35 === MIN on desc, no group ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: ["FANFARE"]
2020/12/19 23:10:36 === MAX on asc, no group ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: ["OZEAN"]
2020/12/19 23:10:36 === MAX on desc, no group ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: ["OZEAN"]
2020/12/19 23:10:36 === COUNT(DISTINCT const_expr, no group ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: [1]
2020/12/19 23:10:36 === COUNT(DISTINCT const_expr, no group, no row match ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: [0]
2020/12/19 23:10:36 === COUNT(const_expr, no group ===
2020/12/19 23:10:36 Total Scanresults = 1
2020/12/19 23:10:36 Count of scanResults is 1
2020/12/19 23:10:36 Value: [345]
2020/12/19 23:10:41 Created the secondary index indexMinAggr. Waiting for it become active
2020/12/19 23:10:41 Index is now active
2020/12/19 23:10:41 === Equality filter check: Equality for a, nil filter for b - inclusion 0, no filter for c ===
2020/12/19 23:10:41 Total Scanresults = 1
2020/12/19 23:10:41 Count of scanResults is 1
2020/12/19 23:10:41 Value: [5]
2020/12/19 23:10:41 === Equality filter check: Equality for a, nil filter for b - inclusion 3, no filter for c ===
2020/12/19 23:10:41 Total Scanresults = 1
2020/12/19 23:10:41 Count of scanResults is 1
2020/12/19 23:10:41 Value: [5]
2020/12/19 23:10:42 === Equality filter check: Equality for a, nil filter for b - inclusion 3, nil filter for c ===
2020/12/19 23:10:42 Total Scanresults = 1
2020/12/19 23:10:42 Count of scanResults is 1
2020/12/19 23:10:42 Value: [5]
--- PASS: TestGroupAggr_FirstValidAggrOnly (27.15s)
=== RUN   TestGroupAggrPrimary
2020/12/19 23:10:42 In TestGroupAggrPrimary()
2020/12/19 23:10:42 Total Scanresults = 1
2020/12/19 23:10:42 Total Scanresults = 1
2020/12/19 23:10:42 Total Scanresults = 1
2020/12/19 23:10:42 Total Scanresults = 1002
2020/12/19 23:10:43 Total Scanresults = 1002
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 --- MB-28305 Scenario 1 ---
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Count of scanResults is 1
2020/12/19 23:10:43 Value: [0]
2020/12/19 23:10:43 --- MB-28305 Scenario 2 ---
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Count of scanResults is 1
2020/12/19 23:10:43 Value: [0]
2020/12/19 23:10:43 --- MB-28305 Scenario 3 ---
2020/12/19 23:10:43 Total Scanresults = 1
2020/12/19 23:10:43 Count of scanResults is 1
2020/12/19 23:10:43 Value: [0]
--- PASS: TestGroupAggrPrimary (1.58s)
=== RUN   TestIndexNodeRebalanceIn
2020/12/19 23:10:43 In TestIndexNodeRebalanceIn()
2020/12/19 23:10:43 This test will rebalance in an indexer node into the cluster
2020/12/19 23:10:43 Adding node: http://127.0.0.1:9002 with role: index to the cluster
2020/12/19 23:10:49 addNode: Successfully added node with hostname: 127.0.0.1:9002, res: {"otpNode":"n_2@127.0.0.1"}
2020-12-19T23:10:52.642+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9112: connect: connection refused
2020-12-19T23:10:52.673+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9112: connect: connection refused
2020-12-19T23:10:53.817+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020/12/19 23:10:55 Rebalance progress: 100
--- PASS: TestIndexNodeRebalanceIn (11.44s)
=== RUN   TestIndexNodeRebalanceOut
2020/12/19 23:10:55 In TestIndexNodeRebalanceOut()
2020/12/19 23:10:55 This test will rebalance out an indexer node (127.0.0.1:9001) out of the cluster
2020/12/19 23:10:55 Removing node(s): [127.0.0.1:9001] from the cluster
2020/12/19 23:11:00 Rebalance progress: 0.1302083333333333
2020/12/19 23:11:05 Rebalance progress: 1.171875
2020/12/19 23:11:10 Rebalance progress: 2.12673611111111
2020/12/19 23:11:15 Rebalance progress: 3.125
2020/12/19 23:11:20 Rebalance progress: 4.166666666666667
2020/12/19 23:11:25 Rebalance progress: 5.078125
2020/12/19 23:11:30 Rebalance progress: 6.119791666666667
2020/12/19 23:11:35 Rebalance progress: 7.335069444444444
2020/12/19 23:11:40 Rebalance progress: 8.42013888888889
2020/12/19 23:11:45 Rebalance progress: 9.244791666666666
2020/12/19 23:11:50 Rebalance progress: 10.02604166666667
2020/12/19 23:11:55 Rebalance progress: 11.11111111111111
2020/12/19 23:12:00 Rebalance progress: 12.02256944444444
2020/12/19 23:12:05 Rebalance progress: 12.97743055555556
2020/12/19 23:12:10 Rebalance progress: 14.0625
2020/12/19 23:12:15 Rebalance progress: 15.06076388888889
2020/12/19 23:12:20 Rebalance progress: 15.75520833333333
2020/12/19 23:12:25 Rebalance progress: 16.84027777777778
2020/12/19 23:12:30 Rebalance progress: 17.53472222222222
2020/12/19 23:12:35 Rebalance progress: 18.53298611111111
2020/12/19 23:12:40 Rebalance progress: 19.66145833333333
2020/12/19 23:12:45 Rebalance progress: 20.57291666666667
2020/12/19 23:12:50 Rebalance progress: 21.875
2020/12/19 23:12:55 Rebalance progress: 23.13368055555556
2020/12/19 23:13:00 Rebalance progress: 24.52256944444444
2020/12/19 23:13:05 Rebalance progress: 25.78125
2020/12/19 23:13:10 Rebalance progress: 27.1484375
2020/12/19 23:13:15 Rebalance progress: 28.34201388888889
2020/12/19 23:13:20 Rebalance progress: 29.34027777777778
2020/12/19 23:13:25 Rebalance progress: 30.33854166666667
2020/12/19 23:13:30 Rebalance progress: 31.48871527777778
2020/12/19 23:13:35 Rebalance progress: 33.13802083333334
2020/12/19 23:13:40 Rebalance progress: 33.33333333333334
2020/12/19 23:13:45 Rebalance progress: 33.33333333333334
2020/12/19 23:13:50 Rebalance progress: 38.33333333333333
2020/12/19 23:13:55 Rebalance progress: 70.83333333333333
2020-12-19T23:14:00.182+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:45654->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:14:00.248+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:45634->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 23:14:01 Rebalance progress: 83.33333333333333
2020/12/19 23:14:05 Rebalance progress: 100
--- PASS: TestIndexNodeRebalanceOut (193.06s)
=== RUN   TestFailoverAndRebalance
2020/12/19 23:14:08 In TestFailoverAndRebalance()
2020/12/19 23:14:08 This test will failover and rebalance-out an indexer node (127.0.0.1:9002) out of the cluster
2020/12/19 23:14:08 Failing over: [127.0.0.1:9002]
2020-12-19T23:14:08.827+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = EOF. Kill Pipe.
2020-12-19T23:14:08.827+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:14:08.829+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = EOF. Kill Pipe.
2020-12-19T23:14:08.829+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 23:14:13 Rebalance progress: 100
--- PASS: TestFailoverAndRebalance (8.44s)
=== RUN   TestResetCluster
2020/12/19 23:14:16 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2020/12/19 23:14:21 Rebalance progress: 100
2020/12/19 23:14:31 Adding node: http://127.0.0.1:9001 with role: index to the cluster
2020/12/19 23:14:36 addNode: Successfully added node with hostname: 127.0.0.1:9001, res: {"otpNode":"n_1@127.0.0.1"}
2020-12-19T23:14:40.379+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020-12-19T23:14:40.379+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020-12-19T23:14:41.508+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020/12/19 23:14:41 Rebalance progress: 100
--- PASS: TestResetCluster (24.82s)
=== RUN   TestAlterIndexIncrReplica
2020/12/19 23:14:41 In TestAlterIndexIncrReplica()
2020/12/19 23:14:41 This test creates an index with one replica and then increments replica count to 2
2020/12/19 23:14:41 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2020-12-19T23:14:42.816+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:14:42.816+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:14:42.817+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:14:42.856+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:14:44.857+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020-12-19T23:14:44.867+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020/12/19 23:14:46 Rebalance progress: 100
2020/12/19 23:14:56 Adding node: http://127.0.0.1:9001 with role: index to the cluster
2020/12/19 23:15:01 addNode: Successfully added node with hostname: 127.0.0.1:9001, res: {"otpNode":"n_1@127.0.0.1"}
2020-12-19T23:15:05.126+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020-12-19T23:15:05.128+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020/12/19 23:15:06 Rebalance progress: 100
2020/12/19 23:15:06 Adding node: http://127.0.0.1:9002 with role: index to the cluster
2020-12-19T23:15:06.211+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020-12-19T23:15:06.224+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020/12/19 23:15:10 addNode: Successfully added node with hostname: 127.0.0.1:9002, res: {"otpNode":"n_2@127.0.0.1"}
2020/12/19 23:15:16 Rebalance progress: 100
2020/12/19 23:15:16 Adding node: http://127.0.0.1:9003 with role: index to the cluster
2020/12/19 23:15:22 addNode: Successfully added node with hostname: 127.0.0.1:9003, res: {"otpNode":"n_3@127.0.0.1"}
2020-12-19T23:15:24.889+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9118: connect: connection refused
2020-12-19T23:15:25.237+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9118: connect: connection refused
2020-12-19T23:15:25.997+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020-12-19T23:15:26.286+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020/12/19 23:15:27 Rebalance progress: 100
2020/12/19 23:15:27 In DropAllSecondaryIndexes()
2020/12/19 23:16:13 Flushed the bucket default, Response body: 
2020/12/19 23:16:19 Created the secondary index idx_1. Waiting for it become active
2020/12/19 23:16:19 Index is now active
2020/12/19 23:16:19 Executing alter index command: alter index `default`.idx_1 with {"action":"replica_count", "num_replica":2}
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
2020/12/19 23:16:41 Using n1ql client
--- PASS: TestAlterIndexIncrReplica (119.95s)
=== RUN   TestAlterIndexDecrReplica
2020/12/19 23:16:41 In TestAlterIndexDecrReplica()
2020/12/19 23:16:41 This test creates an index with two replicas and then decrements replica count to 1
2020/12/19 23:16:41 In DropAllSecondaryIndexes()
2020/12/19 23:16:41 Index found:  idx_1
2020/12/19 23:16:41 Dropped index idx_1
2020/12/19 23:16:56 Created the secondary index idx_2. Waiting for it become active
2020/12/19 23:16:56 Index is now active
2020/12/19 23:16:56 Executing alter index command: alter index `default`.idx_2 with {"action":"replica_count", "num_replica":1}
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
2020/12/19 23:17:12 Using n1ql client
--- PASS: TestAlterIndexDecrReplica (31.08s)
=== RUN   TestAlterIndexDropReplica
2020/12/19 23:17:12 In TestAlterIndexDropReplica()
2020/12/19 23:17:12 This test creates an index with two replicas and then drops one replica from cluster
2020/12/19 23:17:12 In DropAllSecondaryIndexes()
2020/12/19 23:17:12 Index found:  idx_2
2020/12/19 23:17:12 Dropped index idx_2
2020/12/19 23:17:27 Created the secondary index idx_3. Waiting for it become active
2020/12/19 23:17:27 Index is now active
2020/12/19 23:17:27 Executing alter index command: alter index `default`.idx_3 with {"action":"drop_replica", "replicaId":0}
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
2020/12/19 23:17:43 Using n1ql client
--- PASS: TestAlterIndexDropReplica (30.95s)
=== RUN   TestResetCluster_1
2020/12/19 23:17:43 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2020-12-19T23:17:47.108+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.108+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:17:47.116+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.117+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:17:47.266+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.267+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:17:47.268+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.268+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:17:47.536+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.536+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:17:47.536+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = EOF. Kill Pipe.
2020-12-19T23:17:47.536+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 23:17:48 Rebalance progress: 100
2020/12/19 23:17:58 Adding node: http://127.0.0.1:9001 with role: index to the cluster
--- FAIL: TestResetCluster_1 (15.07s)
    cluster_setup.go:61: Error while adding node: 127.0.0.1:9001 (role: index) to cluster, err: Unexpected response while adding node: ["Failed to connect to http://127.0.0.1:9001. Could not connect to \"127.0.0.1\" on port 9001.  This could be due to an incorrect host/port combination or a firewall in place between the servers."], err: 
=== RUN   TestPartitionDistributionWithReplica
2020/12/19 23:17:58 Not running TestPartitionDistributionWithReplica for forestdb as partition indexes are not supported with forestdb storage mode
--- PASS: TestPartitionDistributionWithReplica (0.00s)
=== RUN   TestPartitionedPartialIndex
2020/12/19 23:17:58 Not running TestPartitionedPartialIndex for forestdb as partition indexes are not supported with forestdb storage mode
--- PASS: TestPartitionedPartialIndex (0.00s)
=== RUN   TestResetCluster_2
2020/12/19 23:17:58 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2020/12/19 23:18:03 Rebalance progress: 100
2020/12/19 23:18:13 Adding node: http://127.0.0.1:9001 with role: index to the cluster
2020/12/19 23:18:18 addNode: Successfully added node with hostname: 127.0.0.1:9001, res: {"otpNode":"n_1@127.0.0.1"}
2020-12-19T23:18:22.265+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020-12-19T23:18:22.286+05:30 [Error] WatcherServer.runOnce() error : dial tcp 127.0.0.1:9106: connect: connection refused
2020/12/19 23:18:23 Rebalance progress: 100
--- PASS: TestResetCluster_2 (24.72s)
=== RUN   TestCollectionSetup
2020/12/19 23:18:23 In TestCollectionSetup()
2020/12/19 23:18:23 In DropAllSecondaryIndexes()
2020-12-19T23:18:23.408+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2020/12/19 23:19:18 Flushed the bucket default, Response body: 
--- PASS: TestCollectionSetup (56.82s)
=== RUN   TestCollectionDefault
2020/12/19 23:19:20 In TestCollectionDefault()
2020/12/19 23:19:29 Created the secondary index _default__default_i1. Waiting for it become active
2020/12/19 23:19:29 Index is now active
2020/12/19 23:19:29 Using n1ql client
2020/12/19 23:19:29 Expected and Actual scan responses are the same
2020/12/19 23:19:33 Created the secondary index _default__default_i2. Waiting for it become active
2020/12/19 23:19:33 Index is now active
2020/12/19 23:19:33 Using n1ql client
2020/12/19 23:19:33 Expected and Actual scan responses are the same
2020/12/19 23:19:33 Dropping the secondary index _default__default_i1
2020/12/19 23:19:34 Index dropped
2020/12/19 23:19:34 Using n1ql client
2020/12/19 23:19:34 Expected and Actual scan responses are the same
2020/12/19 23:19:37 Created the secondary index _default__default_i1. Waiting for it become active
2020/12/19 23:19:37 Index is now active
2020/12/19 23:19:37 Using n1ql client
2020/12/19 23:19:37 Expected and Actual scan responses are the same
2020/12/19 23:19:37 Dropping the secondary index _default__default_i1
2020/12/19 23:19:38 Index dropped
2020/12/19 23:19:38 Dropping the secondary index _default__default_i2
2020/12/19 23:19:38 Index dropped
2020/12/19 23:19:40 Created the secondary index _default__default_i1. Waiting for it become active
2020/12/19 23:19:40 Index is now active
2020/12/19 23:19:40 Using n1ql client
2020/12/19 23:19:41 Expected and Actual scan responses are the same
2020/12/19 23:19:45 Created the secondary index _default__default_i2. Waiting for it become active
2020/12/19 23:19:45 Index is now active
2020/12/19 23:19:45 Using n1ql client
2020/12/19 23:19:45 Expected and Actual scan responses are the same
2020/12/19 23:19:45 Dropping the secondary index _default__default_i1
2020/12/19 23:19:45 Index dropped
2020/12/19 23:19:45 Dropping the secondary index _default__default_i2
2020/12/19 23:19:45 Index dropped
2020/12/19 23:19:46 Build command issued for the deferred indexes [_default__default_i1 _default__default_i2]
2020/12/19 23:19:46 Waiting for the index _default__default_i1 to become active
2020/12/19 23:19:46 Waiting for index to go active ...
2020/12/19 23:19:47 Waiting for index to go active ...
2020/12/19 23:19:48 Waiting for index to go active ...
2020/12/19 23:19:49 Index is now active
2020/12/19 23:19:49 Waiting for the index _default__default_i2 to become active
2020/12/19 23:19:49 Index is now active
2020/12/19 23:19:55 Using n1ql client
2020/12/19 23:19:55 Expected and Actual scan responses are the same
2020/12/19 23:19:55 Using n1ql client
2020/12/19 23:19:56 Expected and Actual scan responses are the same
2020/12/19 23:19:56 Dropping the secondary index _default__default_i1
2020/12/19 23:19:56 Index dropped
2020/12/19 23:20:02 Using n1ql client
2020/12/19 23:20:02 Expected and Actual scan responses are the same
2020/12/19 23:20:02 Dropping the secondary index _default__default_i2
2020/12/19 23:20:02 Index dropped
--- PASS: TestCollectionDefault (42.09s)
=== RUN   TestCollectionNonDefault
2020/12/19 23:20:02 In TestCollectionNonDefault()
2020/12/19 23:20:02 Creating scope: s1 for bucket: default as it does not exist
2020/12/19 23:20:02 Create scope succeeded for bucket default, scopeName: s1, body: {"uid":"1"} 
2020/12/19 23:20:02 Created collection succeeded for bucket: default, scope: s1, collection: c1, body: {"uid":"2"}
2020/12/19 23:20:16 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:20:16 Index is now active
2020/12/19 23:20:16 Using n1ql client
2020-12-19T23:20:16.862+05:30 [Info] metadata provider version changed 1766 -> 1767
2020-12-19T23:20:16.863+05:30 [Info] switched currmeta from 1766 -> 1767 force false 
2020-12-19T23:20:16.863+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:20:16.863+05:30 [Info] GSIC[default/default-s1-c1-1608400216847757645] started ...
2020/12/19 23:20:16 Expected and Actual scan responses are the same
2020/12/19 23:20:21 Created the secondary index s1_c1_i2. Waiting for it become active
2020/12/19 23:20:21 Index is now active
2020/12/19 23:20:21 Using n1ql client
2020/12/19 23:20:22 Expected and Actual scan responses are the same
2020/12/19 23:20:22 Dropping the secondary index s1_c1_i1
2020/12/19 23:20:22 Index dropped
2020/12/19 23:20:22 Using n1ql client
2020/12/19 23:20:23 Expected and Actual scan responses are the same
2020/12/19 23:20:26 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:20:26 Index is now active
2020/12/19 23:20:26 Using n1ql client
2020/12/19 23:20:26 Expected and Actual scan responses are the same
2020/12/19 23:20:26 Dropping the secondary index s1_c1_i1
2020/12/19 23:20:26 Index dropped
2020/12/19 23:20:26 Dropping the secondary index s1_c1_i2
2020/12/19 23:20:26 Index dropped
2020/12/19 23:20:29 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:20:29 Index is now active
2020/12/19 23:20:29 Using n1ql client
2020/12/19 23:20:30 Expected and Actual scan responses are the same
2020/12/19 23:20:34 Created the secondary index s1_c1_i2. Waiting for it become active
2020/12/19 23:20:34 Index is now active
2020/12/19 23:20:34 Using n1ql client
2020/12/19 23:20:34 Expected and Actual scan responses are the same
2020/12/19 23:20:34 Dropping the secondary index s1_c1_i1
2020/12/19 23:20:34 Index dropped
2020/12/19 23:20:34 Dropping the secondary index s1_c1_i2
2020/12/19 23:20:34 Index dropped
2020/12/19 23:20:35 Build command issued for the deferred indexes [s1_c1_i1 s1_c1_i2]
2020/12/19 23:20:35 Waiting for the index s1_c1_i1 to become active
2020/12/19 23:20:35 Waiting for index to go active ...
2020/12/19 23:20:36 Waiting for index to go active ...
2020/12/19 23:20:37 Waiting for index to go active ...
2020/12/19 23:20:38 Index is now active
2020/12/19 23:20:38 Waiting for the index s1_c1_i2 to become active
2020/12/19 23:20:38 Index is now active
2020/12/19 23:20:39 Using n1ql client
2020/12/19 23:20:40 Expected and Actual scan responses are the same
2020/12/19 23:20:40 Using n1ql client
2020/12/19 23:20:40 Expected and Actual scan responses are the same
2020/12/19 23:20:40 Dropping the secondary index s1_c1_i1
2020/12/19 23:20:40 Index dropped
2020/12/19 23:20:41 Using n1ql client
2020/12/19 23:20:42 Expected and Actual scan responses are the same
2020/12/19 23:20:42 Dropping the secondary index s1_c1_i2
2020/12/19 23:20:42 Index dropped
--- PASS: TestCollectionNonDefault (40.03s)
=== RUN   TestCollectionMetaAtSnapEnd
2020/12/19 23:20:42 In TestCollectionMetaAtSnapEnd()
2020/12/19 23:20:42 Creating scope: s2 for bucket: default as it does not exist
2020/12/19 23:20:42 Create scope succeeded for bucket default, scopeName: s2, body: {"uid":"3"} 
2020/12/19 23:20:42 Created collection succeeded for bucket: default, scope: s2, collection: c2, body: {"uid":"4"}
2020/12/19 23:20:55 Created the secondary index s2_c2_i1. Waiting for it become active
2020/12/19 23:20:55 Index is now active
2020/12/19 23:20:55 Using n1ql client
2020-12-19T23:20:55.755+05:30 [Info] metadata provider version changed 1825 -> 1826
2020-12-19T23:20:55.755+05:30 [Info] switched currmeta from 1825 -> 1826 force false 
2020-12-19T23:20:55.755+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:20:55.755+05:30 [Info] GSIC[default/default-s2-c2-1608400255738707706] started ...
2020/12/19 23:20:55 Expected and Actual scan responses are the same
2020/12/19 23:20:58 Using n1ql client
2020/12/19 23:20:58 Expected and Actual scan responses are the same
2020/12/19 23:20:58 Created collection succeeded for bucket: default, scope: s2, collection: c3, body: {"uid":"5"}
2020/12/19 23:21:08 Using n1ql client
2020/12/19 23:21:08 Expected and Actual scan responses are the same
2020/12/19 23:21:12 Created the secondary index s2_c2_i2. Waiting for it become active
2020/12/19 23:21:12 Index is now active
2020/12/19 23:21:12 Using n1ql client
2020/12/19 23:21:12 Expected and Actual scan responses are the same
2020/12/19 23:21:12 Using n1ql client
2020/12/19 23:21:12 Expected and Actual scan responses are the same
2020/12/19 23:21:18 Using n1ql client
2020/12/19 23:21:18 Expected and Actual scan responses are the same
2020/12/19 23:21:18 Using n1ql client
2020/12/19 23:21:19 Expected and Actual scan responses are the same
--- PASS: TestCollectionMetaAtSnapEnd (36.79s)
=== RUN   TestCollectionUpdateSeq
2020/12/19 23:21:19 In TestCollectionUpdateSeq()
2020/12/19 23:21:19 Using n1ql client
2020/12/19 23:21:20 Expected and Actual scan responses are the same
2020/12/19 23:21:20 Using n1ql client
2020/12/19 23:21:20 Expected and Actual scan responses are the same
2020/12/19 23:21:25 Using n1ql client
2020/12/19 23:21:26 Expected and Actual scan responses are the same
2020/12/19 23:21:26 Using n1ql client
2020/12/19 23:21:26 Expected and Actual scan responses are the same
2020/12/19 23:21:26 Dropping the secondary index s2_c2_i1
2020/12/19 23:21:26 Index dropped
2020/12/19 23:21:26 Dropping the secondary index s2_c2_i2
2020/12/19 23:21:26 Index dropped
--- PASS: TestCollectionUpdateSeq (7.27s)
=== RUN   TestCollectionMultiple
2020/12/19 23:21:26 In TestCollectionMultiple()
2020/12/19 23:21:29 Created the secondary index _default__default_i3. Waiting for it become active
2020/12/19 23:21:29 Index is now active
2020/12/19 23:21:29 Using n1ql client
2020/12/19 23:21:29 Expected and Actual scan responses are the same
2020/12/19 23:21:34 Created the secondary index s1_c1_i4. Waiting for it become active
2020/12/19 23:21:34 Index is now active
2020/12/19 23:21:34 Using n1ql client
2020/12/19 23:21:34 Expected and Actual scan responses are the same
2020/12/19 23:21:34 Dropping the secondary index _default__default_i3
2020/12/19 23:21:34 Index dropped
2020/12/19 23:21:34 Dropping the secondary index s1_c1_i4
2020/12/19 23:21:34 Index dropped
--- PASS: TestCollectionMultiple (8.48s)
=== RUN   TestCollectionNoDocs
2020/12/19 23:21:34 In TestCollectionNoDocs()
2020/12/19 23:21:39 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:21:39 Index is now active
2020/12/19 23:21:39 Using n1ql client
2020/12/19 23:21:39 Expected and Actual scan responses are the same
2020/12/19 23:21:44 Created the secondary index s1_c1_i2. Waiting for it become active
2020/12/19 23:21:44 Index is now active
2020/12/19 23:21:44 Using n1ql client
2020/12/19 23:21:45 Expected and Actual scan responses are the same
2020/12/19 23:21:45 Dropping the secondary index s1_c1_i1
2020/12/19 23:21:45 Index dropped
2020/12/19 23:21:45 Using n1ql client
2020/12/19 23:21:45 Expected and Actual scan responses are the same
2020/12/19 23:21:49 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:21:49 Index is now active
2020/12/19 23:21:49 Using n1ql client
2020/12/19 23:21:50 Expected and Actual scan responses are the same
2020/12/19 23:21:55 Using n1ql client
2020/12/19 23:21:55 Expected and Actual scan responses are the same
2020/12/19 23:21:55 Using n1ql client
2020/12/19 23:21:55 Expected and Actual scan responses are the same
2020/12/19 23:21:55 Dropping the secondary index s1_c1_i1
2020/12/19 23:21:55 Index dropped
2020/12/19 23:21:55 Dropping the secondary index s1_c1_i2
2020/12/19 23:21:56 Index dropped
--- PASS: TestCollectionNoDocs (21.33s)
=== RUN   TestCollectionPrimaryIndex
2020/12/19 23:21:56 In TestCollectionPrimaryIndex()
2020/12/19 23:22:01 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:22:01 Index is now active
2020/12/19 23:22:01 Using n1ql client
2020/12/19 23:22:07 Created the secondary index s1_c1_i2. Waiting for it become active
2020/12/19 23:22:07 Index is now active
2020/12/19 23:22:07 Using n1ql client
2020/12/19 23:22:07 Using n1ql client
2020/12/19 23:22:08 Using n1ql client
2020/12/19 23:22:08 Dropping the secondary index s1_c1_i1
2020/12/19 23:22:08 Index dropped
2020/12/19 23:22:13 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:22:13 Index is now active
2020/12/19 23:22:13 Using n1ql client
2020/12/19 23:22:13 Expected and Actual scan responses are the same
2020/12/19 23:22:14 Using n1ql client
2020/12/19 23:22:14 Expected and Actual scan responses are the same
2020/12/19 23:22:14 Using n1ql client
2020/12/19 23:22:14 Dropping the secondary index s1_c1_i1
2020/12/19 23:22:14 Index dropped
2020/12/19 23:22:14 Dropping the secondary index s1_c1_i2
2020/12/19 23:22:14 Index dropped
--- PASS: TestCollectionPrimaryIndex (18.66s)
=== RUN   TestCollectionMultipleBuilds
2020/12/19 23:22:16 Build command issued for the deferred indexes [15963093274005503334 17315973589745504244]
2020/12/19 23:22:16 Build command issued for the deferred indexes [7573722804214401832 17771875395169641802]
2020/12/19 23:22:16 Waiting for index to go active ...
2020/12/19 23:22:17 Waiting for index to go active ...
2020/12/19 23:22:18 Waiting for index to go active ...
2020/12/19 23:22:19 Waiting for index to go active ...
2020/12/19 23:22:20 Index is now active
2020/12/19 23:22:20 Index is now active
2020/12/19 23:22:20 Waiting for index to go active ...
2020/12/19 23:22:21 Waiting for index to go active ...
2020/12/19 23:22:22 Waiting for index to go active ...
2020/12/19 23:22:23 Waiting for index to go active ...
2020/12/19 23:22:24 Waiting for index to go active ...
2020/12/19 23:22:25 Waiting for index to go active ...
2020/12/19 23:22:26 Index is now active
2020/12/19 23:22:26 Index is now active
2020/12/19 23:22:26 Using n1ql client
2020/12/19 23:22:26 Expected and Actual scan responses are the same
2020/12/19 23:22:26 Using n1ql client
2020/12/19 23:22:26 Expected and Actual scan responses are the same
2020/12/19 23:22:26 Using n1ql client
2020/12/19 23:22:26 Expected and Actual scan responses are the same
2020/12/19 23:22:26 Using n1ql client
2020/12/19 23:22:26 Expected and Actual scan responses are the same
2020/12/19 23:22:26 Dropping the secondary index s2_c2_i3
2020/12/19 23:22:26 Index dropped
2020/12/19 23:22:26 Dropping the secondary index s2_c2_i4
2020/12/19 23:22:27 Index dropped
2020/12/19 23:22:27 Dropping the secondary index s1_c1_i1
2020/12/19 23:22:27 Index dropped
2020/12/19 23:22:27 Dropping the secondary index s1_c1_i2
2020/12/19 23:22:27 Index dropped
--- PASS: TestCollectionMultipleBuilds (12.49s)
=== RUN   TestCollectionMultipleBuilds2
2020/12/19 23:22:30 Build command issued for the deferred indexes [10952168866384093439 13923997574393159284 1166023196655751331 11402725020658604277 16125501410951268262 9121329885273041782 13737561174603106531 12566199512824322272]
2020/12/19 23:22:30 Waiting for index to go active ...
2020/12/19 23:22:31 Waiting for index to go active ...
2020/12/19 23:22:32 Waiting for index to go active ...
2020/12/19 23:22:33 Waiting for index to go active ...
2020/12/19 23:22:34 Index is now active
2020/12/19 23:22:34 Index is now active
2020/12/19 23:22:34 Waiting for index to go active ...
2020/12/19 23:22:35 Waiting for index to go active ...
2020/12/19 23:22:36 Waiting for index to go active ...
2020/12/19 23:22:37 Waiting for index to go active ...
2020/12/19 23:22:38 Waiting for index to go active ...
2020/12/19 23:22:39 Waiting for index to go active ...
2020/12/19 23:22:40 Waiting for index to go active ...
2020/12/19 23:22:41 Waiting for index to go active ...
2020/12/19 23:22:42 Waiting for index to go active ...
2020/12/19 23:22:43 Waiting for index to go active ...
2020/12/19 23:22:44 Waiting for index to go active ...
2020/12/19 23:22:45 Waiting for index to go active ...
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Index is now active
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020-12-19T23:22:46.947+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:22:46.947+05:30 [Info] GSIC[default/default-s2-c3-1608400366943666065] started ...
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:46 Expected and Actual scan responses are the same
2020/12/19 23:22:46 Using n1ql client
2020/12/19 23:22:47 Expected and Actual scan responses are the same
2020/12/19 23:22:47 Using n1ql client
2020/12/19 23:22:47 Expected and Actual scan responses are the same
2020/12/19 23:22:48 Using n1ql client
2020/12/19 23:22:48 Expected and Actual scan responses are the same
2020/12/19 23:22:48 Using n1ql client
2020/12/19 23:22:48 Expected and Actual scan responses are the same
2020/12/19 23:22:48 Dropping the secondary index s1_c1_i1
2020/12/19 23:22:48 Index dropped
2020/12/19 23:22:48 Dropping the secondary index s1_c1_i2
2020/12/19 23:22:48 Index dropped
2020/12/19 23:22:48 Dropping the secondary index s2_c2_i1
2020/12/19 23:22:48 Index dropped
2020/12/19 23:22:48 Dropping the secondary index s2_c2_i2
2020/12/19 23:22:49 Index dropped
2020/12/19 23:22:49 Dropping the secondary index s2_c3_i1
2020/12/19 23:22:49 Index dropped
2020/12/19 23:22:49 Dropping the secondary index s2_c3_i2
2020/12/19 23:22:49 Index dropped
2020/12/19 23:22:49 Dropping the secondary index _default__default_i1
2020/12/19 23:22:49 Index dropped
2020/12/19 23:22:49 Dropping the secondary index _default__default_i2
2020/12/19 23:22:49 Index dropped
--- PASS: TestCollectionMultipleBuilds2 (22.26s)
=== RUN   TestCollectionIndexDropConcurrentBuild
2020/12/19 23:22:49 In TestCollectionIndexDropConcurrentBuild()
2020/12/19 23:22:50 Build command issued for the deferred indexes [2462055565433862370 5779954257055640687]
2020/12/19 23:22:51 Dropping the secondary index s1_c1_i1
2020/12/19 23:22:51 Index dropped
2020/12/19 23:22:51 Waiting for index to go active ...
2020/12/19 23:22:52 Waiting for index to go active ...
2020/12/19 23:22:53 Waiting for index to go active ...
2020/12/19 23:22:54 Index is now active
2020/12/19 23:22:54 Using n1ql client
2020/12/19 23:22:54 Expected and Actual scan responses are the same
2020/12/19 23:22:54 Dropping the secondary index s1_c1_i2
2020/12/19 23:22:55 Index dropped
--- PASS: TestCollectionIndexDropConcurrentBuild (5.50s)
=== RUN   TestCollectionIndexDropConcurrentBuild2
2020/12/19 23:22:55 In TestCollectionIndexDropConcurrentBuild2()
2020/12/19 23:23:00 Created the secondary index s1_c1_i3. Waiting for it become active
2020/12/19 23:23:00 Index is now active
2020/12/19 23:23:00 Using n1ql client
2020/12/19 23:23:00 Expected and Actual scan responses are the same
2020/12/19 23:23:00 Build command issued for the deferred indexes [9038613711973858111 8313129980031238782]
2020/12/19 23:23:01 Dropping the secondary index s1_c1_i3
2020/12/19 23:23:01 Index dropped
2020/12/19 23:23:01 Waiting for index to go active ...
2020/12/19 23:23:02 Waiting for index to go active ...
2020/12/19 23:23:03 Waiting for index to go active ...
2020/12/19 23:23:04 Waiting for index to go active ...
2020/12/19 23:23:05 Index is now active
2020/12/19 23:23:05 Index is now active
2020/12/19 23:23:05 Using n1ql client
2020/12/19 23:23:06 Expected and Actual scan responses are the same
2020/12/19 23:23:06 Using n1ql client
2020/12/19 23:23:06 Expected and Actual scan responses are the same
2020/12/19 23:23:06 Dropping the secondary index s1_c1_i1
2020/12/19 23:23:07 Index dropped
2020/12/19 23:23:07 Dropping the secondary index s1_c1_i2
2020/12/19 23:23:07 Index dropped
--- PASS: TestCollectionIndexDropConcurrentBuild2 (12.65s)
=== RUN   TestCollectionDrop
2020/12/19 23:23:07 In TestCollectionDrop()
2020/12/19 23:23:11 Created the secondary index s1_c1_i1. Waiting for it become active
2020/12/19 23:23:11 Index is now active
2020/12/19 23:23:16 Created the secondary index s1_c1_i2. Waiting for it become active
2020/12/19 23:23:16 Index is now active
2020/12/19 23:23:20 Created the secondary index s2_c2_i1. Waiting for it become active
2020/12/19 23:23:20 Index is now active
2020/12/19 23:23:24 Created the secondary index s2_c2_i2. Waiting for it become active
2020/12/19 23:23:24 Index is now active
2020/12/19 23:23:28 Created the secondary index s2_c3_i1. Waiting for it become active
2020/12/19 23:23:28 Index is now active
2020/12/19 23:23:32 Created the secondary index s2_c3_i2. Waiting for it become active
2020/12/19 23:23:32 Index is now active
2020/12/19 23:23:36 Created the secondary index _default__default_i1. Waiting for it become active
2020/12/19 23:23:36 Index is now active
2020/12/19 23:23:40 Created the secondary index _default__default_i2. Waiting for it become active
2020/12/19 23:23:40 Index is now active
2020/12/19 23:23:40 Dropped collection c1 for bucket: default, scope: s1, body: {"uid":"6"}
2020/12/19 23:23:45 Using n1ql client
2020/12/19 23:23:45 Scan failed as expected with error: GSI index s1_c1_i1 not found.
2020/12/19 23:23:45 Dropped scope s2 for bucket: default, body: {"uid":"7"}
2020/12/19 23:23:50 Using n1ql client
2020-12-19T23:23:50.492+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:23:50.492+05:30 [Info] GSIC[default/default-s2-c1-1608400430489368348] started ...
2020/12/19 23:23:50 Scan failed as expected with error: GSI index s2_c1_i1 not found.
--- PASS: TestCollectionDrop (42.82s)
=== RUN   TestCollectionDDLWithConcurrentSystemEvents
2020/12/19 23:23:50 Creating scope: sc for bucket: default as it does not exist
2020/12/19 23:23:50 Create scope succeeded for bucket default, scopeName: sc, body: {"uid":"8"} 
2020/12/19 23:23:50 Created collection succeeded for bucket: default, scope: sc, collection: cc, body: {"uid":"9"}
2020/12/19 23:24:04 Created the secondary index sc_cc_i1. Waiting for it become active
2020/12/19 23:24:04 Index is now active
2020/12/19 23:24:06 Build command issued for the deferred indexes [sc_cc_i2]
2020/12/19 23:24:06 Waiting for the index sc_cc_i2 to become active
2020/12/19 23:24:06 Waiting for index to go active ...
2020/12/19 23:24:07 Created collection succeeded for bucket: default, scope: sc, collection: cc_0, body: {"uid":"a"}
2020/12/19 23:24:07 Created collection succeeded for bucket: default, scope: sc, collection: cc_1, body: {"uid":"b"}
2020/12/19 23:24:07 Waiting for index to go active ...
2020/12/19 23:24:08 Created collection succeeded for bucket: default, scope: sc, collection: cc_2, body: {"uid":"c"}
2020/12/19 23:24:08 Created collection succeeded for bucket: default, scope: sc, collection: cc_3, body: {"uid":"d"}
2020/12/19 23:24:08 Created collection succeeded for bucket: default, scope: sc, collection: cc_4, body: {"uid":"e"}
2020/12/19 23:24:08 Waiting for index to go active ...
2020/12/19 23:24:09 Created collection succeeded for bucket: default, scope: sc, collection: cc_5, body: {"uid":"f"}
2020/12/19 23:24:09 Created collection succeeded for bucket: default, scope: sc, collection: cc_6, body: {"uid":"10"}
2020/12/19 23:24:09 Waiting for index to go active ...
2020/12/19 23:24:10 Created collection succeeded for bucket: default, scope: sc, collection: cc_7, body: {"uid":"11"}
2020/12/19 23:24:10 Created collection succeeded for bucket: default, scope: sc, collection: cc_8, body: {"uid":"12"}
2020/12/19 23:24:10 Waiting for index to go active ...
2020/12/19 23:24:11 Created collection succeeded for bucket: default, scope: sc, collection: cc_9, body: {"uid":"13"}
2020/12/19 23:24:11 Waiting for index to go active ...
2020/12/19 23:24:12 Waiting for index to go active ...
2020/12/19 23:24:13 Waiting for index to go active ...
2020/12/19 23:24:14 Index is now active
2020/12/19 23:24:14 Using n1ql client
2020-12-19T23:24:14.878+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:24:14.879+05:30 [Info] GSIC[default/default-sc-cc-1608400454875359477] started ...
--- PASS: TestCollectionDDLWithConcurrentSystemEvents (24.39s)
=== RUN   TestCollectionDropWithMultipleBuckets
2020/12/19 23:24:14 In TestCollectionWithDropMultipleBuckets()
2020/12/19 23:24:14 This test will create a collection across multiple buckets and 
2020/12/19 23:24:14 drops a collection on one bucket. Indexer should not drop indexes
2020/12/19 23:24:14 with same CollectionID but different buckets
2020/12/19 23:24:14 Creating test_bucket_1
2020/12/19 23:24:14 Created bucket test_bucket_1, responseBody: 
2020/12/19 23:24:24 Creating test_bucket_2
2020/12/19 23:24:24 Created bucket test_bucket_2, responseBody: 
2020/12/19 23:24:34 Creating collection: test for bucket: test_bucket_1
2020/12/19 23:24:35 Created collection succeeded for bucket: test_bucket_1, scope: _default, collection: test, body: {"uid":"1"}
2020/12/19 23:24:35 Creating collection: test for bucket: test_bucket_2
2020/12/19 23:24:35 Created collection succeeded for bucket: test_bucket_2, scope: _default, collection: test, body: {"uid":"1"}
2020/12/19 23:24:45 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_1
2020/12/19 23:24:49 Created the secondary index idx_1. Waiting for it become active
2020/12/19 23:24:49 Index is now active
2020/12/19 23:24:54 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_2
2020/12/19 23:24:58 Created the secondary index idx_1. Waiting for it become active
2020/12/19 23:24:58 Index is now active
2020/12/19 23:25:03 Dropping collection: test for bucket: test_bucket_1
2020/12/19 23:25:03 Dropped collection test for bucket: test_bucket_1, scope: _default, body: {"uid":"2"}
2020/12/19 23:25:05 Scanning index: idx_1, bucket: test_bucket_2
2020/12/19 23:25:05 Using n1ql client
2020-12-19T23:25:05.498+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:25:05.499+05:30 [Info] GSIC[default/test_bucket_2-_default-test-1608400505495184321] started ...
2020/12/19 23:25:05 Deleting bucket: test_bucket_2
2020/12/19 23:25:08 Deleted bucket test_bucket_2, responseBody: 
2020/12/19 23:25:13 Creating test_bucket_2
2020/12/19 23:25:13 Created bucket test_bucket_2, responseBody: 
2020/12/19 23:25:23 Creating collection: test for bucket: test_bucket_2
2020/12/19 23:25:23 Created collection succeeded for bucket: test_bucket_2, scope: _default, collection: test, body: {"uid":"1"}
2020/12/19 23:25:33 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_2
2020/12/19 23:25:38 Build command issued for the deferred indexes [idx_1]
2020/12/19 23:25:38 Waiting for the index idx_1 to become active
2020/12/19 23:25:38 Waiting for index to go active ...
2020/12/19 23:25:39 Waiting for index to go active ...
2020/12/19 23:25:40 Waiting for index to go active ...
2020/12/19 23:25:41 Waiting for index to go active ...
2020/12/19 23:25:42 Index is now active
2020/12/19 23:25:42 Scanning index: idx_1, bucket: test_bucket_2
2020/12/19 23:25:42 Using n1ql client
2020/12/19 23:25:45 Deleted bucket test_bucket_1, responseBody: 
2020/12/19 23:25:47 Deleted bucket test_bucket_2, responseBody: 
--- PASS: TestCollectionDropWithMultipleBuckets (97.58s)
=== RUN   TestStringToByteSlice
--- PASS: TestStringToByteSlice (0.00s)
=== RUN   TestStringToByteSlice_Stack
--- PASS: TestStringToByteSlice_Stack (1.32s)
=== RUN   TestByteSliceToString
--- PASS: TestByteSliceToString (0.00s)
=== RUN   TestBytesToString_WithUnusedBytes
--- PASS: TestBytesToString_WithUnusedBytes (0.00s)
=== RUN   TestStringHeadersCompatible
--- PASS: TestStringHeadersCompatible (0.00s)
=== RUN   TestSliceHeadersCompatible
--- PASS: TestSliceHeadersCompatible (0.00s)
=== RUN   TestIdxCorruptBasicSanityMultipleIndices
2020/12/19 23:25:53 In DropAllSecondaryIndexes()
2020/12/19 23:25:53 Index found:  sc_cc_i1
2020/12/19 23:25:53 Dropped index sc_cc_i1
2020/12/19 23:25:53 Index found:  sc_cc_i2
2020/12/19 23:25:53 Dropped index sc_cc_i2
2020/12/19 23:25:53 Index found:  _default__default_i1
2020/12/19 23:25:54 Dropped index _default__default_i1
2020/12/19 23:25:54 Index found:  _default__default_i2
2020/12/19 23:25:54 Dropped index _default__default_i2
Creating two indices ...
2020/12/19 23:26:07 Created the secondary index corrupt_idx1_age. Waiting for it become active
2020/12/19 23:26:07 Index is now active
2020/12/19 23:26:12 Created the secondary index corrupt_idx2_company. Waiting for it become active
2020/12/19 23:26:12 Index is now active
hosts = [127.0.0.1:9108]
2020/12/19 23:26:12 Corrupting index corrupt_idx1_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx1_age_17722307450209554578_0.index
2020/12/19 23:26:12 Corrupting index corrupt_idx1_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx1_age_17722307450209554578_0.index filepath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx1_age_17722307450209554578_0.index/data.fdb.0
2020/12/19 23:26:12 Written data to offset  1253375
2020/12/19 23:26:12 FDBCorrupt: Corrupted header for block id 305
2020/12/19 23:26:12 Written data to offset  53247
2020/12/19 23:26:12 FDBCorrupt: Corrupted header for block id 12
2020/12/19 23:26:12 Written data to offset  45055
2020/12/19 23:26:12 FDBCorrupt: Corrupted header for block id 10
Restarting indexer process ...
2020/12/19 23:26:12 []
2020-12-19T23:26:12.930+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:26:12.930+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:26:12.931+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:26:12.931+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 23:26:33 Using n1ql client
2020-12-19T23:26:33.855+05:30 [Error] transport error between 127.0.0.1:53188->127.0.0.1:9107: write tcp 127.0.0.1:53188->127.0.0.1:9107: write: broken pipe
2020-12-19T23:26:33.855+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 7088130222484248635 request transport failed `write tcp 127.0.0.1:53188->127.0.0.1:9107: write: broken pipe`
2020-12-19T23:26:33.855+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 23:26:33 Using n1ql client
--- PASS: TestIdxCorruptBasicSanityMultipleIndices (40.10s)
=== RUN   TestIdxCorruptPartitionedIndex
Not running TestPartitionedIndex for forestdb
--- PASS: TestIdxCorruptPartitionedIndex (0.00s)
=== RUN   TestIdxCorruptMOITwoSnapsOneCorrupt
Not running TestMOITwoSnapsOneCorrupt for forestdb
--- PASS: TestIdxCorruptMOITwoSnapsOneCorrupt (0.00s)
=== RUN   TestIdxCorruptMOITwoSnapsBothCorrupt
Not running TestMOITwoSnapsBothCorrupt for forestdb
--- PASS: TestIdxCorruptMOITwoSnapsBothCorrupt (0.00s)
=== RUN   TestIdxCorruptBackup
2020/12/19 23:26:33 Changing config key indexer.settings.enable_corrupt_index_backup to value true
Creating index ...
2020-12-19T23:26:34.028+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:26:34.187+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:26:34.233+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:26:34.233+05:30 [Info] Score: 0
2020-12-19T23:26:34.233+05:30 [Info] variation: 0
2020-12-19T23:26:34.233+05:30 [Info] ElapsedTime: 6ms
2020-12-19T23:26:34.233+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:26:34.233+05:30 [Info] Iteration: 0
2020-12-19T23:26:34.233+05:30 [Info] Move: 0
2020-12-19T23:26:34.233+05:30 [Info] ----------------------------------------
2020-12-19T23:26:34.233+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:26:34.233+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Data Size Mean 1259477375 (1.17298G)
2020-12-19T23:26:34.233+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:26:34.233+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:26:34.233+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:26:34.233+05:30 [Info] ----------------------------------------
2020-12-19T23:26:34.233+05:30 [Info] Number of indexes: 2
2020-12-19T23:26:34.233+05:30 [Info] Number of indexers: 1
2020-12-19T23:26:34.233+05:30 [Info] Avg Index Size: 629145600 (600M)
2020-12-19T23:26:34.233+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:26:34.233+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:26:34.233+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:26:34.233+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:26:34.233+05:30 [Info] ----------------------------------------
2020-12-19T23:26:34.233+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:26:34.233+05:30 [Info] CPU Quota 4
2020-12-19T23:26:34.233+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:26:34.234+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:26:34.234+05:30 [Info] ----------------------------------------
2020-12-19T23:26:34.234+05:30 [Info] Total iteration: 0
2020-12-19T23:26:34.234+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:26:34.234+05:30 [Info] RandomSwap call: 0
2020-12-19T23:26:34.234+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:26:34.234+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:26:34.234+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:26:34.234+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:26:34.234+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:26:34.234+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:26:34.234+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:26:34.234+05:30 [Info] ----------------------------------------
2020-12-19T23:26:34.234+05:30 [Info] 
2020-12-19T23:26:34.234+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:e30a25a8d4f0a5cfd88615a1d168d9a7, useLiveData:true
2020-12-19T23:26:34.234+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258528435 (1.1721G), data:1259477375 (1.17298G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2020-12-19T23:26:34.234+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:26:34.234+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:26:34.234+05:30 [Info] 		Index name:corrupt_idx2_company 0, bucket:default, scope:_default, collection:_default, defnId:13224752993389894353, instId:6577575421096779528, Partition: 0, new/moved:false
2020-12-19T23:26:34.234+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:237235 (231.675K), data:1186175 (1.13122M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:26:34.234+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:26:34.234+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:26:34.234+05:30 [Info] 		Index name:corrupt_idx6_age 0, bucket:default, scope:_default, collection:_default, defnId:1863214229811631284, instId:8496889850675907680, Partition: 0, new/moved:true
2020-12-19T23:26:34.234+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:26:34.234+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:26:34.234+05:30 [Info] ****************************************
2020-12-19T23:26:34.234+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:26:34.300+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.300+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.309+05:30 [Info] switched currmeta from 2182 -> 2186 force true 
2020-12-19T23:26:34.314+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.314+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.325+05:30 [Info] switched currmeta from 2186 -> 2190 force true 
2020-12-19T23:26:34.468+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.468+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.477+05:30 [Info] switched currmeta from 2186 -> 2187 force true 
2020-12-19T23:26:34.480+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.480+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.487+05:30 [Info] switched currmeta from 2190 -> 2191 force true 
2020-12-19T23:26:34.562+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.562+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.562+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:34.562+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:34.565+05:30 [Info] switched currmeta from 2187 -> 2187 force true 
2020-12-19T23:26:34.566+05:30 [Info] switched currmeta from 2191 -> 2191 force true 
2020-12-19T23:26:36.383+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:26:36.488+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:36.488+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:36.496+05:30 [Info] switched currmeta from 2191 -> 2191 force true 
2020-12-19T23:26:36.504+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:36.504+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:36.515+05:30 [Info] switched currmeta from 2187 -> 2187 force true 
2020-12-19T23:26:37.346+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:37.346+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:37.349+05:30 [Info] switched currmeta from 2187 -> 2188 force true 
2020-12-19T23:26:37.353+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:37.353+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:37.357+05:30 [Info] switched currmeta from 2191 -> 2192 force true 
2020-12-19T23:26:38.007+05:30 [Info] CreateIndex 1863214229811631284 default _default _default/corrupt_idx6_age using:forestdb exprType:N1QL whereExpr:() secExprs:([`age`]) desc:[false] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.099272384s) err()
2020/12/19 23:26:38 Created the secondary index corrupt_idx6_age. Waiting for it become active
2020-12-19T23:26:38.008+05:30 [Info] metadata provider version changed 2192 -> 2193
2020-12-19T23:26:38.008+05:30 [Info] switched currmeta from 2192 -> 2193 force false 
2020/12/19 23:26:38 Index is now active
2020-12-19T23:26:38.106+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:38.106+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:38.108+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:38.108+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:38.110+05:30 [Info] switched currmeta from 2188 -> 2189 force true 
2020-12-19T23:26:38.112+05:30 [Info] switched currmeta from 2193 -> 2193 force true 
hosts = [127.0.0.1:9108]
2020/12/19 23:26:38 Corrupting index corrupt_idx6_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx6_age_4773240488147617685_0.index
2020/12/19 23:26:38 Corrupting index corrupt_idx6_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx6_age_4773240488147617685_0.index filepath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx6_age_4773240488147617685_0.index/data.fdb.0
2020/12/19 23:26:38 Written data to offset  1249279
2020/12/19 23:26:38 FDBCorrupt: Corrupted header for block id 304
2020/12/19 23:26:38 Written data to offset  53247
2020/12/19 23:26:38 FDBCorrupt: Corrupted header for block id 12
2020/12/19 23:26:38 Written data to offset  45055
2020/12/19 23:26:38 FDBCorrupt: Corrupted header for block id 10
Restarting indexer process ...
2020/12/19 23:26:38 []
2020-12-19T23:26:38.183+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:26:38.184+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:26:38.184+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:26:38.185+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:26:41.336+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:26:41.390+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:41.390+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:41.394+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:41.394+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:41.394+05:30 [Info] switched currmeta from 2193 -> 2193 force true 
2020-12-19T23:26:41.396+05:30 [Info] switched currmeta from 2189 -> 2189 force true 
2020-12-19T23:26:44.743+05:30 [Info] Rollback time has changed for index inst 6577575421096779528. New rollback time 1608400598912367359
2020-12-19T23:26:44.743+05:30 [Info] Rollback time has changed for index inst 6577575421096779528. New rollback time 1608400598912367359
--- PASS: TestIdxCorruptBackup (24.27s)
=== RUN   TestStatsPersistence
2020/12/19 23:26:58 In TestStatsPersistence()
2020/12/19 23:26:58 In DropAllSecondaryIndexes()
2020-12-19T23:26:58.154+05:30 [Info] metadata provider version changed 2193 -> 2200
2020-12-19T23:26:58.154+05:30 [Info] switched currmeta from 2193 -> 2200 force false 
2020/12/19 23:26:58 Index found:  corrupt_idx2_company
2020-12-19T23:26:58.154+05:30 [Info] DropIndex 13224752993389894353 ...
2020-12-19T23:26:58.218+05:30 [Info] metadata provider version changed 2200 -> 2202
2020-12-19T23:26:58.218+05:30 [Info] switched currmeta from 2200 -> 2202 force false 
2020-12-19T23:26:58.218+05:30 [Info] DropIndex 13224752993389894353 - elapsed(64.266157ms), err()
2020/12/19 23:26:58 Dropped index corrupt_idx2_company
2020-12-19T23:26:58.491+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:58.491+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:58.505+05:30 [Info] switched currmeta from 2202 -> 2202 force true 
2020-12-19T23:26:58.512+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:58.512+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:58.537+05:30 [Info] switched currmeta from 2189 -> 2198 force true 
2020-12-19T23:26:58.607+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:58.607+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:58.611+05:30 [Info] switched currmeta from 2202 -> 2202 force true 
2020-12-19T23:26:58.615+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:58.615+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:58.617+05:30 [Info] switched currmeta from 2198 -> 2198 force true 
2020-12-19T23:26:59.226+05:30 [Info] CreateIndex default _default _default index_age ...
2020-12-19T23:26:59.227+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:26:59.228+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_age)
2020-12-19T23:26:59.264+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:26:59.408+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:26:59.434+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:26:59.434+05:30 [Info] Score: 0
2020-12-19T23:26:59.434+05:30 [Info] variation: 0
2020-12-19T23:26:59.434+05:30 [Info] ElapsedTime: 6ms
2020-12-19T23:26:59.434+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:26:59.434+05:30 [Info] Iteration: 0
2020-12-19T23:26:59.434+05:30 [Info] Move: 0
2020-12-19T23:26:59.434+05:30 [Info] ----------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:26:59.434+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Data Size Mean 1258291200 (1.17188G)
2020-12-19T23:26:59.434+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:26:59.434+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:26:59.434+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:26:59.434+05:30 [Info] ----------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] Number of indexes: 1
2020-12-19T23:26:59.434+05:30 [Info] Number of indexers: 1
2020-12-19T23:26:59.434+05:30 [Info] Avg Index Size: 1258291200 (1.17188G)
2020-12-19T23:26:59.434+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:26:59.434+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:26:59.434+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:26:59.434+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:26:59.434+05:30 [Info] ----------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:26:59.434+05:30 [Info] CPU Quota 4
2020-12-19T23:26:59.434+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:26:59.434+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:26:59.434+05:30 [Info] ----------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] Total iteration: 0
2020-12-19T23:26:59.434+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:26:59.434+05:30 [Info] RandomSwap call: 0
2020-12-19T23:26:59.434+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:26:59.434+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:26:59.434+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:26:59.434+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:26:59.434+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:26:59.434+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:26:59.434+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:26:59.434+05:30 [Info] ----------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] 
2020-12-19T23:26:59.434+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:e30a25a8d4f0a5cfd88615a1d168d9a7, useLiveData:true
2020-12-19T23:26:59.434+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2020-12-19T23:26:59.434+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:26:59.434+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:26:59.434+05:30 [Info] 		Index name:index_age 0, bucket:default, scope:_default, collection:_default, defnId:454000905147901893, instId:17744511631896227947, Partition: 0, new/moved:true
2020-12-19T23:26:59.434+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:26:59.434+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:26:59.434+05:30 [Info] ****************************************
2020-12-19T23:26:59.434+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:26:59.591+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:59.591+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:59.596+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:59.596+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:59.603+05:30 [Info] switched currmeta from 2202 -> 2207 force true 
2020-12-19T23:26:59.605+05:30 [Info] switched currmeta from 2198 -> 2203 force true 
2020-12-19T23:26:59.681+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:59.681+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:59.684+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:26:59.684+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:26:59.688+05:30 [Info] switched currmeta from 2207 -> 2207 force true 
2020-12-19T23:26:59.689+05:30 [Info] switched currmeta from 2203 -> 2203 force true 
2020-12-19T23:27:01.400+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:27:01.510+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:01.510+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:01.563+05:30 [Info] switched currmeta from 2207 -> 2207 force true 
2020-12-19T23:27:01.575+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:01.575+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:01.591+05:30 [Info] switched currmeta from 2203 -> 2203 force true 
2020-12-19T23:27:02.453+05:30 [Info] CreateIndex 454000905147901893 default _default _default/index_age using:forestdb exprType:N1QL whereExpr:() secExprs:([`age`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.226402905s) err()
2020/12/19 23:27:02 Created the secondary index index_age. Waiting for it become active
2020-12-19T23:27:02.453+05:30 [Info] metadata provider version changed 2207 -> 2208
2020-12-19T23:27:02.453+05:30 [Info] switched currmeta from 2207 -> 2208 force false 
2020/12/19 23:27:02 Index is now active
2020-12-19T23:27:02.453+05:30 [Info] CreateIndex default _default _default index_gender ...
2020-12-19T23:27:02.454+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:27:02.458+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_gender)
2020-12-19T23:27:02.537+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:02.537+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:02.540+05:30 [Info] switched currmeta from 2203 -> 2204 force true 
2020-12-19T23:27:02.546+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:02.546+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:02.549+05:30 [Info] switched currmeta from 2208 -> 2208 force true 
2020-12-19T23:27:02.570+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:27:02.826+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:27:02.851+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:27:02.851+05:30 [Info] Score: 0
2020-12-19T23:27:02.851+05:30 [Info] variation: 0
2020-12-19T23:27:02.851+05:30 [Info] ElapsedTime: 5ms
2020-12-19T23:27:02.851+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:27:02.851+05:30 [Info] Iteration: 0
2020-12-19T23:27:02.851+05:30 [Info] Move: 0
2020-12-19T23:27:02.851+05:30 [Info] ----------------------------------------
2020-12-19T23:27:02.851+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:27:02.851+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:27:02.851+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:27:02.851+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:27:02.851+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:27:02.851+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:27:02.851+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Data Size Mean 1259751737 (1.17324G)
2020-12-19T23:27:02.851+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:27:02.851+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:27:02.851+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:02.851+05:30 [Info] ----------------------------------------
2020-12-19T23:27:02.851+05:30 [Info] Number of indexes: 2
2020-12-19T23:27:02.851+05:30 [Info] Number of indexers: 1
2020-12-19T23:27:02.851+05:30 [Info] Avg Index Size: 629145600 (600M)
2020-12-19T23:27:02.851+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:27:02.851+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:27:02.851+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:27:02.852+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:27:02.852+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:27:02.852+05:30 [Info] ----------------------------------------
2020-12-19T23:27:02.852+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:27:02.852+05:30 [Info] CPU Quota 4
2020-12-19T23:27:02.852+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:27:02.852+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:27:02.852+05:30 [Info] ----------------------------------------
2020-12-19T23:27:02.852+05:30 [Info] Total iteration: 0
2020-12-19T23:27:02.852+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:27:02.852+05:30 [Info] RandomSwap call: 0
2020-12-19T23:27:02.852+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:27:02.852+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:27:02.852+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:27:02.852+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:27:02.852+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:27:02.852+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:27:02.852+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:27:02.852+05:30 [Info] ----------------------------------------
2020-12-19T23:27:02.852+05:30 [Info] 
2020-12-19T23:27:02.852+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:e30a25a8d4f0a5cfd88615a1d168d9a7, useLiveData:true
2020-12-19T23:27:02.852+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258583307 (1.17215G), data:1259751737 (1.17324G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2020-12-19T23:27:02.852+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:27:02.852+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:02.852+05:30 [Info] 		Index name:index_age 0, bucket:default, scope:_default, collection:_default, defnId:454000905147901893, instId:2712339231172556498, Partition: 0, new/moved:false
2020-12-19T23:27:02.852+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:292107 (285.261K), data:1460537 (1.39288M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:02.852+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:02.852+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:02.852+05:30 [Info] 		Index name:index_gender 0, bucket:default, scope:_default, collection:_default, defnId:10516207184206497243, instId:1670015673038054605, Partition: 0, new/moved:true
2020-12-19T23:27:02.852+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:02.852+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:02.852+05:30 [Info] ****************************************
2020-12-19T23:27:02.852+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:27:02.938+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:02.938+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:02.944+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:02.944+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:02.954+05:30 [Info] switched currmeta from 2204 -> 2209 force true 
2020-12-19T23:27:02.957+05:30 [Info] switched currmeta from 2208 -> 2213 force true 
2020-12-19T23:27:03.074+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:03.074+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:03.082+05:30 [Info] switched currmeta from 2209 -> 2209 force true 
2020-12-19T23:27:03.085+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:03.085+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:03.090+05:30 [Info] switched currmeta from 2213 -> 2213 force true 
2020-12-19T23:27:03.603+05:30 [Info] GSIC[default/default-_default-_default-1608398403528136132] logstats "default" {"gsi_scan_count":620,"gsi_scan_duration":30998282644,"gsi_throttle_duration":270855776,"gsi_prime_duration":7070761565,"gsi_blocked_duration":45347676,"gsi_total_temp_files":0}
2020-12-19T23:27:04.745+05:30 [Info] Rollback time has changed for index inst 2712339231172556498. New rollback time 1608400598912367359
2020-12-19T23:27:04.745+05:30 [Info] Rollback time has changed for index inst 2712339231172556498. New rollback time 1608400598912367359
2020-12-19T23:27:06.279+05:30 [Info] connected with 1 indexers
2020-12-19T23:27:06.279+05:30 [Info] index 10516207184206497243 has replicas [14329406266147579201]: 
2020-12-19T23:27:06.279+05:30 [Info] index 454000905147901893 has replicas [2712339231172556498]: 
2020-12-19T23:27:06.279+05:30 [Info] index 10516207184206497243 has equivalents [10516207184206497243]: 
2020-12-19T23:27:06.279+05:30 [Info] index 454000905147901893 has equivalents [454000905147901893]: 
2020-12-19T23:27:06.279+05:30 [Info] client load stats {"14329406266147579201": 0,"2712339231172556498": 0}
2020-12-19T23:27:06.279+05:30 [Info] client hit stats {"14329406266147579201": 0,"2712339231172556498": 0}
2020-12-19T23:27:06.279+05:30 [Info] client pending item stats {"14329406266147579201": -2,"2712339231172556498": 9223372036854775807}
2020-12-19T23:27:06.279+05:30 [Info] client stats current {"14329406266147579201": true,"2712339231172556498": true}
2020-12-19T23:27:06.284+05:30 [Info] num concurrent scans {0}
2020-12-19T23:27:06.284+05:30 [Info] average scan response {4 ms}
2020-12-19T23:27:06.354+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:27:06.478+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:06.478+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:06.484+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:06.484+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:06.485+05:30 [Info] switched currmeta from 2209 -> 2210 force true 
2020-12-19T23:27:06.491+05:30 [Info] switched currmeta from 2213 -> 2214 force true 
2020-12-19T23:27:06.516+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:06.516+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:06.520+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:06.520+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:06.520+05:30 [Info] switched currmeta from 2210 -> 2210 force true 
2020-12-19T23:27:06.523+05:30 [Info] switched currmeta from 2214 -> 2214 force true 
2020-12-19T23:27:06.827+05:30 [Info] connected with 1 indexers
2020-12-19T23:27:06.827+05:30 [Info] index 454000905147901893 has replicas [2712339231172556498]: 
2020-12-19T23:27:06.827+05:30 [Info] index 10516207184206497243 has replicas [14329406266147579201]: 
2020-12-19T23:27:06.827+05:30 [Info] index 454000905147901893 has equivalents [454000905147901893]: 
2020-12-19T23:27:06.827+05:30 [Info] index 10516207184206497243 has equivalents [10516207184206497243]: 
2020-12-19T23:27:06.827+05:30 [Info] client load stats {"2712339231172556498": 0,"14329406266147579201": 0}
2020-12-19T23:27:06.827+05:30 [Info] client hit stats {"2712339231172556498": 0,"14329406266147579201": 0}
2020-12-19T23:27:06.827+05:30 [Info] client pending item stats {"14329406266147579201": -2,"2712339231172556498": 9223372036854775807}
2020-12-19T23:27:06.827+05:30 [Info] client stats current {"14329406266147579201": true,"2712339231172556498": true}
2020-12-19T23:27:06.830+05:30 [Info] num concurrent scans {0}
2020-12-19T23:27:06.830+05:30 [Info] average scan response {28 ms}
2020-12-19T23:27:07.233+05:30 [Info] CreateIndex 10516207184206497243 default _default _default/index_gender using:forestdb exprType:N1QL whereExpr:() secExprs:([`gender`]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.779537398s) err()
2020/12/19 23:27:07 Created the secondary index index_gender. Waiting for it become active
2020-12-19T23:27:07.233+05:30 [Info] metadata provider version changed 2214 -> 2215
2020-12-19T23:27:07.233+05:30 [Info] switched currmeta from 2214 -> 2215 force false 
2020/12/19 23:27:07 Index is now active
2020-12-19T23:27:07.233+05:30 [Info] CreateIndex default _default _default index_city ...
2020-12-19T23:27:07.234+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:27:07.235+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_city)
2020-12-19T23:27:07.312+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.312+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.312+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.312+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.317+05:30 [Info] switched currmeta from 2215 -> 2215 force true 
2020-12-19T23:27:07.319+05:30 [Info] switched currmeta from 2210 -> 2211 force true 
2020-12-19T23:27:07.335+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:27:07.495+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:27:07.518+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:27:07.518+05:30 [Info] Score: 0
2020-12-19T23:27:07.518+05:30 [Info] variation: 0
2020-12-19T23:27:07.518+05:30 [Info] ElapsedTime: 5ms
2020-12-19T23:27:07.518+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:27:07.518+05:30 [Info] Iteration: 0
2020-12-19T23:27:07.518+05:30 [Info] Move: 0
2020-12-19T23:27:07.518+05:30 [Info] ----------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:27:07.518+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Data Size Mean 1261135318 (1.17452G)
2020-12-19T23:27:07.518+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:27:07.518+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:27:07.518+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:07.518+05:30 [Info] ----------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] Number of indexes: 3
2020-12-19T23:27:07.518+05:30 [Info] Number of indexers: 1
2020-12-19T23:27:07.518+05:30 [Info] Avg Index Size: 419430400 (400M)
2020-12-19T23:27:07.518+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:27:07.518+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:27:07.518+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:27:07.518+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:27:07.518+05:30 [Info] ----------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:27:07.518+05:30 [Info] CPU Quota 4
2020-12-19T23:27:07.518+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:27:07.518+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:27:07.518+05:30 [Info] ----------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] Total iteration: 0
2020-12-19T23:27:07.518+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:27:07.518+05:30 [Info] RandomSwap call: 0
2020-12-19T23:27:07.518+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:27:07.518+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:27:07.518+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:27:07.518+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:27:07.518+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:27:07.518+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:27:07.518+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:27:07.518+05:30 [Info] ----------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] 
2020-12-19T23:27:07.518+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:e30a25a8d4f0a5cfd88615a1d168d9a7, useLiveData:true
2020-12-19T23:27:07.518+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258860023 (1.1724G), data:1261135318 (1.17452G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:3
2020-12-19T23:27:07.518+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:27:07.518+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:07.518+05:30 [Info] 		Index name:index_gender 0, bucket:default, scope:_default, collection:_default, defnId:10516207184206497243, instId:14329406266147579201, Partition: 0, new/moved:false
2020-12-19T23:27:07.518+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:276716 (270.23K), data:1383581 (1.31949M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:07.519+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:07.519+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:07.519+05:30 [Info] 		Index name:index_age 0, bucket:default, scope:_default, collection:_default, defnId:454000905147901893, instId:2712339231172556498, Partition: 0, new/moved:false
2020-12-19T23:27:07.519+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:292107 (285.261K), data:1460537 (1.39288M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:07.519+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:07.519+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:07.519+05:30 [Info] 		Index name:index_city 0, bucket:default, scope:_default, collection:_default, defnId:8737797510795722796, instId:9061611555996829732, Partition: 0, new/moved:true
2020-12-19T23:27:07.519+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:07.519+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:07.519+05:30 [Info] ****************************************
2020-12-19T23:27:07.519+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:27:07.612+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.612+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.614+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.614+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.625+05:30 [Info] switched currmeta from 2215 -> 2220 force true 
2020-12-19T23:27:07.633+05:30 [Info] switched currmeta from 2211 -> 2216 force true 
2020-12-19T23:27:07.714+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.714+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.729+05:30 [Info] switched currmeta from 2220 -> 2220 force true 
2020-12-19T23:27:07.741+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:07.741+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:07.750+05:30 [Info] switched currmeta from 2216 -> 2216 force true 
2020-12-19T23:27:09.743+05:30 [Info] Rollback time has changed for index inst 14329406266147579201. New rollback time 1608400598912367359
2020-12-19T23:27:09.743+05:30 [Info] Rollback time has changed for index inst 14329406266147579201. New rollback time 1608400598912367359
2020-12-19T23:27:10.355+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:10.355+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:10.357+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:10.357+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:10.360+05:30 [Info] switched currmeta from 2220 -> 2221 force true 
2020-12-19T23:27:10.365+05:30 [Info] switched currmeta from 2216 -> 2217 force true 
2020-12-19T23:27:11.281+05:30 [Info] CreateIndex 8737797510795722796 default _default _default/index_city using:forestdb exprType:N1QL whereExpr:() secExprs:([(`address`.`city`)]) desc:[] isPrimary:false scheme:SINGLE  partitionKeys:([]) with: - elapsed(4.047205725s) err()
2020/12/19 23:27:11 Created the secondary index index_city. Waiting for it become active
2020-12-19T23:27:11.281+05:30 [Info] metadata provider version changed 2221 -> 2222
2020-12-19T23:27:11.281+05:30 [Info] switched currmeta from 2221 -> 2222 force false 
2020/12/19 23:27:11 Index is now active
2020-12-19T23:27:11.281+05:30 [Info] CreateIndex default _default _default p1 ...
2020-12-19T23:27:11.281+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106
2020-12-19T23:27:11.282+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, p1)
2020-12-19T23:27:11.395+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.395+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.400+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:27:11.401+05:30 [Info] switched currmeta from 2222 -> 2222 force true 
2020-12-19T23:27:11.403+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.403+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.415+05:30 [Info] switched currmeta from 2217 -> 2218 force true 
2020-12-19T23:27:11.474+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.474+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.479+05:30 [Info] switched currmeta from 2222 -> 2222 force true 
2020-12-19T23:27:11.482+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.482+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.497+05:30 [Info] switched currmeta from 2218 -> 2218 force true 
2020-12-19T23:27:11.531+05:30 [Info] Planner::processCreateToken: There is no create token to process for node 127.0.0.1:9001
2020-12-19T23:27:11.679+05:30 [Info] Planner::processDropInstanceToken: There is no drop instance token to process for node 127.0.0.1:9001
2020-12-19T23:27:11.700+05:30 [Info] ************ Indexer Layout *************
2020-12-19T23:27:11.700+05:30 [Info] Score: 0
2020-12-19T23:27:11.700+05:30 [Info] variation: 0
2020-12-19T23:27:11.700+05:30 [Info] ElapsedTime: 4ms
2020-12-19T23:27:11.700+05:30 [Info] ConvergenceTime: 2us
2020-12-19T23:27:11.700+05:30 [Info] Iteration: 0
2020-12-19T23:27:11.700+05:30 [Info] Move: 0
2020-12-19T23:27:11.700+05:30 [Info] ----------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] Indexer Memory Mean 1258291200 (1.17188G)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Memory Utilization 0.8000
2020-12-19T23:27:11.700+05:30 [Info] Indexer CPU Mean 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Indexer CPU Utilization 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Indexer IO Mean 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Drain Rate Mean 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Scan Rate Mean 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Data Size Mean 1262588769 (1.17588G)
2020-12-19T23:27:11.700+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] Total Index Data (from non-deleted node) 0
2020-12-19T23:27:11.700+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] No. Index (from non-deleted node) 0
2020-12-19T23:27:11.700+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2020-12-19T23:27:11.700+05:30 [Info] ----------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] Number of indexes: 4
2020-12-19T23:27:11.700+05:30 [Info] Number of indexers: 1
2020-12-19T23:27:11.700+05:30 [Info] Avg Index Size: 314572800 (300M)
2020-12-19T23:27:11.700+05:30 [Info] Max Index Size: 1258291200 (1.17188G)
2020-12-19T23:27:11.700+05:30 [Info] Max Indexer Overhead: 0 (0)
2020-12-19T23:27:11.700+05:30 [Info] Avg Index Cpu: 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Max Index Cpu: 0.0000
2020-12-19T23:27:11.700+05:30 [Info] Num Estimation Run: 1
2020-12-19T23:27:11.700+05:30 [Info] ----------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] Memory Quota 1572864000 (1.46484G)
2020-12-19T23:27:11.700+05:30 [Info] CPU Quota 4
2020-12-19T23:27:11.700+05:30 [Info] Max Cpu Utilization -1
2020-12-19T23:27:11.700+05:30 [Info] Max Memory Utilization -1
2020-12-19T23:27:11.700+05:30 [Info] ----------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] Total iteration: 0
2020-12-19T23:27:11.700+05:30 [Info] RandomSwap time: 0ns
2020-12-19T23:27:11.700+05:30 [Info] RandomSwap call: 0
2020-12-19T23:27:11.700+05:30 [Info] RandomSwap iteration: 0
2020-12-19T23:27:11.700+05:30 [Info] RandomMove time: 0ns
2020-12-19T23:27:11.700+05:30 [Info] RandomMove call: 0 (empty index 0)
2020-12-19T23:27:11.700+05:30 [Info] ExhaustMove time: 0ns
2020-12-19T23:27:11.700+05:30 [Info] ExhaustMove call: 0
2020-12-19T23:27:11.700+05:30 [Info] ExhaustSwap time: 0ns
2020-12-19T23:27:11.700+05:30 [Info] ExhaustSwap call: 0
2020-12-19T23:27:11.700+05:30 [Info] ----------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] 
2020-12-19T23:27:11.700+05:30 [Info] Indexer serverGroup:Group 1, nodeId:127.0.0.1:9001, nodeUUID:e30a25a8d4f0a5cfd88615a1d168d9a7, useLiveData:true
2020-12-19T23:27:11.700+05:30 [Info] Indexer total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1259150713 (1.17268G), data:1262588769 (1.17588G) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2020-12-19T23:27:11.700+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true
2020-12-19T23:27:11.700+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] 		Index name:index_age 0, bucket:default, scope:_default, collection:_default, defnId:454000905147901893, instId:2712339231172556498, Partition: 0, new/moved:false
2020-12-19T23:27:11.700+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:292107 (285.261K), data:1460537 (1.39288M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:11.700+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:11.700+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] 		Index name:index_gender 0, bucket:default, scope:_default, collection:_default, defnId:10516207184206497243, instId:14329406266147579201, Partition: 0, new/moved:false
2020-12-19T23:27:11.700+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:276716 (270.23K), data:1383581 (1.31949M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:11.700+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:11.700+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] 		Index name:index_city 0, bucket:default, scope:_default, collection:_default, defnId:8737797510795722796, instId:4973836470463077170, Partition: 0, new/moved:false
2020-12-19T23:27:11.700+05:30 [Info] 		Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:290690 (283.877K), data:1453451 (1.38612M) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:11.700+05:30 [Info] 		Index resident:0% build:100% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:11.700+05:30 [Info] 		------------------------------------------------------------------------------------------------------------------
2020-12-19T23:27:11.700+05:30 [Info] 		Index name:p1 0, bucket:default, scope:_default, collection:_default, defnId:11323923147130937434, instId:9133949376042254295, Partition: 0, new/moved:true
2020-12-19T23:27:11.701+05:30 [Info] 		Index total memory:1258291200 (1.17188G), mem:1258291200 (1.17188G), overhead:0 (0), min:1258291200 (1.17188G), data:1258291200 (1.17188G) cpu:0.0000 io:0 (0) scan:0 drain:0
2020-12-19T23:27:11.701+05:30 [Info] 		Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2020-12-19T23:27:11.701+05:30 [Info] ****************************************
2020-12-19T23:27:11.701+05:30 [Info] send commit create request to watcher 127.0.0.1:9106
2020-12-19T23:27:11.759+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.759+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.768+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.768+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.770+05:30 [Info] switched currmeta from 2222 -> 2227 force true 
2020-12-19T23:27:11.785+05:30 [Info] switched currmeta from 2218 -> 2223 force true 
2020-12-19T23:27:11.903+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.903+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.922+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:11.922+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:11.924+05:30 [Info] switched currmeta from 2223 -> 2223 force true 
2020-12-19T23:27:11.929+05:30 [Info] switched currmeta from 2227 -> 2227 force true 
2020-12-19T23:27:14.305+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:14.305+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:14.307+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:14.307+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:14.310+05:30 [Info] switched currmeta from 2223 -> 2224 force true 
2020-12-19T23:27:14.312+05:30 [Info] switched currmeta from 2227 -> 2228 force true 
2020-12-19T23:27:14.743+05:30 [Info] Rollback time has changed for index inst 4973836470463077170. New rollback time 1608400598912367359
2020-12-19T23:27:14.744+05:30 [Info] Rollback time has changed for index inst 4973836470463077170. New rollback time 1608400598912367359
2020-12-19T23:27:15.222+05:30 [Info] CreateIndex 11323923147130937434 default _default _default/p1 using:forestdb exprType:N1QL whereExpr:() secExprs:([]) desc:[] isPrimary:true scheme:SINGLE  partitionKeys:([]) with: - elapsed(3.940736422s) err()
2020/12/19 23:27:15 Created the secondary index p1. Waiting for it become active
2020-12-19T23:27:15.222+05:30 [Info] metadata provider version changed 2228 -> 2229
2020-12-19T23:27:15.222+05:30 [Info] switched currmeta from 2228 -> 2229 force false 
2020/12/19 23:27:15 Index is now active
2020/12/19 23:27:15 === Testing for persistence enabled = true, with interval = 5  ===
2020-12-19T23:27:15.222+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2020/12/19 23:27:15 Changing config key indexer.statsPersistenceInterval to value 5
2020-12-19T23:27:15.312+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.settings.allow_large_keys":false,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.enable_corrupt_index_backup":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"forestdb","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.wal_size":4096,"indexer.statsPersistenceInterval":5,"projector.settings.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2020-12-19T23:27:15.321+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:15.321+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:15.327+05:30 [Info] switched currmeta from 2224 -> 2225 force true 
2020-12-19T23:27:15.330+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:15.330+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:15.337+05:30 [Info] switched currmeta from 2229 -> 2229 force true 
2020/12/19 23:27:15 []
2020-12-19T23:27:15.402+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:15.403+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:27:15.406+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:15.406+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:27:16.372+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2020-12-19T23:27:16.522+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:16.522+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:16.531+05:30 [Info] switched currmeta from 2229 -> 2229 force true 
2020-12-19T23:27:16.535+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2020-12-19T23:27:16.535+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2020-12-19T23:27:16.538+05:30 [Info] switched currmeta from 2225 -> 2225 force true 
2020/12/19 23:27:20 Using n1ql client
2020-12-19T23:27:20.352+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:27:20.353+05:30 [Error] transport error between 127.0.0.1:37792->127.0.0.1:9107: write tcp 127.0.0.1:37792->127.0.0.1:9107: write: broken pipe
2020-12-19T23:27:20.353+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 1222937294905553640 request transport failed `write tcp 127.0.0.1:37792->127.0.0.1:9107: write: broken pipe`
2020-12-19T23:27:20.353+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 23:27:20 Using n1ql client
2020/12/19 23:27:20 Using n1ql client
2020/12/19 23:27:27 []
2020-12-19T23:27:27.761+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:27.761+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:27:27.762+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:27.762+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 23:27:32 === Testing for persistence enabled = false, with interval = 0  ===
2020/12/19 23:27:32 Changing config key indexer.statsPersistenceInterval to value 0
2020/12/19 23:27:32 []
2020/12/19 23:27:37 Using n1ql client
2020-12-19T23:27:37.931+05:30 [Info] metadata provider version changed 2225 -> 2232
2020-12-19T23:27:37.931+05:30 [Info] switched currmeta from 2225 -> 2232 force false 
2020-12-19T23:27:37.931+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:27:37.932+05:30 [Error] transport error between 127.0.0.1:39144->127.0.0.1:9107: write tcp 127.0.0.1:39144->127.0.0.1:9107: write: broken pipe
2020-12-19T23:27:37.932+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 861511267011400197 request transport failed `write tcp 127.0.0.1:39144->127.0.0.1:9107: write: broken pipe`
2020-12-19T23:27:37.932+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 23:27:38 Using n1ql client
2020/12/19 23:27:38 Using n1ql client
2020/12/19 23:27:40 []
2020/12/19 23:27:45 === Testing for persistence enabled = true, with interval = 10  ===
2020/12/19 23:27:45 Changing config key indexer.statsPersistenceInterval to value 10
2020/12/19 23:27:45 []
2020-12-19T23:27:45.404+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:45.404+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:27:45.404+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:27:45.405+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020/12/19 23:27:50 Using n1ql client
2020-12-19T23:27:50.381+05:30 [Info] metadata provider version changed 2232 -> 2239
2020-12-19T23:27:50.381+05:30 [Info] switched currmeta from 2232 -> 2239 force false 
2020-12-19T23:27:50.381+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2020-12-19T23:27:50.382+05:30 [Error] transport error between 127.0.0.1:39692->127.0.0.1:9107: write tcp 127.0.0.1:39692->127.0.0.1:9107: write: broken pipe
2020-12-19T23:27:50.382+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 5302171576699907343 request transport failed `write tcp 127.0.0.1:39692->127.0.0.1:9107: write: broken pipe`
2020-12-19T23:27:50.382+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 23:27:50 Using n1ql client
2020/12/19 23:27:50 Using n1ql client
2020/12/19 23:28:02 []
2020/12/19 23:28:07 === Testing for persistence enabled = true, with interval = 5  ===
2020/12/19 23:28:07 Changing config key indexer.statsPersistenceInterval to value 5
2020/12/19 23:28:07 []
2020/12/19 23:28:12 Using n1ql client
2020-12-19T23:28:12.935+05:30 [Error] transport error between 127.0.0.1:40158->127.0.0.1:9107: write tcp 127.0.0.1:40158->127.0.0.1:9107: write: broken pipe
2020-12-19T23:28:12.935+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -6437785702414495699 request transport failed `write tcp 127.0.0.1:40158->127.0.0.1:9107: write: broken pipe`
2020-12-19T23:28:12.935+05:30 [Error] PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2020/12/19 23:28:13 Using n1ql client
2020/12/19 23:28:13 Using n1ql client
2020/12/19 23:28:20 []
2020-12-19T23:28:20.318+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:28:20.318+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2020-12-19T23:28:20.318+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2020-12-19T23:28:20.318+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
--- PASS: TestStatsPersistence (87.18s)
=== RUN   TestStats_StorageStatistics
2020/12/19 23:28:25 In TestStats_StorageStatistics()
2020/12/19 23:28:25 Index found:  index_age
2020/12/19 23:28:25 Stats from Index4 StorageStatistics for index index_age are []
2020/12/19 23:28:25 Index found:  p1
2020/12/19 23:28:25 Stats from Index4 StorageStatistics for index p1 are []
--- PASS: TestStats_StorageStatistics (0.00s)
FAIL
exit status 1
FAIL	github.com/couchbase/indexing/secondary/tests/functionaltests	6799.309s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_functests_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 65488    0 65488    0     0  7994k      0 --:--:-- --:--:-- --:--:-- 9136k
2020/12/19 23:28:28 In TestMain()
2020/12/19 23:28:29 Changing config key indexer.api.enableTestServer to value true
2020/12/19 23:28:29 Using forestdb for creating indexes
2020/12/19 23:28:29 Changing config key indexer.settings.storage_mode to value forestdb
=== RUN   TestRangeWithConcurrentAddMuts
2020/12/19 23:28:34 In TestRangeWithConcurrentAddMuts()
2020/12/19 23:28:34 In DropAllSecondaryIndexes()
2020/12/19 23:28:34 Index found:  index_gender
2020/12/19 23:28:34 Dropped index index_gender
2020/12/19 23:28:34 Index found:  p1
2020/12/19 23:28:34 Dropped index p1
2020/12/19 23:28:34 Index found:  index_age
2020/12/19 23:28:34 Dropped index index_age
2020/12/19 23:28:34 Index found:  index_city
2020/12/19 23:28:34 Dropped index index_city
2020/12/19 23:28:34 Generating JSON docs
2020/12/19 23:28:34 Setting initial JSON docs in KV
2020/12/19 23:28:35 All indexers are active
2020/12/19 23:28:35 Creating a 2i
2020/12/19 23:28:38 Created the secondary index index_company. Waiting for it become active
2020/12/19 23:28:38 Index is now active
2020/12/19 23:28:38 In Range Scan for Thread 1: 
2020/12/19 23:28:38 CreateDocs:: Creating mutations
2020/12/19 23:28:38 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
--- PASS: TestRangeWithConcurrentAddMuts (124.91s)
2020-12-19T23:30:39.061+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:34628->127.0.0.1:9106: use of closed network connection. Kill Pipe.
=== RUN   TestRangeWithConcurrentDelMuts
2020/12/19 23:30:39 In TestRangeWithConcurrentDelMuts()
2020/12/19 23:30:39 Generating JSON docs
2020/12/19 23:30:41 Setting initial JSON docs in KV
2020/12/19 23:30:57 All indexers are active
2020/12/19 23:30:57 Creating a 2i
2020/12/19 23:30:57 Index found:  index_company
2020/12/19 23:30:57 In Range Scan for Thread 1: 
2020/12/19 23:30:57 CreateDocs:: Delete mutations
2020/12/19 23:30:57 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2020-12-19T23:32:57.609+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:37208->127.0.0.1:9106: use of closed network connection. Kill Pipe.
--- PASS: TestRangeWithConcurrentDelMuts (138.55s)
=== RUN   TestScanWithConcurrentIndexOps
2020/12/19 23:32:57 In TestScanWithConcurrentIndexOps()
2020/12/19 23:32:57 Generating JSON docs
2020/12/19 23:33:03 Setting initial JSON docs in KV
2020/12/19 23:33:56 All indexers are active
2020/12/19 23:33:56 Creating a 2i
2020/12/19 23:33:56 Index found:  index_company
2020/12/19 23:33:56 In Range Scan for Thread 1: 
2020/12/19 23:33:56 Create and Drop index operations
2020/12/19 23:33:57 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2020/12/19 23:34:35 Created the secondary index index_age. Waiting for it become active
2020/12/19 23:34:35 Index is now active
2020/12/19 23:35:15 Created the secondary index index_firstname. Waiting for it become active
2020/12/19 23:35:15 Index is now active
2020/12/19 23:35:19 Dropping the secondary index index_age
2020/12/19 23:35:19 Index dropped
2020/12/19 23:35:20 Dropping the secondary index index_firstname
2020/12/19 23:35:20 Index dropped
2020/12/19 23:35:58 Created the secondary index index_age. Waiting for it become active
2020/12/19 23:35:58 Index is now active
2020-12-19T23:35:58.861+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:45706->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 23:36:30 Created the secondary index index_firstname. Waiting for it become active
2020/12/19 23:36:30 Index is now active
2020/12/19 23:36:33 Dropping the secondary index index_age
2020/12/19 23:36:34 Index dropped
2020/12/19 23:36:35 Dropping the secondary index index_firstname
2020/12/19 23:36:35 Index dropped
--- PASS: TestScanWithConcurrentIndexOps (218.63s)
=== RUN   TestConcurrentScans_SameIndex
2020/12/19 23:36:36 In TestConcurrentScans_SameIndex()
2020/12/19 23:36:36 Generating JSON docs
2020-12-19T23:36:36.238+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:45708->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 23:36:42 Setting initial JSON docs in KV
2020/12/19 23:37:36 All indexers are active
2020/12/19 23:37:36 Creating a 2i
2020/12/19 23:37:36 Index found:  index_company
2020/12/19 23:37:36 In Range Scan for Thread 6: 
2020/12/19 23:37:36 In Range Scan for Thread 3: 
2020/12/19 23:37:36 In Range Scan for Thread 1: 
2020/12/19 23:37:36 In Range Scan for Thread 4: 
2020/12/19 23:37:36 In Range Scan for Thread 5: 
2020/12/19 23:37:36 In Range Scan for Thread 2: 
2020/12/19 23:37:36 ListAllSecondaryIndexes() for Thread 6: : Index index_company Bucket default
2020/12/19 23:37:36 ListAllSecondaryIndexes() for Thread 4: : Index index_company Bucket default
2020/12/19 23:37:36 ListAllSecondaryIndexes() for Thread 3: : Index index_company Bucket default
2020/12/19 23:37:36 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2020/12/19 23:37:36 ListAllSecondaryIndexes() for Thread 5: : Index index_company Bucket default
2020/12/19 23:37:37 ListAllSecondaryIndexes() for Thread 2: : Index index_company Bucket default
2020-12-19T23:39:37.442+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46618->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:39:39.068+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46616->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:39:40.137+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46626->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:39:43.276+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46620->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:39:43.448+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46624->127.0.0.1:9106: use of closed network connection. Kill Pipe.
--- PASS: TestConcurrentScans_SameIndex (188.51s)
=== RUN   TestConcurrentScans_MultipleIndexes
2020/12/19 23:39:44 In TestConcurrentScans_MultipleIndexes()
2020/12/19 23:39:44 Generating JSON docs
2020-12-19T23:39:44.742+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:46622->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 23:39:50 Setting initial JSON docs in KV
2020/12/19 23:40:44 All indexers are active
2020/12/19 23:40:44 Creating multiple indexes
2020/12/19 23:40:44 Index found:  index_company
2020/12/19 23:41:40 Created the secondary index index_age. Waiting for it become active
2020/12/19 23:41:40 Index is now active
2020/12/19 23:42:35 Created the secondary index index_firstname. Waiting for it become active
2020/12/19 23:42:35 Index is now active
2020/12/19 23:42:35 In Range Scan for Thread 3: 
2020/12/19 23:42:35 In Range Scan for Thread 1: 
2020/12/19 23:42:35 In Range Scan
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 3: : Index index_firstname Bucket default
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 3: : Index index_company Bucket default
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 3: : Index index_age Bucket default
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 1: : Index index_age Bucket default
2020/12/19 23:42:35 ListAllSecondaryIndexes() for Thread 1: : Index index_firstname Bucket default
2020-12-19T23:44:37.019+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:47582->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020-12-19T23:44:37.645+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:47580->127.0.0.1:9106: use of closed network connection. Kill Pipe.
--- PASS: TestConcurrentScans_MultipleIndexes (295.21s)
=== RUN   TestMutationsWithMultipleIndexBuilds
2020/12/19 23:44:39 In TestMutationsWithMultipleIndexBuilds()
2020-12-19T23:44:39.951+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:47584->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2020/12/19 23:44:39 In DropAllSecondaryIndexes()
2020/12/19 23:44:39 Index found:  index_age
2020/12/19 23:44:40 Dropped index index_age
2020/12/19 23:44:40 Index found:  index_firstname
2020/12/19 23:44:40 Dropped index index_firstname
2020/12/19 23:44:40 Index found:  index_company
2020/12/19 23:44:40 Dropped index index_company
2020/12/19 23:44:40 Generating JSON docs
2020/12/19 23:44:46 Setting initial JSON docs in KV
2020/12/19 23:46:07 Created the secondary index index_primary. Waiting for it become active
2020/12/19 23:46:07 Index is now active
2020/12/19 23:46:07 Creating multiple indexes in deferred mode
2020/12/19 23:46:10 Build Indexes and wait for indexes to become active: [index_company index_age index_firstname index_lastname]
2020/12/19 23:46:10 Build command issued for the deferred indexes [index_company index_age index_firstname index_lastname]
2020/12/19 23:46:10 Waiting for the index index_company to become active
2020/12/19 23:46:11 Waiting for index to go active ...
2020/12/19 23:46:12 Waiting for index to go active ...
2020/12/19 23:46:13 Waiting for index to go active ...
2020/12/19 23:46:14 Waiting for index to go active ...
2020/12/19 23:46:15 Waiting for index to go active ...
2020/12/19 23:46:16 Waiting for index to go active ...
2020/12/19 23:46:17 Waiting for index to go active ...
2020/12/19 23:46:18 Waiting for index to go active ...
2020/12/19 23:46:19 Waiting for index to go active ...
2020/12/19 23:46:20 Waiting for index to go active ...
2020/12/19 23:46:21 Waiting for index to go active ...
2020/12/19 23:46:22 Waiting for index to go active ...
2020/12/19 23:46:23 Waiting for index to go active ...
2020/12/19 23:46:24 Waiting for index to go active ...
2020/12/19 23:46:25 Waiting for index to go active ...
2020/12/19 23:46:26 Waiting for index to go active ...
2020/12/19 23:46:27 Waiting for index to go active ...
2020/12/19 23:46:28 Waiting for index to go active ...
2020/12/19 23:46:29 Waiting for index to go active ...
2020/12/19 23:46:30 Waiting for index to go active ...
2020/12/19 23:46:31 Waiting for index to go active ...
2020/12/19 23:46:32 Waiting for index to go active ...
2020/12/19 23:46:33 Waiting for index to go active ...
2020/12/19 23:46:34 Waiting for index to go active ...
2020/12/19 23:46:35 Waiting for index to go active ...
2020/12/19 23:46:36 Waiting for index to go active ...
2020/12/19 23:46:37 Waiting for index to go active ...
2020/12/19 23:46:38 Waiting for index to go active ...
2020/12/19 23:46:39 Waiting for index to go active ...
2020/12/19 23:46:40 Waiting for index to go active ...
2020/12/19 23:46:41 Waiting for index to go active ...
2020/12/19 23:46:42 Waiting for index to go active ...
2020/12/19 23:46:43 Waiting for index to go active ...
2020/12/19 23:46:44 Waiting for index to go active ...
2020/12/19 23:46:45 Waiting for index to go active ...
2020/12/19 23:46:46 Waiting for index to go active ...
2020/12/19 23:46:47 Waiting for index to go active ...
2020/12/19 23:46:48 Waiting for index to go active ...
2020/12/19 23:46:49 Waiting for index to go active ...
2020/12/19 23:46:50 Waiting for index to go active ...
2020/12/19 23:46:51 Waiting for index to go active ...
2020/12/19 23:46:52 Waiting for index to go active ...
2020/12/19 23:46:53 Waiting for index to go active ...
2020/12/19 23:46:54 Waiting for index to go active ...
2020/12/19 23:46:55 Waiting for index to go active ...
2020/12/19 23:46:56 Waiting for index to go active ...
2020/12/19 23:46:57 Waiting for index to go active ...
2020/12/19 23:46:58 Waiting for index to go active ...
2020/12/19 23:46:59 Waiting for index to go active ...
2020/12/19 23:47:00 Waiting for index to go active ...
2020/12/19 23:47:01 Waiting for index to go active ...
2020/12/19 23:47:02 Waiting for index to go active ...
2020/12/19 23:47:03 Waiting for index to go active ...
2020/12/19 23:47:04 Waiting for index to go active ...
2020/12/19 23:47:05 Waiting for index to go active ...
2020/12/19 23:47:06 Waiting for index to go active ...
2020/12/19 23:47:07 Waiting for index to go active ...
2020/12/19 23:47:08 Waiting for index to go active ...
2020/12/19 23:47:09 Waiting for index to go active ...
2020/12/19 23:47:10 Waiting for index to go active ...
2020/12/19 23:47:11 Waiting for index to go active ...
2020/12/19 23:47:12 Waiting for index to go active ...
2020/12/19 23:47:13 Waiting for index to go active ...
2020/12/19 23:47:14 Waiting for index to go active ...
2020/12/19 23:47:15 Waiting for index to go active ...
2020/12/19 23:47:16 Waiting for index to go active ...
2020/12/19 23:47:17 Waiting for index to go active ...
2020/12/19 23:47:18 Waiting for index to go active ...
2020/12/19 23:47:19 Waiting for index to go active ...
2020/12/19 23:47:20 Waiting for index to go active ...
2020/12/19 23:47:21 Waiting for index to go active ...
2020/12/19 23:47:22 Waiting for index to go active ...
2020/12/19 23:47:23 Waiting for index to go active ...
2020/12/19 23:47:24 Waiting for index to go active ...
2020/12/19 23:47:25 Waiting for index to go active ...
2020/12/19 23:47:26 Waiting for index to go active ...
2020/12/19 23:47:27 Waiting for index to go active ...
2020/12/19 23:47:28 Waiting for index to go active ...
2020/12/19 23:47:29 Waiting for index to go active ...
2020/12/19 23:47:30 Waiting for index to go active ...
2020/12/19 23:47:31 Waiting for index to go active ...
2020/12/19 23:47:32 Waiting for index to go active ...
2020/12/19 23:47:33 Waiting for index to go active ...
2020/12/19 23:47:34 Waiting for index to go active ...
2020/12/19 23:47:35 Waiting for index to go active ...
2020/12/19 23:47:36 Waiting for index to go active ...
2020/12/19 23:47:37 Waiting for index to go active ...
2020/12/19 23:47:38 Waiting for index to go active ...
2020/12/19 23:47:39 Waiting for index to go active ...
2020/12/19 23:47:40 Waiting for index to go active ...
2020/12/19 23:47:41 Waiting for index to go active ...
2020/12/19 23:47:42 Waiting for index to go active ...
2020/12/19 23:47:43 Waiting for index to go active ...
2020/12/19 23:47:44 Waiting for index to go active ...
2020/12/19 23:47:45 Waiting for index to go active ...
2020/12/19 23:47:46 Waiting for index to go active ...
2020/12/19 23:47:47 Waiting for index to go active ...
2020/12/19 23:47:48 Waiting for index to go active ...
2020/12/19 23:47:49 Waiting for index to go active ...
2020/12/19 23:47:50 Waiting for index to go active ...
2020/12/19 23:47:51 Waiting for index to go active ...
2020/12/19 23:47:52 Waiting for index to go active ...
2020/12/19 23:47:53 Waiting for index to go active ...
2020/12/19 23:47:54 Waiting for index to go active ...
2020/12/19 23:47:55 Waiting for index to go active ...
2020/12/19 23:47:56 Waiting for index to go active ...
2020/12/19 23:47:57 Waiting for index to go active ...
2020/12/19 23:47:58 Waiting for index to go active ...
2020/12/19 23:47:59 Waiting for index to go active ...
2020/12/19 23:48:00 Waiting for index to go active ...
2020/12/19 23:48:01 Waiting for index to go active ...
2020/12/19 23:48:02 Waiting for index to go active ...
2020/12/19 23:48:03 Waiting for index to go active ...
2020/12/19 23:48:04 Waiting for index to go active ...
2020/12/19 23:48:05 Waiting for index to go active ...
2020/12/19 23:48:06 Index is now active
2020/12/19 23:48:06 Waiting for the index index_age to become active
2020/12/19 23:48:06 Index is now active
2020/12/19 23:48:06 Waiting for the index index_firstname to become active
2020/12/19 23:48:06 Index is now active
2020/12/19 23:48:06 Waiting for the index index_lastname to become active
2020/12/19 23:48:06 Index is now active
--- PASS: TestMutationsWithMultipleIndexBuilds (206.09s)
PASS
ok  	github.com/couchbase/indexing/secondary/tests/largedatatests	1177.128s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_largedata_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 64680    0 64680    0     0  10.2M      0 --:--:-- --:--:-- --:--:-- 12.3M
Integration tests
echo "Running gsi integration tests with 4 node cluster"
Running gsi integration tests with 4 node cluster
scripts/start_cluster_and_run_tests.sh b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini conf/simple_gsi_n1ql.conf 1 1 gsi_type=forestdb
/opt/build/testrunner /opt/build/testrunner
make[1]: Entering directory '/opt/build/ns_server'
cd build && make --no-print-directory ns_dataclean
Built target ns_dataclean
make[1]: Leaving directory '/opt/build/ns_server'
make[1]: Entering directory '/opt/build/ns_server'
cd build && make --no-print-directory all
==> ale (compile)
Built target ale
Built target ns_cfg
Built target kv_mappings
==> ns_server (compile)
Built target ns_server
==> gen_smtp (compile)
Built target gen_smtp
==> ns_babysitter (compile)
Built target ns_babysitter
==> ns_couchdb (compile)
Built target ns_couchdb
Building Go target vbmap using Go 1.8.5
Built target vbmap
Building Go target ns_gozip using Go 1.8.5
Built target ns_gozip
Building Go target ns_goport using Go 1.8.5
Built target ns_goport
Building Go target ns_generate_cert using Go 1.11.6
Built target ns_generate_cert
Building Go target ns_godu using Go 1.8.5
Built target ns_godu
Building Go target ns_minify using Go 1.8.5
Built target ns_minify
Building Go target ns_gosecrets using Go 1.8.5
Built target ns_gosecrets
make[1]: Leaving directory '/opt/build/ns_server'
/opt/build/testrunner
INFO:root:__main__
INFO:__main__:TestRunner: parsing args...
INFO:__main__:Checking arguments...
INFO:__main__:Conf filename: conf/simple_gsi_n1ql.conf
INFO:__main__:Test prefix: gsi.indexscans_gsi.SecondaryIndexingScanTests
INFO:__main__:Test prefix: gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests
INFO:__main__:Test prefix: gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests
INFO:__main__:TestRunner: start...
INFO:__main__:Global Test input params:
INFO:__main__:
Number of tests initially selected before GROUP filters: 11
INFO:__main__:--> Running test: gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,GROUP=gsi
INFO:__main__:Logs folder: /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_1
*** TestRunner ***
{'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi',
 'conf_file': 'conf/simple_gsi_n1ql.conf',
 'gsi_type': 'forestdb',
 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini',
 'makefile': 'True',
 'num_nodes': 4,
 'spec': 'simple_gsi_n1ql'}
Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_1

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 1, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_1'}
Run before suite setup for gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index
suite_setUp (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... -->before_suite_name:gsi.indexscans_gsi.SecondaryIndexingScanTests.suite_setUp,suite: ]>
2020-12-19 23:48:40 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:48:40 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:48:41 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:48:41 | ERROR | MainProcess | MainThread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 
2020-12-19 23:48:44 | ERROR | MainProcess | MainThread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 
2020-12-19 23:48:50 | ERROR | MainProcess | MainThread | [rest_client._http_request] socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 111] Connection refused 
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.get_nodes_version] Node version in cluster 7.0.0-3874-rel-enterprise
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.get_nodes_versions] Node versions in cluster []
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.setUp] ==============  basetestcase setup was started for test #1 suite_setUp==============
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default/ body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] cannot find service node index in cluster 
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ==============  basetestcase cleanup was started for test #1 suite_setUp ==============
2020-12-19 23:49:02 | ERROR | MainProcess | MainThread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default/ body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ==============  basetestcase cleanup was finished for test #1 suite_setUp ==============
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.tearDown] closing all ssh connections
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.tearDown] closing all memcached connections
Cluster instance shutdown with force
2020-12-19 23:49:02 | INFO | MainProcess | MainThread | [basetestcase.setUp] initializing cluster
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '17', 'memoryTotal': 0, 'memoryFree': 0, 'mcdMemoryReserved': 14750, 'mcdMemoryAllocated': 0, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 8184, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:03 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] GET http://127.0.0.1:9000/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [task.execute] quota for index service will be 256 MB
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [task.execute] set index quota to node 127.0.0.1 
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.set_service_memoryQuota] pools/default params : indexMemoryQuota=256
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=9626
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9000
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:03 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:04 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '18', 'memoryTotal': 0, 'memoryFree': 0, 'mcdMemoryReserved': 14750, 'mcdMemoryAllocated': 0, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 8184, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:04 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] GET http://127.0.0.1:9001/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=9882
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9001
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:04 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '16', 'memoryTotal': 0, 'memoryFree': 0, 'mcdMemoryReserved': 14750, 'mcdMemoryAllocated': 0, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 8184, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:04 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] GET http://127.0.0.1:9002/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=9882
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9002
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:04 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:05 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '17', 'memoryTotal': 0, 'memoryFree': 0, 'mcdMemoryReserved': 14750, 'mcdMemoryAllocated': 0, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 8184, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:05 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] GET http://127.0.0.1:9003/pools/default body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"unknown pool"' auth: Administrator:asdasd
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=9882
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9003
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:05 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:05 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:05 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
2020-12-19 23:49:05 | ERROR | MainProcess | MainThread | [rest_client._http_request] DELETE http://127.0.0.1:9000/settings/rbac/users/local/cbadminbucket body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 404 reason: unknown b'"User was not found."' auth: Administrator:asdasd
2020-12-19 23:49:05 | INFO | MainProcess | MainThread | [internal_user.delete_user] Exception while deleting user. Exception is -b'"User was not found."'
2020-12-19 23:49:05 | INFO | MainProcess | MainThread | [basetestcase.sleep] sleep for 5 secs.  ...
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user ****
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [basetestcase.setUp] done initializing cluster
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:10 | INFO | MainProcess | MainThread | [basetestcase.enable_diag_eval_on_non_local_hosts] Enabled diag/eval for non-local hosts from 127.0.0.1
2020-12-19 23:49:11 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=9626&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
2020-12-19 23:49:11 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket default
2020-12-19 23:49:11 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:12 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 0
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:12 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 1
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:12 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 2
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 3
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:13 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 4
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:49:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:14 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:14 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 5
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.setUp] ==============  basetestcase setup was finished for test #1 suite_setUp ==============
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 18.65979381443299, 'mem_free': 13843775488, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [rest_client.set_index_settings_internal] {'indexer.settings.storage_mode': 'forestdb'} set
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [newtuq.setUp] Allowing the indexer to complete restart after setting the internal settings
2020-12-19 23:49:14 | INFO | MainProcess | MainThread | [basetestcase.sleep] sleep for 5 secs.  ...
2020-12-19 23:49:19 | INFO | MainProcess | MainThread | [rest_client.set_index_settings_internal] {'indexer.api.enableTestServer': True} set
2020-12-19 23:49:19 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:19 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:19 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:20 | INFO | MainProcess | MainThread | [basetestcase.load] create 2016.0 to default documents...
2020-12-19 23:49:20 | INFO | MainProcess | MainThread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:49:22 | INFO | MainProcess | MainThread | [basetestcase.load] LOAD IS FINISHED
2020-12-19 23:49:22 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:22 | INFO | MainProcess | MainThread | [newtuq.setUp] ip:127.0.0.1 port:9000 ssh_username:Administrator
2020-12-19 23:49:22 | INFO | MainProcess | MainThread | [basetestcase.sleep] sleep for 30 secs.  ...
2020-12-19 23:49:52 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:49:52 | INFO | MainProcess | MainThread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:49:52 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 90.16637ms
2020-12-19 23:49:52 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
2020-12-19 23:49:52 | INFO | MainProcess | MainThread | [rest_client.query_tool] query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 589.405197ms
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 21.275831ms
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:49:53 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.get_nodes_from_services_map] list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.drop_primary_index] CHECK FOR PRIMARY INDEXES
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.drop_primary_index] DROP PRIMARY INDEX ON default USING GSI
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 7.424079ms
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] RUN QUERY DROP PRIMARY INDEX ON default USING GSI
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [rest_client.query_tool] query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 59.690804ms
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 3.162766778092054, 'mem_free': 13750808576, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ==============  basetestcase cleanup was started for test #1 suite_setUp ==============
2020-12-19 23:49:54 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets ['default'] on 127.0.0.1
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete....
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.bucket_exists] node 127.0.0.1 existing buckets : []
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 127.0.0.1
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ==============  basetestcase cleanup was finished for test #1 suite_setUp ==============
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [basetestcase.tearDown] closing all ssh connections
2020-12-19 23:49:55 | INFO | MainProcess | MainThread | [basetestcase.tearDown] closing all memcached connections
ok

----------------------------------------------------------------------
Ran 1 test in 74.330s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Cluster instance shutdown with force
-->result: 
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.get_nodes_version] Node version in cluster 7.0.0-3874-rel-enterprise
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster ['7.0.0-3874-rel-enterprise']
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [basetestcase.setUp] ==============  basetestcase setup was started for test #1 test_multi_create_query_explain_drop_index==============
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:55 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 3.162766778092054, 'mem_free': 13750808576, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ==============  basetestcase cleanup was started for test #1 test_multi_create_query_explain_drop_index ==============
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ==============  basetestcase cleanup was finished for test #1 test_multi_create_query_explain_drop_index ==============
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.tearDown] closing all ssh connections
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.tearDown] closing all memcached connections
Cluster instance shutdown with force
2020-12-19 23:49:56 | INFO | MainProcess | test_thread | [basetestcase.setUp] initializing cluster
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '72', 'memoryTotal': 15466930176, 'memoryFree': 13750808576, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 9626, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute] quota for index service will be 256 MB
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute] set index quota to node 127.0.0.1 
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.set_service_memoryQuota] pools/default params : indexMemoryQuota=256
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=7650
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
2020-12-19 23:49:57 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] This node is already provisioned with services, we do not consider this as failure for test case
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9000
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:57 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '74', 'memoryTotal': 15466930176, 'memoryFree': 13646237696, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 9882, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=7906
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9001
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:57 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:58 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '72', 'memoryTotal': 15466930176, 'memoryFree': 13750751232, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 9882, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=7906
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9002
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:58 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [task.execute]  {'uptime': '73', 'memoryTotal': 15466930176, 'memoryFree': 13650448384, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 9882, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=7906
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,asdasd,9003
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:49:58 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:49:59 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:49:59 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:49:59 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
2020-12-19 23:49:59 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2020-12-19 23:49:59 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
2020-12-19 23:49:59 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
2020-12-19 23:49:59 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 5 secs.  ...
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user ****
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [basetestcase.setUp] done initializing cluster
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [remote_util.enable_diag_eval_on_non_local_hosts] b'ok'
2020-12-19 23:50:04 | INFO | MainProcess | test_thread | [basetestcase.enable_diag_eval_on_non_local_hosts] Enabled diag/eval for non-local hosts from 127.0.0.1
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 0
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 1
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 2
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 3
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:05 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:06 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 4
2020-12-19 23:50:06 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 127.0.0.1 to accept set ops
2020-12-19 23:50:06 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:06 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:06 | WARNING | MainProcess | Cluster_Thread | [task.check] vbucket map not ready after try 5
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [basetestcase.setUp] ==============  basetestcase setup was finished for test #1 test_multi_create_query_explain_drop_index ==============
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 32.81834039372041, 'mem_free': 13691772928, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is warmup
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [newtuq.setUp] Waiting for cluster to become healthy
2020-12-19 23:50:06 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 5 secs.  ...
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] Initial status of 127.0.0.1 cluster is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] current status of 127.0.0.1  is healthy
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [rest_client.set_index_settings_internal] {'indexer.settings.storage_mode': 'forestdb'} set
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [newtuq.setUp] Allowing the indexer to complete restart after setting the internal settings
2020-12-19 23:50:11 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 5 secs.  ...
2020-12-19 23:50:16 | INFO | MainProcess | test_thread | [rest_client.set_index_settings_internal] {'indexer.api.enableTestServer': True} set
2020-12-19 23:50:16 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:50:16 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:50:16 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:50:17 | INFO | MainProcess | test_thread | [basetestcase.load] create 2016.0 to default documents...
2020-12-19 23:50:17 | INFO | MainProcess | test_thread | [data_helper.direct_client] creating direct client 127.0.0.1:12000 default
2020-12-19 23:50:19 | INFO | MainProcess | test_thread | [basetestcase.load] LOAD IS FINISHED
2020-12-19 23:50:19 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:19 | INFO | MainProcess | test_thread | [newtuq.setUp] ip:127.0.0.1 port:9000 ssh_username:Administrator
2020-12-19 23:50:19 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 30 secs.  ...
2020-12-19 23:50:49 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:50:49 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:50:49 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 24.582807ms
2020-12-19 23:50:49 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
2020-12-19 23:50:49 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 662.011074ms
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 20.037045ms
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:50:50 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:51 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY CREATE INDEX employee7f00ddfa62cd41139b8229e6e26ba924job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
2020-12-19 23:50:51 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=CREATE+INDEX+employee7f00ddfa62cd41139b8229e6e26ba924job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
2020-12-19 23:50:51 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 133.614796ms
2020-12-19 23:50:51 | INFO | MainProcess | test_thread | [base_gsi.async_build_index] BUILD INDEX on default(employee7f00ddfa62cd41139b8229e6e26ba924job_title) USING GSI
2020-12-19 23:50:52 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY BUILD INDEX on default(employee7f00ddfa62cd41139b8229e6e26ba924job_title) USING GSI
2020-12-19 23:50:52 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=BUILD+INDEX+on+default%28employee7f00ddfa62cd41139b8229e6e26ba924job_title%29+USING+GSI
2020-12-19 23:50:52 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 20.745665ms
2020-12-19 23:50:53 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employee7f00ddfa62cd41139b8229e6e26ba924job_title'
2020-12-19 23:50:53 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7f00ddfa62cd41139b8229e6e26ba924job_title%27
2020-12-19 23:50:53 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 9.071268ms
2020-12-19 23:50:54 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employee7f00ddfa62cd41139b8229e6e26ba924job_title'
2020-12-19 23:50:54 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7f00ddfa62cd41139b8229e6e26ba924job_title%27
2020-12-19 23:50:54 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 6.79264ms
2020-12-19 23:50:55 | INFO | MainProcess | Cluster_Thread | [task.execute]  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 1.936898ms
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [task.execute] {'requestID': '9039d771-91a0-462b-b2e6-7492f5e60a84', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee7f00ddfa62cd41139b8229e6e26ba924job_title', 'index_id': '7afda7ee197472dd', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.936898ms', 'executionTime': '1.784878ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [task.execute]  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:56 | INFO | MainProcess | Cluster_Thread | [task.check]  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [base_gsi.async_query_using_index] Query : SELECT * FROM default WHERE  job_title = "Sales" 
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] FROM clause ===== is default
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] WHERE clause ===== is   doc["job_title"] == "Sales" 
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] UNNEST clause ===== is None
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators.generate_expected_result] SELECT clause ===== is {"*" : doc,}
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators._filter_full_set] -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
2020-12-19 23:50:56 | INFO | MainProcess | test_thread | [tuq_generators._filter_full_set] -->where_clause=  doc["job_title"] == "Sales" 
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [task.execute]  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 119.225486ms
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [tuq_helper._verify_results]  Analyzing Actual Result
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [tuq_helper._verify_results]  Analyzing Expected Result
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [task.execute]  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:57 | INFO | MainProcess | Cluster_Thread | [task.check]  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
2020-12-19 23:50:58 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employee7f00ddfa62cd41139b8229e6e26ba924job_title'
2020-12-19 23:50:58 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7f00ddfa62cd41139b8229e6e26ba924job_title%27
2020-12-19 23:50:58 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 9.679737ms
2020-12-19 23:50:58 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY DROP INDEX employee7f00ddfa62cd41139b8229e6e26ba924job_title ON default USING GSI
2020-12-19 23:50:58 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=DROP+INDEX+employee7f00ddfa62cd41139b8229e6e26ba924job_title+ON+default+USING+GSI
2020-12-19 23:50:59 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 55.430416ms
2020-12-19 23:50:59 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = 'employee7f00ddfa62cd41139b8229e6e26ba924job_title'
2020-12-19 23:50:59 | INFO | MainProcess | Cluster_Thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7f00ddfa62cd41139b8229e6e26ba924job_title%27
2020-12-19 23:50:59 | INFO | MainProcess | Cluster_Thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 2.051188ms
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.ssh_connect_with_retries] SSH Connected to 127.0.0.1 as Administrator
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] extract_remote_info-->distribution_type: linux, distribution_version: default
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully with Administrator
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.drop_primary_index] CHECK FOR PRIMARY INDEXES
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.drop_primary_index] DROP PRIMARY INDEX ON default USING GSI
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY SELECT * FROM system:indexes where name = '#primary'
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 7.900165ms
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] RUN QUERY DROP PRIMARY INDEX ON default USING GSI
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [rest_client.query_tool] query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [tuq_helper.run_cbq_query] TOTAL ELAPSED TIME: 42.398551ms
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics -------
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 3.605459696111254, 'mem_free': 13677580288, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics ---
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ==============  basetestcase cleanup was started for test #1 test_multi_create_query_explain_drop_index ==============
2020-12-19 23:50:59 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets ['default'] on 127.0.0.1
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete....
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.bucket_exists] node 127.0.0.1 existing buckets : []
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 127.0.0.1
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] Could not find any buckets for node 127.0.0.1, nothing to delete
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9000
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9000 is running
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9001
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9001 is running
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9002
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9002 is running
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 127.0.0.1:9003
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [rest_client.is_ns_server_running] -->is_ns_server_running?
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 127.0.0.1:9003 is running
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ==============  basetestcase cleanup was finished for test #1 test_multi_create_query_explain_drop_index ==============
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [basetestcase.tearDown] closing all ssh connections
2020-12-19 23:51:00 | INFO | MainProcess | test_thread | [basetestcase.tearDown] closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 1 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_1
ok

----------------------------------------------------------------------
Ran 1 test in 65.346s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_2

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,delete_ops_per=.5,run_async=True,scan_consistency=request_plus,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'delete_ops_per': '.5', 'run_async': 'True', 'scan_consistency': 'request_plus', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 2, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_2'}
[2020-12-19 23:51:00,652] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:00,653] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:00,922] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:00,929] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:00,940] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:51:00,948] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:51:00,948] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #2 test_multi_create_query_explain_drop_index==============
[2020-12-19 23:51:00,962] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:51:00,967] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:51:00,973] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:51:00,979] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:51:00,983] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:00,997] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:51:00,997] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:01,001] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:51:01,004] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:51:01,005] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:01,008] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:51:01,012] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:51:01,012] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:01,015] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:51:01,020] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:51:01,021] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:51:01,028] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:51:01,029] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:51:01,656] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:51:01,659] - [task:157] INFO -  {'uptime': '138', 'memoryTotal': 15466930176, 'memoryFree': 13542813696, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-19 23:51:01,662] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:51:01,663] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:51:01,663] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:51:01,669] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:51:01,683] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:51:01,684] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:51:01,687] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:51:01,688] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:51:01,689] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:51:01,689] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:51:01,755] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:51:01,760] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:01,760] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:02,042] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:02,055] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:51:02,110] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:51:02,112] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:51:02,117] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:51:02,118] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:51:02,121] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:51:02,133] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:51:02,137] - [task:157] INFO -  {'uptime': '134', 'memoryTotal': 15466930176, 'memoryFree': 13552730112, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:51:02,142] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:51:02,147] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:51:02,147] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:51:02,226] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:51:02,231] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:02,231] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:02,544] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:02,555] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:51:02,609] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:51:02,610] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:51:02,615] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:51:02,616] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:51:02,619] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:51:02,633] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:51:02,636] - [task:157] INFO -  {'uptime': '138', 'memoryTotal': 15466930176, 'memoryFree': 13546598400, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:51:02,641] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:51:02,645] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:51:02,646] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:51:02,714] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:51:02,722] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:02,722] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:02,987] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:02,999] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:51:03,055] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:51:03,056] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:51:03,060] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:51:03,061] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:51:03,064] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:51:03,080] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:51:03,084] - [task:157] INFO -  {'uptime': '138', 'memoryTotal': 15466930176, 'memoryFree': 13551259648, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:51:03,088] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:51:03,094] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:51:03,094] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:51:03,163] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:51:03,167] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:03,168] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:03,458] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:03,470] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:51:03,532] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:51:03,533] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:51:03,538] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:51:03,538] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:51:03,541] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:51:03,564] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:51:03,687] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:51:08,691] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:51:08,705] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:51:08,712] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:08,712] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:08,974] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:08,984] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:51:09,038] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:51:09,040] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:51:09,040] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:51:09,579] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:51:09,585] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:51:09,586] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:09,818] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:09,874] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:09,903] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:51:09,904] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:10,005] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,056] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,083] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:51:10,084] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:10,147] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,194] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,223] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:51:10,223] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:10,289] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,339] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,366] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:51:10,366] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:10,433] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,481] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,510] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:51:10,510] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:51:10,572] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,621] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:10,652] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:51:10,655] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #2 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:51:10,671] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:51:10,671] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 20.09059419131362, 'mem_free': 13549674496, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:51:10,671] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:51:10,679] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:51:10,679] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:51:10,679] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:51:15,688] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:51:15,697] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:51:15,697] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:51:15,705] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:51:15,706] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:51:15,715] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:51:15,715] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:51:15,722] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:51:15,735] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:51:15,736] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:51:15,739] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:51:20,749] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:51:20,752] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:20,752] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:20,996] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:21,945] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:51:21,977] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:51:24,164] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:51:24,181] - [newtuq:82] INFO - {'delete': {'start': 0, 'end': 0}, 'remaining': {'start': 0, 'end': 1}}
[2020-12-19 23:51:24,810] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:51:24,810] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:51:24,810] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:51:54,841] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:51:54,845] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:51:54,869] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 22.502877ms
[2020-12-19 23:51:54,874] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:51:54,878] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:51:55,550] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 670.220003ms
[2020-12-19 23:51:55,558] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:51:55,565] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:51:55,596] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 29.018041ms
[2020-12-19 23:51:55,612] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:51:55,612] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:51:55,998] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:51:56,017] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:51:57,016] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee7087c02ba8124344991515e54a4bfa09job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:51:57,021] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee7087c02ba8124344991515e54a4bfa09job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:51:57,137] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 114.300507ms
[2020-12-19 23:51:57,138] - [base_gsi:202] INFO - BUILD INDEX on default(employee7087c02ba8124344991515e54a4bfa09job_title) USING GSI
[2020-12-19 23:51:58,143] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee7087c02ba8124344991515e54a4bfa09job_title) USING GSI
[2020-12-19 23:51:58,147] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee7087c02ba8124344991515e54a4bfa09job_title%29+USING+GSI
[2020-12-19 23:51:58,178] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 30.280791ms
[2020-12-19 23:51:59,184] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7087c02ba8124344991515e54a4bfa09job_title'
[2020-12-19 23:51:59,188] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7087c02ba8124344991515e54a4bfa09job_title%27
[2020-12-19 23:51:59,199] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.342147ms
[2020-12-19 23:52:00,204] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7087c02ba8124344991515e54a4bfa09job_title'
[2020-12-19 23:52:00,208] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7087c02ba8124344991515e54a4bfa09job_title%27
[2020-12-19 23:52:00,218] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.15148ms
[2020-12-19 23:52:00,753] - [basetestcase:2699] INFO - delete 0.0 to default documents...
[2020-12-19 23:52:00,784] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:01,811] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:52:02,221] - [task:3104] INFO -  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:02,228] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:52:02,232] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
[2020-12-19 23:52:02,236] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.708231ms
[2020-12-19 23:52:02,236] - [task:3114] INFO - {'requestID': '73c54951-ee9c-43e2-b21e-81f41330d7ea', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee7087c02ba8124344991515e54a4bfa09job_title', 'index_id': '5b55b5264208c73d', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.708231ms', 'executionTime': '1.5823ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
[2020-12-19 23:52:02,237] - [task:3115] INFO -  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:02,237] - [task:3145] INFO -  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:02,237] - [base_gsi:463] INFO - Query : SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:52:02,238] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-19 23:52:02,238] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["job_title"] == "Sales" 
[2020-12-19 23:52:02,238] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-19 23:52:02,239] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-19 23:52:02,239] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:52:02,239] - [tuq_generators:329] INFO - -->where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:52:03,238] - [task:3104] INFO -  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:03,243] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:52:03,247] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
[2020-12-19 23:52:03,365] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 107.816787ms
[2020-12-19 23:52:03,365] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-19 23:52:03,366] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-19 23:52:04,173] - [task:3115] INFO -  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:04,173] - [task:3145] INFO -  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:52:05,179] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7087c02ba8124344991515e54a4bfa09job_title'
[2020-12-19 23:52:05,183] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7087c02ba8124344991515e54a4bfa09job_title%27
[2020-12-19 23:52:05,194] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.766442ms
[2020-12-19 23:52:05,197] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee7087c02ba8124344991515e54a4bfa09job_title ON default USING GSI
[2020-12-19 23:52:05,202] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee7087c02ba8124344991515e54a4bfa09job_title+ON+default+USING+GSI
[2020-12-19 23:52:05,243] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 39.826999ms
[2020-12-19 23:52:05,250] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee7087c02ba8124344991515e54a4bfa09job_title'
[2020-12-19 23:52:05,255] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee7087c02ba8124344991515e54a4bfa09job_title%27
[2020-12-19 23:52:05,258] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.399758ms
[2020-12-19 23:52:05,282] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:52:05,287] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:05,287] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:05,672] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:05,681] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:52:05,681] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:52:05,744] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:05,754] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:52:05,758] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:05,758] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:06,124] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:06,134] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:52:06,134] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:52:06,195] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:06,206] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:52:06,206] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:52:06,207] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:52:06,211] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:52:06,215] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:52:06,223] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 6.489623ms
[2020-12-19 23:52:06,228] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:52:06,232] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:52:06,271] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 35.226011ms
[2020-12-19 23:52:06,291] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:52:06,292] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 16.24901081508837, 'mem_free': 13370691584, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:52:06,292] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:52:06,292] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #2 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:52:06,339] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:52:07,061] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:52:07,064] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:52:07,064] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:52:07,070] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,076] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,082] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,087] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,101] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:52:07,101] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,105] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:52:07,108] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:52:07,108] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,112] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:52:07,117] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:52:07,117] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,121] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:52:07,125] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:52:07,125] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,129] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:52:07,129] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #2 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:52:07,129] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:52:07,130] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 2 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_2
ok

----------------------------------------------------------------------
Ran 1 test in 66.488s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_3

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,update_ops_per=.5,run_async=True,scan_consistency=request_plus,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'update_ops_per': '.5', 'run_async': 'True', 'scan_consistency': 'request_plus', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 3, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_3'}
[2020-12-19 23:52:07,194] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:07,194] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:07,565] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:07,573] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,584] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:52:07,593] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:52:07,593] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #3 test_multi_create_query_explain_drop_index==============
[2020-12-19 23:52:07,607] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,613] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,620] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,625] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:52:07,629] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,643] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:52:07,644] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,647] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:52:07,651] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:52:07,651] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,654] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:52:07,658] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:52:07,658] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,661] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:52:07,665] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:52:07,665] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:52:07,668] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:52:07,669] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:52:08,197] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:52:08,201] - [task:157] INFO -  {'uptime': '204', 'memoryTotal': 15466930176, 'memoryFree': 13370691584, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-19 23:52:08,204] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:52:08,204] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:52:08,204] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:52:08,210] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:52:08,223] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:52:08,223] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:52:08,226] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:52:08,227] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:52:08,227] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:52:08,228] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:52:08,292] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:52:08,296] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:08,297] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:08,592] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:08,603] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:52:08,666] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:08,667] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:52:08,671] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:52:08,672] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:52:08,674] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:52:08,688] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:52:08,692] - [task:157] INFO -  {'uptime': '205', 'memoryTotal': 15466930176, 'memoryFree': 13387124736, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:52:08,697] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:52:08,701] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:52:08,701] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:52:08,773] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:52:08,777] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:08,778] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:09,076] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:09,087] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:52:09,145] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:09,146] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:52:09,150] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:52:09,151] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:52:09,154] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:52:09,168] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:52:09,172] - [task:157] INFO -  {'uptime': '203', 'memoryTotal': 15466930176, 'memoryFree': 13372387328, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:52:09,177] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:52:09,186] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:52:09,186] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:52:09,254] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:52:09,259] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:09,259] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:09,562] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:09,575] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:52:09,639] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:09,640] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:52:09,645] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:52:09,645] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:52:09,648] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:52:09,661] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:52:09,665] - [task:157] INFO -  {'uptime': '204', 'memoryTotal': 15466930176, 'memoryFree': 13385924608, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:52:09,671] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:52:09,676] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:52:09,676] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:52:09,750] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:52:09,756] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:09,756] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:10,109] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:10,120] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:52:10,180] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:10,181] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:52:10,186] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:52:10,186] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:52:10,189] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:52:10,210] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:52:10,319] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:52:15,321] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:52:15,336] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:52:15,341] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:15,341] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:15,655] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:15,667] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:52:15,725] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:52:15,726] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:52:15,727] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:52:16,225] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:52:16,233] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:52:16,234] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:16,859] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:16,968] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:16,998] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:52:16,998] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:17,043] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,113] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,139] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:52:17,139] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:17,184] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,252] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,278] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:52:17,278] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:17,326] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,407] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,443] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:52:17,443] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:17,500] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,576] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,602] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:52:17,602] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:52:17,649] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,732] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:17,758] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:52:17,762] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #3 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:52:17,775] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:52:17,775] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 24.3109151047409, 'mem_free': 13456142336, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:52:17,776] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:52:17,793] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:52:17,793] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:52:17,793] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:52:22,800] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:52:22,809] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:52:22,809] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:52:22,818] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:52:22,818] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:52:22,828] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:52:22,828] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:52:22,834] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:52:22,849] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:52:22,849] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:52:22,850] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:52:27,862] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:52:27,865] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:52:27,865] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:52:28,163] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:52:29,101] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:52:29,181] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:52:31,301] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:52:31,319] - [newtuq:82] INFO - {'update': {'start': 0, 'end': 0}, 'remaining': {'start': 0, 'end': 1}}
[2020-12-19 23:52:32,139] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:52:32,139] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:52:32,139] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:53:02,172] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:53:02,176] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:53:02,201] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 22.956259ms
[2020-12-19 23:53:02,206] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:53:02,209] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:53:02,974] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 763.34972ms
[2020-12-19 23:53:02,979] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:53:02,984] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:53:03,020] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 31.027361ms
[2020-12-19 23:53:03,045] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:03,045] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:03,547] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:03,566] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:04,565] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:53:04,570] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:53:04,702] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 130.292661ms
[2020-12-19 23:53:04,703] - [base_gsi:202] INFO - BUILD INDEX on default(employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title) USING GSI
[2020-12-19 23:53:05,708] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title) USING GSI
[2020-12-19 23:53:05,711] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title%29+USING+GSI
[2020-12-19 23:53:05,742] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 29.520596ms
[2020-12-19 23:53:06,747] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title'
[2020-12-19 23:53:06,751] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title%27
[2020-12-19 23:53:06,762] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.464921ms
[2020-12-19 23:53:07,768] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title'
[2020-12-19 23:53:07,772] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title%27
[2020-12-19 23:53:07,782] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.635425ms
[2020-12-19 23:53:08,327] - [basetestcase:2699] INFO - update 0.0 to default documents...
[2020-12-19 23:53:08,362] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:08,907] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:53:09,785] - [task:3104] INFO -  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:09,792] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:53:09,797] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
[2020-12-19 23:53:09,800] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.707576ms
[2020-12-19 23:53:09,800] - [task:3114] INFO - {'requestID': 'bbc18bd0-fcb4-48c6-aa23-3e737dbe7eba', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title', 'index_id': '8931afabf5ef3569', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.707576ms', 'executionTime': '1.626413ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
[2020-12-19 23:53:09,801] - [task:3115] INFO -  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:09,801] - [task:3145] INFO -  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:09,801] - [base_gsi:463] INFO - Query : SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:53:09,802] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-19 23:53:09,802] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["job_title"] == "Sales" 
[2020-12-19 23:53:09,802] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-19 23:53:09,803] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-19 23:53:09,803] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:53:09,803] - [tuq_generators:329] INFO - -->where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:53:10,803] - [task:3104] INFO -  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:10,807] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:53:10,811] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
[2020-12-19 23:53:10,930] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 108.803058ms
[2020-12-19 23:53:10,931] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-19 23:53:10,931] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-19 23:53:11,736] - [task:3115] INFO -  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:11,736] - [task:3145] INFO -  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:53:12,742] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title'
[2020-12-19 23:53:12,746] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title%27
[2020-12-19 23:53:12,756] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.177131ms
[2020-12-19 23:53:12,760] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title ON default USING GSI
[2020-12-19 23:53:12,763] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title+ON+default+USING+GSI
[2020-12-19 23:53:12,804] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 39.279124ms
[2020-12-19 23:53:12,812] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title'
[2020-12-19 23:53:12,818] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeef41c37c3ce6c4ca7a2fb84bacf644f43job_title%27
[2020-12-19 23:53:12,821] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.557362ms
[2020-12-19 23:53:12,850] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:12,854] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:12,854] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:13,308] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:13,318] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:53:13,319] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:53:13,395] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:13,405] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:13,409] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:13,409] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:13,865] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:13,874] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:53:13,874] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:53:13,948] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:13,961] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:13,962] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:53:13,962] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:53:13,966] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:53:13,970] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:53:13,981] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.913397ms
[2020-12-19 23:53:13,985] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:53:13,989] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:53:14,054] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 47.854445ms
[2020-12-19 23:53:14,083] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:53:14,084] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 20.69986541049798, 'mem_free': 13298425856, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:53:14,084] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:53:14,085] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #3 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:53:14,114] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:53:14,712] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:53:14,715] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:53:14,716] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:53:14,721] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:14,727] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:14,733] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:14,738] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:14,752] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:53:14,752] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:14,756] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:53:14,759] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:53:14,759] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:14,763] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:53:14,767] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:53:14,767] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:14,771] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:53:14,775] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:53:14,775] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:14,778] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:53:14,779] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #3 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:53:14,779] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:53:14,780] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 3 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_3
ok

----------------------------------------------------------------------
Ran 1 test in 67.596s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_4

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,expiry_ops_per=.5,run_async=True,scan_consistency=request_plus,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'expiry_ops_per': '.5', 'run_async': 'True', 'scan_consistency': 'request_plus', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 4, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_4'}
[2020-12-19 23:53:14,850] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:14,850] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:15,291] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:15,299] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,310] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:53:15,318] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:53:15,318] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #4 test_multi_create_query_explain_drop_index==============
[2020-12-19 23:53:15,334] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:15,341] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:15,348] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:15,356] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:53:15,361] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,376] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:53:15,377] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,381] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:53:15,385] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:53:15,386] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,390] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:53:15,393] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:53:15,394] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,398] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:53:15,402] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:53:15,402] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:53:15,406] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:53:15,407] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:53:15,853] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:53:15,857] - [task:157] INFO -  {'uptime': '272', 'memoryTotal': 15466930176, 'memoryFree': 13298425856, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:53:15,862] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:53:15,862] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:53:15,862] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:53:15,871] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:53:15,885] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:53:15,885] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:53:15,888] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:53:15,889] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:53:15,889] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:53:15,890] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:53:15,958] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:53:15,963] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:15,964] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:16,336] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:16,348] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:53:16,419] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:16,420] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:53:16,424] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:53:16,425] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:53:16,427] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:53:16,441] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:53:16,445] - [task:157] INFO -  {'uptime': '270', 'memoryTotal': 15466930176, 'memoryFree': 13298245632, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:53:16,450] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:53:16,455] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:53:16,455] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:53:16,523] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:53:16,530] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:16,530] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:16,900] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:16,912] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:53:16,979] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:16,980] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:53:16,985] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:53:16,986] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:53:16,989] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:53:17,002] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:53:17,005] - [task:157] INFO -  {'uptime': '269', 'memoryTotal': 15466930176, 'memoryFree': 13233369088, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:53:17,010] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:53:17,016] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:53:17,017] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:53:17,089] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:53:17,095] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:17,095] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:17,471] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:17,483] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:53:17,561] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:17,562] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:53:17,567] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:53:17,567] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:53:17,572] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:53:17,587] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:53:17,591] - [task:157] INFO -  {'uptime': '270', 'memoryTotal': 15466930176, 'memoryFree': 13367230464, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:53:17,597] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:53:17,603] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:53:17,603] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:53:17,674] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:53:17,677] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:17,678] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:18,043] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:18,057] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:53:18,124] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:18,125] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:53:18,130] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:53:18,130] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:53:18,133] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:53:18,153] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:53:18,278] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:53:23,280] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:53:23,295] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:53:23,299] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:23,299] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:23,716] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:23,726] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:53:23,803] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:53:23,804] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:53:23,805] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:53:24,167] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:53:24,174] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:53:24,174] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:24,376] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,444] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,479] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:53:24,480] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:24,525] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,606] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,695] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:53:24,695] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:24,742] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,791] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,849] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:53:24,850] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:24,897] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:24,945] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:25,002] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:53:25,002] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:25,048] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:25,099] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:25,157] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:53:25,157] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:53:25,205] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:25,252] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:25,324] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:53:25,327] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #4 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:53:25,341] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:53:25,342] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 27.32463295269168, 'mem_free': 13386104832, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:53:25,342] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:53:25,351] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:53:25,352] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:53:25,352] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:53:30,363] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:53:30,372] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:53:30,373] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:53:30,383] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:53:30,383] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:53:30,393] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:53:30,393] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:53:30,400] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:30,416] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:53:30,416] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:53:30,417] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:53:35,428] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:53:35,431] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:53:35,431] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:53:35,807] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:53:36,762] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:53:36,795] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:53:38,959] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:53:38,971] - [newtuq:82] INFO - {'expiry': {'start': 0, 'end': 0}, 'remaining': {'start': 0, 'end': 1}}
[2020-12-19 23:53:39,514] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:53:39,514] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:53:39,514] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:54:09,545] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:54:09,549] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:54:09,572] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 21.79603ms
[2020-12-19 23:54:09,576] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:54:09,580] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:54:10,370] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 787.386627ms
[2020-12-19 23:54:10,400] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:54:10,408] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:54:10,456] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 43.012022ms
[2020-12-19 23:54:10,480] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:10,481] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:10,943] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:10,965] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:11,963] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee621839ccd9954b838b0e40aa5b96f2d8job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:54:11,968] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee621839ccd9954b838b0e40aa5b96f2d8job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:54:12,081] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 111.433629ms
[2020-12-19 23:54:12,081] - [base_gsi:202] INFO - BUILD INDEX on default(employee621839ccd9954b838b0e40aa5b96f2d8job_title) USING GSI
[2020-12-19 23:54:13,087] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee621839ccd9954b838b0e40aa5b96f2d8job_title) USING GSI
[2020-12-19 23:54:13,092] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee621839ccd9954b838b0e40aa5b96f2d8job_title%29+USING+GSI
[2020-12-19 23:54:13,127] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 33.717808ms
[2020-12-19 23:54:14,133] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee621839ccd9954b838b0e40aa5b96f2d8job_title'
[2020-12-19 23:54:14,137] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee621839ccd9954b838b0e40aa5b96f2d8job_title%27
[2020-12-19 23:54:14,149] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.401811ms
[2020-12-19 23:54:15,155] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee621839ccd9954b838b0e40aa5b96f2d8job_title'
[2020-12-19 23:54:15,159] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee621839ccd9954b838b0e40aa5b96f2d8job_title%27
[2020-12-19 23:54:15,167] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 6.190485ms
[2020-12-19 23:54:15,727] - [basetestcase:2699] INFO - update 0.0 to default documents...
[2020-12-19 23:54:15,760] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:16,454] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:54:16,515] - [data_helper:311] INFO - dict:{'ip': '127.0.0.1', 'port': '9000', 'username': 'Administrator', 'password': 'asdasd'}
[2020-12-19 23:54:16,516] - [data_helper:312] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:16,547] - [cluster_helper:371] INFO - Setting flush param on server {'ip': '127.0.0.1', 'port': '9000', 'username': 'Administrator', 'password': 'asdasd'}, exp_pager_stime to 10 on default
[2020-12-19 23:54:16,548] - [mc_bin_client:680] INFO - setting param: exp_pager_stime 10
[2020-12-19 23:54:16,549] - [cluster_helper:385] INFO - Setting flush param on server {'ip': '127.0.0.1', 'port': '9000', 'username': 'Administrator', 'password': 'asdasd'}, exp_pager_stime to 10, result: (1629043507, 0, b'')
[2020-12-19 23:54:17,169] - [task:3104] INFO -  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:17,173] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:54:17,177] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
[2020-12-19 23:54:17,180] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.315731ms
[2020-12-19 23:54:17,181] - [task:3114] INFO - {'requestID': 'f83745f9-631d-47d3-a68a-cb00066b039a', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee621839ccd9954b838b0e40aa5b96f2d8job_title', 'index_id': 'd63086a512a805d8', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.315731ms', 'executionTime': '1.251507ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
[2020-12-19 23:54:17,181] - [task:3115] INFO -  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:17,181] - [task:3145] INFO -  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:17,182] - [base_gsi:463] INFO - Query : SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:54:17,182] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-19 23:54:17,182] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["job_title"] == "Sales" 
[2020-12-19 23:54:17,183] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-19 23:54:17,183] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-19 23:54:17,183] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:54:17,183] - [tuq_generators:329] INFO - -->where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:54:18,183] - [task:3104] INFO -  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:18,188] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:54:18,196] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
[2020-12-19 23:54:18,324] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 119.633934ms
[2020-12-19 23:54:18,324] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-19 23:54:18,325] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-19 23:54:19,121] - [task:3115] INFO -  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:19,122] - [task:3145] INFO -  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:54:20,127] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee621839ccd9954b838b0e40aa5b96f2d8job_title'
[2020-12-19 23:54:20,131] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee621839ccd9954b838b0e40aa5b96f2d8job_title%27
[2020-12-19 23:54:20,142] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.315616ms
[2020-12-19 23:54:20,146] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee621839ccd9954b838b0e40aa5b96f2d8job_title ON default USING GSI
[2020-12-19 23:54:20,150] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee621839ccd9954b838b0e40aa5b96f2d8job_title+ON+default+USING+GSI
[2020-12-19 23:54:20,205] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 53.853009ms
[2020-12-19 23:54:20,213] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee621839ccd9954b838b0e40aa5b96f2d8job_title'
[2020-12-19 23:54:20,218] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee621839ccd9954b838b0e40aa5b96f2d8job_title%27
[2020-12-19 23:54:20,221] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.632083ms
[2020-12-19 23:54:20,241] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:20,245] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:20,245] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:20,734] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:20,743] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:54:20,743] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:54:20,814] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:20,824] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:20,827] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:20,827] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:21,273] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:21,282] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:54:21,282] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:54:21,355] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:21,367] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:21,367] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:54:21,367] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:54:21,371] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:54:21,376] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:54:21,387] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.345287ms
[2020-12-19 23:54:21,392] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:54:21,397] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:54:21,439] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 40.790314ms
[2020-12-19 23:54:21,463] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:54:21,463] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 25.31645569620253, 'mem_free': 13196185600, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:54:21,463] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:54:21,463] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #4 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:54:21,494] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:54:22,704] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:54:22,707] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:54:22,707] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:54:22,713] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:22,718] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:22,724] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:22,730] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:22,744] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:54:22,744] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:22,747] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:54:22,751] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:54:22,751] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:22,755] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:54:22,759] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:54:22,760] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:22,764] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:54:22,768] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:54:22,768] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:22,772] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:54:22,772] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #4 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:54:22,773] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:54:22,777] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 4 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_4
ok

----------------------------------------------------------------------
Ran 1 test in 67.950s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_5

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,create_ops_per=.5,run_async=True,scan_consistency=request_plus,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'create_ops_per': '.5', 'run_async': 'True', 'scan_consistency': 'request_plus', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 5, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_5'}
[2020-12-19 23:54:22,860] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:22,861] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:23,292] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:23,301] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,314] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:54:23,322] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:54:23,322] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #5 test_multi_create_query_explain_drop_index==============
[2020-12-19 23:54:23,336] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:23,341] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:23,346] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:23,352] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:54:23,356] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,369] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:54:23,370] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,373] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:54:23,377] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:54:23,377] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,381] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:54:23,385] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:54:23,385] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,388] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:54:23,392] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:54:23,392] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:54:23,396] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:54:23,397] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:54:23,863] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:54:23,867] - [task:157] INFO -  {'uptime': '340', 'memoryTotal': 15466930176, 'memoryFree': 13196185600, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-19 23:54:23,870] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:54:23,870] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:54:23,870] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:54:23,879] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:54:23,894] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:54:23,894] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:54:23,897] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:54:23,898] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:54:23,898] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:54:23,898] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:54:23,965] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:54:23,969] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:23,970] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:24,411] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:24,426] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:54:24,511] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:24,512] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:54:24,516] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:54:24,517] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:54:24,520] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:54:24,534] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:54:24,538] - [task:157] INFO -  {'uptime': '341', 'memoryTotal': 15466930176, 'memoryFree': 13160669184, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:54:24,543] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:54:24,548] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:54:24,548] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:54:24,617] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:54:24,623] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:24,623] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:25,078] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:25,089] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:54:25,173] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:25,174] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:54:25,180] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:54:25,180] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:54:25,183] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:54:25,198] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:54:25,202] - [task:157] INFO -  {'uptime': '340', 'memoryTotal': 15466930176, 'memoryFree': 13193256960, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:54:25,207] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:54:25,211] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:54:25,211] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:54:25,282] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:54:25,291] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:25,291] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:25,785] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:25,800] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:54:25,876] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:25,878] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:54:25,883] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:54:25,883] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:54:25,886] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:54:25,900] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:54:25,904] - [task:157] INFO -  {'uptime': '340', 'memoryTotal': 15466930176, 'memoryFree': 13187371008, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:54:25,909] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:54:25,914] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:54:25,914] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:54:25,988] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:54:25,994] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:25,994] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:26,407] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:26,418] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:54:26,498] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:26,499] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:54:26,504] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:54:26,505] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:54:26,507] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:54:26,527] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:54:26,655] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:54:31,657] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:54:31,671] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:54:31,679] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:31,679] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:32,078] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:32,089] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:54:32,172] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:54:32,173] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:54:32,174] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:54:32,542] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:54:32,565] - [rest_client:2768] INFO - 0.02 seconds to create bucket default
[2020-12-19 23:54:32,565] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:32,744] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:32,808] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:32,836] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:54:32,836] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:32,901] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:32,965] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:32,992] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:54:32,992] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:33,038] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,164] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,192] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:54:33,192] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:33,238] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,326] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,351] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:54:33,351] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:33,407] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,462] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,531] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:54:33,531] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:54:33,579] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,637] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:33,727] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:54:33,730] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #5 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:54:33,743] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:54:33,743] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 27.21665381649962, 'mem_free': 13313523712, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:54:33,744] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:54:33,750] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:54:33,751] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:54:33,751] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:54:38,759] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:54:38,767] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:54:38,767] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:54:38,775] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:54:38,775] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:54:38,783] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:54:38,784] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:54:38,790] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:38,803] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:54:38,804] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:54:38,804] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:54:43,814] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:54:43,817] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:54:43,817] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:54:44,254] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:54:45,276] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:54:45,310] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:54:47,244] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:54:47,264] - [newtuq:82] INFO - {'remaining': {'start': 0, 'end': 1}, 'create': {'start': 1, 'end': 2}}
[2020-12-19 23:54:48,275] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:54:48,275] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:54:48,275] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:55:18,303] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:55:18,307] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:55:18,332] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 24.233948ms
[2020-12-19 23:55:18,336] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:55:18,340] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:55:19,002] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 660.372945ms
[2020-12-19 23:55:19,012] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:55:19,022] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:55:19,038] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 14.728575ms
[2020-12-19 23:55:19,054] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:19,055] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:19,673] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:19,695] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:55:20,694] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee41ead7cd669540d99f585a327e3b0008job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:55:20,698] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee41ead7cd669540d99f585a327e3b0008job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:55:20,831] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 130.424851ms
[2020-12-19 23:55:20,831] - [base_gsi:202] INFO - BUILD INDEX on default(employee41ead7cd669540d99f585a327e3b0008job_title) USING GSI
[2020-12-19 23:55:21,837] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee41ead7cd669540d99f585a327e3b0008job_title) USING GSI
[2020-12-19 23:55:21,841] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee41ead7cd669540d99f585a327e3b0008job_title%29+USING+GSI
[2020-12-19 23:55:21,863] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 19.984975ms
[2020-12-19 23:55:22,868] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee41ead7cd669540d99f585a327e3b0008job_title'
[2020-12-19 23:55:22,872] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee41ead7cd669540d99f585a327e3b0008job_title%27
[2020-12-19 23:55:22,884] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.656488ms
[2020-12-19 23:55:23,889] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee41ead7cd669540d99f585a327e3b0008job_title'
[2020-12-19 23:55:23,893] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee41ead7cd669540d99f585a327e3b0008job_title%27
[2020-12-19 23:55:23,904] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.205311ms
[2020-12-19 23:55:24,499] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:55:24,532] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:28,109] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:55:28,910] - [task:3104] INFO -  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:28,917] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:55:28,921] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
[2020-12-19 23:55:28,924] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.879417ms
[2020-12-19 23:55:28,924] - [task:3114] INFO - {'requestID': 'b0528510-7cbb-4103-bddc-e6cba05a8c15', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee41ead7cd669540d99f585a327e3b0008job_title', 'index_id': '74390b116a4c4536', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.879417ms', 'executionTime': '1.805583ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
[2020-12-19 23:55:28,925] - [task:3115] INFO -  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:28,925] - [task:3145] INFO -  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:28,925] - [base_gsi:463] INFO - Query : SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:55:28,926] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-19 23:55:28,926] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["job_title"] == "Sales" 
[2020-12-19 23:55:28,926] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-19 23:55:28,927] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-19 23:55:28,927] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:55:28,927] - [tuq_generators:329] INFO - -->where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:55:29,925] - [task:3104] INFO -  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:29,930] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:55:29,934] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
[2020-12-19 23:55:30,180] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 229.098491ms
[2020-12-19 23:55:30,180] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-19 23:55:30,181] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-19 23:55:31,774] - [task:3115] INFO -  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:31,775] - [task:3145] INFO -  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:55:32,781] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee41ead7cd669540d99f585a327e3b0008job_title'
[2020-12-19 23:55:32,784] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee41ead7cd669540d99f585a327e3b0008job_title%27
[2020-12-19 23:55:32,794] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.72506ms
[2020-12-19 23:55:32,798] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee41ead7cd669540d99f585a327e3b0008job_title ON default USING GSI
[2020-12-19 23:55:32,802] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee41ead7cd669540d99f585a327e3b0008job_title+ON+default+USING+GSI
[2020-12-19 23:55:32,840] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 36.401792ms
[2020-12-19 23:55:32,847] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee41ead7cd669540d99f585a327e3b0008job_title'
[2020-12-19 23:55:32,853] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee41ead7cd669540d99f585a327e3b0008job_title%27
[2020-12-19 23:55:32,857] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.674225ms
[2020-12-19 23:55:32,878] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:55:32,882] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:32,882] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:33,463] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:33,473] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:55:33,473] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:55:33,566] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:33,577] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:55:33,580] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:33,581] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:34,165] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:34,175] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:55:34,175] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:55:34,270] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:34,283] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:55:34,283] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:55:34,283] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:55:34,287] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:55:34,291] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:55:34,302] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.008118ms
[2020-12-19 23:55:34,306] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:55:34,310] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:55:34,365] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 52.354149ms
[2020-12-19 23:55:34,384] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:55:34,384] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 12.02274573517465, 'mem_free': 13226860544, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:55:34,384] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:55:34,384] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #5 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:55:34,421] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:55:34,986] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:55:34,989] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:55:34,989] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:55:34,996] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,003] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,009] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,024] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,040] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:55:35,040] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,044] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:55:35,047] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:55:35,048] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,051] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:55:35,056] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:55:35,056] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,059] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:55:35,063] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:55:35,064] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,067] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:55:35,068] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #5 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:55:35,068] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:55:35,070] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 5 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_5
ok

----------------------------------------------------------------------
Ran 1 test in 72.221s

OK
test_multi_create_query_explain_drop_index (gsi.indexscans_gsi.SecondaryIndexingScanTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_6

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index,groups=simple:equals:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,doc_ops=True,create_ops_per=.5,delete_ops_per=.2,update_ops_per=.2,run_async=True,scan_consistency=request_plus,GROUP=gsi

Test Input params:
{'groups': 'simple:equals:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'doc_ops': 'True', 'create_ops_per': '.5', 'delete_ops_per': '.2', 'update_ops_per': '.2', 'run_async': 'True', 'scan_consistency': 'request_plus', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 6, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_6'}
[2020-12-19 23:55:35,143] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:35,143] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:35,760] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:35,767] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,780] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:55:35,790] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:55:35,790] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #6 test_multi_create_query_explain_drop_index==============
[2020-12-19 23:55:35,803] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,809] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,818] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,824] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:55:35,829] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,843] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:55:35,843] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,846] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:55:35,850] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:55:35,851] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,855] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:55:35,859] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:55:35,859] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,862] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:55:35,866] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:55:35,866] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:55:35,870] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:55:35,871] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:55:36,146] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:55:36,150] - [task:157] INFO -  {'uptime': '412', 'memoryTotal': 15466930176, 'memoryFree': 13155258368, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:55:36,153] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:55:36,153] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:55:36,153] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:55:36,159] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:55:36,172] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:55:36,172] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:55:36,178] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:55:36,179] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:55:36,179] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:55:36,180] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:55:36,248] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:55:36,257] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:36,257] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:36,834] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:36,847] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:55:36,943] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:36,945] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:55:36,949] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:55:36,950] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:55:36,952] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:55:36,966] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:55:36,970] - [task:157] INFO -  {'uptime': '412', 'memoryTotal': 15466930176, 'memoryFree': 13162254336, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:55:36,974] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:55:36,979] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:55:36,979] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:55:37,049] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:55:37,055] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:37,055] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:37,649] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:37,661] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:55:37,757] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:37,758] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:55:37,762] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:55:37,763] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:55:37,766] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:55:37,779] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:55:37,784] - [task:157] INFO -  {'uptime': '410', 'memoryTotal': 15466930176, 'memoryFree': 13157388288, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:55:37,789] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:55:37,794] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:55:37,794] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:55:37,867] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:55:37,873] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:37,874] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:38,438] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:38,452] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:55:38,550] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:38,551] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:55:38,555] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:55:38,556] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:55:38,559] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:55:38,572] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:55:38,575] - [task:157] INFO -  {'uptime': '411', 'memoryTotal': 15466930176, 'memoryFree': 13063204864, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:55:38,581] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:55:38,585] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:55:38,586] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:55:38,655] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:55:38,660] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:38,661] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:39,265] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:39,277] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:55:39,376] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:39,377] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:55:39,382] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:55:39,382] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:55:39,385] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:55:39,405] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:55:39,560] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:55:44,565] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:55:44,581] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:55:44,587] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:44,587] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:45,223] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:45,235] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:55:45,356] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:55:45,357] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:55:45,358] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:55:45,421] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:55:45,431] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:55:45,432] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:45,654] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:45,716] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:45,751] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:55:45,751] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:45,810] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:45,910] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:45,940] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:55:45,941] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:46,097] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,151] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,180] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:55:46,180] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:46,238] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,350] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,380] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:55:46,381] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:46,435] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,494] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,611] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:55:46,611] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:55:46,672] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,725] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:55:46,755] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:55:46,758] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #6 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:55:46,772] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:55:46,773] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 31.9478402607987, 'mem_free': 13280727040, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:55:46,773] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:55:46,786] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:55:46,786] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:55:46,786] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:55:51,797] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:55:51,807] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:55:51,807] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:55:51,815] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:55:51,815] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:55:51,823] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:55:51,824] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:55:51,831] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:55:51,849] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:55:51,850] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:55:51,850] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:55:56,859] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:55:56,863] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:55:56,863] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:55:57,441] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:55:58,514] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:55:58,547] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:56:01,318] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:56:01,337] - [newtuq:82] INFO - {'update': {'start': 0, 'end': 0}, 'delete': {'start': 0, 'end': 0}, 'remaining': {'start': 0, 'end': 1}, 'create': {'start': 1, 'end': 2}}
[2020-12-19 23:56:02,840] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:56:02,840] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:56:02,840] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:56:32,863] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:56:32,867] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:56:32,894] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 25.190375ms
[2020-12-19 23:56:32,898] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:56:32,901] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:56:33,520] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 616.680719ms
[2020-12-19 23:56:33,529] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:56:33,533] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:56:33,559] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 23.181084ms
[2020-12-19 23:56:33,578] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:33,579] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:34,299] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:34,320] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:56:35,317] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employeeed5782adf00b449f86709a9ef1cff236job_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:56:35,321] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employeeed5782adf00b449f86709a9ef1cff236job_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:56:35,451] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 127.533759ms
[2020-12-19 23:56:35,451] - [base_gsi:202] INFO - BUILD INDEX on default(employeeed5782adf00b449f86709a9ef1cff236job_title) USING GSI
[2020-12-19 23:56:36,456] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employeeed5782adf00b449f86709a9ef1cff236job_title) USING GSI
[2020-12-19 23:56:36,460] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employeeed5782adf00b449f86709a9ef1cff236job_title%29+USING+GSI
[2020-12-19 23:56:36,490] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 27.68494ms
[2020-12-19 23:56:37,496] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeed5782adf00b449f86709a9ef1cff236job_title'
[2020-12-19 23:56:37,500] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeed5782adf00b449f86709a9ef1cff236job_title%27
[2020-12-19 23:56:37,511] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.905516ms
[2020-12-19 23:56:38,517] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeed5782adf00b449f86709a9ef1cff236job_title'
[2020-12-19 23:56:38,521] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeed5782adf00b449f86709a9ef1cff236job_title%27
[2020-12-19 23:56:38,534] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.584102ms
[2020-12-19 23:56:39,164] - [basetestcase:2699] INFO - update 0.0 to default documents...
[2020-12-19 23:56:39,196] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:56:40,188] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:56:40,640] - [basetestcase:2699] INFO - delete 0.0 to default documents...
[2020-12-19 23:56:40,681] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:56:41,247] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:56:41,854] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:56:41,890] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:56:45,587] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:56:46,553] - [task:3104] INFO -  <<<<< START Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:46,561] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:56:46,566] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+
[2020-12-19 23:56:46,570] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.831298ms
[2020-12-19 23:56:46,570] - [task:3114] INFO - {'requestID': '567da22d-23e3-486a-bd89-f67658bccbdd', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employeeed5782adf00b449f86709a9ef1cff236job_title', 'index_id': '15959a59b9eb6ff7', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '"Sales"', 'inclusion': 3, 'low': '"Sales"'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((`default`.`job_title`) = "Sales")'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, 'text': 'SELECT * FROM default WHERE  job_title = "Sales"'}], 'status': 'success', 'metrics': {'elapsedTime': '1.831298ms', 'executionTime': '1.740096ms', 'resultCount': 1, 'resultSize': 698, 'serviceLoad': 6}}
[2020-12-19 23:56:46,570] - [task:3115] INFO -  <<<<< Done Executing Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:46,571] - [task:3145] INFO -  <<<<< Done VERIFYING Query EXPLAIN SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:46,571] - [base_gsi:463] INFO - Query : SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:56:46,571] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-19 23:56:46,572] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["job_title"] == "Sales" 
[2020-12-19 23:56:46,572] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-19 23:56:46,572] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-19 23:56:46,573] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,}; where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:56:46,573] - [tuq_generators:329] INFO - -->where_clause=  doc["job_title"] == "Sales" 
[2020-12-19 23:56:47,572] - [task:3104] INFO -  <<<<< START Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:47,576] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  job_title = "Sales" 
[2020-12-19 23:56:47,580] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++job_title+%3D+%22Sales%22+&scan_consistency=request_plus
[2020-12-19 23:56:47,808] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 213.400332ms
[2020-12-19 23:56:47,808] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-19 23:56:47,809] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-19 23:56:49,307] - [task:3115] INFO -  <<<<< Done Executing Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:49,308] - [task:3145] INFO -  <<<<< Done VERIFYING Query SELECT * FROM default WHERE  job_title = "Sales"  >>>>>>
[2020-12-19 23:56:50,314] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeed5782adf00b449f86709a9ef1cff236job_title'
[2020-12-19 23:56:50,317] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeed5782adf00b449f86709a9ef1cff236job_title%27
[2020-12-19 23:56:50,329] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.206953ms
[2020-12-19 23:56:50,334] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employeeed5782adf00b449f86709a9ef1cff236job_title ON default USING GSI
[2020-12-19 23:56:50,338] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employeeed5782adf00b449f86709a9ef1cff236job_title+ON+default+USING+GSI
[2020-12-19 23:56:50,377] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 37.729241ms
[2020-12-19 23:56:50,382] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeed5782adf00b449f86709a9ef1cff236job_title'
[2020-12-19 23:56:50,389] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeed5782adf00b449f86709a9ef1cff236job_title%27
[2020-12-19 23:56:50,393] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 2.027214ms
[2020-12-19 23:56:50,412] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:56:50,416] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:50,416] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:51,148] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:51,157] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:56:51,158] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:56:51,264] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:51,277] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:56:51,280] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:51,280] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:51,980] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:51,989] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:56:51,990] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:56:52,102] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:52,115] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:56:52,115] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:56:52,115] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:56:52,119] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:56:52,124] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:56:52,135] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.791298ms
[2020-12-19 23:56:52,139] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:56:52,143] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:56:52,200] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 55.346621ms
[2020-12-19 23:56:52,216] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:56:52,216] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 19.82248520710059, 'mem_free': 12947304448, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:56:52,216] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:56:52,217] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #6 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:56:52,248] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:56:52,940] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:56:52,943] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:56:52,943] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:56:52,949] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:52,955] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:52,960] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:52,965] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:52,980] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:56:52,980] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:52,984] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:56:52,988] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:56:52,988] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:52,992] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:56:52,996] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:56:52,997] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,000] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:56:53,004] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:56:53,004] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,008] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:56:53,008] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #6 test_multi_create_query_explain_drop_index ==============
[2020-12-19 23:56:53,008] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:56:53,010] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_6
ok

----------------------------------------------------------------------
Ran 1 test in 77.877s

OK
test_multi_create_drop_index (gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_7

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests.test_multi_create_drop_index,groups=simple,dataset=default,doc-per-day=1,cbq_version=sherlock,skip_build_tuq=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'simple', 'dataset': 'default', 'doc-per-day': '1', 'cbq_version': 'sherlock', 'skip_build_tuq': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 7, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_7'}
[2020-12-19 23:56:53,119] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:53,120] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:53,789] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:53,797] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,808] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:56:53,817] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:56:53,817] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #7 test_multi_create_drop_index==============
[2020-12-19 23:56:53,832] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:53,837] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:53,843] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:53,849] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:56:53,853] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,867] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:56:53,867] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,871] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:56:53,875] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:56:53,875] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,878] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:56:53,882] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:56:53,882] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,886] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:56:53,890] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:56:53,890] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:56:53,894] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:56:53,895] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:56:54,123] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:56:54,127] - [task:157] INFO -  {'uptime': '490', 'memoryTotal': 15466930176, 'memoryFree': 13048795136, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 3185}
[2020-12-19 23:56:54,130] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:56:54,131] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:56:54,131] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:56:54,138] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:56:54,156] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:56:54,156] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:56:54,163] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:56:54,164] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:56:54,164] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:56:54,164] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:56:54,232] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:56:54,238] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:54,238] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:54,900] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:54,914] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:56:55,031] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:55,034] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:56:55,038] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:56:55,039] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:56:55,043] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:56:55,056] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:56:55,060] - [task:157] INFO -  {'uptime': '488', 'memoryTotal': 15466930176, 'memoryFree': 13058293760, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:56:55,065] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:56:55,070] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:56:55,070] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:56:55,170] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:56:55,175] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:55,176] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:55,843] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:55,856] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:56:55,981] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:55,982] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:56:55,988] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:56:55,988] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:56:55,992] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:56:56,005] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:56:56,009] - [task:157] INFO -  {'uptime': '491', 'memoryTotal': 15466930176, 'memoryFree': 13050314752, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:56:56,014] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:56:56,021] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:56:56,022] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:56:56,107] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:56:56,114] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:56,114] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:56,733] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:56,745] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:56:56,853] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:56,855] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:56:56,860] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:56:56,861] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:56:56,863] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:56:56,877] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:56:56,880] - [task:157] INFO -  {'uptime': '492', 'memoryTotal': 15466930176, 'memoryFree': 13188603904, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:56:56,885] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:56:56,891] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:56:56,891] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:56:56,960] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:56:56,966] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:56:56,966] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:56:57,599] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:56:57,611] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:56:57,715] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:56:57,716] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:56:57,720] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:56:57,720] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:56:57,724] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:56:57,744] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:56:57,850] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:57:02,851] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:57:02,865] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:57:02,870] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:02,870] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:57:03,507] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:57:03,518] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:57:03,623] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:57:03,624] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:57:03,625] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:57:03,759] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:57:03,770] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:57:03,771] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:04,116] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,200] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,226] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:57:04,226] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:04,272] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,335] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,425] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:57:04,425] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:04,472] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,528] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,559] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:57:04,560] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:04,609] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,756] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,782] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:57:04,783] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:04,830] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,876] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:04,965] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:57:04,965] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:57:05,029] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:05,084] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:05,112] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:57:05,115] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #7 test_multi_create_drop_index ==============
[2020-12-19 23:57:05,126] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:57:05,127] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 28.45154304277206, 'mem_free': 13200728064, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:57:05,127] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:57:05,133] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:57:05,134] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:57:05,134] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:57:10,144] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:57:10,154] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:57:10,154] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:57:10,163] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:57:10,164] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:57:10,172] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:57:10,172] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:57:10,179] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:57:10,194] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:57:10,195] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:57:10,195] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:57:15,207] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:57:15,211] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:15,211] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:57:15,878] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:57:17,015] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:57:17,047] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:57:19,650] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:57:19,684] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:57:19,684] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:57:19,685] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:57:49,705] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:57:49,709] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:57:49,734] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 23.312726ms
[2020-12-19 23:57:49,739] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:57:49,743] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:57:50,444] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 699.958197ms
[2020-12-19 23:57:50,483] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:57:50,500] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:57:50,524] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 20.916763ms
[2020-12-19 23:57:50,551] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:50,551] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:57:51,276] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:57:51,292] - [base_gsi:246] INFO - []
[2020-12-19 23:57:52,298] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee13aef6c353494c99b94cfc169b2c2f7bjob_title ON default(job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:57:52,302] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee13aef6c353494c99b94cfc169b2c2f7bjob_title+ON+default%28job_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:57:52,463] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 159.887903ms
[2020-12-19 23:57:52,471] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr ON default(join_yr) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:57:52,478] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:57:52,630] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 149.491815ms
[2020-12-19 23:57:52,630] - [base_gsi:202] INFO - BUILD INDEX on default(employee13aef6c353494c99b94cfc169b2c2f7bjob_title,employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr) USING GSI
[2020-12-19 23:57:53,636] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee13aef6c353494c99b94cfc169b2c2f7bjob_title,employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr) USING GSI
[2020-12-19 23:57:53,640] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee13aef6c353494c99b94cfc169b2c2f7bjob_title%2Cemployee13aef6c353494c99b94cfc169b2c2f7bjoin_yr%29+USING+GSI
[2020-12-19 23:57:53,682] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 38.668464ms
[2020-12-19 23:57:54,687] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjob_title'
[2020-12-19 23:57:54,691] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjob_title%27
[2020-12-19 23:57:54,701] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.081894ms
[2020-12-19 23:57:55,707] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjob_title'
[2020-12-19 23:57:55,710] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjob_title%27
[2020-12-19 23:57:55,720] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 7.759684ms
[2020-12-19 23:57:55,724] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr'
[2020-12-19 23:57:55,729] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr%27
[2020-12-19 23:57:55,732] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.556583ms
[2020-12-19 23:57:56,737] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjob_title'
[2020-12-19 23:57:56,741] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjob_title%27
[2020-12-19 23:57:56,752] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.646957ms
[2020-12-19 23:57:56,756] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee13aef6c353494c99b94cfc169b2c2f7bjob_title ON default USING GSI
[2020-12-19 23:57:56,760] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee13aef6c353494c99b94cfc169b2c2f7bjob_title+ON+default+USING+GSI
[2020-12-19 23:57:56,807] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 45.027146ms
[2020-12-19 23:57:56,818] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr'
[2020-12-19 23:57:56,826] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr%27
[2020-12-19 23:57:56,830] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.801688ms
[2020-12-19 23:57:56,835] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr ON default USING GSI
[2020-12-19 23:57:56,841] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr+ON+default+USING+GSI
[2020-12-19 23:57:56,882] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 38.790134ms
[2020-12-19 23:57:56,887] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjob_title'
[2020-12-19 23:57:56,893] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjob_title%27
[2020-12-19 23:57:56,908] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.419848ms
[2020-12-19 23:57:56,917] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr'
[2020-12-19 23:57:56,922] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee13aef6c353494c99b94cfc169b2c2f7bjoin_yr%27
[2020-12-19 23:57:56,926] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.308815ms
[2020-12-19 23:57:56,941] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:57:56,944] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:56,945] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:57:57,558] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:57:57,567] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:57:57,568] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:57:57,671] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:57:57,681] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:57:57,685] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:57,686] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:57:58,304] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:57:58,313] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:57:58,313] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:57:58,423] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:57:58,435] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:57:58,436] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:57:58,436] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:57:58,440] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:57:58,444] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:57:58,454] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.9633ms
[2020-12-19 23:57:58,459] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:57:58,463] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:57:58,514] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 49.357442ms
[2020-12-19 23:57:58,535] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:57:58,536] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 3.293028042191922, 'mem_free': 13186424832, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:57:58,536] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:57:58,536] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #7 test_multi_create_drop_index ==============
[2020-12-19 23:57:58,571] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:57:59,263] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:57:59,266] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:57:59,267] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:57:59,273] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:57:59,279] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:57:59,285] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:57:59,290] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:57:59,304] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:57:59,305] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:57:59,309] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:57:59,312] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:57:59,312] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:57:59,316] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:57:59,320] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:57:59,321] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:57:59,324] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:57:59,329] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:57:59,329] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:57:59,332] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:57:59,333] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #7 test_multi_create_drop_index ==============
[2020-12-19 23:57:59,333] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:57:59,335] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
summary so far suite gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests , pass 1 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_7
ok

----------------------------------------------------------------------
Ran 1 test in 66.228s

OK
test_multi_create_drop_index (gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_8

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests.test_multi_create_drop_index,groups=composite,dataset=default,doc-per-day=1,cbq_version=sherlock,skip_build_tuq=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'composite', 'dataset': 'default', 'doc-per-day': '1', 'cbq_version': 'sherlock', 'skip_build_tuq': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 8, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_8'}
[2020-12-19 23:57:59,379] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:57:59,379] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:00,050] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:00,058] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,070] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:58:00,080] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:58:00,080] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #8 test_multi_create_drop_index==============
[2020-12-19 23:58:00,096] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:58:00,102] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:58:00,109] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:58:00,115] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:58:00,119] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,137] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:58:00,137] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,156] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:58:00,160] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:58:00,160] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,164] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:58:00,169] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:58:00,169] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,175] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:58:00,179] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:58:00,179] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:58:00,183] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:58:00,184] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:58:00,382] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:58:00,386] - [task:157] INFO -  {'uptime': '556', 'memoryTotal': 15466930176, 'memoryFree': 13186424832, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-19 23:58:00,389] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:58:00,390] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:58:00,390] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:58:00,399] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:58:00,409] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:58:00,409] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:58:00,413] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:58:00,414] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:58:00,414] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:58:00,414] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:58:00,482] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:58:00,487] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:00,487] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:01,140] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:01,152] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:58:01,254] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:58:01,255] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:58:01,260] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:58:01,261] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:58:01,264] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:58:01,277] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:58:01,281] - [task:157] INFO -  {'uptime': '553', 'memoryTotal': 15466930176, 'memoryFree': 13012914176, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:58:01,286] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:58:01,295] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:58:01,295] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:58:01,364] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:58:01,370] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:01,370] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:02,056] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:02,068] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:58:02,178] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:58:02,179] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:58:02,184] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:58:02,185] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:58:02,188] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:58:02,201] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:58:02,205] - [task:157] INFO -  {'uptime': '557', 'memoryTotal': 15466930176, 'memoryFree': 13022392320, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:58:02,210] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:58:02,216] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:58:02,216] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:58:02,284] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:58:02,291] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:02,291] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:02,908] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:02,920] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:58:03,026] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:58:03,027] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:58:03,032] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:58:03,032] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:58:03,035] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:58:03,049] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:58:03,054] - [task:157] INFO -  {'uptime': '558', 'memoryTotal': 15466930176, 'memoryFree': 13009317888, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:58:03,058] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:58:03,064] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:58:03,064] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:58:03,131] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:58:03,141] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:03,141] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:03,767] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:03,779] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:58:03,884] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:58:03,884] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:58:03,889] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:58:03,890] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:58:03,893] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:58:03,912] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:58:04,058] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:58:09,063] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:58:09,077] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:58:09,081] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:09,081] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:09,730] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:09,739] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:58:09,843] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:58:09,844] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:58:09,845] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:58:09,928] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:58:09,935] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:58:09,936] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:10,137] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,191] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,382] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:58:10,383] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:10,430] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,481] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,507] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:58:10,508] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:10,553] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,672] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,698] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:58:10,698] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:10,753] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,809] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:10,835] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:58:10,836] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:10,882] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:11,011] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:11,047] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:58:11,047] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:58:11,111] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:11,159] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:11,199] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:58:11,269] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #8 test_multi_create_drop_index ==============
[2020-12-19 23:58:11,290] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:58:11,290] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 20.70829954041633, 'mem_free': 13156134912, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:58:11,291] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:58:11,299] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:58:11,299] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:58:11,299] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:58:16,308] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:58:16,316] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:58:16,317] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:58:16,325] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:58:16,325] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:58:16,334] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:58:16,334] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:58:16,343] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:58:16,365] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:58:16,366] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:58:16,372] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:58:21,382] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:58:21,384] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:21,385] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:22,081] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:23,123] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:58:23,155] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:58:25,846] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:58:25,883] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:58:25,883] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:58:25,883] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-19 23:58:55,918] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:58:55,921] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:58:55,946] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 23.204054ms
[2020-12-19 23:58:55,956] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-19 23:58:55,960] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-19 23:58:56,631] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 669.132619ms
[2020-12-19 23:58:56,638] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:58:56,648] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:58:56,665] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 14.318864ms
[2020-12-19 23:58:56,685] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:58:56,685] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:58:57,434] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:58:57,449] - [base_gsi:246] INFO - []
[2020-12-19 23:58:58,454] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr ON default(join_yr,job_title) USING GSI  WITH {'defer_build': True}
[2020-12-19 23:58:58,458] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr+ON+default%28join_yr%2Cjob_title%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-19 23:58:58,580] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 120.379954ms
[2020-12-19 23:58:58,581] - [base_gsi:202] INFO - BUILD INDEX on default(employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr) USING GSI
[2020-12-19 23:58:59,585] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr) USING GSI
[2020-12-19 23:58:59,590] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr%29+USING+GSI
[2020-12-19 23:58:59,615] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 24.07142ms
[2020-12-19 23:59:00,622] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr'
[2020-12-19 23:59:00,626] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr%27
[2020-12-19 23:59:00,634] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 6.744138ms
[2020-12-19 23:59:01,639] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr'
[2020-12-19 23:59:01,643] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr%27
[2020-12-19 23:59:01,654] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.310466ms
[2020-12-19 23:59:02,659] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr'
[2020-12-19 23:59:02,664] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr%27
[2020-12-19 23:59:02,674] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.342784ms
[2020-12-19 23:59:02,678] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr ON default USING GSI
[2020-12-19 23:59:02,682] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr+ON+default+USING+GSI
[2020-12-19 23:59:02,746] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 61.753978ms
[2020-12-19 23:59:02,751] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr'
[2020-12-19 23:59:02,756] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeefc2f0883103c49f68bbcba95c2b87ae5job_title_join_yr%27
[2020-12-19 23:59:02,760] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.468918ms
[2020-12-19 23:59:02,786] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:59:02,789] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:02,790] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:03,452] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:03,461] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:59:03,462] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-19 23:59:03,563] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:03,573] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:59:03,579] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:03,579] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:04,247] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:04,257] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-19 23:59:04,257] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-19 23:59:04,366] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:04,381] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:59:04,381] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-19 23:59:04,381] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:59:04,385] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-19 23:59:04,390] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-19 23:59:04,401] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.48797ms
[2020-12-19 23:59:04,409] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-19 23:59:04,413] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-19 23:59:04,467] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 51.67923ms
[2020-12-19 23:59:04,484] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:59:04,484] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 14.09818850091888, 'mem_free': 13045985280, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:59:04,484] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:59:04,484] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #8 test_multi_create_drop_index ==============
[2020-12-19 23:59:04,519] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-19 23:59:05,424] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-19 23:59:05,431] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-19 23:59:05,431] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-19 23:59:05,437] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:05,443] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:05,449] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:05,454] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:05,468] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:59:05,468] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:05,472] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:59:05,476] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:59:05,476] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:05,480] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:59:05,484] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:59:05,484] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:05,488] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:59:05,492] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:59:05,493] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:05,496] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:59:05,496] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #8 test_multi_create_drop_index ==============
[2020-12-19 23:59:05,497] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-19 23:59:05,499] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
summary so far suite gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests , pass 2 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_8
ok

----------------------------------------------------------------------
Ran 1 test in 66.130s

OK
test_remove_bucket_and_query (gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_9

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_remove_bucket_and_query,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'simple:and:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 9, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_9'}
[2020-12-19 23:59:05,545] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:05,545] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:06,222] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:06,230] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,242] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-19 23:59:06,252] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-19 23:59:06,252] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #9 test_remove_bucket_and_query==============
[2020-12-19 23:59:06,266] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:06,272] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:06,278] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:06,284] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-19 23:59:06,287] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,303] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-19 23:59:06,303] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,307] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-19 23:59:06,310] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-19 23:59:06,310] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,314] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-19 23:59:06,317] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-19 23:59:06,318] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,323] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-19 23:59:06,327] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-19 23:59:06,327] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-19 23:59:06,332] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-19 23:59:06,334] - [basetestcase:284] INFO - initializing cluster
[2020-12-19 23:59:06,548] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-19 23:59:06,552] - [task:157] INFO -  {'uptime': '623', 'memoryTotal': 15466930176, 'memoryFree': 13045985280, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-19 23:59:06,555] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-19 23:59:06,555] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-19 23:59:06,556] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-19 23:59:06,561] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-19 23:59:06,573] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-19 23:59:06,574] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-19 23:59:06,577] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-19 23:59:06,578] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-19 23:59:06,578] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-19 23:59:06,579] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-19 23:59:06,646] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:59:06,651] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:06,652] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:07,322] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:07,335] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:59:07,463] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:07,465] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:59:07,469] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:59:07,470] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:59:07,472] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:59:07,486] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-19 23:59:07,490] - [task:157] INFO -  {'uptime': '624', 'memoryTotal': 15466930176, 'memoryFree': 13005758464, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:59:07,495] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:59:07,499] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-19 23:59:07,499] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-19 23:59:07,570] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:59:07,576] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:07,577] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:08,212] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:08,224] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:59:08,335] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:08,336] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:59:08,341] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:59:08,341] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:59:08,345] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:59:08,358] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-19 23:59:08,361] - [task:157] INFO -  {'uptime': '623', 'memoryTotal': 15466930176, 'memoryFree': 13071843328, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:59:08,367] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:59:08,373] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-19 23:59:08,373] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-19 23:59:08,442] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:59:08,447] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:08,447] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:09,108] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:09,122] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:59:09,229] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:09,230] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:59:09,236] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:59:09,236] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:59:09,239] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:59:09,252] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-19 23:59:09,256] - [task:157] INFO -  {'uptime': '623', 'memoryTotal': 15466930176, 'memoryFree': 13000916992, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-19 23:59:09,261] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-19 23:59:09,266] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-19 23:59:09,267] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-19 23:59:09,334] - [rest_client:1033] INFO - --> status:True
[2020-12-19 23:59:09,340] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:09,340] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:10,041] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:10,054] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:59:10,166] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:10,167] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:59:10,171] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-19 23:59:10,172] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-19 23:59:10,175] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-19 23:59:10,195] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-19 23:59:10,346] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:59:15,351] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-19 23:59:15,366] - [basetestcase:321] INFO - done initializing cluster
[2020-12-19 23:59:15,371] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:15,372] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:16,061] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:16,072] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-19 23:59:16,187] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-19 23:59:16,188] - [remote_util:5153] INFO - b'ok'
[2020-12-19 23:59:16,189] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-19 23:59:17,213] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-19 23:59:17,222] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-19 23:59:17,223] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:17,610] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:17,707] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:17,737] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-19 23:59:17,737] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:17,789] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:17,837] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:17,863] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-19 23:59:17,863] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:17,986] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,036] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,062] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-19 23:59:18,063] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:18,109] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,156] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,182] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-19 23:59:18,183] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:18,313] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,382] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,421] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-19 23:59:18,422] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-19 23:59:18,474] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,522] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:18,634] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-19 23:59:18,639] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #9 test_remove_bucket_and_query ==============
[2020-12-19 23:59:18,652] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-19 23:59:18,652] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 32.00425305688464, 'mem_free': 13112946688, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-19 23:59:18,653] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-19 23:59:18,665] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-19 23:59:18,666] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-19 23:59:18,666] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:59:23,674] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:59:23,683] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:59:23,683] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:59:23,692] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:59:23,692] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:59:23,703] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-19 23:59:23,703] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-19 23:59:23,709] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:59:23,722] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-19 23:59:23,723] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-19 23:59:23,723] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-19 23:59:28,736] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-19 23:59:28,740] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-19 23:59:28,740] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-19 23:59:29,378] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-19 23:59:30,410] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-19 23:59:30,446] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-19 23:59:33,190] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-19 23:59:33,222] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-19 23:59:33,222] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-19 23:59:33,223] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-20 00:00:03,255] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:00:03,260] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:00:03,287] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 24.685363ms
[2020-12-20 00:00:03,291] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-20 00:00:03,296] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-20 00:00:03,973] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 675.815348ms
[2020-12-20 00:00:03,980] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:00:03,989] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:00:04,014] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 21.935476ms
[2020-12-20 00:00:04,038] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:04,040] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:04,897] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:04,921] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:05,920] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee4130cc56426e4096b573b69283b411d8join_yr ON default(join_yr) USING GSI  WITH {'defer_build': True}
[2020-12-20 00:00:05,925] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee4130cc56426e4096b573b69283b411d8join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-20 00:00:06,064] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 137.668244ms
[2020-12-20 00:00:06,065] - [base_gsi:202] INFO - BUILD INDEX on default(employee4130cc56426e4096b573b69283b411d8join_yr) USING GSI
[2020-12-20 00:00:07,070] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee4130cc56426e4096b573b69283b411d8join_yr) USING GSI
[2020-12-20 00:00:07,074] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee4130cc56426e4096b573b69283b411d8join_yr%29+USING+GSI
[2020-12-20 00:00:07,103] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 22.638292ms
[2020-12-20 00:00:07,116] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee4130cc56426e4096b573b69283b411d8join_yr'
[2020-12-20 00:00:07,122] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee4130cc56426e4096b573b69283b411d8join_yr%27
[2020-12-20 00:00:07,150] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 26.040496ms
[2020-12-20 00:00:08,155] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee4130cc56426e4096b573b69283b411d8join_yr'
[2020-12-20 00:00:08,160] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee4130cc56426e4096b573b69283b411d8join_yr%27
[2020-12-20 00:00:08,171] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.55431ms
[2020-12-20 00:00:09,177] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee4130cc56426e4096b573b69283b411d8join_yr'
[2020-12-20 00:00:09,181] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee4130cc56426e4096b573b69283b411d8join_yr%27
[2020-12-20 00:00:09,193] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.727182ms
[2020-12-20 00:00:10,198] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:00:10,202] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+
[2020-12-20 00:00:10,206] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.72428ms
[2020-12-20 00:00:10,206] - [base_gsi:407] INFO - {'requestID': '6aec4045-3a09-47e9-ab43-ab3aee5a6f31', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee4130cc56426e4096b573b69283b411d8join_yr', 'index_id': '488430db93cac8cd', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '2014', 'inclusion': 0, 'low': '2010'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, {'#operator': 'Order', 'sort_terms': [{'expr': '(`default`.`_id`)'}]}]}, 'text': 'SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id'}], 'status': 'success', 'metrics': {'elapsedTime': '1.72428ms', 'executionTime': '1.625988ms', 'resultCount': 1, 'resultSize': 866, 'serviceLoad': 6}}
[2020-12-20 00:00:10,207] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-20 00:00:10,207] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:00:10,207] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-20 00:00:10,207] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-20 00:00:10,209] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:00:10,209] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:00:10,210] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,"_id" : doc["_id"]}; where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:00:10,210] - [tuq_generators:329] INFO - -->where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:00:10,299] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:00:10,337] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:00:10,341] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+&scan_consistency=request_plus
[2020-12-20 00:00:10,561] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 201.257711ms
[2020-12-20 00:00:10,562] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-20 00:00:10,562] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-20 00:00:12,795] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:12,800] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee4130cc56426e4096b573b69283b411d8join_yr'
[2020-12-20 00:00:12,804] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee4130cc56426e4096b573b69283b411d8join_yr%27
[2020-12-20 00:00:12,809] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 3.946176ms
[2020-12-20 00:00:12,823] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:12,826] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:12,827] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:13,679] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:13,689] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:00:13,689] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-20 00:00:13,804] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:13,816] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:13,821] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:13,821] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:14,561] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:14,571] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:00:14,571] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-20 00:00:14,693] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:14,703] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:14,703] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-20 00:00:14,704] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:00:14,708] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:00:14,712] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:00:14,720] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 6.795911ms
[2020-12-20 00:00:14,727] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:00:14,727] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 19.52235490141627, 'mem_free': 13009453056, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:00:14,728] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:00:14,728] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #9 test_remove_bucket_and_query ==============
[2020-12-20 00:00:14,743] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:14,749] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:14,754] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:14,761] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:14,766] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:14,782] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:00:14,782] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:14,785] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:00:14,790] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:00:14,790] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:14,793] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:00:14,798] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:00:14,798] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:14,803] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:00:14,807] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:00:14,807] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:14,811] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:00:14,811] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #9 test_remove_bucket_and_query ==============
[2020-12-20 00:00:14,811] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-20 00:00:14,814] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
summary so far suite gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests , pass 2 , fail 0
summary so far suite gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests , pass 1 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_9
ok

----------------------------------------------------------------------
Ran 1 test in 69.280s

OK
test_change_bucket_properties (gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_10

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_change_bucket_properties,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'simple:and:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 10, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_10'}
[2020-12-20 00:00:14,859] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:14,859] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:15,645] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:15,653] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,665] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-20 00:00:15,674] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-20 00:00:15,674] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #10 test_change_bucket_properties==============
[2020-12-20 00:00:15,688] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:15,694] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:15,700] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:15,706] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:00:15,710] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,725] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:00:15,725] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,729] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:00:15,733] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:00:15,733] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,736] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:00:15,740] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:00:15,741] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,745] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:00:15,749] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:00:15,750] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:00:15,753] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:00:15,754] - [basetestcase:284] INFO - initializing cluster
[2020-12-20 00:00:15,862] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-20 00:00:15,866] - [task:157] INFO -  {'uptime': '690', 'memoryTotal': 15466930176, 'memoryFree': 13009453056, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-20 00:00:15,869] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-20 00:00:15,869] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-20 00:00:15,869] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-20 00:00:15,878] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-20 00:00:15,892] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-20 00:00:15,893] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-20 00:00:15,896] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-20 00:00:15,897] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-20 00:00:15,898] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-20 00:00:15,898] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-20 00:00:15,968] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:00:15,974] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:15,974] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:16,754] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:16,767] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:00:16,892] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:16,893] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:00:16,898] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:00:16,899] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:00:16,901] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:00:16,916] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-20 00:00:16,920] - [task:157] INFO -  {'uptime': '690', 'memoryTotal': 15466930176, 'memoryFree': 13071503360, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:00:16,925] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:00:16,949] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-20 00:00:16,949] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-20 00:00:17,017] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:00:17,022] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:17,023] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:17,783] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:17,796] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:00:17,932] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:17,934] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:00:17,938] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:00:17,939] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:00:17,942] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:00:17,955] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-20 00:00:17,959] - [task:157] INFO -  {'uptime': '693', 'memoryTotal': 15466930176, 'memoryFree': 12999544832, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:00:17,965] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:00:17,970] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-20 00:00:17,971] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-20 00:00:18,059] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:00:18,064] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:18,064] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:18,829] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:18,842] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:00:18,964] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:18,965] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:00:18,971] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:00:18,971] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:00:18,975] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:00:18,990] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-20 00:00:18,993] - [task:157] INFO -  {'uptime': '694', 'memoryTotal': 15466930176, 'memoryFree': 13012717568, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:00:18,998] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:00:19,004] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-20 00:00:19,004] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-20 00:00:19,074] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:00:19,080] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:19,080] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:19,854] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:19,867] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:00:19,992] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:19,993] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:00:19,998] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:00:19,998] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:00:20,001] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:00:20,021] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-20 00:00:20,153] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:00:25,157] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-20 00:00:25,171] - [basetestcase:321] INFO - done initializing cluster
[2020-12-20 00:00:25,179] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:25,179] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:25,941] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:25,952] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:00:26,080] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:00:26,081] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:00:26,082] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-20 00:00:27,057] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-20 00:00:27,073] - [rest_client:2768] INFO - 0.02 seconds to create bucket default
[2020-12-20 00:00:27,073] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:27,304] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,358] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,397] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-20 00:00:27,398] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:27,449] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,551] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,578] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-20 00:00:27,579] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:27,776] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,827] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,855] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-20 00:00:27,855] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:27,903] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,951] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:27,978] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-20 00:00:27,978] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:28,025] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:28,177] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:28,213] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-20 00:00:28,213] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:00:28,305] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:28,356] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:28,382] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-20 00:00:28,386] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #10 test_change_bucket_properties ==============
[2020-12-20 00:00:28,398] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:00:28,398] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 34.94535519125683, 'mem_free': 13150158848, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:00:28,398] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:00:28,405] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-20 00:00:28,405] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-20 00:00:28,405] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:00:33,416] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:00:33,425] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:00:33,425] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:00:33,434] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:00:33,434] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:00:33,443] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:00:33,443] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:00:33,450] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:33,463] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-20 00:00:33,464] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-20 00:00:33,464] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:00:38,477] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-20 00:00:38,480] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:00:38,480] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:00:39,229] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:00:40,365] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-20 00:00:40,398] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:00:42,940] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-20 00:00:42,972] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:00:42,973] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-20 00:00:42,973] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-20 00:01:12,997] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:01:13,002] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:01:13,027] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 23.730214ms
[2020-12-20 00:01:13,031] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-20 00:01:13,035] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-20 00:01:13,747] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 710.407774ms
[2020-12-20 00:01:13,753] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:01:13,766] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:01:13,797] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 28.607368ms
[2020-12-20 00:01:13,814] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:13,814] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:14,656] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:14,678] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:15,677] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employee138c37e45c24457883c60dfce96de700join_yr ON default(join_yr) USING GSI  WITH {'defer_build': True}
[2020-12-20 00:01:15,681] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employee138c37e45c24457883c60dfce96de700join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-20 00:01:15,821] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 138.185826ms
[2020-12-20 00:01:15,822] - [base_gsi:202] INFO - BUILD INDEX on default(employee138c37e45c24457883c60dfce96de700join_yr) USING GSI
[2020-12-20 00:01:16,827] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employee138c37e45c24457883c60dfce96de700join_yr) USING GSI
[2020-12-20 00:01:16,831] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employee138c37e45c24457883c60dfce96de700join_yr%29+USING+GSI
[2020-12-20 00:01:16,861] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 27.723928ms
[2020-12-20 00:01:16,871] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee138c37e45c24457883c60dfce96de700join_yr'
[2020-12-20 00:01:16,880] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee138c37e45c24457883c60dfce96de700join_yr%27
[2020-12-20 00:01:16,896] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 14.073742ms
[2020-12-20 00:01:17,901] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee138c37e45c24457883c60dfce96de700join_yr'
[2020-12-20 00:01:17,905] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee138c37e45c24457883c60dfce96de700join_yr%27
[2020-12-20 00:01:17,917] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.023957ms
[2020-12-20 00:01:18,922] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee138c37e45c24457883c60dfce96de700join_yr'
[2020-12-20 00:01:18,927] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee138c37e45c24457883c60dfce96de700join_yr%27
[2020-12-20 00:01:18,939] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.600171ms
[2020-12-20 00:01:19,944] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:01:19,948] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+
[2020-12-20 00:01:19,952] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 2.723953ms
[2020-12-20 00:01:19,952] - [base_gsi:407] INFO - {'requestID': '3aa2722b-a08e-4a1b-b2e6-f6396458c7db', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee138c37e45c24457883c60dfce96de700join_yr', 'index_id': '7bb4c60ce0504eec', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '2014', 'inclusion': 0, 'low': '2010'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, {'#operator': 'Order', 'sort_terms': [{'expr': '(`default`.`_id`)'}]}]}, 'text': 'SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id'}], 'status': 'success', 'metrics': {'elapsedTime': '2.723953ms', 'executionTime': '2.647375ms', 'resultCount': 1, 'resultSize': 866, 'serviceLoad': 6}}
[2020-12-20 00:01:19,953] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-20 00:01:19,953] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:19,954] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-20 00:01:19,954] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-20 00:01:19,954] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:19,955] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:19,955] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,"_id" : doc["_id"]}; where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:19,955] - [tuq_generators:329] INFO - -->where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:20,023] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:20,045] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:01:20,050] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+&scan_consistency=request_plus
[2020-12-20 00:01:20,246] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 178.525652ms
[2020-12-20 00:01:20,247] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-20 00:01:20,248] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-20 00:01:21,503] - [rest_client:2812] INFO - http://127.0.0.1:9000/pools/default/buckets/default with param: 
[2020-12-20 00:01:21,510] - [rest_client:2820] INFO - bucket default updated
[2020-12-20 00:01:21,519] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:01:21,525] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+
[2020-12-20 00:01:21,531] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 3.649764ms
[2020-12-20 00:01:21,532] - [base_gsi:407] INFO - {'requestID': '84327894-a67f-4da0-bf75-306322e4f21e', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employee138c37e45c24457883c60dfce96de700join_yr', 'index_id': '7bb4c60ce0504eec', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '2014', 'inclusion': 0, 'low': '2010'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, {'#operator': 'Order', 'sort_terms': [{'expr': '(`default`.`_id`)'}]}]}, 'text': 'SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id'}], 'status': 'success', 'metrics': {'elapsedTime': '3.649764ms', 'executionTime': '3.58023ms', 'resultCount': 1, 'resultSize': 866, 'serviceLoad': 6}}
[2020-12-20 00:01:21,533] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-20 00:01:21,533] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:21,533] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-20 00:01:21,534] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-20 00:01:21,534] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:21,534] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:21,534] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,"_id" : doc["_id"]}; where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:21,534] - [tuq_generators:329] INFO - -->where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:01:21,613] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:01:21,630] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:01:21,634] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+&scan_consistency=request_plus
[2020-12-20 00:01:21,816] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 171.487377ms
[2020-12-20 00:01:21,816] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-20 00:01:21,817] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-20 00:01:23,038] - [tuq_helper:281] INFO - RUN QUERY DROP INDEX employee138c37e45c24457883c60dfce96de700join_yr ON default USING GSI
[2020-12-20 00:01:23,043] - [rest_client:3839] INFO - query params : statement=DROP+INDEX+employee138c37e45c24457883c60dfce96de700join_yr+ON+default+USING+GSI
[2020-12-20 00:01:23,095] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 50.208947ms
[2020-12-20 00:01:23,103] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employee138c37e45c24457883c60dfce96de700join_yr'
[2020-12-20 00:01:23,108] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employee138c37e45c24457883c60dfce96de700join_yr%27
[2020-12-20 00:01:23,124] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 13.85044ms
[2020-12-20 00:01:23,145] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:23,148] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:23,149] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:23,963] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:23,973] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:01:23,973] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-20 00:01:24,102] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:24,120] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:24,125] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:24,126] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:24,919] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:24,929] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:01:24,929] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-20 00:01:25,057] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:25,070] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:25,070] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-20 00:01:25,071] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:01:25,075] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:01:25,079] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:01:25,090] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 10.07406ms
[2020-12-20 00:01:25,095] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:01:25,099] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-20 00:01:25,154] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 53.366373ms
[2020-12-20 00:01:25,169] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:01:25,169] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 18.90733797536154, 'mem_free': 12995629056, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:01:25,169] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:01:25,170] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #10 test_change_bucket_properties ==============
[2020-12-20 00:01:25,201] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-20 00:01:26,576] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-20 00:01:26,579] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-20 00:01:26,579] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-20 00:01:26,586] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:26,592] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:26,599] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:26,604] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:26,618] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:01:26,619] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:26,623] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:01:26,627] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:01:26,627] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:26,631] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:01:26,638] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:01:26,638] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:26,644] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:01:26,650] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:01:26,651] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:26,655] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:01:26,655] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #10 test_change_bucket_properties ==============
[2020-12-20 00:01:26,655] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-20 00:01:26,658] - [basetestcase:593] INFO - closing all memcached connections
Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
summary so far suite gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests , pass 2 , fail 0
summary so far suite gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests , pass 2 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_10
ok

----------------------------------------------------------------------
Ran 1 test in 71.822s

OK
test_delete_create_bucket_and_query (gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests) ... Logs will be stored at /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_11

./testrunner -i b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini -p makefile=True -t gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query,groups=simple:and:no_orderby_groupby:range,dataset=default,doc-per-day=1,use_gsi_for_primary=True,use_gsi_for_secondary=True,GROUP=gsi

Test Input params:
{'groups': 'simple:and:no_orderby_groupby:range', 'dataset': 'default', 'doc-per-day': '1', 'use_gsi_for_primary': 'True', 'use_gsi_for_secondary': 'True', 'GROUP': 'gsi', 'ini': 'b/resources/dev-4-nodes-xdcr_n1ql_gsi.ini', 'cluster_name': 'dev-4-nodes-xdcr_n1ql_gsi', 'spec': 'simple_gsi_n1ql', 'conf_file': 'conf/simple_gsi_n1ql.conf', 'gsi_type': 'forestdb', 'makefile': 'True', 'num_nodes': 4, 'case_number': 11, 'logs_folder': '/opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_11'}
[2020-12-20 00:01:26,717] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:26,717] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:27,486] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:27,494] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,506] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-20 00:01:27,515] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-20 00:01:27,515] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #11 test_delete_create_bucket_and_query==============
[2020-12-20 00:01:27,530] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:27,536] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:27,541] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:27,547] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:01:27,551] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,566] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:01:27,567] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,571] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:01:27,575] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:01:27,575] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,578] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:01:27,584] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:01:27,585] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,590] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:01:27,594] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:01:27,594] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:01:27,599] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:01:27,600] - [basetestcase:284] INFO - initializing cluster
[2020-12-20 00:01:27,721] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-20 00:01:27,725] - [task:157] INFO -  {'uptime': '764', 'memoryTotal': 15466930176, 'memoryFree': 12995629056, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 2016}
[2020-12-20 00:01:27,728] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-20 00:01:27,728] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-20 00:01:27,728] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-20 00:01:27,742] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-20 00:01:27,751] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-20 00:01:27,751] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-20 00:01:27,756] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-20 00:01:27,757] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-20 00:01:27,758] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-20 00:01:27,758] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-20 00:01:27,830] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:01:27,836] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:27,836] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:28,630] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:28,643] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:01:28,772] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:28,773] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:01:28,779] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:01:28,780] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:01:28,782] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:01:28,797] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-20 00:01:28,804] - [task:157] INFO -  {'uptime': '761', 'memoryTotal': 15466930176, 'memoryFree': 13072519168, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:01:28,810] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:01:28,822] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-20 00:01:28,822] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-20 00:01:28,904] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:01:28,910] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:28,911] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:29,705] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:29,718] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:01:29,845] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:29,846] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:01:29,851] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:01:29,851] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:01:29,855] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:01:29,869] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-20 00:01:29,873] - [task:157] INFO -  {'uptime': '764', 'memoryTotal': 15466930176, 'memoryFree': 12991193088, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:01:29,878] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:01:29,883] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-20 00:01:29,884] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-20 00:01:29,956] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:01:29,962] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:29,962] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:30,758] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:30,774] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:01:30,906] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:30,907] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:01:30,912] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:01:30,913] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:01:30,916] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:01:30,931] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-20 00:01:30,935] - [task:157] INFO -  {'uptime': '765', 'memoryTotal': 15466930176, 'memoryFree': 12999639040, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:01:30,940] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:01:30,945] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-20 00:01:30,945] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-20 00:01:31,020] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:01:31,026] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:31,027] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:31,801] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:31,814] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:01:31,943] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:31,944] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:01:31,950] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:01:31,950] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:01:31,953] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:01:31,973] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-20 00:01:32,106] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:01:37,109] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-20 00:01:37,123] - [basetestcase:321] INFO - done initializing cluster
[2020-12-20 00:01:37,129] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:37,129] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:37,912] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:37,922] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:01:38,067] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:01:38,068] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:01:38,068] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-20 00:01:39,038] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-20 00:01:39,052] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-20 00:01:39,053] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:39,287] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,364] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,578] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-20 00:01:39,578] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:39,626] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,674] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,701] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-20 00:01:39,702] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:39,758] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,805] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:39,926] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-20 00:01:39,927] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:39,978] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,031] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,062] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-20 00:01:40,062] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:40,119] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,186] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,315] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-20 00:01:40,315] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:01:40,394] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,459] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:40,487] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-20 00:01:40,490] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #11 test_delete_create_bucket_and_query ==============
[2020-12-20 00:01:40,504] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:01:40,504] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 33.50814242340601, 'mem_free': 13150810112, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:01:40,504] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:01:40,512] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-20 00:01:40,512] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-20 00:01:40,513] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:01:45,521] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:01:45,529] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:01:45,529] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:01:45,538] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:01:45,538] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:01:45,548] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:01:45,548] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:01:45,555] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:45,577] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-20 00:01:45,578] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-20 00:01:45,579] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:01:50,589] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-20 00:01:50,592] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:01:50,592] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:01:51,363] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:01:52,525] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-20 00:01:52,559] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:01:55,284] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-20 00:01:55,315] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:01:55,316] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-20 00:01:55,316] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-20 00:02:25,347] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:02:25,352] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:02:25,378] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 24.384789ms
[2020-12-20 00:02:25,383] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-20 00:02:25,387] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-20 00:02:26,071] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 682.768706ms
[2020-12-20 00:02:26,081] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:02:26,088] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:02:26,113] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 22.066349ms
[2020-12-20 00:02:26,136] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:26,137] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:27,017] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:27,037] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:28,037] - [tuq_helper:281] INFO - RUN QUERY CREATE INDEX employeeb44da7440e7b453d8c1c32c9af534ba0join_yr ON default(join_yr) USING GSI  WITH {'defer_build': True}
[2020-12-20 00:02:28,041] - [rest_client:3839] INFO - query params : statement=CREATE+INDEX+employeeb44da7440e7b453d8c1c32c9af534ba0join_yr+ON+default%28join_yr%29+USING+GSI++WITH+%7B%27defer_build%27%3A+True%7D
[2020-12-20 00:02:28,177] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 133.507758ms
[2020-12-20 00:02:28,177] - [base_gsi:202] INFO - BUILD INDEX on default(employeeb44da7440e7b453d8c1c32c9af534ba0join_yr) USING GSI
[2020-12-20 00:02:29,182] - [tuq_helper:281] INFO - RUN QUERY BUILD INDEX on default(employeeb44da7440e7b453d8c1c32c9af534ba0join_yr) USING GSI
[2020-12-20 00:02:29,189] - [rest_client:3839] INFO - query params : statement=BUILD+INDEX+on+default%28employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%29+USING+GSI
[2020-12-20 00:02:29,208] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 17.792409ms
[2020-12-20 00:02:29,220] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr'
[2020-12-20 00:02:29,226] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%27
[2020-12-20 00:02:29,244] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 15.693382ms
[2020-12-20 00:02:30,250] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr'
[2020-12-20 00:02:30,254] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%27
[2020-12-20 00:02:30,265] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.2212ms
[2020-12-20 00:02:31,271] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr'
[2020-12-20 00:02:31,275] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%27
[2020-12-20 00:02:31,284] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 7.073609ms
[2020-12-20 00:02:32,291] - [tuq_helper:281] INFO - RUN QUERY EXPLAIN SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:02:32,295] - [rest_client:3839] INFO - query params : statement=EXPLAIN+SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+
[2020-12-20 00:02:32,299] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 2.219165ms
[2020-12-20 00:02:32,299] - [base_gsi:407] INFO - {'requestID': '1280cee6-0501-4c78-86f6-58ee36ee7e54', 'signature': 'json', 'results': [{'plan': {'#operator': 'Sequence', '~children': [{'#operator': 'Sequence', '~children': [{'#operator': 'IndexScan3', 'index': 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr', 'index_id': '3a2ea33f36f42c64', 'index_projection': {'primary_key': True}, 'keyspace': 'default', 'namespace': 'default', 'spans': [{'exact': True, 'range': [{'high': '2014', 'inclusion': 0, 'low': '2010'}]}], 'using': 'gsi'}, {'#operator': 'Fetch', 'keyspace': 'default', 'namespace': 'default'}, {'#operator': 'Parallel', '~child': {'#operator': 'Sequence', '~children': [{'#operator': 'Filter', 'condition': '((2010 < (`default`.`join_yr`)) and ((`default`.`join_yr`) < 2014))'}, {'#operator': 'InitialProject', 'result_terms': [{'expr': 'self', 'star': True}]}]}}]}, {'#operator': 'Order', 'sort_terms': [{'expr': '(`default`.`_id`)'}]}]}, 'text': 'SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id'}], 'status': 'success', 'metrics': {'elapsedTime': '2.219165ms', 'executionTime': '2.128067ms', 'resultCount': 1, 'resultSize': 866, 'serviceLoad': 6}}
[2020-12-20 00:02:32,300] - [tuq_generators:70] INFO - FROM clause ===== is default
[2020-12-20 00:02:32,300] - [tuq_generators:72] INFO - WHERE clause ===== is   doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:02:32,300] - [tuq_generators:74] INFO - UNNEST clause ===== is None
[2020-12-20 00:02:32,300] - [tuq_generators:76] INFO - SELECT clause ===== is {"*" : doc,}
[2020-12-20 00:02:32,301] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:02:32,301] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:02:32,301] - [tuq_generators:326] INFO - -->select_clause:{"*" : doc,"_id" : doc["_id"]}; where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:02:32,301] - [tuq_generators:329] INFO - -->where_clause=  doc["join_yr"] > 2010 and doc["join_yr"] < 2014 
[2020-12-20 00:02:32,366] - [tuq_generators:419] INFO - ORDER clause ========= is doc["_id"],
[2020-12-20 00:02:32,387] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM default WHERE  join_yr > 2010 and join_yr < 2014 ORDER BY _id 
[2020-12-20 00:02:32,391] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+default+WHERE++join_yr+%3E+2010+and+join_yr+%3C+2014+ORDER+BY+_id+&scan_consistency=request_plus
[2020-12-20 00:02:32,572] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 163.572423ms
[2020-12-20 00:02:32,572] - [tuq_helper:362] INFO -  Analyzing Actual Result
[2020-12-20 00:02:32,573] - [tuq_helper:364] INFO -  Analyzing Expected Result
[2020-12-20 00:02:34,557] - [basetestcase:645] INFO - sleep for 2 secs.  ...
[2020-12-20 00:02:36,856] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-20 00:02:36,866] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-20 00:02:36,866] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:37,064] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,124] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,155] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-20 00:02:37,155] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:37,209] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,292] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,482] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-20 00:02:37,482] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:37,528] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,577] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,604] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-20 00:02:37,604] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:37,655] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,702] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,727] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-20 00:02:37,727] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:37,774] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,928] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:37,968] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-20 00:02:37,968] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:38,038] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:38,088] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:38,113] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-20 00:02:38,117] - [basetestcase:645] INFO - sleep for 2 secs.  ...
[2020-12-20 00:02:40,123] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:02:40,123] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:40,127] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:02:40,132] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:02:40,132] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:40,135] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:02:40,140] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:02:40,140] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:40,143] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:02:40,147] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:02:40,148] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:40,151] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:02:40,161] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:40,165] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr'
[2020-12-20 00:02:40,169] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%27
[2020-12-20 00:02:40,205] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 33.133721ms
[2020-12-20 00:02:40,210] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = 'employeeb44da7440e7b453d8c1c32c9af534ba0join_yr'
[2020-12-20 00:02:40,214] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27employeeb44da7440e7b453d8c1c32c9af534ba0join_yr%27
[2020-12-20 00:02:40,217] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.261542ms
[2020-12-20 00:02:40,223] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:40,240] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:40,243] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:40,243] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:41,090] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:41,100] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:02:41,100] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-20 00:02:41,230] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:41,244] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:41,247] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:41,248] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:42,061] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:42,071] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:02:42,071] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-20 00:02:42,206] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:42,216] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:02:42,216] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-20 00:02:42,216] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:02:42,220] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:02:42,224] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:02:42,235] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 9.274731ms
[2020-12-20 00:02:42,236] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:02:42,240] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:02:42,243] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:02:42,246] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 1.204396ms
[2020-12-20 00:02:42,255] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:02:42,256] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 16.98212407991588, 'mem_free': 12881920000, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:02:42,256] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:02:42,256] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #11 test_delete_create_bucket_and_query ==============
[2020-12-20 00:02:42,280] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-20 00:02:42,677] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-20 00:02:42,680] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-20 00:02:42,681] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-20 00:02:42,686] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:42,693] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:42,698] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:42,703] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:42,719] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:02:42,720] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:42,723] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:02:42,727] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:02:42,727] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:42,733] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:02:42,736] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:02:42,736] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:42,740] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:02:42,744] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:02:42,744] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:42,748] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:02:42,748] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #11 test_delete_create_bucket_and_query ==============
[2020-12-20 00:02:42,748] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-20 00:02:42,751] - [basetestcase:593] INFO - closing all memcached connections
ok

----------------------------------------------------------------------
Ran 1 test in 76.044s

OK
suite_tearDown (gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests) ... Cluster instance shutdown with force
summary so far suite gsi.indexscans_gsi.SecondaryIndexingScanTests , pass 6 , fail 0
summary so far suite gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests , pass 2 , fail 0
summary so far suite gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests , pass 3 , fail 0
testrunner logs, diags and results are available under /opt/build/testrunner/logs/testrunner-20-Dec-19_23-48-40/test_11

*** Tests executed count: 11

Run after suite setup for gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query
[2020-12-20 00:02:42,765] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:42,766] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:43,577] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:43,585] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,597] - [rest_client:2381] INFO - Node version in cluster 7.0.0-3874-rel-enterprise
[2020-12-20 00:02:43,605] - [rest_client:2391] INFO - Node versions in cluster ['7.0.0-3874-rel-enterprise']
[2020-12-20 00:02:43,605] - [basetestcase:232] INFO - ==============  basetestcase setup was started for test #11 suite_tearDown==============
[2020-12-20 00:02:43,619] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:43,625] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:43,633] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:43,643] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:02:43,648] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,668] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:02:43,668] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,673] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:02:43,677] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:02:43,678] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,681] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:02:43,684] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:02:43,685] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,688] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:02:43,693] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:02:43,693] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:02:43,697] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:02:43,698] - [basetestcase:284] INFO - initializing cluster
[2020-12-20 00:02:43,768] - [task:152] INFO - server: ip:127.0.0.1 port:9000 ssh_username:Administrator, nodes/self 
[2020-12-20 00:02:43,772] - [task:157] INFO -  {'uptime': '840', 'memoryTotal': 15466930176, 'memoryFree': 13060997120, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9000', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7650, 'moxi': 11211, 'memcached': 12000, 'id': 'n_0@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9000', 'services': ['index', 'kv', 'n1ql'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:02:43,775] - [task:196] INFO - quota for index service will be 256 MB
[2020-12-20 00:02:43,775] - [task:198] INFO - set index quota to node 127.0.0.1 
[2020-12-20 00:02:43,775] - [rest_client:1140] INFO - pools/default params : indexMemoryQuota=256
[2020-12-20 00:02:43,783] - [rest_client:1128] INFO - pools/default params : memoryQuota=7650
[2020-12-20 00:02:43,795] - [rest_client:1089] INFO - --> init_node_services(Administrator,asdasd,127.0.0.1,9000,['kv', 'index', 'n1ql'])
[2020-12-20 00:02:43,796] - [rest_client:1105] INFO - /node/controller/setupServices params on 127.0.0.1: 9000:hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql
[2020-12-20 00:02:43,799] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000//node/controller/setupServices body: hostname=127.0.0.1%3A9000&user=Administrator&password=asdasd&services=kv%2Cindex%2Cn1ql headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:asdasd
[2020-12-20 00:02:43,800] - [rest_client:1111] INFO - This node is already provisioned with services, we do not consider this as failure for test case
[2020-12-20 00:02:43,800] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9000
[2020-12-20 00:02:43,800] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9000:port=9000&username=Administrator&password=asdasd
[2020-12-20 00:02:43,868] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:02:43,873] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:43,874] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:44,670] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:44,684] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:02:44,820] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:44,821] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:02:44,828] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:02:44,828] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:02:44,833] - [rest_client:1005] ERROR - POST http://127.0.0.1:9000/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:02:44,847] - [task:152] INFO - server: ip:127.0.0.1 port:9001 ssh_username:Administrator, nodes/self 
[2020-12-20 00:02:44,851] - [task:157] INFO -  {'uptime': '837', 'memoryTotal': 15466930176, 'memoryFree': 12906340352, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9001', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12002, 'id': 'n_1@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9001', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:02:44,856] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:02:44,861] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9001
[2020-12-20 00:02:44,862] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9001:port=9001&username=Administrator&password=asdasd
[2020-12-20 00:02:44,938] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:02:44,943] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:44,944] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:45,746] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:45,758] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9001/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:02:45,889] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:45,890] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:02:45,895] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9001: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:02:45,895] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:02:45,898] - [rest_client:1005] ERROR - POST http://127.0.0.1:9001/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:02:45,912] - [task:152] INFO - server: ip:127.0.0.1 port:9002 ssh_username:Administrator, nodes/self 
[2020-12-20 00:02:45,915] - [task:157] INFO -  {'uptime': '840', 'memoryTotal': 15466930176, 'memoryFree': 13049540608, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9002', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12004, 'id': 'n_2@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9002', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:02:45,920] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:02:45,924] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9002
[2020-12-20 00:02:45,925] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9002:port=9002&username=Administrator&password=asdasd
[2020-12-20 00:02:46,003] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:02:46,007] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:46,007] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:46,787] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:46,799] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9002/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:02:46,929] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:46,930] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:02:46,936] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9002: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:02:46,936] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:02:46,939] - [rest_client:1005] ERROR - POST http://127.0.0.1:9002/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:02:46,951] - [task:152] INFO - server: ip:127.0.0.1 port:9003 ssh_username:Administrator, nodes/self 
[2020-12-20 00:02:46,955] - [task:157] INFO -  {'uptime': '841', 'memoryTotal': 15466930176, 'memoryFree': 12904456192, 'mcdMemoryReserved': 11800, 'mcdMemoryAllocated': 11800, 'status': 'healthy', 'hostname': '127.0.0.1:9003', 'clusterCompatibility': 458752, 'clusterMembership': 'active', 'recoveryType': 'none', 'version': '7.0.0-3874-rel-enterprise', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 7906, 'moxi': 11211, 'memcached': 12006, 'id': 'n_3@cb.local', 'ip': '127.0.0.1', 'rest_username': '', 'rest_password': '', 'port': '9003', 'services': ['kv'], 'storageTotalRam': 14750, 'curr_items': 0}
[2020-12-20 00:02:46,960] - [rest_client:1128] INFO - pools/default params : memoryQuota=7906
[2020-12-20 00:02:46,965] - [rest_client:1026] INFO - --> in init_cluster...Administrator,asdasd,9003
[2020-12-20 00:02:46,966] - [rest_client:1031] INFO - settings/web params on 127.0.0.1:9003:port=9003&username=Administrator&password=asdasd
[2020-12-20 00:02:47,039] - [rest_client:1033] INFO - --> status:True
[2020-12-20 00:02:47,043] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:47,043] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:47,845] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:47,856] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9003/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:02:47,986] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:47,987] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:02:47,991] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9003: True content: [7,0] command: cluster_compat_mode:get_compat_version().
[2020-12-20 00:02:47,992] - [rest_client:1163] INFO - settings/indexes params : storageMode=forestdb
[2020-12-20 00:02:47,995] - [rest_client:1005] ERROR - POST http://127.0.0.1:9003/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}}' auth: Administrator:asdasd
[2020-12-20 00:02:48,013] - [basetestcase:2369] INFO - **** add built-in 'cbadminbucket' user to node 127.0.0.1 ****
[2020-12-20 00:02:48,141] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:02:53,144] - [basetestcase:2374] INFO - **** add 'admin' role to 'cbadminbucket' user ****
[2020-12-20 00:02:53,158] - [basetestcase:321] INFO - done initializing cluster
[2020-12-20 00:02:53,164] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:02:53,165] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:02:53,937] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:02:53,948] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: curl --silent --show-error http://Administrator:asdasd@localhost:9000/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).'
[2020-12-20 00:02:54,083] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:02:54,084] - [remote_util:5153] INFO - b'ok'
[2020-12-20 00:02:54,084] - [basetestcase:2928] INFO - Enabled diag/eval for non-local hosts from 127.0.0.1
[2020-12-20 00:02:55,057] - [rest_client:2743] INFO - http://127.0.0.1:9000/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=7650&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly&compressionMode=passive&storageBackend=couchstore
[2020-12-20 00:02:55,065] - [rest_client:2768] INFO - 0.01 seconds to create bucket default
[2020-12-20 00:02:55,066] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:55,277] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,548] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,575] - [task:386] WARNING - vbucket map not ready after try 0
[2020-12-20 00:02:55,575] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:55,622] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,678] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,705] - [task:386] WARNING - vbucket map not ready after try 1
[2020-12-20 00:02:55,705] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:55,754] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,804] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:55,832] - [task:386] WARNING - vbucket map not ready after try 2
[2020-12-20 00:02:55,832] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:55,990] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,037] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,063] - [task:386] WARNING - vbucket map not ready after try 3
[2020-12-20 00:02:56,063] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:56,112] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,172] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,201] - [task:386] WARNING - vbucket map not ready after try 4
[2020-12-20 00:02:56,202] - [bucket_helper:344] INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops
[2020-12-20 00:02:56,265] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,418] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:02:56,455] - [task:386] WARNING - vbucket map not ready after try 5
[2020-12-20 00:02:56,457] - [basetestcase:422] INFO - ==============  basetestcase setup was finished for test #11 suite_tearDown ==============
[2020-12-20 00:02:56,474] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:02:56,475] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 30.00824402308326, 'mem_free': 13103849472, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:02:56,475] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:02:56,482] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is warmup
[2020-12-20 00:02:56,482] - [newtuq:23] INFO - Waiting for cluster to become healthy
[2020-12-20 00:02:56,482] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:03:01,493] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:03:01,503] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:03:01,503] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:03:01,518] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:03:01,518] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:03:01,527] - [newtuq:21] INFO - Initial status of 127.0.0.1 cluster is healthy
[2020-12-20 00:03:01,527] - [newtuq:26] INFO - current status of 127.0.0.1  is healthy
[2020-12-20 00:03:01,535] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:01,551] - [rest_client:1891] INFO - {'indexer.settings.storage_mode': 'forestdb'} set
[2020-12-20 00:03:01,551] - [newtuq:36] INFO - Allowing the indexer to complete restart after setting the internal settings
[2020-12-20 00:03:01,552] - [basetestcase:645] INFO - sleep for 5 secs.  ...
[2020-12-20 00:03:06,561] - [rest_client:1891] INFO - {'indexer.api.enableTestServer': True} set
[2020-12-20 00:03:06,565] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:03:06,565] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:03:07,382] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:03:08,483] - [basetestcase:2699] INFO - create 2016.0 to default documents...
[2020-12-20 00:03:08,516] - [data_helper:314] INFO - creating direct client 127.0.0.1:12000 default
[2020-12-20 00:03:11,006] - [basetestcase:2712] INFO - LOAD IS FINISHED
[2020-12-20 00:03:11,041] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:11,041] - [newtuq:94] INFO - ip:127.0.0.1 port:9000 ssh_username:Administrator
[2020-12-20 00:03:11,042] - [basetestcase:645] INFO - sleep for 30 secs.  ...
[2020-12-20 00:03:41,054] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:03:41,058] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:03:41,082] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 22.040306ms
[2020-12-20 00:03:41,086] - [tuq_helper:281] INFO - RUN QUERY CREATE PRIMARY INDEX ON default  USING GSI
[2020-12-20 00:03:41,090] - [rest_client:3839] INFO - query params : statement=CREATE+PRIMARY+INDEX+ON+default++USING+GSI
[2020-12-20 00:03:41,707] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 615.342633ms
[2020-12-20 00:03:41,713] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:03:41,721] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:03:41,748] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 25.425374ms
[2020-12-20 00:03:41,775] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:03:41,775] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:03:42,667] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:03:42,690] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:42,709] - [basetestcase:2590] INFO - list of index nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:42,712] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:03:42,712] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:03:43,513] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:03:43,523] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:03:43,524] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/indexer.log* | wc -l
[2020-12-20 00:03:43,649] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:03:43,659] - [basetestcase:2590] INFO - list of kv nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:43,664] - [remote_util:298] INFO - SSH Connecting to 127.0.0.1 with username:Administrator, attempt#1 of 5
[2020-12-20 00:03:43,664] - [remote_util:336] INFO - SSH Connected to 127.0.0.1 as Administrator
[2020-12-20 00:03:44,501] - [remote_util:3711] INFO - extract_remote_info-->distribution_type: linux, distribution_version: default
[2020-12-20 00:03:44,510] - [rest_client:1706] INFO - /diag/eval status on 127.0.0.1:9000: True content: "/opt/build/ns_server/logs/n_0" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2020-12-20 00:03:44,511] - [remote_util:3395] INFO - running command.raw on 127.0.0.1: zgrep "panic" "/opt/build/ns_server/logs/n_0"/projector.log* | wc -l
[2020-12-20 00:03:44,644] - [remote_util:3443] INFO - command executed successfully with Administrator
[2020-12-20 00:03:44,657] - [basetestcase:2590] INFO - list of n1ql nodes in cluster: [ip:127.0.0.1 port:9000 ssh_username:Administrator]
[2020-12-20 00:03:44,658] - [tuq_helper:673] INFO - CHECK FOR PRIMARY INDEXES
[2020-12-20 00:03:44,658] - [tuq_helper:680] INFO - DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:03:44,662] - [tuq_helper:281] INFO - RUN QUERY SELECT * FROM system:indexes where name = '#primary'
[2020-12-20 00:03:44,666] - [rest_client:3839] INFO - query params : statement=SELECT+%2A+FROM+system%3Aindexes+where+name+%3D+%27%23primary%27
[2020-12-20 00:03:44,676] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 8.680911ms
[2020-12-20 00:03:44,680] - [tuq_helper:281] INFO - RUN QUERY DROP PRIMARY INDEX ON default USING GSI
[2020-12-20 00:03:44,684] - [rest_client:3839] INFO - query params : statement=DROP+PRIMARY+INDEX+ON+default+USING+GSI
[2020-12-20 00:03:44,723] - [tuq_helper:303] INFO - TOTAL ELAPSED TIME: 36.718211ms
[2020-12-20 00:03:44,745] - [basetestcase:460] INFO - ------- Cluster statistics -------
[2020-12-20 00:03:44,745] - [basetestcase:462] INFO - 127.0.0.1:9000 => {'services': ['index', 'kv', 'n1ql'], 'cpu_utilization': 3.167653875869173, 'mem_free': 13071962112, 'mem_total': 15466930176, 'swap_mem_used': 0, 'swap_mem_total': 0}
[2020-12-20 00:03:44,745] - [basetestcase:463] INFO - --- End of cluster statistics ---
[2020-12-20 00:03:44,746] - [basetestcase:547] INFO - ==============  basetestcase cleanup was started for test #11 suite_tearDown ==============
[2020-12-20 00:03:44,787] - [bucket_helper:142] INFO - deleting existing buckets ['default'] on 127.0.0.1
[2020-12-20 00:03:45,533] - [bucket_helper:233] INFO - waiting for bucket deletion to complete....
[2020-12-20 00:03:45,536] - [rest_client:137] INFO - node 127.0.0.1 existing buckets : []
[2020-12-20 00:03:45,536] - [bucket_helper:165] INFO - deleted bucket : default from 127.0.0.1
[2020-12-20 00:03:45,542] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:03:45,548] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:03:45,554] - [bucket_helper:167] INFO - Could not find any buckets for node 127.0.0.1, nothing to delete
[2020-12-20 00:03:45,559] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:03:45,573] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9000
[2020-12-20 00:03:45,574] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:03:45,578] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9000 is running
[2020-12-20 00:03:45,582] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9001
[2020-12-20 00:03:45,582] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:03:45,586] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9001 is running
[2020-12-20 00:03:45,590] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9002
[2020-12-20 00:03:45,590] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:03:45,594] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9002 is running
[2020-12-20 00:03:45,598] - [cluster_helper:82] INFO - waiting for ns_server @ 127.0.0.1:9003
[2020-12-20 00:03:45,598] - [rest_client:41] INFO - -->is_ns_server_running?
[2020-12-20 00:03:45,602] - [cluster_helper:86] INFO - ns_server @ 127.0.0.1:9003 is running
[2020-12-20 00:03:45,602] - [basetestcase:571] INFO - ==============  basetestcase cleanup was finished for test #11 suite_tearDown ==============
[2020-12-20 00:03:45,602] - [basetestcase:588] INFO - closing all ssh connections
[2020-12-20 00:03:45,605] - [basetestcase:593] INFO - closing all memcached connections
ok

----------------------------------------------------------------------
Ran 1 test in 62.882s

OK
Cluster instance shutdown with force
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexscans_gsi.SecondaryIndexingScanTests.test_multi_create_query_explain_drop_index', ' pass')
('gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests.test_multi_create_drop_index', ' pass')
('gsi.indexcreatedrop_gsi.SecondaryIndexingCreateDropTests.test_multi_create_drop_index', ' pass')
('gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_remove_bucket_and_query', ' pass')
('gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_change_bucket_properties', ' pass')
('gsi.cluster_ops_gsi.SecondaryIndexingClusterOpsTests.test_delete_create_bucket_and_query', ' pass')
During the test, Remote Connections: 0, Disconnections: 949
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
('Thread', , 'was not properly terminated, will be terminated now.')
Shutting down the thread...
*** TestRunner ***
scripts/start_cluster_and_run_tests.sh: line 85:  3567 Terminated              COUCHBASE_NUM_VBUCKETS=64 python ./cluster_run --nodes=$servers_count &> $wd/cluster_run.log  (wd: /opt/build/ns_server)
Testing Failed: Required test failed
FAIL	github.com/couchbase/indexing/secondary/tests/functionaltests	6799.309s
--- FAIL: TestResetCluster_1 (15.07s)
Version: versions-19.12.2020-20.37.cfg
Build Log: make-19.12.2020-20.37.log
Server Log: logs-19.12.2020-20.37.tar.gz
Finished