2015-11-29T18:28:10.212-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T18:28:10.245-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T18:28:10.248-08:00 [Info] Setting maxcpus = 4 2015-11-29T18:28:10.248-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T18:28:10.248-08:00 [Info] Setting log level to Info 2015-11-29T18:28:10.248-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T18:28:10.31-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T18:28:10.314-08:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.log_level":"info","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2015-11-29T18:28:10.314-08:00 [Info] Setting maxcpus = 4 2015-11-29T18:28:10.314-08:00 [Info] Setting log level to Info 2015-11-29T18:28:13.524-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T18:28:13.524-08:00 [Info] ClustMgr:handleSetLocalValue Key IndexerId Value 1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.555-08:00 [Info] Indexer Id 1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.6-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.602-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.602-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:28:13.602-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.602-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.604-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.604-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:28:13.604-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.604-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.605-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.605-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:28:13.605-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.605-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.607-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.607-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:28:13.607-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.648-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.648-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.648-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:28:13.648-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.648-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.649-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.649-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:28:13.649-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.649-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.65-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.65-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:28:13.65-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.65-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:13.65-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:13.651-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:28:13.651-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:13.651-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T18:28:13.651-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T18:28:13.651-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T18:28:13.651-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T18:28:13.651-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T18:28:13.651-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T18:28:13.651-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T18:28:20.183-08:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.log_level":"info","indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2015-11-29T18:28:20.184-08:00 [Info] Setting maxcpus = 4 2015-11-29T18:28:20.184-08:00 [Info] Setting log level to Info 2015-11-29T18:28:20.184-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T18:28:20.254-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T18:28:20.255-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:28:20.255-08:00 [Info] Setting log level to Info 2015-11-29T18:28:20.255-08:00 [Info] CompactionManager: Refreshing settings [goport] 2015/11/29 18:28:20 got new line on a stdin; terminating. 2015-11-29T18:28:30.737-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T18:28:30.77-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T18:28:30.785-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:28:30.785-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T18:28:30.785-08:00 [Info] Setting log level to Info 2015-11-29T18:28:30.785-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T18:28:30.849-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T18:28:30.853-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T18:28:30.854-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:28:30.854-08:00 [Info] Setting log level to Info 2015-11-29T18:28:33.98-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T18:28:33.981-08:00 [Info] Indexer Id 1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.013-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.015-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.015-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:28:34.015-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.015-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.017-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.017-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:28:34.017-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.017-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.019-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.019-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:28:34.019-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.019-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.02-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.02-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:28:34.02-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.047-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.048-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.048-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:28:34.048-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.048-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.048-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.049-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:28:34.049-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.049-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.049-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.049-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:28:34.049-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.049-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:28:34.05-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:28:34.05-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:28:34.05-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:28:34.05-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T18:28:34.05-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T18:28:34.05-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T18:28:34.05-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T18:28:34.05-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T18:28:34.05-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T18:28:34.051-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T18:29:33.981-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":143360,"needs_restart":false,"num_connections":0,"timings/stats_response":"65 4230912 346260663526"} [goport] 2015/11/29 18:30:29 got new line on a stdin; terminating. 2015-11-29T18:30:41.139-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T18:30:41.169-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T18:30:41.215-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:30:41.215-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T18:30:41.215-08:00 [Info] Setting log level to Info 2015-11-29T18:30:41.219-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T18:30:41.289-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T18:30:41.289-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T18:30:41.29-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:30:41.29-08:00 [Info] Setting log level to Info 2015-11-29T18:30:44.308-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T18:30:44.308-08:00 [Info] Indexer Id 1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.343-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.344-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.344-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:30:44.344-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.344-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.346-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.346-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:30:44.346-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.346-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.347-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.347-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:30:44.347-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.347-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.348-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.348-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:30:44.348-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.382-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.382-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.382-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:30:44.382-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.382-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.383-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.383-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:30:44.383-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.383-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.384-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.384-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:30:44.384-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.384-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:44.384-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:44.384-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:30:44.384-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:44.384-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T18:30:44.384-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T18:30:44.385-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T18:30:44.385-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T18:30:44.385-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T18:30:44.385-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T18:30:44.385-08:00 [Info] CompactionManager: Refreshing settings [goport] 2015/11/29 18:30:44 got new line on a stdin; terminating. 2015-11-29T18:30:44.77-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T18:30:44.803-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T18:30:44.807-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:30:44.807-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T18:30:44.807-08:00 [Info] Setting log level to Info 2015-11-29T18:30:44.807-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T18:30:44.869-08:00 [Error] [Queryport ":9101"] failed starting listen tcp :9101: bind: address already in use !! 2015-11-29T18:30:44.869-08:00 [Fatal] Indexer::NewIndexer Scan Coordinator Init Error%!(EXTRA *indexer.MsgError=listen tcp :9101: bind: address already in use) 2015-11-29T18:30:44.869-08:00 [Warn] Indexer Failure to Init listen tcp :9101: bind: address already in use 2015-11-29T18:30:44.869-08:00 [Info] Indexer exiting normally 2015-11-29T18:30:50.008-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T18:30:50.041-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T18:30:50.046-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:30:50.046-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T18:30:50.046-08:00 [Info] Setting log level to Info 2015-11-29T18:30:50.046-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T18:30:50.108-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T18:30:50.113-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T18:30:50.113-08:00 [Info] Setting maxcpus = 24 2015-11-29T18:30:50.113-08:00 [Info] Setting log level to Info 2015-11-29T18:30:53.225-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T18:30:53.234-08:00 [Info] Indexer Id 1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.268-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.269-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.269-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:30:53.269-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.269-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.271-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.271-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:30:53.271-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.271-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.273-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.273-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:30:53.273-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.273-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.274-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.274-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:30:53.274-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.306-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.307-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.307-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T18:30:53.307-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.307-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.308-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.308-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T18:30:53.308-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.308-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.308-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.308-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T18:30:53.308-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.308-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 2015-11-29T18:30:53.309-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78. Err projector.topicMissing 2015-11-29T18:30:53.309-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T18:30:53.309-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T18:30:53.309-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T18:30:53.309-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T18:30:53.309-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T18:30:53.309-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T18:30:53.309-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T18:30:53.31-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T18:30:53.31-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T18:31:53.225-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"71 4206982 334147297444"} 2015-11-29T18:32:53.226-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"143 8259398 574564061316"} 2015-11-29T18:33:53.226-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"215 12091865 786863864765"} 2015-11-29T18:34:53.226-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"286 50016995 1175575949639543"} 2015-11-29T18:35:53.226-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"358 53739350 1175774513523952"} 2015-11-29T18:36:53.227-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"430 74326177 1459981561122579"} 2015-11-29T18:37:53.227-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"502 78305054 1460211355569888"} 2015-11-29T18:38:53.244-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"574 82211383 1460432539240211"} 2015-11-29T18:39:53.244-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"646 86079800 1460650083537766"} 2015-11-29T18:40:53.295-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"718 89822187 1460850526809249"} 2015-11-29T18:41:53.296-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"791 93595695 1461051905823451"} 2015-11-29T18:42:53.313-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"863 97306427 1461248306646633"} 2015-11-29T18:43:53.313-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"934 100955467 1461441725655519"} 2015-11-29T18:44:53.348-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1006 104634097 1461636597554057"} 2015-11-29T18:45:53.348-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1078 108334094 1461830604915092"} 2015-11-29T18:46:53.365-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1150 112144607 1462038082722475"} 2015-11-29T18:47:53.366-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1222 115979615 1462249320671685"} 2015-11-29T18:48:53.383-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1294 119628678 1462439552622966"} 2015-11-29T18:49:53.384-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1366 123492743 1462656611606721"} 2015-11-29T18:50:46.834-08:00 [Info] clustMgrAgent::OnIndexCreate Notification Received for Create Index DefnId: 3094208154756435235 Name: by_capped_small_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`capped_small`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) 2015-11-29T18:50:46.834-08:00 [Info] Indexer::handleCreateIndex InstId: 3094208154756435235 Defn: DefnId: 3094208154756435235 Name: by_capped_small_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`capped_small`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) State: INDEX_STATE_CREATED Stream: NIL_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1} 2015-11-29T18:50:46.868-08:00 [Info] Indexer::initPartnInstance Initialized Partition: Index: 3094208154756435235 Partition: PartitionId: 1 Endpoints: [:9105] 2015-11-29T18:50:46.876-08:00 [Info] ForestDBSlice:NewForestDBSlice Created New Slice Id 0 IndexInstId 3094208154756435235 WriterThreads 1 2015-11-29T18:50:46.876-08:00 [Info] Indexer::initPartnInstance Initialized Slice: Index: 3094208154756435235 Slice: SliceId: 0 File: /data/@2i/bucket-1_by_capped_small_0_3094208154756435235_0.index Index: 3094208154756435235 2015-11-29T18:50:46.877-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 3094208154756435235 Name: by_capped_small_0 Bucket: bucket-1 State: INDEX_STATE_CREATED Stream: NIL_STREAM 2015-11-29T18:50:46.877-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap InstanceId: 3094208154756435235 PartitionId: 0 Endpoints: [:9105] 2015-11-29T18:50:46.877-08:00 [Info] clustMgrAgent::OnIndexCreate Success for Create Index DefnId: 3094208154756435235 Name: by_capped_small_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`capped_small`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) 2015-11-29T18:50:46.879-08:00 [Info] clustMgrAgent::OnIndexBuild Notification Received for Build Index [3094208154756435235] 2015-11-29T18:50:46.879-08:00 [Info] Indexer::handleBuildIndex [3094208154756435235] 2015-11-29T18:50:46.962-08:00 [Info] DCPT[secidx:getseqnos-e5:e2:56:7:fc:5:91:96] ##abba feed started ... 2015-11-29T18:50:46.965-08:00 [Info] DCPT[secidx:getseqnos-e5:ea:f:83:a8:84:bf:30] ##abba feed started ... 2015-11-29T18:50:46.967-08:00 [Info] DCPT[secidx:getseqnos-50:6a:30:97:76:20:45:56] ##abba feed started ... 2015-11-29T18:50:46.97-08:00 [Info] DCPT[secidx:getseqnos-82:4b:b0:1b:d6:ca:ce:f0] ##abba feed started ... 2015-11-29T18:50:46.97-08:00 [Info] {bucket,feeds} "bucket-1" created for dcp_seqno cache... 2015-11-29T18:50:46.974-08:00 [Info] Indexer::handleBuildIndex Added Index: [3094208154756435235] to Stream: MAINT_STREAM State: INDEX_STATE_INITIAL 2015-11-29T18:50:46.974-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 3094208154756435235 Name: by_capped_small_0 Bucket: bucket-1 State: INDEX_STATE_INITIAL Stream: MAINT_STREAM 2015-11-29T18:50:46.974-08:00 [Info] Timekeeper::handleStreamOpen Stream MAINT_STREAM State Changed to ACTIVE 2015-11-29T18:50:46.974-08:00 [Info] StreamState::initBucketInStream New Bucket bucket-1 Added for Stream MAINT_STREAM 2015-11-29T18:50:46.974-08:00 [Info] Timekeeper::addIndextoStream IndexCount map[MAINT_STREAM:map[bucket-1:1]] 2015-11-29T18:50:46.974-08:00 [Info] Timekeeper::addIndextoStream add BuildInfo index 3094208154756435235 stream MAINT_STREAM bucket bucket-1 state INDEX_STATE_INITIAL 2015-11-29T18:50:46.974-08:00 [Info] Timekeeper::startTimer MAINT_STREAM bucket-1 2015-11-29T18:50:46.974-08:00 [Info] MutationMgr::handleOpenStream Message: MsgStreamUpdate Type: OPEN_STREAM Stream: MAINT_STREAM Bucket: bucket-1 BuildTS: [0=19535,1=19515,2=19515,3=19535,4=19550,5=19525,6=19525,7=19550,8=19525,9=19550,10=19550,11=19525,12=19515,13=19535,14=19535,15=19515,16=19535,17=19515,18=19515,19=19535,20=19550,21=19525,22=19525,23=19550,24=19525,25=19550,26=19550,27=19525,28=19515,29=19535,30=19535,31=19515,32=19535,33=19515,34=19515,35=19535,36=19550,37=19525,38=19525,39=19550,40=19525,41=19550,42=19550,43=19525,44=19515,45=19535,46=19535,47=19515,48=19535,49=19515,50=19515,51=19535,52=19550,53=19525,54=19525,55=19550,56=19525,57=19550,58=19550,59=19525,60=19515,61=19535,62=19535,63=19515,64=19525,65=19550,66=19550,67=19525,68=19515,69=19535,70=19535,71=19515,72=19535,73=19515,74=19515,75=19535,76=19550,77=19525,78=19525,79=19550,80=19525,81=19550,82=19550,83=19525,84=19515,85=19535,86=19535,87=19515,88=19535,89=19515,90=19515,91=19535,92=19550,93=19525,94=19525,95=19550,96=19525,97=19550,98=19550,99=19525,100=19515,101=19535,102=19535,103=19515,104=19535,105=19515,106=19515,107=19535,108=19550,109=19525,110=19525,111=19550,112=19525,113=19550,114=19550,115=19525,116=19515,117=19535,118=19535,119=19515,120=19535,121=19515,122=19515,123=19535,124=19550,125=19525,126=19525,127=19550,128=19515,129=19535,130=19535,131=19515,132=19525,133=19550,134=19550,135=19525,136=19550,137=19525,138=19525,139=19550,140=19535,141=19515,142=19515,143=19535,144=19515,145=19535,146=19535,147=19515,148=19525,149=19550,150=19550,151=19525,152=19550,153=19525,154=19525,155=19550,156=19535,157=19515,158=19515,159=19535,160=19515,161=19535,162=19535,163=19515,164=19525,165=19550,166=19550,167=19525,168=19550,169=19525,170=19525,171=19550,172=19535,173=19515,174=19515,175=19535,176=19515,177=19535,178=19535,179=19515,180=19525,181=19550,182=19550,183=19525,184=19550,185=19525,186=19525,187=19550,188=19535,189=19515,190=19515,191=19535,192=19550,193=19525,194=19525,195=19550,196=19535,197=19515,198=19515,199=19535,200=19515,201=19535,202=19535,203=19515,204=19525,205=19550,206=19550,207=19525,208=19550,209=19525,210=19525,211=19550,212=19535,213=19515,214=19515,215=19535,216=19515,217=19535,218=19535,219=19515,220=19525,221=19550,222=19550,223=19525,224=19550,225=19525,226=19525,227=19550,228=19535,229=19515,230=19515,231=19535,232=19515,233=19535,234=19535,235=19515,236=19525,237=19550,238=19550,239=19525,240=19550,241=19525,242=19525,243=19550,244=19535,245=19515,246=19515,247=19535,248=19515,249=19535,250=19535,251=19515,252=19525,253=19550,254=19550,255=19525,256=19525,257=19550,258=19550,259=19525,260=19516,261=19535,262=19535,263=19515,264=19535,265=19515,266=19515,267=19535,268=19550,269=19525,270=19525,271=19550,272=19525,273=19550,274=19550,275=19525,276=19515,277=19535,278=19535,279=19515,280=19535,281=19515,282=19515,283=19535,284=19550,285=19525,286=19525,287=19550,288=19525,289=19550,290=19550,291=19525,292=19515,293=19535,294=19535,295=19515,296=19535,297=19515,298=19515,299=19535,300=19550,301=19525,302=19525,303=19550,304=19525,305=19550,306=19550,307=19525,308=19515,309=19535,310=19535,311=19515,312=19535,313=19515,314=19515,315=19535,316=19550,317=19525,318=19525,319=19550,320=19535,321=19515,322=19515,323=19535,324=19550,325=19525,326=19525,327=19550,328=19525,329=19550,330=19550,331=19525,332=19515,333=19535,334=19535,335=19515,336=19535,337=19515,338=19515,339=19535,340=19550,341=19525,342=19525,343=19550,344=19525,345=19550,346=19550,347=19525,348=19515,349=19535,350=19535,351=19515,352=19535,353=19515,354=19515,355=19535,356=19550,357=19525,358=19525,359=19550,360=19525,361=19550,362=19550,363=19525,364=19515,365=19535,366=19535,367=19515,368=19535,369=19515,370=19515,371=19535,372=19550,373=19525,374=19525,375=19550,376=19525,377=19550,378=19550,379=19525,380=19515,381=19535,382=19535,383=19515,384=19550,385=19525,386=19525,387=19550,388=19535,389=19515,390=19515,391=19535,392=19515,393=19535,394=19535,395=19515,396=19525,397=19550,398=19550,399=19525,400=19550,401=19525,402=19525,403=19550,404=19535,405=19515,406=19515,407=19535,408=19515,409=19535,410=19535,411=19515,412=19525,413=19550,414=19550,415=19525,416=19550,417=19525,418=19525,419=19550,420=19535,421=19515,422=19515,423=19535,424=19515,425=19535,426=19535,427=19515,428=19525,429=19550,430=19549,431=19525,432=19550,433=19525,434=19525,435=19550,436=19535,437=19515,438=19515,439=19535,440=19515,441=19535,442=19535,443=19515,444=19525,445=19550,446=19550,447=19525,448=19515,449=19535,450=19535,451=19515,452=19525,453=19550,454=19550,455=19525,456=19550,457=19525,458=19525,459=19550,460=19535,461=19515,462=19515,463=19535,464=19515,465=19535,466=19535,467=19515,468=19525,469=19550,470=19550,471=19525,472=19550,473=19525,474=19525,475=19550,476=19535,477=19515,478=19515,479=19535,480=19515,481=19535,482=19535,483=19515,484=19525,485=19550,486=19550,487=19525,488=19550,489=19525,490=19525,491=19550,492=19535,493=19515,494=19515,495=19535,496=19515,497=19535,498=19535,499=19515,500=19525,501=19550,502=19550,503=19525,504=19550,505=19525,506=19525,507=19550,508=19535,509=19515,510=19515,511=19535,512=19515,513=19535,514=19535,515=19515,516=19525,517=19550,518=19550,519=19525,520=19550,521=19525,522=19525,523=19550,524=19535,525=19515,526=19515,527=19535,528=19515,529=19535,530=19535,531=19515,532=19525,533=19550,534=19550,535=19525,536=19550,537=19525,538=19525,539=19550,540=19535,541=19515,542=19515,543=19535,544=19515,545=19535,546=19535,547=19515,548=19525,549=19550,550=19550,551=19525,552=19549,553=19525,554=19525,555=19550,556=19535,557=19515,558=19515,559=19535,560=19515,561=19535,562=19535,563=19515,564=19525,565=19550,566=19550,567=19525,568=19550,569=19525,570=19525,571=19550,572=19535,573=19515,574=19515,575=19535,576=19550,577=19525,578=19525,579=19550,580=19535,581=19515,582=19515,583=19535,584=19515,585=19535,586=19535,587=19515,588=19525,589=19550,590=19550,591=19525,592=19550,593=19525,594=19525,595=19550,596=19535,597=19515,598=19515,599=19535,600=19515,601=19535,602=19535,603=19515,604=19525,605=19550,606=19550,607=19525,608=19550,609=19525,610=19525,611=19550,612=19535,613=19515,614=19515,615=19535,616=19515,617=19535,618=19535,619=19515,620=19525,621=19550,622=19550,623=19525,624=19550,625=19525,626=19525,627=19550,628=19535,629=19515,630=19515,631=19535,632=19515,633=19535,634=19535,635=19515,636=19525,637=19550,638=19550,639=19525,640=19535,641=19515,642=19516,643=19535,644=19550,645=19525,646=19525,647=19550,648=19525,649=19550,650=19550,651=19525,652=19515,653=19535,654=19535,655=19515,656=19535,657=19515,658=19515,659=19535,660=19550,661=19525,662=19525,663=19550,664=19525,665=19550,666=19550,667=19525,668=19515,669=19535,670=19535,671=19515,672=19535,673=19515,674=19515,675=19535,676=19550,677=19525,678=19525,679=19550,680=19525,681=19550,682=19550,683=19525,684=19515,685=19535,686=19535,687=19515,688=19535,689=19515,690=19515,691=19535,692=19550,693=19525,694=19525,695=19550,696=19525,697=19550,698=19550,699=19525,700=19515,701=19535,702=19535,703=19515,704=19525,705=19550,706=19550,707=19525,708=19515,709=19535,710=19535,711=19515,712=19535,713=19515,714=19515,715=19535,716=19550,717=19525,718=19525,719=19550,720=19525,721=19550,722=19550,723=19525,724=19515,725=19535,726=19535,727=19515,728=19535,729=19515,730=19515,731=19535,732=19550,733=19525,734=19525,735=19550,736=19525,737=19550,738=19550,739=19525,740=19515,741=19535,742=19535,743=19515,744=19535,745=19515,746=19515,747=19535,748=19550,749=19525,750=19525,751=19550,752=19525,753=19550,754=19550,755=19525,756=19515,757=19535,758=19535,759=19515,760=19535,761=19515,762=19515,763=19535,764=19550,765=19525,766=19525,767=19550,768=19550,769=19525,770=19525,771=19550,772=19535,773=19515,774=19515,775=19535,776=19515,777=19535,778=19535,779=19515,780=19525,781=19550,782=19550,783=19525,784=19550,785=19525,786=19525,787=19550,788=19535,789=19515,790=19515,791=19535,792=19515,793=19535,794=19535,795=19515,796=19525,797=19550,798=19550,799=19525,800=19550,801=19525,802=19525,803=19550,804=19535,805=19515,806=19515,807=19535,808=19515,809=19535,810=19535,811=19515,812=19525,813=19550,814=19550,815=19525,816=19550,817=19525,818=19525,819=19550,820=19535,821=19515,822=19515,823=19535,824=19515,825=19535,826=19535,827=19515,828=19525,8 29=19550,830=19550,831=19525,832=19515,833=19535,834=19535,835=19515,836=19525,837=19550,838=19550,839=19525,840=19550,841=19525,842=19525,843=19550,844=19535,845=19515,846=19515,847=19535,848=19515,849=19535,850=19535,851=19515,852=19525,853=19550,854=19550,855=19525,856=19550,857=19525,858=19525,859=19550,860=19535,861=19515,862=19515,863=19535,864=19515,865=19535,866=19535,867=19515,868=19525,869=19550,870=19550,871=19525,872=19550,873=19525,874=19525,875=19550,876=19535,877=19515,878=19515,879=19535,880=19515,881=19535,882=19535,883=19515,884=19525,885=19550,886=19550,887=19525,888=19550,889=19525,890=19525,891=19550,892=19535,893=19515,894=19515,895=19535,896=19525,897=19550,898=19550,899=19525,900=19515,901=19535,902=19535,903=19515,904=19535,905=19515,906=19515,907=19535,908=19550,909=19525,910=19525,911=19550,912=19525,913=19550,914=19550,915=19525,916=19515,917=19535,918=19535,919=19515,920=19535,921=19515,922=19515,923=19535,924=19550,925=19525,926=19525,927=19550,928=19525,929=19550,930=19550,931=19525,932=19515,933=19535,934=19535,935=19515,936=19535,937=19515,938=19515,939=19535,940=19550,941=19525,942=19525,943=19550,944=19525,945=19550,946=19550,947=19525,948=19515,949=19535,950=19535,951=19515,952=19535,953=19515,954=19515,955=19535,956=19550,957=19525,958=19525,959=19550,960=19535,961=19515,962=19515,963=19535,964=19550,965=19525,966=19525,967=19550,968=19525,969=19550,970=19550,971=19525,972=19515,973=19535,974=19535,975=19515,976=19535,977=19515,978=19515,979=19535,980=19550,981=19525,982=19525,983=19550,984=19525,985=19550,986=19550,987=19525,988=19515,989=19535,990=19535,991=19515,992=19535,993=19515,994=19515,995=19535,996=19550,997=19525,998=19525,999=19550,1000=19525,1001=19550,1002=19550,1003=19525,1004=19515,1005=19535,1006=19535,1007=19515,1008=19535,1009=19515,1010=19515,1011=19535,1012=19550,1013=19525,1014=19525,1015=19550,1016=19525,1017=19550,1018=19550,1019=19525,1020=19515,1021=19535,1022=19535,1023=19515] IndexList: [ InstId: 3094208154756435235 Defn: DefnId: 3094208154756435235 Name: by_capped_small_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`capped_small`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) State: INDEX_STATE_INITIAL Stream: MAINT_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1}] RestartTs: 2015-11-29T18:50:46.991-08:00 [Info] MutationMgr:: Set maxVbQueueLength 10000 2015-11-29T18:50:46.991-08:00 [Info] DATP[->dataport ":9105"] started ... 2015-11-29T18:50:46.991-08:00 [Info] MutationStreamReader::startWorkers Starting All Stream Workers MAINT_STREAM 2015-11-29T18:50:46.991-08:00 [Info] MutationStreamReader::startMutationStreamWorker Stream Worker 0 Started for Stream MAINT_STREAM. 2015-11-29T18:50:46.991-08:00 [Info] ClustMgr:handleUpdateTopologyForIndex &{47 [{3094208154756435235 {3094208154756435235 by_capped_small_0 forestdb bucket-1 e2e83fcd75cf3129d7c8c391d58b92d3 false [`capped_small`] N1QL SINGLE (`partition_id` = 0) false [1b:44:cb:a3:85:a1:38:78]} 2 1 0xc20bbb5430 []}] {true true false true} 0} 2015-11-29T18:50:46.992-08:00 [Info] clustMgrAgent::OnIndexBuild returns for Build Index [3094208154756435235] 2015-11-29T18:50:47.494-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T18:50:47.507-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.70:46897" +1 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 5 239257356805059 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 7 195238201363968 0 2015-11-29T18:50:47.717-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 8 110469835935522 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 2 24604606742850 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1 194419600600895 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 3 267273152661431 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 4 244785602548340 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 6 165956228013892 0 2015-11-29T18:50:47.717-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 0 181616725748696 0 2015-11-29T18:50:47.733-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 9 250679938793503 0 2015-11-29T18:50:47.733-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 10 236558377905172 0 2015-11-29T18:50:47.741-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 12 127736244875867 0 2015-11-29T18:50:47.741-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 13 38793522625331 0 2015-11-29T18:50:47.742-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 11 163296808412020 0 2015-11-29T18:50:47.754-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 14 94330091341810 0 2015-11-29T18:50:47.754-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 15 231890816846709 0 2015-11-29T18:50:47.763-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 17 66299019947519 0 2015-11-29T18:50:47.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 16 74476583859732 0 2015-11-29T18:50:47.777-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 19 251620237185579 0 2015-11-29T18:50:47.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 18 5699090016959 0 2015-11-29T18:50:47.796-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1 QueuedCount 3 2015-11-29T18:50:47.799-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:47.801-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 20 2261227022945 0 2015-11-29T18:50:47.801-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 21 178165934536488 0 2015-11-29T18:50:47.811-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 22 256039211663068 0 2015-11-29T18:50:47.816-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 23 112315698898241 0 2015-11-29T18:50:47.816-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 24 105220564612010 0 2015-11-29T18:50:47.823-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 25 253072945153317 0 2015-11-29T18:50:47.823-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 26 96428057557825 0 2015-11-29T18:50:47.828-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 27 240007508384976 0 2015-11-29T18:50:47.828-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 28 280637404370023 0 2015-11-29T18:50:47.829-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 29 160326761156222 0 2015-11-29T18:50:47.835-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 30 86066756439985 0 2015-11-29T18:50:47.835-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 31 91246158102480 0 2015-11-29T18:50:47.841-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 32 217238247055044 0 2015-11-29T18:50:47.841-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 33 213875933037543 0 2015-11-29T18:50:47.853-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 34 160188134207910 0 2015-11-29T18:50:47.853-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 35 268084397427525 0 2015-11-29T18:50:47.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 36 131613676271325 0 2015-11-29T18:50:47.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 37 36411491401230 0 2015-11-29T18:50:47.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 38 181544895037959 0 2015-11-29T18:50:47.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 39 72829841500542 0 2015-11-29T18:50:47.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 40 148377568610001 0 2015-11-29T18:50:47.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 41 132248334859652 0 2015-11-29T18:50:47.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 42 19566515253192 0 2015-11-29T18:50:47.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 43 17445542901329 0 2015-11-29T18:50:47.878-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 46 216905846351778 0 2015-11-29T18:50:47.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 44 229012845268381 0 2015-11-29T18:50:47.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 45 77758262053248 0 2015-11-29T18:50:47.886-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 47 120872606376112 0 2015-11-29T18:50:47.892-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 48 217205923874941 0 2015-11-29T18:50:47.892-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 49 61390844554007 0 2015-11-29T18:50:47.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 50 206111862763884 0 2015-11-29T18:50:47.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 51 47926261356451 0 2015-11-29T18:50:47.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 52 98465531649426 0 2015-11-29T18:50:47.909-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 53 170867986077445 0 2015-11-29T18:50:47.91-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 54 111488325456920 0 2015-11-29T18:50:47.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 56 8881253729024 0 2015-11-29T18:50:47.917-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 55 18280654702640 0 2015-11-29T18:50:47.923-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 57 272112949100316 0 2015-11-29T18:50:47.924-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 58 31426720393197 0 2015-11-29T18:50:47.938-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 59 93134253578252 0 2015-11-29T18:50:47.938-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 60 188239966624670 0 2015-11-29T18:50:47.942-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 61 118886332486247 0 2015-11-29T18:50:47.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 62 251353781116373 0 2015-11-29T18:50:47.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 63 147352835711425 0 2015-11-29T18:50:47.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 64 219058323573446 0 2015-11-29T18:50:47.959-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 65 199902221365029 0 2015-11-29T18:50:47.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 67 185805793625193 0 2015-11-29T18:50:47.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 68 194810426675631 0 2015-11-29T18:50:47.964-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 66 16002637201018 0 2015-11-29T18:50:47.967-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 69 3757043088489 0 2015-11-29T18:50:47.974-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 70 249738698842050 0 2015-11-29T18:50:47.974-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 71 206640046500824 0 2015-11-29T18:50:47.981-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 72 37818335446758 0 2015-11-29T18:50:47.987-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 74 24994917818443 0 2015-11-29T18:50:47.989-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 73 270951655067643 0 2015-11-29T18:50:47.992-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 75 33628104688264 0 2015-11-29T18:50:48.001-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 76 186232869836415 0 2015-11-29T18:50:48.001-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 77 252390287223656 0 2015-11-29T18:50:48.009-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 78 256300973875225 0 2015-11-29T18:50:48.009-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 79 94143205459502 0 2015-11-29T18:50:48.012-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:48.019-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 80 116765817937823 0 2015-11-29T18:50:48.019-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 81 188609390110110 0 2015-11-29T18:50:48.027-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 82 71524832694311 0 2015-11-29T18:50:48.027-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 83 169037120624275 0 2015-11-29T18:50:48.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 84 90033918040399 0 2015-11-29T18:50:48.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 85 31785494060077 0 2015-11-29T18:50:48.04-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 86 209501667524274 0 2015-11-29T18:50:48.04-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 87 109227093626724 0 2015-11-29T18:50:48.049-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 88 225903965907381 0 2015-11-29T18:50:48.049-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 89 801821060438 0 2015-11-29T18:50:48.049-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 90 58890623621066 0 2015-11-29T18:50:48.055-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 91 164379103065602 0 2015-11-29T18:50:48.055-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 92 68676449693661 0 2015-11-29T18:50:48.061-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 93 240805391160176 0 2015-11-29T18:50:48.061-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 94 244178858624702 0 2015-11-29T18:50:48.061-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 95 140097087898570 0 2015-11-29T18:50:48.067-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 96 105311146002496 0 2015-11-29T18:50:48.067-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 97 20101273718025 0 2015-11-29T18:50:48.072-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 100 270425736590056 0 2015-11-29T18:50:48.073-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 98 119022959479210 0 2015-11-29T18:50:48.073-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 99 237464602703314 0 2015-11-29T18:50:48.079-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 101 15429596633817 0 2015-11-29T18:50:48.079-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 102 92307780546676 0 2015-11-29T18:50:48.085-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 103 658513077036 0 2015-11-29T18:50:48.089-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 104 267577063175559 0 2015-11-29T18:50:48.089-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 105 21976817897412 0 2015-11-29T18:50:48.091-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 106 33256513354247 0 2015-11-29T18:50:48.091-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 107 18103322762360 0 2015-11-29T18:50:48.092-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 108 14423894965845 0 2015-11-29T18:50:48.095-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 109 51386722392126 0 2015-11-29T18:50:48.095-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 110 101161473379136 0 2015-11-29T18:50:48.095-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 111 194839741084635 0 2015-11-29T18:50:48.098-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 112 222495477542890 0 2015-11-29T18:50:48.099-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 113 221653078679498 0 2015-11-29T18:50:48.099-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 114 58270870739436 0 2015-11-29T18:50:48.102-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 115 129574964880362 0 2015-11-29T18:50:48.106-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 116 41368508737662 0 2015-11-29T18:50:48.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 119 266142683069475 0 2015-11-29T18:50:48.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 120 169019247864397 0 2015-11-29T18:50:48.109-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 117 157203964748592 0 2015-11-29T18:50:48.109-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 118 202766627214765 0 2015-11-29T18:50:48.118-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 121 52654467773591 0 2015-11-29T18:50:48.118-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 122 60579973755578 0 2015-11-29T18:50:48.118-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 123 131015607628692 0 2015-11-29T18:50:48.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 124 162077094557666 0 2015-11-29T18:50:48.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 125 3508206110027 0 2015-11-29T18:50:48.124-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 127 87206449080025 0 2015-11-29T18:50:48.124-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 128 8681168738504 0 2015-11-29T18:50:48.125-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 126 128458271629557 0 2015-11-29T18:50:48.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 131 218108874691766 0 2015-11-29T18:50:48.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 130 195495907235939 0 2015-11-29T18:50:48.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 132 168955193888404 0 2015-11-29T18:50:48.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 133 137649434871428 0 2015-11-29T18:50:48.13-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 129 54475763435253 0 2015-11-29T18:50:48.13-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 134 177803231024746 0 2015-11-29T18:50:48.131-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 135 72928671035768 0 2015-11-29T18:50:48.131-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 138 195511253911400 0 2015-11-29T18:50:48.132-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 136 195693781175772 0 2015-11-29T18:50:48.132-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 137 122726321255312 0 2015-11-29T18:50:48.134-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 139 275140745858585 0 2015-11-29T18:50:48.134-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 141 44847986375949 0 2015-11-29T18:50:48.134-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 140 94274595796676 0 2015-11-29T18:50:48.138-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 143 15993715003606 0 2015-11-29T18:50:48.139-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 142 92966728949237 0 2015-11-29T18:50:48.142-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 144 137033129044554 0 2015-11-29T18:50:48.142-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 145 241921121185137 0 2015-11-29T18:50:48.146-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 149 20251560066636 0 2015-11-29T18:50:48.146-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 146 9083967458159 0 2015-11-29T18:50:48.146-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 147 201616898513388 0 2015-11-29T18:50:48.147-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 148 18969082966401 0 2015-11-29T18:50:48.149-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 150 199075377622781 0 2015-11-29T18:50:48.149-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 151 65578686590063 0 2015-11-29T18:50:48.149-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 152 79301696309049 0 2015-11-29T18:50:48.153-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 153 187219367536988 0 2015-11-29T18:50:48.153-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 154 202316405512597 0 2015-11-29T18:50:48.153-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 155 25869469579308 0 2015-11-29T18:50:48.158-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 156 130170452234354 0 2015-11-29T18:50:48.158-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 157 175343582298718 0 2015-11-29T18:50:48.161-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 158 123994153929710 0 2015-11-29T18:50:48.161-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 159 266475641288055 0 2015-11-29T18:50:48.166-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 160 278902420376458 0 2015-11-29T18:50:48.166-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 161 37074893476969 0 2015-11-29T18:50:48.166-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 162 34546471008424 0 2015-11-29T18:50:48.171-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 163 235125759078221 0 2015-11-29T18:50:48.171-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 164 99579031397222 0 2015-11-29T18:50:48.175-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 165 221404920942970 0 2015-11-29T18:50:48.175-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 166 258632245921639 0 2015-11-29T18:50:48.175-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 167 227870318509984 0 2015-11-29T18:50:48.178-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 168 105213526106527 0 2015-11-29T18:50:48.183-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 169 76649078209010 0 2015-11-29T18:50:48.183-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 170 22089868231612 0 2015-11-29T18:50:48.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 171 185628864346317 0 2015-11-29T18:50:48.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 172 158675746143347 0 2015-11-29T18:50:48.19-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 173 104247657977375 0 2015-11-29T18:50:48.191-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 174 85254923802709 0 2015-11-29T18:50:48.197-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 175 77909711397761 0 2015-11-29T18:50:48.197-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 176 134946130400406 0 2015-11-29T18:50:48.2-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 178 237285636841959 0 2015-11-29T18:50:48.201-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 177 99119642284199 0 2015-11-29T18:50:48.205-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 179 108645081060700 0 2015-11-29T18:50:48.205-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 180 280066475395987 0 2015-11-29T18:50:48.211-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 181 183137209184620 0 2015-11-29T18:50:48.212-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:48.215-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 182 11238813837016 0 2015-11-29T18:50:48.216-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 183 74513543111587 0 2015-11-29T18:50:48.229-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 184 176656810584993 0 2015-11-29T18:50:48.235-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 185 131338137225013 0 2015-11-29T18:50:48.242-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 186 91460274734534 0 2015-11-29T18:50:48.242-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 187 164973968689379 0 2015-11-29T18:50:48.243-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 188 75694930511721 0 2015-11-29T18:50:48.246-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 190 167447557054041 0 2015-11-29T18:50:48.247-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 189 192737340999718 0 2015-11-29T18:50:48.248-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 191 24405604431766 0 2015-11-29T18:50:48.248-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 192 281197672229510 0 2015-11-29T18:50:48.251-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 193 225187467395741 0 2015-11-29T18:50:48.251-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 194 175019491897777 0 2015-11-29T18:50:48.255-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 195 78175534187329 0 2015-11-29T18:50:48.255-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 196 150734524220620 0 2015-11-29T18:50:48.255-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 197 168147501387614 0 2015-11-29T18:50:48.257-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 198 59265417163027 0 2015-11-29T18:50:48.257-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 199 125516025813888 0 2015-11-29T18:50:48.26-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 200 165078261704634 0 2015-11-29T18:50:48.26-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 201 60430525885853 0 2015-11-29T18:50:48.267-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 202 46858280494810 0 2015-11-29T18:50:48.268-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 203 252948734363849 0 2015-11-29T18:50:48.268-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 204 204646567123168 0 2015-11-29T18:50:48.268-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 205 139816715094411 0 2015-11-29T18:50:48.27-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 206 88935336925268 0 2015-11-29T18:50:48.27-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 207 20014896706517 0 2015-11-29T18:50:48.27-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 208 241397145032865 0 2015-11-29T18:50:48.279-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 209 70970930664000 0 2015-11-29T18:50:48.279-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 210 5349594951187 0 2015-11-29T18:50:48.279-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 212 27991023888832 0 2015-11-29T18:50:48.28-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 211 164941523606287 0 2015-11-29T18:50:48.28-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 213 30585605519613 0 2015-11-29T18:50:48.28-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 214 251354940209559 0 2015-11-29T18:50:48.282-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 215 170051316177093 0 2015-11-29T18:50:48.283-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 216 78920562365661 0 2015-11-29T18:50:48.283-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 217 185291822160767 0 2015-11-29T18:50:48.285-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 219 127817807199941 0 2015-11-29T18:50:48.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 218 219128916067336 0 2015-11-29T18:50:48.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 220 195688014936815 0 2015-11-29T18:50:48.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 221 215166889305587 0 2015-11-29T18:50:48.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000 2015-11-29T18:50:48.297-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 222 56280804577558 0 2015-11-29T18:50:48.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 224 279158928112377 0 2015-11-29T18:50:48.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 226 266586311668309 0 2015-11-29T18:50:48.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 227 209421755063208 0 2015-11-29T18:50:48.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 223 257970876152542 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 228 56151780135720 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 225 222477606111536 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 232 36847841430366 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 229 83259572016014 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 230 10955473169672 0 2015-11-29T18:50:48.299-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 231 66303598243653 0 2015-11-29T18:50:48.305-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 233 24913127484743 0 2015-11-29T18:50:48.308-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 234 174165368643773 0 2015-11-29T18:50:48.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 235 50776389604705 0 2015-11-29T18:50:48.312-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 236 197304677380620 0 2015-11-29T18:50:48.312-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 237 247234637137123 0 2015-11-29T18:50:48.315-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 238 237168661159343 0 2015-11-29T18:50:48.316-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 239 53759500080003 0 2015-11-29T18:50:48.32-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 240 13655293489127 0 2015-11-29T18:50:48.323-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 242 111248126765383 0 2015-11-29T18:50:48.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 241 140629550899832 0 2015-11-29T18:50:48.331-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 244 202958675793700 0 2015-11-29T18:50:48.332-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 243 37316579986329 0 2015-11-29T18:50:48.34-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 245 171899859173078 0 2015-11-29T18:50:48.34-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 246 121662701769046 0 2015-11-29T18:50:48.34-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 247 7306674520734 0 2015-11-29T18:50:48.342-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 249 44944746184062 0 2015-11-29T18:50:48.342-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 248 253232016397691 0 2015-11-29T18:50:48.346-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 251 111659259228109 0 2015-11-29T18:50:48.346-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 250 132755161036074 0 2015-11-29T18:50:48.35-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 253 87179274404875 0 2015-11-29T18:50:48.35-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 252 256047867906340 0 2015-11-29T18:50:48.356-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 254 273872514491112 0 2015-11-29T18:50:48.361-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 InstanceIds [3094208154756435235] 2015-11-29T18:50:48.361-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T18:50:48.366-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 255 159607387890460 0 2015-11-29T18:50:48.403-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.71:35588" +2 2015-11-29T18:50:48.409-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:48.436-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10000 QueuedCount 1827 2015-11-29T18:50:48.565-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 20000 2015-11-29T18:50:48.608-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 257 215671983662441 0 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 258 47461990438252 0 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 259 123388404551916 0 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 260 173602693236041 0 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 261 183484644028015 0 2015-11-29T18:50:48.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 256 265882547704551 0 2015-11-29T18:50:48.688-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 262 153007076742176 0 2015-11-29T18:50:48.688-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 263 42230095635116 0 2015-11-29T18:50:48.704-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 264 27609479851724 0 2015-11-29T18:50:48.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 265 90794739665338 0 2015-11-29T18:50:48.727-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 266 242015595439944 0 2015-11-29T18:50:48.727-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 267 235781853524477 0 2015-11-29T18:50:48.741-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 268 280268499114994 0 2015-11-29T18:50:48.759-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 269 43225664854840 0 2015-11-29T18:50:48.759-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 270 124882952266736 0 2015-11-29T18:50:48.779-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 271 40971182093631 0 2015-11-29T18:50:48.779-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 272 4982619579884 0 2015-11-29T18:50:48.79-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 30000 2015-11-29T18:50:48.794-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 273 175870392515521 0 2015-11-29T18:50:48.807-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:48.807-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 20000 QueuedCount 8161 2015-11-29T18:50:48.815-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 274 241806055417099 0 2015-11-29T18:50:48.825-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 275 43051149667926 0 2015-11-29T18:50:48.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 276 221828254798973 0 2015-11-29T18:50:48.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 277 142013179724706 0 2015-11-29T18:50:48.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 278 35136430236111 0 2015-11-29T18:50:48.849-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 279 131907333138237 0 2015-11-29T18:50:48.849-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 280 106075886959396 0 2015-11-29T18:50:48.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 281 228350929865186 0 2015-11-29T18:50:48.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 282 13419654412296 0 2015-11-29T18:50:48.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 283 46376397479258 0 2015-11-29T18:50:48.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 284 186811484048506 0 2015-11-29T18:50:48.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 285 7396132167162 0 2015-11-29T18:50:48.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 286 39302618034998 0 2015-11-29T18:50:48.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 287 48880616463305 0 2015-11-29T18:50:48.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 288 199835403157564 0 2015-11-29T18:50:48.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 289 170383370193225 0 2015-11-29T18:50:48.885-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 290 109011165578789 0 2015-11-29T18:50:48.885-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 291 157045345013071 0 2015-11-29T18:50:48.89-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 292 280906586982291 0 2015-11-29T18:50:48.89-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 293 94921561225092 0 2015-11-29T18:50:48.89-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 294 192093803142347 0 2015-11-29T18:50:48.899-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 295 133990485548407 0 2015-11-29T18:50:48.899-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 296 202844286113007 0 2015-11-29T18:50:48.902-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 297 89452313567599 0 2015-11-29T18:50:48.902-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 298 127430568305882 0 2015-11-29T18:50:48.909-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 299 246271644430915 0 2015-11-29T18:50:48.909-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 300 55733080001290 0 2015-11-29T18:50:48.914-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 301 208806442634726 0 2015-11-29T18:50:48.923-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 302 50758993280871 0 2015-11-29T18:50:48.923-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 303 222491371264673 0 2015-11-29T18:50:48.926-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 304 168746692814784 0 2015-11-29T18:50:48.926-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 305 262699447428781 0 2015-11-29T18:50:48.931-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 306 15209925596485 0 2015-11-29T18:50:48.931-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 307 168394899768579 0 2015-11-29T18:50:48.931-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 308 135361209794436 0 2015-11-29T18:50:48.942-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 309 145162740851237 0 2015-11-29T18:50:48.942-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 310 219112579183565 0 2015-11-29T18:50:48.946-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 311 95194062074276 0 2015-11-29T18:50:48.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 312 174573870926656 0 2015-11-29T18:50:48.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 313 81930534104327 0 2015-11-29T18:50:48.951-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 314 37160667087121 0 2015-11-29T18:50:48.951-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 315 238315602871245 0 2015-11-29T18:50:48.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 316 249756757096885 0 2015-11-29T18:50:48.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 317 277250328981515 0 2015-11-29T18:50:48.964-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 318 171532250873533 0 2015-11-29T18:50:48.964-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 319 223850631701825 0 2015-11-29T18:50:48.966-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 320 27703718827117 0 2015-11-29T18:50:48.968-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 321 116104245546802 0 2015-11-29T18:50:48.971-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 322 214444638741622 0 2015-11-29T18:50:48.972-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 40000 2015-11-29T18:50:48.976-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 323 45129595100299 0 2015-11-29T18:50:48.99-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 325 280368636059333 0 2015-11-29T18:50:48.992-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 324 78052404470624 0 2015-11-29T18:50:48.994-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 326 75397492342236 0 2015-11-29T18:50:48.996-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 327 165422699790786 0 2015-11-29T18:50:49-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 328 245789086297784 0 2015-11-29T18:50:49.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 329 261673104697128 0 2015-11-29T18:50:49.011-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 330 168903124924700 0 2015-11-29T18:50:49.011-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 331 7032727455517 0 2015-11-29T18:50:49.016-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:49.016-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 332 43816342743816 0 2015-11-29T18:50:49.023-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 30000 QueuedCount 8813 2015-11-29T18:50:49.026-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 333 220578402849755 0 2015-11-29T18:50:49.035-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 334 110523821842096 0 2015-11-29T18:50:49.041-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 335 155066456509199 0 2015-11-29T18:50:49.048-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 336 223348768388605 0 2015-11-29T18:50:49.056-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 337 63305049725144 0 2015-11-29T18:50:49.065-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 338 187842264975433 0 2015-11-29T18:50:49.075-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 339 119295493511886 0 2015-11-29T18:50:49.081-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 340 67598183475304 0 2015-11-29T18:50:49.088-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 341 67044610051319 0 2015-11-29T18:50:49.096-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 342 5414872200961 0 2015-11-29T18:50:49.101-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 344 241307390645432 0 2015-11-29T18:50:49.102-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 343 22993212496639 0 2015-11-29T18:50:49.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 345 150351853084983 0 2015-11-29T18:50:49.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 346 49321334949057 0 2015-11-29T18:50:49.114-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 347 244002405174074 0 2015-11-29T18:50:49.114-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 348 57374382325969 0 2015-11-29T18:50:49.114-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 349 255746185398023 0 2015-11-29T18:50:49.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 350 6026915744634 0 2015-11-29T18:50:49.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 351 113528545303668 0 2015-11-29T18:50:49.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 352 55267593898803 0 2015-11-29T18:50:49.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 353 273262236150198 0 2015-11-29T18:50:49.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 354 113636990483913 0 2015-11-29T18:50:49.131-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 355 197528315797728 0 2015-11-29T18:50:49.131-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 356 3124852016653 0 2015-11-29T18:50:49.137-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 357 14634182963643 0 2015-11-29T18:50:49.137-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 358 54309361270156 0 2015-11-29T18:50:49.139-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 359 266627898381124 0 2015-11-29T18:50:49.144-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 361 146557917320870 0 2015-11-29T18:50:49.145-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 360 128232940898979 0 2015-11-29T18:50:49.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 50000 2015-11-29T18:50:49.15-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 362 30501456860623 0 2015-11-29T18:50:49.15-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 363 102520631587545 0 2015-11-29T18:50:49.16-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 364 249817158909708 0 2015-11-29T18:50:49.16-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 365 181958275376804 0 2015-11-29T18:50:49.163-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 367 127172761071677 0 2015-11-29T18:50:49.165-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 366 69397877286853 0 2015-11-29T18:50:49.165-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 369 18197487234531 0 2015-11-29T18:50:49.166-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 368 125093019411489 0 2015-11-29T18:50:49.175-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 370 72815870566051 0 2015-11-29T18:50:49.175-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 371 242764561601533 0 2015-11-29T18:50:49.192-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 372 273047675174312 0 2015-11-29T18:50:49.192-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 373 28627814277135 0 2015-11-29T18:50:49.195-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 374 121298411575472 0 2015-11-29T18:50:49.196-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 375 7973873209848 0 2015-11-29T18:50:49.199-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 376 88259786785718 0 2015-11-29T18:50:49.201-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 377 62131158948995 0 2015-11-29T18:50:49.202-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 378 96705699682406 0 2015-11-29T18:50:49.202-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 381 230138886179979 0 2015-11-29T18:50:49.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 379 87792572907178 0 2015-11-29T18:50:49.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 380 75189207003542 0 2015-11-29T18:50:49.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 382 242516945775578 0 2015-11-29T18:50:49.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 383 186000620295267 0 2015-11-29T18:50:49.207-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 385 92954883357124 0 2015-11-29T18:50:49.208-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 384 130072569786717 0 2015-11-29T18:50:49.211-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 386 63507202007883 0 2015-11-29T18:50:49.211-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 387 145105769687931 0 2015-11-29T18:50:49.211-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 388 221346469332616 0 2015-11-29T18:50:49.214-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 389 32282155325962 0 2015-11-29T18:50:49.214-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 390 80254950295708 0 2015-11-29T18:50:49.214-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 40000 QueuedCount 9998 2015-11-29T18:50:49.215-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:49.217-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 391 79817387988447 0 2015-11-29T18:50:49.217-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 392 228543472936390 0 2015-11-29T18:50:49.217-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 393 183615820176743 0 2015-11-29T18:50:49.221-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 394 206567605487780 0 2015-11-29T18:50:49.221-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 395 194158747582218 0 2015-11-29T18:50:49.222-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 396 79819383026711 0 2015-11-29T18:50:49.222-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 397 265082097932212 0 2015-11-29T18:50:49.225-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 398 84612946248872 0 2015-11-29T18:50:49.227-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 400 242972475161605 0 2015-11-29T18:50:49.228-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 399 61067415387887 0 2015-11-29T18:50:49.231-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 401 119532508378427 0 2015-11-29T18:50:49.231-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 402 235199257344960 0 2015-11-29T18:50:49.234-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 403 111738822487304 0 2015-11-29T18:50:49.234-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 404 234555384735283 0 2015-11-29T18:50:49.237-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 406 158279428398749 0 2015-11-29T18:50:49.238-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 405 132785894274693 0 2015-11-29T18:50:49.239-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 407 94327846594472 0 2015-11-29T18:50:49.244-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 408 138273220396557 0 2015-11-29T18:50:49.244-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 409 116331318460807 0 2015-11-29T18:50:49.248-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 410 260951745445532 0 2015-11-29T18:50:49.248-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 411 119315242788894 0 2015-11-29T18:50:49.25-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 413 18220231705421 0 2015-11-29T18:50:49.251-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 412 127725987518278 0 2015-11-29T18:50:49.253-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 414 78673106993699 0 2015-11-29T18:50:49.254-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 415 53419388913087 0 2015-11-29T18:50:49.258-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 416 256073338532659 0 2015-11-29T18:50:49.26-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 418 171338301286412 0 2015-11-29T18:50:49.261-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 417 20147789022536 0 2015-11-29T18:50:49.265-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 419 254181599075432 0 2015-11-29T18:50:49.265-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 420 210327416698685 0 2015-11-29T18:50:49.268-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 422 42674553641616 0 2015-11-29T18:50:49.269-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 421 183630774142456 0 2015-11-29T18:50:49.273-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 423 7120948811139 0 2015-11-29T18:50:49.273-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 424 213750100583433 0 2015-11-29T18:50:49.274-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 425 201228749462988 0 2015-11-29T18:50:49.276-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 426 124529380417785 0 2015-11-29T18:50:49.276-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 427 265481929910855 0 2015-11-29T18:50:49.279-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 428 11794699604592 0 2015-11-29T18:50:49.279-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 429 31501181844645 0 2015-11-29T18:50:49.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 60000 2015-11-29T18:50:49.282-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 430 231899801621781 0 2015-11-29T18:50:49.282-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 431 52527057939686 0 2015-11-29T18:50:49.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 432 279827164998981 0 2015-11-29T18:50:49.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 433 104233923828681 0 2015-11-29T18:50:49.29-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 434 107907637386050 0 2015-11-29T18:50:49.291-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 435 222610787314776 0 2015-11-29T18:50:49.295-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 436 208321286293912 0 2015-11-29T18:50:49.295-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 437 239836010709106 0 2015-11-29T18:50:49.307-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 439 215257140047150 0 2015-11-29T18:50:49.307-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 438 130257797768591 0 2015-11-29T18:50:49.312-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 440 3283565500498 0 2015-11-29T18:50:49.313-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 441 119362901319265 0 2015-11-29T18:50:49.313-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 442 31018555665050 0 2015-11-29T18:50:49.313-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 443 262447814153031 0 2015-11-29T18:50:49.322-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 444 174063046698180 0 2015-11-29T18:50:49.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 445 199002004617211 0 2015-11-29T18:50:49.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 446 263095655857945 0 2015-11-29T18:50:49.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 447 166642128042427 0 2015-11-29T18:50:49.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 448 100787890303187 0 2015-11-29T18:50:49.329-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 454 242559895329499 0 2015-11-29T18:50:49.33-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 449 64223096213368 0 2015-11-29T18:50:49.33-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 450 172191411967 0 2015-11-29T18:50:49.331-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 451 30436004225975 0 2015-11-29T18:50:49.331-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 452 6646698874077 0 2015-11-29T18:50:49.331-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 453 45011556536196 0 2015-11-29T18:50:49.333-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 457 207409418815194 0 2015-11-29T18:50:49.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 455 209745102366783 0 2015-11-29T18:50:49.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 456 160804733033371 0 2015-11-29T18:50:49.336-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 458 210126739048700 0 2015-11-29T18:50:49.337-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 459 87718664448206 0 2015-11-29T18:50:49.347-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 460 27746861497186 0 2015-11-29T18:50:49.347-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 461 190966694657871 0 2015-11-29T18:50:49.35-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 462 29522947649472 0 2015-11-29T18:50:49.352-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 463 14544506216882 0 2015-11-29T18:50:49.352-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 464 216014566627345 0 2015-11-29T18:50:49.355-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 465 188372188243077 0 2015-11-29T18:50:49.357-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 466 75703523724381 0 2015-11-29T18:50:49.357-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 467 277793085245074 0 2015-11-29T18:50:49.36-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 468 20355699427310 0 2015-11-29T18:50:49.368-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 469 54066267664491 0 2015-11-29T18:50:49.368-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 470 164820826017604 0 2015-11-29T18:50:49.368-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 471 128361726347773 0 2015-11-29T18:50:49.37-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 472 200815698286014 0 2015-11-29T18:50:49.37-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 474 272867993183152 0 2015-11-29T18:50:49.372-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 473 11592251667949 0 2015-11-29T18:50:49.372-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 475 154861936772020 0 2015-11-29T18:50:49.372-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 476 218182716789549 0 2015-11-29T18:50:49.373-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 477 82192274048876 0 2015-11-29T18:50:49.373-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 478 268931581525210 0 2015-11-29T18:50:49.375-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 479 108470793576481 0 2015-11-29T18:50:49.376-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 480 231603610267852 0 2015-11-29T18:50:49.376-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 481 60875733461199 0 2015-11-29T18:50:49.384-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 482 148142047642158 0 2015-11-29T18:50:49.384-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 483 160668076760958 0 2015-11-29T18:50:49.387-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 486 2553988615823 0 2015-11-29T18:50:49.387-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 484 188801750107706 0 2015-11-29T18:50:49.388-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 485 280482578346092 0 2015-11-29T18:50:49.389-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 487 166941148721441 0 2015-11-29T18:50:49.389-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 488 32310457595737 0 2015-11-29T18:50:49.391-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 489 178752718627346 0 2015-11-29T18:50:49.392-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 491 175588032433784 0 2015-11-29T18:50:49.392-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 490 270027844952274 0 2015-11-29T18:50:49.393-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 492 183776162830496 0 2015-11-29T18:50:49.394-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 493 218452776391416 0 2015-11-29T18:50:49.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 494 121520390658396 0 2015-11-29T18:50:49.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 495 66287600364923 0 2015-11-29T18:50:49.4-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 496 54071191524973 0 2015-11-29T18:50:49.4-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 497 93799616571509 0 2015-11-29T18:50:49.4-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 498 138683010851737 0 2015-11-29T18:50:49.403-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 499 211631236894854 0 2015-11-29T18:50:49.403-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 500 262088265820514 0 2015-11-29T18:50:49.405-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 501 137152775265328 0 2015-11-29T18:50:49.405-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 502 98317951856118 0 2015-11-29T18:50:49.406-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 503 109067400243047 0 2015-11-29T18:50:49.406-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 505 30298537232230 0 2015-11-29T18:50:49.407-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 504 106784356521402 0 2015-11-29T18:50:49.409-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 507 68701143733214 0 2015-11-29T18:50:49.409-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 506 74254937247407 0 2015-11-29T18:50:49.409-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 508 71722345140669 0 2015-11-29T18:50:49.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 70000 2015-11-29T18:50:49.411-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 509 117047317649014 0 2015-11-29T18:50:49.416-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:49.419-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 510 112686899915816 0 2015-11-29T18:50:49.419-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 511 253972441717925 0 2015-11-29T18:50:49.423-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 InstanceIds [3094208154756435235] 2015-11-29T18:50:49.423-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T18:50:49.451-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.72:60251" +3 2015-11-29T18:50:49.531-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 80000 2015-11-29T18:50:49.613-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:49.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 90000 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 518 96472147199439 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 512 79700214137581 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 513 101257024300718 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 514 186777205266006 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 515 109352217534445 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 516 259784800329181 0 2015-11-29T18:50:49.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 517 165043711094714 0 2015-11-29T18:50:49.758-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 519 71058511533535 0 2015-11-29T18:50:49.758-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 520 269453747131715 0 2015-11-29T18:50:49.758-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 521 216859353499692 0 2015-11-29T18:50:49.774-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 522 48686048662730 0 2015-11-29T18:50:49.774-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 523 247771937139989 0 2015-11-29T18:50:49.796-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 525 31455176134364 0 2015-11-29T18:50:49.796-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 526 36204631139052 0 2015-11-29T18:50:49.797-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 100000 2015-11-29T18:50:49.797-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 524 21679160695968 0 2015-11-29T18:50:49.802-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 528 3751009596345 0 2015-11-29T18:50:49.802-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 529 165318383372189 0 2015-11-29T18:50:49.803-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 527 190350197980665 0 2015-11-29T18:50:49.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 530 73404512924355 0 2015-11-29T18:50:49.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 531 273108586515282 0 2015-11-29T18:50:49.811-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 532 138371238973869 0 2015-11-29T18:50:49.811-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 533 31559575077317 0 2015-11-29T18:50:49.811-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 534 213383591264842 0 2015-11-29T18:50:49.818-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 535 111588104477614 0 2015-11-29T18:50:49.818-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 536 109032815151165 0 2015-11-29T18:50:49.827-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 537 43485327752029 0 2015-11-29T18:50:49.827-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 538 114734752932175 0 2015-11-29T18:50:49.83-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 539 100419561433003 0 2015-11-29T18:50:49.83-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 540 276504961863976 0 2015-11-29T18:50:49.83-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 541 174277823239180 0 2015-11-29T18:50:49.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 543 11148113980746 0 2015-11-29T18:50:49.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 544 60582128467966 0 2015-11-29T18:50:49.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 545 16505940242717 0 2015-11-29T18:50:49.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 542 156250765413768 0 2015-11-29T18:50:49.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 546 59901076348201 0 2015-11-29T18:50:49.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 547 33866730916565 0 2015-11-29T18:50:49.841-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 550 13189960016610 0 2015-11-29T18:50:49.842-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 548 86537213972888 0 2015-11-29T18:50:49.842-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 549 138012104042897 0 2015-11-29T18:50:49.844-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 551 73443839244186 0 2015-11-29T18:50:49.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 552 36239899917098 0 2015-11-29T18:50:49.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 553 206077064805318 0 2015-11-29T18:50:49.853-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 554 10838525288209 0 2015-11-29T18:50:49.853-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 555 225523170836815 0 2015-11-29T18:50:49.853-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 557 20331950761583 0 2015-11-29T18:50:49.854-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 556 200741633993738 0 2015-11-29T18:50:49.86-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 560 38063654865705 0 2015-11-29T18:50:49.86-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 558 66149358542966 0 2015-11-29T18:50:49.861-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 559 30998471205445 0 2015-11-29T18:50:49.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 562 8432561856572 0 2015-11-29T18:50:49.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 563 281030856863419 0 2015-11-29T18:50:49.867-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 561 182052294213688 0 2015-11-29T18:50:49.869-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 564 242325540988678 0 2015-11-29T18:50:49.873-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 110000 2015-11-29T18:50:49.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 566 151749047543811 0 2015-11-29T18:50:49.874-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 567 91907548672702 0 2015-11-29T18:50:49.875-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 565 96191728226311 0 2015-11-29T18:50:49.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 571 64595060784996 0 2015-11-29T18:50:49.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 568 108976728197298 0 2015-11-29T18:50:49.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 569 58246595517018 0 2015-11-29T18:50:49.88-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 570 28404685047090 0 2015-11-29T18:50:49.882-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 573 34071742353155 0 2015-11-29T18:50:49.882-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 574 157765385909872 0 2015-11-29T18:50:49.883-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 572 138936771548899 0 2015-11-29T18:50:49.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 575 259616197240533 0 2015-11-29T18:50:49.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 576 13455167393987 0 2015-11-29T18:50:49.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 577 26134670959408 0 2015-11-29T18:50:49.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 578 73549417331232 0 2015-11-29T18:50:49.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 579 21922517081173 0 2015-11-29T18:50:49.892-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:49.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 580 264971416051366 0 2015-11-29T18:50:49.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 581 107456792908191 0 2015-11-29T18:50:49.901-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 582 145337047068953 0 2015-11-29T18:50:49.905-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 583 149473326795790 0 2015-11-29T18:50:49.905-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 584 198168283219884 0 2015-11-29T18:50:49.905-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 585 216326811751893 0 2015-11-29T18:50:49.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 587 260179971260646 0 2015-11-29T18:50:49.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 588 51784885622133 0 2015-11-29T18:50:49.907-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 586 229208841769857 0 2015-11-29T18:50:49.912-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 589 146392694152127 0 2015-11-29T18:50:49.912-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 590 273294125106576 0 2015-11-29T18:50:49.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 592 181615591525898 0 2015-11-29T18:50:49.918-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 591 35408598883734 0 2015-11-29T18:50:49.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 593 13435584848859 0 2015-11-29T18:50:49.935-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 594 71425933299785 0 2015-11-29T18:50:49.935-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 595 101417482686287 0 2015-11-29T18:50:49.938-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 596 40750530491273 0 2015-11-29T18:50:49.941-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 597 206973637702622 0 2015-11-29T18:50:49.941-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 598 31298548288106 0 2015-11-29T18:50:49.942-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 599 236011518001790 0 2015-11-29T18:50:49.949-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 50000 QueuedCount 47008 2015-11-29T18:50:49.951-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 601 217471125667307 0 2015-11-29T18:50:49.953-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 600 227759913706791 0 2015-11-29T18:50:49.959-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 603 100834048049620 0 2015-11-29T18:50:49.96-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 602 268907507193588 0 2015-11-29T18:50:49.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 604 107389171423966 0 2015-11-29T18:50:49.972-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 606 71055143108975 0 2015-11-29T18:50:49.972-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 605 39920300509456 0 2015-11-29T18:50:49.979-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 607 127386333986832 0 2015-11-29T18:50:49.979-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 608 259079362749190 0 2015-11-29T18:50:49.981-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 609 209079757430189 0 2015-11-29T18:50:49.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 610 183767982180738 0 2015-11-29T18:50:49.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 611 160257059461210 0 2015-11-29T18:50:49.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 612 268264995387482 0 2015-11-29T18:50:49.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 613 276973734830857 0 2015-11-29T18:50:49.997-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 614 57022188078045 0 2015-11-29T18:50:49.997-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 615 131487608558068 0 2015-11-29T18:50:49.998-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 120000 2015-11-29T18:50:50.002-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 616 50086916347572 0 2015-11-29T18:50:50.002-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 617 122888159381550 0 2015-11-29T18:50:50.01-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 618 128443749923215 0 2015-11-29T18:50:50.014-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 619 38593709218431 0 2015-11-29T18:50:50.014-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 620 261010749501641 0 2015-11-29T18:50:50.016-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 622 152745166891788 0 2015-11-29T18:50:50.016-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 621 198982204436861 0 2015-11-29T18:50:50.017-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 623 189369504844583 0 2015-11-29T18:50:50.017-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 624 94929839419646 0 2015-11-29T18:50:50.022-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 625 21756731703031 0 2015-11-29T18:50:50.022-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 626 193346754560348 0 2015-11-29T18:50:50.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 628 13718641982946 0 2015-11-29T18:50:50.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 629 260903657470336 0 2015-11-29T18:50:50.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 627 255797024524075 0 2015-11-29T18:50:50.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 630 84530373630384 0 2015-11-29T18:50:50.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 631 50837164004962 0 2015-11-29T18:50:50.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 632 40684630184334 0 2015-11-29T18:50:50.034-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 633 182956364044168 0 2015-11-29T18:50:50.034-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 634 124023389780787 0 2015-11-29T18:50:50.034-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 636 258878465930780 0 2015-11-29T18:50:50.034-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 635 78888102096482 0 2015-11-29T18:50:50.034-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 637 278122850159821 0 2015-11-29T18:50:50.038-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 638 206751527115549 0 2015-11-29T18:50:50.04-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 640 56623613565348 0 2015-11-29T18:50:50.041-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 641 153331401509667 0 2015-11-29T18:50:50.041-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 642 269211962341872 0 2015-11-29T18:50:50.041-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 643 94301973620295 0 2015-11-29T18:50:50.041-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 639 9769662964195 0 2015-11-29T18:50:50.047-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 644 233148871963467 0 2015-11-29T18:50:50.049-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 645 216853524912592 0 2015-11-29T18:50:50.053-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 646 118280773181320 0 2015-11-29T18:50:50.053-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 647 199497166874447 0 2015-11-29T18:50:50.056-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 648 262618548015121 0 2015-11-29T18:50:50.06-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 649 109349224960308 0 2015-11-29T18:50:50.068-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 650 233855907273732 0 2015-11-29T18:50:50.069-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 651 113588277075067 0 2015-11-29T18:50:50.071-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 652 242430194852871 0 2015-11-29T18:50:50.071-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 653 201177356044146 0 2015-11-29T18:50:50.078-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 130000 2015-11-29T18:50:50.08-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 655 67523762105789 0 2015-11-29T18:50:50.081-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 656 199125150476137 0 2015-11-29T18:50:50.081-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 658 7875432334881 0 2015-11-29T18:50:50.081-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 659 17201409439164 0 2015-11-29T18:50:50.081-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 657 201712668563551 0 2015-11-29T18:50:50.087-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 654 34486152350734 0 2015-11-29T18:50:50.094-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 662 136333032562863 0 2015-11-29T18:50:50.094-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 664 186465006628082 0 2015-11-29T18:50:50.094-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 665 104142777816932 0 2015-11-29T18:50:50.094-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 661 141926155370049 0 2015-11-29T18:50:50.095-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 660 49186616120368 0 2015-11-29T18:50:50.095-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 663 214823881623808 0 2015-11-29T18:50:50.097-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 666 125707054170423 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 667 64392102505384 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 671 276700517614203 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 673 85726012193429 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 674 224222537492437 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 668 25522214710692 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 669 264753318725722 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 670 102810984450295 0 2015-11-29T18:50:50.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 672 1893416811263 0 2015-11-29T18:50:50.125-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 678 254382842094014 0 2015-11-29T18:50:50.127-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 675 56847994516552 0 2015-11-29T18:50:50.127-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 676 194225584939516 0 2015-11-29T18:50:50.127-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 677 49859686322644 0 2015-11-29T18:50:50.127-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 679 199106809423943 0 2015-11-29T18:50:50.128-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 681 137929345084299 0 2015-11-29T18:50:50.128-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 682 140757724526052 0 2015-11-29T18:50:50.128-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 60000 QueuedCount 49962 2015-11-29T18:50:50.128-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 683 173803159930813 0 2015-11-29T18:50:50.129-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 680 244128130816587 0 2015-11-29T18:50:50.137-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 685 10806270154912 0 2015-11-29T18:50:50.138-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 684 249052515514893 0 2015-11-29T18:50:50.142-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 686 194580717724173 0 2015-11-29T18:50:50.142-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 687 277068430045654 0 2015-11-29T18:50:50.145-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 688 172368802327975 0 2015-11-29T18:50:50.145-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 689 279085094041611 0 2015-11-29T18:50:50.147-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 690 92699729196714 0 2015-11-29T18:50:50.147-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 691 278234378739165 0 2015-11-29T18:50:50.149-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 692 124695729529843 0 2015-11-29T18:50:50.153-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 693 184510663125221 0 2015-11-29T18:50:50.153-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 694 221235801969709 0 2015-11-29T18:50:50.162-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 697 398156157848 0 2015-11-29T18:50:50.162-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 698 84562269036845 0 2015-11-29T18:50:50.162-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 699 59981894757673 0 2015-11-29T18:50:50.162-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 700 151593193648129 0 2015-11-29T18:50:50.163-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 696 182982631157568 0 2015-11-29T18:50:50.165-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 695 217152640210106 0 2015-11-29T18:50:50.183-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 140000 2015-11-29T18:50:50.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 701 68085300355788 0 2015-11-29T18:50:50.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 703 154038651294339 0 2015-11-29T18:50:50.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 704 32203940127876 0 2015-11-29T18:50:50.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 705 218229761040753 0 2015-11-29T18:50:50.186-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 702 113931104111829 0 2015-11-29T18:50:50.189-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 706 218371087349173 0 2015-11-29T18:50:50.196-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 708 101648649603669 0 2015-11-29T18:50:50.196-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 707 192840665546596 0 2015-11-29T18:50:50.197-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 709 34682756535475 0 2015-11-29T18:50:50.237-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 710 81977915151963 0 2015-11-29T18:50:50.238-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 711 86767442918538 0 2015-11-29T18:50:50.239-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 712 87970727856598 0 2015-11-29T18:50:50.241-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 713 219052378583167 0 2015-11-29T18:50:50.243-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 714 225516928709701 0 2015-11-29T18:50:50.243-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 715 23504721723095 0 2015-11-29T18:50:50.26-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:50.266-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 716 246492919484896 0 2015-11-29T18:50:50.281-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 717 184184625273153 0 2015-11-29T18:50:50.286-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 718 31133102689505 0 2015-11-29T18:50:50.288-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 719 47936414817011 0 2015-11-29T18:50:50.29-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 720 71399436010772 0 2015-11-29T18:50:50.291-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 721 269840317764344 0 2015-11-29T18:50:50.292-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 722 109873625265193 0 2015-11-29T18:50:50.293-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 150000 2015-11-29T18:50:50.293-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 723 270681613189757 0 2015-11-29T18:50:50.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 724 141372977350071 0 2015-11-29T18:50:50.301-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 726 88624865172109 0 2015-11-29T18:50:50.301-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 725 209044236734087 0 2015-11-29T18:50:50.303-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 727 113574565231764 0 2015-11-29T18:50:50.303-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 728 80221232019285 0 2015-11-29T18:50:50.303-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 729 195519486969065 0 2015-11-29T18:50:50.322-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 70000 QueuedCount 50000 2015-11-29T18:50:50.325-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 InstanceIds [3094208154756435235] 2015-11-29T18:50:50.326-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T18:50:50.33-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 730 66283632850829 0 2015-11-29T18:50:50.335-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 731 30296677541829 0 2015-11-29T18:50:50.336-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 732 26523670010800 0 2015-11-29T18:50:50.355-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 733 126091928702914 0 2015-11-29T18:50:50.356-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 734 134524718808225 0 2015-11-29T18:50:50.358-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 735 149131686446847 0 2015-11-29T18:50:50.366-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 736 223438113276757 0 2015-11-29T18:50:50.37-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 737 96719147654757 0 2015-11-29T18:50:50.375-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 738 16549954363084 0 2015-11-29T18:50:50.376-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 739 103983684015228 0 2015-11-29T18:50:50.381-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 740 221051916259200 0 2015-11-29T18:50:50.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 741 92647512687246 0 2015-11-29T18:50:50.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 742 222558527049171 0 2015-11-29T18:50:50.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 743 164182202337738 0 2015-11-29T18:50:50.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 744 254523078920793 0 2015-11-29T18:50:50.397-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 745 263068515399860 0 2015-11-29T18:50:50.4-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 160000 2015-11-29T18:50:50.402-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 746 22807649153840 0 2015-11-29T18:50:50.426-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 747 138063070621720 0 2015-11-29T18:50:50.442-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 748 202072577499483 0 2015-11-29T18:50:50.445-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 749 29244478780113 0 2015-11-29T18:50:50.449-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 750 198404974288828 0 2015-11-29T18:50:50.451-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 751 116088788952972 0 2015-11-29T18:50:50.455-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 752 160982802160647 0 2015-11-29T18:50:50.457-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 753 152872064669505 0 2015-11-29T18:50:50.458-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 754 38478611255699 0 2015-11-29T18:50:50.466-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 755 159040661395582 0 2015-11-29T18:50:50.469-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 756 175977186596243 0 2015-11-29T18:50:50.475-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.73:43758" +4 2015-11-29T18:50:50.479-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 757 228661538440516 0 2015-11-29T18:50:50.485-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 758 279020653056154 0 2015-11-29T18:50:50.486-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 759 276101434011957 0 2015-11-29T18:50:50.492-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 760 33999638195526 0 2015-11-29T18:50:50.492-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 761 258723945305864 0 2015-11-29T18:50:50.494-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 762 263132032460465 0 2015-11-29T18:50:50.503-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 763 231751802822868 0 2015-11-29T18:50:50.503-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 80000 QueuedCount 50000 2015-11-29T18:50:50.508-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 764 51973947139062 0 2015-11-29T18:50:50.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 170000 2015-11-29T18:50:50.512-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 765 221341227025557 0 2015-11-29T18:50:50.575-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 766 270166886779191 0 2015-11-29T18:50:50.585-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 767 166647038170393 0 2015-11-29T18:50:50.703-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 180000 2015-11-29T18:50:50.853-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 190000 2015-11-29T18:50:51.003-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 200000 2015-11-29T18:50:51.158-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 210000 2015-11-29T18:50:51.312-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1b:44:cb:a3:85:a1:38:78 bucket-1 InstanceIds [3094208154756435235] 2015-11-29T18:50:51.313-08:00 [Info] Indexer::sendStreamUpdateForBuildIndex Stream Request Success For Stream MAINT_STREAM Bucket bucket-1. 2015-11-29T18:50:51.313-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 220000 2015-11-29T18:50:51.316-08:00 [Info] Indexer::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2015-11-29T18:50:51.316-08:00 [Info] Timekeeper::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2015-11-29T18:50:51.316-08:00 [Info] Timekeeper::handleStreamRequestDone Call RepairStream to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2015-11-29T18:50:51.316-08:00 [Info] Timekeeper::handleStreamRequestDone Call RepairMissingStreamBegin to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2015-11-29T18:50:51.316-08:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM 2015-11-29T18:50:51.429-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:51.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 230000 2015-11-29T18:50:51.458-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 90000 QueuedCount 50000 2015-11-29T18:50:51.543-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 240000 2015-11-29T18:50:51.547-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 770 163847010658722 0 2015-11-29T18:50:51.547-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 775 228088540250532 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 776 88926226319102 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 779 206195860460582 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 786 148726527471953 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 774 34346543213414 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 777 247973604273828 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 778 76451226567360 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 780 103950975597865 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 784 247835826077303 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 785 202457859995609 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 768 195000500870267 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 769 155672829604603 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 771 108903368234136 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 772 145740395823388 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 781 75248085340356 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 783 249797793692456 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 787 213744207469005 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 789 238510348544606 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 790 146351053518970 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 773 235279432445799 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 782 66562277094138 0 2015-11-29T18:50:51.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 788 72520242177739 0 2015-11-29T18:50:51.564-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 791 251245130084607 0 2015-11-29T18:50:51.564-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 792 93313626659257 0 2015-11-29T18:50:51.564-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 793 75469247977019 0 2015-11-29T18:50:51.587-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 794 273637209308542 0 2015-11-29T18:50:51.587-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 795 271035108396086 0 2015-11-29T18:50:51.587-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 796 185941504769876 0 2015-11-29T18:50:51.601-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 797 217468662049274 0 2015-11-29T18:50:51.601-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 798 144142452617615 0 2015-11-29T18:50:51.601-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 799 151171395044719 0 2015-11-29T18:50:51.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 800 247956798393804 0 2015-11-29T18:50:51.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 801 73878657562989 0 2015-11-29T18:50:51.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 802 244576116882032 0 2015-11-29T18:50:51.63-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 100000 QueuedCount 50000 2015-11-29T18:50:51.634-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 803 81362543280344 0 2015-11-29T18:50:51.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 250000 2015-11-29T18:50:51.673-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 805 249736834936912 0 2015-11-29T18:50:51.674-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 804 196229119691456 0 2015-11-29T18:50:51.681-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 806 268277272146021 0 2015-11-29T18:50:51.682-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 807 153685348738293 0 2015-11-29T18:50:51.682-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 808 193098394870612 0 2015-11-29T18:50:51.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 809 51402373533061 0 2015-11-29T18:50:51.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 810 95577645559072 0 2015-11-29T18:50:51.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 811 79234696368092 0 2015-11-29T18:50:51.713-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 815 53887973269360 0 2015-11-29T18:50:51.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 812 104176761748425 0 2015-11-29T18:50:51.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 813 49200543926025 0 2015-11-29T18:50:51.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 814 143215532205746 0 2015-11-29T18:50:51.725-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 816 216689356093792 0 2015-11-29T18:50:51.725-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 817 93242813290516 0 2015-11-29T18:50:51.725-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 818 265825639561613 0 2015-11-29T18:50:51.725-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 819 212082295489005 0 2015-11-29T18:50:51.729-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 820 125765739918581 0 2015-11-29T18:50:51.732-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:51.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 821 8075299102992 0 2015-11-29T18:50:51.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 822 106103215619886 0 2015-11-29T18:50:51.744-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 823 135750192535827 0 2015-11-29T18:50:51.751-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 824 193147552402735 0 2015-11-29T18:50:51.752-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 825 29390055055989 0 2015-11-29T18:50:51.761-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 260000 2015-11-29T18:50:51.761-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 826 175134135634041 0 2015-11-29T18:50:51.761-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 827 147962401272257 0 2015-11-29T18:50:51.761-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 828 240909406702972 0 2015-11-29T18:50:51.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 829 240955148082202 0 2015-11-29T18:50:51.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 830 210290904363207 0 2015-11-29T18:50:51.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 831 98674630866360 0 2015-11-29T18:50:51.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 832 55728082252452 0 2015-11-29T18:50:51.79-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 833 115382176963596 0 2015-11-29T18:50:51.79-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 834 271910794934237 0 2015-11-29T18:50:51.795-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 835 169236211555689 0 2015-11-29T18:50:51.795-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 836 64967457374865 0 2015-11-29T18:50:51.798-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 841 20036463294184 0 2015-11-29T18:50:51.798-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 842 116619061062629 0 2015-11-29T18:50:51.798-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 837 40007675762257 0 2015-11-29T18:50:51.799-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 838 256777672972906 0 2015-11-29T18:50:51.799-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 839 193898095058524 0 2015-11-29T18:50:51.799-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 840 51165323565530 0 2015-11-29T18:50:51.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 844 94778039693589 0 2015-11-29T18:50:51.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 845 33832497382615 0 2015-11-29T18:50:51.808-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 843 202352429083161 0 2015-11-29T18:50:51.812-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 110000 QueuedCount 50000 2015-11-29T18:50:51.813-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 846 164870565223348 0 2015-11-29T18:50:51.813-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 847 12519141527597 0 2015-11-29T18:50:51.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 849 242026373328783 0 2015-11-29T18:50:51.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 850 215698969104713 0 2015-11-29T18:50:51.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 848 108019770957960 0 2015-11-29T18:50:51.832-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 851 196281236812805 0 2015-11-29T18:50:51.832-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 852 271684396173034 0 2015-11-29T18:50:51.843-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 853 13825490230659 0 2015-11-29T18:50:51.845-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 854 9430379785909 0 2015-11-29T18:50:51.845-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 855 233605562420782 0 2015-11-29T18:50:51.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 856 132786413409887 0 2015-11-29T18:50:51.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 857 276588511861294 0 2015-11-29T18:50:51.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 858 107657584871668 0 2015-11-29T18:50:51.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 859 101815985845032 0 2015-11-29T18:50:51.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 860 121373338289518 0 2015-11-29T18:50:51.868-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 270000 2015-11-29T18:50:51.876-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 862 222408966428007 0 2015-11-29T18:50:51.876-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 861 192450904836369 0 2015-11-29T18:50:51.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 863 174281181139876 0 2015-11-29T18:50:51.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 864 158134771499017 0 2015-11-29T18:50:51.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 865 36666867751105 0 2015-11-29T18:50:51.895-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 866 97921031694657 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 867 9010583546000 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 868 104344622065094 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 869 60876436389066 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 870 170416794015641 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 874 28690391284577 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 878 18611834543107 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 880 193937356932270 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 872 171995237906527 0 2015-11-29T18:50:51.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 875 176296848367994 0 2015-11-29T18:50:51.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 876 209628411274505 0 2015-11-29T18:50:51.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 879 100179564922018 0 2015-11-29T18:50:51.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 871 220834956150764 0 2015-11-29T18:50:51.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 873 89951570811458 0 2015-11-29T18:50:51.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 877 218649161514574 0 2015-11-29T18:50:51.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 881 234187205265714 0 2015-11-29T18:50:51.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 883 122186385780751 0 2015-11-29T18:50:51.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 882 155290927973855 0 2015-11-29T18:50:51.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 884 200960653470927 0 2015-11-29T18:50:51.91-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 885 7382264760402 0 2015-11-29T18:50:51.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 886 215018124988513 0 2015-11-29T18:50:51.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 887 5338831272050 0 2015-11-29T18:50:51.92-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 888 77962394486158 0 2015-11-29T18:50:51.921-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 889 173646407948969 0 2015-11-29T18:50:51.927-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 891 97206368444438 0 2015-11-29T18:50:51.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 890 174529521587564 0 2015-11-29T18:50:51.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 892 3088263599486 0 2015-11-29T18:50:51.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 893 650144944993 0 2015-11-29T18:50:51.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 894 88300316146974 0 2015-11-29T18:50:51.931-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 895 263116730876486 0 2015-11-29T18:50:51.95-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 896 18574322877258 0 2015-11-29T18:50:51.95-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 897 63647698160386 0 2015-11-29T18:50:51.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 898 177640196299282 0 2015-11-29T18:50:51.963-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 899 45104473073999 0 2015-11-29T18:50:51.968-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 900 64988338547131 0 2015-11-29T18:50:51.972-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 901 243486180725224 0 2015-11-29T18:50:51.978-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 902 207844256972739 0 2015-11-29T18:50:51.98-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 280000 2015-11-29T18:50:51.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 904 197029221682078 0 2015-11-29T18:50:51.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 903 98678324256576 0 2015-11-29T18:50:51.996-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 905 132302530846365 0 2015-11-29T18:50:51.996-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 120000 QueuedCount 50000 2015-11-29T18:50:51.999-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 907 187697551289954 0 2015-11-29T18:50:52.004-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 906 257775260029908 0 2015-11-29T18:50:52.004-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 909 207843727398991 0 2015-11-29T18:50:52.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 908 190814365842956 0 2015-11-29T18:50:52.009-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 910 213051010063675 0 2015-11-29T18:50:52.01-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:52.022-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 911 168350414826061 0 2015-11-29T18:50:52.036-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 912 257960645828158 0 2015-11-29T18:50:52.04-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 913 158027699216238 0 2015-11-29T18:50:52.042-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 914 208051120993125 0 2015-11-29T18:50:52.043-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 915 272669954262236 0 2015-11-29T18:50:52.092-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 916 59823849380539 0 2015-11-29T18:50:52.092-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 917 69609509628036 0 2015-11-29T18:50:52.1-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 918 64022163192204 0 2015-11-29T18:50:52.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 290000 2015-11-29T18:50:52.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 919 84902489761205 0 2015-11-29T18:50:52.126-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 920 118648899711002 0 2015-11-29T18:50:52.13-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 921 258318419171369 0 2015-11-29T18:50:52.135-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 922 200719610785405 0 2015-11-29T18:50:52.139-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 923 230584492813688 0 2015-11-29T18:50:52.17-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 924 240178583620565 0 2015-11-29T18:50:52.177-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 925 189656617742391 0 2015-11-29T18:50:52.184-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 927 173413157804902 0 2015-11-29T18:50:52.185-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 926 239691453710644 0 2015-11-29T18:50:52.216-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 928 210575002012118 0 2015-11-29T18:50:52.218-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 929 267422299205106 0 2015-11-29T18:50:52.219-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 930 164820715358759 0 2015-11-29T18:50:52.221-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 931 271878034818102 0 2015-11-29T18:50:52.221-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 932 277227594943317 0 2015-11-29T18:50:52.24-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 933 266502353624483 0 2015-11-29T18:50:52.241-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 934 147388758815952 0 2015-11-29T18:50:52.243-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 935 168239455289679 0 2015-11-29T18:50:52.265-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 936 153457528287355 0 2015-11-29T18:50:52.27-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 937 13531498869827 0 2015-11-29T18:50:52.273-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 300000 2015-11-29T18:50:52.275-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 938 159474895937221 0 2015-11-29T18:50:52.277-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 939 102407851823811 0 2015-11-29T18:50:52.302-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 940 85855800684259 0 2015-11-29T18:50:52.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 941 158812379754015 0 2015-11-29T18:50:52.315-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 942 45151529919204 0 2015-11-29T18:50:52.316-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 943 115541333802524 0 2015-11-29T18:50:52.317-08:00 [Info] StreamState::adjustNonSnapAlignedVbs Bucket bucket-1 StreamId MAINT_STREAM Vbuckets []. 2015-11-29T18:50:52.317-08:00 [Info] Timekeeper::repairStream Nothing to repair for Stream MAINT_STREAM and Bucket bucket-1 2015-11-29T18:50:52.319-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 944 95668456662855 0 2015-11-29T18:50:52.329-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 945 165978145509896 0 2015-11-29T18:50:52.342-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 946 270347860093221 0 2015-11-29T18:50:52.343-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 947 246483637722133 0 2015-11-29T18:50:52.355-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 948 1496135745347 0 2015-11-29T18:50:52.355-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 949 109370645579144 0 2015-11-29T18:50:52.36-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 950 220726256219615 0 2015-11-29T18:50:52.361-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 951 102327995421761 0 2015-11-29T18:50:52.368-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 952 143693120242602 0 2015-11-29T18:50:52.387-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 953 72496121990919 0 2015-11-29T18:50:52.39-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 954 257042048024574 0 2015-11-29T18:50:52.394-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 955 238949445515062 0 2015-11-29T18:50:52.395-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 956 21357744278556 0 2015-11-29T18:50:52.42-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 958 218465681683204 0 2015-11-29T18:50:52.42-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 957 29235331162622 0 2015-11-29T18:50:52.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 310000 2015-11-29T18:50:52.442-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 959 195208965470858 0 2015-11-29T18:50:52.443-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 960 18209830886457 0 2015-11-29T18:50:52.447-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 961 182809992345078 0 2015-11-29T18:50:52.447-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 962 151724057452703 0 2015-11-29T18:50:52.447-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 963 191339023801021 0 2015-11-29T18:50:52.449-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 964 81947857399099 0 2015-11-29T18:50:52.467-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 965 250764572160122 0 2015-11-29T18:50:52.481-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 966 57792469685255 0 2015-11-29T18:50:52.481-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 967 83623175546782 0 2015-11-29T18:50:52.487-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 968 275764823985236 0 2015-11-29T18:50:52.487-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 969 64190774648482 0 2015-11-29T18:50:52.492-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 970 20056888486773 0 2015-11-29T18:50:52.499-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 972 151960479493829 0 2015-11-29T18:50:52.5-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 971 172354784353690 0 2015-11-29T18:50:52.51-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 973 43042582503141 0 2015-11-29T18:50:52.521-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 974 251726030468514 0 2015-11-29T18:50:52.524-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 975 157564318711312 0 2015-11-29T18:50:52.525-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 976 242803987930854 0 2015-11-29T18:50:52.527-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 977 112306156757938 0 2015-11-29T18:50:52.527-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 978 236058346923467 0 2015-11-29T18:50:52.541-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 979 126981425086761 0 2015-11-29T18:50:52.552-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 980 229894052743809 0 2015-11-29T18:50:52.56-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 982 250812884905321 0 2015-11-29T18:50:52.561-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 981 85554074769416 0 2015-11-29T18:50:52.581-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 983 212298193634991 0 2015-11-29T18:50:52.584-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 984 128096691580702 0 2015-11-29T18:50:52.585-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 985 229623542177016 0 2015-11-29T18:50:52.597-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 320000 2015-11-29T18:50:52.603-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 986 7184896548456 0 2015-11-29T18:50:52.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 987 17731328590626 0 2015-11-29T18:50:52.623-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 988 17977326348915 0 2015-11-29T18:50:52.631-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 989 250649342025226 0 2015-11-29T18:50:52.632-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 990 13286446669499 0 2015-11-29T18:50:52.635-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 991 49119388994925 0 2015-11-29T18:50:52.637-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 992 211236987404372 0 2015-11-29T18:50:52.637-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 993 15457110985228 0 2015-11-29T18:50:52.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 994 136839671837568 0 2015-11-29T18:50:52.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 995 116532608327687 0 2015-11-29T18:50:52.657-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 996 182447293527718 0 2015-11-29T18:50:52.684-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 997 211699642032562 0 2015-11-29T18:50:52.685-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 998 52490209641156 0 2015-11-29T18:50:52.703-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 999 43423901486818 0 2015-11-29T18:50:52.708-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1000 208989890574944 0 2015-11-29T18:50:52.716-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1001 103045665771510 0 2015-11-29T18:50:52.72-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1002 239918437681470 0 2015-11-29T18:50:52.73-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1004 197570065922260 0 2015-11-29T18:50:52.731-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1003 244045004214587 0 2015-11-29T18:50:52.736-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1005 205849564430 0 2015-11-29T18:50:52.74-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1006 182720928174379 0 2015-11-29T18:50:52.75-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1007 278258344246456 0 2015-11-29T18:50:52.75-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1008 127603215710800 0 2015-11-29T18:50:52.808-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 330000 2015-11-29T18:50:52.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1009 62689284816456 0 2015-11-29T18:50:52.849-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1010 85285684596424 0 2015-11-29T18:50:52.856-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1011 129077800847204 0 2015-11-29T18:50:52.856-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1012 241997026605126 0 2015-11-29T18:50:52.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1014 179264509292767 0 2015-11-29T18:50:52.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1013 141397561938021 0 2015-11-29T18:50:52.89-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1015 212013858720089 0 2015-11-29T18:50:52.892-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1016 34829176814870 0 2015-11-29T18:50:52.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1017 136431084675167 0 2015-11-29T18:50:52.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1018 93385279693103 0 2015-11-29T18:50:52.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1019 238724177683432 0 2015-11-29T18:50:52.918-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1020 136838319028589 0 2015-11-29T18:50:52.924-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1021 12436319036719 0 2015-11-29T18:50:52.932-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1022 84503192382646 0 2015-11-29T18:50:52.944-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1023 148660425059267 0 2015-11-29T18:50:52.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 340000 2015-11-29T18:50:52.999-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 130000 QueuedCount 50000 2015-11-29T18:50:53.046-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 350000 2015-11-29T18:50:53.107-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 140000 QueuedCount 43207 2015-11-29T18:50:53.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 360000 2015-11-29T18:50:53.218-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 150000 QueuedCount 33207 2015-11-29T18:50:53.317-08:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM done 2015-11-29T18:50:53.332-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 160000 QueuedCount 23207 2015-11-29T18:50:53.332-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 370000 2015-11-29T18:50:53.384-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":0,"bucket-1:by_capped_small_0:avg_ts_items_count":0,"bucket-1:by_capped_small_0:build_progress":0,"bucket-1:by_capped_small_0:data_size":16812269,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":24576,"bucket-1:by_capped_small_0:flush_queue_size":20312,"bucket-1:by_capped_small_0:frag_percent":0,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":5789757,"bucket-1:by_capped_small_0:items_count":0,"bucket-1:by_capped_small_0:num_commits":0,"bucket-1:by_capped_small_0:num_compactions":0,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":170671,"bucket-1:by_capped_small_0:num_docs_pending":19702430,"bucket-1:by_capped_small_0:num_docs_queued":126899,"bucket-1:by_capped_small_0:num_flush_queued":183207,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":0,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":0,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"0 0 0","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"162896 1100024927 3323965172745873","bucket-1:by_capped_small_0:timings/storage_handle_open":"0 0 0","bucket-1:by_capped_small_0:timings/storage_info":"1 6836 46730896","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_set":"0 0 0","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"163843 3022689129 1619605718553602277","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":190497,"bucket-1:num_mutations_queued":373704,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":13,"memory_quota":104857600000,"memory_used":17338368,"needs_restart":false,"num_connections":0,"timings/stats_response":"1438 130352802 1464234676857080"} 2015-11-29T18:50:53.384-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:23063314, Disk:24576, ExtraSnapshotData:0, Fragmentation:0% 2015-11-29T18:50:53.479-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 380000 2015-11-29T18:50:53.625-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 390000 2015-11-29T18:50:53.764-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 400000 2015-11-29T18:50:53.91-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 410000 2015-11-29T18:50:53.91-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 170000 QueuedCount 13207 2015-11-29T18:50:54.007-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 180000 QueuedCount 3207 2015-11-29T18:50:54.054-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 420000 2015-11-29T18:50:54.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 430000 2015-11-29T18:50:54.364-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 440000 2015-11-29T18:50:54.515-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 450000 2015-11-29T18:50:54.628-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.010114123s CommitTime 581.330161ms TotalFlushTime 4.98905037s TotalCommitTime 581.330161ms 2015-11-29T18:50:54.628-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 92669, 92669, 1 committed:true 2015-11-29T18:50:54.628-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 11004501655997803646 (SnapshotInfo: seqnos: 92669, 92669, 1 committed:true) SnapCreateDur 1.593271839s SnapOpenDur 255.233µs 2015-11-29T18:50:54.709-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:54.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 460000 2015-11-29T18:50:54.746-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:54.79-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:54.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 470000 2015-11-29T18:50:54.858-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 190000 QueuedCount 50000 2015-11-29T18:50:54.864-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 480000 2015-11-29T18:50:54.872-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:54.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 490000 2015-11-29T18:50:55.016-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 500000 2015-11-29T18:50:55.054-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 200000 QueuedCount 50000 2015-11-29T18:50:55.092-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 510000 2015-11-29T18:50:55.167-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 520000 2015-11-29T18:50:55.235-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:55.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 530000 2015-11-29T18:50:55.261-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 210000 QueuedCount 50000 2015-11-29T18:50:55.359-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 540000 2015-11-29T18:50:55.471-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 220000 QueuedCount 50000 2015-11-29T18:50:55.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 550000 2015-11-29T18:50:55.605-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 560000 2015-11-29T18:50:55.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 570000 2015-11-29T18:50:55.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 580000 2015-11-29T18:50:56.081-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 590000 2015-11-29T18:50:56.228-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 600000 2015-11-29T18:50:56.326-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:56.351-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 610000 2015-11-29T18:50:56.361-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 230000 QueuedCount 50000 2015-11-29T18:50:56.469-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 620000 2015-11-29T18:50:56.581-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 630000 2015-11-29T18:50:56.583-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 240000 QueuedCount 50000 2015-11-29T18:50:56.631-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:56.698-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 640000 2015-11-29T18:50:56.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 650000 2015-11-29T18:50:56.825-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 250000 QueuedCount 50000 2015-11-29T18:50:56.946-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 660000 2015-11-29T18:50:56.955-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:57.068-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 670000 2015-11-29T18:50:57.075-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 260000 QueuedCount 50000 2015-11-29T18:50:57.192-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 680000 2015-11-29T18:50:57.358-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 690000 2015-11-29T18:50:57.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 700000 2015-11-29T18:50:57.73-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 710000 2015-11-29T18:50:57.873-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 720000 2015-11-29T18:50:57.958-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:50:57.982-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 270000 QueuedCount 50000 2015-11-29T18:50:57.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 730000 2015-11-29T18:50:58.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 740000 2015-11-29T18:50:58.103-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 280000 QueuedCount 49549 2015-11-29T18:50:58.194-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 750000 2015-11-29T18:50:58.283-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 290000 QueuedCount 39549 2015-11-29T18:50:58.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 760000 2015-11-29T18:50:58.382-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 300000 QueuedCount 29549 2015-11-29T18:50:58.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 770000 2015-11-29T18:50:58.655-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 780000 2015-11-29T18:50:58.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 790000 2015-11-29T18:50:58.98-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 800000 2015-11-29T18:50:59.128-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 810000 2015-11-29T18:50:59.211-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 310000 QueuedCount 19549 2015-11-29T18:50:59.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 820000 2015-11-29T18:50:59.306-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 320000 QueuedCount 9549 2015-11-29T18:50:59.421-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 830000 2015-11-29T18:50:59.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 840000 2015-11-29T18:50:59.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 850000 2015-11-29T18:50:59.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 860000 2015-11-29T18:51:00.041-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 9.763µs CommitTime 630.140129ms TotalFlushTime 9.493202412s TotalCommitTime 1.21147029s 2015-11-29T18:51:00.041-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 166885, 166885, 2 committed:true 2015-11-29T18:51:00.041-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 10712277186853337175 (SnapshotInfo: seqnos: 166885, 166885, 2 committed:true) SnapCreateDur 636.24521ms SnapOpenDur 62.438µs 2015-11-29T18:51:00.051-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 870000 2015-11-29T18:51:00.07-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.073-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 330000 QueuedCount 10105 2015-11-29T18:51:00.104-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.134-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 880000 2015-11-29T18:51:00.138-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.172-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 890000 2015-11-29T18:51:00.26-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 340000 QueuedCount 49981 2015-11-29T18:51:00.274-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 900000 2015-11-29T18:51:00.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 910000 2015-11-29T18:51:00.408-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 920000 2015-11-29T18:51:00.426-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.442-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 350000 QueuedCount 49095 2015-11-29T18:51:00.488-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 930000 2015-11-29T18:51:00.565-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 940000 2015-11-29T18:51:00.634-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 360000 QueuedCount 50000 2015-11-29T18:51:00.653-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 950000 2015-11-29T18:51:00.687-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:00.755-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 960000 2015-11-29T18:51:00.833-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 370000 QueuedCount 50000 2015-11-29T18:51:00.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 970000 2015-11-29T18:51:01.033-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 980000 2015-11-29T18:51:01.197-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 990000 2015-11-29T18:51:01.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1000000 2015-11-29T18:51:01.52-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1010000 2015-11-29T18:51:01.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1020000 2015-11-29T18:51:01.764-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:01.784-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1030000 2015-11-29T18:51:01.81-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 380000 QueuedCount 50000 2015-11-29T18:51:01.88-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1040000 2015-11-29T18:51:02.07-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:02.078-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 390000 QueuedCount 49195 2015-11-29T18:51:02.104-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1050000 2015-11-29T18:51:02.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1060000 2015-11-29T18:51:02.188-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 400000 QueuedCount 49999 2015-11-29T18:51:02.214-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:02.286-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1070000 2015-11-29T18:51:02.305-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 410000 QueuedCount 50000 2015-11-29T18:51:02.416-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1080000 2015-11-29T18:51:02.555-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1090000 2015-11-29T18:51:02.693-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1100000 2015-11-29T18:51:02.833-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1110000 2015-11-29T18:51:02.877-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:02.93-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1120000 2015-11-29T18:51:02.931-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 420000 QueuedCount 49999 2015-11-29T18:51:03.017-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1130000 2015-11-29T18:51:03.087-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 430000 QueuedCount 50000 2015-11-29T18:51:03.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1140000 2015-11-29T18:51:03.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1150000 2015-11-29T18:51:03.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1160000 2015-11-29T18:51:03.406-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 440000 QueuedCount 50000 2015-11-29T18:51:03.452-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:03.507-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1170000 2015-11-29T18:51:03.624-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1180000 2015-11-29T18:51:03.65-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 450000 QueuedCount 50000 2015-11-29T18:51:03.752-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1190000 2015-11-29T18:51:03.915-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1200000 2015-11-29T18:51:04.076-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1210000 2015-11-29T18:51:04.24-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1220000 2015-11-29T18:51:04.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1230000 2015-11-29T18:51:04.533-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1240000 2015-11-29T18:51:04.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1250000 2015-11-29T18:51:04.688-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 460000 QueuedCount 50000 2015-11-29T18:51:04.73-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1260000 2015-11-29T18:51:04.807-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 470000 QueuedCount 47956 2015-11-29T18:51:04.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1270000 2015-11-29T18:51:04.917-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 480000 QueuedCount 37956 2015-11-29T18:51:04.97-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1280000 2015-11-29T18:51:05.011-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 490000 QueuedCount 27956 2015-11-29T18:51:05.092-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1290000 2015-11-29T18:51:05.216-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1300000 2015-11-29T18:51:05.337-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1310000 2015-11-29T18:51:05.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1320000 2015-11-29T18:51:05.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1330000 2015-11-29T18:51:05.601-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 500000 QueuedCount 17956 2015-11-29T18:51:05.689-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 510000 QueuedCount 7956 2015-11-29T18:51:05.703-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1340000 2015-11-29T18:51:05.831-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1350000 2015-11-29T18:51:05.987-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1360000 2015-11-29T18:51:06.156-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1370000 2015-11-29T18:51:06.33-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1380000 2015-11-29T18:51:06.464-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.517µs CommitTime 687.220062ms TotalFlushTime 14.89085966s TotalCommitTime 1.898690352s 2015-11-29T18:51:06.464-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 260957, 260957, 3 committed:true 2015-11-29T18:51:06.464-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 260957, 260957, 3 committed:true) SnapCreateDur 698.437461ms SnapOpenDur 100.781µs 2015-11-29T18:51:06.496-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1390000 2015-11-29T18:51:06.507-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:06.527-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 520000 QueuedCount 19420 2015-11-29T18:51:06.546-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:06.579-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:06.58-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1400000 2015-11-29T18:51:06.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1410000 2015-11-29T18:51:06.722-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 530000 QueuedCount 50000 2015-11-29T18:51:06.732-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1420000 2015-11-29T18:51:06.749-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:06.812-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1430000 2015-11-29T18:51:06.888-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1440000 2015-11-29T18:51:06.91-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 540000 QueuedCount 50000 2015-11-29T18:51:06.964-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1450000 2015-11-29T18:51:06.998-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:07.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1460000 2015-11-29T18:51:07.121-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 550000 QueuedCount 50000 2015-11-29T18:51:07.14-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1470000 2015-11-29T18:51:07.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1480000 2015-11-29T18:51:07.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1490000 2015-11-29T18:51:07.581-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1500000 2015-11-29T18:51:07.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1510000 2015-11-29T18:51:07.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1520000 2015-11-29T18:51:08.11-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1530000 2015-11-29T18:51:08.21-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 560000 QueuedCount 50000 2015-11-29T18:51:08.212-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:08.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1540000 2015-11-29T18:51:08.323-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 570000 QueuedCount 50000 2015-11-29T18:51:08.337-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1550000 2015-11-29T18:51:08.409-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:08.436-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 580000 QueuedCount 50000 2015-11-29T18:51:08.437-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1560000 2015-11-29T18:51:08.516-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1570000 2015-11-29T18:51:08.539-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 590000 QueuedCount 50000 2015-11-29T18:51:08.582-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:08.61-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1580000 2015-11-29T18:51:08.72-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1590000 2015-11-29T18:51:08.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1600000 2015-11-29T18:51:08.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1610000 2015-11-29T18:51:09.125-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1620000 2015-11-29T18:51:09.161-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 600000 QueuedCount 50000 2015-11-29T18:51:09.22-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1630000 2015-11-29T18:51:09.255-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 610000 QueuedCount 50000 2015-11-29T18:51:09.337-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1640000 2015-11-29T18:51:09.346-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 620000 QueuedCount 40511 2015-11-29T18:51:09.44-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 630000 QueuedCount 30511 2015-11-29T18:51:09.473-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1650000 2015-11-29T18:51:09.608-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1660000 2015-11-29T18:51:09.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1670000 2015-11-29T18:51:09.862-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1680000 2015-11-29T18:51:09.966-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 640000 QueuedCount 20511 2015-11-29T18:51:09.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1690000 2015-11-29T18:51:10.039-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 650000 QueuedCount 10511 2015-11-29T18:51:10.118-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 660000 QueuedCount 511 2015-11-29T18:51:10.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1700000 2015-11-29T18:51:10.241-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1710000 2015-11-29T18:51:10.364-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1720000 2015-11-29T18:51:10.491-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1730000 2015-11-29T18:51:10.642-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1740000 2015-11-29T18:51:10.759-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.943µs CommitTime 612.189801ms TotalFlushTime 18.322664592s TotalCommitTime 2.510880153s 2015-11-29T18:51:10.759-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 333029, 333029, 4 committed:true 2015-11-29T18:51:10.759-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 333029, 333029, 4 committed:true) SnapCreateDur 628.218945ms SnapOpenDur 83.237µs 2015-11-29T18:51:10.797-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:10.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1750000 2015-11-29T18:51:10.832-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:10.864-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:10.893-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1760000 2015-11-29T18:51:10.901-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:10.971-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1770000 2015-11-29T18:51:10.981-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 670000 QueuedCount 50000 2015-11-29T18:51:11.045-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1780000 2015-11-29T18:51:11.108-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:11.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1790000 2015-11-29T18:51:11.185-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 680000 QueuedCount 50000 2015-11-29T18:51:11.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1800000 2015-11-29T18:51:11.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1810000 2015-11-29T18:51:11.358-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1820000 2015-11-29T18:51:11.397-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 690000 QueuedCount 50000 2015-11-29T18:51:11.445-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1830000 2015-11-29T18:51:11.552-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:11.567-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1840000 2015-11-29T18:51:11.609-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 700000 QueuedCount 50000 2015-11-29T18:51:11.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1850000 2015-11-29T18:51:11.901-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1860000 2015-11-29T18:51:12.065-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1870000 2015-11-29T18:51:12.219-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1880000 2015-11-29T18:51:12.377-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1890000 2015-11-29T18:51:12.482-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1900000 2015-11-29T18:51:12.495-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 710000 QueuedCount 50000 2015-11-29T18:51:12.497-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:12.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1910000 2015-11-29T18:51:12.642-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 720000 QueuedCount 49999 2015-11-29T18:51:12.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1920000 2015-11-29T18:51:12.713-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:12.761-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1930000 2015-11-29T18:51:12.84-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 730000 QueuedCount 50000 2015-11-29T18:51:12.858-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1940000 2015-11-29T18:51:12.956-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1950000 2015-11-29T18:51:12.957-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:13.047-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 740000 QueuedCount 50000 2015-11-29T18:51:13.054-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1960000 2015-11-29T18:51:13.219-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1970000 2015-11-29T18:51:13.393-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1980000 2015-11-29T18:51:13.567-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1990000 2015-11-29T18:51:13.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2000000 2015-11-29T18:51:13.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2010000 2015-11-29T18:51:14.069-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2020000 2015-11-29T18:51:14.115-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:14.134-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 750000 QueuedCount 48137 2015-11-29T18:51:14.159-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2030000 2015-11-29T18:51:14.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2040000 2015-11-29T18:51:14.291-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 760000 QueuedCount 50000 2015-11-29T18:51:14.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2050000 2015-11-29T18:51:14.489-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 770000 QueuedCount 41688 2015-11-29T18:51:14.59-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2060000 2015-11-29T18:51:14.687-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 780000 QueuedCount 31688 2015-11-29T18:51:14.777-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2070000 2015-11-29T18:51:14.959-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2080000 2015-11-29T18:51:15.118-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2090000 2015-11-29T18:51:15.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2100000 2015-11-29T18:51:15.435-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2110000 2015-11-29T18:51:15.514-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 790000 QueuedCount 21688 2015-11-29T18:51:15.588-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2120000 2015-11-29T18:51:15.605-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 800000 QueuedCount 11688 2015-11-29T18:51:15.7-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 810000 QueuedCount 1688 2015-11-29T18:51:15.738-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2130000 2015-11-29T18:51:15.902-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2140000 2015-11-29T18:51:16.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2150000 2015-11-29T18:51:16.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2160000 2015-11-29T18:51:16.432-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2170000 2015-11-29T18:51:16.548-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.903µs CommitTime 810.327177ms TotalFlushTime 22.984573108s TotalCommitTime 3.32120733s 2015-11-29T18:51:16.548-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 409258, 409258, 5 committed:true 2015-11-29T18:51:16.548-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 409258, 409258, 5 committed:true) SnapCreateDur 831.741398ms SnapOpenDur 87.458µs 2015-11-29T18:51:16.583-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:16.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2180000 2015-11-29T18:51:16.619-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:16.654-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:16.69-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:16.693-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2190000 2015-11-29T18:51:16.768-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 820000 QueuedCount 50000 2015-11-29T18:51:16.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2200000 2015-11-29T18:51:16.842-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2210000 2015-11-29T18:51:16.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2220000 2015-11-29T18:51:16.965-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 830000 QueuedCount 50000 2015-11-29T18:51:16.996-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2230000 2015-11-29T18:51:17.007-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:17.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2240000 2015-11-29T18:51:17.166-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2250000 2015-11-29T18:51:17.18-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 840000 QueuedCount 50000 2015-11-29T18:51:17.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2260000 2015-11-29T18:51:17.377-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2270000 2015-11-29T18:51:17.399-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 850000 QueuedCount 49999 2015-11-29T18:51:17.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2280000 2015-11-29T18:51:17.708-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2290000 2015-11-29T18:51:17.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2300000 2015-11-29T18:51:18.057-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2310000 2015-11-29T18:51:18.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2320000 2015-11-29T18:51:18.355-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2330000 2015-11-29T18:51:18.422-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 860000 QueuedCount 50000 2015-11-29T18:51:18.441-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:18.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2340000 2015-11-29T18:51:18.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2350000 2015-11-29T18:51:18.54-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 870000 QueuedCount 50000 2015-11-29T18:51:18.623-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2360000 2015-11-29T18:51:18.675-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 880000 QueuedCount 50000 2015-11-29T18:51:18.719-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2370000 2015-11-29T18:51:18.815-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2380000 2015-11-29T18:51:18.841-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:18.872-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 890000 QueuedCount 50000 2015-11-29T18:51:18.915-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2390000 2015-11-29T18:51:19.037-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2400000 2015-11-29T18:51:19.218-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2410000 2015-11-29T18:51:19.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2420000 2015-11-29T18:51:19.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2430000 2015-11-29T18:51:19.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2440000 2015-11-29T18:51:19.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2450000 2015-11-29T18:51:19.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 900000 QueuedCount 50000 2015-11-29T18:51:20.06-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2460000 2015-11-29T18:51:20.082-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:20.084-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 910000 QueuedCount 49709 2015-11-29T18:51:20.146-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2470000 2015-11-29T18:51:20.196-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 920000 QueuedCount 50000 2015-11-29T18:51:20.236-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2480000 2015-11-29T18:51:20.305-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 930000 QueuedCount 45212 2015-11-29T18:51:20.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2490000 2015-11-29T18:51:20.529-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2500000 2015-11-29T18:51:20.676-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2510000 2015-11-29T18:51:20.816-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2520000 2015-11-29T18:51:20.966-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2530000 2015-11-29T18:51:20.968-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 940000 QueuedCount 35212 2015-11-29T18:51:21.047-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 950000 QueuedCount 25212 2015-11-29T18:51:21.1-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2540000 2015-11-29T18:51:21.127-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 960000 QueuedCount 15212 2015-11-29T18:51:21.211-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 970000 QueuedCount 5212 2015-11-29T18:51:21.231-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2550000 2015-11-29T18:51:21.369-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2560000 2015-11-29T18:51:21.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2570000 2015-11-29T18:51:21.647-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2580000 2015-11-29T18:51:21.784-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2590000 2015-11-29T18:51:21.858-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.437µs CommitTime 118.79266ms TotalFlushTime 27.861829287s TotalCommitTime 3.43999999s 2015-11-29T18:51:21.858-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 491378, 491378, 6 committed:true 2015-11-29T18:51:21.858-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 491378, 491378, 6 committed:true) SnapCreateDur 143.163969ms SnapOpenDur 119.88µs 2015-11-29T18:51:21.889-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:21.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2600000 2015-11-29T18:51:21.921-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:21.951-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:21.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 980000 QueuedCount 38925 2015-11-29T18:51:21.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2610000 2015-11-29T18:51:21.984-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:22.049-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2620000 2015-11-29T18:51:22.109-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2630000 2015-11-29T18:51:22.152-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:22.165-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 990000 QueuedCount 49251 2015-11-29T18:51:22.175-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2640000 2015-11-29T18:51:22.237-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2650000 2015-11-29T18:51:22.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2660000 2015-11-29T18:51:22.36-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1000000 QueuedCount 50000 2015-11-29T18:51:22.382-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2670000 2015-11-29T18:51:22.473-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2680000 2015-11-29T18:51:22.478-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:22.565-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1010000 QueuedCount 50000 2015-11-29T18:51:22.586-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2690000 2015-11-29T18:51:22.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2700000 2015-11-29T18:51:22.888-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2710000 2015-11-29T18:51:23.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2720000 2015-11-29T18:51:23.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2730000 2015-11-29T18:51:23.368-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2740000 2015-11-29T18:51:23.384-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:171240292, Disk:224768000, ExtraSnapshotData:0, Fragmentation:23.81464799259681% 2015-11-29T18:51:23.502-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2750000 2015-11-29T18:51:23.511-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1020000 QueuedCount 50000 2015-11-29T18:51:23.572-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:23.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2760000 2015-11-29T18:51:23.612-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1030000 QueuedCount 50000 2015-11-29T18:51:23.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2770000 2015-11-29T18:51:23.715-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:23.717-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1040000 QueuedCount 49758 2015-11-29T18:51:23.755-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2780000 2015-11-29T18:51:23.822-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1050000 QueuedCount 50000 2015-11-29T18:51:23.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2790000 2015-11-29T18:51:23.869-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:23.943-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2800000 2015-11-29T18:51:24.081-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2810000 2015-11-29T18:51:24.225-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2820000 2015-11-29T18:51:24.372-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2830000 2015-11-29T18:51:24.487-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1060000 QueuedCount 50000 2015-11-29T18:51:24.496-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2840000 2015-11-29T18:51:24.576-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1070000 QueuedCount 50000 2015-11-29T18:51:24.577-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2850000 2015-11-29T18:51:24.605-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:24.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2860000 2015-11-29T18:51:24.665-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1080000 QueuedCount 50000 2015-11-29T18:51:24.734-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2870000 2015-11-29T18:51:24.76-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1090000 QueuedCount 50000 2015-11-29T18:51:24.777-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:24.816-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2880000 2015-11-29T18:51:24.927-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2890000 2015-11-29T18:51:25.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2900000 2015-11-29T18:51:25.182-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2910000 2015-11-29T18:51:25.305-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2920000 2015-11-29T18:51:25.313-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1100000 QueuedCount 50000 2015-11-29T18:51:25.379-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:25.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2930000 2015-11-29T18:51:25.397-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1110000 QueuedCount 47764 2015-11-29T18:51:25.458-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2940000 2015-11-29T18:51:25.488-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1120000 QueuedCount 50000 2015-11-29T18:51:25.548-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2950000 2015-11-29T18:51:25.575-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1130000 QueuedCount 43766 2015-11-29T18:51:25.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2960000 2015-11-29T18:51:25.799-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2970000 2015-11-29T18:51:25.932-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2980000 2015-11-29T18:51:26.059-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2990000 2015-11-29T18:51:26.124-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1140000 QueuedCount 33766 2015-11-29T18:51:26.183-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3000000 2015-11-29T18:51:26.202-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1150000 QueuedCount 23766 2015-11-29T18:51:26.283-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1160000 QueuedCount 13766 2015-11-29T18:51:26.307-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3010000 2015-11-29T18:51:26.369-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1170000 QueuedCount 3766 2015-11-29T18:51:26.434-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3020000 2015-11-29T18:51:26.556-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3030000 2015-11-29T18:51:26.682-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3040000 2015-11-29T18:51:26.817-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3050000 2015-11-29T18:51:26.884-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.608µs CommitTime 469.445038ms TotalFlushTime 32.127393731s TotalCommitTime 3.909445028s 2015-11-29T18:51:26.884-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 590847, 590847, 7 committed:true 2015-11-29T18:51:26.884-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 590847, 590847, 7 committed:true) SnapCreateDur 480.603047ms SnapOpenDur 45.986µs 2015-11-29T18:51:26.918-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:26.93-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3060000 2015-11-29T18:51:26.949-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:26.979-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:27.001-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3070000 2015-11-29T18:51:27.01-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:27.026-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1180000 QueuedCount 47078 2015-11-29T18:51:27.067-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3080000 2015-11-29T18:51:27.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3090000 2015-11-29T18:51:27.192-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3100000 2015-11-29T18:51:27.214-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1190000 QueuedCount 49999 2015-11-29T18:51:27.242-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:27.26-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3110000 2015-11-29T18:51:27.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3120000 2015-11-29T18:51:27.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3130000 2015-11-29T18:51:27.408-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1200000 QueuedCount 50000 2015-11-29T18:51:27.489-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3140000 2015-11-29T18:51:27.597-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3150000 2015-11-29T18:51:27.597-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1210000 QueuedCount 49995 2015-11-29T18:51:27.654-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:27.728-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3160000 2015-11-29T18:51:27.91-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3170000 2015-11-29T18:51:28.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3180000 2015-11-29T18:51:28.269-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3190000 2015-11-29T18:51:28.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3200000 2015-11-29T18:51:28.601-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3210000 2015-11-29T18:51:28.753-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3220000 2015-11-29T18:51:28.825-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1220000 QueuedCount 50000 2015-11-29T18:51:28.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3230000 2015-11-29T18:51:28.931-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:28.946-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1230000 QueuedCount 48466 2015-11-29T18:51:28.957-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3240000 2015-11-29T18:51:29.039-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3250000 2015-11-29T18:51:29.059-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1240000 QueuedCount 49999 2015-11-29T18:51:29.112-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:29.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3260000 2015-11-29T18:51:29.171-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1250000 QueuedCount 50000 2015-11-29T18:51:29.224-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3270000 2015-11-29T18:51:29.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3280000 2015-11-29T18:51:29.502-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3290000 2015-11-29T18:51:29.647-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3300000 2015-11-29T18:51:29.788-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3310000 2015-11-29T18:51:29.866-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1260000 QueuedCount 50000 2015-11-29T18:51:29.879-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:29.893-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3320000 2015-11-29T18:51:29.972-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1270000 QueuedCount 50000 2015-11-29T18:51:29.973-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3330000 2015-11-29T18:51:30.042-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:30.063-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3340000 2015-11-29T18:51:30.065-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1280000 QueuedCount 50000 2015-11-29T18:51:30.134-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3350000 2015-11-29T18:51:30.179-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1290000 QueuedCount 50000 2015-11-29T18:51:30.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3360000 2015-11-29T18:51:30.232-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:30.338-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3370000 2015-11-29T18:51:30.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3380000 2015-11-29T18:51:30.593-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3390000 2015-11-29T18:51:30.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3400000 2015-11-29T18:51:30.739-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1300000 QueuedCount 50000 2015-11-29T18:51:30.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3410000 2015-11-29T18:51:30.834-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:30.873-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1310000 QueuedCount 50000 2015-11-29T18:51:30.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3420000 2015-11-29T18:51:30.984-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3430000 2015-11-29T18:51:31.019-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1320000 QueuedCount 49763 2015-11-29T18:51:31.098-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3440000 2015-11-29T18:51:31.116-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1330000 QueuedCount 39763 2015-11-29T18:51:31.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3450000 2015-11-29T18:51:31.362-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3460000 2015-11-29T18:51:31.493-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3470000 2015-11-29T18:51:31.621-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3480000 2015-11-29T18:51:31.678-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1340000 QueuedCount 29763 2015-11-29T18:51:31.75-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3490000 2015-11-29T18:51:31.756-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1350000 QueuedCount 19763 2015-11-29T18:51:31.836-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1360000 QueuedCount 9763 2015-11-29T18:51:31.88-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3500000 2015-11-29T18:51:32.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3510000 2015-11-29T18:51:32.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3520000 2015-11-29T18:51:32.271-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3530000 2015-11-29T18:51:32.397-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 11.033µs CommitTime 469.787157ms TotalFlushTime 36.868938813s TotalCommitTime 4.379232185s 2015-11-29T18:51:32.397-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 689481, 689481, 8 committed:true 2015-11-29T18:51:32.397-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 689481, 689481, 8 committed:true) SnapCreateDur 479.88711ms SnapOpenDur 118.341µs 2015-11-29T18:51:32.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3540000 2015-11-29T18:51:32.422-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1370000 QueuedCount 5696 2015-11-29T18:51:32.427-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:32.461-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:32.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3550000 2015-11-29T18:51:32.502-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:32.522-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1380000 QueuedCount 42583 2015-11-29T18:51:32.56-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3560000 2015-11-29T18:51:32.616-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1390000 QueuedCount 49989 2015-11-29T18:51:32.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3570000 2015-11-29T18:51:32.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3580000 2015-11-29T18:51:32.73-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:32.749-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3590000 2015-11-29T18:51:32.763-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1400000 QueuedCount 50000 2015-11-29T18:51:32.81-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3600000 2015-11-29T18:51:32.869-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3610000 2015-11-29T18:51:32.934-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3620000 2015-11-29T18:51:32.967-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1410000 QueuedCount 50000 2015-11-29T18:51:33.015-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3630000 2015-11-29T18:51:33.169-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3640000 2015-11-29T18:51:33.346-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3650000 2015-11-29T18:51:33.518-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3660000 2015-11-29T18:51:33.671-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3670000 2015-11-29T18:51:33.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3680000 2015-11-29T18:51:33.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3690000 2015-11-29T18:51:33.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1420000 QueuedCount 50000 2015-11-29T18:51:33.991-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:34.033-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3700000 2015-11-29T18:51:34.083-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1430000 QueuedCount 50000 2015-11-29T18:51:34.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3710000 2015-11-29T18:51:34.169-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:34.192-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1440000 QueuedCount 50000 2015-11-29T18:51:34.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3720000 2015-11-29T18:51:34.301-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3730000 2015-11-29T18:51:34.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:34.365-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1450000 QueuedCount 50000 2015-11-29T18:51:34.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3740000 2015-11-29T18:51:34.596-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3750000 2015-11-29T18:51:34.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3760000 2015-11-29T18:51:34.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3770000 2015-11-29T18:51:35.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3780000 2015-11-29T18:51:35.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3790000 2015-11-29T18:51:35.367-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3800000 2015-11-29T18:51:35.414-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:35.422-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1460000 QueuedCount 49224 2015-11-29T18:51:35.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3810000 2015-11-29T18:51:35.53-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1470000 QueuedCount 49999 2015-11-29T18:51:35.53-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:35.554-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3820000 2015-11-29T18:51:35.654-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3830000 2015-11-29T18:51:35.725-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1480000 QueuedCount 50000 2015-11-29T18:51:35.771-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3840000 2015-11-29T18:51:35.782-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:35.897-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3850000 2015-11-29T18:51:35.955-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1490000 QueuedCount 50000 2015-11-29T18:51:36.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3860000 2015-11-29T18:51:36.182-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3870000 2015-11-29T18:51:36.336-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3880000 2015-11-29T18:51:36.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3890000 2015-11-29T18:51:36.632-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3900000 2015-11-29T18:51:36.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3910000 2015-11-29T18:51:36.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3920000 2015-11-29T18:51:36.952-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1500000 QueuedCount 50000 2015-11-29T18:51:36.968-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:36.997-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3930000 2015-11-29T18:51:37.082-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1510000 QueuedCount 50000 2015-11-29T18:51:37.084-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3940000 2015-11-29T18:51:37.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3950000 2015-11-29T18:51:37.311-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1520000 QueuedCount 50000 2015-11-29T18:51:37.319-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3960000 2015-11-29T18:51:37.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3970000 2015-11-29T18:51:37.529-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1530000 QueuedCount 44039 2015-11-29T18:51:37.634-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3980000 2015-11-29T18:51:37.814-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3990000 2015-11-29T18:51:37.986-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4000000 2015-11-29T18:51:38.136-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4010000 2015-11-29T18:51:38.286-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4020000 2015-11-29T18:51:38.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4030000 2015-11-29T18:51:38.481-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1540000 QueuedCount 34039 2015-11-29T18:51:38.572-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4040000 2015-11-29T18:51:38.578-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1550000 QueuedCount 24039 2015-11-29T18:51:38.679-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1560000 QueuedCount 14039 2015-11-29T18:51:38.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4050000 2015-11-29T18:51:38.782-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1570000 QueuedCount 4039 2015-11-29T18:51:38.863-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4060000 2015-11-29T18:51:39.006-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4070000 2015-11-29T18:51:39.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4080000 2015-11-29T18:51:39.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4090000 2015-11-29T18:51:39.437-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4100000 2015-11-29T18:51:39.601-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4110000 2015-11-29T18:51:39.615-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 6.863µs CommitTime 183.559753ms TotalFlushTime 43.530554024s TotalCommitTime 4.562791938s 2015-11-29T18:51:39.615-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 792290, 792290, 9 committed:true 2015-11-29T18:51:39.615-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 792290, 792290, 9 committed:true) SnapCreateDur 210.6353ms SnapOpenDur 97.047µs 2015-11-29T18:51:39.657-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:39.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:39.714-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4120000 2015-11-29T18:51:39.728-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:39.769-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1580000 QueuedCount 50000 2015-11-29T18:51:39.789-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4130000 2015-11-29T18:51:39.853-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4140000 2015-11-29T18:51:39.916-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4150000 2015-11-29T18:51:39.957-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1590000 QueuedCount 50000 2015-11-29T18:51:39.979-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:39.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4160000 2015-11-29T18:51:40.058-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4170000 2015-11-29T18:51:40.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4180000 2015-11-29T18:51:40.166-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1600000 QueuedCount 50000 2015-11-29T18:51:40.225-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4190000 2015-11-29T18:51:40.292-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:40.345-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4200000 2015-11-29T18:51:40.387-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1610000 QueuedCount 50000 2015-11-29T18:51:40.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4210000 2015-11-29T18:51:40.636-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4220000 2015-11-29T18:51:40.814-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4230000 2015-11-29T18:51:40.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4240000 2015-11-29T18:51:41.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4250000 2015-11-29T18:51:41.278-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4260000 2015-11-29T18:51:41.375-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1620000 QueuedCount 50000 2015-11-29T18:51:41.38-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4270000 2015-11-29T18:51:41.391-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:41.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4280000 2015-11-29T18:51:41.485-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1630000 QueuedCount 50000 2015-11-29T18:51:41.564-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:41.564-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4290000 2015-11-29T18:51:41.593-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1640000 QueuedCount 50000 2015-11-29T18:51:41.65-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4300000 2015-11-29T18:51:41.752-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1650000 QueuedCount 50000 2015-11-29T18:51:41.755-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4310000 2015-11-29T18:51:41.815-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:41.878-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4320000 2015-11-29T18:51:42.05-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4330000 2015-11-29T18:51:42.221-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4340000 2015-11-29T18:51:42.398-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4350000 2015-11-29T18:51:42.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4360000 2015-11-29T18:51:42.719-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4370000 2015-11-29T18:51:42.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4380000 2015-11-29T18:51:42.871-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1660000 QueuedCount 50000 2015-11-29T18:51:42.947-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4390000 2015-11-29T18:51:42.977-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:42.989-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1670000 QueuedCount 48918 2015-11-29T18:51:43.035-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4400000 2015-11-29T18:51:43.106-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1680000 QueuedCount 50000 2015-11-29T18:51:43.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4410000 2015-11-29T18:51:43.215-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1690000 QueuedCount 44442 2015-11-29T18:51:43.251-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4420000 2015-11-29T18:51:43.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4430000 2015-11-29T18:51:43.572-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4440000 2015-11-29T18:51:43.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4450000 2015-11-29T18:51:43.892-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4460000 2015-11-29T18:51:44.064-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4470000 2015-11-29T18:51:44.221-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4480000 2015-11-29T18:51:44.327-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1700000 QueuedCount 34442 2015-11-29T18:51:44.385-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4490000 2015-11-29T18:51:44.438-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1710000 QueuedCount 24442 2015-11-29T18:51:44.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4500000 2015-11-29T18:51:44.538-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1720000 QueuedCount 14442 2015-11-29T18:51:44.642-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1730000 QueuedCount 4442 2015-11-29T18:51:44.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4510000 2015-11-29T18:51:44.842-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4520000 2015-11-29T18:51:45.019-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4530000 2015-11-29T18:51:45.18-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4540000 2015-11-29T18:51:45.351-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4550000 2015-11-29T18:51:45.521-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4560000 2015-11-29T18:51:45.683-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4570000 2015-11-29T18:51:45.76-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 13.88µs CommitTime 1.03643142s TotalFlushTime 48.323062499s TotalCommitTime 5.599223358s 2015-11-29T18:51:45.76-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 873141, 873141, 10 committed:true 2015-11-29T18:51:45.761-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 873141, 873141, 10 committed:true) SnapCreateDur 1.062812993s SnapOpenDur 56.872µs 2015-11-29T18:51:45.794-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:45.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4580000 2015-11-29T18:51:45.837-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:45.908-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4590000 2015-11-29T18:51:45.915-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1740000 QueuedCount 50000 2015-11-29T18:51:45.986-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4600000 2015-11-29T18:51:45.989-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:46.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4610000 2015-11-29T18:51:46.126-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1750000 QueuedCount 50000 2015-11-29T18:51:46.143-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4620000 2015-11-29T18:51:46.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4630000 2015-11-29T18:51:46.306-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4640000 2015-11-29T18:51:46.349-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1760000 QueuedCount 50000 2015-11-29T18:51:46.393-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4650000 2015-11-29T18:51:46.501-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4660000 2015-11-29T18:51:46.556-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:46.572-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1770000 QueuedCount 49211 2015-11-29T18:51:46.628-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4670000 2015-11-29T18:51:46.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4680000 2015-11-29T18:51:46.971-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4690000 2015-11-29T18:51:47.162-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4700000 2015-11-29T18:51:47.352-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4710000 2015-11-29T18:51:47.528-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4720000 2015-11-29T18:51:47.873-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4730000 2015-11-29T18:51:47.93-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1780000 QueuedCount 50000 2015-11-29T18:51:47.984-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4740000 2015-11-29T18:51:48.101-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4750000 2015-11-29T18:51:48.138-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:48.161-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1790000 QueuedCount 50000 2015-11-29T18:51:48.228-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4760000 2015-11-29T18:51:48.351-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4770000 2015-11-29T18:51:48.392-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1800000 QueuedCount 50000 2015-11-29T18:51:48.482-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4780000 2015-11-29T18:51:48.614-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1810000 QueuedCount 41975 2015-11-29T18:51:48.64-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4790000 2015-11-29T18:51:48.795-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4800000 2015-11-29T18:51:48.956-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4810000 2015-11-29T18:51:49.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4820000 2015-11-29T18:51:49.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4830000 2015-11-29T18:51:49.434-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4840000 2015-11-29T18:51:49.601-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4850000 2015-11-29T18:51:49.75-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4860000 2015-11-29T18:51:49.793-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1820000 QueuedCount 31975 2015-11-29T18:51:49.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4870000 2015-11-29T18:51:49.914-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1830000 QueuedCount 21975 2015-11-29T18:51:50.018-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1840000 QueuedCount 11975 2015-11-29T18:51:50.034-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4880000 2015-11-29T18:51:50.121-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1850000 QueuedCount 1975 2015-11-29T18:51:50.17-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4890000 2015-11-29T18:51:50.306-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4900000 2015-11-29T18:51:50.44-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4910000 2015-11-29T18:51:50.575-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4920000 2015-11-29T18:51:50.71-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4930000 2015-11-29T18:51:50.768-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.085µs CommitTime 605.971543ms TotalFlushTime 52.447777682s TotalCommitTime 6.205194901s 2015-11-29T18:51:50.768-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 932374, 932374, 11 committed:true 2015-11-29T18:51:50.768-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 932374, 932374, 11 committed:true) SnapCreateDur 618.933001ms SnapOpenDur 59.563µs 2015-11-29T18:51:50.8-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:50.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4940000 2015-11-29T18:51:50.832-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:50.864-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:50.874-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1860000 QueuedCount 28414 2015-11-29T18:51:50.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4950000 2015-11-29T18:51:50.902-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:50.967-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4960000 2015-11-29T18:51:51.019-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1870000 QueuedCount 50000 2015-11-29T18:51:51.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4970000 2015-11-29T18:51:51.09-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4980000 2015-11-29T18:51:51.151-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4990000 2015-11-29T18:51:51.201-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:51.219-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1880000 QueuedCount 49111 2015-11-29T18:51:51.225-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5000000 2015-11-29T18:51:51.297-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5010000 2015-11-29T18:51:51.38-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5020000 2015-11-29T18:51:51.43-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1890000 QueuedCount 50000 2015-11-29T18:51:51.493-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5030000 2015-11-29T18:51:51.671-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5040000 2015-11-29T18:51:51.85-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5050000 2015-11-29T18:51:52.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5060000 2015-11-29T18:51:52.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5070000 2015-11-29T18:51:52.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5080000 2015-11-29T18:51:52.551-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5090000 2015-11-29T18:51:52.623-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:52.627-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1900000 QueuedCount 49542 2015-11-29T18:51:52.648-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5100000 2015-11-29T18:51:52.732-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5110000 2015-11-29T18:51:52.746-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1910000 QueuedCount 50000 2015-11-29T18:51:52.82-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:52.828-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5120000 2015-11-29T18:51:52.868-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1920000 QueuedCount 49978 2015-11-29T18:51:52.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5130000 2015-11-29T18:51:53.039-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:53.052-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5140000 2015-11-29T18:51:53.099-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1930000 QueuedCount 50000 2015-11-29T18:51:53.173-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5150000 2015-11-29T18:51:53.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5160000 2015-11-29T18:51:53.385-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5612299180,"bucket-1:by_capped_small_0:avg_ts_items_count":147803,"bucket-1:by_capped_small_0:build_progress":9,"bucket-1:by_capped_small_0:data_size":309334613,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":517926912,"bucket-1:by_capped_small_0:flush_queue_size":50041,"bucket-1:by_capped_small_0:frag_percent":40,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":91264368,"bucket-1:by_capped_small_0:items_count":932374,"bucket-1:by_capped_small_0:num_commits":11,"bucket-1:by_capped_small_0:num_compactions":0,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":1966076,"bucket-1:by_capped_small_0:num_docs_pending":14874965,"bucket-1:by_capped_small_0:num_docs_queued":3158959,"bucket-1:by_capped_small_0:num_flush_queued":1982767,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":11,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":5007915625,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"11 6205194901 4168975332978193287","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"1932727 14728368815 5478420214532037","bucket-1:by_capped_small_0:timings/storage_handle_open":"11 688774 50800857410","bucket-1:by_capped_small_0:timings/storage_info":"45 671452 101045049734","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"10 4289667 2241539554543","bucket-1:by_capped_small_0:timings/storage_meta_set":"11 6037539 3991311013937","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"1946669 37773289064 5083862862313373772","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":3179532,"bucket-1:num_mutations_queued":5162259,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":199,"memory_quota":104857600000,"memory_used":463114240,"needs_restart":false,"num_connections":0,"timings/stats_response":"1510 160291939 1477360923425177"} 2015-11-29T18:51:53.385-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:310297184, Disk:517926912, ExtraSnapshotData:0, Fragmentation:40.088615437693264% 2015-11-29T18:51:53.385-08:00 [Info] CompactionDaemon: Compacting index instance:3094208154756435235 2015-11-29T18:51:53.513-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5170000 2015-11-29T18:51:53.68-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5180000 2015-11-29T18:51:53.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5190000 2015-11-29T18:51:54.012-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5200000 2015-11-29T18:51:54.153-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5210000 2015-11-29T18:51:54.216-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 590847. Slice Id 0, IndexInstId 3094208154756435235, IndexDefnId 3094208154756435235 2015-11-29T18:51:54.291-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5220000 2015-11-29T18:51:54.457-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5230000 2015-11-29T18:51:54.504-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:54.517-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1940000 QueuedCount 49165 2015-11-29T18:51:54.568-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5240000 2015-11-29T18:51:54.68-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5250000 2015-11-29T18:51:54.701-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1950000 QueuedCount 50000 2015-11-29T18:51:54.847-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5260000 2015-11-29T18:51:54.921-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1960000 QueuedCount 40219 2015-11-29T18:51:55.025-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5270000 2015-11-29T18:51:55.141-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1970000 QueuedCount 30219 2015-11-29T18:51:55.206-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5280000 2015-11-29T18:51:55.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5290000 2015-11-29T18:51:55.545-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5300000 2015-11-29T18:51:55.686-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5310000 2015-11-29T18:51:55.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5320000 2015-11-29T18:51:55.986-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5330000 2015-11-29T18:51:56.096-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1980000 QueuedCount 20219 2015-11-29T18:51:56.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5340000 2015-11-29T18:51:56.197-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 1990000 QueuedCount 10219 2015-11-29T18:51:56.269-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5350000 2015-11-29T18:51:56.324-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2000000 QueuedCount 219 2015-11-29T18:51:56.401-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5360000 2015-11-29T18:51:56.533-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5370000 2015-11-29T18:51:56.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5380000 2015-11-29T18:51:56.786-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5390000 2015-11-29T18:51:56.907-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5400000 2015-11-29T18:51:56.954-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.99µs CommitTime 595.126926ms TotalFlushTime 57.748149711s TotalCommitTime 6.800321827s 2015-11-29T18:51:56.955-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1007651, 1007651, 12 committed:true 2015-11-29T18:51:56.955-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1007651, 1007651, 12 committed:true) SnapCreateDur 618.215633ms SnapOpenDur 67.02µs 2015-11-29T18:51:56.985-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5410000 2015-11-29T18:51:57.019-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.055-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5420000 2015-11-29T18:51:57.132-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.146-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5430000 2015-11-29T18:51:57.172-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2010000 QueuedCount 50000 2015-11-29T18:51:57.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5440000 2015-11-29T18:51:57.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5450000 2015-11-29T18:51:57.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5460000 2015-11-29T18:51:57.354-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.381-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2020000 QueuedCount 50000 2015-11-29T18:51:57.418-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5470000 2015-11-29T18:51:57.489-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5480000 2015-11-29T18:51:57.55-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:57.558-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2030000 QueuedCount 49529 2015-11-29T18:51:57.579-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5490000 2015-11-29T18:51:57.674-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5500000 2015-11-29T18:51:57.737-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2040000 QueuedCount 50000 2015-11-29T18:51:57.781-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5510000 2015-11-29T18:51:57.909-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5520000 2015-11-29T18:51:58.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5530000 2015-11-29T18:51:58.171-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5540000 2015-11-29T18:51:58.298-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5550000 2015-11-29T18:51:58.421-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5560000 2015-11-29T18:51:58.49-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:58.525-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5570000 2015-11-29T18:51:58.616-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2050000 QueuedCount 49999 2015-11-29T18:51:58.621-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5580000 2015-11-29T18:51:58.714-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:58.726-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5590000 2015-11-29T18:51:58.816-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2060000 QueuedCount 50000 2015-11-29T18:51:58.826-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5600000 2015-11-29T18:51:58.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5610000 2015-11-29T18:51:58.975-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:59.025-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2070000 QueuedCount 50000 2015-11-29T18:51:59.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5620000 2015-11-29T18:51:59.128-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5630000 2015-11-29T18:51:59.225-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5640000 2015-11-29T18:51:59.242-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2080000 QueuedCount 50000 2015-11-29T18:51:59.263-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:51:59.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5650000 2015-11-29T18:51:59.469-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5660000 2015-11-29T18:51:59.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5670000 2015-11-29T18:51:59.727-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5680000 2015-11-29T18:51:59.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5690000 2015-11-29T18:51:59.985-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5700000 2015-11-29T18:52:00.118-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5710000 2015-11-29T18:52:00.242-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5720000 2015-11-29T18:52:00.334-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5730000 2015-11-29T18:52:00.374-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2090000 QueuedCount 50000 2015-11-29T18:52:00.428-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5740000 2015-11-29T18:52:00.43-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:00.527-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5750000 2015-11-29T18:52:00.577-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2100000 QueuedCount 50000 2015-11-29T18:52:00.625-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5760000 2015-11-29T18:52:00.74-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5770000 2015-11-29T18:52:00.773-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2110000 QueuedCount 44408 2015-11-29T18:52:00.872-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5780000 2015-11-29T18:52:00.98-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2120000 QueuedCount 34408 2015-11-29T18:52:01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5790000 2015-11-29T18:52:01.125-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5800000 2015-11-29T18:52:01.255-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5810000 2015-11-29T18:52:01.386-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5820000 2015-11-29T18:52:01.512-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5830000 2015-11-29T18:52:01.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5840000 2015-11-29T18:52:01.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5850000 2015-11-29T18:52:01.903-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5860000 2015-11-29T18:52:01.923-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2130000 QueuedCount 24408 2015-11-29T18:52:02.023-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2140000 QueuedCount 14408 2015-11-29T18:52:02.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5870000 2015-11-29T18:52:02.13-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2150000 QueuedCount 4408 2015-11-29T18:52:02.15-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5880000 2015-11-29T18:52:02.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5890000 2015-11-29T18:52:02.401-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5900000 2015-11-29T18:52:02.525-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5910000 2015-11-29T18:52:02.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5920000 2015-11-29T18:52:02.723-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.684µs CommitTime 534.899749ms TotalFlushTime 1m2.690631489s TotalCommitTime 7.335221576s 2015-11-29T18:52:02.724-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1085368, 1085368, 13 committed:true 2015-11-29T18:52:02.724-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1085368, 1085368, 13 committed:true) SnapCreateDur 547.117394ms SnapOpenDur 39.608µs 2015-11-29T18:52:02.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:02.763-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5930000 2015-11-29T18:52:02.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:02.801-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2160000 QueuedCount 16990 2015-11-29T18:52:02.82-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:02.839-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5940000 2015-11-29T18:52:02.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5950000 2015-11-29T18:52:02.911-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2170000 QueuedCount 50000 2015-11-29T18:52:02.952-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:02.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5960000 2015-11-29T18:52:03.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5970000 2015-11-29T18:52:03.043-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2180000 QueuedCount 50000 2015-11-29T18:52:03.083-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5980000 2015-11-29T18:52:03.147-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5990000 2015-11-29T18:52:03.218-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6000000 2015-11-29T18:52:03.258-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2190000 QueuedCount 50000 2015-11-29T18:52:03.295-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6010000 2015-11-29T18:52:03.382-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6020000 2015-11-29T18:52:03.511-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6030000 2015-11-29T18:52:03.637-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6040000 2015-11-29T18:52:03.758-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6050000 2015-11-29T18:52:03.878-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6060000 2015-11-29T18:52:03.999-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6070000 2015-11-29T18:52:04.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6080000 2015-11-29T18:52:04.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6090000 2015-11-29T18:52:04.324-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:04.342-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2200000 QueuedCount 48330 2015-11-29T18:52:04.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6100000 2015-11-29T18:52:04.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6110000 2015-11-29T18:52:04.468-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2210000 QueuedCount 50000 2015-11-29T18:52:04.541-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6120000 2015-11-29T18:52:04.589-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:04.633-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2220000 QueuedCount 50000 2015-11-29T18:52:04.639-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6130000 2015-11-29T18:52:04.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6140000 2015-11-29T18:52:04.844-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6150000 2015-11-29T18:52:04.852-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2230000 QueuedCount 50000 2015-11-29T18:52:04.885-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:04.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6160000 2015-11-29T18:52:05.081-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6170000 2015-11-29T18:52:05.211-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6180000 2015-11-29T18:52:05.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6190000 2015-11-29T18:52:05.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6200000 2015-11-29T18:52:05.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6210000 2015-11-29T18:52:05.732-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6220000 2015-11-29T18:52:05.84-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2240000 QueuedCount 50000 2015-11-29T18:52:05.841-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6230000 2015-11-29T18:52:05.866-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:05.927-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6240000 2015-11-29T18:52:05.951-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2250000 QueuedCount 50000 2015-11-29T18:52:06.026-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6250000 2015-11-29T18:52:06.058-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2260000 QueuedCount 43130 2015-11-29T18:52:06.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6260000 2015-11-29T18:52:06.164-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2270000 QueuedCount 33130 2015-11-29T18:52:06.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6270000 2015-11-29T18:52:06.425-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6280000 2015-11-29T18:52:06.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6290000 2015-11-29T18:52:06.694-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6300000 2015-11-29T18:52:06.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6310000 2015-11-29T18:52:06.878-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2280000 QueuedCount 23130 2015-11-29T18:52:06.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6320000 2015-11-29T18:52:06.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2290000 QueuedCount 13130 2015-11-29T18:52:07.07-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2300000 QueuedCount 3130 2015-11-29T18:52:07.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6330000 2015-11-29T18:52:07.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6340000 2015-11-29T18:52:07.332-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6350000 2015-11-29T18:52:07.458-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6360000 2015-11-29T18:52:07.586-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6370000 2015-11-29T18:52:07.717-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6380000 2015-11-29T18:52:07.846-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6390000 2015-11-29T18:52:07.977-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6400000 2015-11-29T18:52:07.979-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.947µs CommitTime 847.001315ms TotalFlushTime 1m6.851243243s TotalCommitTime 8.182222891s 2015-11-29T18:52:07.979-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1159848, 1159848, 14 committed:true 2015-11-29T18:52:07.979-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1159848, 1159848, 14 committed:true) SnapCreateDur 872.60364ms SnapOpenDur 52.412µs 2015-11-29T18:52:08.01-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:08.041-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:08.064-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6410000 2015-11-29T18:52:08.078-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:08.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6420000 2015-11-29T18:52:08.144-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2310000 QueuedCount 50000 2015-11-29T18:52:08.197-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6430000 2015-11-29T18:52:08.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6440000 2015-11-29T18:52:08.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6450000 2015-11-29T18:52:08.343-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2320000 QueuedCount 50000 2015-11-29T18:52:08.399-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6460000 2015-11-29T18:52:08.411-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:08.477-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6470000 2015-11-29T18:52:08.546-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2330000 QueuedCount 50000 2015-11-29T18:52:08.56-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6480000 2015-11-29T18:52:08.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6490000 2015-11-29T18:52:08.757-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6500000 2015-11-29T18:52:08.758-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2340000 QueuedCount 50000 2015-11-29T18:52:08.861-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6510000 2015-11-29T18:52:08.991-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6520000 2015-11-29T18:52:09.12-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6530000 2015-11-29T18:52:09.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6540000 2015-11-29T18:52:09.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6550000 2015-11-29T18:52:09.521-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6560000 2015-11-29T18:52:09.649-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6570000 2015-11-29T18:52:09.78-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6580000 2015-11-29T18:52:09.807-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:09.876-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6590000 2015-11-29T18:52:09.879-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2350000 QueuedCount 50000 2015-11-29T18:52:09.953-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:09.967-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6600000 2015-11-29T18:52:09.99-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2360000 QueuedCount 50000 2015-11-29T18:52:10.045-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6610000 2015-11-29T18:52:10.068-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:10.099-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2370000 QueuedCount 50000 2015-11-29T18:52:10.129-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6620000 2015-11-29T18:52:10.171-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:10.213-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2380000 QueuedCount 50000 2015-11-29T18:52:10.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6630000 2015-11-29T18:52:10.249-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:10.322-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6640000 2015-11-29T18:52:10.438-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6650000 2015-11-29T18:52:10.557-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6660000 2015-11-29T18:52:10.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6670000 2015-11-29T18:52:10.81-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6680000 2015-11-29T18:52:10.921-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6690000 2015-11-29T18:52:10.944-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2390000 QueuedCount 50000 2015-11-29T18:52:11.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6700000 2015-11-29T18:52:11.04-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:11.08-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2400000 QueuedCount 50000 2015-11-29T18:52:11.109-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6710000 2015-11-29T18:52:11.213-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6720000 2015-11-29T18:52:11.289-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2410000 QueuedCount 50000 2015-11-29T18:52:11.311-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6730000 2015-11-29T18:52:11.407-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6740000 2015-11-29T18:52:11.49-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2420000 QueuedCount 50000 2015-11-29T18:52:11.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6750000 2015-11-29T18:52:11.636-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6760000 2015-11-29T18:52:11.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6770000 2015-11-29T18:52:11.892-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6780000 2015-11-29T18:52:12.02-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6790000 2015-11-29T18:52:12.147-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6800000 2015-11-29T18:52:12.273-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6810000 2015-11-29T18:52:12.384-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2430000 QueuedCount 40598 2015-11-29T18:52:12.41-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6820000 2015-11-29T18:52:12.495-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2440000 QueuedCount 30598 2015-11-29T18:52:12.547-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6830000 2015-11-29T18:52:12.597-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2450000 QueuedCount 20598 2015-11-29T18:52:12.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6840000 2015-11-29T18:52:12.704-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2460000 QueuedCount 10598 2015-11-29T18:52:12.812-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6850000 2015-11-29T18:52:12.948-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6860000 2015-11-29T18:52:13.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6870000 2015-11-29T18:52:13.234-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6880000 2015-11-29T18:52:13.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6890000 2015-11-29T18:52:13.408-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2470000 QueuedCount 598 2015-11-29T18:52:13.511-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6900000 2015-11-29T18:52:13.57-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.763µs CommitTime 137.26709ms TotalFlushTime 1m12.036947065s TotalCommitTime 8.319489981s 2015-11-29T18:52:13.57-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1244147, 1244147, 15 committed:true 2015-11-29T18:52:13.57-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1244147, 1244147, 15 committed:true) SnapCreateDur 148.321615ms SnapOpenDur 92.255µs 2015-11-29T18:52:13.605-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:13.631-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6910000 2015-11-29T18:52:13.637-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:13.668-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:13.693-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2480000 QueuedCount 41287 2015-11-29T18:52:13.7-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:13.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6920000 2015-11-29T18:52:13.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6930000 2015-11-29T18:52:13.795-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2490000 QueuedCount 50000 2015-11-29T18:52:13.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6940000 2015-11-29T18:52:13.85-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:13.889-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6950000 2015-11-29T18:52:13.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6960000 2015-11-29T18:52:13.98-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2500000 QueuedCount 50000 2015-11-29T18:52:14.016-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6970000 2015-11-29T18:52:14.084-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6980000 2015-11-29T18:52:14.158-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6990000 2015-11-29T18:52:14.168-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:14.196-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2510000 QueuedCount 50000 2015-11-29T18:52:14.268-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7000000 2015-11-29T18:52:14.4-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7010000 2015-11-29T18:52:14.534-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7020000 2015-11-29T18:52:14.664-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7030000 2015-11-29T18:52:14.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7040000 2015-11-29T18:52:14.924-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7050000 2015-11-29T18:52:15.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7060000 2015-11-29T18:52:15.183-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7070000 2015-11-29T18:52:15.285-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7080000 2015-11-29T18:52:15.371-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2520000 QueuedCount 50000 2015-11-29T18:52:15.379-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7090000 2015-11-29T18:52:15.438-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:15.479-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7100000 2015-11-29T18:52:15.534-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2530000 QueuedCount 49999 2015-11-29T18:52:15.571-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7110000 2015-11-29T18:52:15.61-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:15.635-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2540000 QueuedCount 50000 2015-11-29T18:52:15.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7120000 2015-11-29T18:52:15.731-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7130000 2015-11-29T18:52:15.739-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2550000 QueuedCount 50000 2015-11-29T18:52:15.843-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7140000 2015-11-29T18:52:15.977-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7150000 2015-11-29T18:52:16.104-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7160000 2015-11-29T18:52:16.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7170000 2015-11-29T18:52:16.35-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7180000 2015-11-29T18:52:16.471-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7190000 2015-11-29T18:52:16.496-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:16.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7200000 2015-11-29T18:52:16.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7210000 2015-11-29T18:52:16.838-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7220000 2015-11-29T18:52:16.875-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2560000 QueuedCount 50000 2015-11-29T18:52:16.934-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7230000 2015-11-29T18:52:17.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7240000 2015-11-29T18:52:17.073-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2570000 QueuedCount 50000 2015-11-29T18:52:17.156-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7250000 2015-11-29T18:52:17.263-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7260000 2015-11-29T18:52:17.296-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2580000 QueuedCount 50000 2015-11-29T18:52:17.376-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7270000 2015-11-29T18:52:17.507-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7280000 2015-11-29T18:52:17.515-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2590000 QueuedCount 46948 2015-11-29T18:52:17.65-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7290000 2015-11-29T18:52:17.792-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7300000 2015-11-29T18:52:17.935-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7310000 2015-11-29T18:52:18.067-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7320000 2015-11-29T18:52:18.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7330000 2015-11-29T18:52:18.343-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7340000 2015-11-29T18:52:18.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7350000 2015-11-29T18:52:18.49-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2600000 QueuedCount 36948 2015-11-29T18:52:18.591-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2610000 QueuedCount 26948 2015-11-29T18:52:18.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7360000 2015-11-29T18:52:18.697-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2620000 QueuedCount 16948 2015-11-29T18:52:18.733-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7370000 2015-11-29T18:52:18.805-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2630000 QueuedCount 6948 2015-11-29T18:52:18.865-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7380000 2015-11-29T18:52:19.005-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7390000 2015-11-29T18:52:19.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7400000 2015-11-29T18:52:19.263-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7410000 2015-11-29T18:52:19.398-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7420000 2015-11-29T18:52:19.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7430000 2015-11-29T18:52:19.666-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7440000 2015-11-29T18:52:19.791-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7450000 2015-11-29T18:52:19.846-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 10.36µs CommitTime 337.720942ms TotalFlushTime 1m17.690183715s TotalCommitTime 8.657210923s 2015-11-29T18:52:19.846-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1328820, 1328820, 16 committed:true 2015-11-29T18:52:19.846-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1328820, 1328820, 16 committed:true) SnapCreateDur 364.118533ms SnapOpenDur 81.36µs 2015-11-29T18:52:19.89-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:19.903-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7460000 2015-11-29T18:52:19.928-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:19.934-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2640000 QueuedCount 47025 2015-11-29T18:52:19.979-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7470000 2015-11-29T18:52:20.046-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7480000 2015-11-29T18:52:20.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7490000 2015-11-29T18:52:20.134-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2650000 QueuedCount 50000 2015-11-29T18:52:20.184-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7500000 2015-11-29T18:52:20.185-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:20.255-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7510000 2015-11-29T18:52:20.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7520000 2015-11-29T18:52:20.344-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2660000 QueuedCount 50000 2015-11-29T18:52:20.407-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7530000 2015-11-29T18:52:20.424-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:20.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7540000 2015-11-29T18:52:20.551-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2670000 QueuedCount 50000 2015-11-29T18:52:20.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7550000 2015-11-29T18:52:20.682-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:20.707-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7560000 2015-11-29T18:52:20.863-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7570000 2015-11-29T18:52:20.992-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7580000 2015-11-29T18:52:21.112-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7590000 2015-11-29T18:52:21.234-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7600000 2015-11-29T18:52:21.36-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7610000 2015-11-29T18:52:21.765-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7620000 2015-11-29T18:52:21.889-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7630000 2015-11-29T18:52:21.94-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2680000 QueuedCount 49999 2015-11-29T18:52:21.987-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7640000 2015-11-29T18:52:22.083-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7650000 2015-11-29T18:52:22.119-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:22.141-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2690000 QueuedCount 50000 2015-11-29T18:52:22.179-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7660000 2015-11-29T18:52:22.273-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7670000 2015-11-29T18:52:22.357-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2700000 QueuedCount 50000 2015-11-29T18:52:22.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7680000 2015-11-29T18:52:22.471-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7690000 2015-11-29T18:52:22.579-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2710000 QueuedCount 45617 2015-11-29T18:52:22.592-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7700000 2015-11-29T18:52:22.711-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7710000 2015-11-29T18:52:22.835-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7720000 2015-11-29T18:52:22.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7730000 2015-11-29T18:52:23.101-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7740000 2015-11-29T18:52:23.237-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7750000 2015-11-29T18:52:23.358-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7760000 2015-11-29T18:52:23.48-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7770000 2015-11-29T18:52:23.562-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2720000 QueuedCount 35617 2015-11-29T18:52:23.609-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7780000 2015-11-29T18:52:23.663-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2730000 QueuedCount 25617 2015-11-29T18:52:23.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7790000 2015-11-29T18:52:23.769-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2740000 QueuedCount 15617 2015-11-29T18:52:23.863-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7800000 2015-11-29T18:52:23.877-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2750000 QueuedCount 5617 2015-11-29T18:52:23.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7810000 2015-11-29T18:52:24.132-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7820000 2015-11-29T18:52:24.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7830000 2015-11-29T18:52:24.422-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7840000 2015-11-29T18:52:24.56-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7850000 2015-11-29T18:52:24.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7860000 2015-11-29T18:52:24.845-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7870000 2015-11-29T18:52:24.986-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7880000 2015-11-29T18:52:25.029-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.616µs CommitTime 1.060147032s TotalFlushTime 1m21.573598592s TotalCommitTime 9.717357955s 2015-11-29T18:52:25.029-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1388746, 1388746, 17 committed:true 2015-11-29T18:52:25.029-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1388746, 1388746, 17 committed:true) SnapCreateDur 1.085646604s SnapOpenDur 47.911µs 2015-11-29T18:52:25.071-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:25.105-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7890000 2015-11-29T18:52:25.112-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:25.159-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2760000 QueuedCount 50000 2015-11-29T18:52:25.174-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7900000 2015-11-29T18:52:25.241-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7910000 2015-11-29T18:52:25.276-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:25.316-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7920000 2015-11-29T18:52:25.379-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2770000 QueuedCount 50000 2015-11-29T18:52:25.385-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7930000 2015-11-29T18:52:25.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7940000 2015-11-29T18:52:25.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7950000 2015-11-29T18:52:25.559-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:25.588-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2780000 QueuedCount 50000 2015-11-29T18:52:25.62-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7960000 2015-11-29T18:52:25.72-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7970000 2015-11-29T18:52:25.801-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2790000 QueuedCount 50000 2015-11-29T18:52:25.822-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7980000 2015-11-29T18:52:25.924-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7990000 2015-11-29T18:52:26.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8000000 2015-11-29T18:52:26.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8010000 2015-11-29T18:52:26.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8020000 2015-11-29T18:52:26.451-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8030000 2015-11-29T18:52:26.585-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8040000 2015-11-29T18:52:26.634-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:26.664-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2800000 QueuedCount 50000 2015-11-29T18:52:26.684-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8050000 2015-11-29T18:52:26.768-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8060000 2015-11-29T18:52:26.771-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2810000 QueuedCount 50000 2015-11-29T18:52:26.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8070000 2015-11-29T18:52:26.882-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2820000 QueuedCount 50000 2015-11-29T18:52:26.907-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:26.943-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8080000 2015-11-29T18:52:26.996-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2830000 QueuedCount 50000 2015-11-29T18:52:27.027-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8090000 2015-11-29T18:52:27.138-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8100000 2015-11-29T18:52:27.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8110000 2015-11-29T18:52:27.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8120000 2015-11-29T18:52:27.538-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8130000 2015-11-29T18:52:27.667-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8140000 2015-11-29T18:52:27.693-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2840000 QueuedCount 50000 2015-11-29T18:52:27.712-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:27.751-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8150000 2015-11-29T18:52:27.847-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8160000 2015-11-29T18:52:27.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8170000 2015-11-29T18:52:27.986-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2850000 QueuedCount 50000 2015-11-29T18:52:28.092-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8180000 2015-11-29T18:52:28.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8190000 2015-11-29T18:52:28.344-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8200000 2015-11-29T18:52:28.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8210000 2015-11-29T18:52:28.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8220000 2015-11-29T18:52:28.714-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8230000 2015-11-29T18:52:28.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8240000 2015-11-29T18:52:28.965-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8250000 2015-11-29T18:52:29.091-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8260000 2015-11-29T18:52:29.214-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8270000 2015-11-29T18:52:29.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8280000 2015-11-29T18:52:29.472-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8290000 2015-11-29T18:52:29.572-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2860000 QueuedCount 47402 2015-11-29T18:52:29.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8300000 2015-11-29T18:52:29.73-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8310000 2015-11-29T18:52:29.77-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2870000 QueuedCount 37402 2015-11-29T18:52:29.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8320000 2015-11-29T18:52:29.988-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8330000 2015-11-29T18:52:30.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8340000 2015-11-29T18:52:30.244-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8350000 2015-11-29T18:52:30.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8360000 2015-11-29T18:52:30.515-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8370000 2015-11-29T18:52:30.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8380000 2015-11-29T18:52:30.786-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8390000 2015-11-29T18:52:30.831-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2880000 QueuedCount 27402 2015-11-29T18:52:30.924-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8400000 2015-11-29T18:52:30.961-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2890000 QueuedCount 17402 2015-11-29T18:52:31.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8410000 2015-11-29T18:52:31.079-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2900000 QueuedCount 7402 2015-11-29T18:52:31.187-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8420000 2015-11-29T18:52:31.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8430000 2015-11-29T18:52:31.444-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8440000 2015-11-29T18:52:31.569-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8450000 2015-11-29T18:52:31.698-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8460000 2015-11-29T18:52:31.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8470000 2015-11-29T18:52:31.955-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8480000 2015-11-29T18:52:32.093-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8490000 2015-11-29T18:52:32.124-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.987µs CommitTime 917.440966ms TotalFlushTime 1m27.465371903s TotalCommitTime 10.634798921s 2015-11-29T18:52:32.124-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1465308, 1465308, 18 committed:true 2015-11-29T18:52:32.124-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1465308, 1465308, 18 committed:true) SnapCreateDur 943.008685ms SnapOpenDur 64.174µs 2015-11-29T18:52:32.16-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:32.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8500000 2015-11-29T18:52:32.201-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:32.207-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2910000 QueuedCount 40301 2015-11-29T18:52:32.261-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8510000 2015-11-29T18:52:32.323-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8520000 2015-11-29T18:52:32.33-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:32.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8530000 2015-11-29T18:52:32.409-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2920000 QueuedCount 50000 2015-11-29T18:52:32.461-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8540000 2015-11-29T18:52:32.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8550000 2015-11-29T18:52:32.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8560000 2015-11-29T18:52:32.61-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2930000 QueuedCount 50000 2015-11-29T18:52:32.643-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:32.673-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8570000 2015-11-29T18:52:32.79-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8580000 2015-11-29T18:52:32.905-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2940000 QueuedCount 50000 2015-11-29T18:52:32.906-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8590000 2015-11-29T18:52:33.003-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8600000 2015-11-29T18:52:33.039-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:33.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8610000 2015-11-29T18:52:33.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8620000 2015-11-29T18:52:33.39-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8630000 2015-11-29T18:52:33.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8640000 2015-11-29T18:52:33.679-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8650000 2015-11-29T18:52:33.78-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2950000 QueuedCount 50000 2015-11-29T18:52:33.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8660000 2015-11-29T18:52:33.886-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2960000 QueuedCount 50000 2015-11-29T18:52:33.89-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8670000 2015-11-29T18:52:33.989-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2970000 QueuedCount 43488 2015-11-29T18:52:34.005-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8680000 2015-11-29T18:52:34.091-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2980000 QueuedCount 33488 2015-11-29T18:52:34.139-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8690000 2015-11-29T18:52:34.271-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8700000 2015-11-29T18:52:34.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8710000 2015-11-29T18:52:34.518-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8720000 2015-11-29T18:52:34.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8730000 2015-11-29T18:52:34.753-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 2990000 QueuedCount 23488 2015-11-29T18:52:34.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8740000 2015-11-29T18:52:34.845-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3000000 QueuedCount 13488 2015-11-29T18:52:34.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8750000 2015-11-29T18:52:34.928-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3010000 QueuedCount 3488 2015-11-29T18:52:35.021-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8760000 2015-11-29T18:52:35.395-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.899µs CommitTime 411.72678ms TotalFlushTime 1m30.134147762s TotalCommitTime 11.046525701s 2015-11-29T18:52:35.396-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1518725, 1518725, 19 committed:true 2015-11-29T18:52:35.396-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1518725, 1518725, 19 committed:true) SnapCreateDur 431.053728ms SnapOpenDur 51.724µs 2015-11-29T18:52:35.429-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:35.462-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:35.497-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:35.523-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3020000 QueuedCount 50000 2015-11-29T18:52:35.744-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3030000 QueuedCount 50000 2015-11-29T18:52:35.973-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3040000 QueuedCount 50000 2015-11-29T18:52:36.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:36.233-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3050000 QueuedCount 50000 2015-11-29T18:52:37.442-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3060000 QueuedCount 50000 2015-11-29T18:52:37.64-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3070000 QueuedCount 50000 2015-11-29T18:52:37.679-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:37.785-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3080000 QueuedCount 50000 2015-11-29T18:52:38.031-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3090000 QueuedCount 50000 2015-11-29T18:52:38.956-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:38.983-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8770000 2015-11-29T18:52:39.01-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3100000 QueuedCount 50000 2015-11-29T18:52:39.049-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8780000 2015-11-29T18:52:39.12-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8790000 2015-11-29T18:52:39.182-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8800000 2015-11-29T18:52:39.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8810000 2015-11-29T18:52:39.253-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3110000 QueuedCount 50000 2015-11-29T18:52:39.318-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8820000 2015-11-29T18:52:39.404-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8830000 2015-11-29T18:52:39.45-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3120000 QueuedCount 41443 2015-11-29T18:52:39.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8840000 2015-11-29T18:52:39.594-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8850000 2015-11-29T18:52:39.689-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8860000 2015-11-29T18:52:39.784-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8870000 2015-11-29T18:52:42.459-08:00 [Info] CompactionDaemon: Finished compacting index instance:3094208154756435235 2015-11-29T18:52:42.48-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3130000 QueuedCount 31443 2015-11-29T18:52:42.673-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3140000 QueuedCount 21443 2015-11-29T18:52:42.875-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3150000 QueuedCount 11443 2015-11-29T18:52:43.063-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3160000 QueuedCount 1443 2015-11-29T18:52:44.139-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 23.347µs CommitTime 1.01795297s TotalFlushTime 1m37.431300416s TotalCommitTime 12.064478671s 2015-11-29T18:52:44.139-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1593203, 1593203, 20 committed:true 2015-11-29T18:52:44.139-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1593203, 1593203, 20 committed:true) SnapCreateDur 1.044580684s SnapOpenDur 60.234µs 2015-11-29T18:52:44.331-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3170000 QueuedCount 2204 2015-11-29T18:52:44.663-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_capped_small_0_3094208154756435235_0.index/data.fdb.0', errno = 2: 'No such file or directory' 2015-11-29T18:52:44.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 743 2015-11-29T18:52:44.856-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 9.15µs CommitTime 448.717452ms TotalFlushTime 1m37.632347983s TotalCommitTime 12.513196123s 2015-11-29T18:52:44.856-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1598662, 1598662, 21 committed:true 2015-11-29T18:52:44.856-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1598662, 1598662, 21 committed:true) SnapCreateDur 474.891105ms SnapOpenDur 153µs 2015-11-29T18:52:44.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 743 2015-11-29T18:52:44.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 743 2015-11-29T18:52:44.891-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:44.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 743 2015-11-29T18:52:44.925-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:44.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 743 2015-11-29T18:52:44.961-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:44.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 743 2015-11-29T18:52:44.997-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:45.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 743 2015-11-29T18:52:45.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 743 2015-11-29T18:52:45.064-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3180000 QueuedCount 50000 2015-11-29T18:52:45.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 743 2015-11-29T18:52:45.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 743 2015-11-29T18:52:45.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 743 2015-11-29T18:52:45.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 743 2015-11-29T18:52:45.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 743 2015-11-29T18:52:45.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 743 2015-11-29T18:52:45.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 743 2015-11-29T18:52:45.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 743 2015-11-29T18:52:45.284-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:45.3-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3190000 QueuedCount 49215 2015-11-29T18:52:45.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 743 2015-11-29T18:52:45.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 743 2015-11-29T18:52:45.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 743 2015-11-29T18:52:45.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 743 2015-11-29T18:52:45.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 743 2015-11-29T18:52:45.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 743 2015-11-29T18:52:45.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 743 2015-11-29T18:52:45.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 743 2015-11-29T18:52:45.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 743 2015-11-29T18:52:45.553-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3200000 QueuedCount 50000 2015-11-29T18:52:45.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 743 2015-11-29T18:52:45.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 743 2015-11-29T18:52:45.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 743 2015-11-29T18:52:45.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 743 2015-11-29T18:52:45.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 743 2015-11-29T18:52:45.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 743 2015-11-29T18:52:45.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 743 2015-11-29T18:52:45.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 743 2015-11-29T18:52:45.806-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3210000 QueuedCount 50000 2015-11-29T18:52:45.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 743 2015-11-29T18:52:45.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 743 2015-11-29T18:52:45.862-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:45.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 743 2015-11-29T18:52:46.956-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3220000 QueuedCount 50000 2015-11-29T18:52:46.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8880000 2015-11-29T18:52:47.035-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8890000 2015-11-29T18:52:47.093-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:47.106-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3230000 QueuedCount 49327 2015-11-29T18:52:47.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8900000 2015-11-29T18:52:47.351-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3240000 QueuedCount 50000 2015-11-29T18:52:47.443-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:47.601-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8910000 2015-11-29T18:52:47.605-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3250000 QueuedCount 50000 2015-11-29T18:52:48.839-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:48.91-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3260000 QueuedCount 50000 2015-11-29T18:52:49.001-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8920000 2015-11-29T18:52:49.165-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3270000 QueuedCount 50000 2015-11-29T18:52:49.352-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:49.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8930000 2015-11-29T18:52:49.411-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3280000 QueuedCount 50000 2015-11-29T18:52:49.668-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3290000 QueuedCount 50000 2015-11-29T18:52:49.721-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8940000 2015-11-29T18:52:50.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8950000 2015-11-29T18:52:50.843-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3300000 QueuedCount 49999 2015-11-29T18:52:50.896-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8960000 2015-11-29T18:52:50.959-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3310000 QueuedCount 41919 2015-11-29T18:52:51.063-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3320000 QueuedCount 31919 2015-11-29T18:52:51.17-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3330000 QueuedCount 21919 2015-11-29T18:52:51.883-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3340000 QueuedCount 11919 2015-11-29T18:52:51.982-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3350000 QueuedCount 1919 2015-11-29T18:52:52.713-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.944µs CommitTime 687.869877ms TotalFlushTime 1m44.234343829s TotalCommitTime 13.201066s 2015-11-29T18:52:52.713-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1689202, 1689202, 22 committed:true 2015-11-29T18:52:52.713-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1689202, 1689202, 22 committed:true) SnapCreateDur 714.075967ms SnapOpenDur 86.622µs 2015-11-29T18:52:52.756-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:52.795-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:52.836-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:52.875-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8970000 2015-11-29T18:52:52.931-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3360000 QueuedCount 50000 2015-11-29T18:52:52.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8980000 2015-11-29T18:52:53.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8990000 2015-11-29T18:52:53.107-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9000000 2015-11-29T18:52:53.157-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3370000 QueuedCount 50000 2015-11-29T18:52:53.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9010000 2015-11-29T18:52:53.264-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9020000 2015-11-29T18:52:53.304-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:53.346-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9030000 2015-11-29T18:52:53.385-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5800223015,"bucket-1:by_capped_small_0:avg_ts_items_count":126809,"bucket-1:by_capped_small_0:build_progress":16,"bucket-1:by_capped_small_0:data_size":528474166,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":1108172800,"bucket-1:by_capped_small_0:flush_queue_size":50042,"bucket-1:by_capped_small_0:frag_percent":52,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":154593742,"bucket-1:by_capped_small_0:items_count":1598662,"bucket-1:by_capped_small_0:num_commits":22,"bucket-1:by_capped_small_0:num_compactions":1,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":3293463,"bucket-1:by_capped_small_0:num_docs_pending":11083535,"bucket-1:by_capped_small_0:num_docs_queued":5623002,"bucket-1:by_capped_small_0:num_flush_queued":3429931,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":22,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":7856533601,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"22 13201066000 -8941296859458942250","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"3379890 30865558204 8032614645800215678","bucket-1:by_capped_small_0:timings/storage_handle_open":"22 1226626 84533279342","bucket-1:by_capped_small_0:timings/storage_info":"89 1723523 284683914135","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"22 812533693 643462733681523053","bucket-1:by_capped_small_0:timings/storage_meta_set":"22 14028610 10309263490020","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"3407310 70119567817 6600621833019390003","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5605153,"bucket-1:num_mutations_queued":9035045,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":340,"memory_quota":104857600000,"memory_used":960319488,"needs_restart":false,"num_connections":0,"timings/stats_response":"1581 186849219 1487783250778849"} 2015-11-29T18:52:53.387-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3380000 QueuedCount 50000 2015-11-29T18:52:53.423-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9040000 2015-11-29T18:52:53.501-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9050000 2015-11-29T18:52:53.572-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9060000 2015-11-29T18:52:53.578-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3390000 QueuedCount 50000 2015-11-29T18:52:53.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9070000 2015-11-29T18:52:53.753-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9080000 2015-11-29T18:52:53.857-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9090000 2015-11-29T18:52:53.957-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9100000 2015-11-29T18:52:54.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9110000 2015-11-29T18:52:54.156-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9120000 2015-11-29T18:52:54.258-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9130000 2015-11-29T18:52:54.362-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9140000 2015-11-29T18:52:54.466-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9150000 2015-11-29T18:52:54.565-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9160000 2015-11-29T18:52:54.67-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9170000 2015-11-29T18:52:54.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9180000 2015-11-29T18:52:54.767-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:54.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9190000 2015-11-29T18:52:54.875-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3400000 QueuedCount 50000 2015-11-29T18:52:55.091-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9200000 2015-11-29T18:52:55.131-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3410000 QueuedCount 49246 2015-11-29T18:52:55.345-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3420000 QueuedCount 39246 2015-11-29T18:52:55.56-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3430000 QueuedCount 29246 2015-11-29T18:52:56.563-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3440000 QueuedCount 19246 2015-11-29T18:52:56.665-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3450000 QueuedCount 9246 2015-11-29T18:52:57.635-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 27.193µs CommitTime 844.051096ms TotalFlushTime 1m48.043652778s TotalCommitTime 14.045117096s 2015-11-29T18:52:57.635-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1743740, 1743740, 23 committed:true 2015-11-29T18:52:57.635-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1743740, 1743740, 23 committed:true) SnapCreateDur 870.284046ms SnapOpenDur 86.656µs 2015-11-29T18:52:57.671-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:57.676-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3460000 QueuedCount 14667 2015-11-29T18:52:57.709-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:57.746-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:57.759-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9210000 2015-11-29T18:52:57.838-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9220000 2015-11-29T18:52:57.901-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3470000 QueuedCount 50000 2015-11-29T18:52:57.915-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9230000 2015-11-29T18:52:57.921-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:57.994-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9240000 2015-11-29T18:52:58.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9250000 2015-11-29T18:52:58.118-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3480000 QueuedCount 50000 2015-11-29T18:52:58.269-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:58.363-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3490000 QueuedCount 50000 2015-11-29T18:52:58.626-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3500000 QueuedCount 50000 2015-11-29T18:52:59.954-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:52:59.989-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3510000 QueuedCount 50000 2015-11-29T18:53:00.238-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3520000 QueuedCount 50000 2015-11-29T18:53:00.512-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3530000 QueuedCount 50000 2015-11-29T18:53:00.788-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3540000 QueuedCount 50000 2015-11-29T18:53:01.92-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3550000 QueuedCount 40339 2015-11-29T18:53:02.027-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3560000 QueuedCount 30339 2015-11-29T18:53:02.138-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3570000 QueuedCount 20339 2015-11-29T18:53:02.252-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3580000 QueuedCount 10339 2015-11-29T18:53:02.996-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3590000 QueuedCount 339 2015-11-29T18:53:03.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 15 2015-11-29T18:53:03.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 15 2015-11-29T18:53:03.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 15 2015-11-29T18:53:03.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 15 2015-11-29T18:53:03.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 15 2015-11-29T18:53:03.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 15 2015-11-29T18:53:03.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 15 2015-11-29T18:53:03.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 15 2015-11-29T18:53:03.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 15 2015-11-29T18:53:03.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 15 2015-11-29T18:53:03.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 15 2015-11-29T18:53:03.465-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 26.197µs CommitTime 431.201294ms TotalFlushTime 1m53.020293327s TotalCommitTime 14.47631839s 2015-11-29T18:53:03.465-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1809880, 1809880, 24 committed:true 2015-11-29T18:53:03.465-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1809880, 1809880, 24 committed:true) SnapCreateDur 457.462046ms SnapOpenDur 81.63µs 2015-11-29T18:53:03.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 15 2015-11-29T18:53:03.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 15 2015-11-29T18:53:03.517-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:03.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 15 2015-11-29T18:53:03.554-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:03.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 15 2015-11-29T18:53:03.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 15 2015-11-29T18:53:03.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 15 2015-11-29T18:53:03.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 15 2015-11-29T18:53:03.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 15 2015-11-29T18:53:03.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 15 2015-11-29T18:53:03.734-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3600000 QueuedCount 50000 2015-11-29T18:53:03.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 15 2015-11-29T18:53:03.741-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:03.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 15 2015-11-29T18:53:03.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 15 2015-11-29T18:53:03.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 15 2015-11-29T18:53:03.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 15 2015-11-29T18:53:03.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 15 2015-11-29T18:53:03.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 15 2015-11-29T18:53:03.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 15 2015-11-29T18:53:03.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3610000 QueuedCount 50000 2015-11-29T18:53:03.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 15 2015-11-29T18:53:04.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 15 2015-11-29T18:53:04.034-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:04.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 15 2015-11-29T18:53:04.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 15 2015-11-29T18:53:04.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 15 2015-11-29T18:53:04.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 15 2015-11-29T18:53:04.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 15 2015-11-29T18:53:04.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 15 2015-11-29T18:53:04.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 15 2015-11-29T18:53:04.222-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3620000 QueuedCount 50000 2015-11-29T18:53:04.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 15 2015-11-29T18:53:04.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 15 2015-11-29T18:53:04.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 15 2015-11-29T18:53:04.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 15 2015-11-29T18:53:04.356-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:04.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 15 2015-11-29T18:53:04.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 15 2015-11-29T18:53:04.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 15 2015-11-29T18:53:04.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 15 2015-11-29T18:53:04.472-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3630000 QueuedCount 50000 2015-11-29T18:53:04.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 15 2015-11-29T18:53:04.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 15 2015-11-29T18:53:04.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 15 2015-11-29T18:53:04.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 15 2015-11-29T18:53:04.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 15 2015-11-29T18:53:04.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 15 2015-11-29T18:53:04.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 15 2015-11-29T18:53:04.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 15 2015-11-29T18:53:04.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 15 2015-11-29T18:53:04.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 15 2015-11-29T18:53:04.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 15 2015-11-29T18:53:04.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 15 2015-11-29T18:53:04.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 15 2015-11-29T18:53:04.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 15 2015-11-29T18:53:04.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 15 2015-11-29T18:53:04.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 15 2015-11-29T18:53:04.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 15 2015-11-29T18:53:05.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 15 2015-11-29T18:53:05.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 15 2015-11-29T18:53:05.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 15 2015-11-29T18:53:05.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 15 2015-11-29T18:53:05.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 15 2015-11-29T18:53:05.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 15 2015-11-29T18:53:05.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 15 2015-11-29T18:53:05.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 15 2015-11-29T18:53:05.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 15 2015-11-29T18:53:05.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 15 2015-11-29T18:53:05.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 15 2015-11-29T18:53:05.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 15 2015-11-29T18:53:05.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 15 2015-11-29T18:53:05.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 15 2015-11-29T18:53:05.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 15 2015-11-29T18:53:05.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 15 2015-11-29T18:53:05.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 15 2015-11-29T18:53:05.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 15 2015-11-29T18:53:05.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 15 2015-11-29T18:53:05.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 15 2015-11-29T18:53:05.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 15 2015-11-29T18:53:05.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 15 2015-11-29T18:53:05.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 15 2015-11-29T18:53:05.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 15 2015-11-29T18:53:05.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 15 2015-11-29T18:53:05.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 15 2015-11-29T18:53:05.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 15 2015-11-29T18:53:05.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 15 2015-11-29T18:53:05.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 15 2015-11-29T18:53:05.844-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3640000 QueuedCount 50000 2015-11-29T18:53:05.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 15 2015-11-29T18:53:05.871-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:06.004-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9260000 2015-11-29T18:53:06.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9270000 2015-11-29T18:53:06.136-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3650000 QueuedCount 50000 2015-11-29T18:53:06.175-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9280000 2015-11-29T18:53:06.261-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9290000 2015-11-29T18:53:06.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9300000 2015-11-29T18:53:06.374-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3660000 QueuedCount 50000 2015-11-29T18:53:06.422-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9310000 2015-11-29T18:53:06.515-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9320000 2015-11-29T18:53:06.604-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3670000 QueuedCount 43702 2015-11-29T18:53:06.628-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9330000 2015-11-29T18:53:06.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9340000 2015-11-29T18:53:06.861-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9350000 2015-11-29T18:53:06.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9360000 2015-11-29T18:53:07.069-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9370000 2015-11-29T18:53:07.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9380000 2015-11-29T18:53:07.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9390000 2015-11-29T18:53:07.401-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9400000 2015-11-29T18:53:07.61-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3680000 QueuedCount 33702 2015-11-29T18:53:07.713-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3690000 QueuedCount 23702 2015-11-29T18:53:07.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3700000 QueuedCount 13702 2015-11-29T18:53:07.93-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3710000 QueuedCount 3702 2015-11-29T18:53:09.222-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.29µs CommitTime 1.219845274s TotalFlushTime 1m57.173202627s TotalCommitTime 15.696163664s 2015-11-29T18:53:09.222-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1870993, 1870993, 25 committed:true 2015-11-29T18:53:09.222-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1870993, 1870993, 25 committed:true) SnapCreateDur 1.246787107s SnapOpenDur 49.997µs 2015-11-29T18:53:09.264-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:09.298-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:09.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:09.388-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3720000 QueuedCount 50000 2015-11-29T18:53:09.401-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:09.618-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3730000 QueuedCount 50000 2015-11-29T18:53:09.705-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:09.868-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3740000 QueuedCount 50000 2015-11-29T18:53:10.086-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:10.122-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3750000 QueuedCount 50000 2015-11-29T18:53:11.423-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3760000 QueuedCount 50000 2015-11-29T18:53:11.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:11.625-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3770000 QueuedCount 49666 2015-11-29T18:53:11.881-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3780000 QueuedCount 50000 2015-11-29T18:53:12.123-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3790000 QueuedCount 48327 2015-11-29T18:53:12.459-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:603893991, Disk:1401012224, ExtraSnapshotData:0, Fragmentation:56.89587994629803% 2015-11-29T18:53:12.459-08:00 [Info] CompactionDaemon: Compacting index instance:3094208154756435235 2015-11-29T18:53:12.46-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 75 2015-11-29T18:53:12.49-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 75 2015-11-29T18:53:12.52-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 75 2015-11-29T18:53:12.55-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 75 2015-11-29T18:53:12.58-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 75 2015-11-29T18:53:12.61-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 75 2015-11-29T18:53:12.64-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 75 2015-11-29T18:53:12.67-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 75 2015-11-29T18:53:12.7-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 75 2015-11-29T18:53:12.73-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 75 2015-11-29T18:53:12.76-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 75 2015-11-29T18:53:12.79-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 75 2015-11-29T18:53:12.82-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 75 2015-11-29T18:53:12.85-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 75 2015-11-29T18:53:12.88-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 75 2015-11-29T18:53:12.91-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 75 2015-11-29T18:53:12.94-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 75 2015-11-29T18:53:12.97-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 75 2015-11-29T18:53:13-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 75 2015-11-29T18:53:13.03-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 75 2015-11-29T18:53:13.06-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 75 2015-11-29T18:53:13.067-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 1598662. Slice Id 0, IndexInstId 3094208154756435235, IndexDefnId 3094208154756435235 2015-11-29T18:53:13.09-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 75 2015-11-29T18:53:13.12-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 75 2015-11-29T18:53:13.15-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 75 2015-11-29T18:53:13.18-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 75 2015-11-29T18:53:13.21-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 75 2015-11-29T18:53:13.24-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 75 2015-11-29T18:53:13.27-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 75 2015-11-29T18:53:13.3-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 75 2015-11-29T18:53:13.323-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3800000 QueuedCount 38327 2015-11-29T18:53:13.33-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 75 2015-11-29T18:53:13.36-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 75 2015-11-29T18:53:13.39-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 75 2015-11-29T18:53:13.42-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 75 2015-11-29T18:53:13.432-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3810000 QueuedCount 28327 2015-11-29T18:53:13.45-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 75 2015-11-29T18:53:13.48-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 75 2015-11-29T18:53:13.51-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 75 2015-11-29T18:53:13.54-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 75 2015-11-29T18:53:13.57-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 75 2015-11-29T18:53:13.579-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3820000 QueuedCount 18327 2015-11-29T18:53:13.6-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 75 2015-11-29T18:53:13.63-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 75 2015-11-29T18:53:13.66-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 75 2015-11-29T18:53:13.69-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 75 2015-11-29T18:53:13.72-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 75 2015-11-29T18:53:13.744-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3830000 QueuedCount 8327 2015-11-29T18:53:13.75-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 75 2015-11-29T18:53:13.78-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 75 2015-11-29T18:53:13.81-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 75 2015-11-29T18:53:13.84-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 75 2015-11-29T18:53:13.87-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 75 2015-11-29T18:53:13.9-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 75 2015-11-29T18:53:13.93-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 75 2015-11-29T18:53:13.96-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 75 2015-11-29T18:53:13.99-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 75 2015-11-29T18:53:14.02-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 75 2015-11-29T18:53:14.05-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 75 2015-11-29T18:53:14.08-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 75 2015-11-29T18:53:14.11-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 75 2015-11-29T18:53:14.14-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 75 2015-11-29T18:53:14.17-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 75 2015-11-29T18:53:14.2-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 75 2015-11-29T18:53:14.23-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 75 2015-11-29T18:53:14.26-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 75 2015-11-29T18:53:14.29-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 75 2015-11-29T18:53:14.32-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 75 2015-11-29T18:53:14.35-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 75 2015-11-29T18:53:14.38-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 75 2015-11-29T18:53:14.41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 75 2015-11-29T18:53:14.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 75 2015-11-29T18:53:14.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 75 2015-11-29T18:53:14.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 75 2015-11-29T18:53:14.53-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 75 2015-11-29T18:53:14.56-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 75 2015-11-29T18:53:14.59-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 75 2015-11-29T18:53:14.62-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 75 2015-11-29T18:53:14.65-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 75 2015-11-29T18:53:14.68-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 75 2015-11-29T18:53:14.71-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 75 2015-11-29T18:53:14.732-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.087µs CommitTime 81.241269ms TotalFlushTime 2m2.195571379s TotalCommitTime 15.777404933s 2015-11-29T18:53:14.732-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1933844, 1933844, 26 committed:true 2015-11-29T18:53:14.732-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1933844, 1933844, 26 committed:true) SnapCreateDur 104.510761ms SnapOpenDur 77.473µs 2015-11-29T18:53:14.74-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 75 2015-11-29T18:53:14.766-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:14.791-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3840000 QueuedCount 21210 2015-11-29T18:53:14.797-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:14.818-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9410000 2015-11-29T18:53:14.829-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:14.886-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9420000 2015-11-29T18:53:14.895-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:14.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9430000 2015-11-29T18:53:15.005-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3850000 QueuedCount 50000 2015-11-29T18:53:15.011-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9440000 2015-11-29T18:53:15.074-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9450000 2015-11-29T18:53:15.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9460000 2015-11-29T18:53:15.187-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:15.202-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9470000 2015-11-29T18:53:15.209-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3860000 QueuedCount 50000 2015-11-29T18:53:15.266-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9480000 2015-11-29T18:53:15.329-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9490000 2015-11-29T18:53:15.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9500000 2015-11-29T18:53:15.439-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3870000 QueuedCount 50000 2015-11-29T18:53:15.464-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9510000 2015-11-29T18:53:15.534-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9520000 2015-11-29T18:53:15.589-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:15.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9530000 2015-11-29T18:53:15.664-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9540000 2015-11-29T18:53:15.744-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9550000 2015-11-29T18:53:15.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9560000 2015-11-29T18:53:15.911-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9570000 2015-11-29T18:53:15.996-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9580000 2015-11-29T18:53:16.085-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9590000 2015-11-29T18:53:16.172-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9600000 2015-11-29T18:53:16.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9610000 2015-11-29T18:53:16.345-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9620000 2015-11-29T18:53:16.437-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9630000 2015-11-29T18:53:16.544-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9640000 2015-11-29T18:53:16.696-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3880000 QueuedCount 50000 2015-11-29T18:53:16.818-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3890000 QueuedCount 50000 2015-11-29T18:53:16.891-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:16.94-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3900000 QueuedCount 50000 2015-11-29T18:53:17.109-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3910000 QueuedCount 50000 2015-11-29T18:53:18.299-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3920000 QueuedCount 42762 2015-11-29T18:53:18.412-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3930000 QueuedCount 32762 2015-11-29T18:53:18.516-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3940000 QueuedCount 22762 2015-11-29T18:53:18.621-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3950000 QueuedCount 12762 2015-11-29T18:53:19.348-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3960000 QueuedCount 2762 2015-11-29T18:53:19.542-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.025µs CommitTime 144.7268ms TotalFlushTime 2m6.61407506s TotalCommitTime 15.922131733s 2015-11-29T18:53:19.542-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 1997203, 1997203, 27 committed:true 2015-11-29T18:53:19.542-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 1997203, 1997203, 27 committed:true) SnapCreateDur 157.82073ms SnapOpenDur 38.759µs 2015-11-29T18:53:19.573-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:19.602-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:19.632-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:19.663-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:19.709-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3970000 QueuedCount 50000 2015-11-29T18:53:19.809-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:19.918-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3980000 QueuedCount 50000 2015-11-29T18:53:20.11-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:20.14-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 3990000 QueuedCount 50000 2015-11-29T18:53:20.159-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9650000 2015-11-29T18:53:20.361-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4000000 QueuedCount 50000 2015-11-29T18:53:20.412-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:21.192-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4010000 QueuedCount 50000 2015-11-29T18:53:21.266-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:21.31-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4020000 QueuedCount 50000 2015-11-29T18:53:21.359-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9660000 2015-11-29T18:53:21.442-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4030000 QueuedCount 50000 2015-11-29T18:53:21.444-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:21.506-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9670000 2015-11-29T18:53:21.556-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4040000 QueuedCount 50000 2015-11-29T18:53:21.612-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:22.731-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4050000 QueuedCount 50000 2015-11-29T18:53:23.37-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9680000 2015-11-29T18:53:23.843-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:23.897-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4060000 QueuedCount 50000 2015-11-29T18:53:24.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9690000 2015-11-29T18:53:24.987-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9700000 2015-11-29T18:53:25.042-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4070000 QueuedCount 50000 2015-11-29T18:53:25.263-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4080000 QueuedCount 44568 2015-11-29T18:53:26.342-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4090000 QueuedCount 34568 2015-11-29T18:53:26.452-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4100000 QueuedCount 24568 2015-11-29T18:53:26.828-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4110000 QueuedCount 14568 2015-11-29T18:53:27.625-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4120000 QueuedCount 4568 2015-11-29T18:53:28.804-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.19µs CommitTime 1.054954241s TotalFlushTime 2m14.428950295s TotalCommitTime 16.977085974s 2015-11-29T18:53:28.805-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2078718, 2078718, 28 committed:true 2015-11-29T18:53:28.805-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2078718, 2078718, 28 committed:true) SnapCreateDur 1.08174985s SnapOpenDur 58.942µs 2015-11-29T18:53:28.85-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:28.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9710000 2015-11-29T18:53:28.913-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4130000 QueuedCount 50000 2015-11-29T18:53:28.972-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9720000 2015-11-29T18:53:29.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9730000 2015-11-29T18:53:29.104-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4140000 QueuedCount 41708 2015-11-29T18:53:29.132-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9740000 2015-11-29T18:53:29.292-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4150000 QueuedCount 31708 2015-11-29T18:53:29.459-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4160000 QueuedCount 21708 2015-11-29T18:53:30.247-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4170000 QueuedCount 11708 2015-11-29T18:53:30.342-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4180000 QueuedCount 1708 2015-11-29T18:53:30.67-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.322µs CommitTime 288.958996ms TotalFlushTime 2m15.89918608s TotalCommitTime 17.26604497s 2015-11-29T18:53:30.67-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2107606, 2107606, 29 committed:true 2015-11-29T18:53:30.67-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2107606, 2107606, 29 committed:true) SnapCreateDur 301.946034ms SnapOpenDur 85.325µs 2015-11-29T18:53:30.707-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:30.74-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:30.745-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9750000 2015-11-29T18:53:30.77-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:30.818-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9760000 2015-11-29T18:53:30.822-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:30.872-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4190000 QueuedCount 50000 2015-11-29T18:53:30.889-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9770000 2015-11-29T18:53:30.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9780000 2015-11-29T18:53:31.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9790000 2015-11-29T18:53:31.073-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4200000 QueuedCount 50000 2015-11-29T18:53:31.074-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9800000 2015-11-29T18:53:31.097-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:31.14-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9810000 2015-11-29T18:53:31.289-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9820000 2015-11-29T18:53:31.291-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4210000 QueuedCount 50000 2015-11-29T18:53:31.446-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:31.515-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4220000 QueuedCount 50000 2015-11-29T18:53:31.531-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9830000 2015-11-29T18:53:32.732-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4230000 QueuedCount 50000 2015-11-29T18:53:32.76-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9840000 2015-11-29T18:53:32.845-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:32.86-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4240000 QueuedCount 48729 2015-11-29T18:53:32.913-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9850000 2015-11-29T18:53:32.985-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4250000 QueuedCount 50000 2015-11-29T18:53:33.064-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9860000 2015-11-29T18:53:33.156-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:33.162-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4260000 QueuedCount 49698 2015-11-29T18:53:34.326-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4270000 QueuedCount 50000 2015-11-29T18:53:34.384-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:34.446-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9870000 2015-11-29T18:53:34.452-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4280000 QueuedCount 50000 2015-11-29T18:53:34.538-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9880000 2015-11-29T18:53:34.561-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4290000 QueuedCount 45989 2015-11-29T18:53:34.664-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4300000 QueuedCount 35989 2015-11-29T18:53:35.37-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4310000 QueuedCount 25989 2015-11-29T18:53:35.465-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4320000 QueuedCount 15989 2015-11-29T18:53:35.548-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4330000 QueuedCount 5989 2015-11-29T18:53:36.053-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.143µs CommitTime 442.101066ms TotalFlushTime 2m20.550651949s TotalCommitTime 17.708146036s 2015-11-29T18:53:36.053-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2184362, 2184362, 30 committed:true 2015-11-29T18:53:36.053-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2184362, 2184362, 30 committed:true) SnapCreateDur 452.747838ms SnapOpenDur 65.297µs 2015-11-29T18:53:36.083-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:36.113-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:36.143-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:36.164-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4340000 QueuedCount 32152 2015-11-29T18:53:36.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9890000 2015-11-29T18:53:36.181-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:36.247-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9900000 2015-11-29T18:53:36.308-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9910000 2015-11-29T18:53:36.369-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9920000 2015-11-29T18:53:36.382-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4350000 QueuedCount 50000 2015-11-29T18:53:36.461-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9930000 2015-11-29T18:53:37.5-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4360000 QueuedCount 50000 2015-11-29T18:53:37.575-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:37.585-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9940000 2015-11-29T18:53:37.735-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4370000 QueuedCount 50000 2015-11-29T18:53:37.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9950000 2015-11-29T18:53:37.883-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:38.88-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4380000 QueuedCount 50000 2015-11-29T18:53:39.034-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9960000 2015-11-29T18:53:39.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:39.081-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4390000 QueuedCount 48873 2015-11-29T18:53:39.297-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4400000 QueuedCount 50000 2015-11-29T18:53:39.308-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9970000 2015-11-29T18:53:39.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:39.519-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4410000 QueuedCount 50000 2015-11-29T18:53:39.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9980000 2015-11-29T18:53:39.594-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:40.762-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4420000 QueuedCount 50000 2015-11-29T18:53:40.811-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9990000 2015-11-29T18:53:40.891-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4430000 QueuedCount 45523 2015-11-29T18:53:40.998-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4440000 QueuedCount 35523 2015-11-29T18:53:41.103-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4450000 QueuedCount 25523 2015-11-29T18:53:41.826-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4460000 QueuedCount 15523 2015-11-29T18:53:41.923-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4470000 QueuedCount 5523 2015-11-29T18:53:42.66-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.42µs CommitTime 650.006632ms TotalFlushTime 2m26.168978602s TotalCommitTime 18.358152668s 2015-11-29T18:53:42.66-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2254670, 2254670, 31 committed:true 2015-11-29T18:53:42.66-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2254670, 2254670, 31 committed:true) SnapCreateDur 673.546292ms SnapOpenDur 116.685µs 2015-11-29T18:53:42.691-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:42.722-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:42.742-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000000 2015-11-29T18:53:42.754-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:42.775-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4480000 QueuedCount 35352 2015-11-29T18:53:42.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:42.814-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10010000 2015-11-29T18:53:42.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10020000 2015-11-29T18:53:42.935-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10030000 2015-11-29T18:53:42.947-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:42.98-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4490000 QueuedCount 50000 2015-11-29T18:53:43.001-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10040000 2015-11-29T18:53:43.063-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10050000 2015-11-29T18:53:43.126-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10060000 2015-11-29T18:53:43.181-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4500000 QueuedCount 50000 2015-11-29T18:53:43.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:43.189-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10070000 2015-11-29T18:53:43.314-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10080000 2015-11-29T18:53:43.394-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4510000 QueuedCount 50000 2015-11-29T18:53:43.428-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:43.502-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10090000 2015-11-29T18:53:44.208-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4520000 QueuedCount 50000 2015-11-29T18:53:44.246-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:44.303-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4530000 QueuedCount 50000 2015-11-29T18:53:44.318-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10100000 2015-11-29T18:53:44.448-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4540000 QueuedCount 50000 2015-11-29T18:53:44.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10110000 2015-11-29T18:53:44.576-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:44.621-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10120000 2015-11-29T18:53:44.676-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4550000 QueuedCount 50000 2015-11-29T18:53:45.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4560000 QueuedCount 50000 2015-11-29T18:53:45.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10130000 2015-11-29T18:53:46.037-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10140000 2015-11-29T18:53:46.044-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4570000 QueuedCount 50000 2015-11-29T18:53:46.071-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:46.274-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4580000 QueuedCount 50000 2015-11-29T18:53:46.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10150000 2015-11-29T18:53:46.509-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4590000 QueuedCount 50000 2015-11-29T18:53:46.676-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10160000 2015-11-29T18:53:49.138-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4600000 QueuedCount 45412 2015-11-29T18:53:49.257-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4610000 QueuedCount 35412 2015-11-29T18:53:49.375-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4620000 QueuedCount 25412 2015-11-29T18:53:49.487-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4630000 QueuedCount 15412 2015-11-29T18:53:50.213-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4640000 QueuedCount 5412 2015-11-29T18:53:50.48-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.545µs CommitTime 200.631217ms TotalFlushTime 2m33.40144488s TotalCommitTime 18.558783885s 2015-11-29T18:53:50.48-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2340020, 2340020, 32 committed:true 2015-11-29T18:53:50.48-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2340020, 2340020, 32 committed:true) SnapCreateDur 213.728594ms SnapOpenDur 76.619µs 2015-11-29T18:53:50.516-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.548-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.568-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10170000 2015-11-29T18:53:50.577-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.586-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4650000 QueuedCount 39014 2015-11-29T18:53:50.607-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10180000 2015-11-29T18:53:50.682-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.682-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4660000 QueuedCount 49976 2015-11-29T18:53:50.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10190000 2015-11-29T18:53:50.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10200000 2015-11-29T18:53:50.781-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4670000 QueuedCount 50000 2015-11-29T18:53:50.797-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.823-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:50.831-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10210000 2015-11-29T18:53:50.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10220000 2015-11-29T18:53:50.94-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4680000 QueuedCount 50000 2015-11-29T18:53:50.967-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10230000 2015-11-29T18:53:51.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10240000 2015-11-29T18:53:51.093-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10250000 2015-11-29T18:53:52.429-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:52.883-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10260000 2015-11-29T18:53:52.951-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4690000 QueuedCount 50000 2015-11-29T18:53:53.18-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4700000 QueuedCount 50000 2015-11-29T18:53:53.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10270000 2015-11-29T18:53:53.385-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":6803340215,"bucket-1:by_capped_small_0:avg_ts_items_count":151625,"bucket-1:by_capped_small_0:build_progress":23,"bucket-1:by_capped_small_0:data_size":744617131,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":1825546240,"bucket-1:by_capped_small_0:flush_queue_size":47025,"bucket-1:by_capped_small_0:frag_percent":59,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":218400785,"bucket-1:by_capped_small_0:items_count":2254670,"bucket-1:by_capped_small_0:num_commits":32,"bucket-1:by_capped_small_0:num_compactions":2,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":4621141,"bucket-1:by_capped_small_0:num_docs_pending":9836751,"bucket-1:by_capped_small_0:num_docs_queued":5542108,"bucket-1:by_capped_small_0:num_flush_queued":4753778,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":32,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":7820351261,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"32 18558783885 -4672730956515326195","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"4706754 43807528004 8085646125568622420","bucket-1:by_capped_small_0:timings/storage_handle_open":"32 1733869 113696948311","bucket-1:by_capped_small_0:timings/storage_info":"129 2424538 368249028018","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"33 1404362276 987131190162516614","bucket-1:by_capped_small_0:timings/storage_meta_set":"32 20148133 14552434382473","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"4742424 107018774612 -7158174046304866916","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5519367,"bucket-1:num_mutations_queued":10273145,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":363,"memory_quota":104857600000,"memory_used":2159554560,"needs_restart":false,"num_connections":0,"timings/stats_response":"1653 216233269 1500319998477527"} 2015-11-29T18:53:53.96-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4710000 QueuedCount 43778 2015-11-29T18:53:54.981-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4720000 QueuedCount 33778 2015-11-29T18:53:56.027-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4730000 QueuedCount 23778 2015-11-29T18:53:56.13-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4740000 QueuedCount 13778 2015-11-29T18:53:56.24-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4750000 QueuedCount 3778 2015-11-29T18:53:57.127-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 16.567µs CommitTime 805.394997ms TotalFlushTime 2m39.016948919s TotalCommitTime 19.364178882s 2015-11-29T18:53:57.127-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2394665, 2394665, 33 committed:true 2015-11-29T18:53:57.127-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2394665, 2394665, 33 committed:true) SnapCreateDur 832.47686ms SnapOpenDur 62.799µs 2015-11-29T18:53:57.16-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:57.192-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:57.217-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10280000 2015-11-29T18:53:57.222-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:57.284-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10290000 2015-11-29T18:53:57.286-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:57.293-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4760000 QueuedCount 49706 2015-11-29T18:53:57.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10300000 2015-11-29T18:53:57.407-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10310000 2015-11-29T18:53:57.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10320000 2015-11-29T18:53:57.493-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4770000 QueuedCount 50000 2015-11-29T18:53:57.528-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10330000 2015-11-29T18:53:57.543-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:57.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10340000 2015-11-29T18:53:57.649-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10350000 2015-11-29T18:53:57.697-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4780000 QueuedCount 50000 2015-11-29T18:53:57.708-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10360000 2015-11-29T18:53:57.768-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10370000 2015-11-29T18:53:57.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10380000 2015-11-29T18:53:57.9-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4790000 QueuedCount 45009 2015-11-29T18:53:57.916-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10390000 2015-11-29T18:53:57.998-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10400000 2015-11-29T18:53:58.079-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10410000 2015-11-29T18:53:58.721-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4800000 QueuedCount 35009 2015-11-29T18:53:58.826-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4810000 QueuedCount 25009 2015-11-29T18:53:58.938-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4820000 QueuedCount 15009 2015-11-29T18:53:59.045-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4830000 QueuedCount 5009 2015-11-29T18:53:59.798-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.59µs CommitTime 149.366632ms TotalFlushTime 2m41.389462782s TotalCommitTime 19.513545514s 2015-11-29T18:53:59.798-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2436131, 2436131, 34 committed:true 2015-11-29T18:53:59.798-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2436131, 2436131, 34 committed:true) SnapCreateDur 175.933069ms SnapOpenDur 81.687µs 2015-11-29T18:53:59.828-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:59.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10420000 2015-11-29T18:53:59.858-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:59.889-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:59.915-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10430000 2015-11-29T18:53:59.921-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:53:59.926-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4840000 QueuedCount 48734 2015-11-29T18:53:59.981-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10440000 2015-11-29T18:54:00.042-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10450000 2015-11-29T18:54:00.102-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10460000 2015-11-29T18:54:00.127-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4850000 QueuedCount 49999 2015-11-29T18:54:00.166-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10470000 2015-11-29T18:54:00.196-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:00.235-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10480000 2015-11-29T18:54:00.339-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4860000 QueuedCount 50000 2015-11-29T18:54:00.416-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10490000 2015-11-29T18:54:00.522-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:00.558-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4870000 QueuedCount 50000 2015-11-29T18:54:00.568-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10500000 2015-11-29T18:54:01.806-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10510000 2015-11-29T18:54:01.823-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4880000 QueuedCount 50000 2015-11-29T18:54:01.889-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:02.017-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10520000 2015-11-29T18:54:02.035-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4890000 QueuedCount 50000 2015-11-29T18:54:02.268-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4900000 QueuedCount 50000 2015-11-29T18:54:02.433-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:02.471-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10530000 2015-11-29T18:54:02.478-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4910000 QueuedCount 50000 2015-11-29T18:54:02.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10540000 2015-11-29T18:54:03.406-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4920000 QueuedCount 50000 2015-11-29T18:54:03.437-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10550000 2015-11-29T18:54:03.517-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4930000 QueuedCount 50000 2015-11-29T18:54:03.555-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10560000 2015-11-29T18:54:03.63-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4940000 QueuedCount 50000 2015-11-29T18:54:03.631-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:03.647-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10570000 2015-11-29T18:54:03.736-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10580000 2015-11-29T18:54:03.756-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4950000 QueuedCount 50000 2015-11-29T18:54:04.476-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4960000 QueuedCount 50000 2015-11-29T18:54:04.695-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4970000 QueuedCount 46842 2015-11-29T18:54:04.897-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4980000 QueuedCount 36842 2015-11-29T18:54:05.079-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 4990000 QueuedCount 26842 2015-11-29T18:54:05.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5000000 QueuedCount 16842 2015-11-29T18:54:06.086-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5010000 QueuedCount 6842 2015-11-29T18:54:06.9-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 11.784µs CommitTime 710.454124ms TotalFlushTime 2m47.364766251s TotalCommitTime 20.223999638s 2015-11-29T18:54:06.9-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2526703, 2526703, 35 committed:true 2015-11-29T18:54:06.9-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2526703, 2526703, 35 committed:true) SnapCreateDur 737.082785ms SnapOpenDur 73.48µs 2015-11-29T18:54:06.934-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:06.948-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10590000 2015-11-29T18:54:06.963-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:06.986-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5020000 QueuedCount 27635 2015-11-29T18:54:06.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:07.022-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:07.025-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10600000 2015-11-29T18:54:07.09-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10610000 2015-11-29T18:54:07.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:07.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10620000 2015-11-29T18:54:07.187-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5030000 QueuedCount 50000 2015-11-29T18:54:07.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10630000 2015-11-29T18:54:07.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10640000 2015-11-29T18:54:07.409-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5040000 QueuedCount 50000 2015-11-29T18:54:07.411-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:07.641-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5050000 QueuedCount 50000 2015-11-29T18:54:08.861-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5060000 QueuedCount 50000 2015-11-29T18:54:08.896-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:08.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10650000 2015-11-29T18:54:09.066-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5070000 QueuedCount 50000 2015-11-29T18:54:09.131-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10660000 2015-11-29T18:54:09.317-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5080000 QueuedCount 50000 2015-11-29T18:54:09.374-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10670000 2015-11-29T18:54:09.546-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5090000 QueuedCount 41932 2015-11-29T18:54:10.533-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5100000 QueuedCount 31932 2015-11-29T18:54:10.629-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5110000 QueuedCount 21932 2015-11-29T18:54:10.732-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5120000 QueuedCount 11932 2015-11-29T18:54:10.844-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5130000 QueuedCount 1932 2015-11-29T18:54:11.788-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.097µs CommitTime 892.968107ms TotalFlushTime 2m51.06943979s TotalCommitTime 21.116967745s 2015-11-29T18:54:11.788-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2584649, 2584649, 36 committed:true 2015-11-29T18:54:11.789-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2584649, 2584649, 36 committed:true) SnapCreateDur 919.684835ms SnapOpenDur 60.587µs 2015-11-29T18:54:11.821-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:11.85-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:11.88-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:11.885-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10680000 2015-11-29T18:54:11.909-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:11.957-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10690000 2015-11-29T18:54:12.015-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5140000 QueuedCount 50000 2015-11-29T18:54:12.025-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10700000 2015-11-29T18:54:12.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10710000 2015-11-29T18:54:12.166-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10720000 2015-11-29T18:54:12.186-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:12.23-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10730000 2015-11-29T18:54:12.276-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5150000 QueuedCount 50000 2015-11-29T18:54:12.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10740000 2015-11-29T18:54:12.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10750000 2015-11-29T18:54:12.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10760000 2015-11-29T18:54:12.555-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:12.557-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5160000 QueuedCount 49903 2015-11-29T18:54:12.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10770000 2015-11-29T18:54:12.787-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5170000 QueuedCount 50000 2015-11-29T18:54:13.812-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:13.858-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10780000 2015-11-29T18:54:13.947-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5180000 QueuedCount 50000 2015-11-29T18:54:14.102-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10790000 2015-11-29T18:54:14.131-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:14.163-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5190000 QueuedCount 50000 2015-11-29T18:54:14.255-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10800000 2015-11-29T18:54:14.323-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10810000 2015-11-29T18:54:14.39-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5200000 QueuedCount 50000 2015-11-29T18:54:14.393-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10820000 2015-11-29T18:54:14.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10830000 2015-11-29T18:54:14.583-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5210000 QueuedCount 44654 2015-11-29T18:54:15.5-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5220000 QueuedCount 34654 2015-11-29T18:54:15.597-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5230000 QueuedCount 24654 2015-11-29T18:54:15.698-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5240000 QueuedCount 14654 2015-11-29T18:54:15.802-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5250000 QueuedCount 4654 2015-11-29T18:54:16.556-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.981µs CommitTime 82.481575ms TotalFlushTime 2m55.484519004s TotalCommitTime 21.19944932s 2015-11-29T18:54:16.556-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2646500, 2646500, 37 committed:true 2015-11-29T18:54:16.556-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2646500, 2646500, 37 committed:true) SnapCreateDur 92.70995ms SnapOpenDur 36.522µs 2015-11-29T18:54:16.585-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10840000 2015-11-29T18:54:16.585-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:16.614-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:16.643-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:16.673-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:16.683-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5260000 QueuedCount 40478 2015-11-29T18:54:16.694-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10850000 2015-11-29T18:54:16.76-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10860000 2015-11-29T18:54:16.786-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:16.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10870000 2015-11-29T18:54:16.896-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10880000 2015-11-29T18:54:16.898-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5270000 QueuedCount 50000 2015-11-29T18:54:16.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10890000 2015-11-29T18:54:17.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:17.106-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5280000 QueuedCount 50000 2015-11-29T18:54:17.114-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10900000 2015-11-29T18:54:17.324-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5290000 QueuedCount 50000 2015-11-29T18:54:17.33-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10910000 2015-11-29T18:54:17.357-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:18.445-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5300000 QueuedCount 50000 2015-11-29T18:54:18.578-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:20.086-08:00 [Info] CompactionDaemon: Finished compacting index instance:3094208154756435235 2015-11-29T18:54:20.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10920000 2015-11-29T18:54:20.141-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5310000 QueuedCount 50000 2015-11-29T18:54:20.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10930000 2015-11-29T18:54:20.318-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5320000 QueuedCount 50000 2015-11-29T18:54:20.336-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:20.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10940000 2015-11-29T18:54:20.495-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5330000 QueuedCount 50000 2015-11-29T18:54:20.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10950000 2015-11-29T18:54:20.737-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5340000 QueuedCount 47208 2015-11-29T18:54:21.964-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5350000 QueuedCount 37208 2015-11-29T18:54:22.071-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5360000 QueuedCount 27208 2015-11-29T18:54:22.184-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5370000 QueuedCount 17208 2015-11-29T18:54:22.299-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5380000 QueuedCount 7208 2015-11-29T18:54:23.359-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.49µs CommitTime 956.373119ms TotalFlushTime 3m1.051173331s TotalCommitTime 22.155822439s 2015-11-29T18:54:23.359-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2713280, 2713280, 38 committed:true 2015-11-29T18:54:23.359-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2713280, 2713280, 38 committed:true) SnapCreateDur 969.42992ms SnapOpenDur 61.51µs 2015-11-29T18:54:23.392-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:23.433-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:23.441-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5390000 QueuedCount 40591 2015-11-29T18:54:23.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10960000 2015-11-29T18:54:23.52-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10970000 2015-11-29T18:54:23.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10980000 2015-11-29T18:54:23.657-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5400000 QueuedCount 50000 2015-11-29T18:54:23.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10990000 2015-11-29T18:54:23.738-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11000000 2015-11-29T18:54:23.822-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11010000 2015-11-29T18:54:23.882-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5410000 QueuedCount 50000 2015-11-29T18:54:23.909-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11020000 2015-11-29T18:54:23.917-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:24.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11030000 2015-11-29T18:54:24.108-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5420000 QueuedCount 50000 2015-11-29T18:54:24.244-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11040000 2015-11-29T18:54:25.133-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5430000 QueuedCount 50000 2015-11-29T18:54:25.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11050000 2015-11-29T18:54:25.298-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:25.37-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5440000 QueuedCount 50000 2015-11-29T18:54:25.517-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11060000 2015-11-29T18:54:25.624-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5450000 QueuedCount 50000 2015-11-29T18:54:25.82-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:25.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11070000 2015-11-29T18:54:25.874-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5460000 QueuedCount 50000 2015-11-29T18:54:26.095-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11080000 2015-11-29T18:54:26.161-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_capped_small_0_3094208154756435235_0.index/data.fdb.1', errno = 2: 'No such file or directory' 2015-11-29T18:54:27.261-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5470000 QueuedCount 50000 2015-11-29T18:54:27.388-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5480000 QueuedCount 42743 2015-11-29T18:54:27.499-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5490000 QueuedCount 32743 2015-11-29T18:54:27.608-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5500000 QueuedCount 22743 2015-11-29T18:54:28.364-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5510000 QueuedCount 12743 2015-11-29T18:54:28.468-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5520000 QueuedCount 2743 2015-11-29T18:54:29.125-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 14.664µs CommitTime 600.953937ms TotalFlushTime 3m5.867049959s TotalCommitTime 22.756776376s 2015-11-29T18:54:29.126-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2781531, 2781531, 39 committed:true 2015-11-29T18:54:29.126-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2781531, 2781531, 39 committed:true) SnapCreateDur 627.077978ms SnapOpenDur 142.135µs 2015-11-29T18:54:29.163-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:29.173-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11090000 2015-11-29T18:54:29.201-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:29.24-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:29.268-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11100000 2015-11-29T18:54:29.335-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5530000 QueuedCount 50000 2015-11-29T18:54:29.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11110000 2015-11-29T18:54:29.418-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11120000 2015-11-29T18:54:29.501-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11130000 2015-11-29T18:54:29.567-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5540000 QueuedCount 50000 2015-11-29T18:54:29.583-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11140000 2015-11-29T18:54:29.628-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:29.673-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11150000 2015-11-29T18:54:29.861-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5550000 QueuedCount 50000 2015-11-29T18:54:29.94-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11160000 2015-11-29T18:54:30.088-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5560000 QueuedCount 50000 2015-11-29T18:54:30.139-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:30.164-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11170000 2015-11-29T18:54:31.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11180000 2015-11-29T18:54:31.37-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5570000 QueuedCount 50000 2015-11-29T18:54:31.496-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5580000 QueuedCount 50000 2015-11-29T18:54:31.5-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11190000 2015-11-29T18:54:31.525-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:31.621-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5590000 QueuedCount 49999 2015-11-29T18:54:31.624-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11200000 2015-11-29T18:54:31.73-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5600000 QueuedCount 50000 2015-11-29T18:54:31.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11210000 2015-11-29T18:54:32.38-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5610000 QueuedCount 40916 2015-11-29T18:54:32.465-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5620000 QueuedCount 30916 2015-11-29T18:54:32.552-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5630000 QueuedCount 20916 2015-11-29T18:54:32.642-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5640000 QueuedCount 10916 2015-11-29T18:54:33.287-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5650000 QueuedCount 916 2015-11-29T18:54:33.704-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.527µs CommitTime 377.712689ms TotalFlushTime 3m9.803065205s TotalCommitTime 23.134489065s 2015-11-29T18:54:33.704-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2846044, 2846044, 40 committed:true 2015-11-29T18:54:33.704-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2846044, 2846044, 40 committed:true) SnapCreateDur 403.608991ms SnapOpenDur 76.35µs 2015-11-29T18:54:33.743-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:33.78-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:33.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11220000 2015-11-29T18:54:33.815-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:33.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11230000 2015-11-29T18:54:33.922-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11240000 2015-11-29T18:54:33.927-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5660000 QueuedCount 50000 2015-11-29T18:54:33.993-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11250000 2015-11-29T18:54:34-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:34.067-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11260000 2015-11-29T18:54:34.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11270000 2015-11-29T18:54:34.159-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5670000 QueuedCount 50000 2015-11-29T18:54:34.218-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11280000 2015-11-29T18:54:34.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11290000 2015-11-29T18:54:34.401-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5680000 QueuedCount 50000 2015-11-29T18:54:34.451-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:34.597-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11300000 2015-11-29T18:54:34.681-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5690000 QueuedCount 50000 2015-11-29T18:54:35.911-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11310000 2015-11-29T18:54:35.933-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5700000 QueuedCount 50000 2015-11-29T18:54:35.962-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:36.041-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11320000 2015-11-29T18:54:36.05-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5710000 QueuedCount 50000 2015-11-29T18:54:36.162-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11330000 2015-11-29T18:54:36.172-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5720000 QueuedCount 50000 2015-11-29T18:54:36.188-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:36.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11340000 2015-11-29T18:54:36.411-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5730000 QueuedCount 50000 2015-11-29T18:54:37.586-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:37.669-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5740000 QueuedCount 50000 2015-11-29T18:54:37.785-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11350000 2015-11-29T18:54:37.938-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5750000 QueuedCount 50000 2015-11-29T18:54:38.159-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5760000 QueuedCount 42091 2015-11-29T18:54:38.375-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5770000 QueuedCount 32091 2015-11-29T18:54:39.224-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5780000 QueuedCount 22091 2015-11-29T18:54:39.327-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5790000 QueuedCount 12091 2015-11-29T18:54:39.435-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5800000 QueuedCount 2091 2015-11-29T18:54:40.024-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.643µs CommitTime 551.892311ms TotalFlushTime 3m15.188956186s TotalCommitTime 23.686381376s 2015-11-29T18:54:40.024-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 2921884, 2921884, 41 committed:true 2015-11-29T18:54:40.024-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 2921884, 2921884, 41 committed:true) SnapCreateDur 564.337619ms SnapOpenDur 46.408µs 2015-11-29T18:54:40.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:40.088-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11360000 2015-11-29T18:54:40.092-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:40.125-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:40.158-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11370000 2015-11-29T18:54:40.174-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5810000 QueuedCount 50000 2015-11-29T18:54:40.217-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11380000 2015-11-29T18:54:40.253-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:40.281-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11390000 2015-11-29T18:54:40.344-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11400000 2015-11-29T18:54:40.376-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5820000 QueuedCount 50000 2015-11-29T18:54:40.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11410000 2015-11-29T18:54:40.547-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11420000 2015-11-29T18:54:40.614-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5830000 QueuedCount 50000 2015-11-29T18:54:40.62-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:40.776-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11430000 2015-11-29T18:54:40.866-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5840000 QueuedCount 50000 2015-11-29T18:54:41.975-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:41.996-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11440000 2015-11-29T18:54:42.016-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5850000 QueuedCount 50000 2015-11-29T18:54:42.089-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11450000 2015-11-29T18:54:42.189-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5860000 QueuedCount 50000 2015-11-29T18:54:42.243-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:42.316-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11460000 2015-11-29T18:54:42.44-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5870000 QueuedCount 50000 2015-11-29T18:54:42.575-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11470000 2015-11-29T18:54:42.65-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:42.694-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5880000 QueuedCount 50000 2015-11-29T18:54:42.746-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11480000 2015-11-29T18:54:43.886-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5890000 QueuedCount 50000 2015-11-29T18:54:43.891-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11490000 2015-11-29T18:54:44.009-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5900000 QueuedCount 50000 2015-11-29T18:54:44.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11500000 2015-11-29T18:54:44.108-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11510000 2015-11-29T18:54:44.131-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5910000 QueuedCount 48975 2015-11-29T18:54:44.244-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5920000 QueuedCount 38975 2015-11-29T18:54:44.951-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5930000 QueuedCount 28975 2015-11-29T18:54:45.035-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5940000 QueuedCount 18975 2015-11-29T18:54:45.123-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5950000 QueuedCount 8975 2015-11-29T18:54:46.331-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.29µs CommitTime 1.095111901s TotalFlushTime 3m20.030924455s TotalCommitTime 24.781493277s 2015-11-29T18:54:46.331-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3001205, 3001205, 42 committed:true 2015-11-29T18:54:46.331-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3001205, 3001205, 42 committed:true) SnapCreateDur 1.121104364s SnapOpenDur 55.902µs 2015-11-29T18:54:46.384-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:46.39-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5960000 QueuedCount 30738 2015-11-29T18:54:46.448-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11520000 2015-11-29T18:54:46.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11530000 2015-11-29T18:54:46.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:46.604-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11540000 2015-11-29T18:54:46.626-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5970000 QueuedCount 50000 2015-11-29T18:54:46.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11550000 2015-11-29T18:54:46.759-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11560000 2015-11-29T18:54:46.84-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11570000 2015-11-29T18:54:46.853-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5980000 QueuedCount 50000 2015-11-29T18:54:46.925-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11580000 2015-11-29T18:54:46.931-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:47.018-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11590000 2015-11-29T18:54:47.089-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 5990000 QueuedCount 50000 2015-11-29T18:54:47.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11600000 2015-11-29T18:54:47.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11610000 2015-11-29T18:54:47.326-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:48.368-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6000000 QueuedCount 50000 2015-11-29T18:54:48.477-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11620000 2015-11-29T18:54:48.601-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6010000 QueuedCount 50000 2015-11-29T18:54:48.737-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11630000 2015-11-29T18:54:48.749-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:48.85-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6020000 QueuedCount 50000 2015-11-29T18:54:49.084-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11640000 2015-11-29T18:54:49.103-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6030000 QueuedCount 50000 2015-11-29T18:54:49.328-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6040000 QueuedCount 41040 2015-11-29T18:54:50.087-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:969776448, Disk:2083168256, ExtraSnapshotData:0, Fragmentation:53.44704177366266% 2015-11-29T18:54:50.087-08:00 [Info] CompactionDaemon: Compacting index instance:3094208154756435235 2015-11-29T18:54:50.367-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 2713280. Slice Id 0, IndexInstId 3094208154756435235, IndexDefnId 3094208154756435235 2015-11-29T18:54:50.67-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6050000 QueuedCount 31040 2015-11-29T18:54:50.782-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6060000 QueuedCount 21040 2015-11-29T18:54:50.899-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6070000 QueuedCount 11040 2015-11-29T18:54:51.072-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6080000 QueuedCount 1040 2015-11-29T18:54:52.143-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.951µs CommitTime 1.022517142s TotalFlushTime 3m24.477659377s TotalCommitTime 25.804010419s 2015-11-29T18:54:52.143-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3062857, 3062857, 43 committed:true 2015-11-29T18:54:52.143-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3062857, 3062857, 43 committed:true) SnapCreateDur 1.043295791s SnapOpenDur 55.18µs 2015-11-29T18:54:52.179-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:52.22-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:52.23-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11650000 2015-11-29T18:54:52.302-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11660000 2015-11-29T18:54:52.37-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11670000 2015-11-29T18:54:52.382-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6090000 QueuedCount 50000 2015-11-29T18:54:52.405-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:52.442-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11680000 2015-11-29T18:54:52.511-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11690000 2015-11-29T18:54:52.579-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11700000 2015-11-29T18:54:52.609-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6100000 QueuedCount 50000 2015-11-29T18:54:52.648-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11710000 2015-11-29T18:54:52.726-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11720000 2015-11-29T18:54:52.822-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11730000 2015-11-29T18:54:52.831-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6110000 QueuedCount 50000 2015-11-29T18:54:52.831-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:52.93-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11740000 2015-11-29T18:54:53.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11750000 2015-11-29T18:54:53.072-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6120000 QueuedCount 49801 2015-11-29T18:54:53.386-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5924790778,"bucket-1:by_capped_small_0:avg_ts_items_count":135437,"bucket-1:by_capped_small_0:build_progress":30,"bucket-1:by_capped_small_0:data_size":966213927,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":2083168256,"bucket-1:by_capped_small_0:flush_queue_size":50035,"bucket-1:by_capped_small_0:frag_percent":53,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":286925517,"bucket-1:by_capped_small_0:items_count":3001205,"bucket-1:by_capped_small_0:num_commits":43,"bucket-1:by_capped_small_0:num_compactions":3,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":6066047,"bucket-1:by_capped_small_0:num_docs_pending":8356108,"bucket-1:by_capped_small_0:num_docs_queued":5577845,"bucket-1:by_capped_small_0:num_flush_queued":6171745,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":43,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":5811857534,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"43 25804010419 1275039404984380225","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"6121711 58476357276 8249447402202924544","bucket-1:by_capped_small_0:timings/storage_handle_open":"43 2193298 134601856440","bucket-1:by_capped_small_0:timings/storage_info":"173 3096965 423310804245","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"45 1670697380 1054707967874394292","bucket-1:by_capped_small_0:timings/storage_meta_set":"43 27485137 19982950343939","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"6166674 139852935906 -3240840441800586488","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5586737,"bucket-1:num_mutations_queued":11758448,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":388,"memory_quota":104857600000,"memory_used":1760948224,"needs_restart":false,"num_connections":0,"timings/stats_response":"1725 245773567 1512912881496077"} 2015-11-29T18:54:54.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11760000 2015-11-29T18:54:54.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:54.116-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6130000 QueuedCount 50000 2015-11-29T18:54:54.167-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11770000 2015-11-29T18:54:54.235-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6140000 QueuedCount 50000 2015-11-29T18:54:54.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11780000 2015-11-29T18:54:54.346-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6150000 QueuedCount 40853 2015-11-29T18:54:54.459-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6160000 QueuedCount 30853 2015-11-29T18:54:55.184-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6170000 QueuedCount 20853 2015-11-29T18:54:55.273-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6180000 QueuedCount 10853 2015-11-29T18:54:55.367-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6190000 QueuedCount 853 2015-11-29T18:54:56.261-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 11.753µs CommitTime 850.53652ms TotalFlushTime 3m27.536561101s TotalCommitTime 26.654546939s 2015-11-29T18:54:56.262-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3118169, 3118169, 44 committed:true 2015-11-29T18:54:56.262-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3118169, 3118169, 44 committed:true) SnapCreateDur 876.279412ms SnapOpenDur 54.821µs 2015-11-29T18:54:56.295-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:56.327-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:56.364-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:56.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11790000 2015-11-29T18:54:56.435-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11800000 2015-11-29T18:54:56.473-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6200000 QueuedCount 50000 2015-11-29T18:54:56.496-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11810000 2015-11-29T18:54:56.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11820000 2015-11-29T18:54:56.627-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11830000 2015-11-29T18:54:56.669-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:56.677-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6210000 QueuedCount 49579 2015-11-29T18:54:56.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11840000 2015-11-29T18:54:56.896-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6220000 QueuedCount 50000 2015-11-29T18:54:56.897-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11850000 2015-11-29T18:54:57.004-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:57.03-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11860000 2015-11-29T18:54:57.132-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6230000 QueuedCount 50000 2015-11-29T18:54:58.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11870000 2015-11-29T18:54:58.452-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:58.462-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6240000 QueuedCount 49498 2015-11-29T18:54:58.691-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6250000 QueuedCount 50000 2015-11-29T18:54:58.726-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11880000 2015-11-29T18:54:58.795-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:54:58.927-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6260000 QueuedCount 50000 2015-11-29T18:54:59.06-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11890000 2015-11-29T18:54:59.216-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11900000 2015-11-29T18:54:59.217-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6270000 QueuedCount 50000 2015-11-29T18:54:59.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:00.397-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6280000 QueuedCount 50000 2015-11-29T18:55:00.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11910000 2015-11-29T18:55:00.512-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6290000 QueuedCount 45629 2015-11-29T18:55:00.623-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6300000 QueuedCount 35629 2015-11-29T18:55:00.736-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6310000 QueuedCount 25629 2015-11-29T18:55:01.51-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6320000 QueuedCount 15629 2015-11-29T18:55:01.602-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6330000 QueuedCount 5629 2015-11-29T18:55:02.539-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.28µs CommitTime 848.637189ms TotalFlushTime 3m32.618363679s TotalCommitTime 27.503184128s 2015-11-29T18:55:02.539-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3191228, 3191228, 45 committed:true 2015-11-29T18:55:02.539-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3191228, 3191228, 45 committed:true) SnapCreateDur 874.456296ms SnapOpenDur 51.918µs 2015-11-29T18:55:02.572-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:02.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11920000 2015-11-29T18:55:02.604-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:02.636-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:02.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11930000 2015-11-29T18:55:02.671-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6340000 QueuedCount 50000 2015-11-29T18:55:02.722-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11940000 2015-11-29T18:55:02.782-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11950000 2015-11-29T18:55:02.844-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11960000 2015-11-29T18:55:02.846-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:02.902-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6350000 QueuedCount 50000 2015-11-29T18:55:02.923-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11970000 2015-11-29T18:55:02.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11980000 2015-11-29T18:55:03.133-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6360000 QueuedCount 50000 2015-11-29T18:55:03.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11990000 2015-11-29T18:55:03.367-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6370000 QueuedCount 50000 2015-11-29T18:55:03.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12000000 2015-11-29T18:55:03.428-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:04.287-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6380000 QueuedCount 50000 2015-11-29T18:55:04.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12010000 2015-11-29T18:55:04.405-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6390000 QueuedCount 50000 2015-11-29T18:55:04.44-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12020000 2015-11-29T18:55:04.526-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6400000 QueuedCount 50000 2015-11-29T18:55:04.528-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12030000 2015-11-29T18:55:04.569-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:04.595-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12040000 2015-11-29T18:55:04.651-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6410000 QueuedCount 50000 2015-11-29T18:55:04.668-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12050000 2015-11-29T18:55:05.996-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6420000 QueuedCount 50000 2015-11-29T18:55:06.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12060000 2015-11-29T18:55:06.216-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6430000 QueuedCount 49177 2015-11-29T18:55:06.421-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6440000 QueuedCount 39177 2015-11-29T18:55:06.616-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6450000 QueuedCount 29177 2015-11-29T18:55:07.588-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6460000 QueuedCount 19177 2015-11-29T18:55:07.693-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6470000 QueuedCount 9177 2015-11-29T18:55:08.309-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.56µs CommitTime 496.469198ms TotalFlushTime 3m37.611057335s TotalCommitTime 27.999653326s 2015-11-29T18:55:08.309-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3263911, 3263911, 46 committed:true 2015-11-29T18:55:08.309-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3263911, 3263911, 46 committed:true) SnapCreateDur 509.115848ms SnapOpenDur 51.808µs 2015-11-29T18:55:08.347-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:08.352-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6480000 QueuedCount 19489 2015-11-29T18:55:08.362-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12070000 2015-11-29T18:55:08.384-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:08.42-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:08.44-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12080000 2015-11-29T18:55:08.504-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12090000 2015-11-29T18:55:08.562-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6490000 QueuedCount 50000 2015-11-29T18:55:08.567-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12100000 2015-11-29T18:55:08.663-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12110000 2015-11-29T18:55:08.724-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:08.788-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6500000 QueuedCount 50000 2015-11-29T18:55:08.826-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12120000 2015-11-29T18:55:08.924-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12130000 2015-11-29T18:55:08.996-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6510000 QueuedCount 50000 2015-11-29T18:55:09.049-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12140000 2015-11-29T18:55:09.051-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:10.191-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6520000 QueuedCount 50000 2015-11-29T18:55:10.228-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12150000 2015-11-29T18:55:10.307-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:10.353-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6530000 QueuedCount 50000 2015-11-29T18:55:10.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12160000 2015-11-29T18:55:10.584-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6540000 QueuedCount 50000 2015-11-29T18:55:10.707-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12170000 2015-11-29T18:55:10.806-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6550000 QueuedCount 48739 2015-11-29T18:55:11.01-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6560000 QueuedCount 38739 2015-11-29T18:55:12.011-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6570000 QueuedCount 28739 2015-11-29T18:55:12.113-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6580000 QueuedCount 18739 2015-11-29T18:55:12.217-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6590000 QueuedCount 8739 2015-11-29T18:55:13.016-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.887µs CommitTime 692.440227ms TotalFlushTime 3m41.354154262s TotalCommitTime 28.692093553s 2015-11-29T18:55:13.016-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3323901, 3323901, 47 committed:true 2015-11-29T18:55:13.016-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3323901, 3323901, 47 committed:true) SnapCreateDur 705.090371ms SnapOpenDur 45.19µs 2015-11-29T18:55:13.053-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:13.055-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6600000 QueuedCount 22601 2015-11-29T18:55:13.085-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12180000 2015-11-29T18:55:13.088-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:13.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12190000 2015-11-29T18:55:13.164-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:13.17-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6610000 QueuedCount 49513 2015-11-29T18:55:13.21-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12200000 2015-11-29T18:55:13.264-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12210000 2015-11-29T18:55:13.278-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6620000 QueuedCount 50000 2015-11-29T18:55:13.324-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12220000 2015-11-29T18:55:13.382-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12230000 2015-11-29T18:55:13.391-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:13.48-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12240000 2015-11-29T18:55:13.488-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6630000 QueuedCount 50000 2015-11-29T18:55:13.7-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12250000 2015-11-29T18:55:14.586-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6640000 QueuedCount 50000 2015-11-29T18:55:14.624-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:14.698-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6650000 QueuedCount 50000 2015-11-29T18:55:14.725-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12260000 2015-11-29T18:55:14.88-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6660000 QueuedCount 50000 2015-11-29T18:55:14.908-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12270000 2015-11-29T18:55:14.968-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:15.035-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12280000 2015-11-29T18:55:15.098-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6670000 QueuedCount 50000 2015-11-29T18:55:15.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12290000 2015-11-29T18:55:15.328-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6680000 QueuedCount 50000 2015-11-29T18:55:16.416-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:16.456-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12300000 2015-11-29T18:55:16.478-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6690000 QueuedCount 50000 2015-11-29T18:55:16.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12310000 2015-11-29T18:55:16.594-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6700000 QueuedCount 50000 2015-11-29T18:55:16.706-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6710000 QueuedCount 43665 2015-11-29T18:55:16.817-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6720000 QueuedCount 33665 2015-11-29T18:55:17.57-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6730000 QueuedCount 23665 2015-11-29T18:55:17.658-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6740000 QueuedCount 13665 2015-11-29T18:55:17.75-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6750000 QueuedCount 3665 2015-11-29T18:55:18.324-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.981µs CommitTime 525.370492ms TotalFlushTime 3m45.85275671s TotalCommitTime 29.217464045s 2015-11-29T18:55:18.324-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3401090, 3401090, 48 committed:true 2015-11-29T18:55:18.324-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3401090, 3401090, 48 committed:true) SnapCreateDur 535.495498ms SnapOpenDur 56.14µs 2015-11-29T18:55:18.356-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:18.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12320000 2015-11-29T18:55:18.389-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:18.423-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:18.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12330000 2015-11-29T18:55:18.479-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6760000 QueuedCount 50000 2015-11-29T18:55:18.515-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12340000 2015-11-29T18:55:18.572-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:18.572-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12350000 2015-11-29T18:55:18.613-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6770000 QueuedCount 50000 2015-11-29T18:55:18.633-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12360000 2015-11-29T18:55:18.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12370000 2015-11-29T18:55:18.762-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6780000 QueuedCount 50000 2015-11-29T18:55:18.77-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:19.04-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6790000 QueuedCount 50000 2015-11-29T18:55:19.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12380000 2015-11-29T18:55:20.087-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:20.187-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6800000 QueuedCount 50000 2015-11-29T18:55:20.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12390000 2015-11-29T18:55:20.41-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6810000 QueuedCount 50000 2015-11-29T18:55:20.417-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:20.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12400000 2015-11-29T18:55:20.661-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6820000 QueuedCount 50000 2015-11-29T18:55:20.757-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:20.9-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6830000 QueuedCount 50000 2015-11-29T18:55:20.937-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12410000 2015-11-29T18:55:21.96-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:21.974-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6840000 QueuedCount 48736 2015-11-29T18:55:22.02-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12420000 2015-11-29T18:55:22.094-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6850000 QueuedCount 50000 2015-11-29T18:55:22.195-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6860000 QueuedCount 43016 2015-11-29T18:55:23.278-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6870000 QueuedCount 33016 2015-11-29T18:55:24.892-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6880000 QueuedCount 23016 2015-11-29T18:55:25.02-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6890000 QueuedCount 13016 2015-11-29T18:55:25.138-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6900000 QueuedCount 3016 2015-11-29T18:55:26.057-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 16.17µs CommitTime 854.23818ms TotalFlushTime 3m52.368391208s TotalCommitTime 30.071702225s 2015-11-29T18:55:26.057-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3475533, 3475533, 49 committed:true 2015-11-29T18:55:26.057-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3475533, 3475533, 49 committed:true) SnapCreateDur 879.983658ms SnapOpenDur 51.24µs 2015-11-29T18:55:26.095-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:26.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12430000 2015-11-29T18:55:26.164-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12440000 2015-11-29T18:55:26.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:26.22-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6910000 QueuedCount 49921 2015-11-29T18:55:26.221-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12450000 2015-11-29T18:55:26.284-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12460000 2015-11-29T18:55:26.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12470000 2015-11-29T18:55:26.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12480000 2015-11-29T18:55:26.421-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6920000 QueuedCount 50000 2015-11-29T18:55:26.478-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12490000 2015-11-29T18:55:26.547-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12500000 2015-11-29T18:55:26.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12510000 2015-11-29T18:55:26.689-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6930000 QueuedCount 50000 2015-11-29T18:55:26.807-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12520000 2015-11-29T18:55:26.891-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:26.907-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6940000 QueuedCount 49129 2015-11-29T18:55:26.962-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12530000 2015-11-29T18:55:28.157-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6950000 QueuedCount 50000 2015-11-29T18:55:28.222-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12540000 2015-11-29T18:55:28.294-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:28.381-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6960000 QueuedCount 50000 2015-11-29T18:55:28.499-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12550000 2015-11-29T18:55:28.681-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6970000 QueuedCount 50000 2015-11-29T18:55:28.894-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6980000 QueuedCount 41358 2015-11-29T18:55:29.916-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 6990000 QueuedCount 31358 2015-11-29T18:55:30.022-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7000000 QueuedCount 21358 2015-11-29T18:55:30.124-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7010000 QueuedCount 11358 2015-11-29T18:55:30.229-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7020000 QueuedCount 1358 2015-11-29T18:55:31.248-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.26µs CommitTime 970.568601ms TotalFlushTime 3m56.294708603s TotalCommitTime 31.042270826s 2015-11-29T18:55:31.248-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3534729, 3534729, 50 committed:true 2015-11-29T18:55:31.249-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3534729, 3534729, 50 committed:true) SnapCreateDur 996.36789ms SnapOpenDur 49.972µs 2015-11-29T18:55:31.281-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:31.298-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12560000 2015-11-29T18:55:31.313-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:31.346-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:31.366-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12570000 2015-11-29T18:55:31.426-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12580000 2015-11-29T18:55:31.451-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7030000 QueuedCount 50000 2015-11-29T18:55:31.485-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12590000 2015-11-29T18:55:31.546-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12600000 2015-11-29T18:55:31.591-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:31.614-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12610000 2015-11-29T18:55:31.648-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7040000 QueuedCount 50000 2015-11-29T18:55:31.675-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12620000 2015-11-29T18:55:31.799-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12630000 2015-11-29T18:55:31.897-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7050000 QueuedCount 50000 2015-11-29T18:55:32.13-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:32.174-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7060000 QueuedCount 50000 2015-11-29T18:55:32.226-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12640000 2015-11-29T18:55:33.32-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7070000 QueuedCount 50000 2015-11-29T18:55:33.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12650000 2015-11-29T18:55:33.474-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7080000 QueuedCount 50000 2015-11-29T18:55:33.506-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:33.604-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7090000 QueuedCount 50000 2015-11-29T18:55:33.607-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12660000 2015-11-29T18:55:33.719-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7100000 QueuedCount 48099 2015-11-29T18:55:34.435-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7110000 QueuedCount 38099 2015-11-29T18:55:34.524-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7120000 QueuedCount 28099 2015-11-29T18:55:34.613-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7130000 QueuedCount 18099 2015-11-29T18:55:34.704-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7140000 QueuedCount 8099 2015-11-29T18:55:35.895-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.477µs CommitTime 230.111331ms TotalFlushTime 4m0.453669744s TotalCommitTime 31.272382157s 2015-11-29T18:55:35.895-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3597475, 3597475, 51 committed:true 2015-11-29T18:55:35.895-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3597475, 3597475, 51 committed:true) SnapCreateDur 255.764067ms SnapOpenDur 108.287µs 2015-11-29T18:55:35.927-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:35.953-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12670000 2015-11-29T18:55:35.96-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7150000 QueuedCount 30143 2015-11-29T18:55:35.96-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:35.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:36.027-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12680000 2015-11-29T18:55:36.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12690000 2015-11-29T18:55:36.15-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12700000 2015-11-29T18:55:36.154-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7160000 QueuedCount 50000 2015-11-29T18:55:36.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12710000 2015-11-29T18:55:36.211-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:36.302-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12720000 2015-11-29T18:55:36.36-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7170000 QueuedCount 50000 2015-11-29T18:55:36.489-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12730000 2015-11-29T18:55:36.596-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7180000 QueuedCount 50000 2015-11-29T18:55:36.647-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:36.89-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7190000 QueuedCount 50000 2015-11-29T18:55:36.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12740000 2015-11-29T18:55:37.93-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:37.933-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7200000 QueuedCount 49615 2015-11-29T18:55:37.974-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12750000 2015-11-29T18:55:38.043-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7210000 QueuedCount 49999 2015-11-29T18:55:38.124-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12760000 2015-11-29T18:55:38.131-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:38.156-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7220000 QueuedCount 50000 2015-11-29T18:55:38.187-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12770000 2015-11-29T18:55:38.271-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7230000 QueuedCount 50000 2015-11-29T18:55:38.314-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12780000 2015-11-29T18:55:38.909-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:39.059-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7240000 QueuedCount 50000 2015-11-29T18:55:39.155-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12790000 2015-11-29T18:55:39.274-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7250000 QueuedCount 47103 2015-11-29T18:55:39.47-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7260000 QueuedCount 37103 2015-11-29T18:55:39.667-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7270000 QueuedCount 27103 2015-11-29T18:55:40.552-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7280000 QueuedCount 17103 2015-11-29T18:55:40.65-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7290000 QueuedCount 7103 2015-11-29T18:55:41.506-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.82µs CommitTime 764.887215ms TotalFlushTime 4m4.986056966s TotalCommitTime 32.037269372s 2015-11-29T18:55:41.506-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3670873, 3670873, 52 committed:true 2015-11-29T18:55:41.506-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3670873, 3670873, 52 committed:true) SnapCreateDur 777.481641ms SnapOpenDur 98.365µs 2015-11-29T18:55:41.537-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:41.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:41.589-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7300000 QueuedCount 25854 2015-11-29T18:55:41.597-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12800000 2015-11-29T18:55:41.6-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:41.661-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12810000 2015-11-29T18:55:41.718-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:41.722-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12820000 2015-11-29T18:55:41.786-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12830000 2015-11-29T18:55:41.79-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7310000 QueuedCount 50000 2015-11-29T18:55:41.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12840000 2015-11-29T18:55:41.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12850000 2015-11-29T18:55:42.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12860000 2015-11-29T18:55:42.895-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12870000 2015-11-29T18:55:42.957-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7320000 QueuedCount 50000 2015-11-29T18:55:42.986-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:43.049-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12880000 2015-11-29T18:55:43.18-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7330000 QueuedCount 50000 2015-11-29T18:55:43.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12890000 2015-11-29T18:55:43.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:44.276-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7340000 QueuedCount 50000 2015-11-29T18:55:44.344-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12900000 2015-11-29T18:55:44.485-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7350000 QueuedCount 50000 2015-11-29T18:55:44.514-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:44.583-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12910000 2015-11-29T18:55:44.706-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7360000 QueuedCount 50000 2015-11-29T18:55:44.925-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7370000 QueuedCount 46464 2015-11-29T18:55:45.953-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7380000 QueuedCount 36464 2015-11-29T18:55:46.05-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7390000 QueuedCount 26464 2015-11-29T18:55:46.151-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7400000 QueuedCount 16464 2015-11-29T18:55:46.255-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7410000 QueuedCount 6464 2015-11-29T18:55:46.889-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 41.11µs CommitTime 552.190469ms TotalFlushTime 4m9.540381585s TotalCommitTime 32.589459841s 2015-11-29T18:55:46.889-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3730070, 3730070, 53 committed:true 2015-11-29T18:55:46.889-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3730070, 3730070, 53 committed:true) SnapCreateDur 564.863801ms SnapOpenDur 52.506µs 2015-11-29T18:55:46.92-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:46.952-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:46.985-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7420000 QueuedCount 44592 2015-11-29T18:55:46.987-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:46.995-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12920000 2015-11-29T18:55:47.058-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12930000 2015-11-29T18:55:47.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12940000 2015-11-29T18:55:47.184-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12950000 2015-11-29T18:55:47.187-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7430000 QueuedCount 50000 2015-11-29T18:55:47.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12960000 2015-11-29T18:55:47.306-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12970000 2015-11-29T18:55:47.37-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12980000 2015-11-29T18:55:47.392-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7440000 QueuedCount 50000 2015-11-29T18:55:47.46-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12990000 2015-11-29T18:55:47.473-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:47.508-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.905992% blocked 2015-11-29T18:55:47.531-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13000000 2015-11-29T18:55:47.531-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7450000 QueuedCount 50000 2015-11-29T18:55:47.653-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13010000 2015-11-29T18:55:48.715-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.909712% blocked 2015-11-29T18:55:48.733-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7460000 QueuedCount 50000 2015-11-29T18:55:48.825-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13020000 2015-11-29T18:55:48.859-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7470000 QueuedCount 50000 2015-11-29T18:55:48.901-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:48.922-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13030000 2015-11-29T18:55:49.028-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7480000 QueuedCount 50000 2015-11-29T18:55:49.095-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13040000 2015-11-29T18:55:49.235-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13050000 2015-11-29T18:55:49.25-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7490000 QueuedCount 50000 2015-11-29T18:55:49.36-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:49.475-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.912617% blocked 2015-11-29T18:55:50.384-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7500000 QueuedCount 50000 2015-11-29T18:55:50.482-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.914601% blocked 2015-11-29T18:55:50.527-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13060000 2015-11-29T18:55:50.602-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7510000 QueuedCount 50000 2015-11-29T18:55:50.685-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:50.711-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13070000 2015-11-29T18:55:50.836-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7520000 QueuedCount 50000 2015-11-29T18:55:50.988-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13080000 2015-11-29T18:55:51.095-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7530000 QueuedCount 46809 2015-11-29T18:55:51.299-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7540000 QueuedCount 36809 2015-11-29T18:55:52.324-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7550000 QueuedCount 26809 2015-11-29T18:55:52.443-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7560000 QueuedCount 16809 2015-11-29T18:55:52.56-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7570000 QueuedCount 6809 2015-11-29T18:55:53.321-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 6.039µs CommitTime 668.684756ms TotalFlushTime 4m14.949661735s TotalCommitTime 33.258144597s 2015-11-29T18:55:53.321-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3809610, 3809610, 54 committed:true 2015-11-29T18:55:53.321-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3809610, 3809610, 54 committed:true) SnapCreateDur 681.223038ms SnapOpenDur 50.51µs 2015-11-29T18:55:53.354-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:53.386-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:53.386-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5918871185,"bucket-1:by_capped_small_0:avg_ts_items_count":144810,"bucket-1:by_capped_small_0:build_progress":37,"bucket-1:by_capped_small_0:data_size":1197494084,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":2979848192,"bucket-1:by_capped_small_0:flush_queue_size":30664,"bucket-1:by_capped_small_0:frag_percent":59,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":354647790,"bucket-1:by_capped_small_0:items_count":3730070,"bucket-1:by_capped_small_0:num_commits":54,"bucket-1:by_capped_small_0:num_compactions":3,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":7544797,"bucket-1:by_capped_small_0:num_docs_pending":6945076,"bucket-1:by_capped_small_0:num_docs_queued":5510127,"bucket-1:by_capped_small_0:num_flush_queued":7609357,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":54,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":6432223276,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"54 33258144597 6782389712489886027","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"7578695 72332214809 8249611042961345541","bucket-1:by_capped_small_0:timings/storage_handle_open":"54 2564811 147649340161","bucket-1:by_capped_small_0:timings/storage_info":"217 3594796 434914894640","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"56 1676001596 1054710764156211532","bucket-1:by_capped_small_0:timings/storage_meta_set":"54 33289319 23565281361777","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"7621026 174062641963 825607537302766921","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5474477,"bucket-1:num_mutations_queued":13083834,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":428,"memory_quota":104857600000,"memory_used":3424153600,"needs_restart":false,"num_connections":0,"timings/stats_response":"1797 270957738 1521965331700492"} 2015-11-29T18:55:53.413-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:53.416-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7580000 QueuedCount 38902 2015-11-29T18:55:53.431-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13090000 2015-11-29T18:55:53.493-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13100000 2015-11-29T18:55:53.545-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:53.556-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13110000 2015-11-29T18:55:53.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13120000 2015-11-29T18:55:53.62-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7590000 QueuedCount 50000 2015-11-29T18:55:53.675-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13130000 2015-11-29T18:55:53.736-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13140000 2015-11-29T18:55:53.796-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13150000 2015-11-29T18:55:53.83-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7600000 QueuedCount 50000 2015-11-29T18:55:53.977-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13160000 2015-11-29T18:55:53.984-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:54.038-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7610000 QueuedCount 50000 2015-11-29T18:55:54.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13170000 2015-11-29T18:55:54.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13180000 2015-11-29T18:55:54.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13190000 2015-11-29T18:55:54.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13200000 2015-11-29T18:55:54.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13210000 2015-11-29T18:55:54.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13220000 2015-11-29T18:55:54.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13230000 2015-11-29T18:55:54.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13240000 2015-11-29T18:55:54.813-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13250000 2015-11-29T18:55:54.944-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13260000 2015-11-29T18:55:55.673-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7620000 QueuedCount 49999 2015-11-29T18:55:57.156-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:55:57.318-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13270000 2015-11-29T18:55:57.321-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7630000 QueuedCount 50000 2015-11-29T18:55:57.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13280000 2015-11-29T18:55:57.473-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13290000 2015-11-29T18:55:57.54-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7640000 QueuedCount 50000 2015-11-29T18:55:57.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13300000 2015-11-29T18:55:57.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13310000 2015-11-29T18:55:57.755-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7650000 QueuedCount 46778 2015-11-29T18:55:57.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13320000 2015-11-29T18:55:57.884-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13330000 2015-11-29T18:55:57.999-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13340000 2015-11-29T18:55:58.114-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13350000 2015-11-29T18:55:58.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13360000 2015-11-29T18:55:58.346-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13370000 2015-11-29T18:55:58.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13380000 2015-11-29T18:55:58.588-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13390000 2015-11-29T18:55:58.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13400000 2015-11-29T18:55:58.843-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13410000 2015-11-29T18:55:58.87-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7660000 QueuedCount 36778 2015-11-29T18:55:58.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13420000 2015-11-29T18:55:58.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7670000 QueuedCount 26778 2015-11-29T18:55:59.081-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7680000 QueuedCount 16778 2015-11-29T18:55:59.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13430000 2015-11-29T18:55:59.19-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7690000 QueuedCount 6778 2015-11-29T18:55:59.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13440000 2015-11-29T18:56:00.326-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.123µs CommitTime 1.032253653s TotalFlushTime 4m20.664005399s TotalCommitTime 34.29039825s 2015-11-29T18:56:00.326-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3869856, 3869856, 55 committed:true 2015-11-29T18:56:00.326-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3869856, 3869856, 55 committed:true) SnapCreateDur 1.058111359s SnapOpenDur 100.686µs 2015-11-29T18:56:00.358-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:00.389-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:00.421-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:00.426-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7700000 QueuedCount 43602 2015-11-29T18:56:00.451-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13450000 2015-11-29T18:56:00.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13460000 2015-11-29T18:56:00.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:00.574-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7710000 QueuedCount 49431 2015-11-29T18:56:00.768-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7720000 QueuedCount 50000 2015-11-29T18:56:00.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:00.995-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7730000 QueuedCount 50000 2015-11-29T18:56:02.334-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7740000 QueuedCount 50000 2015-11-29T18:56:02.352-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:02.478-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7750000 QueuedCount 50000 2015-11-29T18:56:02.697-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7760000 QueuedCount 46918 2015-11-29T18:56:02.898-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7770000 QueuedCount 36918 2015-11-29T18:56:03.855-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7780000 QueuedCount 26918 2015-11-29T18:56:03.957-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7790000 QueuedCount 16918 2015-11-29T18:56:04.06-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7800000 QueuedCount 6918 2015-11-29T18:56:04.687-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.725µs CommitTime 539.570031ms TotalFlushTime 4m24.24140151s TotalCommitTime 34.829968281s 2015-11-29T18:56:04.687-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 3924789, 3924789, 56 committed:true 2015-11-29T18:56:04.687-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 3924789, 3924789, 56 committed:true) SnapCreateDur 552.089434ms SnapOpenDur 51.998µs 2015-11-29T18:56:04.718-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:04.748-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:04.77-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7810000 QueuedCount 28957 2015-11-29T18:56:04.778-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:04.84-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:04.984-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7820000 QueuedCount 50000 2015-11-29T18:56:05.152-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:05.205-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7830000 QueuedCount 50000 2015-11-29T18:56:05.45-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7840000 QueuedCount 50000 2015-11-29T18:56:05.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 666 2015-11-29T18:56:05.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 666 2015-11-29T18:56:05.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 666 2015-11-29T18:56:05.631-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:05.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 666 2015-11-29T18:56:05.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 666 2015-11-29T18:56:05.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 666 2015-11-29T18:56:05.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 666 2015-11-29T18:56:05.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 666 2015-11-29T18:56:05.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 666 2015-11-29T18:56:05.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 666 2015-11-29T18:56:05.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 666 2015-11-29T18:56:05.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 666 2015-11-29T18:56:05.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 666 2015-11-29T18:56:05.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 666 2015-11-29T18:56:05.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 666 2015-11-29T18:56:05.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 666 2015-11-29T18:56:06.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 666 2015-11-29T18:56:06.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 666 2015-11-29T18:56:06.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 666 2015-11-29T18:56:06.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 666 2015-11-29T18:56:06.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 666 2015-11-29T18:56:06.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 666 2015-11-29T18:56:06.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 666 2015-11-29T18:56:06.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 666 2015-11-29T18:56:06.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 666 2015-11-29T18:56:06.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 666 2015-11-29T18:56:06.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 666 2015-11-29T18:56:06.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 666 2015-11-29T18:56:06.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 666 2015-11-29T18:56:06.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 666 2015-11-29T18:56:06.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 666 2015-11-29T18:56:06.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 666 2015-11-29T18:56:06.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 666 2015-11-29T18:56:06.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 666 2015-11-29T18:56:06.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 666 2015-11-29T18:56:06.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 666 2015-11-29T18:56:06.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 666 2015-11-29T18:56:06.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 666 2015-11-29T18:56:06.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 666 2015-11-29T18:56:06.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 666 2015-11-29T18:56:06.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 666 2015-11-29T18:56:06.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 666 2015-11-29T18:56:06.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 666 2015-11-29T18:56:06.835-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7850000 QueuedCount 50000 2015-11-29T18:56:06.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 666 2015-11-29T18:56:06.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 666 2015-11-29T18:56:06.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 666 2015-11-29T18:56:06.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 666 2015-11-29T18:56:06.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 666 2015-11-29T18:56:06.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 666 2015-11-29T18:56:07.004-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7860000 QueuedCount 50000 2015-11-29T18:56:07.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 666 2015-11-29T18:56:07.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 666 2015-11-29T18:56:07.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 666 2015-11-29T18:56:07.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 666 2015-11-29T18:56:07.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 666 2015-11-29T18:56:07.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 666 2015-11-29T18:56:07.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 666 2015-11-29T18:56:07.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 666 2015-11-29T18:56:07.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 666 2015-11-29T18:56:07.26-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7870000 QueuedCount 50000 2015-11-29T18:56:07.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 666 2015-11-29T18:56:07.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 666 2015-11-29T18:56:07.338-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:07.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 666 2015-11-29T18:56:07.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 666 2015-11-29T18:56:07.395-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7880000 QueuedCount 50000 2015-11-29T18:56:07.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 666 2015-11-29T18:56:07.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 666 2015-11-29T18:56:07.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 666 2015-11-29T18:56:07.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 666 2015-11-29T18:56:07.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 666 2015-11-29T18:56:07.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 666 2015-11-29T18:56:07.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 666 2015-11-29T18:56:07.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 666 2015-11-29T18:56:07.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 666 2015-11-29T18:56:07.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 666 2015-11-29T18:56:07.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 666 2015-11-29T18:56:07.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 666 2015-11-29T18:56:07.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 666 2015-11-29T18:56:07.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 666 2015-11-29T18:56:07.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 666 2015-11-29T18:56:07.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 666 2015-11-29T18:56:07.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 666 2015-11-29T18:56:07.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 666 2015-11-29T18:56:07.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 666 2015-11-29T18:56:07.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 666 2015-11-29T18:56:08.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 666 2015-11-29T18:56:08.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 666 2015-11-29T18:56:08.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 666 2015-11-29T18:56:08.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 666 2015-11-29T18:56:08.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 666 2015-11-29T18:56:08.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 666 2015-11-29T18:56:08.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 666 2015-11-29T18:56:08.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 666 2015-11-29T18:56:08.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 666 2015-11-29T18:56:08.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 666 2015-11-29T18:56:08.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 666 2015-11-29T18:56:08.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 666 2015-11-29T18:56:08.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 666 2015-11-29T18:56:08.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 666 2015-11-29T18:56:08.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 666 2015-11-29T18:56:08.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 666 2015-11-29T18:56:08.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 666 2015-11-29T18:56:08.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 666 2015-11-29T18:56:08.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 666 2015-11-29T18:56:08.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 666 2015-11-29T18:56:08.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 666 2015-11-29T18:56:08.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 666 2015-11-29T18:56:08.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 666 2015-11-29T18:56:08.675-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7890000 QueuedCount 50000 2015-11-29T18:56:08.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 666 2015-11-29T18:56:08.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 666 2015-11-29T18:56:08.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 666 2015-11-29T18:56:08.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 666 2015-11-29T18:56:08.802-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7900000 QueuedCount 50000 2015-11-29T18:56:08.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 666 2015-11-29T18:56:08.827-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:08.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 666 2015-11-29T18:56:08.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13470000 2015-11-29T18:56:08.929-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7910000 QueuedCount 50000 2015-11-29T18:56:08.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13480000 2015-11-29T18:56:09.046-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7920000 QueuedCount 50000 2015-11-29T18:56:09.159-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7930000 QueuedCount 43066 2015-11-29T18:56:09.917-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7940000 QueuedCount 33066 2015-11-29T18:56:10.013-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7950000 QueuedCount 23066 2015-11-29T18:56:10.102-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7960000 QueuedCount 13066 2015-11-29T18:56:10.193-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7970000 QueuedCount 3066 2015-11-29T18:56:10.897-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.498µs CommitTime 132.910664ms TotalFlushTime 4m29.942009513s TotalCommitTime 34.962878945s 2015-11-29T18:56:10.897-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4007708, 4007708, 57 committed:true 2015-11-29T18:56:10.897-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4007708, 4007708, 57 committed:true) SnapCreateDur 144.305822ms SnapOpenDur 45.817µs 2015-11-29T18:56:10.931-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:10.963-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:10.964-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13490000 2015-11-29T18:56:10.995-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:11.032-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13500000 2015-11-29T18:56:11.074-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7980000 QueuedCount 50000 2015-11-29T18:56:11.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13510000 2015-11-29T18:56:11.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13520000 2015-11-29T18:56:11.221-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13530000 2015-11-29T18:56:11.225-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:11.277-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 7990000 QueuedCount 50000 2015-11-29T18:56:11.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13540000 2015-11-29T18:56:11.352-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13550000 2015-11-29T18:56:11.431-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13560000 2015-11-29T18:56:11.519-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13570000 2015-11-29T18:56:11.556-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8000000 QueuedCount 50000 2015-11-29T18:56:11.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13580000 2015-11-29T18:56:11.678-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13590000 2015-11-29T18:56:11.759-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13600000 2015-11-29T18:56:11.78-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:11.848-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8010000 QueuedCount 50000 2015-11-29T18:56:11.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13610000 2015-11-29T18:56:11.933-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13620000 2015-11-29T18:56:12.015-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13630000 2015-11-29T18:56:13.091-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8020000 QueuedCount 50000 2015-11-29T18:56:13.318-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8030000 QueuedCount 50000 2015-11-29T18:56:13.349-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:13.547-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8040000 QueuedCount 50000 2015-11-29T18:56:13.778-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8050000 QueuedCount 50000 2015-11-29T18:56:13.8-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:14.975-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8060000 QueuedCount 50000 2015-11-29T18:56:15.104-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:15.195-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8070000 QueuedCount 50000 2015-11-29T18:56:15.43-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8080000 QueuedCount 50000 2015-11-29T18:56:15.636-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8090000 QueuedCount 41047 2015-11-29T18:56:16.587-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8100000 QueuedCount 31047 2015-11-29T18:56:16.687-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8110000 QueuedCount 21047 2015-11-29T18:56:16.792-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8120000 QueuedCount 11047 2015-11-29T18:56:16.9-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8130000 QueuedCount 1047 2015-11-29T18:56:17.052-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 682 2015-11-29T18:56:17.082-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 682 2015-11-29T18:56:17.112-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 682 2015-11-29T18:56:17.142-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 682 2015-11-29T18:56:17.172-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 682 2015-11-29T18:56:17.202-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 682 2015-11-29T18:56:17.232-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 682 2015-11-29T18:56:17.262-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 682 2015-11-29T18:56:17.292-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 682 2015-11-29T18:56:17.322-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 682 2015-11-29T18:56:17.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 682 2015-11-29T18:56:17.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 682 2015-11-29T18:56:17.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 682 2015-11-29T18:56:17.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 682 2015-11-29T18:56:17.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 682 2015-11-29T18:56:17.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 682 2015-11-29T18:56:17.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 682 2015-11-29T18:56:17.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 682 2015-11-29T18:56:17.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 682 2015-11-29T18:56:17.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 682 2015-11-29T18:56:17.652-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 682 2015-11-29T18:56:17.682-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 682 2015-11-29T18:56:17.712-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 682 2015-11-29T18:56:17.742-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 682 2015-11-29T18:56:17.772-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 682 2015-11-29T18:56:17.802-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 682 2015-11-29T18:56:17.832-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 682 2015-11-29T18:56:17.862-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 682 2015-11-29T18:56:17.892-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 682 2015-11-29T18:56:17.92-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.993µs CommitTime 979.5194ms TotalFlushTime 4m35.556484265s TotalCommitTime 35.942398345s 2015-11-29T18:56:17.92-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4086891, 4086891, 58 committed:true 2015-11-29T18:56:17.92-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4086891, 4086891, 58 committed:true) SnapCreateDur 1.0059592s SnapOpenDur 56.336µs 2015-11-29T18:56:17.922-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 682 2015-11-29T18:56:17.955-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:17.99-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:18.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13640000 2015-11-29T18:56:18.026-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:18.067-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13650000 2015-11-29T18:56:18.139-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13660000 2015-11-29T18:56:18.141-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8140000 QueuedCount 50000 2015-11-29T18:56:18.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13670000 2015-11-29T18:56:18.258-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13680000 2015-11-29T18:56:18.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13690000 2015-11-29T18:56:18.36-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8150000 QueuedCount 50000 2015-11-29T18:56:18.375-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:18.375-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13700000 2015-11-29T18:56:18.436-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13710000 2015-11-29T18:56:18.498-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13720000 2015-11-29T18:56:18.556-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8160000 QueuedCount 50000 2015-11-29T18:56:18.561-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13730000 2015-11-29T18:56:18.624-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13740000 2015-11-29T18:56:18.688-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13750000 2015-11-29T18:56:18.693-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:18.754-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8170000 QueuedCount 50000 2015-11-29T18:56:18.755-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13760000 2015-11-29T18:56:18.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13770000 2015-11-29T18:56:19.736-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8180000 QueuedCount 50000 2015-11-29T18:56:19.803-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:19.955-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8190000 QueuedCount 50000 2015-11-29T18:56:20.161-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:20.181-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8200000 QueuedCount 49066 2015-11-29T18:56:20.433-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8210000 QueuedCount 50000 2015-11-29T18:56:21.666-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8220000 QueuedCount 44882 2015-11-29T18:56:21.78-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8230000 QueuedCount 34882 2015-11-29T18:56:21.897-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8240000 QueuedCount 24882 2015-11-29T18:56:22.024-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8250000 QueuedCount 14882 2015-11-29T18:56:22.837-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8260000 QueuedCount 4882 2015-11-29T18:56:23.445-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 6.874µs CommitTime 527.043163ms TotalFlushTime 4m40.280785478s TotalCommitTime 36.469441508s 2015-11-29T18:56:23.445-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4153522, 4153522, 59 committed:true 2015-11-29T18:56:23.445-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4153522, 4153522, 59 committed:true) SnapCreateDur 554.787956ms SnapOpenDur 52.84µs 2015-11-29T18:56:23.479-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:23.512-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:23.545-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:23.549-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13780000 2015-11-29T18:56:23.576-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8270000 QueuedCount 50000 2015-11-29T18:56:23.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13790000 2015-11-29T18:56:23.673-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13800000 2015-11-29T18:56:23.721-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:23.737-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13810000 2015-11-29T18:56:23.779-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8280000 QueuedCount 50000 2015-11-29T18:56:23.803-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13820000 2015-11-29T18:56:24.005-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8290000 QueuedCount 50000 2015-11-29T18:56:24.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:24.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13830000 2015-11-29T18:56:24.152-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13840000 2015-11-29T18:56:24.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13850000 2015-11-29T18:56:24.254-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8300000 QueuedCount 50000 2015-11-29T18:56:25.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13860000 2015-11-29T18:56:25.382-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:25.406-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8310000 QueuedCount 50000 2015-11-29T18:56:25.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13870000 2015-11-29T18:56:25.565-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8320000 QueuedCount 50000 2015-11-29T18:56:25.771-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8330000 QueuedCount 42634 2015-11-29T18:56:25.971-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8340000 QueuedCount 32634 2015-11-29T18:56:26.966-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8350000 QueuedCount 22634 2015-11-29T18:56:27.069-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8360000 QueuedCount 12634 2015-11-29T18:56:27.179-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8370000 QueuedCount 2634 2015-11-29T18:56:28.119-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 11.414µs CommitTime 875.368841ms TotalFlushTime 4m43.836179191s TotalCommitTime 37.344810349s 2015-11-29T18:56:28.119-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4207342, 4207342, 60 committed:true 2015-11-29T18:56:28.119-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4207342, 4207342, 60 committed:true) SnapCreateDur 904.129112ms SnapOpenDur 51.656µs 2015-11-29T18:56:28.152-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:28.183-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:28.205-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13880000 2015-11-29T18:56:28.216-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:28.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13890000 2015-11-29T18:56:28.297-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8380000 QueuedCount 50000 2015-11-29T18:56:28.336-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13900000 2015-11-29T18:56:28.351-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:28.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13910000 2015-11-29T18:56:28.468-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13920000 2015-11-29T18:56:28.501-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8390000 QueuedCount 50000 2015-11-29T18:56:28.532-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13930000 2015-11-29T18:56:28.597-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13940000 2015-11-29T18:56:28.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13950000 2015-11-29T18:56:28.692-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:28.722-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8400000 QueuedCount 50000 2015-11-29T18:56:28.817-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13960000 2015-11-29T18:56:29.013-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8410000 QueuedCount 50000 2015-11-29T18:56:29.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13970000 2015-11-29T18:56:30.296-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:30.375-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8420000 QueuedCount 50000 2015-11-29T18:56:30.482-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13980000 2015-11-29T18:56:30.501-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:30.504-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8430000 QueuedCount 49760 2015-11-29T18:56:30.551-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13990000 2015-11-29T18:56:30.63-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8440000 QueuedCount 50000 2015-11-29T18:56:30.675-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14000000 2015-11-29T18:56:30.821-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8450000 QueuedCount 44694 2015-11-29T18:56:31.946-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8460000 QueuedCount 34694 2015-11-29T18:56:32.051-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8470000 QueuedCount 24694 2015-11-29T18:56:32.162-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8480000 QueuedCount 14694 2015-11-29T18:56:32.276-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8490000 QueuedCount 4694 2015-11-29T18:56:33.096-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.044µs CommitTime 745.58582ms TotalFlushTime 4m47.823532172s TotalCommitTime 38.090396169s 2015-11-29T18:56:33.097-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4268188, 4268188, 61 committed:true 2015-11-29T18:56:33.097-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4268188, 4268188, 61 committed:true) SnapCreateDur 758.144302ms SnapOpenDur 39.6µs 2015-11-29T18:56:33.139-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:33.184-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14010000 2015-11-29T18:56:33.238-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8500000 QueuedCount 50000 2015-11-29T18:56:33.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14020000 2015-11-29T18:56:33.305-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14030000 2015-11-29T18:56:33.327-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:33.374-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14040000 2015-11-29T18:56:33.441-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14050000 2015-11-29T18:56:33.444-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8510000 QueuedCount 50000 2015-11-29T18:56:33.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14060000 2015-11-29T18:56:33.58-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14070000 2015-11-29T18:56:33.65-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8520000 QueuedCount 50000 2015-11-29T18:56:33.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14080000 2015-11-29T18:56:33.799-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:33.867-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14090000 2015-11-29T18:56:33.869-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8530000 QueuedCount 50000 2015-11-29T18:56:34.821-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8540000 QueuedCount 50000 2015-11-29T18:56:34.829-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14100000 2015-11-29T18:56:34.927-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:35.05-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8550000 QueuedCount 50000 2015-11-29T18:56:35.073-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14110000 2015-11-29T18:56:35.246-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8560000 QueuedCount 50000 2015-11-29T18:56:35.253-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14120000 2015-11-29T18:56:35.309-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:35.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14130000 2015-11-29T18:56:35.502-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8570000 QueuedCount 50000 2015-11-29T18:56:36.786-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:36.822-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8580000 QueuedCount 50000 2015-11-29T18:56:36.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14140000 2015-11-29T18:56:37.018-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8590000 QueuedCount 50000 2015-11-29T18:56:37.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14150000 2015-11-29T18:56:37.228-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8600000 QueuedCount 41188 2015-11-29T18:56:37.434-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8610000 QueuedCount 31188 2015-11-29T18:56:38.429-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8620000 QueuedCount 21188 2015-11-29T18:56:38.533-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8630000 QueuedCount 11188 2015-11-29T18:56:38.647-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8640000 QueuedCount 1188 2015-11-29T18:56:39.208-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 6.491µs CommitTime 528.443583ms TotalFlushTime 4m53.051900065s TotalCommitTime 38.618839752s 2015-11-29T18:56:39.208-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4341460, 4341460, 62 committed:true 2015-11-29T18:56:39.208-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4341460, 4341460, 62 committed:true) SnapCreateDur 541.228354ms SnapOpenDur 47.415µs 2015-11-29T18:56:39.239-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:39.276-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:39.308-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14160000 2015-11-29T18:56:39.309-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:39.373-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14170000 2015-11-29T18:56:39.419-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8650000 QueuedCount 50000 2015-11-29T18:56:39.435-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14180000 2015-11-29T18:56:39.496-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14190000 2015-11-29T18:56:39.557-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:39.641-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8660000 QueuedCount 50000 2015-11-29T18:56:39.877-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8670000 QueuedCount 50000 2015-11-29T18:56:39.943-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:40.124-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8680000 QueuedCount 50000 2015-11-29T18:56:41.431-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:41.465-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8690000 QueuedCount 50000 2015-11-29T18:56:41.632-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14200000 2015-11-29T18:56:41.698-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8700000 QueuedCount 50000 2015-11-29T18:56:41.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14210000 2015-11-29T18:56:41.785-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14220000 2015-11-29T18:56:41.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:41.862-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14230000 2015-11-29T18:56:41.933-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8710000 QueuedCount 50000 2015-11-29T18:56:41.936-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14240000 2015-11-29T18:56:42.015-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14250000 2015-11-29T18:56:42.098-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14260000 2015-11-29T18:56:42.189-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14270000 2015-11-29T18:56:42.228-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8720000 QueuedCount 49449 2015-11-29T18:56:42.296-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14280000 2015-11-29T18:56:42.427-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14290000 2015-11-29T18:56:43.384-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8730000 QueuedCount 39449 2015-11-29T18:56:43.497-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8740000 QueuedCount 29449 2015-11-29T18:56:43.612-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8750000 QueuedCount 19449 2015-11-29T18:56:43.73-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8760000 QueuedCount 9449 2015-11-29T18:56:46.65-08:00 [Info] CompactionDaemon: Finished compacting index instance:3094208154756435235 2015-11-29T18:56:47.04-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.634µs CommitTime 250.645365ms TotalFlushTime 5m0.296989121s TotalCommitTime 38.869485117s 2015-11-29T18:56:47.04-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4405512, 4405512, 63 committed:true 2015-11-29T18:56:47.041-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4405512, 4405512, 63 committed:true) SnapCreateDur 279.454405ms SnapOpenDur 190.481µs 2015-11-29T18:56:47.085-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8770000 QueuedCount 20328 2015-11-29T18:56:47.153-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14300000 2015-11-29T18:56:47.252-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14310000 2015-11-29T18:56:47.3-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8780000 QueuedCount 15090 2015-11-29T18:56:47.302-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_capped_small_0_3094208154756435235_0.index/data.fdb.2', errno = 2: 'No such file or directory' 2015-11-29T18:56:47.511-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8790000 QueuedCount 5090 2015-11-29T18:56:48.573-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 9.19µs CommitTime 925.988578ms TotalFlushTime 5m0.813430665s TotalCommitTime 39.795473695s 2015-11-29T18:56:48.573-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4418359, 4418359, 64 committed:true 2015-11-29T18:56:48.573-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4418359, 4418359, 64 committed:true) SnapCreateDur 952.185837ms SnapOpenDur 63.25µs 2015-11-29T18:56:48.617-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14320000 2015-11-29T18:56:48.624-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:48.669-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:48.737-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8800000 QueuedCount 50000 2015-11-29T18:56:48.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8810000 QueuedCount 50000 2015-11-29T18:56:49.143-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:49.223-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8820000 QueuedCount 50000 2015-11-29T18:56:49.305-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:49.325-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:49.394-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:49.468-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8830000 QueuedCount 50000 2015-11-29T18:56:49.632-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14330000 2015-11-29T18:56:50.843-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8840000 QueuedCount 50000 2015-11-29T18:56:50.966-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14340000 2015-11-29T18:56:51.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14350000 2015-11-29T18:56:51.079-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8850000 QueuedCount 50000 2015-11-29T18:56:51.085-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:51.124-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14360000 2015-11-29T18:56:51.195-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:51.205-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14370000 2015-11-29T18:56:51.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:51.274-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8860000 QueuedCount 50000 2015-11-29T18:56:51.289-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14380000 2015-11-29T18:56:51.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14390000 2015-11-29T18:56:51.361-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:51.383-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:51.434-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14400000 2015-11-29T18:56:51.441-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8870000 QueuedCount 50000 2015-11-29T18:56:51.517-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14410000 2015-11-29T18:56:51.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14420000 2015-11-29T18:56:51.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:52.8-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:52.812-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8880000 QueuedCount 49053 2015-11-29T18:56:52.973-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8890000 QueuedCount 46533 2015-11-29T18:56:53.084-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8900000 QueuedCount 36533 2015-11-29T18:56:53.199-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8910000 QueuedCount 26533 2015-11-29T18:56:53.387-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":4132205326,"bucket-1:by_capped_small_0:avg_ts_items_count":78641,"bucket-1:by_capped_small_0:build_progress":44,"bucket-1:by_capped_small_0:data_size":1400728118,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":3084533760,"bucket-1:by_capped_small_0:flush_queue_size":18044,"bucket-1:by_capped_small_0:frag_percent":54,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":416442063,"bucket-1:by_capped_small_0:items_count":4418359,"bucket-1:by_capped_small_0:num_commits":64,"bucket-1:by_capped_small_0:num_compactions":3,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":8877037,"bucket-1:by_capped_small_0:num_docs_pending":5669395,"bucket-1:by_capped_small_0:num_docs_queued":5453568,"bucket-1:by_capped_small_0:num_flush_queued":8936533,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":64,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":1532689046,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"64 39795473695 -6531073554713075875","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"8918490 88427843280 -5419582886245920266","bucket-1:by_capped_small_0:timings/storage_handle_open":"64 3019185 176039586593","bucket-1:by_capped_small_0:timings/storage_info":"257 4167834 483274614036","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"66 1680991506 1054713560120693682","bucket-1:by_capped_small_0:timings/storage_meta_set":"64 40195690 28927995264562","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"8959600 206580059206 5816950107547000510","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5492595,"bucket-1:num_mutations_queued":14429128,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":429,"memory_quota":104857600000,"memory_used":2568769536,"needs_restart":false,"num_connections":0,"timings/stats_response":"1869 297697721 1532259678590031"} 2015-11-29T18:56:54.012-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8920000 QueuedCount 16533 2015-11-29T18:56:54.118-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8930000 QueuedCount 6533 2015-11-29T18:56:54.64-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.84µs CommitTime 432.153532ms TotalFlushTime 5m6.080925478s TotalCommitTime 40.227627227s 2015-11-29T18:56:54.64-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4488804, 4488804, 65 committed:true 2015-11-29T18:56:54.64-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4488804, 4488804, 65 committed:true) SnapCreateDur 444.852332ms SnapOpenDur 49.551µs 2015-11-29T18:56:54.665-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:54.689-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:54.696-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8940000 QueuedCount 5539 2015-11-29T18:56:54.721-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:54.757-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:54.79-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14430000 2015-11-29T18:56:54.808-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8950000 QueuedCount 50000 2015-11-29T18:56:54.849-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14440000 2015-11-29T18:56:54.866-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:54.909-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14450000 2015-11-29T18:56:54.91-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8960000 QueuedCount 50000 2015-11-29T18:56:55.072-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8970000 QueuedCount 50000 2015-11-29T18:56:55.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14460000 2015-11-29T18:56:55.943-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8980000 QueuedCount 50000 2015-11-29T18:56:55.952-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:56.022-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14470000 2015-11-29T18:56:56.044-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 8990000 QueuedCount 50000 2015-11-29T18:56:56.143-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14480000 2015-11-29T18:56:56.149-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9000000 QueuedCount 50000 2015-11-29T18:56:56.224-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:56.254-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9010000 QueuedCount 49999 2015-11-29T18:56:56.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14490000 2015-11-29T18:56:56.934-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9020000 QueuedCount 50000 2015-11-29T18:56:57.164-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:57.166-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9030000 QueuedCount 49852 2015-11-29T18:56:57.267-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14500000 2015-11-29T18:56:57.413-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9040000 QueuedCount 50000 2015-11-29T18:56:57.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14510000 2015-11-29T18:56:57.648-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:57.66-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9050000 QueuedCount 49440 2015-11-29T18:56:57.747-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14520000 2015-11-29T18:56:57.917-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9060000 QueuedCount 50000 2015-11-29T18:56:58.933-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14530000 2015-11-29T18:56:59.008-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:56:59.013-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9070000 QueuedCount 49537 2015-11-29T18:56:59.088-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14540000 2015-11-29T18:56:59.175-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9080000 QueuedCount 50000 2015-11-29T18:56:59.357-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14550000 2015-11-29T18:56:59.401-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9090000 QueuedCount 49027 2015-11-29T18:56:59.614-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9100000 QueuedCount 39027 2015-11-29T18:57:00.602-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9110000 QueuedCount 29027 2015-11-29T18:57:00.707-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9120000 QueuedCount 19027 2015-11-29T18:57:00.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9130000 QueuedCount 9027 2015-11-29T18:57:01.554-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 10.18µs CommitTime 631.936565ms TotalFlushTime 5m11.950508467s TotalCommitTime 40.859563792s 2015-11-29T18:57:01.554-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4589719, 4589719, 66 committed:true 2015-11-29T18:57:01.554-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4589719, 4589719, 66 committed:true) SnapCreateDur 642.927527ms SnapOpenDur 53.679µs 2015-11-29T18:57:01.59-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:01.601-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9140000 QueuedCount 18657 2015-11-29T18:57:01.626-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:01.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14560000 2015-11-29T18:57:01.657-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:01.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14570000 2015-11-29T18:57:01.771-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14580000 2015-11-29T18:57:01.815-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9150000 QueuedCount 50000 2015-11-29T18:57:01.828-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14590000 2015-11-29T18:57:01.844-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:01.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14600000 2015-11-29T18:57:02.012-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:02.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14610000 2015-11-29T18:57:02.027-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9160000 QueuedCount 49246 2015-11-29T18:57:02.338-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9170000 QueuedCount 50000 2015-11-29T18:57:02.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14620000 2015-11-29T18:57:02.626-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9180000 QueuedCount 50000 2015-11-29T18:57:03.749-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:03.776-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14630000 2015-11-29T18:57:03.822-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9190000 QueuedCount 50000 2015-11-29T18:57:03.943-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14640000 2015-11-29T18:57:04.059-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9200000 QueuedCount 50000 2015-11-29T18:57:04.173-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14650000 2015-11-29T18:57:04.271-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:04.303-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9210000 QueuedCount 49284 2015-11-29T18:57:04.519-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9220000 QueuedCount 39284 2015-11-29T18:57:05.512-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9230000 QueuedCount 29284 2015-11-29T18:57:05.613-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9240000 QueuedCount 19284 2015-11-29T18:57:05.717-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9250000 QueuedCount 9284 2015-11-29T18:57:06.373-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.594µs CommitTime 536.451059ms TotalFlushTime 5m15.915500925s TotalCommitTime 41.396014851s 2015-11-29T18:57:06.374-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4648943, 4648943, 67 committed:true 2015-11-29T18:57:06.374-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4648943, 4648943, 67 committed:true) SnapCreateDur 551.198054ms SnapOpenDur 45.877µs 2015-11-29T18:57:06.408-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:06.415-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9260000 QueuedCount 17265 2015-11-29T18:57:06.44-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14660000 2015-11-29T18:57:06.448-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:06.512-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14670000 2015-11-29T18:57:06.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14680000 2015-11-29T18:57:06.618-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9270000 QueuedCount 50000 2015-11-29T18:57:06.635-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14690000 2015-11-29T18:57:06.682-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:06.698-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14700000 2015-11-29T18:57:06.763-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14710000 2015-11-29T18:57:06.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9280000 QueuedCount 50000 2015-11-29T18:57:06.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14720000 2015-11-29T18:57:06.887-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14730000 2015-11-29T18:57:06.949-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14740000 2015-11-29T18:57:07.026-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9290000 QueuedCount 50000 2015-11-29T18:57:07.033-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:07.17-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14750000 2015-11-29T18:57:07.28-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9300000 QueuedCount 50000 2015-11-29T18:57:08.442-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14760000 2015-11-29T18:57:08.492-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:08.512-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9310000 QueuedCount 48464 2015-11-29T18:57:08.65-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9320000 QueuedCount 50000 2015-11-29T18:57:08.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14770000 2015-11-29T18:57:08.756-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:08.787-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9330000 QueuedCount 50000 2015-11-29T18:57:08.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14780000 2015-11-29T18:57:09.037-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9340000 QueuedCount 50000 2015-11-29T18:57:10.012-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:10.059-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9350000 QueuedCount 50000 2015-11-29T18:57:10.089-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14790000 2015-11-29T18:57:10.168-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9360000 QueuedCount 44232 2015-11-29T18:57:10.278-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9370000 QueuedCount 34232 2015-11-29T18:57:10.389-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9380000 QueuedCount 24232 2015-11-29T18:57:11.095-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9390000 QueuedCount 14232 2015-11-29T18:57:11.179-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9400000 QueuedCount 4232 2015-11-29T18:57:12.112-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 16.88µs CommitTime 867.890023ms TotalFlushTime 5m20.464033176s TotalCommitTime 42.263904874s 2015-11-29T18:57:12.112-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4721175, 4721175, 68 committed:true 2015-11-29T18:57:12.112-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4721175, 4721175, 68 committed:true) SnapCreateDur 893.818463ms SnapOpenDur 65.012µs 2015-11-29T18:57:12.159-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:12.181-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14800000 2015-11-29T18:57:12.265-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14810000 2015-11-29T18:57:12.273-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9410000 QueuedCount 50000 2015-11-29T18:57:12.329-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:12.342-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14820000 2015-11-29T18:57:12.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14830000 2015-11-29T18:57:12.488-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9420000 QueuedCount 50000 2015-11-29T18:57:12.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14840000 2015-11-29T18:57:12.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14850000 2015-11-29T18:57:12.73-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9430000 QueuedCount 50000 2015-11-29T18:57:12.911-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14860000 2015-11-29T18:57:12.975-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9440000 QueuedCount 50000 2015-11-29T18:57:13.063-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:14.037-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14870000 2015-11-29T18:57:14.065-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9450000 QueuedCount 50000 2015-11-29T18:57:14.163-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14880000 2015-11-29T18:57:14.18-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9460000 QueuedCount 49999 2015-11-29T18:57:14.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14890000 2015-11-29T18:57:14.3-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9470000 QueuedCount 50000 2015-11-29T18:57:14.332-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:14.358-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14900000 2015-11-29T18:57:14.421-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9480000 QueuedCount 50000 2015-11-29T18:57:14.489-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14910000 2015-11-29T18:57:15.15-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9490000 QueuedCount 50000 2015-11-29T18:57:15.242-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14920000 2015-11-29T18:57:15.343-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9500000 QueuedCount 50000 2015-11-29T18:57:15.361-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:15.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14930000 2015-11-29T18:57:15.563-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9510000 QueuedCount 50000 2015-11-29T18:57:15.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14940000 2015-11-29T18:57:15.822-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9520000 QueuedCount 50000 2015-11-29T18:57:15.84-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14950000 2015-11-29T18:57:16.65-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:1497164590, Disk:3485736960, ExtraSnapshotData:0, Fragmentation:57.04883623806198% 2015-11-29T18:57:16.65-08:00 [Info] CompactionDaemon: Compacting index instance:3094208154756435235 2015-11-29T18:57:16.965-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9530000 QueuedCount 45065 2015-11-29T18:57:16.972-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 4418359. Slice Id 0, IndexInstId 3094208154756435235, IndexDefnId 3094208154756435235 2015-11-29T18:57:17.411-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9540000 QueuedCount 35065 2015-11-29T18:57:17.611-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9550000 QueuedCount 25065 2015-11-29T18:57:17.827-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9560000 QueuedCount 15065 2015-11-29T18:57:18.001-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9570000 QueuedCount 5065 2015-11-29T18:57:18.999-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.96µs CommitTime 139.952043ms TotalFlushTime 5m26.798928623s TotalCommitTime 42.403856917s 2015-11-29T18:57:18.999-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4805672, 4805672, 69 committed:true 2015-11-29T18:57:18.999-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4805672, 4805672, 69 committed:true) SnapCreateDur 153.006021ms SnapOpenDur 55.778µs 2015-11-29T18:57:19.041-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.08-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14960000 2015-11-29T18:57:19.136-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9580000 QueuedCount 50000 2015-11-29T18:57:19.156-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14970000 2015-11-29T18:57:19.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14980000 2015-11-29T18:57:19.273-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14990000 2015-11-29T18:57:19.331-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15000000 2015-11-29T18:57:19.344-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9590000 QueuedCount 50000 2015-11-29T18:57:19.352-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.395-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15010000 2015-11-29T18:57:19.457-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15020000 2015-11-29T18:57:19.481-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.488-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9600000 QueuedCount 49655 2015-11-29T18:57:19.529-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15030000 2015-11-29T18:57:19.577-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.598-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.62-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.7-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:19.733-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9610000 QueuedCount 50000 2015-11-29T18:57:19.848-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15040000 2015-11-29T18:57:20.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9620000 QueuedCount 50000 2015-11-29T18:57:21.021-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:21.094-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9630000 QueuedCount 43692 2015-11-29T18:57:21.193-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9640000 QueuedCount 33692 2015-11-29T18:57:21.293-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9650000 QueuedCount 23692 2015-11-29T18:57:21.969-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9660000 QueuedCount 13692 2015-11-29T18:57:22.043-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9670000 QueuedCount 3692 2015-11-29T18:57:22.684-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 9.393µs CommitTime 585.254883ms TotalFlushTime 5m29.701610812s TotalCommitTime 42.9891118s 2015-11-29T18:57:22.684-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4854275, 4854275, 70 committed:true 2015-11-29T18:57:22.684-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4854275, 4854275, 70 committed:true) SnapCreateDur 611.299403ms SnapOpenDur 77.954µs 2015-11-29T18:57:22.708-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.73-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.751-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.772-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.795-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.809-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9680000 QueuedCount 2665 2015-11-29T18:57:22.816-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.842-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.865-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.871-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15050000 2015-11-29T18:57:22.886-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.908-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.929-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.949-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.949-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15060000 2015-11-29T18:57:22.974-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:22.982-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9690000 QueuedCount 10312 2015-11-29T18:57:23.008-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:23.048-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:23.054-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15070000 2015-11-29T18:57:23.07-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:23.125-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15080000 2015-11-29T18:57:23.184-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9700000 QueuedCount 50000 2015-11-29T18:57:23.191-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15090000 2015-11-29T18:57:23.203-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:23.265-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15100000 2015-11-29T18:57:23.335-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15110000 2015-11-29T18:57:23.401-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9710000 QueuedCount 50000 2015-11-29T18:57:24.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15120000 2015-11-29T18:57:24.489-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9720000 QueuedCount 50000 2015-11-29T18:57:24.62-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:24.621-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9730000 QueuedCount 49912 2015-11-29T18:57:24.689-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15130000 2015-11-29T18:57:24.734-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9740000 QueuedCount 50000 2015-11-29T18:57:24.813-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15140000 2015-11-29T18:57:24.859-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9750000 QueuedCount 50000 2015-11-29T18:57:24.937-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15150000 2015-11-29T18:57:25.019-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15160000 2015-11-29T18:57:25.107-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15170000 2015-11-29T18:57:25.202-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15180000 2015-11-29T18:57:25.295-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15190000 2015-11-29T18:57:25.584-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9760000 QueuedCount 50000 2015-11-29T18:57:25.605-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:25.687-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9770000 QueuedCount 50000 2015-11-29T18:57:25.73-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:25.791-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9780000 QueuedCount 50000 2015-11-29T18:57:25.806-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:25.827-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:25.886-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:25.9-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9790000 QueuedCount 48579 2015-11-29T18:57:27.112-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9800000 QueuedCount 50000 2015-11-29T18:57:27.129-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:27.27-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9810000 QueuedCount 50000 2015-11-29T18:57:27.466-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9820000 QueuedCount 42448 2015-11-29T18:57:27.661-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9830000 QueuedCount 32448 2015-11-29T18:57:28.523-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9840000 QueuedCount 22448 2015-11-29T18:57:28.617-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9850000 QueuedCount 12448 2015-11-29T18:57:28.713-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9860000 QueuedCount 2448 2015-11-29T18:57:29.197-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.45µs CommitTime 442.595478ms TotalFlushTime 5m35.426015536s TotalCommitTime 43.431707278s 2015-11-29T18:57:29.197-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 4947576, 4947576, 71 committed:true 2015-11-29T18:57:29.197-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 4947576, 4947576, 71 committed:true) SnapCreateDur 455.24267ms SnapOpenDur 39.096µs 2015-11-29T18:57:29.221-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.244-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.275-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.301-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.314-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15200000 2015-11-29T18:57:29.346-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.36-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9870000 QueuedCount 47054 2015-11-29T18:57:29.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15210000 2015-11-29T18:57:29.455-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15220000 2015-11-29T18:57:29.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15230000 2015-11-29T18:57:29.551-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9880000 QueuedCount 50000 2015-11-29T18:57:29.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15240000 2015-11-29T18:57:29.632-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.653-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.674-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.695-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.716-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.737-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.751-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9890000 QueuedCount 46005 2015-11-29T18:57:29.753-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15250000 2015-11-29T18:57:29.907-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15260000 2015-11-29T18:57:29.915-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:29.979-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9900000 QueuedCount 50000 2015-11-29T18:57:30.038-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15270000 2015-11-29T18:57:30.048-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:30.932-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:30.953-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15280000 2015-11-29T18:57:31.005-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9910000 QueuedCount 50000 2015-11-29T18:57:31.045-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:31.142-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15290000 2015-11-29T18:57:31.22-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9920000 QueuedCount 50000 2015-11-29T18:57:31.266-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:31.328-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15300000 2015-11-29T18:57:31.443-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9930000 QueuedCount 50000 2015-11-29T18:57:31.444-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:31.543-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15310000 2015-11-29T18:57:31.545-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:31.566-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:31.617-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15320000 2015-11-29T18:57:31.686-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15330000 2015-11-29T18:57:31.698-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9940000 QueuedCount 50000 2015-11-29T18:57:31.76-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15340000 2015-11-29T18:57:31.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:32.793-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9950000 QueuedCount 50000 2015-11-29T18:57:32.809-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:32.92-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9960000 QueuedCount 50000 2015-11-29T18:57:33.037-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9970000 QueuedCount 50000 2015-11-29T18:57:33.154-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9980000 QueuedCount 50000 2015-11-29T18:57:33.85-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 9990000 QueuedCount 42474 2015-11-29T18:57:33.95-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10000000 QueuedCount 32474 2015-11-29T18:57:34.04-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10010000 QueuedCount 22474 2015-11-29T18:57:34.13-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10020000 QueuedCount 12474 2015-11-29T18:57:34.738-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10030000 QueuedCount 2474 2015-11-29T18:57:34.942-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.118µs CommitTime 167.089594ms TotalFlushTime 5m40.666966067s TotalCommitTime 43.598796872s 2015-11-29T18:57:34.942-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5031320, 5031320, 72 committed:true 2015-11-29T18:57:34.942-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5031320, 5031320, 72 committed:true) SnapCreateDur 178.086416ms SnapOpenDur 53.458µs 2015-11-29T18:57:34.987-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15350000 2015-11-29T18:57:35.021-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.077-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15360000 2015-11-29T18:57:35.123-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10040000 QueuedCount 50000 2015-11-29T18:57:35.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15370000 2015-11-29T18:57:35.138-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.203-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15380000 2015-11-29T18:57:35.261-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15390000 2015-11-29T18:57:35.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15400000 2015-11-29T18:57:35.327-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10050000 QueuedCount 50000 2015-11-29T18:57:35.374-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.396-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15410000 2015-11-29T18:57:35.462-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15420000 2015-11-29T18:57:35.529-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15430000 2015-11-29T18:57:35.546-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10060000 QueuedCount 50000 2015-11-29T18:57:35.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15440000 2015-11-29T18:57:35.638-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.687-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15450000 2015-11-29T18:57:35.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15460000 2015-11-29T18:57:35.774-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10070000 QueuedCount 50000 2015-11-29T18:57:35.815-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:35.85-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15470000 2015-11-29T18:57:35.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15480000 2015-11-29T18:57:36.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15490000 2015-11-29T18:57:36.15-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15500000 2015-11-29T18:57:36.24-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15510000 2015-11-29T18:57:36.335-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15520000 2015-11-29T18:57:36.437-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15530000 2015-11-29T18:57:36.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15540000 2015-11-29T18:57:36.638-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15550000 2015-11-29T18:57:36.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15560000 2015-11-29T18:57:36.853-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15570000 2015-11-29T18:57:36.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15580000 2015-11-29T18:57:37.043-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15590000 2015-11-29T18:57:37.046-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.077-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10080000 QueuedCount 50000 2015-11-29T18:57:37.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15600000 2015-11-29T18:57:37.16-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.187-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15610000 2015-11-29T18:57:37.211-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10090000 QueuedCount 50000 2015-11-29T18:57:37.254-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15620000 2015-11-29T18:57:37.263-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.331-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15630000 2015-11-29T18:57:37.438-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10100000 QueuedCount 50000 2015-11-29T18:57:37.448-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.651-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.663-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10110000 QueuedCount 49354 2015-11-29T18:57:37.672-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.725-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:37.746-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:38.533-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:38.555-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10120000 QueuedCount 50000 2015-11-29T18:57:38.672-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10130000 QueuedCount 50000 2015-11-29T18:57:38.788-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10140000 QueuedCount 50000 2015-11-29T18:57:38.906-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10150000 QueuedCount 47497 2015-11-29T18:57:39.602-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10160000 QueuedCount 37497 2015-11-29T18:57:39.687-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10170000 QueuedCount 27497 2015-11-29T18:57:39.778-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10180000 QueuedCount 17497 2015-11-29T18:57:39.871-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10190000 QueuedCount 7497 2015-11-29T18:57:40.621-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.158µs CommitTime 662.010374ms TotalFlushTime 5m45.378178737s TotalCommitTime 44.260807246s 2015-11-29T18:57:40.621-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5113076, 5113076, 73 committed:true 2015-11-29T18:57:40.622-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5113076, 5113076, 73 committed:true) SnapCreateDur 672.708986ms SnapOpenDur 57.96µs 2015-11-29T18:57:40.666-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.677-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10200000 QueuedCount 27426 2015-11-29T18:57:40.745-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.766-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.777-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10210000 QueuedCount 46996 2015-11-29T18:57:40.789-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.81-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.837-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:40.871-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10220000 QueuedCount 50000 2015-11-29T18:57:40.903-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:41.003-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10230000 QueuedCount 50000 2015-11-29T18:57:42.208-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10240000 QueuedCount 50000 2015-11-29T18:57:42.328-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10250000 QueuedCount 50000 2015-11-29T18:57:42.336-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:42.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 368 2015-11-29T18:57:42.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 368 2015-11-29T18:57:42.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 368 2015-11-29T18:57:42.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 368 2015-11-29T18:57:42.491-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10260000 QueuedCount 50000 2015-11-29T18:57:42.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 368 2015-11-29T18:57:42.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 368 2015-11-29T18:57:42.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 368 2015-11-29T18:57:42.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 368 2015-11-29T18:57:42.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 368 2015-11-29T18:57:42.65-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 368 2015-11-29T18:57:42.68-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 368 2015-11-29T18:57:42.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 368 2015-11-29T18:57:42.717-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10270000 QueuedCount 50000 2015-11-29T18:57:42.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 368 2015-11-29T18:57:42.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 368 2015-11-29T18:57:42.8-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 368 2015-11-29T18:57:42.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 368 2015-11-29T18:57:42.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 368 2015-11-29T18:57:42.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 368 2015-11-29T18:57:42.92-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 368 2015-11-29T18:57:42.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 368 2015-11-29T18:57:42.961-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10280000 QueuedCount 50000 2015-11-29T18:57:42.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 368 2015-11-29T18:57:43.01-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 368 2015-11-29T18:57:43.04-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 368 2015-11-29T18:57:43.07-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 368 2015-11-29T18:57:43.1-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 368 2015-11-29T18:57:43.13-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 368 2015-11-29T18:57:43.16-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 368 2015-11-29T18:57:43.19-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 368 2015-11-29T18:57:43.22-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 368 2015-11-29T18:57:43.25-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 368 2015-11-29T18:57:43.28-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 368 2015-11-29T18:57:43.31-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 368 2015-11-29T18:57:43.34-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 368 2015-11-29T18:57:43.37-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 368 2015-11-29T18:57:43.4-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 368 2015-11-29T18:57:43.43-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 368 2015-11-29T18:57:43.46-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 368 2015-11-29T18:57:43.49-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 368 2015-11-29T18:57:43.52-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 368 2015-11-29T18:57:43.55-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 368 2015-11-29T18:57:43.58-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 368 2015-11-29T18:57:43.61-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 368 2015-11-29T18:57:43.64-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 368 2015-11-29T18:57:43.67-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 368 2015-11-29T18:57:43.7-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 368 2015-11-29T18:57:43.73-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 368 2015-11-29T18:57:43.76-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 368 2015-11-29T18:57:43.79-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 368 2015-11-29T18:57:43.82-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 368 2015-11-29T18:57:43.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 368 2015-11-29T18:57:43.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 368 2015-11-29T18:57:43.887-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:43.999-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15640000 2015-11-29T18:57:44.02-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10290000 QueuedCount 50000 2015-11-29T18:57:44.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15650000 2015-11-29T18:57:44.216-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15660000 2015-11-29T18:57:44.262-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10300000 QueuedCount 50000 2015-11-29T18:57:44.581-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10310000 QueuedCount 50000 2015-11-29T18:57:44.865-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10320000 QueuedCount 47246 2015-11-29T18:57:45.883-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10330000 QueuedCount 37246 2015-11-29T18:57:45.987-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10340000 QueuedCount 27246 2015-11-29T18:57:46.09-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10350000 QueuedCount 17246 2015-11-29T18:57:46.194-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10360000 QueuedCount 7246 2015-11-29T18:57:47.026-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 18.956µs CommitTime 174.005017ms TotalFlushTime 5m51.182512782s TotalCommitTime 44.434812263s 2015-11-29T18:57:47.026-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5196884, 5196884, 74 committed:true 2015-11-29T18:57:47.026-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5196884, 5196884, 74 committed:true) SnapCreateDur 186.856649ms SnapOpenDur 75.068µs 2015-11-29T18:57:47.068-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:47.107-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:47.113-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10370000 QueuedCount 48323 2015-11-29T18:57:47.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15670000 2015-11-29T18:57:47.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15680000 2015-11-29T18:57:47.259-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15690000 2015-11-29T18:57:47.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15700000 2015-11-29T18:57:47.362-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10380000 QueuedCount 50000 2015-11-29T18:57:47.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15710000 2015-11-29T18:57:47.471-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15720000 2015-11-29T18:57:47.551-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15730000 2015-11-29T18:57:47.635-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15740000 2015-11-29T18:57:47.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15750000 2015-11-29T18:57:47.799-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15760000 2015-11-29T18:57:47.887-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15770000 2015-11-29T18:57:47.903-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:47.97-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15780000 2015-11-29T18:57:48.567-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10390000 QueuedCount 50000 2015-11-29T18:57:48.825-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10400000 QueuedCount 50000 2015-11-29T18:57:50.097-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10410000 QueuedCount 50000 2015-11-29T18:57:50.287-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:50.332-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10420000 QueuedCount 50000 2015-11-29T18:57:50.558-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10430000 QueuedCount 50000 2015-11-29T18:57:50.786-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10440000 QueuedCount 49299 2015-11-29T18:57:51.855-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10450000 QueuedCount 39299 2015-11-29T18:57:51.962-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10460000 QueuedCount 29299 2015-11-29T18:57:52.064-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10470000 QueuedCount 19299 2015-11-29T18:57:52.171-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10480000 QueuedCount 9299 2015-11-29T18:57:53.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 381 2015-11-29T18:57:53.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 381 2015-11-29T18:57:53.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 381 2015-11-29T18:57:53.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 381 2015-11-29T18:57:53.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 381 2015-11-29T18:57:53.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 381 2015-11-29T18:57:53.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 381 2015-11-29T18:57:53.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 381 2015-11-29T18:57:53.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 381 2015-11-29T18:57:53.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 381 2015-11-29T18:57:53.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 381 2015-11-29T18:57:53.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 381 2015-11-29T18:57:53.387-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":6057004201,"bucket-1:by_capped_small_0:avg_ts_items_count":167144,"bucket-1:by_capped_small_0:build_progress":52,"bucket-1:by_capped_small_0:data_size":1632279389,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":4067889152,"bucket-1:by_capped_small_0:flush_queue_size":0,"bucket-1:by_capped_small_0:frag_percent":59,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":487325601,"bucket-1:by_capped_small_0:items_count":5196884,"bucket-1:by_capped_small_0:num_commits":74,"bucket-1:by_capped_small_0:num_compactions":4,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":10467802,"bucket-1:by_capped_small_0:num_docs_pending":4212716,"bucket-1:by_capped_small_0:num_docs_queued":5319482,"bucket-1:by_capped_small_0:num_flush_queued":10489299,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":74,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":6404246324,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"74 44434812263 -3849505203374698593","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"10489299 103042675701 -5304892614202316597","bucket-1:by_capped_small_0:timings/storage_handle_open":"74 3402973 191892115717","bucket-1:by_capped_small_0:timings/storage_info":"300 4833528 561001047516","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"78 1986807563 1145209907816319807","bucket-1:by_capped_small_0:timings/storage_meta_set":"75 45809637 32245561596419","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"10515202 241196076316 -8343503817557456982","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5297983,"bucket-1:num_mutations_queued":15787282,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":405,"memory_quota":104857600000,"memory_used":3704512512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1941 323930831 1542081570287853"} 2015-11-29T18:57:53.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 381 2015-11-29T18:57:53.418-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.72µs CommitTime 1.117498841s TotalFlushTime 5m56.123305637s TotalCommitTime 45.552311104s 2015-11-29T18:57:53.418-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5257601, 5257601, 75 committed:true 2015-11-29T18:57:53.418-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5257601, 5257601, 75 committed:true) SnapCreateDur 1.146784129s SnapOpenDur 48.114µs 2015-11-29T18:57:53.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 381 2015-11-29T18:57:53.446-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.448-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10490000 QueuedCount 7287 2015-11-29T18:57:53.473-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.501-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.51-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15790000 2015-11-29T18:57:53.529-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.55-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10500000 QueuedCount 25894 2015-11-29T18:57:53.552-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.58-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15800000 2015-11-29T18:57:53.606-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.653-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15810000 2015-11-29T18:57:53.654-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:53.659-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10510000 QueuedCount 49457 2015-11-29T18:57:53.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15820000 2015-11-29T18:57:53.773-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10520000 QueuedCount 49999 2015-11-29T18:57:53.78-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15830000 2015-11-29T18:57:53.84-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15840000 2015-11-29T18:57:53.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15850000 2015-11-29T18:57:53.902-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10530000 QueuedCount 50000 2015-11-29T18:57:53.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15860000 2015-11-29T18:57:54.071-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15870000 2015-11-29T18:57:54.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15880000 2015-11-29T18:57:54.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15890000 2015-11-29T18:57:54.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15900000 2015-11-29T18:57:54.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15910000 2015-11-29T18:57:54.519-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15920000 2015-11-29T18:57:54.545-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:54.594-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15930000 2015-11-29T18:57:54.603-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:54.624-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:54.624-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10540000 QueuedCount 47879 2015-11-29T18:57:54.646-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:54.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15940000 2015-11-29T18:57:54.716-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10550000 QueuedCount 50000 2015-11-29T18:57:54.733-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15950000 2015-11-29T18:57:54.799-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15960000 2015-11-29T18:57:54.938-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10560000 QueuedCount 50000 2015-11-29T18:57:55.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:55.187-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10570000 QueuedCount 49726 2015-11-29T18:57:57.056-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10580000 QueuedCount 50000 2015-11-29T18:57:57.372-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10590000 QueuedCount 50000 2015-11-29T18:57:57.543-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:57.635-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10600000 QueuedCount 47168 2015-11-29T18:57:57.846-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10610000 QueuedCount 37168 2015-11-29T18:57:58.907-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10620000 QueuedCount 27168 2015-11-29T18:57:59.013-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10630000 QueuedCount 17168 2015-11-29T18:57:59.123-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10640000 QueuedCount 7168 2015-11-29T18:57:59.814-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 392 2015-11-29T18:57:59.844-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 392 2015-11-29T18:57:59.874-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 392 2015-11-29T18:57:59.904-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 392 2015-11-29T18:57:59.918-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.504µs CommitTime 699.831189ms TotalFlushTime 6m1.589639961s TotalCommitTime 46.252142293s 2015-11-29T18:57:59.918-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5335765, 5335765, 76 committed:true 2015-11-29T18:57:59.918-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5335765, 5335765, 76 committed:true) SnapCreateDur 712.464634ms SnapOpenDur 57.976µs 2015-11-29T18:57:59.934-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 392 2015-11-29T18:57:59.939-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:59.962-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:59.964-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 392 2015-11-29T18:57:59.991-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:57:59.994-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 392 2015-11-29T18:58:00.008-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10650000 QueuedCount 10469 2015-11-29T18:58:00.018-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:00.024-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 392 2015-11-29T18:58:00.043-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:00.054-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 392 2015-11-29T18:58:00.075-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:00.084-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 392 2015-11-29T18:58:00.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15970000 2015-11-29T18:58:00.233-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10660000 QueuedCount 50000 2015-11-29T18:58:00.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15980000 2015-11-29T18:58:00.363-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15990000 2015-11-29T18:58:00.4-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:00.444-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10670000 QueuedCount 50000 2015-11-29T18:58:00.547-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16000000 2015-11-29T18:58:00.694-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10680000 QueuedCount 50000 2015-11-29T18:58:00.763-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16010000 2015-11-29T18:58:00.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16020000 2015-11-29T18:58:00.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16030000 2015-11-29T18:58:01.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16040000 2015-11-29T18:58:01.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16050000 2015-11-29T18:58:01.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16060000 2015-11-29T18:58:01.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16070000 2015-11-29T18:58:01.367-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16080000 2015-11-29T18:58:01.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16090000 2015-11-29T18:58:01.553-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16100000 2015-11-29T18:58:01.642-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16110000 2015-11-29T18:58:02.099-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10690000 QueuedCount 50000 2015-11-29T18:58:02.355-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:02.385-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10700000 QueuedCount 50000 2015-11-29T18:58:02.617-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10710000 QueuedCount 50000 2015-11-29T18:58:02.813-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:02.883-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10720000 QueuedCount 50000 2015-11-29T18:58:03.115-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10730000 QueuedCount 42960 2015-11-29T18:58:04.194-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10740000 QueuedCount 32960 2015-11-29T18:58:04.303-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10750000 QueuedCount 22960 2015-11-29T18:58:04.419-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10760000 QueuedCount 12960 2015-11-29T18:58:04.529-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10770000 QueuedCount 2960 2015-11-29T18:58:05.37-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.151µs CommitTime 141.527994ms TotalFlushTime 6m6.585817512s TotalCommitTime 46.393670287s 2015-11-29T18:58:05.371-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5397403, 5397403, 77 committed:true 2015-11-29T18:58:05.371-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5397403, 5397403, 77 committed:true) SnapCreateDur 154.279876ms SnapOpenDur 47.806µs 2015-11-29T18:58:05.395-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:05.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16120000 2015-11-29T18:58:05.42-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:05.447-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:05.483-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:05.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16130000 2015-11-29T18:58:05.533-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10780000 QueuedCount 50000 2015-11-29T18:58:05.75-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:05.753-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10790000 QueuedCount 49804 2015-11-29T18:58:05.984-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10800000 QueuedCount 50000 2015-11-29T18:58:06.196-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:06.212-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10810000 QueuedCount 49178 2015-11-29T18:58:07.326-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10820000 QueuedCount 50000 2015-11-29T18:58:07.498-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10830000 QueuedCount 50000 2015-11-29T18:58:07.69-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:07.706-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10840000 QueuedCount 48539 2015-11-29T18:58:07.846-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10850000 QueuedCount 50000 2015-11-29T18:58:07.853-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:08.689-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10860000 QueuedCount 49999 2015-11-29T18:58:08.787-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10870000 QueuedCount 40112 2015-11-29T18:58:08.887-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10880000 QueuedCount 30112 2015-11-29T18:58:08.991-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10890000 QueuedCount 20112 2015-11-29T18:58:09.641-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10900000 QueuedCount 10112 2015-11-29T18:58:09.721-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10910000 QueuedCount 112 2015-11-29T18:58:10.021-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.989µs CommitTime 280.532416ms TotalFlushTime 6m10.624446629s TotalCommitTime 46.674202703s 2015-11-29T18:58:10.021-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5465128, 5465128, 78 committed:true 2015-11-29T18:58:10.021-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5465128, 5465128, 78 committed:true) SnapCreateDur 290.868921ms SnapOpenDur 65.905µs 2015-11-29T18:58:10.044-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.069-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.09-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.114-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.142-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.17-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.196-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.253-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10920000 QueuedCount 50000 2015-11-29T18:58:10.394-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:10.516-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16140000 2015-11-29T18:58:10.557-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10930000 QueuedCount 50000 2015-11-29T18:58:10.764-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16150000 2015-11-29T18:58:10.843-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16160000 2015-11-29T18:58:10.92-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16170000 2015-11-29T18:58:10.998-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16180000 2015-11-29T18:58:11.149-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10940000 QueuedCount 49999 2015-11-29T18:58:12.026-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10950000 QueuedCount 50000 2015-11-29T18:58:13.107-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:13.204-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10960000 QueuedCount 50000 2015-11-29T18:58:13.317-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10970000 QueuedCount 50000 2015-11-29T18:58:14.45-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10980000 QueuedCount 44215 2015-11-29T18:58:14.647-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 10990000 QueuedCount 34215 2015-11-29T18:58:15.536-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11000000 QueuedCount 24215 2015-11-29T18:58:15.635-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11010000 QueuedCount 14215 2015-11-29T18:58:15.742-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11020000 QueuedCount 4215 2015-11-29T18:58:16.033-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 193 2015-11-29T18:58:16.063-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 193 2015-11-29T18:58:16.093-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 193 2015-11-29T18:58:16.123-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 193 2015-11-29T18:58:16.153-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 193 2015-11-29T18:58:16.183-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 193 2015-11-29T18:58:16.213-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 193 2015-11-29T18:58:16.243-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 193 2015-11-29T18:58:16.273-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 193 2015-11-29T18:58:16.303-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 193 2015-11-29T18:58:16.333-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 193 2015-11-29T18:58:16.362-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 193 2015-11-29T18:58:16.393-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 193 2015-11-29T18:58:16.405-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 13.534µs CommitTime 598.926738ms TotalFlushTime 6m16.151626887s TotalCommitTime 47.273129441s 2015-11-29T18:58:16.405-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5522092, 5522092, 79 committed:true 2015-11-29T18:58:16.405-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5522092, 5522092, 79 committed:true) SnapCreateDur 611.984597ms SnapOpenDur 51.357µs 2015-11-29T18:58:16.423-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 193 2015-11-29T18:58:16.434-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.46-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.484-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16190000 2015-11-29T18:58:16.512-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.538-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.546-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11030000 QueuedCount 30565 2015-11-29T18:58:16.566-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.579-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16200000 2015-11-29T18:58:16.591-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.617-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.649-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16210000 2015-11-29T18:58:16.704-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:16.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16220000 2015-11-29T18:58:16.746-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11040000 QueuedCount 50000 2015-11-29T18:58:16.77-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16230000 2015-11-29T18:58:16.835-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16240000 2015-11-29T18:58:16.9-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16250000 2015-11-29T18:58:16.954-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11050000 QueuedCount 50000 2015-11-29T18:58:16.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16260000 2015-11-29T18:58:17.04-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16270000 2015-11-29T18:58:17.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16280000 2015-11-29T18:58:17.187-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11060000 QueuedCount 50000 2015-11-29T18:58:17.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16290000 2015-11-29T18:58:17.223-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:17.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16300000 2015-11-29T18:58:18.182-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11070000 QueuedCount 50000 2015-11-29T18:58:18.304-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11080000 QueuedCount 50000 2015-11-29T18:58:18.386-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:18.475-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11090000 QueuedCount 50000 2015-11-29T18:58:18.724-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11100000 QueuedCount 50000 2015-11-29T18:58:19.769-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11110000 QueuedCount 43747 2015-11-29T18:58:19.875-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11120000 QueuedCount 33747 2015-11-29T18:58:19.98-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11130000 QueuedCount 23747 2015-11-29T18:58:20.083-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11140000 QueuedCount 13747 2015-11-29T18:58:20.758-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11150000 QueuedCount 3747 2015-11-29T18:58:21.012-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.939µs CommitTime 207.697705ms TotalFlushTime 6m20.281386594s TotalCommitTime 47.480827146s 2015-11-29T18:58:21.012-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5585999, 5585999, 80 committed:true 2015-11-29T18:58:21.012-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5585999, 5585999, 80 committed:true) SnapCreateDur 218.545187ms SnapOpenDur 50.022µs 2015-11-29T18:58:21.038-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16310000 2015-11-29T18:58:21.065-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.089-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.116-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.132-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16320000 2015-11-29T18:58:21.147-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.164-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11160000 QueuedCount 34530 2015-11-29T18:58:21.196-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.204-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16330000 2015-11-29T18:58:21.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16340000 2015-11-29T18:58:21.309-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.33-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.35-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16350000 2015-11-29T18:58:21.381-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11170000 QueuedCount 50000 2015-11-29T18:58:21.415-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16360000 2015-11-29T18:58:21.487-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16370000 2015-11-29T18:58:21.57-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16380000 2015-11-29T18:58:21.611-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11180000 QueuedCount 50000 2015-11-29T18:58:21.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16390000 2015-11-29T18:58:21.757-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16400000 2015-11-29T18:58:21.828-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11190000 QueuedCount 50000 2015-11-29T18:58:21.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16410000 2015-11-29T18:58:21.925-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:21.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16420000 2015-11-29T18:58:22.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16430000 2015-11-29T18:58:22.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11200000 QueuedCount 50000 2015-11-29T18:58:23.04-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16440000 2015-11-29T18:58:23.104-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11210000 QueuedCount 50000 2015-11-29T18:58:23.115-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16450000 2015-11-29T18:58:23.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16460000 2015-11-29T18:58:23.227-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11220000 QueuedCount 50000 2015-11-29T18:58:23.244-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:23.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16470000 2015-11-29T18:58:23.353-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11230000 QueuedCount 50000 2015-11-29T18:58:23.401-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16480000 2015-11-29T18:58:23.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16490000 2015-11-29T18:58:23.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16500000 2015-11-29T18:58:23.785-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16510000 2015-11-29T18:58:23.914-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16520000 2015-11-29T18:58:24.038-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16530000 2015-11-29T18:58:24.105-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:24.113-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11240000 QueuedCount 49114 2015-11-29T18:58:24.139-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16540000 2015-11-29T18:58:24.209-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11250000 QueuedCount 47939 2015-11-29T18:58:24.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16550000 2015-11-29T18:58:24.303-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11260000 QueuedCount 37939 2015-11-29T18:58:24.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16560000 2015-11-29T18:58:24.398-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11270000 QueuedCount 27939 2015-11-29T18:58:24.502-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16570000 2015-11-29T18:58:24.634-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16580000 2015-11-29T18:58:24.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16590000 2015-11-29T18:58:24.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16600000 2015-11-29T18:58:25.03-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16610000 2015-11-29T18:58:25.047-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11280000 QueuedCount 17939 2015-11-29T18:58:25.136-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11290000 QueuedCount 7939 2015-11-29T18:58:25.159-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16620000 2015-11-29T18:58:25.294-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16630000 2015-11-29T18:58:25.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16640000 2015-11-29T18:58:25.636-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.954µs CommitTime 415.19117ms TotalFlushTime 6m24.280383488s TotalCommitTime 47.896018316s 2015-11-29T18:58:25.637-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5657277, 5657277, 81 committed:true 2015-11-29T18:58:25.637-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5657277, 5657277, 81 committed:true) SnapCreateDur 426.234212ms SnapOpenDur 45.014µs 2015-11-29T18:58:25.664-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.676-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16650000 2015-11-29T18:58:25.689-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.698-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11300000 QueuedCount 11576 2015-11-29T18:58:25.722-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.751-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.753-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16660000 2015-11-29T18:58:25.775-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.799-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16670000 2015-11-29T18:58:25.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:25.897-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16680000 2015-11-29T18:58:25.929-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11310000 QueuedCount 49999 2015-11-29T18:58:25.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16690000 2015-11-29T18:58:26.085-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:26.105-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11320000 QueuedCount 49053 2015-11-29T18:58:26.198-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16700000 2015-11-29T18:58:26.253-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16710000 2015-11-29T18:58:26.321-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11330000 QueuedCount 50000 2015-11-29T18:58:27.604-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11340000 QueuedCount 50000 2015-11-29T18:58:27.73-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11350000 QueuedCount 50000 2015-11-29T18:58:27.746-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:27.859-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11360000 QueuedCount 50000 2015-11-29T18:58:27.986-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11370000 QueuedCount 50000 2015-11-29T18:58:27.994-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:28.193-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:28.206-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11380000 QueuedCount 49394 2015-11-29T18:58:30.036-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:30.115-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11390000 QueuedCount 50000 2015-11-29T18:58:30.344-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11400000 QueuedCount 50000 2015-11-29T18:58:30.555-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11410000 QueuedCount 40975 2015-11-29T18:58:30.766-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11420000 QueuedCount 30975 2015-11-29T18:58:31.302-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 316 2015-11-29T18:58:31.332-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 316 2015-11-29T18:58:31.362-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 316 2015-11-29T18:58:31.392-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 316 2015-11-29T18:58:31.422-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 316 2015-11-29T18:58:31.452-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 316 2015-11-29T18:58:31.482-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 316 2015-11-29T18:58:31.512-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 316 2015-11-29T18:58:31.542-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 316 2015-11-29T18:58:31.572-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 316 2015-11-29T18:58:31.602-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 316 2015-11-29T18:58:31.632-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 316 2015-11-29T18:58:31.639-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11430000 QueuedCount 20975 2015-11-29T18:58:31.662-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 316 2015-11-29T18:58:31.692-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 316 2015-11-29T18:58:31.722-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 316 2015-11-29T18:58:31.747-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11440000 QueuedCount 10975 2015-11-29T18:58:31.752-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 316 2015-11-29T18:58:31.782-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 316 2015-11-29T18:58:31.812-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 316 2015-11-29T18:58:31.842-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 316 2015-11-29T18:58:31.858-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11450000 QueuedCount 975 2015-11-29T18:58:31.872-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 316 2015-11-29T18:58:31.902-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 316 2015-11-29T18:58:31.932-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 316 2015-11-29T18:58:31.962-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 316 2015-11-29T18:58:31.992-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 316 2015-11-29T18:58:32.022-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 316 2015-11-29T18:58:32.052-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 316 2015-11-29T18:58:32.082-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 316 2015-11-29T18:58:32.112-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 316 2015-11-29T18:58:32.142-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 316 2015-11-29T18:58:32.172-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 316 2015-11-29T18:58:32.202-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 316 2015-11-29T18:58:32.232-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 316 2015-11-29T18:58:32.262-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 316 2015-11-29T18:58:32.292-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 316 2015-11-29T18:58:32.322-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 316 2015-11-29T18:58:32.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 316 2015-11-29T18:58:32.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 316 2015-11-29T18:58:32.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 316 2015-11-29T18:58:32.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 316 2015-11-29T18:58:32.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 316 2015-11-29T18:58:32.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 316 2015-11-29T18:58:32.515-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.293µs CommitTime 626.081261ms TotalFlushTime 6m30.183159978s TotalCommitTime 48.522099577s 2015-11-29T18:58:32.515-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5733378, 5733378, 82 committed:true 2015-11-29T18:58:32.515-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5733378, 5733378, 82 committed:true) SnapCreateDur 638.743699ms SnapOpenDur 49.207µs 2015-11-29T18:58:32.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 316 2015-11-29T18:58:32.544-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 316 2015-11-29T18:58:32.571-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 316 2015-11-29T18:58:32.602-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 316 2015-11-29T18:58:32.623-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.629-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11460000 QueuedCount 21170 2015-11-29T18:58:32.654-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.678-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16720000 2015-11-29T18:58:32.689-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.743-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11470000 QueuedCount 50000 2015-11-29T18:58:32.744-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16730000 2015-11-29T18:58:32.803-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16740000 2015-11-29T18:58:32.849-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11480000 QueuedCount 50000 2015-11-29T18:58:32.863-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16750000 2015-11-29T18:58:32.889-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:32.93-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16760000 2015-11-29T18:58:32.957-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11490000 QueuedCount 50000 2015-11-29T18:58:32.992-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16770000 2015-11-29T18:58:33.077-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16780000 2015-11-29T18:58:33.164-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16790000 2015-11-29T18:58:33.251-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16800000 2015-11-29T18:58:33.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16810000 2015-11-29T18:58:33.43-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16820000 2015-11-29T18:58:33.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16830000 2015-11-29T18:58:33.612-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16840000 2015-11-29T18:58:33.677-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16850000 2015-11-29T18:58:33.678-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11500000 QueuedCount 50000 2015-11-29T18:58:33.746-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16860000 2015-11-29T18:58:33.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16870000 2015-11-29T18:58:33.871-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:33.891-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11510000 QueuedCount 49047 2015-11-29T18:58:33.892-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16880000 2015-11-29T18:58:33.965-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16890000 2015-11-29T18:58:34.042-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16900000 2015-11-29T18:58:34.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16910000 2015-11-29T18:58:34.119-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11520000 QueuedCount 50000 2015-11-29T18:58:34.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16920000 2015-11-29T18:58:34.286-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16930000 2015-11-29T18:58:34.361-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11530000 QueuedCount 50000 2015-11-29T18:58:34.396-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16940000 2015-11-29T18:58:34.418-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:34.513-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16950000 2015-11-29T18:58:34.641-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16960000 2015-11-29T18:58:34.769-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16970000 2015-11-29T18:58:34.895-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16980000 2015-11-29T18:58:35.022-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16990000 2015-11-29T18:58:35.152-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17000000 2015-11-29T18:58:35.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17010000 2015-11-29T18:58:35.407-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17020000 2015-11-29T18:58:35.473-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11540000 QueuedCount 50000 2015-11-29T18:58:35.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17030000 2015-11-29T18:58:35.581-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17040000 2015-11-29T18:58:35.588-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11550000 QueuedCount 50000 2015-11-29T18:58:35.632-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:35.67-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17050000 2015-11-29T18:58:35.709-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11560000 QueuedCount 50000 2015-11-29T18:58:35.921-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11570000 QueuedCount 42475 2015-11-29T18:58:36.955-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11580000 QueuedCount 32475 2015-11-29T18:58:37.064-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11590000 QueuedCount 22475 2015-11-29T18:58:37.178-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11600000 QueuedCount 12475 2015-11-29T18:58:37.293-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11610000 QueuedCount 2475 2015-11-29T18:58:38.445-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.576µs CommitTime 1.088268007s TotalFlushTime 6m34.757282622s TotalCommitTime 49.610367584s 2015-11-29T18:58:38.445-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5813427, 5813427, 83 committed:true 2015-11-29T18:58:38.445-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5813427, 5813427, 83 committed:true) SnapCreateDur 1.114317336s SnapOpenDur 57.032µs 2015-11-29T18:58:38.466-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.522-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.546-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.574-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.577-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11620000 QueuedCount 23892 2015-11-29T18:58:38.613-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:38.688-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11630000 QueuedCount 50000 2015-11-29T18:58:38.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17060000 2015-11-29T18:58:38.815-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11640000 QueuedCount 50000 2015-11-29T18:58:38.925-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17070000 2015-11-29T18:58:39-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:39.09-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11650000 QueuedCount 50000 2015-11-29T18:58:39.204-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17080000 2015-11-29T18:58:40.307-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11660000 QueuedCount 50000 2015-11-29T18:58:40.318-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17090000 2015-11-29T18:58:40.375-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17100000 2015-11-29T18:58:40.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17110000 2015-11-29T18:58:40.436-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11670000 QueuedCount 50000 2015-11-29T18:58:40.473-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:40.491-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17120000 2015-11-29T18:58:40.563-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11680000 QueuedCount 50000 2015-11-29T18:58:40.775-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11690000 QueuedCount 50000 2015-11-29T18:58:40.83-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:41.937-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11700000 QueuedCount 50000 2015-11-29T18:58:42.055-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11710000 QueuedCount 48450 2015-11-29T18:58:42.165-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11720000 QueuedCount 38450 2015-11-29T18:58:42.278-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11730000 QueuedCount 28450 2015-11-29T18:58:43.032-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11740000 QueuedCount 18450 2015-11-29T18:58:43.122-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11750000 QueuedCount 8450 2015-11-29T18:58:43.65-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.841µs CommitTime 442.032554ms TotalFlushTime 6m39.242065851s TotalCommitTime 50.052400138s 2015-11-29T18:58:43.65-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5885445, 5885445, 84 committed:true 2015-11-29T18:58:43.65-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5885445, 5885445, 84 committed:true) SnapCreateDur 451.926199ms SnapOpenDur 59.997µs 2015-11-29T18:58:43.679-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:43.708-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11760000 QueuedCount 21791 2015-11-29T18:58:43.708-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:43.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17130000 2015-11-29T18:58:43.734-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:43.786-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17140000 2015-11-29T18:58:43.847-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17150000 2015-11-29T18:58:43.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:43.911-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17160000 2015-11-29T18:58:43.919-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11770000 QueuedCount 48981 2015-11-29T18:58:43.977-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17170000 2015-11-29T18:58:44.04-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17180000 2015-11-29T18:58:44.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17190000 2015-11-29T18:58:44.128-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11780000 QueuedCount 50000 2015-11-29T18:58:44.17-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17200000 2015-11-29T18:58:44.354-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11790000 QueuedCount 50000 2015-11-29T18:58:44.502-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:45.581-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11800000 QueuedCount 50000 2015-11-29T18:58:45.629-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:45.707-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11810000 QueuedCount 50000 2015-11-29T18:58:45.794-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:45.831-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:45.919-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11820000 QueuedCount 47679 2015-11-29T18:58:46.126-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11830000 QueuedCount 37679 2015-11-29T18:58:46.336-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11840000 QueuedCount 27679 2015-11-29T18:58:47.189-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11850000 QueuedCount 17679 2015-11-29T18:58:47.293-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11860000 QueuedCount 7679 2015-11-29T18:58:47.959-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.869µs CommitTime 564.431565ms TotalFlushTime 6m42.746170599s TotalCommitTime 50.616831703s 2015-11-29T18:58:47.959-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5939551, 5939551, 85 committed:true 2015-11-29T18:58:47.959-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5939551, 5939551, 85 committed:true) SnapCreateDur 577.09533ms SnapOpenDur 51.411µs 2015-11-29T18:58:47.984-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.01-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.026-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11870000 QueuedCount 11033 2015-11-29T18:58:48.036-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.062-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.087-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.112-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:48.236-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11880000 QueuedCount 50000 2015-11-29T18:58:48.564-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11890000 QueuedCount 49999 2015-11-29T18:58:49.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 1019 2015-11-29T18:58:49.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 1019 2015-11-29T18:58:49.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 1019 2015-11-29T18:58:49.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 1019 2015-11-29T18:58:49.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 1019 2015-11-29T18:58:49.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 1019 2015-11-29T18:58:49.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 1019 2015-11-29T18:58:49.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 1019 2015-11-29T18:58:49.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 1019 2015-11-29T18:58:49.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 1019 2015-11-29T18:58:49.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 1019 2015-11-29T18:58:49.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 1019 2015-11-29T18:58:49.569-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:49.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 1019 2015-11-29T18:58:49.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 1019 2015-11-29T18:58:49.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 1019 2015-11-29T18:58:49.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 1019 2015-11-29T18:58:49.691-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11900000 QueuedCount 50000 2015-11-29T18:58:49.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 1019 2015-11-29T18:58:49.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 1019 2015-11-29T18:58:49.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 1019 2015-11-29T18:58:49.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 1019 2015-11-29T18:58:49.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 1019 2015-11-29T18:58:49.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 1019 2015-11-29T18:58:49.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 1019 2015-11-29T18:58:49.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 1019 2015-11-29T18:58:49.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 1019 2015-11-29T18:58:49.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 1019 2015-11-29T18:58:50.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 1019 2015-11-29T18:58:50.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 1019 2015-11-29T18:58:50.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 1019 2015-11-29T18:58:50.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 1019 2015-11-29T18:58:50.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 1019 2015-11-29T18:58:50.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 1019 2015-11-29T18:58:50.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 1019 2015-11-29T18:58:50.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 1019 2015-11-29T18:58:50.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 1019 2015-11-29T18:58:50.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 1019 2015-11-29T18:58:50.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 1019 2015-11-29T18:58:50.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 1019 2015-11-29T18:58:50.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 1019 2015-11-29T18:58:50.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 1019 2015-11-29T18:58:50.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 1019 2015-11-29T18:58:50.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 1019 2015-11-29T18:58:50.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 1019 2015-11-29T18:58:50.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 1019 2015-11-29T18:58:50.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 1019 2015-11-29T18:58:50.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 1019 2015-11-29T18:58:50.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 1019 2015-11-29T18:58:50.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 1019 2015-11-29T18:58:50.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 1019 2015-11-29T18:58:50.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 1019 2015-11-29T18:58:50.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 1019 2015-11-29T18:58:50.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 1019 2015-11-29T18:58:50.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 1019 2015-11-29T18:58:50.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 1019 2015-11-29T18:58:50.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 1019 2015-11-29T18:58:50.852-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11910000 QueuedCount 50000 2015-11-29T18:58:50.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 1019 2015-11-29T18:58:50.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 1019 2015-11-29T18:58:50.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 1019 2015-11-29T18:58:50.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 1019 2015-11-29T18:58:51.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 1019 2015-11-29T18:58:51.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 1019 2015-11-29T18:58:51.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 1019 2015-11-29T18:58:51.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 1019 2015-11-29T18:58:51.11-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11920000 QueuedCount 50000 2015-11-29T18:58:51.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 1019 2015-11-29T18:58:51.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 1019 2015-11-29T18:58:51.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 1019 2015-11-29T18:58:51.204-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:51.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 1019 2015-11-29T18:58:51.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 1019 2015-11-29T18:58:51.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 1019 2015-11-29T18:58:51.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 1019 2015-11-29T18:58:51.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 1019 2015-11-29T18:58:51.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 1019 2015-11-29T18:58:51.364-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11930000 QueuedCount 50000 2015-11-29T18:58:51.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 1019 2015-11-29T18:58:51.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 1019 2015-11-29T18:58:51.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 1019 2015-11-29T18:58:51.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 1019 2015-11-29T18:58:51.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 1019 2015-11-29T18:58:51.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 1019 2015-11-29T18:58:51.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 1019 2015-11-29T18:58:51.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 1019 2015-11-29T18:58:51.615-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11940000 QueuedCount 47807 2015-11-29T18:58:51.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 1019 2015-11-29T18:58:51.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 1019 2015-11-29T18:58:51.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 1019 2015-11-29T18:58:51.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 1019 2015-11-29T18:58:51.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 1019 2015-11-29T18:58:51.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 1019 2015-11-29T18:58:51.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 1019 2015-11-29T18:58:51.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 1019 2015-11-29T18:58:51.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 1019 2015-11-29T18:58:51.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 1019 2015-11-29T18:58:51.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 1019 2015-11-29T18:58:51.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 1019 2015-11-29T18:58:51.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 1019 2015-11-29T18:58:52.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 1019 2015-11-29T18:58:52.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 1019 2015-11-29T18:58:52.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 1019 2015-11-29T18:58:52.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 1019 2015-11-29T18:58:52.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 1019 2015-11-29T18:58:52.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 1019 2015-11-29T18:58:52.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 1019 2015-11-29T18:58:52.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 1019 2015-11-29T18:58:52.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 1019 2015-11-29T18:58:52.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 1019 2015-11-29T18:58:52.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 1019 2015-11-29T18:58:52.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 1019 2015-11-29T18:58:52.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 1019 2015-11-29T18:58:52.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 1019 2015-11-29T18:58:52.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 1019 2015-11-29T18:58:52.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 1019 2015-11-29T18:58:52.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 1019 2015-11-29T18:58:52.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 1019 2015-11-29T18:58:52.542-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11950000 QueuedCount 37807 2015-11-29T18:58:52.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 1019 2015-11-29T18:58:52.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 1019 2015-11-29T18:58:52.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 1019 2015-11-29T18:58:52.641-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11960000 QueuedCount 27807 2015-11-29T18:58:52.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 1019 2015-11-29T18:58:52.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 1019 2015-11-29T18:58:52.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 1019 2015-11-29T18:58:52.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 1019 2015-11-29T18:58:52.743-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11970000 QueuedCount 17807 2015-11-29T18:58:52.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 1019 2015-11-29T18:58:52.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 1019 2015-11-29T18:58:52.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 1019 2015-11-29T18:58:52.847-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11980000 QueuedCount 7807 2015-11-29T18:58:52.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 1019 2015-11-29T18:58:52.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 1019 2015-11-29T18:58:52.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 1019 2015-11-29T18:58:52.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 1019 2015-11-29T18:58:52.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 1019 2015-11-29T18:58:53.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 1019 2015-11-29T18:58:53.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 1019 2015-11-29T18:58:53.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 1019 2015-11-29T18:58:53.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 1019 2015-11-29T18:58:53.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 1019 2015-11-29T18:58:53.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 1019 2015-11-29T18:58:53.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 1019 2015-11-29T18:58:53.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 1019 2015-11-29T18:58:53.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 1019 2015-11-29T18:58:53.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 1019 2015-11-29T18:58:53.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 1019 2015-11-29T18:58:53.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 1019 2015-11-29T18:58:53.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 1019 2015-11-29T18:58:53.388-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":4934464590,"bucket-1:by_capped_small_0:avg_ts_items_count":129358,"bucket-1:by_capped_small_0:build_progress":59,"bucket-1:by_capped_small_0:data_size":1849031093,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":5281566720,"bucket-1:by_capped_small_0:flush_queue_size":0,"bucket-1:by_capped_small_0:frag_percent":64,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":551785187,"bucket-1:by_capped_small_0:items_count":5939551,"bucket-1:by_capped_small_0:num_commits":85,"bucket-1:by_capped_small_0:num_compactions":4,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":11974008,"bucket-1:by_capped_small_0:num_docs_pending":2792237,"bucket-1:by_capped_small_0:num_docs_queued":5233755,"bucket-1:by_capped_small_0:num_flush_queued":11987807,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":85,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":4308996069,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"85 50616831703 652306811470030381","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"11987807 116808697898 -5304733624568375020","bucket-1:by_capped_small_0:timings/storage_handle_open":"85 3772972 204707767224","bucket-1:by_capped_small_0:timings/storage_info":"344 6049987 837963088423","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"89 1990829171 1145211513494650421","bucket-1:by_capped_small_0:timings/storage_meta_set":"86 50233615 34265648343761","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"11998688 277132191437 -5783190910282296171","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5219954,"bucket-1:num_mutations_queued":17207761,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":364,"memory_quota":104857600000,"memory_used":5183602688,"needs_restart":false,"num_connections":0,"timings/stats_response":"2013 350055538 1552007384908476"} 2015-11-29T18:58:53.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 1019 2015-11-29T18:58:53.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 1019 2015-11-29T18:58:53.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 1019 2015-11-29T18:58:53.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 1019 2015-11-29T18:58:53.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 1019 2015-11-29T18:58:53.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 1019 2015-11-29T18:58:53.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 1019 2015-11-29T18:58:53.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 1019 2015-11-29T18:58:53.638-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.029µs CommitTime 685.195475ms TotalFlushTime 6m47.418473821s TotalCommitTime 51.302027178s 2015-11-29T18:58:53.638-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 5999344, 5999344, 86 committed:true 2015-11-29T18:58:53.638-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 5999344, 5999344, 86 committed:true) SnapCreateDur 697.873912ms SnapOpenDur 64.001µs 2015-11-29T18:58:53.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 1019 2015-11-29T18:58:53.666-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:53.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 1019 2015-11-29T18:58:53.692-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:53.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 1019 2015-11-29T18:58:53.703-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 11990000 QueuedCount 15603 2015-11-29T18:58:53.719-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:53.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 1019 2015-11-29T18:58:53.752-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:53.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 1019 2015-11-29T18:58:53.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 1019 2015-11-29T18:58:53.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 1019 2015-11-29T18:58:53.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 1019 2015-11-29T18:58:53.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 1019 2015-11-29T18:58:53.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 1019 2015-11-29T18:58:53.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 1019 2015-11-29T18:58:53.969-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12000000 QueuedCount 50000 2015-11-29T18:58:53.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 1019 2015-11-29T18:58:54.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 1019 2015-11-29T18:58:54.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 1019 2015-11-29T18:58:54.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 1019 2015-11-29T18:58:54.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 1019 2015-11-29T18:58:54.096-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.117-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 1019 2015-11-29T18:58:54.138-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 1019 2015-11-29T18:58:54.16-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 1019 2015-11-29T18:58:54.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.199-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12010000 QueuedCount 48821 2015-11-29T18:58:54.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 1019 2015-11-29T18:58:54.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 1019 2015-11-29T18:58:54.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 1019 2015-11-29T18:58:54.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 1019 2015-11-29T18:58:54.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 1019 2015-11-29T18:58:54.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 1019 2015-11-29T18:58:54.39-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 1019 2015-11-29T18:58:54.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 1019 2015-11-29T18:58:54.425-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:54.44-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12020000 QueuedCount 49219 2015-11-29T18:58:54.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 1019 2015-11-29T18:58:54.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 1019 2015-11-29T18:58:54.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 1019 2015-11-29T18:58:54.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 1019 2015-11-29T18:58:54.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 1019 2015-11-29T18:58:54.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 1019 2015-11-29T18:58:54.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 1019 2015-11-29T18:58:54.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 1019 2015-11-29T18:58:54.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 1019 2015-11-29T18:58:54.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 1019 2015-11-29T18:58:54.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 1019 2015-11-29T18:58:54.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 1019 2015-11-29T18:58:54.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 1019 2015-11-29T18:58:54.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 1019 2015-11-29T18:58:54.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 1019 2015-11-29T18:58:54.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 1019 2015-11-29T18:58:54.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 1019 2015-11-29T18:58:54.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 1019 2015-11-29T18:58:54.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 1019 2015-11-29T18:58:55.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 1019 2015-11-29T18:58:55.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 1019 2015-11-29T18:58:55.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 1019 2015-11-29T18:58:55.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 1019 2015-11-29T18:58:55.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 1019 2015-11-29T18:58:55.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 1019 2015-11-29T18:58:55.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 1019 2015-11-29T18:58:55.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 1019 2015-11-29T18:58:55.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 1019 2015-11-29T18:58:55.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 1019 2015-11-29T18:58:55.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 1019 2015-11-29T18:58:55.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 1019 2015-11-29T18:58:55.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 1019 2015-11-29T18:58:55.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 1019 2015-11-29T18:58:55.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 1019 2015-11-29T18:58:55.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 1019 2015-11-29T18:58:55.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 1019 2015-11-29T18:58:55.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 1019 2015-11-29T18:58:55.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 1019 2015-11-29T18:58:55.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 1019 2015-11-29T18:58:55.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 1019 2015-11-29T18:58:55.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 1019 2015-11-29T18:58:55.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 1019 2015-11-29T18:58:55.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 1019 2015-11-29T18:58:55.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 1019 2015-11-29T18:58:55.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 1019 2015-11-29T18:58:55.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 1019 2015-11-29T18:58:55.827-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12030000 QueuedCount 50000 2015-11-29T18:58:55.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 1019 2015-11-29T18:58:55.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 1019 2015-11-29T18:58:55.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 1019 2015-11-29T18:58:55.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 1019 2015-11-29T18:58:55.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 1019 2015-11-29T18:58:55.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 1019 2015-11-29T18:58:56.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 1019 2015-11-29T18:58:56.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 1019 2015-11-29T18:58:56.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 1019 2015-11-29T18:58:56.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 1019 2015-11-29T18:58:56.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 1019 2015-11-29T18:58:56.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 1019 2015-11-29T18:58:56.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 1019 2015-11-29T18:58:56.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 1019 2015-11-29T18:58:56.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 1019 2015-11-29T18:58:56.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 1019 2015-11-29T18:58:56.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 1019 2015-11-29T18:58:56.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 1019 2015-11-29T18:58:56.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 1019 2015-11-29T18:58:56.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 1019 2015-11-29T18:58:56.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 1019 2015-11-29T18:58:56.439-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12040000 QueuedCount 50000 2015-11-29T18:58:56.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 1019 2015-11-29T18:58:56.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 1019 2015-11-29T18:58:56.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 1019 2015-11-29T18:58:56.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 1019 2015-11-29T18:58:56.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 1019 2015-11-29T18:58:56.607-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:56.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 1019 2015-11-29T18:58:56.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 1019 2015-11-29T18:58:56.665-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12050000 QueuedCount 50000 2015-11-29T18:58:56.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 1019 2015-11-29T18:58:56.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 1019 2015-11-29T18:58:56.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 1019 2015-11-29T18:58:56.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 1019 2015-11-29T18:58:56.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 1019 2015-11-29T18:58:56.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 1019 2015-11-29T18:58:56.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 1019 2015-11-29T18:58:56.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 1019 2015-11-29T18:58:56.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 1019 2015-11-29T18:58:56.912-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12060000 QueuedCount 50000 2015-11-29T18:58:56.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 1019 2015-11-29T18:58:56.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 1019 2015-11-29T18:58:57.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 1019 2015-11-29T18:58:57.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 1019 2015-11-29T18:58:57.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 1019 2015-11-29T18:58:57.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 1019 2015-11-29T18:58:57.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 1019 2015-11-29T18:58:57.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 1019 2015-11-29T18:58:57.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 1019 2015-11-29T18:58:57.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 1019 2015-11-29T18:58:57.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 1019 2015-11-29T18:58:57.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 1019 2015-11-29T18:58:57.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 1019 2015-11-29T18:58:57.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 1019 2015-11-29T18:58:57.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 1019 2015-11-29T18:58:57.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 1019 2015-11-29T18:58:57.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 1019 2015-11-29T18:58:57.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 1019 2015-11-29T18:58:57.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 1019 2015-11-29T18:58:57.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 1019 2015-11-29T18:58:57.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 1019 2015-11-29T18:58:57.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 1019 2015-11-29T18:58:57.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 1019 2015-11-29T18:58:57.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 1019 2015-11-29T18:58:57.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 1019 2015-11-29T18:58:57.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 1019 2015-11-29T18:58:57.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 1019 2015-11-29T18:58:57.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 1019 2015-11-29T18:58:57.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 1019 2015-11-29T18:58:57.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 1019 2015-11-29T18:58:57.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 1019 2015-11-29T18:58:57.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 1019 2015-11-29T18:58:57.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 1019 2015-11-29T18:58:57.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 1019 2015-11-29T18:58:57.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 1019 2015-11-29T18:58:57.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 1019 2015-11-29T18:58:58.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 1019 2015-11-29T18:58:58.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 1019 2015-11-29T18:58:58.059-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12070000 QueuedCount 46458 2015-11-29T18:58:58.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 1019 2015-11-29T18:58:58.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 1019 2015-11-29T18:58:58.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 1019 2015-11-29T18:58:58.166-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12080000 QueuedCount 36458 2015-11-29T18:58:58.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 1019 2015-11-29T18:58:58.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 1019 2015-11-29T18:58:58.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 1019 2015-11-29T18:58:58.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 1019 2015-11-29T18:58:58.277-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12090000 QueuedCount 26458 2015-11-29T18:58:58.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 1019 2015-11-29T18:58:58.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 1019 2015-11-29T18:58:58.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 1019 2015-11-29T18:58:58.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 1019 2015-11-29T18:58:58.392-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12100000 QueuedCount 16458 2015-11-29T18:58:58.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 1019 2015-11-29T18:58:58.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 1019 2015-11-29T18:58:58.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 1019 2015-11-29T18:58:58.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 1019 2015-11-29T18:58:58.509-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12110000 QueuedCount 6458 2015-11-29T18:58:58.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 1019 2015-11-29T18:58:58.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 1019 2015-11-29T18:58:58.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 1019 2015-11-29T18:58:58.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 1019 2015-11-29T18:58:58.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 1019 2015-11-29T18:58:58.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 1019 2015-11-29T18:58:58.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 1019 2015-11-29T18:58:58.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 1019 2015-11-29T18:58:58.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 1019 2015-11-29T18:58:58.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 1019 2015-11-29T18:58:58.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 1019 2015-11-29T18:58:58.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 1019 2015-11-29T18:58:58.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 1019 2015-11-29T18:58:58.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 1019 2015-11-29T18:58:58.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 1019 2015-11-29T18:58:58.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 1019 2015-11-29T18:58:59.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 1019 2015-11-29T18:58:59.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 1019 2015-11-29T18:58:59.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 1019 2015-11-29T18:58:59.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 1019 2015-11-29T18:58:59.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 1019 2015-11-29T18:58:59.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 1019 2015-11-29T18:58:59.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 1019 2015-11-29T18:58:59.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 1019 2015-11-29T18:58:59.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 1019 2015-11-29T18:58:59.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 1019 2015-11-29T18:58:59.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 1019 2015-11-29T18:58:59.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 1019 2015-11-29T18:58:59.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 1019 2015-11-29T18:58:59.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 1019 2015-11-29T18:58:59.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 1019 2015-11-29T18:58:59.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 1019 2015-11-29T18:58:59.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 1019 2015-11-29T18:58:59.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 1019 2015-11-29T18:58:59.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 1019 2015-11-29T18:58:59.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 1019 2015-11-29T18:58:59.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 1019 2015-11-29T18:58:59.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 1019 2015-11-29T18:58:59.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 1019 2015-11-29T18:58:59.685-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.802µs CommitTime 447.586927ms TotalFlushTime 6m52.663657064s TotalCommitTime 51.749614105s 2015-11-29T18:58:59.685-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6063790, 6063790, 87 committed:true 2015-11-29T18:58:59.685-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6063790, 6063790, 87 committed:true) SnapCreateDur 473.769177ms SnapOpenDur 76.913µs 2015-11-29T18:58:59.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 1019 2015-11-29T18:58:59.717-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 1019 2015-11-29T18:58:59.747-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 1019 2015-11-29T18:58:59.769-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.781-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12120000 QueuedCount 29652 2015-11-29T18:58:59.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 1019 2015-11-29T18:58:59.794-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 1019 2015-11-29T18:58:59.821-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.847-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 1019 2015-11-29T18:58:59.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 1019 2015-11-29T18:58:59.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 1019 2015-11-29T18:58:59.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 1019 2015-11-29T18:58:59.943-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:58:59.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 1019 2015-11-29T18:58:59.99-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12130000 QueuedCount 50000 2015-11-29T18:59:00.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 1019 2015-11-29T18:59:00.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 1019 2015-11-29T18:59:00.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 1019 2015-11-29T18:59:00.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 1019 2015-11-29T18:59:00.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 1019 2015-11-29T18:59:00.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 1019 2015-11-29T18:59:00.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 1019 2015-11-29T18:59:00.208-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12140000 QueuedCount 50000 2015-11-29T18:59:00.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 1019 2015-11-29T18:59:00.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:00.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 1019 2015-11-29T18:59:00.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 1019 2015-11-29T18:59:00.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 1019 2015-11-29T18:59:00.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 1019 2015-11-29T18:59:00.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 1019 2015-11-29T18:59:00.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 1019 2015-11-29T18:59:00.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 1019 2015-11-29T18:59:00.428-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12150000 QueuedCount 50000 2015-11-29T18:59:00.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 1019 2015-11-29T18:59:00.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 1019 2015-11-29T18:59:00.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 1019 2015-11-29T18:59:00.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 1019 2015-11-29T18:59:00.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 1019 2015-11-29T18:59:00.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 1019 2015-11-29T18:59:00.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 1019 2015-11-29T18:59:00.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 1019 2015-11-29T18:59:00.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 1019 2015-11-29T18:59:00.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 1019 2015-11-29T18:59:00.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 1019 2015-11-29T18:59:00.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 1019 2015-11-29T18:59:00.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 1019 2015-11-29T18:59:00.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 1019 2015-11-29T18:59:00.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 1019 2015-11-29T18:59:00.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 1019 2015-11-29T18:59:00.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 1019 2015-11-29T18:59:00.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 1019 2015-11-29T18:59:00.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 1019 2015-11-29T18:59:01.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 1019 2015-11-29T18:59:01.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 1019 2015-11-29T18:59:01.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 1019 2015-11-29T18:59:01.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 1019 2015-11-29T18:59:01.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 1019 2015-11-29T18:59:01.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 1019 2015-11-29T18:59:01.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 1019 2015-11-29T18:59:01.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 1019 2015-11-29T18:59:01.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 1019 2015-11-29T18:59:01.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 1019 2015-11-29T18:59:01.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 1019 2015-11-29T18:59:01.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 1019 2015-11-29T18:59:01.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 1019 2015-11-29T18:59:01.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 1019 2015-11-29T18:59:01.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 1019 2015-11-29T18:59:01.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 1019 2015-11-29T18:59:01.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 1019 2015-11-29T18:59:01.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 1019 2015-11-29T18:59:01.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 1019 2015-11-29T18:59:01.575-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12160000 QueuedCount 50000 2015-11-29T18:59:01.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 1019 2015-11-29T18:59:01.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 1019 2015-11-29T18:59:01.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 1019 2015-11-29T18:59:01.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 1019 2015-11-29T18:59:01.695-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12170000 QueuedCount 49999 2015-11-29T18:59:01.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 1019 2015-11-29T18:59:01.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 1019 2015-11-29T18:59:01.757-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:01.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 1019 2015-11-29T18:59:01.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 1019 2015-11-29T18:59:01.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12180000 QueuedCount 50000 2015-11-29T18:59:01.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 1019 2015-11-29T18:59:01.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 1019 2015-11-29T18:59:01.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 1019 2015-11-29T18:59:01.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 1019 2015-11-29T18:59:01.949-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12190000 QueuedCount 50000 2015-11-29T18:59:01.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 1019 2015-11-29T18:59:01.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 1019 2015-11-29T18:59:02.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 1019 2015-11-29T18:59:02.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 1019 2015-11-29T18:59:02.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 1019 2015-11-29T18:59:02.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 1019 2015-11-29T18:59:02.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 1019 2015-11-29T18:59:02.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 1019 2015-11-29T18:59:02.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 1019 2015-11-29T18:59:02.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 1019 2015-11-29T18:59:02.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 1019 2015-11-29T18:59:02.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 1019 2015-11-29T18:59:02.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 1019 2015-11-29T18:59:02.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 1019 2015-11-29T18:59:02.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 1019 2015-11-29T18:59:02.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 1019 2015-11-29T18:59:02.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 1019 2015-11-29T18:59:02.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 1019 2015-11-29T18:59:02.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 1019 2015-11-29T18:59:02.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 1019 2015-11-29T18:59:02.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 1019 2015-11-29T18:59:02.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 1019 2015-11-29T18:59:02.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 1019 2015-11-29T18:59:02.639-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12200000 QueuedCount 43170 2015-11-29T18:59:02.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 1019 2015-11-29T18:59:02.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 1019 2015-11-29T18:59:02.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18480 Milliseconds Vbucket 1019 2015-11-29T18:59:02.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18510 Milliseconds Vbucket 1019 2015-11-29T18:59:02.739-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12210000 QueuedCount 33170 2015-11-29T18:59:02.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18540 Milliseconds Vbucket 1019 2015-11-29T18:59:02.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18570 Milliseconds Vbucket 1019 2015-11-29T18:59:02.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18600 Milliseconds Vbucket 1019 2015-11-29T18:59:02.84-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12220000 QueuedCount 23170 2015-11-29T18:59:02.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18630 Milliseconds Vbucket 1019 2015-11-29T18:59:02.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18660 Milliseconds Vbucket 1019 2015-11-29T18:59:02.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18690 Milliseconds Vbucket 1019 2015-11-29T18:59:02.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18720 Milliseconds Vbucket 1019 2015-11-29T18:59:02.945-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12230000 QueuedCount 13170 2015-11-29T18:59:02.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18750 Milliseconds Vbucket 1019 2015-11-29T18:59:03.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18780 Milliseconds Vbucket 1019 2015-11-29T18:59:03.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18810 Milliseconds Vbucket 1019 2015-11-29T18:59:03.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18840 Milliseconds Vbucket 1019 2015-11-29T18:59:03.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18870 Milliseconds Vbucket 1019 2015-11-29T18:59:03.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18900 Milliseconds Vbucket 1019 2015-11-29T18:59:03.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18930 Milliseconds Vbucket 1019 2015-11-29T18:59:03.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18960 Milliseconds Vbucket 1019 2015-11-29T18:59:03.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18990 Milliseconds Vbucket 1019 2015-11-29T18:59:03.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19020 Milliseconds Vbucket 1019 2015-11-29T18:59:03.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19050 Milliseconds Vbucket 1019 2015-11-29T18:59:03.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19080 Milliseconds Vbucket 1019 2015-11-29T18:59:03.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19110 Milliseconds Vbucket 1019 2015-11-29T18:59:03.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19140 Milliseconds Vbucket 1019 2015-11-29T18:59:03.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19170 Milliseconds Vbucket 1019 2015-11-29T18:59:03.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19200 Milliseconds Vbucket 1019 2015-11-29T18:59:03.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19230 Milliseconds Vbucket 1019 2015-11-29T18:59:03.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19260 Milliseconds Vbucket 1019 2015-11-29T18:59:03.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19290 Milliseconds Vbucket 1019 2015-11-29T18:59:03.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19320 Milliseconds Vbucket 1019 2015-11-29T18:59:03.554-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12240000 QueuedCount 3170 2015-11-29T18:59:03.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19350 Milliseconds Vbucket 1019 2015-11-29T18:59:03.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19380 Milliseconds Vbucket 1019 2015-11-29T18:59:03.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19410 Milliseconds Vbucket 1019 2015-11-29T18:59:03.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19440 Milliseconds Vbucket 1019 2015-11-29T18:59:03.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19470 Milliseconds Vbucket 1019 2015-11-29T18:59:03.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19500 Milliseconds Vbucket 1019 2015-11-29T18:59:03.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19530 Milliseconds Vbucket 1019 2015-11-29T18:59:03.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19560 Milliseconds Vbucket 1019 2015-11-29T18:59:03.81-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.598µs CommitTime 211.491515ms TotalFlushTime 6m56.336931591s TotalCommitTime 51.96110562s 2015-11-29T18:59:03.81-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6127995, 6127995, 88 committed:true 2015-11-29T18:59:03.81-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6127995, 6127995, 88 committed:true) SnapCreateDur 222.360016ms SnapOpenDur 55.134µs 2015-11-29T18:59:03.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19590 Milliseconds Vbucket 1019 2015-11-29T18:59:03.838-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:03.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19620 Milliseconds Vbucket 1019 2015-11-29T18:59:03.866-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:03.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19650 Milliseconds Vbucket 1019 2015-11-29T18:59:03.896-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:03.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17210000 2015-11-29T18:59:03.923-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:03.95-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:03.967-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12250000 QueuedCount 44080 2015-11-29T18:59:03.972-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:04-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17220000 2015-11-29T18:59:04.06-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17230000 2015-11-29T18:59:04.121-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17240000 2015-11-29T18:59:04.171-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12260000 QueuedCount 50000 2015-11-29T18:59:04.176-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:04.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17250000 2015-11-29T18:59:04.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17260000 2015-11-29T18:59:04.321-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17270000 2015-11-29T18:59:04.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:04.367-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12270000 QueuedCount 50000 2015-11-29T18:59:04.387-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17280000 2015-11-29T18:59:04.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17290000 2015-11-29T18:59:04.508-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17300000 2015-11-29T18:59:04.512-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12280000 QueuedCount 50000 2015-11-29T18:59:04.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17310000 2015-11-29T18:59:04.649-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17320000 2015-11-29T18:59:04.732-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17330000 2015-11-29T18:59:04.814-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17340000 2015-11-29T18:59:04.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17350000 2015-11-29T18:59:04.981-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17360000 2015-11-29T18:59:05.065-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17370000 2015-11-29T18:59:05.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17380000 2015-11-29T18:59:05.236-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17390000 2015-11-29T18:59:05.288-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12290000 QueuedCount 50000 2015-11-29T18:59:05.298-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17400000 2015-11-29T18:59:05.359-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17410000 2015-11-29T18:59:05.42-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:05.421-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17420000 2015-11-29T18:59:05.491-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17430000 2015-11-29T18:59:05.492-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12300000 QueuedCount 50000 2015-11-29T18:59:05.556-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17440000 2015-11-29T18:59:05.732-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12310000 QueuedCount 50000 2015-11-29T18:59:06.013-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12320000 QueuedCount 50000 2015-11-29T18:59:06.028-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:06.102-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:06.998-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12330000 QueuedCount 50000 2015-11-29T18:59:07.002-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:07.096-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12340000 QueuedCount 41208 2015-11-29T18:59:07.199-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12350000 QueuedCount 31208 2015-11-29T18:59:07.295-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12360000 QueuedCount 21208 2015-11-29T18:59:07.888-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12370000 QueuedCount 11208 2015-11-29T18:59:07.97-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12380000 QueuedCount 1208 2015-11-29T18:59:08.637-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 15.147µs CommitTime 627.410598ms TotalFlushTime 7m0.252028636s TotalCommitTime 52.588516218s 2015-11-29T18:59:08.637-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6196500, 6196500, 89 committed:true 2015-11-29T18:59:08.637-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6196500, 6196500, 89 committed:true) SnapCreateDur 653.541766ms SnapOpenDur 94.809µs 2015-11-29T18:59:08.66-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.685-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.711-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.737-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.762-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.786-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.817-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:08.819-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12390000 QueuedCount 39438 2015-11-29T18:59:08.843-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:09.025-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12400000 QueuedCount 50000 2015-11-29T18:59:09.242-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12410000 QueuedCount 50000 2015-11-29T18:59:09.478-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12420000 QueuedCount 50000 2015-11-29T18:59:09.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:10.462-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12430000 QueuedCount 50000 2015-11-29T18:59:10.582-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 807 2015-11-29T18:59:10.612-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 807 2015-11-29T18:59:10.626-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12440000 QueuedCount 50000 2015-11-29T18:59:10.642-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 807 2015-11-29T18:59:10.672-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 807 2015-11-29T18:59:10.702-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 807 2015-11-29T18:59:10.732-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 807 2015-11-29T18:59:10.762-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 807 2015-11-29T18:59:10.792-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 807 2015-11-29T18:59:10.82-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12450000 QueuedCount 50000 2015-11-29T18:59:10.822-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 807 2015-11-29T18:59:10.835-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:10.852-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 807 2015-11-29T18:59:10.882-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 807 2015-11-29T18:59:10.912-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 807 2015-11-29T18:59:10.942-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 807 2015-11-29T18:59:10.972-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 807 2015-11-29T18:59:11.002-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 807 2015-11-29T18:59:11.032-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 807 2015-11-29T18:59:11.042-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12460000 QueuedCount 50000 2015-11-29T18:59:11.062-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 807 2015-11-29T18:59:11.092-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 807 2015-11-29T18:59:11.122-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 807 2015-11-29T18:59:11.152-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 807 2015-11-29T18:59:11.182-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 807 2015-11-29T18:59:11.212-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 807 2015-11-29T18:59:11.242-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 807 2015-11-29T18:59:11.272-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 807 2015-11-29T18:59:11.302-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 807 2015-11-29T18:59:11.332-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 807 2015-11-29T18:59:11.362-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 807 2015-11-29T18:59:11.392-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 807 2015-11-29T18:59:11.422-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 807 2015-11-29T18:59:11.452-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 807 2015-11-29T18:59:11.482-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 807 2015-11-29T18:59:11.512-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 807 2015-11-29T18:59:11.542-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 807 2015-11-29T18:59:11.572-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 807 2015-11-29T18:59:11.602-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 807 2015-11-29T18:59:11.632-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 807 2015-11-29T18:59:11.662-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 807 2015-11-29T18:59:11.692-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 807 2015-11-29T18:59:11.722-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 807 2015-11-29T18:59:11.752-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 807 2015-11-29T18:59:11.782-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 807 2015-11-29T18:59:11.812-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 807 2015-11-29T18:59:11.842-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 807 2015-11-29T18:59:11.872-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 807 2015-11-29T18:59:11.902-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 807 2015-11-29T18:59:11.932-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 807 2015-11-29T18:59:11.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 807 2015-11-29T18:59:11.992-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 807 2015-11-29T18:59:12.022-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 807 2015-11-29T18:59:12.052-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 807 2015-11-29T18:59:12.082-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 807 2015-11-29T18:59:12.112-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 807 2015-11-29T18:59:12.142-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 807 2015-11-29T18:59:12.172-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 807 2015-11-29T18:59:12.181-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:12.197-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12470000 QueuedCount 49123 2015-11-29T18:59:12.202-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 807 2015-11-29T18:59:12.232-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 807 2015-11-29T18:59:12.262-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 807 2015-11-29T18:59:12.292-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 807 2015-11-29T18:59:12.322-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 807 2015-11-29T18:59:12.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 807 2015-11-29T18:59:12.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 807 2015-11-29T18:59:12.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 807 2015-11-29T18:59:12.426-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12480000 QueuedCount 49397 2015-11-29T18:59:12.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 807 2015-11-29T18:59:12.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 807 2015-11-29T18:59:12.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 807 2015-11-29T18:59:12.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 807 2015-11-29T18:59:12.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 807 2015-11-29T18:59:12.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 807 2015-11-29T18:59:12.619-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12490000 QueuedCount 39397 2015-11-29T18:59:12.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 807 2015-11-29T18:59:12.652-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 807 2015-11-29T18:59:12.682-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 807 2015-11-29T18:59:12.712-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 807 2015-11-29T18:59:12.742-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 807 2015-11-29T18:59:12.772-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 807 2015-11-29T18:59:12.802-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 807 2015-11-29T18:59:12.819-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12500000 QueuedCount 29397 2015-11-29T18:59:12.832-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 807 2015-11-29T18:59:12.862-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 807 2015-11-29T18:59:12.892-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 807 2015-11-29T18:59:12.922-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 807 2015-11-29T18:59:12.952-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 807 2015-11-29T18:59:12.982-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 807 2015-11-29T18:59:13.012-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 807 2015-11-29T18:59:13.042-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 807 2015-11-29T18:59:13.072-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 807 2015-11-29T18:59:13.102-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 807 2015-11-29T18:59:13.132-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 807 2015-11-29T18:59:13.162-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 807 2015-11-29T18:59:13.192-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 807 2015-11-29T18:59:13.222-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 807 2015-11-29T18:59:13.252-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 807 2015-11-29T18:59:13.282-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 807 2015-11-29T18:59:13.312-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 807 2015-11-29T18:59:13.342-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 807 2015-11-29T18:59:13.372-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 807 2015-11-29T18:59:13.402-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 807 2015-11-29T18:59:13.432-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 807 2015-11-29T18:59:13.462-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 807 2015-11-29T18:59:13.492-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 807 2015-11-29T18:59:13.522-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 807 2015-11-29T18:59:13.552-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 807 2015-11-29T18:59:13.582-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 807 2015-11-29T18:59:13.587-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12510000 QueuedCount 19397 2015-11-29T18:59:13.612-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 807 2015-11-29T18:59:13.642-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 807 2015-11-29T18:59:13.672-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 807 2015-11-29T18:59:13.685-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12520000 QueuedCount 9397 2015-11-29T18:59:13.702-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 807 2015-11-29T18:59:13.732-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 807 2015-11-29T18:59:13.762-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 807 2015-11-29T18:59:13.792-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 807 2015-11-29T18:59:13.822-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 807 2015-11-29T18:59:13.852-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 807 2015-11-29T18:59:13.882-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 807 2015-11-29T18:59:13.912-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 807 2015-11-29T18:59:13.942-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 807 2015-11-29T18:59:13.972-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 807 2015-11-29T18:59:14.002-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 807 2015-11-29T18:59:14.032-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 807 2015-11-29T18:59:14.062-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 807 2015-11-29T18:59:14.092-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 807 2015-11-29T18:59:14.122-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 807 2015-11-29T18:59:14.152-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 807 2015-11-29T18:59:14.182-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 807 2015-11-29T18:59:14.212-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 807 2015-11-29T18:59:14.242-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 807 2015-11-29T18:59:14.272-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 807 2015-11-29T18:59:14.302-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 807 2015-11-29T18:59:14.302-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.928µs CommitTime 505.072587ms TotalFlushTime 7m5.029876593s TotalCommitTime 53.093588805s 2015-11-29T18:59:14.302-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6270261, 6270261, 90 committed:true 2015-11-29T18:59:14.302-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6270261, 6270261, 90 committed:true) SnapCreateDur 517.729883ms SnapOpenDur 44.286µs 2015-11-29T18:59:14.326-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.332-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 807 2015-11-29T18:59:14.335-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12530000 QueuedCount 3957 2015-11-29T18:59:14.35-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.362-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 807 2015-11-29T18:59:14.376-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.392-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 807 2015-11-29T18:59:14.401-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.422-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 807 2015-11-29T18:59:14.426-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.452-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 807 2015-11-29T18:59:14.454-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:14.53-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17450000 2015-11-29T18:59:14.55-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12540000 QueuedCount 50000 2015-11-29T18:59:14.587-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17460000 2015-11-29T18:59:14.645-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17470000 2015-11-29T18:59:14.755-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12550000 QueuedCount 50000 2015-11-29T18:59:14.775-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:15.456-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17480000 2015-11-29T18:59:16.553-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12560000 QueuedCount 50000 2015-11-29T18:59:16.664-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17490000 2015-11-29T18:59:16.79-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12570000 QueuedCount 50000 2015-11-29T18:59:19.247-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:19.484-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12580000 QueuedCount 50000 2015-11-29T18:59:19.687-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12590000 QueuedCount 44572 2015-11-29T18:59:19.882-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12600000 QueuedCount 34572 2015-11-29T18:59:20.081-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12610000 QueuedCount 24572 2015-11-29T18:59:20.971-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12620000 QueuedCount 14572 2015-11-29T18:59:21.073-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12630000 QueuedCount 4572 2015-11-29T18:59:21.627-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.643µs CommitTime 492.438167ms TotalFlushTime 7m11.631162809s TotalCommitTime 53.586026972s 2015-11-29T18:59:21.627-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6322338, 6322338, 91 committed:true 2015-11-29T18:59:21.627-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6322338, 6322338, 91 committed:true) SnapCreateDur 505.381031ms SnapOpenDur 55.141µs 2015-11-29T18:59:21.65-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.673-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.697-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.713-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12640000 QueuedCount 5456 2015-11-29T18:59:21.727-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.776-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.806-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17500000 2015-11-29T18:59:21.823-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12650000 QueuedCount 50000 2015-11-29T18:59:21.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:21.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17510000 2015-11-29T18:59:21.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17520000 2015-11-29T18:59:21.936-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12660000 QueuedCount 50000 2015-11-29T18:59:22.019-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17530000 2015-11-29T18:59:22.056-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12670000 QueuedCount 50000 2015-11-29T18:59:22.079-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:22.748-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12680000 QueuedCount 50000 2015-11-29T18:59:22.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17540000 2015-11-29T18:59:22.778-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:22.8-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:22.842-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17550000 2015-11-29T18:59:22.848-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12690000 QueuedCount 50000 2015-11-29T18:59:22.861-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:22.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17560000 2015-11-29T18:59:22.939-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:22.943-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12700000 QueuedCount 49499 2015-11-29T18:59:23.139-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12710000 QueuedCount 50000 2015-11-29T18:59:23.23-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:24.281-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12720000 QueuedCount 50000 2015-11-29T18:59:24.503-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12730000 QueuedCount 50000 2015-11-29T18:59:24.506-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:24.704-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12740000 QueuedCount 41234 2015-11-29T18:59:24.909-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12750000 QueuedCount 31234 2015-11-29T18:59:25.688-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12760000 QueuedCount 21234 2015-11-29T18:59:25.787-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12770000 QueuedCount 11234 2015-11-29T18:59:25.894-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12780000 QueuedCount 1234 2015-11-29T18:59:26.722-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 10.943µs CommitTime 786.862725ms TotalFlushTime 7m15.678400379s TotalCommitTime 54.372889697s 2015-11-29T18:59:26.722-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6395204, 6395204, 92 committed:true 2015-11-29T18:59:26.722-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6395204, 6395204, 92 committed:true) SnapCreateDur 813.806703ms SnapOpenDur 64.552µs 2015-11-29T18:59:26.75-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:26.773-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:26.795-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:26.838-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:26.86-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12790000 QueuedCount 36368 2015-11-29T18:59:26.957-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17570000 2015-11-29T18:59:27.016-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17580000 2015-11-29T18:59:27.062-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12800000 QueuedCount 50000 2015-11-29T18:59:27.072-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17590000 2015-11-29T18:59:27.127-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:27.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17600000 2015-11-29T18:59:27.279-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12810000 QueuedCount 50000 2015-11-29T18:59:27.315-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17610000 2015-11-29T18:59:27.371-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:27.392-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:27.413-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:27.434-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:27.49-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12820000 QueuedCount 50000 2015-11-29T18:59:27.531-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:28.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17620000 2015-11-29T18:59:28.508-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12830000 QueuedCount 50000 2015-11-29T18:59:28.544-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:28.637-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17630000 2015-11-29T18:59:28.666-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12840000 QueuedCount 50000 2015-11-29T18:59:28.692-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:28.806-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:28.886-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12850000 QueuedCount 50000 2015-11-29T18:59:28.91-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17640000 2015-11-29T18:59:28.915-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:29.11-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:29.116-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12860000 QueuedCount 49711 2015-11-29T18:59:29.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:30.031-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:30.092-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12870000 QueuedCount 50000 2015-11-29T18:59:30.115-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17650000 2015-11-29T18:59:30.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17660000 2015-11-29T18:59:30.205-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12880000 QueuedCount 50000 2015-11-29T18:59:30.319-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12890000 QueuedCount 50000 2015-11-29T18:59:30.49-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12900000 QueuedCount 45094 2015-11-29T18:59:31.491-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12910000 QueuedCount 35094 2015-11-29T18:59:31.595-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12920000 QueuedCount 25094 2015-11-29T18:59:31.706-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12930000 QueuedCount 15094 2015-11-29T18:59:31.818-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12940000 QueuedCount 5094 2015-11-29T18:59:32.607-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.118µs CommitTime 716.382669ms TotalFlushTime 7m20.541788549s TotalCommitTime 55.089272366s 2015-11-29T18:59:32.607-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6475909, 6475909, 93 committed:true 2015-11-29T18:59:32.607-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6475909, 6475909, 93 committed:true) SnapCreateDur 729.036509ms SnapOpenDur 36.899µs 2015-11-29T18:59:32.651-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:32.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17670000 2015-11-29T18:59:32.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17680000 2015-11-29T18:59:32.737-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12950000 QueuedCount 50000 2015-11-29T18:59:32.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17690000 2015-11-29T18:59:32.801-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:32.846-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17700000 2015-11-29T18:59:32.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12960000 QueuedCount 50000 2015-11-29T18:59:33.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:33.056-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:33.156-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17710000 2015-11-29T18:59:33.24-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12970000 QueuedCount 50000 2015-11-29T18:59:33.363-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17720000 2015-11-29T18:59:33.481-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12980000 QueuedCount 50000 2015-11-29T18:59:33.578-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:35.709-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 12990000 QueuedCount 50000 2015-11-29T18:59:36.529-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:36.72-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13000000 QueuedCount 50000 2015-11-29T18:59:36.932-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13010000 QueuedCount 40102 2015-11-29T18:59:37.139-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13020000 QueuedCount 30102 2015-11-29T18:59:38.071-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13030000 QueuedCount 20102 2015-11-29T18:59:38.171-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13040000 QueuedCount 10102 2015-11-29T18:59:38.276-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13050000 QueuedCount 102 2015-11-29T18:59:38.57-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 163 2015-11-29T18:59:38.6-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 163 2015-11-29T18:59:38.63-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 163 2015-11-29T18:59:38.66-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 163 2015-11-29T18:59:38.69-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 163 2015-11-29T18:59:38.72-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 163 2015-11-29T18:59:38.75-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 163 2015-11-29T18:59:38.78-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 163 2015-11-29T18:59:38.81-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 163 2015-11-29T18:59:38.84-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 163 2015-11-29T18:59:38.87-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 163 2015-11-29T18:59:38.9-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 163 2015-11-29T18:59:38.93-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 163 2015-11-29T18:59:38.96-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 163 2015-11-29T18:59:38.99-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 163 2015-11-29T18:59:39.02-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 163 2015-11-29T18:59:39.05-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 163 2015-11-29T18:59:39.08-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 163 2015-11-29T18:59:39.11-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 163 2015-11-29T18:59:39.14-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 163 2015-11-29T18:59:39.163-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 18.27µs CommitTime 853.758339ms TotalFlushTime 7m25.978841816s TotalCommitTime 55.943030705s 2015-11-29T18:59:39.163-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6528089, 6528089, 94 committed:true 2015-11-29T18:59:39.163-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6528089, 6528089, 94 committed:true) SnapCreateDur 880.000518ms SnapOpenDur 53.884µs 2015-11-29T18:59:39.17-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 163 2015-11-29T18:59:39.187-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.2-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 163 2015-11-29T18:59:39.214-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.23-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 163 2015-11-29T18:59:39.243-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.26-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 163 2015-11-29T18:59:39.27-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.29-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 163 2015-11-29T18:59:39.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.313-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.32-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 163 2015-11-29T18:59:39.35-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 163 2015-11-29T18:59:39.369-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:39.38-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13060000 QueuedCount 49407 2015-11-29T18:59:39.38-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 163 2015-11-29T18:59:39.41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 163 2015-11-29T18:59:39.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 163 2015-11-29T18:59:39.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 163 2015-11-29T18:59:39.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 163 2015-11-29T18:59:39.53-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 163 2015-11-29T18:59:39.56-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 163 2015-11-29T18:59:39.59-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 163 2015-11-29T18:59:39.598-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13070000 QueuedCount 50000 2015-11-29T18:59:39.62-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 163 2015-11-29T18:59:39.65-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 163 2015-11-29T18:59:39.68-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 163 2015-11-29T18:59:39.71-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 163 2015-11-29T18:59:39.74-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 163 2015-11-29T18:59:39.77-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 163 2015-11-29T18:59:39.8-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 163 2015-11-29T18:59:39.825-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13080000 QueuedCount 50000 2015-11-29T18:59:39.83-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 163 2015-11-29T18:59:39.86-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 163 2015-11-29T18:59:39.89-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 163 2015-11-29T18:59:39.92-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 163 2015-11-29T18:59:39.95-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 163 2015-11-29T18:59:39.98-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 163 2015-11-29T18:59:40.01-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 163 2015-11-29T18:59:40.04-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 163 2015-11-29T18:59:40.051-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13090000 QueuedCount 50000 2015-11-29T18:59:40.07-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 163 2015-11-29T18:59:40.1-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 163 2015-11-29T18:59:40.13-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 163 2015-11-29T18:59:40.16-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 163 2015-11-29T18:59:40.19-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 163 2015-11-29T18:59:40.22-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 163 2015-11-29T18:59:40.25-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 163 2015-11-29T18:59:40.28-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 163 2015-11-29T18:59:40.31-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 163 2015-11-29T18:59:40.34-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 163 2015-11-29T18:59:40.37-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 163 2015-11-29T18:59:40.4-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 163 2015-11-29T18:59:40.43-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 163 2015-11-29T18:59:40.46-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 163 2015-11-29T18:59:40.49-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 163 2015-11-29T18:59:40.52-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 163 2015-11-29T18:59:40.55-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 163 2015-11-29T18:59:40.58-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 163 2015-11-29T18:59:40.61-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 163 2015-11-29T18:59:40.64-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 163 2015-11-29T18:59:40.67-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 163 2015-11-29T18:59:40.7-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 163 2015-11-29T18:59:40.73-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 163 2015-11-29T18:59:40.76-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 163 2015-11-29T18:59:40.79-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 163 2015-11-29T18:59:40.82-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 163 2015-11-29T18:59:40.85-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 163 2015-11-29T18:59:40.88-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 163 2015-11-29T18:59:40.91-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 163 2015-11-29T18:59:40.94-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 163 2015-11-29T18:59:40.97-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 163 2015-11-29T18:59:41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 163 2015-11-29T18:59:41.03-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 163 2015-11-29T18:59:41.06-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 163 2015-11-29T18:59:41.09-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 163 2015-11-29T18:59:41.12-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 163 2015-11-29T18:59:41.15-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 163 2015-11-29T18:59:41.18-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 163 2015-11-29T18:59:41.186-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:41.21-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 163 2015-11-29T18:59:41.24-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 163 2015-11-29T18:59:41.27-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 163 2015-11-29T18:59:41.282-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13100000 QueuedCount 50000 2015-11-29T18:59:41.3-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 163 2015-11-29T18:59:41.33-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 163 2015-11-29T18:59:41.36-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 163 2015-11-29T18:59:41.39-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 163 2015-11-29T18:59:41.406-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:41.419-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13110000 QueuedCount 48981 2015-11-29T18:59:41.42-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 163 2015-11-29T18:59:41.45-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 163 2015-11-29T18:59:41.48-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 163 2015-11-29T18:59:41.51-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 163 2015-11-29T18:59:41.54-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 163 2015-11-29T18:59:41.57-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 163 2015-11-29T18:59:41.6-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 163 2015-11-29T18:59:41.63-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 163 2015-11-29T18:59:41.66-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 163 2015-11-29T18:59:41.69-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 163 2015-11-29T18:59:41.72-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 163 2015-11-29T18:59:41.75-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 163 2015-11-29T18:59:41.78-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 163 2015-11-29T18:59:41.81-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 163 2015-11-29T18:59:41.84-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 163 2015-11-29T18:59:41.87-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 163 2015-11-29T18:59:41.9-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 163 2015-11-29T18:59:41.93-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 163 2015-11-29T18:59:41.96-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 163 2015-11-29T18:59:41.99-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 163 2015-11-29T18:59:42.02-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 163 2015-11-29T18:59:42.05-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 163 2015-11-29T18:59:42.08-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 163 2015-11-29T18:59:42.11-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 163 2015-11-29T18:59:42.14-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 163 2015-11-29T18:59:42.17-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 163 2015-11-29T18:59:42.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 163 2015-11-29T18:59:42.23-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 163 2015-11-29T18:59:42.26-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 163 2015-11-29T18:59:42.29-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 163 2015-11-29T18:59:42.32-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 163 2015-11-29T18:59:42.35-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 163 2015-11-29T18:59:42.38-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 163 2015-11-29T18:59:42.41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 163 2015-11-29T18:59:42.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 163 2015-11-29T18:59:42.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 163 2015-11-29T18:59:42.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 163 2015-11-29T18:59:42.53-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 163 2015-11-29T18:59:42.56-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 163 2015-11-29T18:59:42.59-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 163 2015-11-29T18:59:42.62-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 163 2015-11-29T18:59:42.65-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 163 2015-11-29T18:59:42.68-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 163 2015-11-29T18:59:42.71-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 163 2015-11-29T18:59:42.74-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 163 2015-11-29T18:59:42.77-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 163 2015-11-29T18:59:42.8-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 163 2015-11-29T18:59:42.83-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 163 2015-11-29T18:59:42.86-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 163 2015-11-29T18:59:42.89-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 163 2015-11-29T18:59:42.92-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 163 2015-11-29T18:59:42.95-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 163 2015-11-29T18:59:42.98-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 163 2015-11-29T18:59:43.01-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 163 2015-11-29T18:59:43.04-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 163 2015-11-29T18:59:43.07-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 163 2015-11-29T18:59:43.1-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 163 2015-11-29T18:59:43.13-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 163 2015-11-29T18:59:43.16-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 163 2015-11-29T18:59:43.19-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 163 2015-11-29T18:59:43.22-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 163 2015-11-29T18:59:43.25-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 163 2015-11-29T18:59:43.258-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13120000 QueuedCount 50000 2015-11-29T18:59:43.28-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 163 2015-11-29T18:59:43.31-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 163 2015-11-29T18:59:43.34-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 163 2015-11-29T18:59:43.37-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 163 2015-11-29T18:59:43.4-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 163 2015-11-29T18:59:43.43-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 163 2015-11-29T18:59:43.46-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 163 2015-11-29T18:59:43.49-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 163 2015-11-29T18:59:43.501-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13130000 QueuedCount 50000 2015-11-29T18:59:43.52-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 163 2015-11-29T18:59:43.55-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 163 2015-11-29T18:59:43.58-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 163 2015-11-29T18:59:43.61-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 163 2015-11-29T18:59:43.64-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 163 2015-11-29T18:59:43.67-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 163 2015-11-29T18:59:43.7-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 163 2015-11-29T18:59:43.73-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 163 2015-11-29T18:59:43.76-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 163 2015-11-29T18:59:43.79-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 163 2015-11-29T18:59:43.82-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 163 2015-11-29T18:59:43.85-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 163 2015-11-29T18:59:43.88-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 163 2015-11-29T18:59:43.91-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 163 2015-11-29T18:59:43.94-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 163 2015-11-29T18:59:43.97-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 163 2015-11-29T18:59:44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 163 2015-11-29T18:59:44.03-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 163 2015-11-29T18:59:44.06-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 163 2015-11-29T18:59:44.09-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 163 2015-11-29T18:59:44.12-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 163 2015-11-29T18:59:44.15-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 163 2015-11-29T18:59:44.18-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 163 2015-11-29T18:59:44.21-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 163 2015-11-29T18:59:44.24-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 163 2015-11-29T18:59:44.27-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 163 2015-11-29T18:59:44.3-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 163 2015-11-29T18:59:44.33-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 163 2015-11-29T18:59:44.36-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 163 2015-11-29T18:59:44.39-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 163 2015-11-29T18:59:44.42-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 163 2015-11-29T18:59:44.45-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 163 2015-11-29T18:59:44.48-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 163 2015-11-29T18:59:44.51-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 163 2015-11-29T18:59:44.54-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 163 2015-11-29T18:59:44.555-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:44.57-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 163 2015-11-29T18:59:44.6-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 163 2015-11-29T18:59:44.63-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 163 2015-11-29T18:59:44.647-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13140000 QueuedCount 50000 2015-11-29T18:59:44.66-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 163 2015-11-29T18:59:44.69-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 163 2015-11-29T18:59:44.72-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 163 2015-11-29T18:59:44.75-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 163 2015-11-29T18:59:44.775-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13150000 QueuedCount 50000 2015-11-29T18:59:44.78-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 163 2015-11-29T18:59:44.81-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 163 2015-11-29T18:59:44.84-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 163 2015-11-29T18:59:44.87-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 163 2015-11-29T18:59:44.899-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13160000 QueuedCount 46456 2015-11-29T18:59:44.9-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 163 2015-11-29T18:59:44.93-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 163 2015-11-29T18:59:44.96-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 163 2015-11-29T18:59:44.99-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 163 2015-11-29T18:59:45.014-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13170000 QueuedCount 36456 2015-11-29T18:59:45.02-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 163 2015-11-29T18:59:45.05-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 163 2015-11-29T18:59:45.08-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 163 2015-11-29T18:59:45.11-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 163 2015-11-29T18:59:45.14-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 163 2015-11-29T18:59:45.17-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 163 2015-11-29T18:59:45.2-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 163 2015-11-29T18:59:45.23-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 163 2015-11-29T18:59:45.26-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 163 2015-11-29T18:59:45.29-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 163 2015-11-29T18:59:45.32-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 163 2015-11-29T18:59:45.35-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 163 2015-11-29T18:59:45.38-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 163 2015-11-29T18:59:45.41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 163 2015-11-29T18:59:45.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 163 2015-11-29T18:59:45.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 163 2015-11-29T18:59:45.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 163 2015-11-29T18:59:45.53-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 163 2015-11-29T18:59:45.56-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 163 2015-11-29T18:59:45.59-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 163 2015-11-29T18:59:45.62-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 163 2015-11-29T18:59:45.65-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 163 2015-11-29T18:59:45.68-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 163 2015-11-29T18:59:45.71-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 163 2015-11-29T18:59:45.74-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 163 2015-11-29T18:59:45.761-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13180000 QueuedCount 26456 2015-11-29T18:59:45.77-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 163 2015-11-29T18:59:45.8-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 163 2015-11-29T18:59:45.83-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 163 2015-11-29T18:59:45.86-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 163 2015-11-29T18:59:45.869-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13190000 QueuedCount 16456 2015-11-29T18:59:45.89-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 163 2015-11-29T18:59:45.92-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 163 2015-11-29T18:59:45.95-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 163 2015-11-29T18:59:45.963-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13200000 QueuedCount 6456 2015-11-29T18:59:45.98-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 163 2015-11-29T18:59:46.01-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 163 2015-11-29T18:59:46.04-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 163 2015-11-29T18:59:46.07-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 163 2015-11-29T18:59:46.1-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 163 2015-11-29T18:59:46.13-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 163 2015-11-29T18:59:46.16-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 163 2015-11-29T18:59:46.19-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 163 2015-11-29T18:59:46.22-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 163 2015-11-29T18:59:46.25-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 163 2015-11-29T18:59:46.28-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 163 2015-11-29T18:59:46.31-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 163 2015-11-29T18:59:46.34-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 163 2015-11-29T18:59:46.37-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 163 2015-11-29T18:59:46.4-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 163 2015-11-29T18:59:46.43-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 163 2015-11-29T18:59:46.46-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 163 2015-11-29T18:59:46.49-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 163 2015-11-29T18:59:46.52-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 163 2015-11-29T18:59:46.55-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 163 2015-11-29T18:59:46.58-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 163 2015-11-29T18:59:46.61-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 163 2015-11-29T18:59:46.64-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 163 2015-11-29T18:59:46.67-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 163 2015-11-29T18:59:46.686-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.64µs CommitTime 647.337389ms TotalFlushTime 7m32.521915684s TotalCommitTime 56.590368094s 2015-11-29T18:59:46.686-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6606390, 6606390, 95 committed:true 2015-11-29T18:59:46.686-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6606390, 6606390, 95 committed:true) SnapCreateDur 657.985173ms SnapOpenDur 38.092µs 2015-11-29T18:59:46.7-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 163 2015-11-29T18:59:46.722-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:46.73-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 163 2015-11-29T18:59:46.758-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:46.76-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 163 2015-11-29T18:59:46.778-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13210000 QueuedCount 34388 2015-11-29T18:59:46.79-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 163 2015-11-29T18:59:46.791-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:46.82-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 163 2015-11-29T18:59:46.85-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 163 2015-11-29T18:59:46.88-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 163 2015-11-29T18:59:46.91-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 163 2015-11-29T18:59:46.94-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 163 2015-11-29T18:59:46.963-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:46.97-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 163 2015-11-29T18:59:46.991-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13220000 QueuedCount 50000 2015-11-29T18:59:47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 163 2015-11-29T18:59:47.03-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 163 2015-11-29T18:59:47.06-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 163 2015-11-29T18:59:47.09-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 163 2015-11-29T18:59:47.097-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:47.12-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 163 2015-11-29T18:59:47.15-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 163 2015-11-29T18:59:47.18-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 163 2015-11-29T18:59:47.21-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 163 2015-11-29T18:59:47.214-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13230000 QueuedCount 50000 2015-11-29T18:59:47.24-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 163 2015-11-29T18:59:47.27-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 163 2015-11-29T18:59:47.3-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 163 2015-11-29T18:59:47.33-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 163 2015-11-29T18:59:47.36-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 163 2015-11-29T18:59:47.39-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 163 2015-11-29T18:59:47.42-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 163 2015-11-29T18:59:47.449-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13240000 QueuedCount 50000 2015-11-29T18:59:47.45-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 163 2015-11-29T18:59:47.48-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 163 2015-11-29T18:59:47.51-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 163 2015-11-29T18:59:47.54-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 163 2015-11-29T18:59:47.57-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 163 2015-11-29T18:59:47.6-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 163 2015-11-29T18:59:47.63-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 163 2015-11-29T18:59:47.66-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 163 2015-11-29T18:59:47.69-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 163 2015-11-29T18:59:47.72-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 163 2015-11-29T18:59:47.75-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 163 2015-11-29T18:59:47.78-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 163 2015-11-29T18:59:47.81-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 163 2015-11-29T18:59:47.84-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 163 2015-11-29T18:59:47.87-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 163 2015-11-29T18:59:47.9-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 163 2015-11-29T18:59:47.93-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 163 2015-11-29T18:59:47.96-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 163 2015-11-29T18:59:47.99-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 163 2015-11-29T18:59:48.02-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 163 2015-11-29T18:59:48.05-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 163 2015-11-29T18:59:48.08-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 163 2015-11-29T18:59:48.11-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 163 2015-11-29T18:59:48.14-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 163 2015-11-29T18:59:48.17-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 163 2015-11-29T18:59:48.2-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 163 2015-11-29T18:59:48.23-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 163 2015-11-29T18:59:48.26-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 163 2015-11-29T18:59:48.29-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 163 2015-11-29T18:59:48.32-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 163 2015-11-29T18:59:48.35-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 163 2015-11-29T18:59:48.38-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 163 2015-11-29T18:59:48.41-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 163 2015-11-29T18:59:48.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 163 2015-11-29T18:59:48.47-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 163 2015-11-29T18:59:48.487-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:48.5-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 163 2015-11-29T18:59:48.503-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13250000 QueuedCount 48415 2015-11-29T18:59:48.539-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17730000 2015-11-29T18:59:48.641-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13260000 QueuedCount 50000 2015-11-29T18:59:48.653-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17740000 2015-11-29T18:59:48.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:48.767-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13270000 QueuedCount 48493 2015-11-29T18:59:48.829-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17750000 2015-11-29T18:59:48.892-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13280000 QueuedCount 50000 2015-11-29T18:59:48.948-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17760000 2015-11-29T18:59:48.974-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:49.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17770000 2015-11-29T18:59:49.6-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13290000 QueuedCount 50000 2015-11-29T18:59:49.677-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17780000 2015-11-29T18:59:49.697-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13300000 QueuedCount 50000 2015-11-29T18:59:49.73-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:49.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17790000 2015-11-29T18:59:49.797-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17800000 2015-11-29T18:59:49.798-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13310000 QueuedCount 50000 2015-11-29T18:59:49.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17810000 2015-11-29T18:59:49.902-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13320000 QueuedCount 50000 2015-11-29T18:59:49.912-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17820000 2015-11-29T18:59:49.987-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17830000 2015-11-29T18:59:50.012-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13330000 QueuedCount 40512 2015-11-29T18:59:50.059-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17840000 2015-11-29T18:59:50.131-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17850000 2015-11-29T18:59:50.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17860000 2015-11-29T18:59:50.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17870000 2015-11-29T18:59:50.699-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13340000 QueuedCount 30512 2015-11-29T18:59:50.791-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13350000 QueuedCount 20512 2015-11-29T18:59:50.889-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13360000 QueuedCount 10512 2015-11-29T18:59:50.987-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13370000 QueuedCount 512 2015-11-29T18:59:51.772-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.05µs CommitTime 762.896093ms TotalFlushTime 7m36.558909143s TotalCommitTime 57.353264187s 2015-11-29T18:59:51.772-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6687753, 6687753, 96 committed:true 2015-11-29T18:59:51.772-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6687753, 6687753, 96 committed:true) SnapCreateDur 773.586078ms SnapOpenDur 40.947µs 2015-11-29T18:59:51.803-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:51.835-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:51.866-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:51.908-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17880000 2015-11-29T18:59:51.97-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17890000 2015-11-29T18:59:51.992-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13380000 QueuedCount 50000 2015-11-29T18:59:52.109-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:52.21-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13390000 QueuedCount 50000 2015-11-29T18:59:52.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17900000 2015-11-29T18:59:52.327-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:52.39-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17910000 2015-11-29T18:59:52.437-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13400000 QueuedCount 50000 2015-11-29T18:59:52.445-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17920000 2015-11-29T18:59:52.657-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13410000 QueuedCount 50000 2015-11-29T18:59:53.388-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5966871966,"bucket-1:by_capped_small_0:avg_ts_items_count":152902,"bucket-1:by_capped_small_0:build_progress":67,"bucket-1:by_capped_small_0:data_size":2061040268,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":6599921664,"bucket-1:by_capped_small_0:flush_queue_size":50027,"bucket-1:by_capped_small_0:frag_percent":68,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":612622827,"bucket-1:by_capped_small_0:items_count":6687753,"bucket-1:by_capped_small_0:num_commits":96,"bucket-1:by_capped_small_0:num_compactions":4,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":13435330,"bucket-1:by_capped_small_0:num_docs_pending":2093421,"bucket-1:by_capped_small_0:num_docs_queued":4471249,"bucket-1:by_capped_small_0:num_flush_queued":13461540,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":96,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":5085615152,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"96 57353264187 5120416615270744699","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"13411514 130027015634 -5304578673491246006","bucket-1:by_capped_small_0:timings/storage_handle_open":"96 4139088 217922701284","bucket-1:by_capped_small_0:timings/storage_info":"385 6486112 846538888698","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"99 1995213777 1145213664692609241","bucket-1:by_capped_small_0:timings/storage_meta_set":"96 56108119 38347528414683","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"13416466 312307960980 -6350790853597755962","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":4467232,"bucket-1:num_mutations_queued":17928746,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":298,"memory_quota":104857600000,"memory_used":7868067840,"needs_restart":false,"num_connections":0,"timings/stats_response":"2085 376323902 1561968506295188"} 2015-11-29T18:59:53.737-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:53.853-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13420000 QueuedCount 50000 2015-11-29T18:59:54.045-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:54.087-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13430000 QueuedCount 50000 2015-11-29T18:59:54.334-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13440000 QueuedCount 49874 2015-11-29T18:59:54.334-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:54.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17930000 2015-11-29T18:59:54.564-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13450000 QueuedCount 50000 2015-11-29T18:59:55.521-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13460000 QueuedCount 50000 2015-11-29T18:59:55.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T18:59:55.727-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13470000 QueuedCount 50000 2015-11-29T18:59:55.923-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17940000 2015-11-29T18:59:55.963-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13480000 QueuedCount 50000 2015-11-29T18:59:56.041-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17950000 2015-11-29T18:59:56.469-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17960000 2015-11-29T18:59:57.151-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13490000 QueuedCount 49999 2015-11-29T18:59:58.85-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13500000 QueuedCount 49885 2015-11-29T18:59:59.049-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13510000 QueuedCount 39885 2015-11-29T18:59:59.249-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13520000 QueuedCount 29885 2015-11-29T18:59:59.441-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13530000 QueuedCount 19885 2015-11-29T19:00:00.224-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13540000 QueuedCount 9885 2015-11-29T19:00:00.74-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.923µs CommitTime 390.302149ms TotalFlushTime 7m44.665163604s TotalCommitTime 57.743566336s 2015-11-29T19:00:00.741-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6777133, 6777133, 97 committed:true 2015-11-29T19:00:00.741-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6777133, 6777133, 97 committed:true) SnapCreateDur 402.628936ms SnapOpenDur 50.301µs 2015-11-29T19:00:00.762-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13550000 QueuedCount 1240 2015-11-29T19:00:00.839-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17970000 2015-11-29T19:00:00.923-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17980000 2015-11-29T19:00:00.955-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13560000 QueuedCount 14077 2015-11-29T19:00:01.004-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17990000 2015-11-29T19:00:01.151-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13570000 QueuedCount 4077 2015-11-29T19:00:02.092-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 9.44µs CommitTime 826.310586ms TotalFlushTime 7m45.104359761s TotalCommitTime 58.569876922s 2015-11-29T19:00:02.092-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6789161, 6789161, 98 committed:true 2015-11-29T19:00:02.092-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6789161, 6789161, 98 committed:true) SnapCreateDur 852.627677ms SnapOpenDur 44.026µs 2015-11-29T19:00:02.132-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:02.17-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:02.184-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18000000 2015-11-29T19:00:02.261-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13580000 QueuedCount 50000 2015-11-29T19:00:02.332-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:02.499-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13590000 QueuedCount 50000 2015-11-29T19:00:02.744-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13600000 QueuedCount 50000 2015-11-29T19:00:02.964-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13610000 QueuedCount 50000 2015-11-29T19:00:03.007-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:03.07-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18010000 2015-11-29T19:00:04.201-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13620000 QueuedCount 50000 2015-11-29T19:00:04.363-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13630000 QueuedCount 50000 2015-11-29T19:00:04.606-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13640000 QueuedCount 50000 2015-11-29T19:00:04.75-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:04.845-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13650000 QueuedCount 50000 2015-11-29T19:00:04.88-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18020000 2015-11-29T19:00:06.067-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13660000 QueuedCount 50000 2015-11-29T19:00:06.277-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13670000 QueuedCount 50000 2015-11-29T19:00:06.48-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:06.511-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13680000 QueuedCount 50000 2015-11-29T19:00:06.75-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13690000 QueuedCount 50000 2015-11-29T19:00:07.998-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13700000 QueuedCount 50000 2015-11-29T19:00:08.122-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13710000 QueuedCount 49530 2015-11-29T19:00:08.238-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13720000 QueuedCount 39530 2015-11-29T19:00:08.358-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13730000 QueuedCount 29530 2015-11-29T19:00:09.122-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13740000 QueuedCount 19530 2015-11-29T19:00:09.234-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13750000 QueuedCount 9530 2015-11-29T19:00:09.861-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.214µs CommitTime 501.835093ms TotalFlushTime 7m51.873521711s TotalCommitTime 59.071712015s 2015-11-29T19:00:09.861-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6881291, 6881291, 99 committed:true 2015-11-29T19:00:09.861-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6881291, 6881291, 99 committed:true) SnapCreateDur 514.586117ms SnapOpenDur 39.995µs 2015-11-29T19:00:09.896-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13760000 QueuedCount 16929 2015-11-29T19:00:09.897-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:09.924-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:09.937-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 212 2015-11-29T19:00:09.966-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:09.967-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 212 2015-11-29T19:00:09.997-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 212 2015-11-29T19:00:10.027-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 212 2015-11-29T19:00:10.057-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 212 2015-11-29T19:00:10.087-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 212 2015-11-29T19:00:10.117-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 212 2015-11-29T19:00:10.118-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13770000 QueuedCount 50000 2015-11-29T19:00:10.147-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 212 2015-11-29T19:00:10.177-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 212 2015-11-29T19:00:10.207-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 212 2015-11-29T19:00:10.237-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 212 2015-11-29T19:00:10.267-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 212 2015-11-29T19:00:10.273-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:10.297-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 212 2015-11-29T19:00:10.327-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 212 2015-11-29T19:00:10.342-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13780000 QueuedCount 50000 2015-11-29T19:00:10.357-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 212 2015-11-29T19:00:10.387-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 212 2015-11-29T19:00:10.417-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 212 2015-11-29T19:00:10.447-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 212 2015-11-29T19:00:10.477-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 212 2015-11-29T19:00:10.507-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 212 2015-11-29T19:00:10.537-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 212 2015-11-29T19:00:10.567-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 212 2015-11-29T19:00:10.576-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:10.577-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13790000 QueuedCount 49922 2015-11-29T19:00:10.597-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 212 2015-11-29T19:00:10.627-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 212 2015-11-29T19:00:10.657-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 212 2015-11-29T19:00:10.687-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 212 2015-11-29T19:00:10.717-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 212 2015-11-29T19:00:10.747-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 212 2015-11-29T19:00:10.777-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 212 2015-11-29T19:00:10.807-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 212 2015-11-29T19:00:10.83-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13800000 QueuedCount 50000 2015-11-29T19:00:10.837-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 212 2015-11-29T19:00:10.867-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 212 2015-11-29T19:00:10.897-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 212 2015-11-29T19:00:10.927-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 212 2015-11-29T19:00:10.957-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 212 2015-11-29T19:00:10.987-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 212 2015-11-29T19:00:11.017-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 212 2015-11-29T19:00:11.047-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 212 2015-11-29T19:00:11.077-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 212 2015-11-29T19:00:11.107-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 212 2015-11-29T19:00:11.137-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 212 2015-11-29T19:00:11.167-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 212 2015-11-29T19:00:11.197-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 212 2015-11-29T19:00:11.227-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 212 2015-11-29T19:00:11.257-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 212 2015-11-29T19:00:11.287-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 212 2015-11-29T19:00:11.317-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 212 2015-11-29T19:00:11.347-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 212 2015-11-29T19:00:11.377-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 212 2015-11-29T19:00:11.407-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 212 2015-11-29T19:00:11.437-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 212 2015-11-29T19:00:11.467-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 212 2015-11-29T19:00:11.497-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 212 2015-11-29T19:00:11.527-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 212 2015-11-29T19:00:11.557-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 212 2015-11-29T19:00:11.587-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 212 2015-11-29T19:00:11.617-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 212 2015-11-29T19:00:11.647-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 212 2015-11-29T19:00:11.677-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 212 2015-11-29T19:00:11.707-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 212 2015-11-29T19:00:11.737-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 212 2015-11-29T19:00:11.767-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 212 2015-11-29T19:00:11.797-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 212 2015-11-29T19:00:11.827-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 212 2015-11-29T19:00:11.857-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 212 2015-11-29T19:00:11.887-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 212 2015-11-29T19:00:11.917-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 212 2015-11-29T19:00:11.933-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:11.947-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 212 2015-11-29T19:00:11.977-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 212 2015-11-29T19:00:11.984-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13810000 QueuedCount 49875 2015-11-29T19:00:12.007-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 212 2015-11-29T19:00:12.037-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 212 2015-11-29T19:00:12.067-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 212 2015-11-29T19:00:12.097-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13820000 QueuedCount 39875 2015-11-29T19:00:12.097-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 212 2015-11-29T19:00:12.127-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 212 2015-11-29T19:00:12.157-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 212 2015-11-29T19:00:12.187-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 212 2015-11-29T19:00:12.208-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13830000 QueuedCount 29875 2015-11-29T19:00:12.217-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 212 2015-11-29T19:00:12.247-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 212 2015-11-29T19:00:12.277-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 212 2015-11-29T19:00:12.307-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 212 2015-11-29T19:00:12.323-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13840000 QueuedCount 19875 2015-11-29T19:00:12.337-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 212 2015-11-29T19:00:12.367-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 212 2015-11-29T19:00:12.397-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 212 2015-11-29T19:00:12.427-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 212 2015-11-29T19:00:12.457-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 212 2015-11-29T19:00:12.487-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 212 2015-11-29T19:00:12.517-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 212 2015-11-29T19:00:12.547-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 212 2015-11-29T19:00:12.577-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 212 2015-11-29T19:00:12.607-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 212 2015-11-29T19:00:12.637-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 212 2015-11-29T19:00:12.667-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 212 2015-11-29T19:00:12.697-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 212 2015-11-29T19:00:12.727-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 212 2015-11-29T19:00:12.757-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 212 2015-11-29T19:00:12.787-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 212 2015-11-29T19:00:12.817-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 212 2015-11-29T19:00:12.847-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 212 2015-11-29T19:00:12.877-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 212 2015-11-29T19:00:12.907-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 212 2015-11-29T19:00:12.937-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 212 2015-11-29T19:00:12.967-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 212 2015-11-29T19:00:12.997-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 212 2015-11-29T19:00:13.027-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 212 2015-11-29T19:00:13.057-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 212 2015-11-29T19:00:13.08-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13850000 QueuedCount 9875 2015-11-29T19:00:13.087-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 212 2015-11-29T19:00:13.117-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 212 2015-11-29T19:00:13.147-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 212 2015-11-29T19:00:13.177-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 212 2015-11-29T19:00:13.207-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 212 2015-11-29T19:00:13.237-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 212 2015-11-29T19:00:13.267-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 212 2015-11-29T19:00:13.297-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 212 2015-11-29T19:00:13.327-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 212 2015-11-29T19:00:13.357-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 212 2015-11-29T19:00:13.387-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 212 2015-11-29T19:00:13.417-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 212 2015-11-29T19:00:13.447-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 212 2015-11-29T19:00:13.477-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 212 2015-11-29T19:00:13.507-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 212 2015-11-29T19:00:13.537-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 212 2015-11-29T19:00:13.567-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 212 2015-11-29T19:00:13.597-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 212 2015-11-29T19:00:13.627-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 212 2015-11-29T19:00:13.639-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.66µs CommitTime 455.906295ms TotalFlushTime 7m54.982230729s TotalCommitTime 59.52761831s 2015-11-29T19:00:13.639-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 6931174, 6931174, 100 committed:true 2015-11-29T19:00:13.639-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 6931174, 6931174, 100 committed:true) SnapCreateDur 466.705792ms SnapOpenDur 46.176µs 2015-11-29T19:00:13.657-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 212 2015-11-29T19:00:13.665-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13860000 QueuedCount 7027 2015-11-29T19:00:13.673-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:13.687-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 212 2015-11-29T19:00:13.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:13.738-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:13.75-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18030000 2015-11-29T19:00:13.812-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18040000 2015-11-29T19:00:13.868-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18050000 2015-11-29T19:00:13.881-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13870000 QueuedCount 50000 2015-11-29T19:00:13.981-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18060000 2015-11-29T19:00:14.098-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18070000 2015-11-29T19:00:14.106-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13880000 QueuedCount 50000 2015-11-29T19:00:14.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:14.251-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18080000 2015-11-29T19:00:14.321-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18090000 2015-11-29T19:00:14.364-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13890000 QueuedCount 50000 2015-11-29T19:00:14.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18100000 2015-11-29T19:00:14.456-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18110000 2015-11-29T19:00:14.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18120000 2015-11-29T19:00:14.632-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13900000 QueuedCount 50000 2015-11-29T19:00:15.674-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:15.748-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13910000 QueuedCount 50000 2015-11-29T19:00:15.793-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:16.011-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13920000 QueuedCount 50000 2015-11-29T19:00:16.051-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:16.072-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:16.179-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13930000 QueuedCount 50000 2015-11-29T19:00:16.293-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13940000 QueuedCount 50000 2015-11-29T19:00:16.295-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:17.001-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13950000 QueuedCount 50000 2015-11-29T19:00:17.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:17.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18130000 2015-11-29T19:00:17.103-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13960000 QueuedCount 46141 2015-11-29T19:00:17.203-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13970000 QueuedCount 36141 2015-11-29T19:00:17.308-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13980000 QueuedCount 26141 2015-11-29T19:00:19.231-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 13990000 QueuedCount 16141 2015-11-29T19:00:20.442-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14000000 QueuedCount 6141 2015-11-29T19:00:21.584-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 8.926µs CommitTime 972.834668ms TotalFlushTime 8m1.620253064s TotalCommitTime 1m0.500452978s 2015-11-29T19:00:21.584-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7003702, 7003702, 101 committed:true 2015-11-29T19:00:21.584-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7003702, 7003702, 101 committed:true) SnapCreateDur 999.411876ms SnapOpenDur 57.695µs 2015-11-29T19:00:21.629-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:21.684-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18140000 2015-11-29T19:00:21.716-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14010000 QueuedCount 50000 2015-11-29T19:00:21.751-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18150000 2015-11-29T19:00:21.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18160000 2015-11-29T19:00:21.895-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18170000 2015-11-29T19:00:21.898-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:21.965-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18180000 2015-11-29T19:00:21.988-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14020000 QueuedCount 50000 2015-11-29T19:00:22.031-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18190000 2015-11-29T19:00:22.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18200000 2015-11-29T19:00:22.193-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18210000 2015-11-29T19:00:22.201-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14030000 QueuedCount 50000 2015-11-29T19:00:22.259-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:22.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18220000 2015-11-29T19:00:22.398-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18230000 2015-11-29T19:00:22.42-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14040000 QueuedCount 50000 2015-11-29T19:00:22.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18240000 2015-11-29T19:00:22.639-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18250000 2015-11-29T19:00:22.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18260000 2015-11-29T19:00:22.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18270000 2015-11-29T19:00:23.024-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18280000 2015-11-29T19:00:23.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18290000 2015-11-29T19:00:23.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18300000 2015-11-29T19:00:23.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18310000 2015-11-29T19:00:23.451-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14050000 QueuedCount 43886 2015-11-29T19:00:23.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18320000 2015-11-29T19:00:23.565-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14060000 QueuedCount 33886 2015-11-29T19:00:23.607-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18330000 2015-11-29T19:00:23.684-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14070000 QueuedCount 23886 2015-11-29T19:00:23.73-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18340000 2015-11-29T19:00:23.808-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14080000 QueuedCount 13886 2015-11-29T19:00:23.858-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18350000 2015-11-29T19:00:23.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18360000 2015-11-29T19:00:24.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18370000 2015-11-29T19:00:24.227-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18380000 2015-11-29T19:00:24.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18390000 2015-11-29T19:00:24.478-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18400000 2015-11-29T19:00:24.612-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14090000 QueuedCount 3886 2015-11-29T19:00:24.933-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.885µs CommitTime 270.155095ms TotalFlushTime 8m4.545718057s TotalCommitTime 1m0.770608073s 2015-11-29T19:00:24.934-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7047338, 7047338, 102 committed:true 2015-11-29T19:00:24.934-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7047338, 7047338, 102 committed:true) SnapCreateDur 280.837242ms SnapOpenDur 44.172µs 2015-11-29T19:00:24.957-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:24.977-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.006-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.032-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.033-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14100000 QueuedCount 14023 2015-11-29T19:00:25.062-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18410000 2015-11-29T19:00:25.088-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.112-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.14-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.145-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14110000 QueuedCount 36426 2015-11-29T19:00:25.164-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.268-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:25.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18420000 2015-11-29T19:00:25.352-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14120000 QueuedCount 50000 2015-11-29T19:00:25.645-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14130000 QueuedCount 50000 2015-11-29T19:00:26.976-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14140000 QueuedCount 50000 2015-11-29T19:00:27.038-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:27.091-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18430000 2015-11-29T19:00:27.133-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:27.212-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14150000 QueuedCount 50000 2015-11-29T19:00:27.301-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18440000 2015-11-29T19:00:27.455-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14160000 QueuedCount 50000 2015-11-29T19:00:27.599-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:27.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18450000 2015-11-29T19:00:27.713-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14170000 QueuedCount 50000 2015-11-29T19:00:28.947-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14180000 QueuedCount 50000 2015-11-29T19:00:28.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18460000 2015-11-29T19:00:29.069-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14190000 QueuedCount 50000 2015-11-29T19:00:29.185-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14200000 QueuedCount 42009 2015-11-29T19:00:29.302-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14210000 QueuedCount 32009 2015-11-29T19:00:30.109-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14220000 QueuedCount 22009 2015-11-29T19:00:30.205-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14230000 QueuedCount 12009 2015-11-29T19:00:30.305-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14240000 QueuedCount 2009 2015-11-29T19:00:30.916-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.607µs CommitTime 571.239469ms TotalFlushTime 8m9.590313744s TotalCommitTime 1m1.341847542s 2015-11-29T19:00:30.916-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7120856, 7120856, 103 committed:true 2015-11-29T19:00:30.916-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7120856, 7120856, 103 committed:true) SnapCreateDur 581.442173ms SnapOpenDur 58.032µs 2015-11-29T19:00:30.954-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:30.988-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:30.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18470000 2015-11-29T19:00:31.014-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.059-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18480000 2015-11-29T19:00:31.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18490000 2015-11-29T19:00:31.142-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.147-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14250000 QueuedCount 49813 2015-11-29T19:00:31.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18500000 2015-11-29T19:00:31.417-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18510000 2015-11-29T19:00:31.428-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14260000 QueuedCount 50000 2015-11-29T19:00:31.631-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18520000 2015-11-29T19:00:31.639-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.657-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14270000 QueuedCount 49121 2015-11-29T19:00:31.751-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.772-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.794-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:31.845-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18530000 2015-11-29T19:00:31.883-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14280000 QueuedCount 50000 2015-11-29T19:00:31.897-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:32.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18540000 2015-11-29T19:00:32.796-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:32.817-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14290000 QueuedCount 48133 2015-11-29T19:00:32.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18550000 2015-11-29T19:00:32.936-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14300000 QueuedCount 50000 2015-11-29T19:00:33.122-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14310000 QueuedCount 50000 2015-11-29T19:00:33.352-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14320000 QueuedCount 43449 2015-11-29T19:00:34.457-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14330000 QueuedCount 33449 2015-11-29T19:00:34.572-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14340000 QueuedCount 23449 2015-11-29T19:00:34.695-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14350000 QueuedCount 13449 2015-11-29T19:00:34.817-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14360000 QueuedCount 3449 2015-11-29T19:00:36.051-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 5.811µs CommitTime 1.166394335s TotalFlushTime 8m13.297715061s TotalCommitTime 1m2.508241877s 2015-11-29T19:00:36.051-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7181157, 7181157, 104 committed:true 2015-11-29T19:00:36.051-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7181157, 7181157, 104 committed:true) SnapCreateDur 1.192721197s SnapOpenDur 55.084µs 2015-11-29T19:00:36.091-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:36.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18560000 2015-11-29T19:00:36.131-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:36.146-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14370000 QueuedCount 44276 2015-11-29T19:00:36.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18570000 2015-11-29T19:00:36.234-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18580000 2015-11-29T19:00:36.239-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:36.247-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14380000 QueuedCount 49130 2015-11-29T19:00:36.297-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18590000 2015-11-29T19:00:36.351-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14390000 QueuedCount 50000 2015-11-29T19:00:36.357-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18600000 2015-11-29T19:00:36.54-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14400000 QueuedCount 50000 2015-11-29T19:00:36.582-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:37.861-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14410000 QueuedCount 50000 2015-11-29T19:00:37.885-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:38.076-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14420000 QueuedCount 44603 2015-11-29T19:00:38.3-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14430000 QueuedCount 34603 2015-11-29T19:00:38.473-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14440000 QueuedCount 24603 2015-11-29T19:00:39.281-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14450000 QueuedCount 14603 2015-11-29T19:00:39.383-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14460000 QueuedCount 4603 2015-11-29T19:00:40.362-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.524µs CommitTime 899.657763ms TotalFlushTime 8m16.498794672s TotalCommitTime 1m3.40789964s 2015-11-29T19:00:40.362-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7231242, 7231242, 105 committed:true 2015-11-29T19:00:40.362-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7231242, 7231242, 105 committed:true) SnapCreateDur 926.039339ms SnapOpenDur 86.686µs 2015-11-29T19:00:40.396-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.426-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.448-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.469-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.488-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14470000 QueuedCount 25367 2015-11-29T19:00:40.492-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.517-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.545-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.571-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.628-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.702-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14480000 QueuedCount 50000 2015-11-29T19:00:40.722-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:40.914-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14490000 QueuedCount 50000 2015-11-29T19:00:40.984-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:41.137-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:41.144-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14500000 QueuedCount 49641 2015-11-29T19:00:41.217-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:41.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 485 2015-11-29T19:00:41.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 485 2015-11-29T19:00:41.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 485 2015-11-29T19:00:41.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 485 2015-11-29T19:00:41.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 485 2015-11-29T19:00:41.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 485 2015-11-29T19:00:41.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 485 2015-11-29T19:00:41.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 485 2015-11-29T19:00:41.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 485 2015-11-29T19:00:41.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 485 2015-11-29T19:00:41.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 485 2015-11-29T19:00:41.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 485 2015-11-29T19:00:41.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 485 2015-11-29T19:00:41.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 485 2015-11-29T19:00:41.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 485 2015-11-29T19:00:41.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 485 2015-11-29T19:00:41.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 485 2015-11-29T19:00:41.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 485 2015-11-29T19:00:41.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 485 2015-11-29T19:00:41.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 485 2015-11-29T19:00:41.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 485 2015-11-29T19:00:42.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 485 2015-11-29T19:00:42.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 485 2015-11-29T19:00:42.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 485 2015-11-29T19:00:42.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 485 2015-11-29T19:00:42.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 485 2015-11-29T19:00:42.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 485 2015-11-29T19:00:42.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 485 2015-11-29T19:00:42.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 485 2015-11-29T19:00:42.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 485 2015-11-29T19:00:42.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 485 2015-11-29T19:00:42.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 485 2015-11-29T19:00:42.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 485 2015-11-29T19:00:42.364-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14510000 QueuedCount 50000 2015-11-29T19:00:42.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 485 2015-11-29T19:00:42.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 485 2015-11-29T19:00:42.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 485 2015-11-29T19:00:42.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 485 2015-11-29T19:00:42.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 485 2015-11-29T19:00:42.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 485 2015-11-29T19:00:42.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 485 2015-11-29T19:00:42.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 485 2015-11-29T19:00:42.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 485 2015-11-29T19:00:42.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 485 2015-11-29T19:00:42.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 485 2015-11-29T19:00:42.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 485 2015-11-29T19:00:42.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 485 2015-11-29T19:00:42.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 485 2015-11-29T19:00:42.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 485 2015-11-29T19:00:42.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 485 2015-11-29T19:00:42.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 485 2015-11-29T19:00:42.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 485 2015-11-29T19:00:42.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 485 2015-11-29T19:00:42.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 485 2015-11-29T19:00:42.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 485 2015-11-29T19:00:43.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 485 2015-11-29T19:00:43.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 485 2015-11-29T19:00:43.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 485 2015-11-29T19:00:43.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 485 2015-11-29T19:00:43.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 485 2015-11-29T19:00:43.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 485 2015-11-29T19:00:43.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 485 2015-11-29T19:00:43.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 485 2015-11-29T19:00:43.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 485 2015-11-29T19:00:43.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 485 2015-11-29T19:00:43.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 485 2015-11-29T19:00:43.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 485 2015-11-29T19:00:43.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 485 2015-11-29T19:00:43.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 485 2015-11-29T19:00:43.41-08:00 [Info] CompactionDaemon: Finished compacting index instance:3094208154756435235 2015-11-29T19:00:43.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 485 2015-11-29T19:00:43.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 485 2015-11-29T19:00:43.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 485 2015-11-29T19:00:43.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 485 2015-11-29T19:00:43.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 485 2015-11-29T19:00:43.573-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14520000 QueuedCount 50000 2015-11-29T19:00:43.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 485 2015-11-29T19:00:43.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 485 2015-11-29T19:00:43.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 485 2015-11-29T19:00:43.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 485 2015-11-29T19:00:43.684-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:43.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 485 2015-11-29T19:00:43.716-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14530000 QueuedCount 50000 2015-11-29T19:00:43.795-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18610000 2015-11-29T19:00:43.835-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14540000 QueuedCount 50000 2015-11-29T19:00:43.974-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18620000 2015-11-29T19:00:44.05-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14550000 QueuedCount 50000 2015-11-29T19:00:45.067-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14560000 QueuedCount 47742 2015-11-29T19:00:45.165-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14570000 QueuedCount 37742 2015-11-29T19:00:45.265-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14580000 QueuedCount 27742 2015-11-29T19:00:45.374-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14590000 QueuedCount 17742 2015-11-29T19:00:46.068-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14600000 QueuedCount 7742 2015-11-29T19:00:46.489-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 10.161µs CommitTime 343.331553ms TotalFlushTime 8m21.979369s TotalCommitTime 1m3.751231193s 2015-11-29T19:00:46.489-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7302627, 7302627, 106 committed:true 2015-11-29T19:00:46.489-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7302627, 7302627, 106 committed:true) SnapCreateDur 353.431928ms SnapOpenDur 41.527µs 2015-11-29T19:00:46.514-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.54-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.552-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14610000 QueuedCount 10568 2015-11-29T19:00:46.563-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18630000 2015-11-29T19:00:46.587-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.608-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.635-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18640000 2015-11-29T19:00:46.638-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.665-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.689-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18650000 2015-11-29T19:00:46.743-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14620000 QueuedCount 50000 2015-11-29T19:00:46.772-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18660000 2015-11-29T19:00:46.833-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18670000 2015-11-29T19:00:46.871-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:46.9-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18680000 2015-11-29T19:00:46.942-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14630000 QueuedCount 50000 2015-11-29T19:00:46.958-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18690000 2015-11-29T19:00:47.018-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18700000 2015-11-29T19:00:47.083-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18710000 2015-11-29T19:00:47.153-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18720000 2015-11-29T19:00:47.162-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14640000 QueuedCount 50000 2015-11-29T19:00:47.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18730000 2015-11-29T19:00:47.293-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18740000 2015-11-29T19:00:47.362-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18750000 2015-11-29T19:00:47.442-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18760000 2015-11-29T19:00:47.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18770000 2015-11-29T19:00:47.602-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18780000 2015-11-29T19:00:47.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18790000 2015-11-29T19:00:48.154-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14650000 QueuedCount 50000 2015-11-29T19:00:48.252-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:48.27-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14660000 QueuedCount 48240 2015-11-29T19:00:48.445-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14670000 QueuedCount 50000 2015-11-29T19:00:48.681-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14680000 QueuedCount 50000 2015-11-29T19:00:48.886-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_capped_small_0_3094208154756435235_0.index/data.fdb.3', errno = 2: 'No such file or directory' 2015-11-29T19:00:48.908-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14690000 QueuedCount 50000 2015-11-29T19:00:48.918-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:50.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18800000 2015-11-29T19:00:50.081-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14700000 QueuedCount 49027 2015-11-29T19:00:50.208-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14710000 QueuedCount 39027 2015-11-29T19:00:50.317-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14720000 QueuedCount 29027 2015-11-29T19:00:50.428-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14730000 QueuedCount 19027 2015-11-29T19:00:51.261-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14740000 QueuedCount 9027 2015-11-29T19:00:52.185-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 17.31µs CommitTime 800.177711ms TotalFlushTime 8m26.537391052s TotalCommitTime 1m4.551408904s 2015-11-29T19:00:52.185-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7372854, 7372854, 107 committed:true 2015-11-29T19:00:52.185-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7372854, 7372854, 107 committed:true) SnapCreateDur 826.413169ms SnapOpenDur 64.844µs 2015-11-29T19:00:52.212-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.221-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14750000 QueuedCount 5194 2015-11-29T19:00:52.236-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.26-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.29-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.318-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.337-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18810000 2015-11-29T19:00:52.342-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.351-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14760000 QueuedCount 24965 2015-11-29T19:00:52.372-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.394-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.415-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18820000 2015-11-29T19:00:52.475-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18830000 2015-11-29T19:00:52.481-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14770000 QueuedCount 50000 2015-11-29T19:00:52.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:52.542-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18840000 2015-11-29T19:00:52.615-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18850000 2015-11-29T19:00:52.684-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14780000 QueuedCount 50000 2015-11-29T19:00:52.695-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18860000 2015-11-29T19:00:52.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18870000 2015-11-29T19:00:52.85-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18880000 2015-11-29T19:00:53.389-08:00 [Info] PeriodicStats = {"bucket-1:by_capped_small_0:avg_scan_latency":0,"bucket-1:by_capped_small_0:avg_scan_wait_latency":0,"bucket-1:by_capped_small_0:avg_ts_interval":5579559788,"bucket-1:by_capped_small_0:avg_ts_items_count":134744,"bucket-1:by_capped_small_0:build_progress":74,"bucket-1:by_capped_small_0:data_size":2270847456,"bucket-1:by_capped_small_0:delete_bytes":0,"bucket-1:by_capped_small_0:disk_size":6612635648,"bucket-1:by_capped_small_0:flush_queue_size":50026,"bucket-1:by_capped_small_0:frag_percent":65,"bucket-1:by_capped_small_0:get_bytes":0,"bucket-1:by_capped_small_0:insert_bytes":671706503,"bucket-1:by_capped_small_0:items_count":7372854,"bucket-1:by_capped_small_0:num_commits":107,"bucket-1:by_capped_small_0:num_compactions":4,"bucket-1:by_capped_small_0:num_completed_requests":0,"bucket-1:by_capped_small_0:num_docs_indexed":14821015,"bucket-1:by_capped_small_0:num_docs_pending":1122437,"bucket-1:by_capped_small_0:num_docs_queued":4056548,"bucket-1:by_capped_small_0:num_flush_queued":14839982,"bucket-1:by_capped_small_0:num_last_snapshot_reply":0,"bucket-1:by_capped_small_0:num_requests":0,"bucket-1:by_capped_small_0:num_rows_returned":0,"bucket-1:by_capped_small_0:num_snapshot_waiters":0,"bucket-1:by_capped_small_0:num_snapshots":107,"bucket-1:by_capped_small_0:scan_bytes_read":0,"bucket-1:by_capped_small_0:scan_wait_duration":0,"bucket-1:by_capped_small_0:since_last_snapshot":5696255650,"bucket-1:by_capped_small_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_capped_small_0:timings/storage_commit":"107 64551408904 -7757787138728800712","bucket-1:by_capped_small_0:timings/storage_del":"0 0 0","bucket-1:by_capped_small_0:timings/storage_get":"14789957 144685794944 -4267748146197860886","bucket-1:by_capped_small_0:timings/storage_handle_open":"107 4479188 229169552648","bucket-1:by_capped_small_0:timings/storage_info":"429 7396757 992822333257","bucket-1:by_capped_small_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_capped_small_0:timings/storage_meta_get":"110 2000622058 1145216717774997662","bucket-1:by_capped_small_0:timings/storage_meta_set":"107 63205176 43748189658722","bucket-1:by_capped_small_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_capped_small_0:timings/storage_set":"14786668 345939751065 -4032719548831671433","bucket-1:by_capped_small_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_capped_small_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_capped_small_0:total_scan_duration":0,"bucket-1:mutation_queue_size":4042713,"bucket-1:num_mutations_queued":18882670,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":274,"memory_quota":104857600000,"memory_used":3558121472,"needs_restart":false,"num_connections":0,"timings/stats_response":"2157 402529872 1571862512855620"} 2015-11-29T19:00:53.861-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14790000 QueuedCount 50000 2015-11-29T19:00:54.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:54.095-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14800000 QueuedCount 50000 2015-11-29T19:00:54.297-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14810000 QueuedCount 40522 2015-11-29T19:00:54.5-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14820000 QueuedCount 30522 2015-11-29T19:00:54.708-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14830000 QueuedCount 20522 2015-11-29T19:00:55.58-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14840000 QueuedCount 10522 2015-11-29T19:00:55.678-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14850000 QueuedCount 522 2015-11-29T19:00:56.178-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2.333µs CommitTime 478.430553ms TotalFlushTime 8m29.843809467s TotalCommitTime 1m5.029839457s 2015-11-29T19:00:56.178-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7423679, 7423679, 108 committed:true 2015-11-29T19:00:56.179-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7423679, 7423679, 108 committed:true) SnapCreateDur 491.113752ms SnapOpenDur 55.67µs 2015-11-29T19:00:56.211-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.238-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.268-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.306-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.402-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14860000 QueuedCount 50000 2015-11-29T19:00:56.43-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.503-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.632-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14870000 QueuedCount 50000 2015-11-29T19:00:56.833-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:56.878-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14880000 QueuedCount 50000 2015-11-29T19:00:57.085-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:57.121-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14890000 QueuedCount 50000 2015-11-29T19:00:58.294-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:58.341-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14900000 QueuedCount 50000 2015-11-29T19:00:58.386-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:58.563-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14910000 QueuedCount 50000 2015-11-29T19:00:58.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:00:58.797-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14920000 QueuedCount 49320 2015-11-29T19:00:59.042-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14930000 QueuedCount 50000 2015-11-29T19:01:00.095-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14940000 QueuedCount 50000 2015-11-29T19:01:00.33-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14950000 QueuedCount 50000 2015-11-29T19:01:00.417-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:00.578-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14960000 QueuedCount 50000 2015-11-29T19:01:00.84-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14970000 QueuedCount 50000 2015-11-29T19:01:01.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 370 2015-11-29T19:01:01.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 370 2015-11-29T19:01:01.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 370 2015-11-29T19:01:01.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 370 2015-11-29T19:01:01.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 370 2015-11-29T19:01:01.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 370 2015-11-29T19:01:01.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 370 2015-11-29T19:01:01.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 370 2015-11-29T19:01:01.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 370 2015-11-29T19:01:01.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 370 2015-11-29T19:01:01.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 370 2015-11-29T19:01:01.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 370 2015-11-29T19:01:01.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 370 2015-11-29T19:01:01.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 370 2015-11-29T19:01:01.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 370 2015-11-29T19:01:01.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 370 2015-11-29T19:01:01.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 370 2015-11-29T19:01:01.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 370 2015-11-29T19:01:01.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 370 2015-11-29T19:01:01.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 370 2015-11-29T19:01:01.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 370 2015-11-29T19:01:01.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 370 2015-11-29T19:01:01.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 370 2015-11-29T19:01:01.907-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14980000 QueuedCount 50000 2015-11-29T19:01:01.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 370 2015-11-29T19:01:01.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 370 2015-11-29T19:01:01.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 370 2015-11-29T19:01:02.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 370 2015-11-29T19:01:02.015-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 14990000 QueuedCount 42727 2015-11-29T19:01:02.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 370 2015-11-29T19:01:02.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 370 2015-11-29T19:01:02.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 370 2015-11-29T19:01:02.116-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15000000 QueuedCount 32727 2015-11-29T19:01:02.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 370 2015-11-29T19:01:02.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 370 2015-11-29T19:01:02.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 370 2015-11-29T19:01:02.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 370 2015-11-29T19:01:02.222-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15010000 QueuedCount 22727 2015-11-29T19:01:02.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 370 2015-11-29T19:01:02.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 370 2015-11-29T19:01:02.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 370 2015-11-29T19:01:02.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 370 2015-11-29T19:01:02.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 370 2015-11-29T19:01:02.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 370 2015-11-29T19:01:02.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 370 2015-11-29T19:01:02.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 370 2015-11-29T19:01:02.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 370 2015-11-29T19:01:02.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 370 2015-11-29T19:01:02.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 370 2015-11-29T19:01:02.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 370 2015-11-29T19:01:02.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 370 2015-11-29T19:01:02.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 370 2015-11-29T19:01:02.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 370 2015-11-29T19:01:02.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 370 2015-11-29T19:01:02.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 370 2015-11-29T19:01:02.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 370 2015-11-29T19:01:02.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 370 2015-11-29T19:01:02.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 370 2015-11-29T19:01:02.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 370 2015-11-29T19:01:02.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 370 2015-11-29T19:01:02.893-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15020000 QueuedCount 12727 2015-11-29T19:01:02.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 370 2015-11-29T19:01:02.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 370 2015-11-29T19:01:02.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 370 2015-11-29T19:01:02.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15030000 QueuedCount 2727 2015-11-29T19:01:02.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 370 2015-11-29T19:01:03.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 370 2015-11-29T19:01:03.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 370 2015-11-29T19:01:03.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 370 2015-11-29T19:01:03.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 370 2015-11-29T19:01:03.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 370 2015-11-29T19:01:03.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 370 2015-11-29T19:01:03.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 370 2015-11-29T19:01:03.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 370 2015-11-29T19:01:03.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 370 2015-11-29T19:01:03.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 370 2015-11-29T19:01:03.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 370 2015-11-29T19:01:03.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 370 2015-11-29T19:01:03.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 370 2015-11-29T19:01:03.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 370 2015-11-29T19:01:03.424-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.707µs CommitTime 412.016839ms TotalFlushTime 8m36.127574468s TotalCommitTime 1m5.441856296s 2015-11-29T19:01:03.424-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7514817, 7514817, 109 committed:true 2015-11-29T19:01:03.424-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7514817, 7514817, 109 committed:true) SnapCreateDur 421.868749ms SnapOpenDur 46.415µs 2015-11-29T19:01:03.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 370 2015-11-29T19:01:03.45-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:03.475-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:03.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 370 2015-11-29T19:01:03.508-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:03.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 370 2015-11-29T19:01:03.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 370 2015-11-29T19:01:03.546-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:03.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 370 2015-11-29T19:01:03.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 370 2015-11-29T19:01:03.601-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15040000 QueuedCount 50000 2015-11-29T19:01:03.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 370 2015-11-29T19:01:03.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 370 2015-11-29T19:01:03.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 370 2015-11-29T19:01:03.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 370 2015-11-29T19:01:03.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 370 2015-11-29T19:01:03.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 370 2015-11-29T19:01:03.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 370 2015-11-29T19:01:03.821-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15050000 QueuedCount 50000 2015-11-29T19:01:03.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 370 2015-11-29T19:01:03.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 370 2015-11-29T19:01:03.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 370 2015-11-29T19:01:03.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 370 2015-11-29T19:01:03.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 370 2015-11-29T19:01:03.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 370 2015-11-29T19:01:04.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 370 2015-11-29T19:01:04.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 370 2015-11-29T19:01:04.062-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15060000 QueuedCount 50000 2015-11-29T19:01:04.07-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:04.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 370 2015-11-29T19:01:04.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 370 2015-11-29T19:01:04.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 370 2015-11-29T19:01:04.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 370 2015-11-29T19:01:04.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 370 2015-11-29T19:01:04.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 370 2015-11-29T19:01:04.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 370 2015-11-29T19:01:04.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 370 2015-11-29T19:01:04.291-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:04.305-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15070000 QueuedCount 49296 2015-11-29T19:01:04.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 370 2015-11-29T19:01:04.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 370 2015-11-29T19:01:04.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 370 2015-11-29T19:01:04.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 370 2015-11-29T19:01:04.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 370 2015-11-29T19:01:04.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 370 2015-11-29T19:01:04.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 370 2015-11-29T19:01:04.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 370 2015-11-29T19:01:04.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 370 2015-11-29T19:01:04.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 370 2015-11-29T19:01:04.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 370 2015-11-29T19:01:04.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 370 2015-11-29T19:01:04.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 370 2015-11-29T19:01:04.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 370 2015-11-29T19:01:04.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 370 2015-11-29T19:01:04.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 370 2015-11-29T19:01:04.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 370 2015-11-29T19:01:04.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 370 2015-11-29T19:01:04.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 370 2015-11-29T19:01:04.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 370 2015-11-29T19:01:04.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 370 2015-11-29T19:01:04.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 370 2015-11-29T19:01:04.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 370 2015-11-29T19:01:05.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 370 2015-11-29T19:01:05.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 370 2015-11-29T19:01:05.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 370 2015-11-29T19:01:05.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 370 2015-11-29T19:01:05.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 370 2015-11-29T19:01:05.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 370 2015-11-29T19:01:05.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 370 2015-11-29T19:01:05.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 370 2015-11-29T19:01:05.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 370 2015-11-29T19:01:05.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 370 2015-11-29T19:01:05.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 370 2015-11-29T19:01:05.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 370 2015-11-29T19:01:05.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 370 2015-11-29T19:01:05.376-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:05.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 370 2015-11-29T19:01:05.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 370 2015-11-29T19:01:05.443-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15080000 QueuedCount 50000 2015-11-29T19:01:05.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 370 2015-11-29T19:01:05.484-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:05.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 370 2015-11-29T19:01:05.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 370 2015-11-29T19:01:05.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 370 2015-11-29T19:01:05.552-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15090000 QueuedCount 50000 2015-11-29T19:01:05.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 370 2015-11-29T19:01:05.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 370 2015-11-29T19:01:05.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 370 2015-11-29T19:01:05.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 370 2015-11-29T19:01:05.668-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15100000 QueuedCount 50000 2015-11-29T19:01:05.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 370 2015-11-29T19:01:05.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 370 2015-11-29T19:01:05.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 370 2015-11-29T19:01:05.775-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15110000 QueuedCount 42226 2015-11-29T19:01:05.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 370 2015-11-29T19:01:05.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 370 2015-11-29T19:01:05.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 370 2015-11-29T19:01:05.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 370 2015-11-29T19:01:05.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 370 2015-11-29T19:01:05.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 370 2015-11-29T19:01:05.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 370 2015-11-29T19:01:05.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 370 2015-11-29T19:01:06.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 370 2015-11-29T19:01:06.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 370 2015-11-29T19:01:06.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 370 2015-11-29T19:01:06.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 370 2015-11-29T19:01:06.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 370 2015-11-29T19:01:06.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 370 2015-11-29T19:01:06.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 370 2015-11-29T19:01:06.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 370 2015-11-29T19:01:06.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 370 2015-11-29T19:01:06.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 370 2015-11-29T19:01:06.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 370 2015-11-29T19:01:06.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 370 2015-11-29T19:01:06.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 370 2015-11-29T19:01:06.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 370 2015-11-29T19:01:06.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 370 2015-11-29T19:01:06.452-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15120000 QueuedCount 32226 2015-11-29T19:01:06.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 370 2015-11-29T19:01:06.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 370 2015-11-29T19:01:06.538-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15130000 QueuedCount 22226 2015-11-29T19:01:06.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 370 2015-11-29T19:01:06.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 370 2015-11-29T19:01:06.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 370 2015-11-29T19:01:06.621-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15140000 QueuedCount 12226 2015-11-29T19:01:06.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 370 2015-11-29T19:01:06.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 370 2015-11-29T19:01:06.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 370 2015-11-29T19:01:06.706-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15150000 QueuedCount 2226 2015-11-29T19:01:06.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 370 2015-11-29T19:01:06.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 370 2015-11-29T19:01:06.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 370 2015-11-29T19:01:06.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 370 2015-11-29T19:01:06.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 370 2015-11-29T19:01:06.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 370 2015-11-29T19:01:06.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 370 2015-11-29T19:01:06.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 370 2015-11-29T19:01:06.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 370 2015-11-29T19:01:06.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 370 2015-11-29T19:01:07.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 370 2015-11-29T19:01:07.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 370 2015-11-29T19:01:07.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 370 2015-11-29T19:01:07.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 370 2015-11-29T19:01:07.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 370 2015-11-29T19:01:07.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 370 2015-11-29T19:01:07.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 370 2015-11-29T19:01:07.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 370 2015-11-29T19:01:07.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 370 2015-11-29T19:01:07.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 370 2015-11-29T19:01:07.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 370 2015-11-29T19:01:07.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 370 2015-11-29T19:01:07.374-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 7.24µs CommitTime 628.728199ms TotalFlushTime 8m39.183951754s TotalCommitTime 1m6.070584495s 2015-11-29T19:01:07.374-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7574322, 7574322, 110 committed:true 2015-11-29T19:01:07.374-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7574322, 7574322, 110 committed:true) SnapCreateDur 639.227121ms SnapOpenDur 44.98µs 2015-11-29T19:01:07.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 370 2015-11-29T19:01:07.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 370 2015-11-29T19:01:07.411-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:07.44-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 370 2015-11-29T19:01:07.446-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:07.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 370 2015-11-29T19:01:07.474-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:07.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 370 2015-11-29T19:01:07.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 370 2015-11-29T19:01:07.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 370 2015-11-29T19:01:07.56-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15160000 QueuedCount 50000 2015-11-29T19:01:07.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 370 2015-11-29T19:01:07.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 370 2015-11-29T19:01:07.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 370 2015-11-29T19:01:07.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 370 2015-11-29T19:01:07.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 370 2015-11-29T19:01:07.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 370 2015-11-29T19:01:07.764-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15170000 QueuedCount 50000 2015-11-29T19:01:07.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 370 2015-11-29T19:01:07.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 370 2015-11-29T19:01:07.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 370 2015-11-29T19:01:07.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 370 2015-11-29T19:01:07.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 370 2015-11-29T19:01:07.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 370 2015-11-29T19:01:07.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 370 2015-11-29T19:01:07.952-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15180000 QueuedCount 50000 2015-11-29T19:01:07.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 370 2015-11-29T19:01:08.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 370 2015-11-29T19:01:08.013-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:08.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 370 2015-11-29T19:01:08.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 370 2015-11-29T19:01:08.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 370 2015-11-29T19:01:08.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 370 2015-11-29T19:01:08.153-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15190000 QueuedCount 50000 2015-11-29T19:01:08.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 370 2015-11-29T19:01:08.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 370 2015-11-29T19:01:08.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 370 2015-11-29T19:01:08.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 370 2015-11-29T19:01:08.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 370 2015-11-29T19:01:08.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 370 2015-11-29T19:01:08.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 370 2015-11-29T19:01:08.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 370 2015-11-29T19:01:08.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 370 2015-11-29T19:01:08.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 370 2015-11-29T19:01:08.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 370 2015-11-29T19:01:08.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 370 2015-11-29T19:01:08.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 370 2015-11-29T19:01:08.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 370 2015-11-29T19:01:08.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 370 2015-11-29T19:01:08.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 370 2015-11-29T19:01:08.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 370 2015-11-29T19:01:08.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 370 2015-11-29T19:01:08.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 370 2015-11-29T19:01:08.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 370 2015-11-29T19:01:08.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 370 2015-11-29T19:01:08.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 370 2015-11-29T19:01:08.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 370 2015-11-29T19:01:08.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 370 2015-11-29T19:01:08.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 370 2015-11-29T19:01:08.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 370 2015-11-29T19:01:08.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 370 2015-11-29T19:01:08.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 370 2015-11-29T19:01:08.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 370 2015-11-29T19:01:09.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 370 2015-11-29T19:01:09.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 370 2015-11-29T19:01:09.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 370 2015-11-29T19:01:09.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 370 2015-11-29T19:01:09.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 370 2015-11-29T19:01:09.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 370 2015-11-29T19:01:09.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 370 2015-11-29T19:01:09.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 370 2015-11-29T19:01:09.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 370 2015-11-29T19:01:09.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 370 2015-11-29T19:01:09.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 370 2015-11-29T19:01:09.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 370 2015-11-29T19:01:09.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 370 2015-11-29T19:01:09.404-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:09.405-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15200000 QueuedCount 49967 2015-11-29T19:01:09.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 370 2015-11-29T19:01:09.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 370 2015-11-29T19:01:09.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 370 2015-11-29T19:01:09.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 370 2015-11-29T19:01:09.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 370 2015-11-29T19:01:09.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 370 2015-11-29T19:01:09.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 370 2015-11-29T19:01:09.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 370 2015-11-29T19:01:09.644-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15210000 QueuedCount 50000 2015-11-29T19:01:09.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 370 2015-11-29T19:01:09.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 370 2015-11-29T19:01:09.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 370 2015-11-29T19:01:09.728-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:09.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 370 2015-11-29T19:01:09.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 370 2015-11-29T19:01:09.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 370 2015-11-29T19:01:09.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 370 2015-11-29T19:01:09.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 370 2015-11-29T19:01:09.884-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15220000 QueuedCount 50000 2015-11-29T19:01:09.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 370 2015-11-29T19:01:09.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 370 2015-11-29T19:01:09.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 370 2015-11-29T19:01:09.976-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:09.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 370 2015-11-29T19:01:10.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 370 2015-11-29T19:01:10.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 370 2015-11-29T19:01:10.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 370 2015-11-29T19:01:10.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 370 2015-11-29T19:01:10.136-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:10.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 370 2015-11-29T19:01:10.139-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15230000 QueuedCount 49856 2015-11-29T19:01:10.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 370 2015-11-29T19:01:10.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 370 2015-11-29T19:01:10.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 370 2015-11-29T19:01:10.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 370 2015-11-29T19:01:10.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 370 2015-11-29T19:01:10.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 370 2015-11-29T19:01:10.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 370 2015-11-29T19:01:10.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 370 2015-11-29T19:01:10.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 370 2015-11-29T19:01:10.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 370 2015-11-29T19:01:10.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 370 2015-11-29T19:01:10.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 370 2015-11-29T19:01:10.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 370 2015-11-29T19:01:10.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 370 2015-11-29T19:01:10.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 370 2015-11-29T19:01:10.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 370 2015-11-29T19:01:10.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 370 2015-11-29T19:01:10.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 370 2015-11-29T19:01:10.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 370 2015-11-29T19:01:10.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 370 2015-11-29T19:01:10.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 370 2015-11-29T19:01:10.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 370 2015-11-29T19:01:10.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 370 2015-11-29T19:01:10.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 370 2015-11-29T19:01:10.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 370 2015-11-29T19:01:10.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 370 2015-11-29T19:01:10.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 370 2015-11-29T19:01:10.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 370 2015-11-29T19:01:11.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 370 2015-11-29T19:01:11.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 370 2015-11-29T19:01:11.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 370 2015-11-29T19:01:11.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 370 2015-11-29T19:01:11.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 370 2015-11-29T19:01:11.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 370 2015-11-29T19:01:11.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 370 2015-11-29T19:01:11.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 370 2015-11-29T19:01:11.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 370 2015-11-29T19:01:11.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 370 2015-11-29T19:01:11.288-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15240000 QueuedCount 50000 2015-11-29T19:01:11.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 370 2015-11-29T19:01:11.308-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:11.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 370 2015-11-29T19:01:11.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 370 2015-11-29T19:01:11.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 370 2015-11-29T19:01:11.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 370 2015-11-29T19:01:11.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 370 2015-11-29T19:01:11.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 370 2015-11-29T19:01:11.502-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15250000 QueuedCount 50000 2015-11-29T19:01:11.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 370 2015-11-29T19:01:11.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 370 2015-11-29T19:01:11.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 370 2015-11-29T19:01:11.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 370 2015-11-29T19:01:11.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 370 2015-11-29T19:01:11.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 370 2015-11-29T19:01:11.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 370 2015-11-29T19:01:11.712-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15260000 QueuedCount 41159 2015-11-29T19:01:11.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 370 2015-11-29T19:01:11.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 370 2015-11-29T19:01:11.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 370 2015-11-29T19:01:11.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 370 2015-11-29T19:01:11.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 370 2015-11-29T19:01:11.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 370 2015-11-29T19:01:11.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 370 2015-11-29T19:01:11.919-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15270000 QueuedCount 31159 2015-11-29T19:01:11.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 370 2015-11-29T19:01:11.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 370 2015-11-29T19:01:11.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 370 2015-11-29T19:01:12.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 370 2015-11-29T19:01:12.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 370 2015-11-29T19:01:12.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 370 2015-11-29T19:01:12.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 370 2015-11-29T19:01:12.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 370 2015-11-29T19:01:12.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 370 2015-11-29T19:01:12.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 370 2015-11-29T19:01:12.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 370 2015-11-29T19:01:12.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 370 2015-11-29T19:01:12.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 370 2015-11-29T19:01:12.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 370 2015-11-29T19:01:12.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 370 2015-11-29T19:01:12.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 370 2015-11-29T19:01:12.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 370 2015-11-29T19:01:12.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 370 2015-11-29T19:01:12.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 370 2015-11-29T19:01:12.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 370 2015-11-29T19:01:12.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 370 2015-11-29T19:01:12.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 370 2015-11-29T19:01:12.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 370 2015-11-29T19:01:12.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 370 2015-11-29T19:01:12.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 370 2015-11-29T19:01:12.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 370 2015-11-29T19:01:12.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 370 2015-11-29T19:01:12.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 370 2015-11-29T19:01:12.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 370 2015-11-29T19:01:12.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 370 2015-11-29T19:01:12.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 370 2015-11-29T19:01:12.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 370 2015-11-29T19:01:12.869-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15280000 QueuedCount 21159 2015-11-29T19:01:12.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 370 2015-11-29T19:01:12.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 370 2015-11-29T19:01:12.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 370 2015-11-29T19:01:12.974-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15290000 QueuedCount 11159 2015-11-29T19:01:12.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 370 2015-11-29T19:01:13.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 370 2015-11-29T19:01:13.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 370 2015-11-29T19:01:13.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 370 2015-11-29T19:01:13.083-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15300000 QueuedCount 1159 2015-11-29T19:01:13.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 370 2015-11-29T19:01:13.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 370 2015-11-29T19:01:13.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 370 2015-11-29T19:01:13.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 370 2015-11-29T19:01:13.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 370 2015-11-29T19:01:13.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 370 2015-11-29T19:01:13.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 370 2015-11-29T19:01:13.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 370 2015-11-29T19:01:13.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 370 2015-11-29T19:01:13.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 370 2015-11-29T19:01:13.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 370 2015-11-29T19:01:13.41-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 3094208154756435235 Data:2351720802, Disk:7039967232, ExtraSnapshotData:0, Fragmentation:66.59471948519433% 2015-11-29T19:01:13.41-08:00 [Info] CompactionDaemon: Compacting index instance:3094208154756435235 2015-11-29T19:01:13.433-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 7372854. Slice Id 0, IndexInstId 3094208154756435235, IndexDefnId 3094208154756435235 2015-11-29T19:01:13.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 370 2015-11-29T19:01:13.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 370 2015-11-29T19:01:13.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 370 2015-11-29T19:01:13.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 370 2015-11-29T19:01:13.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 370 2015-11-29T19:01:13.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 370 2015-11-29T19:01:13.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 370 2015-11-29T19:01:13.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 370 2015-11-29T19:01:13.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 370 2015-11-29T19:01:13.704-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 4.632µs CommitTime 590.337731ms TotalFlushTime 8m44.498167107s TotalCommitTime 1m6.660922226s 2015-11-29T19:01:13.704-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7648568, 7648568, 111 committed:true 2015-11-29T19:01:13.704-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7648568, 7648568, 111 committed:true) SnapCreateDur 603.085064ms SnapOpenDur 513.363µs 2015-11-29T19:01:13.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 370 2015-11-29T19:01:13.734-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:13.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 370 2015-11-29T19:01:13.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 370 2015-11-29T19:01:13.782-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:13.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 370 2015-11-29T19:01:13.812-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:13.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 370 2015-11-29T19:01:13.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 370 2015-11-29T19:01:13.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 370 2015-11-29T19:01:13.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 370 2015-11-29T19:01:13.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 370 2015-11-29T19:01:13.954-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15310000 QueuedCount 50000 2015-11-29T19:01:13.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 370 2015-11-29T19:01:14.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 370 2015-11-29T19:01:14.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 370 2015-11-29T19:01:14.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 370 2015-11-29T19:01:14.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 370 2015-11-29T19:01:14.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 370 2015-11-29T19:01:14.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 370 2015-11-29T19:01:14.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 370 2015-11-29T19:01:14.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 370 2015-11-29T19:01:14.247-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15320000 QueuedCount 50000 2015-11-29T19:01:14.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 370 2015-11-29T19:01:14.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 370 2015-11-29T19:01:14.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:14.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 370 2015-11-29T19:01:14.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 370 2015-11-29T19:01:14.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 370 2015-11-29T19:01:14.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 370 2015-11-29T19:01:14.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 370 2015-11-29T19:01:14.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 370 2015-11-29T19:01:14.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 370 2015-11-29T19:01:14.515-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15330000 QueuedCount 50000 2015-11-29T19:01:14.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 370 2015-11-29T19:01:14.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 370 2015-11-29T19:01:14.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 370 2015-11-29T19:01:14.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 370 2015-11-29T19:01:14.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 370 2015-11-29T19:01:14.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 370 2015-11-29T19:01:14.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18480 Milliseconds Vbucket 370 2015-11-29T19:01:14.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18510 Milliseconds Vbucket 370 2015-11-29T19:01:14.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18540 Milliseconds Vbucket 370 2015-11-29T19:01:14.768-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15340000 QueuedCount 50000 2015-11-29T19:01:14.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18570 Milliseconds Vbucket 370 2015-11-29T19:01:14.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18600 Milliseconds Vbucket 370 2015-11-29T19:01:14.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18630 Milliseconds Vbucket 370 2015-11-29T19:01:14.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18660 Milliseconds Vbucket 370 2015-11-29T19:01:14.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18690 Milliseconds Vbucket 370 2015-11-29T19:01:14.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18720 Milliseconds Vbucket 370 2015-11-29T19:01:14.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18750 Milliseconds Vbucket 370 2015-11-29T19:01:14.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18780 Milliseconds Vbucket 370 2015-11-29T19:01:15.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18810 Milliseconds Vbucket 370 2015-11-29T19:01:15.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18840 Milliseconds Vbucket 370 2015-11-29T19:01:15.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18870 Milliseconds Vbucket 370 2015-11-29T19:01:15.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18900 Milliseconds Vbucket 370 2015-11-29T19:01:15.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18930 Milliseconds Vbucket 370 2015-11-29T19:01:15.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18960 Milliseconds Vbucket 370 2015-11-29T19:01:15.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18990 Milliseconds Vbucket 370 2015-11-29T19:01:15.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19020 Milliseconds Vbucket 370 2015-11-29T19:01:15.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19050 Milliseconds Vbucket 370 2015-11-29T19:01:15.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19080 Milliseconds Vbucket 370 2015-11-29T19:01:15.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19110 Milliseconds Vbucket 370 2015-11-29T19:01:15.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19140 Milliseconds Vbucket 370 2015-11-29T19:01:15.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19170 Milliseconds Vbucket 370 2015-11-29T19:01:15.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19200 Milliseconds Vbucket 370 2015-11-29T19:01:15.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19230 Milliseconds Vbucket 370 2015-11-29T19:01:15.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19260 Milliseconds Vbucket 370 2015-11-29T19:01:15.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19290 Milliseconds Vbucket 370 2015-11-29T19:01:15.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19320 Milliseconds Vbucket 370 2015-11-29T19:01:15.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19350 Milliseconds Vbucket 370 2015-11-29T19:01:15.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19380 Milliseconds Vbucket 370 2015-11-29T19:01:15.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19410 Milliseconds Vbucket 370 2015-11-29T19:01:15.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19440 Milliseconds Vbucket 370 2015-11-29T19:01:15.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19470 Milliseconds Vbucket 370 2015-11-29T19:01:15.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19500 Milliseconds Vbucket 370 2015-11-29T19:01:15.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19530 Milliseconds Vbucket 370 2015-11-29T19:01:15.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19560 Milliseconds Vbucket 370 2015-11-29T19:01:15.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19590 Milliseconds Vbucket 370 2015-11-29T19:01:15.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19620 Milliseconds Vbucket 370 2015-11-29T19:01:15.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19650 Milliseconds Vbucket 370 2015-11-29T19:01:15.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19680 Milliseconds Vbucket 370 2015-11-29T19:01:15.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19710 Milliseconds Vbucket 370 2015-11-29T19:01:15.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19740 Milliseconds Vbucket 370 2015-11-29T19:01:15.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19770 Milliseconds Vbucket 370 2015-11-29T19:01:16.009-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15350000 QueuedCount 50000 2015-11-29T19:01:16.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19800 Milliseconds Vbucket 370 2015-11-29T19:01:16.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19830 Milliseconds Vbucket 370 2015-11-29T19:01:16.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19860 Milliseconds Vbucket 370 2015-11-29T19:01:16.094-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:16.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19890 Milliseconds Vbucket 370 2015-11-29T19:01:16.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19920 Milliseconds Vbucket 370 2015-11-29T19:01:16.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19950 Milliseconds Vbucket 370 2015-11-29T19:01:16.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19980 Milliseconds Vbucket 370 2015-11-29T19:01:16.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20010 Milliseconds Vbucket 370 2015-11-29T19:01:16.239-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15360000 QueuedCount 50000 2015-11-29T19:01:16.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20040 Milliseconds Vbucket 370 2015-11-29T19:01:16.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20070 Milliseconds Vbucket 370 2015-11-29T19:01:16.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20100 Milliseconds Vbucket 370 2015-11-29T19:01:16.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20130 Milliseconds Vbucket 370 2015-11-29T19:01:16.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20160 Milliseconds Vbucket 370 2015-11-29T19:01:16.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20190 Milliseconds Vbucket 370 2015-11-29T19:01:16.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20220 Milliseconds Vbucket 370 2015-11-29T19:01:16.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20250 Milliseconds Vbucket 370 2015-11-29T19:01:16.484-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15370000 QueuedCount 50000 2015-11-29T19:01:16.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20280 Milliseconds Vbucket 370 2015-11-29T19:01:16.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20310 Milliseconds Vbucket 370 2015-11-29T19:01:16.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20340 Milliseconds Vbucket 370 2015-11-29T19:01:16.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20370 Milliseconds Vbucket 370 2015-11-29T19:01:16.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20400 Milliseconds Vbucket 370 2015-11-29T19:01:16.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20430 Milliseconds Vbucket 370 2015-11-29T19:01:16.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20460 Milliseconds Vbucket 370 2015-11-29T19:01:16.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20490 Milliseconds Vbucket 370 2015-11-29T19:01:16.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20520 Milliseconds Vbucket 370 2015-11-29T19:01:16.767-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15380000 QueuedCount 50000 2015-11-29T19:01:16.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20550 Milliseconds Vbucket 370 2015-11-29T19:01:16.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20580 Milliseconds Vbucket 370 2015-11-29T19:01:16.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20610 Milliseconds Vbucket 370 2015-11-29T19:01:16.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20640 Milliseconds Vbucket 370 2015-11-29T19:01:16.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20670 Milliseconds Vbucket 370 2015-11-29T19:01:16.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20700 Milliseconds Vbucket 370 2015-11-29T19:01:16.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20730 Milliseconds Vbucket 370 2015-11-29T19:01:16.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20760 Milliseconds Vbucket 370 2015-11-29T19:01:17.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20790 Milliseconds Vbucket 370 2015-11-29T19:01:17.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20820 Milliseconds Vbucket 370 2015-11-29T19:01:17.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20850 Milliseconds Vbucket 370 2015-11-29T19:01:17.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20880 Milliseconds Vbucket 370 2015-11-29T19:01:17.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20910 Milliseconds Vbucket 370 2015-11-29T19:01:17.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20940 Milliseconds Vbucket 370 2015-11-29T19:01:17.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20970 Milliseconds Vbucket 370 2015-11-29T19:01:17.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21000 Milliseconds Vbucket 370 2015-11-29T19:01:17.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21030 Milliseconds Vbucket 370 2015-11-29T19:01:17.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21060 Milliseconds Vbucket 370 2015-11-29T19:01:17.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21090 Milliseconds Vbucket 370 2015-11-29T19:01:17.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21120 Milliseconds Vbucket 370 2015-11-29T19:01:17.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21150 Milliseconds Vbucket 370 2015-11-29T19:01:17.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21180 Milliseconds Vbucket 370 2015-11-29T19:01:17.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21210 Milliseconds Vbucket 370 2015-11-29T19:01:17.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21240 Milliseconds Vbucket 370 2015-11-29T19:01:17.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21270 Milliseconds Vbucket 370 2015-11-29T19:01:17.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21300 Milliseconds Vbucket 370 2015-11-29T19:01:17.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21330 Milliseconds Vbucket 370 2015-11-29T19:01:17.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21360 Milliseconds Vbucket 370 2015-11-29T19:01:17.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21390 Milliseconds Vbucket 370 2015-11-29T19:01:17.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21420 Milliseconds Vbucket 370 2015-11-29T19:01:17.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21450 Milliseconds Vbucket 370 2015-11-29T19:01:17.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21480 Milliseconds Vbucket 370 2015-11-29T19:01:17.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21510 Milliseconds Vbucket 370 2015-11-29T19:01:17.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21540 Milliseconds Vbucket 370 2015-11-29T19:01:17.76-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:17.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21570 Milliseconds Vbucket 370 2015-11-29T19:01:17.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21600 Milliseconds Vbucket 370 2015-11-29T19:01:17.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21630 Milliseconds Vbucket 370 2015-11-29T19:01:17.849-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15390000 QueuedCount 50000 2015-11-29T19:01:17.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21660 Milliseconds Vbucket 370 2015-11-29T19:01:17.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21690 Milliseconds Vbucket 370 2015-11-29T19:01:17.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21720 Milliseconds Vbucket 370 2015-11-29T19:01:17.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21750 Milliseconds Vbucket 370 2015-11-29T19:01:17.977-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15400000 QueuedCount 50000 2015-11-29T19:01:17.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21780 Milliseconds Vbucket 370 2015-11-29T19:01:18.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21810 Milliseconds Vbucket 370 2015-11-29T19:01:18.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21840 Milliseconds Vbucket 370 2015-11-29T19:01:18.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21870 Milliseconds Vbucket 370 2015-11-29T19:01:18.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21900 Milliseconds Vbucket 370 2015-11-29T19:01:18.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21930 Milliseconds Vbucket 370 2015-11-29T19:01:18.154-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15410000 QueuedCount 48136 2015-11-29T19:01:18.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21960 Milliseconds Vbucket 370 2015-11-29T19:01:18.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21990 Milliseconds Vbucket 370 2015-11-29T19:01:18.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22020 Milliseconds Vbucket 370 2015-11-29T19:01:18.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22050 Milliseconds Vbucket 370 2015-11-29T19:01:18.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22080 Milliseconds Vbucket 370 2015-11-29T19:01:18.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22110 Milliseconds Vbucket 370 2015-11-29T19:01:18.355-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15420000 QueuedCount 38136 2015-11-29T19:01:18.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22140 Milliseconds Vbucket 370 2015-11-29T19:01:18.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22170 Milliseconds Vbucket 370 2015-11-29T19:01:18.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22200 Milliseconds Vbucket 370 2015-11-29T19:01:18.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22230 Milliseconds Vbucket 370 2015-11-29T19:01:18.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22260 Milliseconds Vbucket 370 2015-11-29T19:01:18.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22290 Milliseconds Vbucket 370 2015-11-29T19:01:18.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22320 Milliseconds Vbucket 370 2015-11-29T19:01:18.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22350 Milliseconds Vbucket 370 2015-11-29T19:01:18.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22380 Milliseconds Vbucket 370 2015-11-29T19:01:18.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22410 Milliseconds Vbucket 370 2015-11-29T19:01:18.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22440 Milliseconds Vbucket 370 2015-11-29T19:01:18.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22470 Milliseconds Vbucket 370 2015-11-29T19:01:18.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22500 Milliseconds Vbucket 370 2015-11-29T19:01:18.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22530 Milliseconds Vbucket 370 2015-11-29T19:01:18.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22560 Milliseconds Vbucket 370 2015-11-29T19:01:18.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22590 Milliseconds Vbucket 370 2015-11-29T19:01:18.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22620 Milliseconds Vbucket 370 2015-11-29T19:01:18.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22650 Milliseconds Vbucket 370 2015-11-29T19:01:18.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22680 Milliseconds Vbucket 370 2015-11-29T19:01:18.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22710 Milliseconds Vbucket 370 2015-11-29T19:01:18.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22740 Milliseconds Vbucket 370 2015-11-29T19:01:18.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22770 Milliseconds Vbucket 370 2015-11-29T19:01:19.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22800 Milliseconds Vbucket 370 2015-11-29T19:01:19.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22830 Milliseconds Vbucket 370 2015-11-29T19:01:19.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22860 Milliseconds Vbucket 370 2015-11-29T19:01:19.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22890 Milliseconds Vbucket 370 2015-11-29T19:01:19.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22920 Milliseconds Vbucket 370 2015-11-29T19:01:19.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22950 Milliseconds Vbucket 370 2015-11-29T19:01:19.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22980 Milliseconds Vbucket 370 2015-11-29T19:01:19.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23010 Milliseconds Vbucket 370 2015-11-29T19:01:19.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23040 Milliseconds Vbucket 370 2015-11-29T19:01:19.282-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15430000 QueuedCount 28136 2015-11-29T19:01:19.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23070 Milliseconds Vbucket 370 2015-11-29T19:01:19.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23100 Milliseconds Vbucket 370 2015-11-29T19:01:19.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23130 Milliseconds Vbucket 370 2015-11-29T19:01:19.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23160 Milliseconds Vbucket 370 2015-11-29T19:01:19.396-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15440000 QueuedCount 18136 2015-11-29T19:01:19.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23190 Milliseconds Vbucket 370 2015-11-29T19:01:19.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23220 Milliseconds Vbucket 370 2015-11-29T19:01:19.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23250 Milliseconds Vbucket 370 2015-11-29T19:01:19.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23280 Milliseconds Vbucket 370 2015-11-29T19:01:19.501-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15450000 QueuedCount 8136 2015-11-29T19:01:19.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23310 Milliseconds Vbucket 370 2015-11-29T19:01:19.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23340 Milliseconds Vbucket 370 2015-11-29T19:01:19.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23370 Milliseconds Vbucket 370 2015-11-29T19:01:19.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23400 Milliseconds Vbucket 370 2015-11-29T19:01:19.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23430 Milliseconds Vbucket 370 2015-11-29T19:01:19.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23460 Milliseconds Vbucket 370 2015-11-29T19:01:19.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23490 Milliseconds Vbucket 370 2015-11-29T19:01:19.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23520 Milliseconds Vbucket 370 2015-11-29T19:01:19.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23550 Milliseconds Vbucket 370 2015-11-29T19:01:19.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23580 Milliseconds Vbucket 370 2015-11-29T19:01:19.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23610 Milliseconds Vbucket 370 2015-11-29T19:01:19.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23640 Milliseconds Vbucket 370 2015-11-29T19:01:19.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23670 Milliseconds Vbucket 370 2015-11-29T19:01:19.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23700 Milliseconds Vbucket 370 2015-11-29T19:01:19.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23730 Milliseconds Vbucket 370 2015-11-29T19:01:19.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23760 Milliseconds Vbucket 370 2015-11-29T19:01:20.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23790 Milliseconds Vbucket 370 2015-11-29T19:01:20.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23820 Milliseconds Vbucket 370 2015-11-29T19:01:20.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23850 Milliseconds Vbucket 370 2015-11-29T19:01:20.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23880 Milliseconds Vbucket 370 2015-11-29T19:01:20.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23910 Milliseconds Vbucket 370 2015-11-29T19:01:20.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23940 Milliseconds Vbucket 370 2015-11-29T19:01:20.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23970 Milliseconds Vbucket 370 2015-11-29T19:01:20.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24000 Milliseconds Vbucket 370 2015-11-29T19:01:20.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24030 Milliseconds Vbucket 370 2015-11-29T19:01:20.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24060 Milliseconds Vbucket 370 2015-11-29T19:01:20.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24090 Milliseconds Vbucket 370 2015-11-29T19:01:20.315-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 1.988µs CommitTime 715.110325ms TotalFlushTime 8m49.911086968s TotalCommitTime 1m7.376032551s 2015-11-29T19:01:20.315-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7727796, 7727796, 112 committed:true 2015-11-29T19:01:20.315-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7727796, 7727796, 112 committed:true) SnapCreateDur 727.970413ms SnapOpenDur 53.01µs 2015-11-29T19:01:20.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24120 Milliseconds Vbucket 370 2015-11-29T19:01:20.352-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:20.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24150 Milliseconds Vbucket 370 2015-11-29T19:01:20.374-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15460000 QueuedCount 21330 2015-11-29T19:01:20.39-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:20.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24180 Milliseconds Vbucket 370 2015-11-29T19:01:20.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24210 Milliseconds Vbucket 370 2015-11-29T19:01:20.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24240 Milliseconds Vbucket 370 2015-11-29T19:01:20.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24270 Milliseconds Vbucket 370 2015-11-29T19:01:20.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24300 Milliseconds Vbucket 370 2015-11-29T19:01:20.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24330 Milliseconds Vbucket 370 2015-11-29T19:01:20.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24360 Milliseconds Vbucket 370 2015-11-29T19:01:20.59-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15470000 QueuedCount 50000 2015-11-29T19:01:20.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24390 Milliseconds Vbucket 370 2015-11-29T19:01:20.627-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:20.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24420 Milliseconds Vbucket 370 2015-11-29T19:01:20.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24450 Milliseconds Vbucket 370 2015-11-29T19:01:20.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24480 Milliseconds Vbucket 370 2015-11-29T19:01:20.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24510 Milliseconds Vbucket 370 2015-11-29T19:01:20.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24540 Milliseconds Vbucket 370 2015-11-29T19:01:20.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24570 Milliseconds Vbucket 370 2015-11-29T19:01:20.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24600 Milliseconds Vbucket 370 2015-11-29T19:01:20.823-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15480000 QueuedCount 49998 2015-11-29T19:01:20.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24630 Milliseconds Vbucket 370 2015-11-29T19:01:20.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24660 Milliseconds Vbucket 370 2015-11-29T19:01:20.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24690 Milliseconds Vbucket 370 2015-11-29T19:01:20.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24720 Milliseconds Vbucket 370 2015-11-29T19:01:20.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24750 Milliseconds Vbucket 370 2015-11-29T19:01:20.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24780 Milliseconds Vbucket 370 2015-11-29T19:01:21.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24810 Milliseconds Vbucket 370 2015-11-29T19:01:21.047-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15490000 QueuedCount 50000 2015-11-29T19:01:21.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24840 Milliseconds Vbucket 370 2015-11-29T19:01:21.081-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:21.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24870 Milliseconds Vbucket 370 2015-11-29T19:01:21.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24900 Milliseconds Vbucket 370 2015-11-29T19:01:21.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24930 Milliseconds Vbucket 370 2015-11-29T19:01:21.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24960 Milliseconds Vbucket 370 2015-11-29T19:01:21.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24990 Milliseconds Vbucket 370 2015-11-29T19:01:21.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25020 Milliseconds Vbucket 370 2015-11-29T19:01:21.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25050 Milliseconds Vbucket 370 2015-11-29T19:01:21.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25080 Milliseconds Vbucket 370 2015-11-29T19:01:21.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25110 Milliseconds Vbucket 370 2015-11-29T19:01:21.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25140 Milliseconds Vbucket 370 2015-11-29T19:01:21.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25170 Milliseconds Vbucket 370 2015-11-29T19:01:21.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25200 Milliseconds Vbucket 370 2015-11-29T19:01:21.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25230 Milliseconds Vbucket 370 2015-11-29T19:01:21.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25260 Milliseconds Vbucket 370 2015-11-29T19:01:21.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25290 Milliseconds Vbucket 370 2015-11-29T19:01:21.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25320 Milliseconds Vbucket 370 2015-11-29T19:01:21.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25350 Milliseconds Vbucket 370 2015-11-29T19:01:21.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25380 Milliseconds Vbucket 370 2015-11-29T19:01:21.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25410 Milliseconds Vbucket 370 2015-11-29T19:01:21.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25440 Milliseconds Vbucket 370 2015-11-29T19:01:21.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25470 Milliseconds Vbucket 370 2015-11-29T19:01:21.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25500 Milliseconds Vbucket 370 2015-11-29T19:01:21.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25530 Milliseconds Vbucket 370 2015-11-29T19:01:21.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25560 Milliseconds Vbucket 370 2015-11-29T19:01:21.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25590 Milliseconds Vbucket 370 2015-11-29T19:01:21.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25620 Milliseconds Vbucket 370 2015-11-29T19:01:21.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25650 Milliseconds Vbucket 370 2015-11-29T19:01:21.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25680 Milliseconds Vbucket 370 2015-11-29T19:01:21.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25710 Milliseconds Vbucket 370 2015-11-29T19:01:21.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25740 Milliseconds Vbucket 370 2015-11-29T19:01:21.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25770 Milliseconds Vbucket 370 2015-11-29T19:01:21.998-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15500000 QueuedCount 50000 2015-11-29T19:01:22.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25800 Milliseconds Vbucket 370 2015-11-29T19:01:22.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25830 Milliseconds Vbucket 370 2015-11-29T19:01:22.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25860 Milliseconds Vbucket 370 2015-11-29T19:01:22.104-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15510000 QueuedCount 50000 2015-11-29T19:01:22.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25890 Milliseconds Vbucket 370 2015-11-29T19:01:22.109-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:22.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25920 Milliseconds Vbucket 370 2015-11-29T19:01:22.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25950 Milliseconds Vbucket 370 2015-11-29T19:01:22.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25980 Milliseconds Vbucket 370 2015-11-29T19:01:22.216-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15520000 QueuedCount 50000 2015-11-29T19:01:22.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26010 Milliseconds Vbucket 370 2015-11-29T19:01:22.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26040 Milliseconds Vbucket 370 2015-11-29T19:01:22.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26070 Milliseconds Vbucket 370 2015-11-29T19:01:22.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26100 Milliseconds Vbucket 370 2015-11-29T19:01:22.336-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:22.348-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15530000 QueuedCount 49227 2015-11-29T19:01:22.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26130 Milliseconds Vbucket 370 2015-11-29T19:01:22.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26160 Milliseconds Vbucket 370 2015-11-29T19:01:22.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26190 Milliseconds Vbucket 370 2015-11-29T19:01:22.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26220 Milliseconds Vbucket 370 2015-11-29T19:01:22.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26250 Milliseconds Vbucket 370 2015-11-29T19:01:22.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26280 Milliseconds Vbucket 370 2015-11-29T19:01:22.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26310 Milliseconds Vbucket 370 2015-11-29T19:01:22.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26340 Milliseconds Vbucket 370 2015-11-29T19:01:22.559-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15540000 QueuedCount 50000 2015-11-29T19:01:22.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26370 Milliseconds Vbucket 370 2015-11-29T19:01:22.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26400 Milliseconds Vbucket 370 2015-11-29T19:01:22.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26430 Milliseconds Vbucket 370 2015-11-29T19:01:22.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26460 Milliseconds Vbucket 370 2015-11-29T19:01:22.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26490 Milliseconds Vbucket 370 2015-11-29T19:01:22.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26520 Milliseconds Vbucket 370 2015-11-29T19:01:22.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26550 Milliseconds Vbucket 370 2015-11-29T19:01:22.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26580 Milliseconds Vbucket 370 2015-11-29T19:01:22.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26610 Milliseconds Vbucket 370 2015-11-29T19:01:22.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26640 Milliseconds Vbucket 370 2015-11-29T19:01:22.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26670 Milliseconds Vbucket 370 2015-11-29T19:01:22.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26700 Milliseconds Vbucket 370 2015-11-29T19:01:22.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26730 Milliseconds Vbucket 370 2015-11-29T19:01:22.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26760 Milliseconds Vbucket 370 2015-11-29T19:01:23.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26790 Milliseconds Vbucket 370 2015-11-29T19:01:23.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26820 Milliseconds Vbucket 370 2015-11-29T19:01:23.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26850 Milliseconds Vbucket 370 2015-11-29T19:01:23.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26880 Milliseconds Vbucket 370 2015-11-29T19:01:23.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26910 Milliseconds Vbucket 370 2015-11-29T19:01:23.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26940 Milliseconds Vbucket 370 2015-11-29T19:01:23.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 26970 Milliseconds Vbucket 370 2015-11-29T19:01:23.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27000 Milliseconds Vbucket 370 2015-11-29T19:01:23.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27030 Milliseconds Vbucket 370 2015-11-29T19:01:23.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27060 Milliseconds Vbucket 370 2015-11-29T19:01:23.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27090 Milliseconds Vbucket 370 2015-11-29T19:01:23.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27120 Milliseconds Vbucket 370 2015-11-29T19:01:23.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27150 Milliseconds Vbucket 370 2015-11-29T19:01:23.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27180 Milliseconds Vbucket 370 2015-11-29T19:01:23.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27210 Milliseconds Vbucket 370 2015-11-29T19:01:23.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27240 Milliseconds Vbucket 370 2015-11-29T19:01:23.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27270 Milliseconds Vbucket 370 2015-11-29T19:01:23.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27300 Milliseconds Vbucket 370 2015-11-29T19:01:23.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27330 Milliseconds Vbucket 370 2015-11-29T19:01:23.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27360 Milliseconds Vbucket 370 2015-11-29T19:01:23.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27390 Milliseconds Vbucket 370 2015-11-29T19:01:23.637-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15550000 QueuedCount 50000 2015-11-29T19:01:23.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27420 Milliseconds Vbucket 370 2015-11-29T19:01:23.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27450 Milliseconds Vbucket 370 2015-11-29T19:01:23.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27480 Milliseconds Vbucket 370 2015-11-29T19:01:23.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27510 Milliseconds Vbucket 370 2015-11-29T19:01:23.754-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:23.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 27540 Milliseconds Vbucket 370 2015-11-29T19:01:23.857-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15560000 QueuedCount 50000 2015-11-29T19:01:24.074-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15570000 QueuedCount 50000 2015-11-29T19:01:24.313-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15580000 QueuedCount 50000 2015-11-29T19:01:25.508-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15590000 QueuedCount 42867 2015-11-29T19:01:25.66-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15600000 QueuedCount 32867 2015-11-29T19:01:26.707-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15610000 QueuedCount 22867 2015-11-29T19:01:26.918-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15620000 QueuedCount 12867 2015-11-29T19:01:27.893-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15630000 QueuedCount 2867 2015-11-29T19:01:28.352-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 2µs CommitTime 409.603965ms TotalFlushTime 8m57.093786123s TotalCommitTime 1m7.785636516s 2015-11-29T19:01:28.352-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7814844, 7814844, 113 committed:true 2015-11-29T19:01:28.352-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7814844, 7814844, 113 committed:true) SnapCreateDur 422.256972ms SnapOpenDur 66.12µs 2015-11-29T19:01:28.375-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.397-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.428-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.46-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.462-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15640000 QueuedCount 23281 2015-11-29T19:01:28.491-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.605-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15650000 QueuedCount 50000 2015-11-29T19:01:28.711-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:28.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 185 2015-11-29T19:01:28.846-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15660000 QueuedCount 50000 2015-11-29T19:01:28.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 185 2015-11-29T19:01:28.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 185 2015-11-29T19:01:28.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 185 2015-11-29T19:01:28.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 185 2015-11-29T19:01:28.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 185 2015-11-29T19:01:29.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 185 2015-11-29T19:01:29.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 185 2015-11-29T19:01:29.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 185 2015-11-29T19:01:29.105-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15670000 QueuedCount 50000 2015-11-29T19:01:29.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 185 2015-11-29T19:01:29.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 185 2015-11-29T19:01:29.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 185 2015-11-29T19:01:29.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 185 2015-11-29T19:01:29.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 185 2015-11-29T19:01:29.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 185 2015-11-29T19:01:29.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 185 2015-11-29T19:01:29.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 185 2015-11-29T19:01:29.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 185 2015-11-29T19:01:29.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 185 2015-11-29T19:01:29.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 185 2015-11-29T19:01:29.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 185 2015-11-29T19:01:29.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 185 2015-11-29T19:01:29.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 185 2015-11-29T19:01:29.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 185 2015-11-29T19:01:29.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 185 2015-11-29T19:01:29.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 185 2015-11-29T19:01:29.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 185 2015-11-29T19:01:29.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 185 2015-11-29T19:01:29.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 185 2015-11-29T19:01:29.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 185 2015-11-29T19:01:29.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 185 2015-11-29T19:01:29.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 185 2015-11-29T19:01:29.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 185 2015-11-29T19:01:29.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 185 2015-11-29T19:01:29.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 185 2015-11-29T19:01:29.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 185 2015-11-29T19:01:29.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 185 2015-11-29T19:01:29.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 185 2015-11-29T19:01:29.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 185 2015-11-29T19:01:30.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 185 2015-11-29T19:01:30.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 185 2015-11-29T19:01:30.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 185 2015-11-29T19:01:30.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 185 2015-11-29T19:01:30.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 185 2015-11-29T19:01:30.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 185 2015-11-29T19:01:30.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 185 2015-11-29T19:01:30.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 185 2015-11-29T19:01:30.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 185 2015-11-29T19:01:30.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 185 2015-11-29T19:01:30.291-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15680000 QueuedCount 50000 2015-11-29T19:01:30.292-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:30.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 185 2015-11-29T19:01:30.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 185 2015-11-29T19:01:30.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 185 2015-11-29T19:01:30.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 185 2015-11-29T19:01:30.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 185 2015-11-29T19:01:30.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 185 2015-11-29T19:01:30.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 185 2015-11-29T19:01:30.51-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15690000 QueuedCount 50000 2015-11-29T19:01:30.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 185 2015-11-29T19:01:30.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 185 2015-11-29T19:01:30.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 185 2015-11-29T19:01:30.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 185 2015-11-29T19:01:30.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 185 2015-11-29T19:01:30.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 185 2015-11-29T19:01:30.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 185 2015-11-29T19:01:30.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 185 2015-11-29T19:01:30.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 185 2015-11-29T19:01:30.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 185 2015-11-29T19:01:30.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 185 2015-11-29T19:01:30.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 185 2015-11-29T19:01:30.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 185 2015-11-29T19:01:30.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 185 2015-11-29T19:01:30.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 185 2015-11-29T19:01:30.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 185 2015-11-29T19:01:31.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 185 2015-11-29T19:01:31.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 185 2015-11-29T19:01:31.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 185 2015-11-29T19:01:31.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 185 2015-11-29T19:01:31.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 185 2015-11-29T19:01:31.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 185 2015-11-29T19:01:31.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 185 2015-11-29T19:01:31.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 185 2015-11-29T19:01:31.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 185 2015-11-29T19:01:31.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 185 2015-11-29T19:01:31.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 185 2015-11-29T19:01:31.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 185 2015-11-29T19:01:31.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 185 2015-11-29T19:01:31.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 185 2015-11-29T19:01:31.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 185 2015-11-29T19:01:31.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 185 2015-11-29T19:01:31.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 185 2015-11-29T19:01:31.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 185 2015-11-29T19:01:31.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 185 2015-11-29T19:01:31.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 185 2015-11-29T19:01:31.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 185 2015-11-29T19:01:31.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 185 2015-11-29T19:01:31.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 185 2015-11-29T19:01:31.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 185 2015-11-29T19:01:31.713-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15700000 QueuedCount 50000 2015-11-29T19:01:31.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 185 2015-11-29T19:01:31.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 185 2015-11-29T19:01:31.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 185 2015-11-29T19:01:31.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 185 2015-11-29T19:01:31.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 185 2015-11-29T19:01:31.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 185 2015-11-29T19:01:31.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 185 2015-11-29T19:01:31.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 185 2015-11-29T19:01:31.95-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15710000 QueuedCount 44412 2015-11-29T19:01:31.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 185 2015-11-29T19:01:31.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 185 2015-11-29T19:01:32.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 185 2015-11-29T19:01:32.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 185 2015-11-29T19:01:32.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 185 2015-11-29T19:01:32.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 185 2015-11-29T19:01:32.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 185 2015-11-29T19:01:32.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 185 2015-11-29T19:01:32.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 185 2015-11-29T19:01:32.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 185 2015-11-29T19:01:32.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 185 2015-11-29T19:01:32.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 185 2015-11-29T19:01:32.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 185 2015-11-29T19:01:32.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 185 2015-11-29T19:01:32.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 185 2015-11-29T19:01:32.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 185 2015-11-29T19:01:32.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 185 2015-11-29T19:01:32.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 185 2015-11-29T19:01:32.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 185 2015-11-29T19:01:32.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 185 2015-11-29T19:01:32.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 185 2015-11-29T19:01:32.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 185 2015-11-29T19:01:32.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 185 2015-11-29T19:01:32.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 185 2015-11-29T19:01:32.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 185 2015-11-29T19:01:32.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 185 2015-11-29T19:01:32.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 185 2015-11-29T19:01:32.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 185 2015-11-29T19:01:32.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 185 2015-11-29T19:01:32.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 185 2015-11-29T19:01:32.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 185 2015-11-29T19:01:32.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 185 2015-11-29T19:01:32.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 185 2015-11-29T19:01:32.925-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15720000 QueuedCount 34412 2015-11-29T19:01:32.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 185 2015-11-29T19:01:32.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 185 2015-11-29T19:01:33.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 185 2015-11-29T19:01:33.028-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15730000 QueuedCount 24412 2015-11-29T19:01:33.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 185 2015-11-29T19:01:33.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 185 2015-11-29T19:01:33.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 185 2015-11-29T19:01:33.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 185 2015-11-29T19:01:33.139-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15740000 QueuedCount 14412 2015-11-29T19:01:33.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 185 2015-11-29T19:01:33.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 185 2015-11-29T19:01:33.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 185 2015-11-29T19:01:33.247-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15750000 QueuedCount 4412 2015-11-29T19:01:33.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 185 2015-11-29T19:01:33.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 185 2015-11-29T19:01:33.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 185 2015-11-29T19:01:33.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 185 2015-11-29T19:01:33.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 185 2015-11-29T19:01:33.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 185 2015-11-29T19:01:33.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 185 2015-11-29T19:01:33.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 185 2015-11-29T19:01:33.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 185 2015-11-29T19:01:33.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 185 2015-11-29T19:01:33.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 185 2015-11-29T19:01:33.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 185 2015-11-29T19:01:33.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 185 2015-11-29T19:01:33.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 185 2015-11-29T19:01:33.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 185 2015-11-29T19:01:33.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 185 2015-11-29T19:01:33.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 185 2015-11-29T19:01:33.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 185 2015-11-29T19:01:33.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 185 2015-11-29T19:01:33.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 185 2015-11-29T19:01:33.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 185 2015-11-29T19:01:33.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 185 2015-11-29T19:01:33.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 185 2015-11-29T19:01:33.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 185 2015-11-29T19:01:33.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 185 2015-11-29T19:01:34.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 185 2015-11-29T19:01:34.024-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 3094208154756435235 FlushTime 3.738µs CommitTime 719.129541ms TotalFlushTime 9m1.732971391s TotalCommitTime 1m8.504766057s 2015-11-29T19:01:34.024-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 3094208154756435235 Creating New Snapshot SnapshotInfo: seqnos: 7875031, 7875031, 114 committed:true 2015-11-29T19:01:34.024-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 3094208154756435235 PartitionId: 0 SliceId: 0 Crc64: 14563537479397214175 (SnapshotInfo: seqnos: 7875031, 7875031, 114 committed:true) SnapCreateDur 729.581659ms SnapOpenDur 48.842µs 2015-11-29T19:01:34.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 185 2015-11-29T19:01:34.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 185 2015-11-29T19:01:34.061-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:34.089-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:34.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 185 2015-11-29T19:01:34.116-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:34.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 185 2015-11-29T19:01:34.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 185 2015-11-29T19:01:34.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 185 2015-11-29T19:01:34.185-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15760000 QueuedCount 50000 2015-11-29T19:01:34.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 185 2015-11-29T19:01:34.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 185 2015-11-29T19:01:34.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 185 2015-11-29T19:01:34.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 185 2015-11-29T19:01:34.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 185 2015-11-29T19:01:34.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 185 2015-11-29T19:01:34.391-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 185 2015-11-29T19:01:34.421-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 185 2015-11-29T19:01:34.448-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15770000 QueuedCount 50000 2015-11-29T19:01:34.451-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 185 2015-11-29T19:01:34.481-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 185 2015-11-29T19:01:34.511-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 185 2015-11-29T19:01:34.541-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 185 2015-11-29T19:01:34.569-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:34.571-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 185 2015-11-29T19:01:34.601-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 185 2015-11-29T19:01:34.631-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 185 2015-11-29T19:01:34.661-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 185 2015-11-29T19:01:34.675-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15780000 QueuedCount 50000 2015-11-29T19:01:34.691-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 185 2015-11-29T19:01:34.721-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 185 2015-11-29T19:01:34.751-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 185 2015-11-29T19:01:34.781-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 185 2015-11-29T19:01:34.811-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 185 2015-11-29T19:01:34.841-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 185 2015-11-29T19:01:34.871-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 185 2015-11-29T19:01:34.901-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 185 2015-11-29T19:01:34.906-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15790000 QueuedCount 50000 2015-11-29T19:01:34.931-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 185 2015-11-29T19:01:34.961-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 185 2015-11-29T19:01:34.991-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 185 2015-11-29T19:01:35.021-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 185 2015-11-29T19:01:35.051-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 185 2015-11-29T19:01:35.081-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 185 2015-11-29T19:01:35.111-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 185 2015-11-29T19:01:35.141-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 185 2015-11-29T19:01:35.171-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 185 2015-11-29T19:01:35.201-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 185 2015-11-29T19:01:35.231-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 185 2015-11-29T19:01:35.261-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 185 2015-11-29T19:01:35.291-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 185 2015-11-29T19:01:35.321-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 185 2015-11-29T19:01:35.351-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 185 2015-11-29T19:01:35.381-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 185 2015-11-29T19:01:35.411-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 185 2015-11-29T19:01:35.441-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 185 2015-11-29T19:01:35.471-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 185 2015-11-29T19:01:35.501-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 185 2015-11-29T19:01:35.531-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 185 2015-11-29T19:01:35.561-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 185 2015-11-29T19:01:35.591-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 185 2015-11-29T19:01:35.621-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 185 2015-11-29T19:01:35.651-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 185 2015-11-29T19:01:35.681-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 185 2015-11-29T19:01:35.711-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 185 2015-11-29T19:01:35.741-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 185 2015-11-29T19:01:35.771-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 185 2015-11-29T19:01:35.801-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 185 2015-11-29T19:01:35.831-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 185 2015-11-29T19:01:35.861-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 185 2015-11-29T19:01:35.891-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 185 2015-11-29T19:01:35.921-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 185 2015-11-29T19:01:35.951-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 185 2015-11-29T19:01:35.967-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15800000 QueuedCount 50000 2015-11-29T19:01:35.981-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 185 2015-11-29T19:01:36.011-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 185 2015-11-29T19:01:36.041-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 185 2015-11-29T19:01:36.042-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T19:01:36.071-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 185 2015-11-29T19:01:36.08-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15810000 QueuedCount 50000 2015-11-29T19:01:36.101-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 185 2015-11-29T19:01:36.131-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 185 2015-11-29T19:01:36.161-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 185 2015-11-29T19:01:36.191-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 185 2015-11-29T19:01:36.203-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15820000 QueuedCount 50000 2015-11-29T19:01:36.221-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 185 2015-11-29T19:01:36.251-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 185 2015-11-29T19:01:36.281-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 185 2015-11-29T19:01:36.311-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 185 2015-11-29T19:01:36.326-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15830000 QueuedCount 48970 2015-11-29T19:01:36.341-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 185 2015-11-29T19:01:36.371-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 185 2015-11-29T19:01:36.401-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 185 2015-11-29T19:01:36.431-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 185 2015-11-29T19:01:36.461-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 185 2015-11-29T19:01:36.491-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 185 2015-11-29T19:01:36.521-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 185 2015-11-29T19:01:36.551-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 185 2015-11-29T19:01:36.581-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 185 2015-11-29T19:01:36.611-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 185 2015-11-29T19:01:36.641-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 185 2015-11-29T19:01:36.671-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 185 2015-11-29T19:01:36.701-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 185 2015-11-29T19:01:36.731-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 185 2015-11-29T19:01:36.761-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 185 2015-11-29T19:01:36.791-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 185 2015-11-29T19:01:36.821-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 185 2015-11-29T19:01:36.851-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 185 2015-11-29T19:01:36.881-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 185 2015-11-29T19:01:36.911-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 185 2015-11-29T19:01:36.941-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 185 2015-11-29T19:01:36.971-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 185 2015-11-29T19:01:37.001-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 185 2015-11-29T19:01:37.031-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 185 2015-11-29T19:01:37.037-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15840000 QueuedCount 38970 2015-11-29T19:01:37.061-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 185 2015-11-29T19:01:37.091-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 185 2015-11-29T19:01:37.121-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 185 2015-11-29T19:01:37.127-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15850000 QueuedCount 28970 2015-11-29T19:01:37.151-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 185 2015-11-29T19:01:37.181-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 185 2015-11-29T19:01:37.211-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 185 2015-11-29T19:01:37.22-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15860000 QueuedCount 18970 2015-11-29T19:01:37.241-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 185 2015-11-29T19:01:37.271-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 185 2015-11-29T19:01:37.301-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 185 2015-11-29T19:01:37.317-08:00 [Info] logWriterStat:: 3094208154756435235 FlushedCount 15870000 QueuedCount 8970 2015-11-29T19:01:37.331-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 185 2015-11-29T19:01:37.361-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Mill