2015-11-29T03:23:26.209-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T03:23:26.245-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T03:23:26.249-08:00 [Info] Setting maxcpus = 4 2015-11-29T03:23:26.249-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T03:23:26.249-08:00 [Info] Setting log level to Info 2015-11-29T03:23:26.249-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T03:23:26.31-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T03:23:26.314-08:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.log_level":"info","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2015-11-29T03:23:26.314-08:00 [Info] Setting maxcpus = 4 2015-11-29T03:23:26.314-08:00 [Info] Setting log level to Info 2015-11-29T03:23:30.111-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T03:23:30.127-08:00 [Info] ClustMgr:handleSetLocalValue Key IndexerId Value 1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.127-08:00 [Info] Indexer Id 1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.18-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.182-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.182-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:23:30.182-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.182-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.184-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.184-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:23:30.184-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.184-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.185-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.185-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:23:30.185-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.185-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.187-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.187-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:23:30.187-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.218-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.219-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.219-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:23:30.219-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.219-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.22-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.22-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:23:30.22-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.22-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.22-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.22-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:23:30.22-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.22-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:30.221-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:30.221-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:23:30.221-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:30.221-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T03:23:30.221-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T03:23:30.221-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T03:23:30.221-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T03:23:30.221-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T03:23:30.221-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T03:23:30.222-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T03:23:34.129-08:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.log_level":"info","indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2015-11-29T03:23:34.129-08:00 [Info] Setting maxcpus = 4 2015-11-29T03:23:34.129-08:00 [Info] Setting log level to Info 2015-11-29T03:23:34.129-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T03:23:34.2-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T03:23:34.201-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:23:34.201-08:00 [Info] Setting log level to Info 2015-11-29T03:23:34.201-08:00 [Info] CompactionManager: Refreshing settings [goport] 2015/11/29 03:23:34 got new line on a stdin; terminating. 2015-11-29T03:23:44.772-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T03:23:44.804-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T03:23:44.819-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:23:44.819-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T03:23:44.819-08:00 [Info] Setting log level to Info 2015-11-29T03:23:44.819-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T03:23:44.884-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T03:23:44.888-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T03:23:44.888-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:23:44.888-08:00 [Info] Setting log level to Info 2015-11-29T03:23:48.09-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T03:23:48.09-08:00 [Info] Indexer Id 1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.119-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.121-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.121-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:23:48.121-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.121-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.123-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.123-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:23:48.123-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.123-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.124-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.124-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:23:48.124-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.124-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.126-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.126-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:23:48.126-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.143-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.143-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.143-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:23:48.143-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.143-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.144-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.144-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:23:48.144-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.144-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.145-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.145-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:23:48.145-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.145-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:23:48.145-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:23:48.145-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:23:48.145-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:23:48.145-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T03:23:48.146-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T03:23:48.146-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T03:23:48.146-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T03:23:48.146-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T03:23:48.146-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T03:23:48.146-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T03:24:48.09-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":143360,"needs_restart":false,"num_connections":0,"timings/stats_response":"65 3994340 276884501386"} [goport] 2015/11/29 03:25:43 got new line on a stdin; terminating. 2015-11-29T03:25:55.257-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T03:25:55.289-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T03:25:55.305-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:25:55.305-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T03:25:55.305-08:00 [Info] Setting log level to Info 2015-11-29T03:25:55.305-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T03:25:55.368-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T03:25:55.372-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T03:25:55.372-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:25:55.372-08:00 [Info] Setting log level to Info 2015-11-29T03:25:58.496-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T03:25:58.498-08:00 [Info] Indexer Id 1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.532-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.533-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.533-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:25:58.533-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.533-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.534-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.534-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:25:58.534-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.534-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.536-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.536-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:25:58.536-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.536-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.537-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.537-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:25:58.537-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.568-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.569-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.569-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:25:58.569-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.569-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.57-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.57-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:25:58.57-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.57-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.57-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.57-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:25:58.57-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.57-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:25:58.571-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:25:58.571-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:25:58.571-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:25:58.571-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T03:25:58.571-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T03:25:58.571-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T03:25:58.571-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T03:25:58.571-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T03:25:58.572-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T03:25:58.572-08:00 [Info] CompactionManager: Refreshing settings [goport] 2015/11/29 03:25:58 got new line on a stdin; terminating. 2015-11-29T03:25:58.812-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T03:25:58.844-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T03:25:58.848-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:25:58.848-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T03:25:58.848-08:00 [Info] Setting log level to Info 2015-11-29T03:25:58.849-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T03:25:58.912-08:00 [Error] [Queryport ":9101"] failed starting listen tcp :9101: bind: address already in use !! 2015-11-29T03:25:58.912-08:00 [Fatal] Indexer::NewIndexer Scan Coordinator Init Error%!(EXTRA *indexer.MsgError=listen tcp :9101: bind: address already in use) 2015-11-29T03:25:58.913-08:00 [Warn] Indexer Failure to Init listen tcp :9101: bind: address already in use 2015-11-29T03:25:58.913-08:00 [Info] Indexer exiting normally 2015-11-29T03:26:04.047-08:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2015-11-29T03:26:04.079-08:00 [Info] Indexer::NewIndexer Status INIT 2015-11-29T03:26:04.084-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:26:04.084-08:00 [Info] Setting buffer block size to 16384 bytes 2015-11-29T03:26:04.084-08:00 [Info] Setting log level to Info 2015-11-29T03:26:04.084-08:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2015-11-29T03:26:04.146-08:00 [Info] [Queryport ":9101"] started ... 2015-11-29T03:26:04.15-08:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2015-11-29T03:26:04.15-08:00 [Info] Setting maxcpus = 24 2015-11-29T03:26:04.151-08:00 [Info] Setting log level to Info 2015-11-29T03:26:07.325-08:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2015-11-29T03:26:07.334-08:00 [Info] Indexer Id 1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.372-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.374-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.374-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:26:07.374-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.374-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.376-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.376-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:26:07.376-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.376-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.377-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.377-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:26:07.377-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.377-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.379-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.379-08:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:26:07.379-08:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.411-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.411-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.411-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2015-11-29T03:26:07.411-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.411-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.412-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.412-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2015-11-29T03:26:07.412-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.412-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.413-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.413-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2015-11-29T03:26:07.413-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.413-08:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 2015-11-29T03:26:07.413-08:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84. Err projector.topicMissing 2015-11-29T03:26:07.413-08:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2015-11-29T03:26:07.413-08:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2015-11-29T03:26:07.413-08:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2015-11-29T03:26:07.413-08:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2015-11-29T03:26:07.414-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2015-11-29T03:26:07.414-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2015-11-29T03:26:07.414-08:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2015-11-29T03:26:07.414-08:00 [Info] Indexer::NewIndexer Status ACTIVE 2015-11-29T03:26:07.414-08:00 [Info] CompactionManager: Refreshing settings 2015-11-29T03:27:07.326-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"72 4233274 327191436572"} 2015-11-29T03:28:07.326-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"144 8150991 554255539717"} 2015-11-29T03:29:07.326-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"216 11943652 760594697686"} 2015-11-29T03:30:07.326-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"287 15664021 964055256045"} 2015-11-29T03:31:07.327-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"359 19368327 1161398148245"} 2015-11-29T03:32:07.327-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"431 40777220 311242245901700"} 2015-11-29T03:33:07.327-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"503 44489459 311441470579323"} 2015-11-29T03:34:07.327-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"575 65637609 616482754084249"} 2015-11-29T03:35:07.328-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"647 69389927 616684899037575"} 2015-11-29T03:36:07.328-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"719 73042510 616874302936970"} 2015-11-29T03:37:07.379-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"791 76961185 617099151634731"} 2015-11-29T03:38:07.412-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"863 80686577 617298493403373"} 2015-11-29T03:39:07.412-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"934 84458491 617505205935399"} 2015-11-29T03:40:07.43-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1006 88189978 617708366714544"} 2015-11-29T03:41:07.43-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1078 91964189 617911078452609"} 2015-11-29T03:42:07.448-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1150 95848138 618136903733776"} 2015-11-29T03:43:07.448-08:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1222 99596864 618338112197054"} 2015-11-29T03:43:16.461-08:00 [Info] clustMgrAgent::OnIndexCreate Notification Received for Create Index DefnId: 16481390354720717219 Name: by_email_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) 2015-11-29T03:43:16.462-08:00 [Info] Indexer::handleCreateIndex InstId: 16481390354720717219 Defn: DefnId: 16481390354720717219 Name: by_email_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) State: INDEX_STATE_CREATED Stream: NIL_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1} 2015-11-29T03:43:16.497-08:00 [Info] Indexer::initPartnInstance Initialized Partition: Index: 16481390354720717219 Partition: PartitionId: 1 Endpoints: [:9105] 2015-11-29T03:43:16.505-08:00 [Info] ForestDBSlice:NewForestDBSlice Created New Slice Id 0 IndexInstId 16481390354720717219 WriterThreads 1 2015-11-29T03:43:16.505-08:00 [Info] Indexer::initPartnInstance Initialized Slice: Index: 16481390354720717219 Slice: SliceId: 0 File: /data/@2i/bucket-1_by_email_0_16481390354720717219_0.index Index: 16481390354720717219 2015-11-29T03:43:16.505-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 16481390354720717219 Name: by_email_0 Bucket: bucket-1 State: INDEX_STATE_CREATED Stream: NIL_STREAM 2015-11-29T03:43:16.505-08:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap InstanceId: 16481390354720717219 PartitionId: 0 Endpoints: [:9105] 2015-11-29T03:43:16.506-08:00 [Info] clustMgrAgent::OnIndexCreate Success for Create Index DefnId: 16481390354720717219 Name: by_email_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) 2015-11-29T03:43:16.523-08:00 [Info] clustMgrAgent::OnIndexBuild Notification Received for Build Index [16481390354720717219] 2015-11-29T03:43:16.523-08:00 [Info] Indexer::handleBuildIndex [16481390354720717219] 2015-11-29T03:43:16.603-08:00 [Info] DCPT[secidx:getseqnos-e7:17:a7:4:b8:ac:51:fb] ##abba feed started ... 2015-11-29T03:43:16.605-08:00 [Info] DCPT[secidx:getseqnos-ee:49:1c:b5:19:2:3e:cc] ##abba feed started ... 2015-11-29T03:43:16.608-08:00 [Info] DCPT[secidx:getseqnos-a3:63:7f:3e:53:68:92:f5] ##abba feed started ... 2015-11-29T03:43:16.611-08:00 [Info] DCPT[secidx:getseqnos-f0:6f:68:2a:f4:a4:57:57] ##abba feed started ... 2015-11-29T03:43:16.611-08:00 [Info] {bucket,feeds} "bucket-1" created for dcp_seqno cache... 2015-11-29T03:43:16.614-08:00 [Info] Indexer::handleBuildIndex Added Index: [16481390354720717219] to Stream: MAINT_STREAM State: INDEX_STATE_INITIAL 2015-11-29T03:43:16.614-08:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 16481390354720717219 Name: by_email_0 Bucket: bucket-1 State: INDEX_STATE_INITIAL Stream: MAINT_STREAM 2015-11-29T03:43:16.614-08:00 [Info] Timekeeper::handleStreamOpen Stream MAINT_STREAM State Changed to ACTIVE 2015-11-29T03:43:16.614-08:00 [Info] StreamState::initBucketInStream New Bucket bucket-1 Added for Stream MAINT_STREAM 2015-11-29T03:43:16.615-08:00 [Info] Timekeeper::addIndextoStream IndexCount map[MAINT_STREAM:map[bucket-1:1]] 2015-11-29T03:43:16.615-08:00 [Info] Timekeeper::addIndextoStream add BuildInfo index 16481390354720717219 stream MAINT_STREAM bucket bucket-1 state INDEX_STATE_INITIAL 2015-11-29T03:43:16.615-08:00 [Info] Timekeeper::startTimer MAINT_STREAM bucket-1 2015-11-29T03:43:16.615-08:00 [Info] MutationMgr::handleOpenStream Message: MsgStreamUpdate Type: OPEN_STREAM Stream: MAINT_STREAM Bucket: bucket-1 BuildTS: [0=19535,1=19515,2=19515,3=19535,4=19550,5=19525,6=19525,7=19550,8=19525,9=19550,10=19550,11=19525,12=19515,13=19535,14=19535,15=19515,16=19535,17=19515,18=19515,19=19535,20=19550,21=19525,22=19525,23=19550,24=19525,25=19550,26=19550,27=19525,28=19515,29=19535,30=19535,31=19515,32=19535,33=19515,34=19515,35=19535,36=19550,37=19525,38=19525,39=19550,40=19525,41=19550,42=19550,43=19525,44=19515,45=19535,46=19535,47=19515,48=19535,49=19515,50=19515,51=19535,52=19550,53=19525,54=19525,55=19550,56=19525,57=19550,58=19550,59=19525,60=19515,61=19535,62=19535,63=19515,64=19525,65=19550,66=19550,67=19525,68=19515,69=19535,70=19535,71=19515,72=19535,73=19515,74=19515,75=19535,76=19550,77=19525,78=19525,79=19550,80=19525,81=19550,82=19550,83=19525,84=19515,85=19535,86=19535,87=19515,88=19535,89=19515,90=19515,91=19535,92=19550,93=19525,94=19525,95=19550,96=19525,97=19550,98=19550,99=19525,100=19515,101=19535,102=19535,103=19515,104=19535,105=19515,106=19515,107=19535,108=19550,109=19525,110=19525,111=19550,112=19525,113=19550,114=19550,115=19525,116=19515,117=19535,118=19535,119=19515,120=19535,121=19515,122=19515,123=19535,124=19550,125=19525,126=19525,127=19550,128=19515,129=19535,130=19535,131=19515,132=19525,133=19550,134=19550,135=19525,136=19550,137=19525,138=19525,139=19550,140=19535,141=19515,142=19515,143=19535,144=19515,145=19535,146=19535,147=19515,148=19525,149=19550,150=19550,151=19525,152=19550,153=19525,154=19525,155=19550,156=19535,157=19515,158=19515,159=19535,160=19515,161=19535,162=19535,163=19515,164=19525,165=19550,166=19550,167=19525,168=19550,169=19525,170=19525,171=19550,172=19535,173=19515,174=19515,175=19535,176=19515,177=19535,178=19535,179=19515,180=19525,181=19550,182=19550,183=19525,184=19550,185=19525,186=19525,187=19550,188=19535,189=19515,190=19515,191=19535,192=19550,193=19525,194=19525,195=19550,196=19535,197=19515,198=19515,199=19535,200=19515,201=19535,202=19535,203=19515,204=19525,205=19550,206=19550,207=19525,208=19550,209=19525,210=19525,211=19550,212=19535,213=19515,214=19515,215=19535,216=19515,217=19535,218=19535,219=19515,220=19525,221=19550,222=19550,223=19525,224=19550,225=19525,226=19525,227=19550,228=19535,229=19515,230=19515,231=19535,232=19515,233=19535,234=19535,235=19515,236=19525,237=19550,238=19550,239=19525,240=19550,241=19525,242=19525,243=19550,244=19535,245=19515,246=19515,247=19535,248=19515,249=19535,250=19535,251=19515,252=19525,253=19550,254=19550,255=19525,256=19525,257=19550,258=19550,259=19525,260=19516,261=19535,262=19535,263=19515,264=19535,265=19515,266=19515,267=19535,268=19550,269=19525,270=19525,271=19550,272=19525,273=19550,274=19550,275=19525,276=19515,277=19535,278=19535,279=19515,280=19535,281=19515,282=19515,283=19535,284=19550,285=19525,286=19525,287=19550,288=19525,289=19550,290=19550,291=19525,292=19515,293=19535,294=19535,295=19515,296=19535,297=19515,298=19515,299=19535,300=19550,301=19525,302=19525,303=19550,304=19525,305=19550,306=19550,307=19525,308=19515,309=19535,310=19535,311=19515,312=19535,313=19515,314=19515,315=19535,316=19550,317=19525,318=19525,319=19550,320=19535,321=19515,322=19515,323=19535,324=19550,325=19525,326=19525,327=19550,328=19525,329=19550,330=19550,331=19525,332=19515,333=19535,334=19535,335=19515,336=19535,337=19515,338=19515,339=19535,340=19550,341=19525,342=19525,343=19550,344=19525,345=19550,346=19550,347=19525,348=19515,349=19535,350=19535,351=19515,352=19535,353=19515,354=19515,355=19535,356=19550,357=19525,358=19525,359=19550,360=19525,361=19550,362=19550,363=19525,364=19515,365=19535,366=19535,367=19515,368=19535,369=19515,370=19515,371=19535,372=19550,373=19525,374=19525,375=19550,376=19525,377=19550,378=19550,379=19525,380=19515,381=19535,382=19535,383=19515,384=19550,385=19525,386=19525,387=19550,388=19535,389=19515,390=19515,391=19535,392=19515,393=19535,394=19535,395=19515,396=19525,397=19550,398=19550,399=19525,400=19550,401=19525,402=19525,403=19550,404=19535,405=19515,406=19515,407=19535,408=19515,409=19535,410=19535,411=19515,412=19525,413=19550,414=19550,415=19525,416=19550,417=19525,418=19525,419=19550,420=19535,421=19515,422=19515,423=19535,424=19515,425=19535,426=19535,427=19515,428=19525,429=19550,430=19549,431=19525,432=19550,433=19525,434=19525,435=19550,436=19535,437=19515,438=19515,439=19535,440=19515,441=19535,442=19535,443=19515,444=19525,445=19550,446=19550,447=19525,448=19515,449=19535,450=19535,451=19515,452=19525,453=19550,454=19550,455=19525,456=19550,457=19525,458=19525,459=19550,460=19535,461=19515,462=19515,463=19535,464=19515,465=19535,466=19535,467=19515,468=19525,469=19550,470=19550,471=19525,472=19550,473=19525,474=19525,475=19550,476=19535,477=19515,478=19515,479=19535,480=19515,481=19535,482=19535,483=19515,484=19525,485=19550,486=19550,487=19525,488=19550,489=19525,490=19525,491=19550,492=19535,493=19515,494=19515,495=19535,496=19515,497=19535,498=19535,499=19515,500=19525,501=19550,502=19550,503=19525,504=19550,505=19525,506=19525,507=19550,508=19535,509=19515,510=19515,511=19535,512=19515,513=19535,514=19535,515=19515,516=19525,517=19550,518=19550,519=19525,520=19550,521=19525,522=19525,523=19550,524=19535,525=19515,526=19515,527=19535,528=19515,529=19535,530=19535,531=19515,532=19525,533=19550,534=19550,535=19525,536=19550,537=19525,538=19525,539=19550,540=19535,541=19515,542=19515,543=19535,544=19515,545=19535,546=19535,547=19515,548=19525,549=19550,550=19550,551=19525,552=19549,553=19525,554=19525,555=19550,556=19535,557=19515,558=19515,559=19535,560=19515,561=19535,562=19535,563=19515,564=19525,565=19550,566=19550,567=19525,568=19550,569=19525,570=19525,571=19550,572=19535,573=19515,574=19515,575=19535,576=19550,577=19525,578=19525,579=19550,580=19535,581=19515,582=19515,583=19535,584=19515,585=19535,586=19535,587=19515,588=19525,589=19550,590=19550,591=19525,592=19550,593=19525,594=19525,595=19550,596=19535,597=19515,598=19515,599=19535,600=19515,601=19535,602=19535,603=19515,604=19525,605=19550,606=19550,607=19525,608=19550,609=19525,610=19525,611=19550,612=19535,613=19515,614=19515,615=19535,616=19515,617=19535,618=19535,619=19515,620=19525,621=19550,622=19550,623=19525,624=19550,625=19525,626=19525,627=19550,628=19535,629=19515,630=19515,631=19535,632=19515,633=19535,634=19535,635=19515,636=19525,637=19550,638=19550,639=19525,640=19535,641=19515,642=19516,643=19535,644=19550,645=19525,646=19525,647=19550,648=19525,649=19550,650=19550,651=19525,652=19515,653=19535,654=19535,655=19515,656=19535,657=19515,658=19515,659=19535,660=19550,661=19525,662=19525,663=19550,664=19525,665=19550,666=19550,667=19525,668=19515,669=19535,670=19535,671=19515,672=19535,673=19515,674=19515,675=19535,676=19550,677=19525,678=19525,679=19550,680=19525,681=19550,682=19550,683=19525,684=19515,685=19535,686=19535,687=19515,688=19535,689=19515,690=19515,691=19535,692=19550,693=19525,694=19525,695=19550,696=19525,697=19550,698=19550,699=19525,700=19515,701=19535,702=19535,703=19515,704=19525,705=19550,706=19550,707=19525,708=19515,709=19535,710=19535,711=19515,712=19535,713=19515,714=19515,715=19535,716=19550,717=19525,718=19525,719=19550,720=19525,721=19550,722=19550,723=19525,724=19515,725=19535,726=19535,727=19515,728=19535,729=19515,730=19515,731=19535,732=19550,733=19525,734=19525,735=19550,736=19525,737=19550,738=19550,739=19525,740=19515,741=19535,742=19535,743=19515,744=19535,745=19515,746=19515,747=19535,748=19550,749=19525,750=19525,751=19550,752=19525,753=19550,754=19550,755=19525,756=19515,757=19535,758=19535,759=19515,760=19535,761=19515,762=19515,763=19535,764=19550,765=19525,766=19525,767=19550,768=19550,769=19525,770=19525,771=19550,772=19535,773=19515,774=19515,775=19535,776=19515,777=19535,778=19535,779=19515,780=19525,781=19550,782=19550,783=19525,784=19550,785=19525,786=19525,787=19550,788=19535,789=19515,790=19515,791=19535,792=19515,793=19535,794=19535,795=19515,796=19525,797=19550,798=19550,799=19525,800=19550,801=19525,802=19525,803=19550,804=19535,805=19515,806=19515,807=19535,808=19515,809=19535,810=19535,811=19515,812=19525,813=19550,814=19550,815=19525,816=19550,817=19525,818=19525,819=19550,820=19535,821=19515,822=19515,823=19535,824=19515,825=19535,826=19535,827=19515,828=19525,8 29=19550,830=19550,831=19525,832=19515,833=19535,834=19535,835=19515,836=19525,837=19550,838=19550,839=19525,840=19550,841=19525,842=19525,843=19550,844=19535,845=19515,846=19515,847=19535,848=19515,849=19535,850=19535,851=19515,852=19525,853=19550,854=19550,855=19525,856=19550,857=19525,858=19525,859=19550,860=19535,861=19515,862=19515,863=19535,864=19515,865=19535,866=19535,867=19515,868=19525,869=19550,870=19550,871=19525,872=19550,873=19525,874=19525,875=19550,876=19535,877=19515,878=19515,879=19535,880=19515,881=19535,882=19535,883=19515,884=19525,885=19550,886=19550,887=19525,888=19550,889=19525,890=19525,891=19550,892=19535,893=19515,894=19515,895=19535,896=19525,897=19550,898=19550,899=19525,900=19515,901=19535,902=19535,903=19515,904=19535,905=19515,906=19515,907=19535,908=19550,909=19525,910=19525,911=19550,912=19525,913=19550,914=19550,915=19525,916=19515,917=19535,918=19535,919=19515,920=19535,921=19515,922=19515,923=19535,924=19550,925=19525,926=19525,927=19550,928=19525,929=19550,930=19550,931=19525,932=19515,933=19535,934=19535,935=19515,936=19535,937=19515,938=19515,939=19535,940=19550,941=19525,942=19525,943=19550,944=19525,945=19550,946=19550,947=19525,948=19515,949=19535,950=19535,951=19515,952=19535,953=19515,954=19515,955=19535,956=19550,957=19525,958=19525,959=19550,960=19535,961=19515,962=19515,963=19535,964=19550,965=19525,966=19525,967=19550,968=19525,969=19550,970=19550,971=19525,972=19515,973=19535,974=19535,975=19515,976=19535,977=19515,978=19515,979=19535,980=19550,981=19525,982=19525,983=19550,984=19525,985=19550,986=19550,987=19525,988=19515,989=19535,990=19535,991=19515,992=19535,993=19515,994=19515,995=19535,996=19550,997=19525,998=19525,999=19550,1000=19525,1001=19550,1002=19550,1003=19525,1004=19515,1005=19535,1006=19535,1007=19515,1008=19535,1009=19515,1010=19515,1011=19535,1012=19550,1013=19525,1014=19525,1015=19550,1016=19525,1017=19550,1018=19550,1019=19525,1020=19515,1021=19535,1022=19535,1023=19515] IndexList: [ InstId: 16481390354720717219 Defn: DefnId: 16481390354720717219 Name: by_email_0 Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email`] PartitionScheme: SINGLE PartitionKey: WhereExpr: (`partition_id` = 0) State: INDEX_STATE_INITIAL Stream: MAINT_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1}] RestartTs: 2015-11-29T03:43:16.628-08:00 [Info] MutationMgr:: Set maxVbQueueLength 10000 2015-11-29T03:43:16.629-08:00 [Info] DATP[->dataport ":9105"] started ... 2015-11-29T03:43:16.629-08:00 [Info] MutationStreamReader::startWorkers Starting All Stream Workers MAINT_STREAM 2015-11-29T03:43:16.629-08:00 [Info] MutationStreamReader::startMutationStreamWorker Stream Worker 0 Started for Stream MAINT_STREAM. 2015-11-29T03:43:16.629-08:00 [Info] ClustMgr:handleUpdateTopologyForIndex &{47 [{16481390354720717219 {16481390354720717219 by_email_0 forestdb bucket-1 585aa7ef9afb7aabc901a13a7093fb85 false [`email`] N1QL SINGLE (`partition_id` = 0) false [1c:d5:f6:54:e4:c7:e:84]} 2 1 0xc20bb83e50 []}] {true true false true} 0} 2015-11-29T03:43:16.63-08:00 [Info] clustMgrAgent::OnIndexBuild returns for Build Index [16481390354720717219] 2015-11-29T03:43:17.111-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T03:43:17.126-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.70:46773" +1 2015-11-29T03:43:17.334-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1 2015-11-29T03:43:17.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 5 190950295364460 0 2015-11-29T03:43:17.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 6 129987382718902 0 2015-11-29T03:43:17.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 7 6565181220398 0 2015-11-29T03:43:17.334-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 0 225918567448549 0 2015-11-29T03:43:17.335-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1 228123273855009 0 2015-11-29T03:43:17.335-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 2 42604377909753 0 2015-11-29T03:43:17.335-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 3 255374544894640 0 2015-11-29T03:43:17.335-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 4 263551701931846 0 2015-11-29T03:43:17.353-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 8 221019346020813 0 2015-11-29T03:43:17.353-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 9 93144032030200 0 2015-11-29T03:43:17.358-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 10 92563330523704 0 2015-11-29T03:43:17.358-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 11 166838711857429 0 2015-11-29T03:43:17.37-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 13 215328521858218 0 2015-11-29T03:43:17.372-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 12 49023944753415 0 2015-11-29T03:43:17.383-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 14 129143281740909 0 2015-11-29T03:43:17.383-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 15 230211439690303 0 2015-11-29T03:43:17.396-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 16 165223984325404 0 2015-11-29T03:43:17.396-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 17 271298258530134 0 2015-11-29T03:43:17.396-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 18 9181253140591 0 2015-11-29T03:43:17.409-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 19 184694606710055 0 2015-11-29T03:43:17.432-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 20 22516826521696 0 2015-11-29T03:43:17.432-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 21 172925482401426 0 2015-11-29T03:43:17.436-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1 QueuedCount 11 2015-11-29T03:43:17.441-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:17.445-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 22 103199790606078 0 2015-11-29T03:43:17.445-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 23 246525199813142 0 2015-11-29T03:43:17.451-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 25 100995105789320 0 2015-11-29T03:43:17.451-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 26 242654581547562 0 2015-11-29T03:43:17.451-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 24 78541302286004 0 2015-11-29T03:43:17.459-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 27 200266101698522 0 2015-11-29T03:43:17.459-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 28 157099063250769 0 2015-11-29T03:43:17.467-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 29 159523687294550 0 2015-11-29T03:43:17.467-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 30 278507302250642 0 2015-11-29T03:43:17.467-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 31 52880753449256 0 2015-11-29T03:43:17.479-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 32 159273235837139 0 2015-11-29T03:43:17.48-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 33 152652169655656 0 2015-11-29T03:43:17.48-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 34 167256748746406 0 2015-11-29T03:43:17.484-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 35 230752135977807 0 2015-11-29T03:43:17.484-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 36 140642322641728 0 2015-11-29T03:43:17.49-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 37 97899986233877 0 2015-11-29T03:43:17.49-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 38 197373287221017 0 2015-11-29T03:43:17.496-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 39 237568639396090 0 2015-11-29T03:43:17.496-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 40 228083000339909 0 2015-11-29T03:43:17.5-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 41 141608532919196 0 2015-11-29T03:43:17.5-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 42 76256582308580 0 2015-11-29T03:43:17.5-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 43 76311064418737 0 2015-11-29T03:43:17.507-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 44 31235966457621 0 2015-11-29T03:43:17.507-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 45 131159926371438 0 2015-11-29T03:43:17.51-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 46 63223557647621 0 2015-11-29T03:43:17.513-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 48 15430111822178 0 2015-11-29T03:43:17.513-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 49 242126849516491 0 2015-11-29T03:43:17.515-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 47 99950256214422 0 2015-11-29T03:43:17.519-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 50 184290012382038 0 2015-11-29T03:43:17.519-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 51 105090312899973 0 2015-11-29T03:43:17.519-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 52 20937595226030 0 2015-11-29T03:43:17.524-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 53 17017698449159 0 2015-11-29T03:43:17.524-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 54 141829103880635 0 2015-11-29T03:43:17.528-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 55 169022434888287 0 2015-11-29T03:43:17.528-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 56 83070375838783 0 2015-11-29T03:43:17.531-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 57 175694654751065 0 2015-11-29T03:43:17.532-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 58 153642805014264 0 2015-11-29T03:43:17.532-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 59 83700019146289 0 2015-11-29T03:43:17.534-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 60 26182189514293 0 2015-11-29T03:43:17.534-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 61 264998021502171 0 2015-11-29T03:43:17.551-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 62 68117077860793 0 2015-11-29T03:43:17.551-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 63 77928106005320 0 2015-11-29T03:43:17.554-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 65 104740947318459 0 2015-11-29T03:43:17.555-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 64 179633230799503 0 2015-11-29T03:43:17.557-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 66 145949795780893 0 2015-11-29T03:43:17.557-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 67 112509912246423 0 2015-11-29T03:43:17.558-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 70 57443833753469 0 2015-11-29T03:43:17.56-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 68 44437717606718 0 2015-11-29T03:43:17.56-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 69 264178066177832 0 2015-11-29T03:43:17.563-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 71 52979579995891 0 2015-11-29T03:43:17.563-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 72 217759271783828 0 2015-11-29T03:43:17.567-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 73 170015958658784 0 2015-11-29T03:43:17.57-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 75 228438012931054 0 2015-11-29T03:43:17.57-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 76 38767582528339 0 2015-11-29T03:43:17.57-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 74 204881679659060 0 2015-11-29T03:43:17.574-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 77 145759541693384 0 2015-11-29T03:43:17.574-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 78 207930598683706 0 2015-11-29T03:43:17.576-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 79 33499297622941 0 2015-11-29T03:43:17.576-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 80 17302474051815 0 2015-11-29T03:43:17.581-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 81 94583032317710 0 2015-11-29T03:43:17.581-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 82 252059474665464 0 2015-11-29T03:43:17.584-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 83 187642950324270 0 2015-11-29T03:43:17.584-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 84 185613933294704 0 2015-11-29T03:43:17.587-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 86 81818287393054 0 2015-11-29T03:43:17.588-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 85 47089776223452 0 2015-11-29T03:43:17.592-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 87 45457508449964 0 2015-11-29T03:43:17.592-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 88 257331969064415 0 2015-11-29T03:43:17.592-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 89 228672117402992 0 2015-11-29T03:43:17.596-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 90 248088132471948 0 2015-11-29T03:43:17.596-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 91 198786937192574 0 2015-11-29T03:43:17.599-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 93 50503819099457 0 2015-11-29T03:43:17.6-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 92 199060929738649 0 2015-11-29T03:43:17.604-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 94 180689015805493 0 2015-11-29T03:43:17.604-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 95 63441625151135 0 2015-11-29T03:43:17.624-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 96 209387627452952 0 2015-11-29T03:43:17.625-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 97 105217426940685 0 2015-11-29T03:43:17.625-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 98 151976962366893 0 2015-11-29T03:43:17.627-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 99 92397307854207 0 2015-11-29T03:43:17.627-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 100 148002325497900 0 2015-11-29T03:43:17.629-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 101 21572131687071 0 2015-11-29T03:43:17.629-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 102 131271156159484 0 2015-11-29T03:43:17.63-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 104 227618304677582 0 2015-11-29T03:43:17.63-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 105 108060656254908 0 2015-11-29T03:43:17.631-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 103 149419449226361 0 2015-11-29T03:43:17.631-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 106 98544716410937 0 2015-11-29T03:43:17.631-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 107 48579881397510 0 2015-11-29T03:43:17.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 108 167037593024251 0 2015-11-29T03:43:17.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 109 4363155899743 0 2015-11-29T03:43:17.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 110 38967150708462 0 2015-11-29T03:43:17.642-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 111 93428631383383 0 2015-11-29T03:43:17.643-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 112 141174821353833 0 2015-11-29T03:43:17.643-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 113 50073784046912 0 2015-11-29T03:43:17.645-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 114 131306209796617 0 2015-11-29T03:43:17.645-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 115 73213000597864 0 2015-11-29T03:43:17.652-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 117 109550633038086 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 118 39335157755304 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 123 132528585079963 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 116 105961174670936 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 119 88366235039921 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 120 253991715781357 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 122 260846323270462 0 2015-11-29T03:43:17.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 121 577963601328 0 2015-11-29T03:43:17.664-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 124 168366283489886 0 2015-11-29T03:43:17.665-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 126 172586337511558 0 2015-11-29T03:43:17.666-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 125 199448985213868 0 2015-11-29T03:43:17.669-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 127 170404267406494 0 2015-11-29T03:43:17.679-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 128 128248620414730 0 2015-11-29T03:43:17.687-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 129 242187093585092 0 2015-11-29T03:43:17.687-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 130 88129693981861 0 2015-11-29T03:43:17.688-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 131 281396608057095 0 2015-11-29T03:43:17.688-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 132 50660836886563 0 2015-11-29T03:43:17.689-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 133 211440770299650 0 2015-11-29T03:43:17.704-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 135 256326790977818 0 2015-11-29T03:43:17.704-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 136 41020540041609 0 2015-11-29T03:43:17.704-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 134 223524320444544 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 137 249201520055928 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 140 225062003713713 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 142 179664910881972 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 138 193738637509560 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 139 276898276060511 0 2015-11-29T03:43:17.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 141 127862735251661 0 2015-11-29T03:43:17.709-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 143 47565261198527 0 2015-11-29T03:43:17.71-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 144 111663651347857 0 2015-11-29T03:43:17.71-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 145 78347762064416 0 2015-11-29T03:43:17.712-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 146 69781420218676 0 2015-11-29T03:43:17.712-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 147 32075852383832 0 2015-11-29T03:43:17.712-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 148 230257716800297 0 2015-11-29T03:43:17.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 149 96667697850473 0 2015-11-29T03:43:17.716-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 150 138904210478631 0 2015-11-29T03:43:17.722-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 151 2523869503614 0 2015-11-29T03:43:17.722-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 152 120515238316667 0 2015-11-29T03:43:17.724-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 153 181174449490331 0 2015-11-29T03:43:17.724-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 154 276496392606864 0 2015-11-29T03:43:17.728-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 155 246355812424400 0 2015-11-29T03:43:17.728-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 156 146013135064306 0 2015-11-29T03:43:17.734-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 158 180906092670062 0 2015-11-29T03:43:17.734-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 157 244203399403804 0 2015-11-29T03:43:17.742-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 159 136085471320362 0 2015-11-29T03:43:17.742-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 160 172360718181633 0 2015-11-29T03:43:17.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 161 178365893830412 0 2015-11-29T03:43:17.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 162 199245249352257 0 2015-11-29T03:43:17.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 163 174191587117518 0 2015-11-29T03:43:17.746-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 165 241145108806436 0 2015-11-29T03:43:17.747-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 164 124793051258629 0 2015-11-29T03:43:17.75-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 166 210402302492873 0 2015-11-29T03:43:17.75-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 167 57865587614917 0 2015-11-29T03:43:17.758-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 168 245583492196314 0 2015-11-29T03:43:17.758-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 169 24273965346956 0 2015-11-29T03:43:17.76-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 170 251724639546300 0 2015-11-29T03:43:17.76-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 171 167124065047466 0 2015-11-29T03:43:17.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 172 56331131389045 0 2015-11-29T03:43:17.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 173 183426751307011 0 2015-11-29T03:43:17.781-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 174 26872968670361 0 2015-11-29T03:43:17.791-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 175 48715681549446 0 2015-11-29T03:43:17.794-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 176 133182067155319 0 2015-11-29T03:43:17.799-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 177 140335588991630 0 2015-11-29T03:43:17.799-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 178 154850608827016 0 2015-11-29T03:43:17.802-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 179 272544283909624 0 2015-11-29T03:43:17.802-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 180 161318391640742 0 2015-11-29T03:43:17.805-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 182 239600218335811 0 2015-11-29T03:43:17.806-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 181 9922761204160 0 2015-11-29T03:43:17.808-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 183 90697009255781 0 2015-11-29T03:43:17.809-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 184 122298526897760 0 2015-11-29T03:43:17.819-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 185 24956494167462 0 2015-11-29T03:43:17.821-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 186 82705977015238 0 2015-11-29T03:43:17.821-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 187 245231063251257 0 2015-11-29T03:43:17.822-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 188 7454657618789 0 2015-11-29T03:43:17.822-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 189 163864884073196 0 2015-11-29T03:43:17.825-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 190 113824694071808 0 2015-11-29T03:43:17.825-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 191 105288945276122 0 2015-11-29T03:43:17.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 193 187085478912265 0 2015-11-29T03:43:17.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 192 276207431313685 0 2015-11-29T03:43:17.829-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 195 84106509038336 0 2015-11-29T03:43:17.829-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000 2015-11-29T03:43:17.83-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 194 128952989873310 0 2015-11-29T03:43:17.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 197 111273280780886 0 2015-11-29T03:43:17.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 196 173770988616210 0 2015-11-29T03:43:17.835-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 199 175850576049402 0 2015-11-29T03:43:17.836-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 198 49002065386723 0 2015-11-29T03:43:17.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 200 202518926847311 0 2015-11-29T03:43:17.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 202 137528311713740 0 2015-11-29T03:43:17.841-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 201 13986355565647 0 2015-11-29T03:43:17.842-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 204 147073355784780 0 2015-11-29T03:43:17.843-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 203 214059015530840 0 2015-11-29T03:43:17.848-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:17.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 205 3537469118492 0 2015-11-29T03:43:17.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 206 25432296278509 0 2015-11-29T03:43:17.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 207 102184385970664 0 2015-11-29T03:43:17.851-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 208 48264915788591 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 210 224871727445812 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 212 28687258324202 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 213 208504923744905 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 209 197811369520669 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 211 130077435475779 0 2015-11-29T03:43:17.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 214 55603762511499 0 2015-11-29T03:43:17.857-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 215 158753779016206 0 2015-11-29T03:43:17.859-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 216 76976569645627 0 2015-11-29T03:43:17.861-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 217 35112037817282 0 2015-11-29T03:43:17.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 218 90110606255070 0 2015-11-29T03:43:17.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 219 90443937462037 0 2015-11-29T03:43:17.885-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 220 13219938861234 0 2015-11-29T03:43:17.886-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 221 9085138159098 0 2015-11-29T03:43:17.887-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 222 163631414696635 0 2015-11-29T03:43:17.893-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 223 49327004317309 0 2015-11-29T03:43:17.895-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 224 29895406461020 0 2015-11-29T03:43:17.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 225 66770073342037 0 2015-11-29T03:43:17.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 226 140941785039582 0 2015-11-29T03:43:17.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 228 27449925309458 0 2015-11-29T03:43:17.907-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 227 128717897380216 0 2015-11-29T03:43:17.917-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 229 19512078698866 0 2015-11-29T03:43:17.922-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 230 81312095529713 0 2015-11-29T03:43:17.927-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 231 71026640864141 0 2015-11-29T03:43:17.927-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 234 187889248325211 0 2015-11-29T03:43:17.927-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 235 144497226242386 0 2015-11-29T03:43:17.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 232 1678912332354 0 2015-11-29T03:43:17.928-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 233 27098673831572 0 2015-11-29T03:43:17.933-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 236 182029351175419 0 2015-11-29T03:43:17.933-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 237 275500824276218 0 2015-11-29T03:43:17.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 238 176225397860053 0 2015-11-29T03:43:17.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 239 157725235211618 0 2015-11-29T03:43:17.948-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 240 96869125239982 0 2015-11-29T03:43:17.957-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 241 212501548854096 0 2015-11-29T03:43:17.961-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 242 272289642036678 0 2015-11-29T03:43:17.962-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 243 203197772624425 0 2015-11-29T03:43:17.974-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 244 204168028117024 0 2015-11-29T03:43:17.974-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 245 172502412508168 0 2015-11-29T03:43:17.99-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 246 256932480995575 0 2015-11-29T03:43:18.004-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 247 38038238104938 0 2015-11-29T03:43:18.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 248 86011489268365 0 2015-11-29T03:43:18.006-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 249 144854364614573 0 2015-11-29T03:43:18.008-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 250 155333575507612 0 2015-11-29T03:43:18.022-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 251 10057690072679 0 2015-11-29T03:43:18.022-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 252 38985558872315 0 2015-11-29T03:43:18.049-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:18.052-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10000 QueuedCount 4487 2015-11-29T03:43:18.063-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 253 49724775865321 0 2015-11-29T03:43:18.068-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 254 89684137033865 0 2015-11-29T03:43:18.075-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 255 278617849051669 0 2015-11-29T03:43:18.084-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 InstanceIds [16481390354720717219] 2015-11-29T03:43:18.084-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T03:43:18.115-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.71:35462" +2 2015-11-29T03:43:18.172-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 20000 2015-11-29T03:43:18.247-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:18.29-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 20000 QueuedCount 552 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 261 147999206352820 0 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 256 28888952232840 0 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 257 222904076793534 0 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 258 13184694695501 0 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 259 73763204542637 0 2015-11-29T03:43:18.382-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 260 32340881572308 0 2015-11-29T03:43:18.396-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 262 206298930381362 0 2015-11-29T03:43:18.396-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 263 207076809006691 0 2015-11-29T03:43:18.4-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 264 272051499644692 0 2015-11-29T03:43:18.4-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 265 152210936184066 0 2015-11-29T03:43:18.414-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 266 136905162044935 0 2015-11-29T03:43:18.414-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 267 273745791459395 0 2015-11-29T03:43:18.424-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 268 65127585331057 0 2015-11-29T03:43:18.424-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 269 13475826675367 0 2015-11-29T03:43:18.426-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 270 33049326005082 0 2015-11-29T03:43:18.438-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 271 29226716042372 0 2015-11-29T03:43:18.438-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 272 27909830170153 0 2015-11-29T03:43:18.446-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:18.454-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 273 235945478748466 0 2015-11-29T03:43:18.454-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 274 152760073696735 0 2015-11-29T03:43:18.457-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 30000 2015-11-29T03:43:18.475-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 275 123886508681051 0 2015-11-29T03:43:18.494-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 276 46965480302422 0 2015-11-29T03:43:18.501-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 278 149367552803719 0 2015-11-29T03:43:18.502-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 277 144696433163903 0 2015-11-29T03:43:18.512-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 279 235167960682029 0 2015-11-29T03:43:18.512-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 280 36682220881003 0 2015-11-29T03:43:18.52-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 281 197352487319224 0 2015-11-29T03:43:18.52-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 282 156794951293174 0 2015-11-29T03:43:18.526-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 283 222133633432205 0 2015-11-29T03:43:18.541-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 284 151658132956064 0 2015-11-29T03:43:18.542-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 285 186642030318803 0 2015-11-29T03:43:18.542-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 286 178850044452692 0 2015-11-29T03:43:18.549-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 287 256882458086633 0 2015-11-29T03:43:18.549-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 288 17150500009097 0 2015-11-29T03:43:18.552-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 289 84913268644531 0 2015-11-29T03:43:18.56-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 290 86584932539556 0 2015-11-29T03:43:18.56-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 291 212494860789032 0 2015-11-29T03:43:18.568-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 292 242704408740185 0 2015-11-29T03:43:18.568-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 293 228693798852045 0 2015-11-29T03:43:18.574-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 294 170099819729486 0 2015-11-29T03:43:18.574-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 295 93153752256209 0 2015-11-29T03:43:18.574-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 296 98146738730373 0 2015-11-29T03:43:18.586-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 297 10444889187250 0 2015-11-29T03:43:18.586-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 298 132751682456272 0 2015-11-29T03:43:18.586-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 299 121869607930593 0 2015-11-29T03:43:18.59-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 300 178402132154773 0 2015-11-29T03:43:18.59-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 301 258689330639657 0 2015-11-29T03:43:18.595-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 302 165809864064099 0 2015-11-29T03:43:18.596-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 303 158115168470566 0 2015-11-29T03:43:18.607-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 304 16997925101429 0 2015-11-29T03:43:18.607-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 305 136023007446855 0 2015-11-29T03:43:18.615-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 306 108706186190298 0 2015-11-29T03:43:18.615-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 307 102517896850418 0 2015-11-29T03:43:18.615-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 308 223719686523537 0 2015-11-29T03:43:18.62-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 309 212121272534458 0 2015-11-29T03:43:18.62-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 310 272192827811356 0 2015-11-29T03:43:18.628-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 311 123050837227623 0 2015-11-29T03:43:18.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 312 236357668851787 0 2015-11-29T03:43:18.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 313 219773222698459 0 2015-11-29T03:43:18.636-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 314 265360419468351 0 2015-11-29T03:43:18.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 315 146482967420693 0 2015-11-29T03:43:18.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 316 179905981401147 0 2015-11-29T03:43:18.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 317 137161438205371 0 2015-11-29T03:43:18.643-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 318 246415469216038 0 2015-11-29T03:43:18.643-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 319 142720720900313 0 2015-11-29T03:43:18.65-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 320 277393611742789 0 2015-11-29T03:43:18.652-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:18.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 40000 2015-11-29T03:43:18.659-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 321 261753040344696 0 2015-11-29T03:43:18.663-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 322 181309706650067 0 2015-11-29T03:43:18.663-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 323 151260104693369 0 2015-11-29T03:43:18.668-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 324 142589232162069 0 2015-11-29T03:43:18.669-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 325 268641778272619 0 2015-11-29T03:43:18.669-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 326 34294051082412 0 2015-11-29T03:43:18.671-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 30000 QueuedCount 6098 2015-11-29T03:43:18.672-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 327 89723584020432 0 2015-11-29T03:43:18.672-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 328 240608437619217 0 2015-11-29T03:43:18.676-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 329 70679960197076 0 2015-11-29T03:43:18.681-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 330 117018356310060 0 2015-11-29T03:43:18.681-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 331 55937592584758 0 2015-11-29T03:43:18.681-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 332 232544694820006 0 2015-11-29T03:43:18.684-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 333 33134330146092 0 2015-11-29T03:43:18.685-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 334 267868510846936 0 2015-11-29T03:43:18.687-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 335 280638077906414 0 2015-11-29T03:43:18.688-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 336 263769452761797 0 2015-11-29T03:43:18.692-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 337 264968803143133 0 2015-11-29T03:43:18.692-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 338 178787669310795 0 2015-11-29T03:43:18.697-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 339 145032593918604 0 2015-11-29T03:43:18.697-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 340 240873899112673 0 2015-11-29T03:43:18.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 341 147072345593628 0 2015-11-29T03:43:18.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 342 77318586132758 0 2015-11-29T03:43:18.701-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 343 208624212130282 0 2015-11-29T03:43:18.707-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 344 201174696699571 0 2015-11-29T03:43:18.707-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 345 169700906306846 0 2015-11-29T03:43:18.712-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 346 62664576681438 0 2015-11-29T03:43:18.712-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 347 4293232413189 0 2015-11-29T03:43:18.722-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 348 191256660838464 0 2015-11-29T03:43:18.725-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 349 44956833497814 0 2015-11-29T03:43:18.726-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 350 116006609825098 0 2015-11-29T03:43:18.726-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 351 146414363503628 0 2015-11-29T03:43:18.732-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 352 75995140256609 0 2015-11-29T03:43:18.732-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 353 261216475743724 0 2015-11-29T03:43:18.737-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 354 115873294547623 0 2015-11-29T03:43:18.737-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 355 118680052761054 0 2015-11-29T03:43:18.74-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 357 97134490898720 0 2015-11-29T03:43:18.74-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 358 60979541964260 0 2015-11-29T03:43:18.74-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 356 238881971670541 0 2015-11-29T03:43:18.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 359 30932298417807 0 2015-11-29T03:43:18.743-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 360 198793013807639 0 2015-11-29T03:43:18.751-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 361 12918975274189 0 2015-11-29T03:43:18.751-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 362 131597985719615 0 2015-11-29T03:43:18.751-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 363 148393918830600 0 2015-11-29T03:43:18.752-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 364 96701243800394 0 2015-11-29T03:43:18.759-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 365 100723605677441 0 2015-11-29T03:43:18.759-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 366 165906270462117 0 2015-11-29T03:43:18.763-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 369 119822501975623 0 2015-11-29T03:43:18.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 367 148299865332103 0 2015-11-29T03:43:18.764-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 368 127625296739178 0 2015-11-29T03:43:18.768-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 371 98330571451784 0 2015-11-29T03:43:18.769-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 370 260323773454987 0 2015-11-29T03:43:18.769-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 372 205976248932675 0 2015-11-29T03:43:18.769-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 373 53938601009413 0 2015-11-29T03:43:18.769-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 374 8971762948633 0 2015-11-29T03:43:18.783-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 375 99143218487528 0 2015-11-29T03:43:18.783-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 376 148842796054097 0 2015-11-29T03:43:18.793-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 377 148823688224943 0 2015-11-29T03:43:18.793-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 378 96459503524450 0 2015-11-29T03:43:18.795-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 379 66665944096302 0 2015-11-29T03:43:18.795-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 380 102056094480458 0 2015-11-29T03:43:18.798-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 381 167558258478474 0 2015-11-29T03:43:18.798-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 382 103712702823840 0 2015-11-29T03:43:18.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 383 19309479531152 0 2015-11-29T03:43:18.807-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 384 74554365830324 0 2015-11-29T03:43:18.81-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 50000 2015-11-29T03:43:18.817-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 385 248903297437129 0 2015-11-29T03:43:18.818-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 386 74693427217922 0 2015-11-29T03:43:18.819-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 387 15242997452213 0 2015-11-29T03:43:18.819-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 388 44249880414002 0 2015-11-29T03:43:18.819-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 389 122045959448229 0 2015-11-29T03:43:18.821-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 390 20771882536919 0 2015-11-29T03:43:18.826-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 391 114532413150914 0 2015-11-29T03:43:18.827-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 393 17735303853876 0 2015-11-29T03:43:18.828-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 392 233877939284105 0 2015-11-29T03:43:18.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 394 162037535256644 0 2015-11-29T03:43:18.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 395 277744290067003 0 2015-11-29T03:43:18.84-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 396 148986160909667 0 2015-11-29T03:43:18.845-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 397 225658462215833 0 2015-11-29T03:43:18.846-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 398 41155926381726 0 2015-11-29T03:43:18.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 400 126521015447519 0 2015-11-29T03:43:18.852-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 399 219612500644621 0 2015-11-29T03:43:18.856-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 401 92392368609337 0 2015-11-29T03:43:18.856-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 402 231023888648678 0 2015-11-29T03:43:18.857-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 403 34419021091859 0 2015-11-29T03:43:18.857-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 404 22525847505112 0 2015-11-29T03:43:18.857-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 405 197372480939390 0 2015-11-29T03:43:18.857-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 406 157269754366455 0 2015-11-29T03:43:18.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 408 51139757239480 0 2015-11-29T03:43:18.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 409 241281619002620 0 2015-11-29T03:43:18.858-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 407 51236702339487 0 2015-11-29T03:43:18.858-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:18.868-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 410 160081671903526 0 2015-11-29T03:43:18.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 413 73666174710660 0 2015-11-29T03:43:18.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 415 269209100518453 0 2015-11-29T03:43:18.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 416 86883398889014 0 2015-11-29T03:43:18.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 411 154257625233791 0 2015-11-29T03:43:18.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 412 68714653306390 0 2015-11-29T03:43:18.872-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 414 189795996740526 0 2015-11-29T03:43:18.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 417 193283006951100 0 2015-11-29T03:43:18.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 418 250003148952321 0 2015-11-29T03:43:18.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 419 270336409103791 0 2015-11-29T03:43:18.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 420 24435637636896 0 2015-11-29T03:43:18.873-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 421 77107200969255 0 2015-11-29T03:43:18.876-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 422 136241591231238 0 2015-11-29T03:43:18.878-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 423 173353693273884 0 2015-11-29T03:43:18.879-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 424 151722609212830 0 2015-11-29T03:43:18.886-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 425 233680309880527 0 2015-11-29T03:43:18.886-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 426 35245875658998 0 2015-11-29T03:43:18.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 427 131797521882838 0 2015-11-29T03:43:18.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 428 198991215284468 0 2015-11-29T03:43:18.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 429 119167381626801 0 2015-11-29T03:43:18.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 430 30555336309438 0 2015-11-29T03:43:18.892-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 431 246578855658841 0 2015-11-29T03:43:18.892-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 432 99354817676042 0 2015-11-29T03:43:18.893-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 40000 QueuedCount 8625 2015-11-29T03:43:18.894-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 433 132567569560547 0 2015-11-29T03:43:18.894-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 434 80954113763846 0 2015-11-29T03:43:18.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 435 38966825555739 0 2015-11-29T03:43:18.898-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 436 92263266780812 0 2015-11-29T03:43:18.9-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 438 88908165505807 0 2015-11-29T03:43:18.901-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 437 137192492860048 0 2015-11-29T03:43:18.902-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 439 108519355778317 0 2015-11-29T03:43:18.902-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 440 121721509509846 0 2015-11-29T03:43:18.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 441 260657096733708 0 2015-11-29T03:43:18.906-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 442 204177118835644 0 2015-11-29T03:43:18.912-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 443 156342899552831 0 2015-11-29T03:43:18.912-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 444 115638547875814 0 2015-11-29T03:43:18.916-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 60000 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 445 74423385274562 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 447 59276990263495 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 448 185566078900888 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 446 49060426384334 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 451 215793969222913 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 452 35929404828600 0 2015-11-29T03:43:18.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 453 184388589926969 0 2015-11-29T03:43:18.93-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 449 95697461625731 0 2015-11-29T03:43:18.93-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 455 83881049173185 0 2015-11-29T03:43:18.93-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 450 280019486106722 0 2015-11-29T03:43:18.93-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 454 162385244377427 0 2015-11-29T03:43:18.933-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 456 211924978113847 0 2015-11-29T03:43:18.938-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 457 76848330004979 0 2015-11-29T03:43:18.945-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 458 234549196859537 0 2015-11-29T03:43:18.951-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 459 43433591629201 0 2015-11-29T03:43:18.951-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 460 168465686299342 0 2015-11-29T03:43:18.952-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 462 182675504193466 0 2015-11-29T03:43:18.953-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 461 130023243898422 0 2015-11-29T03:43:18.953-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 463 235958492112135 0 2015-11-29T03:43:18.953-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 464 131371612000268 0 2015-11-29T03:43:18.961-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 465 4886094564953 0 2015-11-29T03:43:18.961-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 466 199813721656189 0 2015-11-29T03:43:18.966-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 471 171030743106748 0 2015-11-29T03:43:18.966-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 472 189740340527954 0 2015-11-29T03:43:18.967-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 467 37933642787731 0 2015-11-29T03:43:18.967-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 468 81035988186934 0 2015-11-29T03:43:18.967-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 469 262602757874593 0 2015-11-29T03:43:18.967-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 470 214316097899940 0 2015-11-29T03:43:18.97-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 475 20188595876786 0 2015-11-29T03:43:18.97-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 473 96036599085743 0 2015-11-29T03:43:18.97-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 474 174233395064471 0 2015-11-29T03:43:18.97-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 476 78726857116716 0 2015-11-29T03:43:18.97-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 477 119975535953896 0 2015-11-29T03:43:18.985-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 480 145273195129390 0 2015-11-29T03:43:18.986-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 478 267948873060635 0 2015-11-29T03:43:18.986-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 479 174314834114793 0 2015-11-29T03:43:18.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 481 39683650252641 0 2015-11-29T03:43:18.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 482 8055414486401 0 2015-11-29T03:43:18.988-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 483 152301580656323 0 2015-11-29T03:43:18.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 484 29902000851209 0 2015-11-29T03:43:18.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 485 128726211863633 0 2015-11-29T03:43:18.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 486 223040640677195 0 2015-11-29T03:43:18.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 487 253271809514129 0 2015-11-29T03:43:18.991-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 488 254714919334720 0 2015-11-29T03:43:19.004-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 491 71300897569921 0 2015-11-29T03:43:19.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 489 14872269724951 0 2015-11-29T03:43:19.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 490 215916217613755 0 2015-11-29T03:43:19.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 492 2691561985203 0 2015-11-29T03:43:19.005-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 493 266093015854090 0 2015-11-29T03:43:19.007-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 494 107876988390245 0 2015-11-29T03:43:19.013-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 InstanceIds [16481390354720717219] 2015-11-29T03:43:19.014-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T03:43:19.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 497 258336962600283 0 2015-11-29T03:43:19.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 498 254984573873159 0 2015-11-29T03:43:19.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 495 209297837055271 0 2015-11-29T03:43:19.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 496 25098202521050 0 2015-11-29T03:43:19.025-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 499 164489548933272 0 2015-11-29T03:43:19.026-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 500 25599287242727 0 2015-11-29T03:43:19.027-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 501 145929305375011 0 2015-11-29T03:43:19.035-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 503 241607649874941 0 2015-11-29T03:43:19.036-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 502 158355655391855 0 2015-11-29T03:43:19.036-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 504 5998371756957 0 2015-11-29T03:43:19.037-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 505 200436277718240 0 2015-11-29T03:43:19.037-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 506 59390595504877 0 2015-11-29T03:43:19.039-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 508 230422378770417 0 2015-11-29T03:43:19.039-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.72:60127" +3 2015-11-29T03:43:19.039-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 507 163769255413290 0 2015-11-29T03:43:19.045-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 509 106387079504523 0 2015-11-29T03:43:19.045-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 510 82615885218927 0 2015-11-29T03:43:19.049-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 70000 2015-11-29T03:43:19.05-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 511 164316597084591 0 2015-11-29T03:43:19.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:19.139-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 80000 2015-11-29T03:43:19.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 90000 2015-11-29T03:43:19.262-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:19.283-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 512 100510391712930 0 2015-11-29T03:43:19.283-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 513 167038832325860 0 2015-11-29T03:43:19.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 514 67515323310301 0 2015-11-29T03:43:19.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 515 99852284299577 0 2015-11-29T03:43:19.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 516 213929785477131 0 2015-11-29T03:43:19.309-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 517 187397104464367 0 2015-11-29T03:43:19.31-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 518 150443663206346 0 2015-11-29T03:43:19.31-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 519 123460495266270 0 2015-11-29T03:43:19.31-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 520 16341312494934 0 2015-11-29T03:43:19.318-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 521 43895777213299 0 2015-11-29T03:43:19.319-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 522 130094040670931 0 2015-11-29T03:43:19.329-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 523 169678467668346 0 2015-11-29T03:43:19.329-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 524 152991512452915 0 2015-11-29T03:43:19.329-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 525 179749649222174 0 2015-11-29T03:43:19.344-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 526 224278982976224 0 2015-11-29T03:43:19.344-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 527 182353849204595 0 2015-11-29T03:43:19.374-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 100000 2015-11-29T03:43:19.378-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 529 13121090094357 0 2015-11-29T03:43:19.378-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 530 280609001322078 0 2015-11-29T03:43:19.379-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 528 132063223492548 0 2015-11-29T03:43:19.388-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 531 241170666246193 0 2015-11-29T03:43:19.388-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 532 208663623543969 0 2015-11-29T03:43:19.441-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 533 170359223628688 0 2015-11-29T03:43:19.45-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 534 200013361103965 0 2015-11-29T03:43:19.454-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 535 212621947651453 0 2015-11-29T03:43:19.454-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 536 78907923201891 0 2015-11-29T03:43:19.465-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 537 257456556581627 0 2015-11-29T03:43:19.465-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 538 154829190545326 0 2015-11-29T03:43:19.465-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 539 274113043979817 0 2015-11-29T03:43:19.472-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 541 141541963749581 0 2015-11-29T03:43:19.472-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 540 62557139314772 0 2015-11-29T03:43:19.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 110000 2015-11-29T03:43:19.48-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 542 195502785330267 0 2015-11-29T03:43:19.481-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 543 102146739585873 0 2015-11-29T03:43:19.481-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 544 65012041355552 0 2015-11-29T03:43:19.481-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 545 140348040208862 0 2015-11-29T03:43:19.485-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 546 88692488150533 0 2015-11-29T03:43:19.485-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 547 22135884898021 0 2015-11-29T03:43:19.493-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 548 87776273980961 0 2015-11-29T03:43:19.493-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 549 168004350623374 0 2015-11-29T03:43:19.493-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 550 253071248108470 0 2015-11-29T03:43:19.497-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 551 36387479595778 0 2015-11-29T03:43:19.497-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 552 109776417805814 0 2015-11-29T03:43:19.497-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 553 274549371010391 0 2015-11-29T03:43:19.503-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 554 101394536882738 0 2015-11-29T03:43:19.503-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 555 181739257538768 0 2015-11-29T03:43:19.51-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 556 33437218810210 0 2015-11-29T03:43:19.51-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 557 67550263942218 0 2015-11-29T03:43:19.51-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 558 258628103848895 0 2015-11-29T03:43:19.514-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 561 56093262828153 0 2015-11-29T03:43:19.515-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 559 88034607720075 0 2015-11-29T03:43:19.515-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 560 245395191478456 0 2015-11-29T03:43:19.517-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 562 163798609546286 0 2015-11-29T03:43:19.517-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 563 275305120729541 0 2015-11-29T03:43:19.521-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 564 48936674751321 0 2015-11-29T03:43:19.521-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 565 27288745047068 0 2015-11-29T03:43:19.522-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 566 232796328233576 0 2015-11-29T03:43:19.522-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 567 33738840299839 0 2015-11-29T03:43:19.527-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 568 276383371190373 0 2015-11-29T03:43:19.527-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 569 210130295407356 0 2015-11-29T03:43:19.54-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 570 240539098570849 0 2015-11-29T03:43:19.54-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 571 6421057324957 0 2015-11-29T03:43:19.546-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 572 161654436680584 0 2015-11-29T03:43:19.546-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 573 75191590335478 0 2015-11-29T03:43:19.546-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 120000 2015-11-29T03:43:19.55-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 50000 QueuedCount 50000 2015-11-29T03:43:19.556-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 574 281140234730405 0 2015-11-29T03:43:19.556-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 575 208757156539853 0 2015-11-29T03:43:19.565-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 576 253989340866010 0 2015-11-29T03:43:19.565-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 577 81887512016923 0 2015-11-29T03:43:19.568-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 578 48719924363024 0 2015-11-29T03:43:19.568-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 579 102399026727186 0 2015-11-29T03:43:19.571-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:19.59-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 580 268702404789703 0 2015-11-29T03:43:19.594-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 581 219524717403383 0 2015-11-29T03:43:19.597-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 582 231517379736956 0 2015-11-29T03:43:19.615-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 583 92995555467500 0 2015-11-29T03:43:19.615-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 584 140042844530751 0 2015-11-29T03:43:19.618-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 585 280289359484850 0 2015-11-29T03:43:19.623-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 586 221704406490329 0 2015-11-29T03:43:19.623-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 587 171954652176809 0 2015-11-29T03:43:19.637-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 588 262755794399075 0 2015-11-29T03:43:19.637-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 589 181389814034922 0 2015-11-29T03:43:19.641-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 591 28733433803385 0 2015-11-29T03:43:19.642-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 590 98723911656318 0 2015-11-29T03:43:19.643-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 593 192927794816009 0 2015-11-29T03:43:19.644-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 592 202621939806892 0 2015-11-29T03:43:19.646-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 594 56857654013912 0 2015-11-29T03:43:19.655-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 595 107338686274238 0 2015-11-29T03:43:19.655-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 596 11093346567727 0 2015-11-29T03:43:19.659-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 597 51494021679236 0 2015-11-29T03:43:19.659-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 598 216655378432046 0 2015-11-29T03:43:19.663-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 130000 2015-11-29T03:43:19.666-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 599 245506983003719 0 2015-11-29T03:43:19.666-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 600 160330536573591 0 2015-11-29T03:43:19.674-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 601 19204633799322 0 2015-11-29T03:43:19.675-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 602 1168187475212 0 2015-11-29T03:43:19.689-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 604 141063110635068 0 2015-11-29T03:43:19.691-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 603 62555465844056 0 2015-11-29T03:43:19.695-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 605 45618950629132 0 2015-11-29T03:43:19.695-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 606 10066918567939 0 2015-11-29T03:43:19.695-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 607 59607360009557 0 2015-11-29T03:43:19.699-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 608 34727362401750 0 2015-11-29T03:43:19.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 609 21358649373452 0 2015-11-29T03:43:19.713-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 610 127803065839546 0 2015-11-29T03:43:19.713-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 611 239942099578993 0 2015-11-29T03:43:19.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 612 265005346016824 0 2015-11-29T03:43:19.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 613 52340971978557 0 2015-11-29T03:43:19.73-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 614 251368359930455 0 2015-11-29T03:43:19.73-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 615 250530305979507 0 2015-11-29T03:43:19.73-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 616 175287924528854 0 2015-11-29T03:43:19.734-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 617 7867634724261 0 2015-11-29T03:43:19.734-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 618 64622012190723 0 2015-11-29T03:43:19.755-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 619 166378799316272 0 2015-11-29T03:43:19.755-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 620 152044750114210 0 2015-11-29T03:43:19.758-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 60000 QueuedCount 49970 2015-11-29T03:43:19.761-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 621 120879627106186 0 2015-11-29T03:43:19.761-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 622 16472725363460 0 2015-11-29T03:43:19.767-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 623 206013230258536 0 2015-11-29T03:43:19.767-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 624 91679977464693 0 2015-11-29T03:43:19.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 140000 2015-11-29T03:43:19.774-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 625 44990314796322 0 2015-11-29T03:43:19.774-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 626 69502915444858 0 2015-11-29T03:43:19.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 627 84068578509762 0 2015-11-29T03:43:19.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 628 88060758310067 0 2015-11-29T03:43:19.778-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 629 237084433956733 0 2015-11-29T03:43:19.783-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 630 41003494623757 0 2015-11-29T03:43:19.783-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 631 17654939334202 0 2015-11-29T03:43:19.794-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 632 95017689965448 0 2015-11-29T03:43:19.794-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 633 12129478410654 0 2015-11-29T03:43:19.801-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 634 155539557845518 0 2015-11-29T03:43:19.801-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 635 229742975523000 0 2015-11-29T03:43:19.804-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 636 152449818026145 0 2015-11-29T03:43:19.804-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 637 144454240049605 0 2015-11-29T03:43:19.808-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 638 151771451607185 0 2015-11-29T03:43:19.808-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 639 224095433175847 0 2015-11-29T03:43:19.815-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 640 253095207927960 0 2015-11-29T03:43:19.815-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 641 34814660929084 0 2015-11-29T03:43:19.815-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 642 148813525370918 0 2015-11-29T03:43:19.822-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 644 32920818406604 0 2015-11-29T03:43:19.823-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 643 141339494048250 0 2015-11-29T03:43:19.829-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 646 58012123703190 0 2015-11-29T03:43:19.829-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 645 43515393869432 0 2015-11-29T03:43:19.856-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 647 52242745886700 0 2015-11-29T03:43:19.876-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 648 99768664186646 0 2015-11-29T03:43:19.876-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 649 275293286593771 0 2015-11-29T03:43:19.883-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 652 115938671988400 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 653 82857573182945 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 655 211736616030892 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 650 229158877271509 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 651 148411296517730 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 654 145593826047543 0 2015-11-29T03:43:19.884-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 656 164760861801321 0 2015-11-29T03:43:19.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 150000 2015-11-29T03:43:19.894-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 657 44080765968669 0 2015-11-29T03:43:19.896-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 658 169885554595852 0 2015-11-29T03:43:19.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 659 62574864305353 0 2015-11-29T03:43:19.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 660 103090468629179 0 2015-11-29T03:43:19.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 661 259030381062031 0 2015-11-29T03:43:19.905-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 662 192682901858481 0 2015-11-29T03:43:19.905-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 663 192996637940970 0 2015-11-29T03:43:19.915-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 665 85007663458399 0 2015-11-29T03:43:19.916-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 664 110952969202867 0 2015-11-29T03:43:19.921-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 667 4965049163455 0 2015-11-29T03:43:19.922-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 666 74221193677137 0 2015-11-29T03:43:19.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 668 98872656666019 0 2015-11-29T03:43:19.929-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 669 7459702601340 0 2015-11-29T03:43:19.933-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 670 75112096878489 0 2015-11-29T03:43:19.933-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 671 39539032881040 0 2015-11-29T03:43:19.936-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 672 61027948971461 0 2015-11-29T03:43:19.936-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 673 108843537861568 0 2015-11-29T03:43:19.937-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 674 128049269314390 0 2015-11-29T03:43:19.95-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 675 254663216321455 0 2015-11-29T03:43:19.95-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 676 32898765029231 0 2015-11-29T03:43:19.959-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 677 32864185287458 0 2015-11-29T03:43:19.959-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 678 147889867709703 0 2015-11-29T03:43:19.969-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 679 65991471500871 0 2015-11-29T03:43:19.969-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 680 190446099423334 0 2015-11-29T03:43:19.977-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 681 173173036059279 0 2015-11-29T03:43:19.977-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 682 2894695423169 0 2015-11-29T03:43:19.978-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 683 199712842839130 0 2015-11-29T03:43:19.979-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 70000 QueuedCount 50000 2015-11-29T03:43:19.993-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 684 6139011605068 0 2015-11-29T03:43:19.993-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 685 268612094524511 0 2015-11-29T03:43:20.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 160000 2015-11-29T03:43:20.008-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 686 215630478185650 0 2015-11-29T03:43:20.008-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 687 122772601033995 0 2015-11-29T03:43:20.009-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 688 199602902816614 0 2015-11-29T03:43:20.009-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 689 278032059877041 0 2015-11-29T03:43:20.01-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 690 228340096786679 0 2015-11-29T03:43:20.01-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 691 183436222426812 0 2015-11-29T03:43:20.018-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 InstanceIds [16481390354720717219] 2015-11-29T03:43:20.018-08:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 Instances [indexInstance: singlePartn: > ] 2015-11-29T03:43:20.029-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 692 75457944158288 0 2015-11-29T03:43:20.029-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 693 184538077472536 0 2015-11-29T03:43:20.03-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 694 123231989740687 0 2015-11-29T03:43:20.03-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 695 153658363194499 0 2015-11-29T03:43:20.03-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 696 199537340296689 0 2015-11-29T03:43:20.031-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 697 135252214559081 0 2015-11-29T03:43:20.031-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 698 194164786579729 0 2015-11-29T03:43:20.032-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 699 61629907092782 0 2015-11-29T03:43:20.032-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 700 227073771015194 0 2015-11-29T03:43:20.039-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:20.055-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 701 268417097055040 0 2015-11-29T03:43:20.055-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 702 130755304230451 0 2015-11-29T03:43:20.057-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 704 267792221353605 0 2015-11-29T03:43:20.058-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 703 204907945542310 0 2015-11-29T03:43:20.062-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 705 275281286835161 0 2015-11-29T03:43:20.062-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 706 264166590799758 0 2015-11-29T03:43:20.068-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 707 277356126919724 0 2015-11-29T03:43:20.068-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 708 184823172314284 0 2015-11-29T03:43:20.071-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 710 198041775088956 0 2015-11-29T03:43:20.071-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 709 2401399822128 0 2015-11-29T03:43:20.073-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 711 280646080266664 0 2015-11-29T03:43:20.073-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 712 57166523648521 0 2015-11-29T03:43:20.087-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 713 253230949010746 0 2015-11-29T03:43:20.089-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 714 144764290366099 0 2015-11-29T03:43:20.098-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 715 134221637727096 0 2015-11-29T03:43:20.098-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 716 224535561440604 0 2015-11-29T03:43:20.101-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 717 267172479661571 0 2015-11-29T03:43:20.101-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 718 98237398898484 0 2015-11-29T03:43:20.105-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 719 147484236193327 0 2015-11-29T03:43:20.105-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 720 49773175832686 0 2015-11-29T03:43:20.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 721 4418702524647 0 2015-11-29T03:43:20.108-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 722 100581314335331 0 2015-11-29T03:43:20.11-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 725 132774195955324 0 2015-11-29T03:43:20.111-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 723 47646944658698 0 2015-11-29T03:43:20.112-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 724 271009236310559 0 2015-11-29T03:43:20.112-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 726 62588952575035 0 2015-11-29T03:43:20.112-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 727 56289991357506 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 731 162820765169486 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 734 10140273192912 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 728 177109726443222 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 729 170623789514359 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 730 144084790013293 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 735 106432307849852 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 736 150506203341954 0 2015-11-29T03:43:20.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 737 108802336527217 0 2015-11-29T03:43:20.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 732 155961235672512 0 2015-11-29T03:43:20.122-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 733 263770785919125 0 2015-11-29T03:43:20.126-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 170000 2015-11-29T03:43:20.137-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 738 147407177062056 0 2015-11-29T03:43:20.137-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 739 168330640331506 0 2015-11-29T03:43:20.143-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 740 21362481193652 0 2015-11-29T03:43:20.144-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 741 6972853106614 0 2015-11-29T03:43:20.144-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 742 146760433577095 0 2015-11-29T03:43:20.157-08:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.73:43640" +4 2015-11-29T03:43:20.165-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 743 34108412273295 0 2015-11-29T03:43:20.166-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 745 79511961703927 0 2015-11-29T03:43:20.167-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 744 209415595463326 0 2015-11-29T03:43:20.174-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 746 5526626089282 0 2015-11-29T03:43:20.174-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 747 131283794986098 0 2015-11-29T03:43:20.177-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 748 49976269982660 0 2015-11-29T03:43:20.177-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 749 227006346742588 0 2015-11-29T03:43:20.182-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 750 197636717038994 0 2015-11-29T03:43:20.182-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 751 155700031478340 0 2015-11-29T03:43:20.186-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 752 80917873880795 0 2015-11-29T03:43:20.186-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 753 47126718407715 0 2015-11-29T03:43:20.198-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 754 99885999995931 0 2015-11-29T03:43:20.198-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 755 55073738893346 0 2015-11-29T03:43:20.199-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 80000 QueuedCount 50000 2015-11-29T03:43:20.202-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 756 8625305803783 0 2015-11-29T03:43:20.202-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 757 241572718120388 0 2015-11-29T03:43:20.205-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 758 220043505850673 0 2015-11-29T03:43:20.205-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 759 210346119480058 0 2015-11-29T03:43:20.205-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 760 153515354018850 0 2015-11-29T03:43:20.246-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 762 177792111485512 0 2015-11-29T03:43:20.247-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 761 217709684914484 0 2015-11-29T03:43:20.262-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 763 228761742342723 0 2015-11-29T03:43:20.262-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 764 135354058690376 0 2015-11-29T03:43:20.269-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 765 80514658992555 0 2015-11-29T03:43:20.27-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 766 179896625377862 0 2015-11-29T03:43:20.278-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 767 63665279107007 0 2015-11-29T03:43:20.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 180000 2015-11-29T03:43:20.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 190000 2015-11-29T03:43:20.608-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 200000 2015-11-29T03:43:20.766-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 210000 2015-11-29T03:43:20.924-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 220000 2015-11-29T03:43:21.061-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 230000 2015-11-29T03:43:21.088-08:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_1c:d5:f6:54:e4:c7:e:84 bucket-1 InstanceIds [16481390354720717219] 2015-11-29T03:43:21.089-08:00 [Info] Indexer::sendStreamUpdateForBuildIndex Stream Request Success For Stream MAINT_STREAM Bucket bucket-1. 2015-11-29T03:43:21.093-08:00 [Info] Indexer::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2015-11-29T03:43:21.093-08:00 [Info] Timekeeper::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2015-11-29T03:43:21.093-08:00 [Info] Timekeeper::handleStreamRequestDone Call RepairStream to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2015-11-29T03:43:21.093-08:00 [Info] Timekeeper::handleStreamRequestDone Call RepairMissingStreamBegin to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2015-11-29T03:43:21.093-08:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM 2015-11-29T03:43:21.156-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 90000 QueuedCount 50000 2015-11-29T03:43:21.174-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:21.177-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 240000 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 773 130610466630900 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 782 146698940719651 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 783 97625199688134 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 784 265741468753081 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 786 260271258433374 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 768 195966796517893 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 779 22449683297091 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 785 22559857263708 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 787 200101609759047 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 772 275951279113544 0 2015-11-29T03:43:21.203-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 776 84953448774655 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 778 50712180368268 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 780 51430252270048 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 769 158523397190530 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 771 265565070036447 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 774 212500943009097 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 775 143795895537424 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 777 222919119520337 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 781 243019649707784 0 2015-11-29T03:43:21.204-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 770 77381583082317 0 2015-11-29T03:43:21.256-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 788 237244873478157 0 2015-11-29T03:43:21.256-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 789 9706227467224 0 2015-11-29T03:43:21.263-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 790 195601739293342 0 2015-11-29T03:43:21.285-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 791 23356769692207 0 2015-11-29T03:43:21.285-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 792 233289193846886 0 2015-11-29T03:43:21.285-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 793 41514522650144 0 2015-11-29T03:43:21.298-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 794 35996537645253 0 2015-11-29T03:43:21.307-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 250000 2015-11-29T03:43:21.327-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 795 272452154543352 0 2015-11-29T03:43:21.327-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 796 128120410486417 0 2015-11-29T03:43:21.36-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 797 103177805205246 0 2015-11-29T03:43:21.36-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 798 115356174123203 0 2015-11-29T03:43:21.365-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 100000 QueuedCount 50000 2015-11-29T03:43:21.394-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 799 117543785458255 0 2015-11-29T03:43:21.394-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 800 96899240908344 0 2015-11-29T03:43:21.423-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 260000 2015-11-29T03:43:21.432-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 801 69085493069557 0 2015-11-29T03:43:21.439-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 802 73881686083200 0 2015-11-29T03:43:21.474-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 803 183796042718307 0 2015-11-29T03:43:21.488-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 804 19537506723880 0 2015-11-29T03:43:21.505-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 805 1513889777371 0 2015-11-29T03:43:21.505-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 806 41906543853080 0 2015-11-29T03:43:21.515-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 807 82265736706065 0 2015-11-29T03:43:21.515-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 808 266917687877266 0 2015-11-29T03:43:21.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 270000 2015-11-29T03:43:21.536-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 809 72879511200016 0 2015-11-29T03:43:21.536-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 810 259395103034195 0 2015-11-29T03:43:21.537-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 811 120865446806184 0 2015-11-29T03:43:21.545-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 812 27268313169870 0 2015-11-29T03:43:21.545-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 813 149268806690882 0 2015-11-29T03:43:21.55-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 814 180804784115921 0 2015-11-29T03:43:21.55-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 815 161901339363930 0 2015-11-29T03:43:21.55-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 816 250847634919919 0 2015-11-29T03:43:21.569-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 818 195312235617648 0 2015-11-29T03:43:21.57-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 817 18412547855079 0 2015-11-29T03:43:21.578-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:21.586-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 819 200642390871078 0 2015-11-29T03:43:21.586-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 820 73983301804553 0 2015-11-29T03:43:21.603-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 821 181493866374834 0 2015-11-29T03:43:21.603-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 822 23806986043925 0 2015-11-29T03:43:21.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 823 40576218754726 0 2015-11-29T03:43:21.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 824 101504574779642 0 2015-11-29T03:43:21.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 825 46771894735379 0 2015-11-29T03:43:21.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 826 62979955067747 0 2015-11-29T03:43:21.619-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 110000 QueuedCount 50000 2015-11-29T03:43:21.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 827 141278014489923 0 2015-11-29T03:43:21.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 828 221623179430219 0 2015-11-29T03:43:21.627-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 829 120321856328899 0 2015-11-29T03:43:21.638-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 830 187094852615537 0 2015-11-29T03:43:21.638-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 831 197832833356217 0 2015-11-29T03:43:21.647-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 832 244921198693479 0 2015-11-29T03:43:21.647-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 833 87276120979504 0 2015-11-29T03:43:21.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 280000 2015-11-29T03:43:21.677-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 835 161524581616019 0 2015-11-29T03:43:21.678-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 834 91136747368525 0 2015-11-29T03:43:21.69-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 836 139675381347039 0 2015-11-29T03:43:21.691-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 837 83162981381937 0 2015-11-29T03:43:21.699-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 840 37450101804064 0 2015-11-29T03:43:21.699-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 841 96339009936880 0 2015-11-29T03:43:21.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 838 55829794571479 0 2015-11-29T03:43:21.7-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 839 150958882977864 0 2015-11-29T03:43:21.705-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 843 146693143515730 0 2015-11-29T03:43:21.705-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 844 25365934162919 0 2015-11-29T03:43:21.706-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 842 153923308735200 0 2015-11-29T03:43:21.723-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 846 35527974302028 0 2015-11-29T03:43:21.724-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 845 47799644832024 0 2015-11-29T03:43:21.736-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 847 278886049087960 0 2015-11-29T03:43:21.736-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 848 148731906080405 0 2015-11-29T03:43:21.741-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 849 124172004938804 0 2015-11-29T03:43:21.745-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 850 90135076623838 0 2015-11-29T03:43:21.759-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 851 26583654606320 0 2015-11-29T03:43:21.774-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 852 89001133841751 0 2015-11-29T03:43:21.775-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 853 212591148363891 0 2015-11-29T03:43:21.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 290000 2015-11-29T03:43:21.783-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 854 60716198012680 0 2015-11-29T03:43:21.797-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 855 31884734524838 0 2015-11-29T03:43:21.797-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 856 230284584396168 0 2015-11-29T03:43:21.805-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 857 206650922662140 0 2015-11-29T03:43:21.805-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 858 236521962719439 0 2015-11-29T03:43:21.812-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 860 263020266871029 0 2015-11-29T03:43:21.813-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 859 78423475030624 0 2015-11-29T03:43:21.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 861 70632216186276 0 2015-11-29T03:43:21.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 862 35026526924185 0 2015-11-29T03:43:21.833-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 864 266008874431861 0 2015-11-29T03:43:21.834-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 863 161483131375240 0 2015-11-29T03:43:21.835-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 865 20917837277109 0 2015-11-29T03:43:21.835-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 866 50185822027572 0 2015-11-29T03:43:21.836-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 867 186663498011716 0 2015-11-29T03:43:21.862-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 868 158689269990915 0 2015-11-29T03:43:21.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 869 263072902615413 0 2015-11-29T03:43:21.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 870 180000147418712 0 2015-11-29T03:43:21.865-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 871 137395812739567 0 2015-11-29T03:43:21.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 872 19989169891047 0 2015-11-29T03:43:21.866-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 873 95575955574198 0 2015-11-29T03:43:21.871-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 874 258002240598305 0 2015-11-29T03:43:21.88-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 120000 QueuedCount 50000 2015-11-29T03:43:21.888-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 875 250856066285920 0 2015-11-29T03:43:21.894-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 876 45916410204512 0 2015-11-29T03:43:21.894-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 877 275084847126747 0 2015-11-29T03:43:21.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 879 256004177965770 0 2015-11-29T03:43:21.897-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 878 7858232024800 0 2015-11-29T03:43:21.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 300000 2015-11-29T03:43:21.903-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 880 86600484731678 0 2015-11-29T03:43:21.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 881 95602883839409 0 2015-11-29T03:43:21.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 882 196945893516867 0 2015-11-29T03:43:21.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 883 69655174806732 0 2015-11-29T03:43:21.904-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 884 55844322509067 0 2015-11-29T03:43:21.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 885 226211678860412 0 2015-11-29T03:43:21.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 886 34880826964609 0 2015-11-29T03:43:21.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 887 138947076456832 0 2015-11-29T03:43:21.947-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 888 213529714058930 0 2015-11-29T03:43:21.952-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 889 226134038304664 0 2015-11-29T03:43:21.952-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 890 21502626116486 0 2015-11-29T03:43:21.956-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 891 7678017582698 0 2015-11-29T03:43:21.958-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 892 3335554401289 0 2015-11-29T03:43:21.958-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 893 158176481489284 0 2015-11-29T03:43:21.962-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 894 234343216773846 0 2015-11-29T03:43:21.971-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 895 128561415147400 0 2015-11-29T03:43:21.971-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 896 1087680978236 0 2015-11-29T03:43:21.983-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 897 150106161120910 0 2015-11-29T03:43:21.983-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 898 124526399153600 0 2015-11-29T03:43:22.017-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 899 211764701168816 0 2015-11-29T03:43:22.017-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 900 157950290009921 0 2015-11-29T03:43:22.019-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 902 131948089230249 0 2015-11-29T03:43:22.021-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 901 195730132483244 0 2015-11-29T03:43:22.024-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 903 231984406393012 0 2015-11-29T03:43:22.029-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 905 118369721576017 0 2015-11-29T03:43:22.031-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 904 108158917932303 0 2015-11-29T03:43:22.032-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 906 28076308939646 0 2015-11-29T03:43:22.033-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 907 100424337389122 0 2015-11-29T03:43:22.052-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 908 84721420835181 0 2015-11-29T03:43:22.052-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 909 154487254599438 0 2015-11-29T03:43:22.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 310000 2015-11-29T03:43:22.058-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 910 115400545811950 0 2015-11-29T03:43:22.058-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 911 149607364363926 0 2015-11-29T03:43:22.059-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 912 28403274022673 0 2015-11-29T03:43:22.059-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 913 237949564321360 0 2015-11-29T03:43:22.072-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 914 181453848400195 0 2015-11-29T03:43:22.077-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 916 248868125276739 0 2015-11-29T03:43:22.077-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 917 142448055663701 0 2015-11-29T03:43:22.08-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 915 6252863369189 0 2015-11-29T03:43:22.08-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 918 146444259640231 0 2015-11-29T03:43:22.093-08:00 [Info] StreamState::adjustNonSnapAlignedVbs Bucket bucket-1 StreamId MAINT_STREAM Vbuckets []. 2015-11-29T03:43:22.094-08:00 [Info] Timekeeper::repairStream Nothing to repair for Stream MAINT_STREAM and Bucket bucket-1 2015-11-29T03:43:22.1-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 919 276209191944543 0 2015-11-29T03:43:22.103-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 920 108944148280882 0 2015-11-29T03:43:22.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 922 172551477028185 0 2015-11-29T03:43:22.121-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 923 88880770512363 0 2015-11-29T03:43:22.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 921 154538745021538 0 2015-11-29T03:43:22.123-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 925 156290657443454 0 2015-11-29T03:43:22.125-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 924 125717999512038 0 2015-11-29T03:43:22.131-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 926 221204967626871 0 2015-11-29T03:43:22.146-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 928 178088277862948 0 2015-11-29T03:43:22.147-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 927 141271613232585 0 2015-11-29T03:43:22.148-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 929 62790645361974 0 2015-11-29T03:43:22.171-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 931 264252014209388 0 2015-11-29T03:43:22.172-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 930 188516101479343 0 2015-11-29T03:43:22.177-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 933 184748596339297 0 2015-11-29T03:43:22.177-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 932 48142132903660 0 2015-11-29T03:43:22.186-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 934 144456073559900 0 2015-11-29T03:43:22.186-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 935 10989604817372 0 2015-11-29T03:43:22.194-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 936 66613711836001 0 2015-11-29T03:43:22.194-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 937 128144812529233 0 2015-11-29T03:43:22.198-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 939 263673810112844 0 2015-11-29T03:43:22.2-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 938 25809055236800 0 2015-11-29T03:43:22.207-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 940 24378473495904 0 2015-11-29T03:43:22.207-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 941 249045484207797 0 2015-11-29T03:43:22.222-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 320000 2015-11-29T03:43:22.227-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 942 184693869074715 0 2015-11-29T03:43:22.236-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 943 188159385740540 0 2015-11-29T03:43:22.236-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 944 224389597351298 0 2015-11-29T03:43:22.251-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 945 34401946557440 0 2015-11-29T03:43:22.251-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 946 244094221580702 0 2015-11-29T03:43:22.253-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 948 275318092328195 0 2015-11-29T03:43:22.253-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 949 219102957939003 0 2015-11-29T03:43:22.254-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 947 276637327682776 0 2015-11-29T03:43:22.266-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 951 125114461873775 0 2015-11-29T03:43:22.266-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 950 194291110607197 0 2015-11-29T03:43:22.274-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 952 211792461113449 0 2015-11-29T03:43:22.294-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 953 40913214645068 0 2015-11-29T03:43:22.294-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 954 42027739844022 0 2015-11-29T03:43:22.302-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 956 151386010657690 0 2015-11-29T03:43:22.302-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 957 24169447830461 0 2015-11-29T03:43:22.303-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 955 233892831998043 0 2015-11-29T03:43:22.304-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 958 210706471412378 0 2015-11-29T03:43:22.324-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 961 84517362982320 0 2015-11-29T03:43:22.325-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 959 11406171782360 0 2015-11-29T03:43:22.325-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 960 78947617451925 0 2015-11-29T03:43:22.327-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 962 32051336753342 0 2015-11-29T03:43:22.327-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 963 128731195088668 0 2015-11-29T03:43:22.333-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 964 125302769350384 0 2015-11-29T03:43:22.333-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 965 21810091986243 0 2015-11-29T03:43:22.34-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 966 278206066286670 0 2015-11-29T03:43:22.349-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 968 184826178608687 0 2015-11-29T03:43:22.349-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 967 1494037233701 0 2015-11-29T03:43:22.352-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 969 221810808749403 0 2015-11-29T03:43:22.352-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 970 118367960777438 0 2015-11-29T03:43:22.358-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 971 13995804037197 0 2015-11-29T03:43:22.358-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 972 223300157091671 0 2015-11-29T03:43:22.362-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 974 66207658293054 0 2015-11-29T03:43:22.362-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 973 73898137302804 0 2015-11-29T03:43:22.373-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 975 264116196346103 0 2015-11-29T03:43:22.373-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 976 85218729980151 0 2015-11-29T03:43:22.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 330000 2015-11-29T03:43:22.394-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 977 168730422719540 0 2015-11-29T03:43:22.413-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 978 237454011932099 0 2015-11-29T03:43:22.413-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 979 102631093275700 0 2015-11-29T03:43:22.417-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 980 30445917159659 0 2015-11-29T03:43:22.426-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 981 142452276484584 0 2015-11-29T03:43:22.426-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 982 92472951568042 0 2015-11-29T03:43:22.452-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 983 146601691505646 0 2015-11-29T03:43:22.454-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 984 141298992989191 0 2015-11-29T03:43:22.465-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 985 208371969514914 0 2015-11-29T03:43:22.486-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 986 191903142893581 0 2015-11-29T03:43:22.519-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 987 46621666347495 0 2015-11-29T03:43:22.528-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 989 17841607108880 0 2015-11-29T03:43:22.528-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 988 74580945683027 0 2015-11-29T03:43:22.546-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 990 31643506859845 0 2015-11-29T03:43:22.547-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 992 231822308050880 0 2015-11-29T03:43:22.548-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 991 241178471241267 0 2015-11-29T03:43:22.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 340000 2015-11-29T03:43:22.551-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 993 271126645454308 0 2015-11-29T03:43:22.611-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 994 217995719612657 0 2015-11-29T03:43:22.612-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 995 15043408341418 0 2015-11-29T03:43:22.625-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 997 216715171916278 0 2015-11-29T03:43:22.626-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 996 201843644644330 0 2015-11-29T03:43:22.63-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 998 35983265782000 0 2015-11-29T03:43:22.63-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 999 269214948073045 0 2015-11-29T03:43:22.639-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1000 199221768297353 0 2015-11-29T03:43:22.64-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1001 41306387480146 0 2015-11-29T03:43:22.653-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1002 48895213179914 0 2015-11-29T03:43:22.656-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1003 25228775753266 0 2015-11-29T03:43:22.657-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1004 142897513402823 0 2015-11-29T03:43:22.657-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1005 100755201443585 0 2015-11-29T03:43:22.659-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1006 221961007458189 0 2015-11-29T03:43:22.673-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1007 267521638314659 0 2015-11-29T03:43:22.675-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1008 1176276834723 0 2015-11-29T03:43:22.675-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1009 209725737218181 0 2015-11-29T03:43:22.682-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1010 256320543295401 0 2015-11-29T03:43:22.682-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1011 221247130357202 0 2015-11-29T03:43:22.684-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1012 749384502824 0 2015-11-29T03:43:22.684-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1013 252651706722278 0 2015-11-29T03:43:22.685-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1014 82479838311413 0 2015-11-29T03:43:22.685-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1015 208021038801696 0 2015-11-29T03:43:22.702-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1017 13459764654417 0 2015-11-29T03:43:22.703-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1016 119098812594770 0 2015-11-29T03:43:22.709-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1018 118039541018009 0 2015-11-29T03:43:22.709-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1019 138971931726417 0 2015-11-29T03:43:22.713-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1020 35939270224508 0 2015-11-29T03:43:22.714-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1021 227287328026580 0 2015-11-29T03:43:22.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 350000 2015-11-29T03:43:22.744-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1022 38345187841717 0 2015-11-29T03:43:22.746-08:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1023 189805285873196 0 2015-11-29T03:43:22.752-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:22.853-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 360000 2015-11-29T03:43:22.877-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 130000 QueuedCount 50000 2015-11-29T03:43:22.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 370000 2015-11-29T03:43:23.072-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 140000 QueuedCount 46441 2015-11-29T03:43:23.081-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 380000 2015-11-29T03:43:23.093-08:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM done 2015-11-29T03:43:23.239-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 390000 2015-11-29T03:43:23.256-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 150000 QueuedCount 36441 2015-11-29T03:43:23.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 400000 2015-11-29T03:43:23.446-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 160000 QueuedCount 26441 2015-11-29T03:43:23.562-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 410000 2015-11-29T03:43:23.724-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 420000 2015-11-29T03:43:23.871-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 430000 2015-11-29T03:43:24.02-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 440000 2015-11-29T03:43:24.054-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 170000 QueuedCount 16441 2015-11-29T03:43:24.158-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 180000 QueuedCount 6441 2015-11-29T03:43:24.171-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 450000 2015-11-29T03:43:24.32-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 460000 2015-11-29T03:43:24.479-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 470000 2015-11-29T03:43:24.674-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 480000 2015-11-29T03:43:24.814-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.210083604s CommitTime 591.404887ms TotalFlushTime 5.422742843s TotalCommitTime 591.404887ms 2015-11-29T03:43:24.814-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 94027, 94027, 1 committed:true 2015-11-29T03:43:24.814-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 12368707656872223059 (SnapshotInfo: seqnos: 94027, 94027, 1 committed:true) SnapCreateDur 1.803919286s SnapOpenDur 236.354µs 2015-11-29T03:43:24.816-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 490000 2015-11-29T03:43:24.852-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:24.891-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:24.906-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 500000 2015-11-29T03:43:24.929-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:24.929-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 190000 QueuedCount 33977 2015-11-29T03:43:24.974-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:24.988-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 510000 2015-11-29T03:43:25.06-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 520000 2015-11-29T03:43:25.13-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 530000 2015-11-29T03:43:25.141-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 200000 QueuedCount 50000 2015-11-29T03:43:25.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 540000 2015-11-29T03:43:25.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 550000 2015-11-29T03:43:25.273-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:25.328-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 210000 QueuedCount 49988 2015-11-29T03:43:25.351-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 560000 2015-11-29T03:43:25.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 570000 2015-11-29T03:43:25.52-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 220000 QueuedCount 50000 2015-11-29T03:43:25.543-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 580000 2015-11-29T03:43:25.607-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:25.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 590000 2015-11-29T03:43:25.822-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 600000 2015-11-29T03:43:25.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 610000 2015-11-29T03:43:26.142-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 620000 2015-11-29T03:43:26.306-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 630000 2015-11-29T03:43:26.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 640000 2015-11-29T03:43:26.468-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 230000 QueuedCount 50000 2015-11-29T03:43:26.559-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 650000 2015-11-29T03:43:26.655-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 240000 QueuedCount 50000 2015-11-29T03:43:26.669-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 660000 2015-11-29T03:43:26.672-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:26.78-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 670000 2015-11-29T03:43:26.862-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 250000 QueuedCount 50000 2015-11-29T03:43:26.901-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 680000 2015-11-29T03:43:27.016-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:27.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 690000 2015-11-29T03:43:27.108-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 260000 QueuedCount 50000 2015-11-29T03:43:27.151-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 700000 2015-11-29T03:43:27.281-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 710000 2015-11-29T03:43:27.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 720000 2015-11-29T03:43:27.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 730000 2015-11-29T03:43:27.819-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 740000 2015-11-29T03:43:27.972-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 750000 2015-11-29T03:43:28.124-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:28.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 760000 2015-11-29T03:43:28.164-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 270000 QueuedCount 50000 2015-11-29T03:43:28.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 770000 2015-11-29T03:43:28.366-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 780000 2015-11-29T03:43:28.42-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 280000 QueuedCount 50000 2015-11-29T03:43:28.51-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 790000 2015-11-29T03:43:28.67-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 290000 QueuedCount 40104 2015-11-29T03:43:28.675-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 800000 2015-11-29T03:43:28.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 810000 2015-11-29T03:43:28.927-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 300000 QueuedCount 30104 2015-11-29T03:43:29.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 820000 2015-11-29T03:43:29.171-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 830000 2015-11-29T03:43:29.331-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 840000 2015-11-29T03:43:29.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 850000 2015-11-29T03:43:29.651-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 860000 2015-11-29T03:43:29.803-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 870000 2015-11-29T03:43:29.848-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 310000 QueuedCount 20104 2015-11-29T03:43:29.953-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 880000 2015-11-29T03:43:29.978-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 320000 QueuedCount 10104 2015-11-29T03:43:30.095-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 890000 2015-11-29T03:43:30.114-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 330000 QueuedCount 104 2015-11-29T03:43:30.253-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 900000 2015-11-29T03:43:30.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 910000 2015-11-29T03:43:30.576-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 920000 2015-11-29T03:43:30.646-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.984µs CommitTime 517.271695ms TotalFlushTime 10.399122722s TotalCommitTime 1.108676582s 2015-11-29T03:43:30.646-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 166771, 166771, 2 committed:true 2015-11-29T03:43:30.646-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 9793711859677040291 (SnapshotInfo: seqnos: 166771, 166771, 2 committed:true) SnapCreateDur 523.503105ms SnapOpenDur 146.551µs 2015-11-29T03:43:30.677-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:30.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 930000 2015-11-29T03:43:30.712-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:30.749-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:30.792-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 940000 2015-11-29T03:43:30.828-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:30.864-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 950000 2015-11-29T03:43:30.887-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 340000 QueuedCount 50000 2015-11-29T03:43:30.935-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 960000 2015-11-29T03:43:31.007-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 970000 2015-11-29T03:43:31.073-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:31.081-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 980000 2015-11-29T03:43:31.089-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 350000 QueuedCount 49191 2015-11-29T03:43:31.16-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 990000 2015-11-29T03:43:31.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1000000 2015-11-29T03:43:31.306-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 360000 QueuedCount 49899 2015-11-29T03:43:31.34-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:31.357-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1010000 2015-11-29T03:43:31.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1020000 2015-11-29T03:43:31.541-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 370000 QueuedCount 50000 2015-11-29T03:43:31.604-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1030000 2015-11-29T03:43:31.768-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1040000 2015-11-29T03:43:31.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1050000 2015-11-29T03:43:32.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1060000 2015-11-29T03:43:32.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1070000 2015-11-29T03:43:32.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:32.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1080000 2015-11-29T03:43:32.413-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 380000 QueuedCount 50000 2015-11-29T03:43:32.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1090000 2015-11-29T03:43:32.663-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:32.689-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 390000 QueuedCount 50000 2015-11-29T03:43:32.694-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1100000 2015-11-29T03:43:32.796-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1110000 2015-11-29T03:43:32.868-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 400000 QueuedCount 50000 2015-11-29T03:43:32.91-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:32.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1120000 2015-11-29T03:43:33.04-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1130000 2015-11-29T03:43:33.113-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 410000 QueuedCount 50000 2015-11-29T03:43:33.168-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1140000 2015-11-29T03:43:33.333-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1150000 2015-11-29T03:43:33.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1160000 2015-11-29T03:43:33.657-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1170000 2015-11-29T03:43:33.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1180000 2015-11-29T03:43:33.94-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1190000 2015-11-29T03:43:34.004-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:34.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1200000 2015-11-29T03:43:34.083-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 420000 QueuedCount 50000 2015-11-29T03:43:34.142-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1210000 2015-11-29T03:43:34.212-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 430000 QueuedCount 44087 2015-11-29T03:43:34.277-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1220000 2015-11-29T03:43:34.325-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 440000 QueuedCount 34087 2015-11-29T03:43:34.409-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1230000 2015-11-29T03:43:34.443-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 450000 QueuedCount 24087 2015-11-29T03:43:34.551-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1240000 2015-11-29T03:43:34.691-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1250000 2015-11-29T03:43:34.828-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1260000 2015-11-29T03:43:34.975-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1270000 2015-11-29T03:43:35.026-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 460000 QueuedCount 14087 2015-11-29T03:43:35.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1280000 2015-11-29T03:43:35.128-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 470000 QueuedCount 4087 2015-11-29T03:43:35.234-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1290000 2015-11-29T03:43:35.377-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1300000 2015-11-29T03:43:35.526-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1310000 2015-11-29T03:43:35.671-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1320000 2015-11-29T03:43:35.716-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.007µs CommitTime 529.906724ms TotalFlushTime 14.674973334s TotalCommitTime 1.638583306s 2015-11-29T03:43:35.716-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 239343, 239343, 3 committed:true 2015-11-29T03:43:35.716-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 239343, 239343, 3 committed:true) SnapCreateDur 541.058545ms SnapOpenDur 129.485µs 2015-11-29T03:43:35.752-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:35.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1330000 2015-11-29T03:43:35.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:35.876-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1340000 2015-11-29T03:43:35.878-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 480000 QueuedCount 50000 2015-11-29T03:43:35.95-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1350000 2015-11-29T03:43:36.025-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1360000 2015-11-29T03:43:36.047-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:36.079-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 490000 QueuedCount 50000 2015-11-29T03:43:36.105-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1370000 2015-11-29T03:43:36.18-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1380000 2015-11-29T03:43:36.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1390000 2015-11-29T03:43:36.284-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 500000 QueuedCount 50000 2015-11-29T03:43:36.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1400000 2015-11-29T03:43:36.438-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1410000 2015-11-29T03:43:36.498-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 510000 QueuedCount 50000 2015-11-29T03:43:36.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1420000 2015-11-29T03:43:36.687-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1430000 2015-11-29T03:43:36.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1440000 2015-11-29T03:43:37.036-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1450000 2015-11-29T03:43:37.211-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1460000 2015-11-29T03:43:37.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:37.354-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1470000 2015-11-29T03:43:37.394-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 520000 QueuedCount 50000 2015-11-29T03:43:37.445-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1480000 2015-11-29T03:43:37.449-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:79806600, Disk:85196800, ExtraSnapshotData:0, Fragmentation:6.326763446514423% 2015-11-29T03:43:37.552-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1490000 2015-11-29T03:43:37.622-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 530000 QueuedCount 50000 2015-11-29T03:43:37.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1500000 2015-11-29T03:43:37.709-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:37.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1510000 2015-11-29T03:43:37.842-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 540000 QueuedCount 50000 2015-11-29T03:43:37.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1520000 2015-11-29T03:43:38.011-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:38.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1530000 2015-11-29T03:43:38.061-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 550000 QueuedCount 50000 2015-11-29T03:43:38.14-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1540000 2015-11-29T03:43:38.271-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1550000 2015-11-29T03:43:38.417-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1560000 2015-11-29T03:43:38.562-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1570000 2015-11-29T03:43:38.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1580000 2015-11-29T03:43:38.834-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1590000 2015-11-29T03:43:38.932-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 560000 QueuedCount 50000 2015-11-29T03:43:38.937-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:38.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1600000 2015-11-29T03:43:39.031-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1610000 2015-11-29T03:43:39.084-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 570000 QueuedCount 50000 2015-11-29T03:43:39.144-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1620000 2015-11-29T03:43:39.145-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:39.255-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1630000 2015-11-29T03:43:39.301-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 580000 QueuedCount 50000 2015-11-29T03:43:39.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1640000 2015-11-29T03:43:39.505-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 590000 QueuedCount 45247 2015-11-29T03:43:39.53-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1650000 2015-11-29T03:43:39.711-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1660000 2015-11-29T03:43:39.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1670000 2015-11-29T03:43:40.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1680000 2015-11-29T03:43:40.246-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1690000 2015-11-29T03:43:40.369-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 600000 QueuedCount 35247 2015-11-29T03:43:40.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1700000 2015-11-29T03:43:40.471-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 610000 QueuedCount 25247 2015-11-29T03:43:40.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1710000 2015-11-29T03:43:40.576-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 620000 QueuedCount 15247 2015-11-29T03:43:40.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1720000 2015-11-29T03:43:40.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 630000 QueuedCount 5247 2015-11-29T03:43:40.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1730000 2015-11-29T03:43:40.988-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1740000 2015-11-29T03:43:41.15-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1750000 2015-11-29T03:43:41.313-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1760000 2015-11-29T03:43:41.485-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1770000 2015-11-29T03:43:41.635-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.66µs CommitTime 876.44567ms TotalFlushTime 19.356331989s TotalCommitTime 2.515028976s 2015-11-29T03:43:41.635-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 320388, 320388, 4 committed:true 2015-11-29T03:43:41.636-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 320388, 320388, 4 committed:true) SnapCreateDur 892.537113ms SnapOpenDur 85.034µs 2015-11-29T03:43:41.666-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1780000 2015-11-29T03:43:41.677-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:41.72-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:41.76-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:41.762-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1790000 2015-11-29T03:43:41.774-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 640000 QueuedCount 47052 2015-11-29T03:43:41.843-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1800000 2015-11-29T03:43:41.926-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1810000 2015-11-29T03:43:42.005-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1820000 2015-11-29T03:43:42.037-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 650000 QueuedCount 50000 2015-11-29T03:43:42.088-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1830000 2015-11-29T03:43:42.103-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:42.175-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1840000 2015-11-29T03:43:42.249-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 660000 QueuedCount 50000 2015-11-29T03:43:42.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1850000 2015-11-29T03:43:42.349-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1860000 2015-11-29T03:43:42.408-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:42.469-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1870000 2015-11-29T03:43:42.472-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 670000 QueuedCount 50000 2015-11-29T03:43:42.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1880000 2015-11-29T03:43:42.619-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:42.749-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1890000 2015-11-29T03:43:42.898-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1900000 2015-11-29T03:43:43.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1910000 2015-11-29T03:43:43.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1920000 2015-11-29T03:43:43.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1930000 2015-11-29T03:43:43.439-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 680000 QueuedCount 50000 2015-11-29T03:43:43.442-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1940000 2015-11-29T03:43:43.532-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:43.534-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1950000 2015-11-29T03:43:43.56-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 690000 QueuedCount 50000 2015-11-29T03:43:43.634-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1960000 2015-11-29T03:43:43.743-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1970000 2015-11-29T03:43:43.774-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 700000 QueuedCount 50000 2015-11-29T03:43:43.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:43.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1980000 2015-11-29T03:43:43.975-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1990000 2015-11-29T03:43:43.993-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 710000 QueuedCount 50000 2015-11-29T03:43:44.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2000000 2015-11-29T03:43:44.111-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:44.241-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2010000 2015-11-29T03:43:44.378-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2020000 2015-11-29T03:43:44.509-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2030000 2015-11-29T03:43:44.642-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2040000 2015-11-29T03:43:44.707-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 720000 QueuedCount 50000 2015-11-29T03:43:44.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2050000 2015-11-29T03:43:44.808-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 730000 QueuedCount 50000 2015-11-29T03:43:44.826-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2060000 2015-11-29T03:43:44.828-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:44.909-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2070000 2015-11-29T03:43:44.912-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 740000 QueuedCount 50000 2015-11-29T03:43:45.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2080000 2015-11-29T03:43:45.018-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 750000 QueuedCount 45040 2015-11-29T03:43:45.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2090000 2015-11-29T03:43:45.28-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2100000 2015-11-29T03:43:45.408-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2110000 2015-11-29T03:43:45.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2120000 2015-11-29T03:43:45.564-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 760000 QueuedCount 35040 2015-11-29T03:43:45.649-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 770000 QueuedCount 25040 2015-11-29T03:43:45.663-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2130000 2015-11-29T03:43:45.73-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 780000 QueuedCount 15040 2015-11-29T03:43:45.787-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2140000 2015-11-29T03:43:45.812-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 790000 QueuedCount 5040 2015-11-29T03:43:45.906-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2150000 2015-11-29T03:43:46.017-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2160000 2015-11-29T03:43:46.129-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2170000 2015-11-29T03:43:46.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2180000 2015-11-29T03:43:46.38-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2190000 2015-11-29T03:43:46.52-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2200000 2015-11-29T03:43:46.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2210000 2015-11-29T03:43:46.764-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.224µs CommitTime 885.644404ms TotalFlushTime 23.284718728s TotalCommitTime 3.40067338s 2015-11-29T03:43:46.764-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 401232, 401232, 5 committed:true 2015-11-29T03:43:46.764-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 401232, 401232, 5 committed:true) SnapCreateDur 906.799609ms SnapOpenDur 298.239µs 2015-11-29T03:43:46.796-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2220000 2015-11-29T03:43:46.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:46.833-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:46.868-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:46.879-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2230000 2015-11-29T03:43:46.903-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 800000 QueuedCount 43097 2015-11-29T03:43:46.904-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:46.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2240000 2015-11-29T03:43:47.031-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:47.032-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2250000 2015-11-29T03:43:47.108-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 810000 QueuedCount 50000 2015-11-29T03:43:47.111-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2260000 2015-11-29T03:43:47.182-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2270000 2015-11-29T03:43:47.261-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2280000 2015-11-29T03:43:47.295-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:47.312-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 820000 QueuedCount 49093 2015-11-29T03:43:47.348-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2290000 2015-11-29T03:43:47.431-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2300000 2015-11-29T03:43:47.521-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 830000 QueuedCount 50000 2015-11-29T03:43:47.543-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2310000 2015-11-29T03:43:47.576-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:47.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2320000 2015-11-29T03:43:47.806-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2330000 2015-11-29T03:43:47.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2340000 2015-11-29T03:43:48.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2350000 2015-11-29T03:43:48.238-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2360000 2015-11-29T03:43:48.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2370000 2015-11-29T03:43:48.443-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 840000 QueuedCount 50000 2015-11-29T03:43:48.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2380000 2015-11-29T03:43:48.514-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:48.559-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 850000 QueuedCount 50000 2015-11-29T03:43:48.56-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2390000 2015-11-29T03:43:48.82-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2400000 2015-11-29T03:43:48.824-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:48.837-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 860000 QueuedCount 48684 2015-11-29T03:43:48.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2410000 2015-11-29T03:43:48.955-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 870000 QueuedCount 50000 2015-11-29T03:43:48.971-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:49.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2420000 2015-11-29T03:43:49.134-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2430000 2015-11-29T03:43:49.297-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2440000 2015-11-29T03:43:49.506-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2450000 2015-11-29T03:43:49.682-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2460000 2015-11-29T03:43:49.834-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2470000 2015-11-29T03:43:49.938-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 880000 QueuedCount 50000 2015-11-29T03:43:49.962-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2480000 2015-11-29T03:43:50.063-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2490000 2015-11-29T03:43:50.076-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:50.085-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 890000 QueuedCount 49543 2015-11-29T03:43:50.183-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2500000 2015-11-29T03:43:50.26-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 900000 QueuedCount 50000 2015-11-29T03:43:50.276-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2510000 2015-11-29T03:43:50.37-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2520000 2015-11-29T03:43:50.385-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 910000 QueuedCount 50000 2015-11-29T03:43:50.46-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2530000 2015-11-29T03:43:50.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2540000 2015-11-29T03:43:50.695-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2550000 2015-11-29T03:43:50.811-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2560000 2015-11-29T03:43:50.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2570000 2015-11-29T03:43:50.982-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 920000 QueuedCount 47677 2015-11-29T03:43:51.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2580000 2015-11-29T03:43:51.076-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 930000 QueuedCount 37677 2015-11-29T03:43:51.173-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 940000 QueuedCount 27677 2015-11-29T03:43:51.184-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2590000 2015-11-29T03:43:51.274-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 950000 QueuedCount 17677 2015-11-29T03:43:51.311-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2600000 2015-11-29T03:43:51.441-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2610000 2015-11-29T03:43:51.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2620000 2015-11-29T03:43:51.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2630000 2015-11-29T03:43:51.824-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 960000 QueuedCount 7677 2015-11-29T03:43:51.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2640000 2015-11-29T03:43:51.958-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2650000 2015-11-29T03:43:52.047-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.142µs CommitTime 145.377716ms TotalFlushTime 28.114845042s TotalCommitTime 3.546051096s 2015-11-29T03:43:52.047-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 488023, 488023, 6 committed:true 2015-11-29T03:43:52.047-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 488023, 488023, 6 committed:true) SnapCreateDur 155.627123ms SnapOpenDur 39.837µs 2015-11-29T03:43:52.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2660000 2015-11-29T03:43:52.09-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:52.119-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 970000 QueuedCount 34012 2015-11-29T03:43:52.129-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:52.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2670000 2015-11-29T03:43:52.224-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2680000 2015-11-29T03:43:52.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2690000 2015-11-29T03:43:52.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:52.335-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 980000 QueuedCount 49072 2015-11-29T03:43:52.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2700000 2015-11-29T03:43:52.408-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2710000 2015-11-29T03:43:52.466-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2720000 2015-11-29T03:43:52.527-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 990000 QueuedCount 50000 2015-11-29T03:43:52.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2730000 2015-11-29T03:43:52.551-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:52.628-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2740000 2015-11-29T03:43:52.731-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2750000 2015-11-29T03:43:52.741-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1000000 QueuedCount 50000 2015-11-29T03:43:52.826-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:52.849-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2760000 2015-11-29T03:43:52.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2770000 2015-11-29T03:43:53.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2780000 2015-11-29T03:43:53.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2790000 2015-11-29T03:43:53.517-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2800000 2015-11-29T03:43:53.698-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2810000 2015-11-29T03:43:53.832-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1010000 QueuedCount 50000 2015-11-29T03:43:53.835-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2820000 2015-11-29T03:43:53.908-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:53.936-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2830000 2015-11-29T03:43:53.955-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1020000 QueuedCount 50000 2015-11-29T03:43:54.026-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2840000 2015-11-29T03:43:54.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2850000 2015-11-29T03:43:54.168-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1030000 QueuedCount 50000 2015-11-29T03:43:54.244-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:54.266-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2860000 2015-11-29T03:43:54.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2870000 2015-11-29T03:43:54.389-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1040000 QueuedCount 50000 2015-11-29T03:43:54.39-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:54.498-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2880000 2015-11-29T03:43:54.634-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2890000 2015-11-29T03:43:54.781-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2900000 2015-11-29T03:43:54.932-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2910000 2015-11-29T03:43:55.088-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2920000 2015-11-29T03:43:55.244-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2930000 2015-11-29T03:43:55.393-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2940000 2015-11-29T03:43:55.541-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2950000 2015-11-29T03:43:55.669-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1050000 QueuedCount 49999 2015-11-29T03:43:55.684-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2960000 2015-11-29T03:43:55.779-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2970000 2015-11-29T03:43:55.788-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:55.793-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1060000 QueuedCount 49523 2015-11-29T03:43:55.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2980000 2015-11-29T03:43:55.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1070000 QueuedCount 50000 2015-11-29T03:43:55.966-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2990000 2015-11-29T03:43:56.05-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1080000 QueuedCount 45537 2015-11-29T03:43:56.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3000000 2015-11-29T03:43:56.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3010000 2015-11-29T03:43:56.386-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3020000 2015-11-29T03:43:56.521-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3030000 2015-11-29T03:43:56.649-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1090000 QueuedCount 35537 2015-11-29T03:43:56.667-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3040000 2015-11-29T03:43:56.744-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1100000 QueuedCount 25537 2015-11-29T03:43:56.809-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3050000 2015-11-29T03:43:56.841-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1110000 QueuedCount 15537 2015-11-29T03:43:56.942-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1120000 QueuedCount 5537 2015-11-29T03:43:56.947-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3060000 2015-11-29T03:43:57.083-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3070000 2015-11-29T03:43:57.22-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3080000 2015-11-29T03:43:57.351-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3090000 2015-11-29T03:43:57.486-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3100000 2015-11-29T03:43:57.493-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.176µs CommitTime 475.082501ms TotalFlushTime 32.774512293s TotalCommitTime 4.021133597s 2015-11-29T03:43:57.493-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 568610, 568610, 7 committed:true 2015-11-29T03:43:57.493-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 568610, 568610, 7 committed:true) SnapCreateDur 487.201372ms SnapOpenDur 47.584µs 2015-11-29T03:43:57.529-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:57.561-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:57.563-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1130000 QueuedCount 23500 2015-11-29T03:43:57.586-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3110000 2015-11-29T03:43:57.594-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:57.627-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:57.659-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3120000 2015-11-29T03:43:57.701-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1140000 QueuedCount 50000 2015-11-29T03:43:57.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3130000 2015-11-29T03:43:57.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3140000 2015-11-29T03:43:57.78-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:57.841-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3150000 2015-11-29T03:43:57.892-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1150000 QueuedCount 50000 2015-11-29T03:43:57.902-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3160000 2015-11-29T03:43:57.965-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3170000 2015-11-29T03:43:58.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3180000 2015-11-29T03:43:58.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1160000 QueuedCount 50000 2015-11-29T03:43:58.063-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:58.101-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3190000 2015-11-29T03:43:58.217-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3200000 2015-11-29T03:43:58.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3210000 2015-11-29T03:43:58.497-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3220000 2015-11-29T03:43:58.646-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3230000 2015-11-29T03:43:58.734-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1170000 QueuedCount 50000 2015-11-29T03:43:58.756-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3240000 2015-11-29T03:43:58.832-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:58.849-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3250000 2015-11-29T03:43:58.861-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1180000 QueuedCount 50000 2015-11-29T03:43:58.945-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3260000 2015-11-29T03:43:59.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3270000 2015-11-29T03:43:59.07-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1190000 QueuedCount 50000 2015-11-29T03:43:59.13-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:59.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3280000 2015-11-29T03:43:59.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3290000 2015-11-29T03:43:59.292-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1200000 QueuedCount 50000 2015-11-29T03:43:59.4-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3300000 2015-11-29T03:43:59.52-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:43:59.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3310000 2015-11-29T03:43:59.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3320000 2015-11-29T03:43:59.897-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3330000 2015-11-29T03:44:00.082-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3340000 2015-11-29T03:44:00.254-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3350000 2015-11-29T03:44:00.399-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3360000 2015-11-29T03:44:00.442-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1210000 QueuedCount 50000 2015-11-29T03:44:00.499-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3370000 2015-11-29T03:44:00.6-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3380000 2015-11-29T03:44:00.632-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1220000 QueuedCount 50000 2015-11-29T03:44:00.655-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:00.711-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3390000 2015-11-29T03:44:00.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3400000 2015-11-29T03:44:00.845-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1230000 QueuedCount 50000 2015-11-29T03:44:00.938-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3410000 2015-11-29T03:44:00.987-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:01.056-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3420000 2015-11-29T03:44:01.072-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1240000 QueuedCount 50000 2015-11-29T03:44:01.18-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3430000 2015-11-29T03:44:01.316-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3440000 2015-11-29T03:44:01.507-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3450000 2015-11-29T03:44:01.696-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3460000 2015-11-29T03:44:01.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3470000 2015-11-29T03:44:02.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3480000 2015-11-29T03:44:02.037-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1250000 QueuedCount 50000 2015-11-29T03:44:02.153-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3490000 2015-11-29T03:44:02.178-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1260000 QueuedCount 40792 2015-11-29T03:44:02.286-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1270000 QueuedCount 30792 2015-11-29T03:44:02.294-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3500000 2015-11-29T03:44:02.387-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1280000 QueuedCount 20792 2015-11-29T03:44:02.436-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3510000 2015-11-29T03:44:02.573-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3520000 2015-11-29T03:44:02.707-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3530000 2015-11-29T03:44:02.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3540000 2015-11-29T03:44:02.997-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3550000 2015-11-29T03:44:03.022-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1290000 QueuedCount 10792 2015-11-29T03:44:03.118-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1300000 QueuedCount 792 2015-11-29T03:44:03.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3560000 2015-11-29T03:44:03.26-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3570000 2015-11-29T03:44:03.386-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3580000 2015-11-29T03:44:03.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3590000 2015-11-29T03:44:03.571-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.02µs CommitTime 412.894912ms TotalFlushTime 38.076999373s TotalCommitTime 4.434028509s 2015-11-29T03:44:03.571-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 656611, 656611, 8 committed:true 2015-11-29T03:44:03.571-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 656611, 656611, 8 committed:true) SnapCreateDur 439.799656ms SnapOpenDur 73.823µs 2015-11-29T03:44:03.604-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:03.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3600000 2015-11-29T03:44:03.639-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:03.684-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:03.696-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3610000 2015-11-29T03:44:03.761-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3620000 2015-11-29T03:44:03.774-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1310000 QueuedCount 50000 2015-11-29T03:44:03.828-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3630000 2015-11-29T03:44:03.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3640000 2015-11-29T03:44:03.983-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3650000 2015-11-29T03:44:03.986-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1320000 QueuedCount 50000 2015-11-29T03:44:04.069-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3660000 2015-11-29T03:44:04.164-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3670000 2015-11-29T03:44:04.202-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1330000 QueuedCount 50000 2015-11-29T03:44:04.227-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:04.262-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3680000 2015-11-29T03:44:04.382-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3690000 2015-11-29T03:44:04.433-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1340000 QueuedCount 50000 2015-11-29T03:44:04.51-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3700000 2015-11-29T03:44:04.674-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3710000 2015-11-29T03:44:04.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3720000 2015-11-29T03:44:05.005-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3730000 2015-11-29T03:44:05.176-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3740000 2015-11-29T03:44:05.313-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3750000 2015-11-29T03:44:05.404-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1350000 QueuedCount 50000 2015-11-29T03:44:05.408-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3760000 2015-11-29T03:44:05.484-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:05.502-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3770000 2015-11-29T03:44:05.541-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1360000 QueuedCount 50000 2015-11-29T03:44:05.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3780000 2015-11-29T03:44:05.673-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1370000 QueuedCount 49999 2015-11-29T03:44:05.683-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3790000 2015-11-29T03:44:05.725-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:05.777-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3800000 2015-11-29T03:44:05.811-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1380000 QueuedCount 50000 2015-11-29T03:44:05.89-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3810000 2015-11-29T03:44:06.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3820000 2015-11-29T03:44:06.162-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3830000 2015-11-29T03:44:06.293-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3840000 2015-11-29T03:44:06.375-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:06.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3850000 2015-11-29T03:44:06.415-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1390000 QueuedCount 50000 2015-11-29T03:44:06.475-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3860000 2015-11-29T03:44:06.516-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1400000 QueuedCount 47407 2015-11-29T03:44:06.595-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3870000 2015-11-29T03:44:06.614-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1410000 QueuedCount 37407 2015-11-29T03:44:06.714-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1420000 QueuedCount 27407 2015-11-29T03:44:06.72-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3880000 2015-11-29T03:44:06.835-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3890000 2015-11-29T03:44:06.954-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3900000 2015-11-29T03:44:07.079-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3910000 2015-11-29T03:44:07.206-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3920000 2015-11-29T03:44:07.212-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1430000 QueuedCount 17407 2015-11-29T03:44:07.292-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1440000 QueuedCount 7407 2015-11-29T03:44:07.322-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3930000 2015-11-29T03:44:07.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3940000 2015-11-29T03:44:07.449-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:224768260, Disk:309047296, ExtraSnapshotData:0, Fragmentation:27.27059485419345% 2015-11-29T03:44:07.449-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5736666126,"bucket-1:by_email_0:avg_ts_items_count":168189,"bucket-1:by_email_0:build_progress":6,"bucket-1:by_email_0:data_size":214065376,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":309047296,"bucket-1:by_email_0:flush_queue_size":0,"bucket-1:by_email_0:frag_percent":30,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":67084611,"bucket-1:by_email_0:items_count":656611,"bucket-1:by_email_0:num_commits":8,"bucket-1:by_email_0:num_compactions":0,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":1381129,"bucket-1:by_email_0:num_docs_pending":16256544,"bucket-1:by_email_0:num_docs_queued":2362327,"bucket-1:by_email_0:num_flush_queued":1447407,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":8,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":6077749245,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"8 4434028509 2867974177175611487","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"1447407 12482904969 1201561722977211","bucket-1:by_email_0:timings/storage_handle_open":"8 725903 113442164759","bucket-1:by_email_0:timings/storage_info":"36 302831 3680320187","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"8 3409975 1659259291587","bucket-1:by_email_0:timings/storage_meta_set":"9 4921667 3159734351339","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"1460190 27099808391 -4625336320425487097","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":2494021,"bucket-1:num_mutations_queued":3941428,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":152,"memory_quota":104857600000,"memory_used":223498240,"needs_restart":false,"num_connections":0,"timings/stats_response":"1294 126242358 629863909884968"} 2015-11-29T03:44:07.557-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3950000 2015-11-29T03:44:07.701-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3960000 2015-11-29T03:44:07.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3970000 2015-11-29T03:44:08.004-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3980000 2015-11-29T03:44:08.08-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.113µs CommitTime 693.046905ms TotalFlushTime 41.626091859s TotalCommitTime 5.127075414s 2015-11-29T03:44:08.081-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 730095, 730095, 9 committed:true 2015-11-29T03:44:08.081-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 730095, 730095, 9 committed:true) SnapCreateDur 719.610783ms SnapOpenDur 109.66µs 2015-11-29T03:44:08.117-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:08.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3990000 2015-11-29T03:44:08.159-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:08.178-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1450000 QueuedCount 25014 2015-11-29T03:44:08.205-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:08.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4000000 2015-11-29T03:44:08.32-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4010000 2015-11-29T03:44:08.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4020000 2015-11-29T03:44:08.419-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1460000 QueuedCount 50000 2015-11-29T03:44:08.439-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:08.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4030000 2015-11-29T03:44:08.541-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4040000 2015-11-29T03:44:08.619-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4050000 2015-11-29T03:44:08.639-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1470000 QueuedCount 50000 2015-11-29T03:44:08.708-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4060000 2015-11-29T03:44:08.8-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:08.815-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4070000 2015-11-29T03:44:08.853-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1480000 QueuedCount 50000 2015-11-29T03:44:08.936-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4080000 2015-11-29T03:44:09.072-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4090000 2015-11-29T03:44:09.235-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4100000 2015-11-29T03:44:09.409-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4110000 2015-11-29T03:44:09.584-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4120000 2015-11-29T03:44:09.753-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4130000 2015-11-29T03:44:09.895-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4140000 2015-11-29T03:44:09.912-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1490000 QueuedCount 50000 2015-11-29T03:44:09.97-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:09.998-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4150000 2015-11-29T03:44:10.056-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1500000 QueuedCount 49999 2015-11-29T03:44:10.092-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4160000 2015-11-29T03:44:10.192-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:10.193-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4170000 2015-11-29T03:44:10.234-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1510000 QueuedCount 50000 2015-11-29T03:44:10.308-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4180000 2015-11-29T03:44:10.412-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4190000 2015-11-29T03:44:10.459-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1520000 QueuedCount 50000 2015-11-29T03:44:10.5-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:10.518-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4200000 2015-11-29T03:44:10.632-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4210000 2015-11-29T03:44:10.796-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4220000 2015-11-29T03:44:10.947-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4230000 2015-11-29T03:44:11.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4240000 2015-11-29T03:44:11.235-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4250000 2015-11-29T03:44:11.242-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1530000 QueuedCount 50000 2015-11-29T03:44:11.309-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:11.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4260000 2015-11-29T03:44:11.345-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1540000 QueuedCount 50000 2015-11-29T03:44:11.403-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4270000 2015-11-29T03:44:11.45-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1550000 QueuedCount 50000 2015-11-29T03:44:11.495-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4280000 2015-11-29T03:44:11.554-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:11.606-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4290000 2015-11-29T03:44:11.642-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1560000 QueuedCount 50000 2015-11-29T03:44:11.712-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4300000 2015-11-29T03:44:11.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4310000 2015-11-29T03:44:11.97-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4320000 2015-11-29T03:44:12.136-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4330000 2015-11-29T03:44:12.3-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4340000 2015-11-29T03:44:12.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4350000 2015-11-29T03:44:12.568-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1570000 QueuedCount 50000 2015-11-29T03:44:12.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4360000 2015-11-29T03:44:12.682-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1580000 QueuedCount 43753 2015-11-29T03:44:12.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4370000 2015-11-29T03:44:12.78-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1590000 QueuedCount 33753 2015-11-29T03:44:12.854-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4380000 2015-11-29T03:44:12.881-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1600000 QueuedCount 23753 2015-11-29T03:44:12.994-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4390000 2015-11-29T03:44:13.135-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4400000 2015-11-29T03:44:13.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4410000 2015-11-29T03:44:13.422-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4420000 2015-11-29T03:44:13.486-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1610000 QueuedCount 13753 2015-11-29T03:44:13.57-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4430000 2015-11-29T03:44:13.581-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1620000 QueuedCount 3753 2015-11-29T03:44:13.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4440000 2015-11-29T03:44:13.843-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4450000 2015-11-29T03:44:13.864-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.458µs CommitTime 227.166737ms TotalFlushTime 46.835953765s TotalCommitTime 5.354242151s 2015-11-29T03:44:13.864-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 819376, 819376, 10 committed:true 2015-11-29T03:44:13.864-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 819376, 819376, 10 committed:true) SnapCreateDur 240.002443ms SnapOpenDur 40.651µs 2015-11-29T03:44:13.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:13.93-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:13.937-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4460000 2015-11-29T03:44:13.959-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:13.989-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:14.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4470000 2015-11-29T03:44:14.03-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1630000 QueuedCount 50000 2015-11-29T03:44:14.072-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4480000 2015-11-29T03:44:14.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4490000 2015-11-29T03:44:14.175-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:14.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4500000 2015-11-29T03:44:14.263-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1640000 QueuedCount 50000 2015-11-29T03:44:14.309-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4510000 2015-11-29T03:44:14.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4520000 2015-11-29T03:44:14.477-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:14.482-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1650000 QueuedCount 49751 2015-11-29T03:44:14.498-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4530000 2015-11-29T03:44:14.615-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4540000 2015-11-29T03:44:14.698-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1660000 QueuedCount 50000 2015-11-29T03:44:14.717-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4550000 2015-11-29T03:44:14.747-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:14.845-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4560000 2015-11-29T03:44:14.991-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4570000 2015-11-29T03:44:15.138-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4580000 2015-11-29T03:44:15.281-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4590000 2015-11-29T03:44:15.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4600000 2015-11-29T03:44:15.405-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1670000 QueuedCount 49999 2015-11-29T03:44:15.49-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:15.499-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4610000 2015-11-29T03:44:15.514-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1680000 QueuedCount 50000 2015-11-29T03:44:15.586-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4620000 2015-11-29T03:44:15.699-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4630000 2015-11-29T03:44:15.701-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1690000 QueuedCount 50000 2015-11-29T03:44:15.702-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:15.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4640000 2015-11-29T03:44:15.926-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1700000 QueuedCount 50000 2015-11-29T03:44:15.946-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4650000 2015-11-29T03:44:15.981-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:16.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4660000 2015-11-29T03:44:16.207-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4670000 2015-11-29T03:44:16.565-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4680000 2015-11-29T03:44:16.691-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4690000 2015-11-29T03:44:16.784-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4700000 2015-11-29T03:44:16.787-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1710000 QueuedCount 49998 2015-11-29T03:44:16.834-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:16.871-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4710000 2015-11-29T03:44:16.895-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1720000 QueuedCount 50000 2015-11-29T03:44:16.959-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4720000 2015-11-29T03:44:17.003-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1730000 QueuedCount 45897 2015-11-29T03:44:17.095-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4730000 2015-11-29T03:44:17.109-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1740000 QueuedCount 35897 2015-11-29T03:44:17.228-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4740000 2015-11-29T03:44:17.359-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4750000 2015-11-29T03:44:17.489-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4760000 2015-11-29T03:44:17.619-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4770000 2015-11-29T03:44:17.729-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1750000 QueuedCount 25897 2015-11-29T03:44:17.758-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4780000 2015-11-29T03:44:17.813-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1760000 QueuedCount 15897 2015-11-29T03:44:17.9-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1770000 QueuedCount 5897 2015-11-29T03:44:17.91-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4790000 2015-11-29T03:44:18.036-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4800000 2015-11-29T03:44:18.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4810000 2015-11-29T03:44:18.281-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4820000 2015-11-29T03:44:18.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4830000 2015-11-29T03:44:18.53-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4840000 2015-11-29T03:44:18.654-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4850000 2015-11-29T03:44:18.779-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4860000 2015-11-29T03:44:18.801-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.69µs CommitTime 809.978147ms TotalFlushTime 50.67961033s TotalCommitTime 6.164220298s 2015-11-29T03:44:18.801-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 896178, 896178, 11 committed:true 2015-11-29T03:44:18.801-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 896178, 896178, 11 committed:true) SnapCreateDur 840.238646ms SnapOpenDur 74.435µs 2015-11-29T03:44:18.844-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:18.892-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4870000 2015-11-29T03:44:18.898-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:18.928-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1780000 QueuedCount 45099 2015-11-29T03:44:18.971-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4880000 2015-11-29T03:44:19.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4890000 2015-11-29T03:44:19.126-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4900000 2015-11-29T03:44:19.149-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1790000 QueuedCount 50000 2015-11-29T03:44:19.191-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:19.211-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4910000 2015-11-29T03:44:19.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4920000 2015-11-29T03:44:19.371-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1800000 QueuedCount 49999 2015-11-29T03:44:19.375-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4930000 2015-11-29T03:44:19.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4940000 2015-11-29T03:44:19.571-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4950000 2015-11-29T03:44:19.599-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1810000 QueuedCount 50000 2015-11-29T03:44:19.681-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:19.69-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4960000 2015-11-29T03:44:19.847-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4970000 2015-11-29T03:44:20.031-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4980000 2015-11-29T03:44:20.206-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4990000 2015-11-29T03:44:20.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5000000 2015-11-29T03:44:20.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5010000 2015-11-29T03:44:20.673-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5020000 2015-11-29T03:44:20.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5030000 2015-11-29T03:44:20.806-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1820000 QueuedCount 50000 2015-11-29T03:44:20.888-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5040000 2015-11-29T03:44:20.92-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:20.932-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1830000 QueuedCount 48996 2015-11-29T03:44:20.983-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5050000 2015-11-29T03:44:21.079-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1840000 QueuedCount 50000 2015-11-29T03:44:21.082-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5060000 2015-11-29T03:44:21.144-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:21.198-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5070000 2015-11-29T03:44:21.314-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1850000 QueuedCount 50000 2015-11-29T03:44:21.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5080000 2015-11-29T03:44:21.434-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5090000 2015-11-29T03:44:21.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5100000 2015-11-29T03:44:21.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5110000 2015-11-29T03:44:21.85-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5120000 2015-11-29T03:44:21.993-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5130000 2015-11-29T03:44:22.124-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5140000 2015-11-29T03:44:22.158-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:22.199-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1860000 QueuedCount 50000 2015-11-29T03:44:22.222-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5150000 2015-11-29T03:44:22.333-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5160000 2015-11-29T03:44:22.393-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1870000 QueuedCount 49486 2015-11-29T03:44:22.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5170000 2015-11-29T03:44:22.596-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1880000 QueuedCount 39486 2015-11-29T03:44:22.645-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5180000 2015-11-29T03:44:22.788-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1890000 QueuedCount 29486 2015-11-29T03:44:22.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5190000 2015-11-29T03:44:23.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5200000 2015-11-29T03:44:23.198-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5210000 2015-11-29T03:44:23.349-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5220000 2015-11-29T03:44:23.512-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5230000 2015-11-29T03:44:23.609-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1900000 QueuedCount 19486 2015-11-29T03:44:23.66-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5240000 2015-11-29T03:44:23.711-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1910000 QueuedCount 9486 2015-11-29T03:44:23.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5250000 2015-11-29T03:44:23.955-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5260000 2015-11-29T03:44:24.131-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5270000 2015-11-29T03:44:24.299-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5280000 2015-11-29T03:44:24.475-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5290000 2015-11-29T03:44:24.59-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 9.16µs CommitTime 751.531465ms TotalFlushTime 55.377877775s TotalCommitTime 6.915751763s 2015-11-29T03:44:24.59-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 969496, 969496, 12 committed:true 2015-11-29T03:44:24.59-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 969496, 969496, 12 committed:true) SnapCreateDur 776.932987ms SnapOpenDur 98.89µs 2015-11-29T03:44:24.63-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:24.634-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1920000 QueuedCount 14394 2015-11-29T03:44:24.637-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5300000 2015-11-29T03:44:24.678-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:24.734-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5310000 2015-11-29T03:44:24.765-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:24.813-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5320000 2015-11-29T03:44:24.884-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1930000 QueuedCount 50000 2015-11-29T03:44:24.89-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5330000 2015-11-29T03:44:24.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5340000 2015-11-29T03:44:25.054-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5350000 2015-11-29T03:44:25.124-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1940000 QueuedCount 50000 2015-11-29T03:44:25.142-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5360000 2015-11-29T03:44:25.149-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:25.237-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5370000 2015-11-29T03:44:25.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5380000 2015-11-29T03:44:25.344-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1950000 QueuedCount 49999 2015-11-29T03:44:25.465-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5390000 2015-11-29T03:44:25.503-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:25.602-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5400000 2015-11-29T03:44:25.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5410000 2015-11-29T03:44:25.959-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5420000 2015-11-29T03:44:26.129-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5430000 2015-11-29T03:44:26.271-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5440000 2015-11-29T03:44:26.41-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5450000 2015-11-29T03:44:26.522-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1960000 QueuedCount 50000 2015-11-29T03:44:26.538-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5460000 2015-11-29T03:44:26.642-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5470000 2015-11-29T03:44:26.683-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1970000 QueuedCount 50000 2015-11-29T03:44:26.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:26.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5480000 2015-11-29T03:44:26.796-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1980000 QueuedCount 50000 2015-11-29T03:44:26.822-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5490000 2015-11-29T03:44:26.865-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:26.912-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5500000 2015-11-29T03:44:26.914-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 1990000 QueuedCount 50000 2015-11-29T03:44:27.012-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5510000 2015-11-29T03:44:27.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5520000 2015-11-29T03:44:27.12-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2000000 QueuedCount 50000 2015-11-29T03:44:27.278-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5530000 2015-11-29T03:44:27.45-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5540000 2015-11-29T03:44:27.621-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5550000 2015-11-29T03:44:27.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5560000 2015-11-29T03:44:27.912-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5570000 2015-11-29T03:44:28.033-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5580000 2015-11-29T03:44:28.033-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:28.088-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2010000 QueuedCount 50000 2015-11-29T03:44:28.126-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5590000 2015-11-29T03:44:28.209-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2020000 QueuedCount 49999 2015-11-29T03:44:28.219-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5600000 2015-11-29T03:44:28.305-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5610000 2015-11-29T03:44:28.327-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2030000 QueuedCount 48273 2015-11-29T03:44:28.428-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5620000 2015-11-29T03:44:28.452-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2040000 QueuedCount 38273 2015-11-29T03:44:28.554-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5630000 2015-11-29T03:44:28.678-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5640000 2015-11-29T03:44:28.798-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5650000 2015-11-29T03:44:28.917-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5660000 2015-11-29T03:44:29.035-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2050000 QueuedCount 28273 2015-11-29T03:44:29.042-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5670000 2015-11-29T03:44:29.126-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2060000 QueuedCount 18273 2015-11-29T03:44:29.152-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5680000 2015-11-29T03:44:29.223-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2070000 QueuedCount 8273 2015-11-29T03:44:29.275-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5690000 2015-11-29T03:44:29.398-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5700000 2015-11-29T03:44:29.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5710000 2015-11-29T03:44:29.64-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5720000 2015-11-29T03:44:29.759-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5730000 2015-11-29T03:44:29.817-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.809µs CommitTime 501.32993ms TotalFlushTime 59.812410267s TotalCommitTime 7.417081693s 2015-11-29T03:44:29.817-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1049076, 1049076, 13 committed:true 2015-11-29T03:44:29.817-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1049076, 1049076, 13 committed:true) SnapCreateDur 511.991095ms SnapOpenDur 78.05µs 2015-11-29T03:44:29.852-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:29.872-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5740000 2015-11-29T03:44:29.876-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2080000 QueuedCount 16726 2015-11-29T03:44:29.888-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:29.923-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:29.953-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5750000 2015-11-29T03:44:30.014-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5760000 2015-11-29T03:44:30.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5770000 2015-11-29T03:44:30.084-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2090000 QueuedCount 50000 2015-11-29T03:44:30.088-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:30.147-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5780000 2015-11-29T03:44:30.213-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5790000 2015-11-29T03:44:30.282-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5800000 2015-11-29T03:44:30.291-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2100000 QueuedCount 50000 2015-11-29T03:44:30.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5810000 2015-11-29T03:44:30.468-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:30.492-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5820000 2015-11-29T03:44:30.524-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2110000 QueuedCount 50000 2015-11-29T03:44:30.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5830000 2015-11-29T03:44:30.711-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5840000 2015-11-29T03:44:30.864-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5850000 2015-11-29T03:44:31.036-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5860000 2015-11-29T03:44:31.207-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5870000 2015-11-29T03:44:31.354-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5880000 2015-11-29T03:44:31.5-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5890000 2015-11-29T03:44:31.641-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5900000 2015-11-29T03:44:31.712-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2120000 QueuedCount 50000 2015-11-29T03:44:31.755-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5910000 2015-11-29T03:44:31.773-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:31.829-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2130000 QueuedCount 50000 2015-11-29T03:44:31.844-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5920000 2015-11-29T03:44:31.937-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5930000 2015-11-29T03:44:31.951-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2140000 QueuedCount 50000 2015-11-29T03:44:31.96-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:32.032-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5940000 2015-11-29T03:44:32.082-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2150000 QueuedCount 50000 2015-11-29T03:44:32.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5950000 2015-11-29T03:44:32.153-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:32.239-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5960000 2015-11-29T03:44:32.412-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5970000 2015-11-29T03:44:32.595-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5980000 2015-11-29T03:44:32.776-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5990000 2015-11-29T03:44:32.947-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6000000 2015-11-29T03:44:33.126-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6010000 2015-11-29T03:44:33.224-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2160000 QueuedCount 50000 2015-11-29T03:44:33.263-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6020000 2015-11-29T03:44:33.342-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:33.348-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2170000 QueuedCount 49471 2015-11-29T03:44:33.363-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6030000 2015-11-29T03:44:33.47-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6040000 2015-11-29T03:44:33.555-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2180000 QueuedCount 50000 2015-11-29T03:44:33.592-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6050000 2015-11-29T03:44:33.721-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6060000 2015-11-29T03:44:33.823-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2190000 QueuedCount 50000 2015-11-29T03:44:33.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6070000 2015-11-29T03:44:33.971-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6080000 2015-11-29T03:44:34.148-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6090000 2015-11-29T03:44:34.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6100000 2015-11-29T03:44:34.42-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6110000 2015-11-29T03:44:34.551-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6120000 2015-11-29T03:44:34.685-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6130000 2015-11-29T03:44:34.78-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2200000 QueuedCount 43874 2015-11-29T03:44:34.81-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6140000 2015-11-29T03:44:34.88-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2210000 QueuedCount 33874 2015-11-29T03:44:34.927-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6150000 2015-11-29T03:44:34.989-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2220000 QueuedCount 23874 2015-11-29T03:44:35.059-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6160000 2015-11-29T03:44:35.117-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2230000 QueuedCount 13874 2015-11-29T03:44:35.196-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6170000 2015-11-29T03:44:35.333-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6180000 2015-11-29T03:44:35.458-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6190000 2015-11-29T03:44:35.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6200000 2015-11-29T03:44:35.729-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6210000 2015-11-29T03:44:35.771-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2240000 QueuedCount 3874 2015-11-29T03:44:35.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6220000 2015-11-29T03:44:35.981-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6230000 2015-11-29T03:44:36.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6240000 2015-11-29T03:44:36.129-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.546µs CommitTime 294.669161ms TotalFlushTime 1m5.489225599s TotalCommitTime 7.711750854s 2015-11-29T03:44:36.129-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1133426, 1133426, 14 committed:true 2015-11-29T03:44:36.129-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1133426, 1133426, 14 committed:true) SnapCreateDur 320.148339ms SnapOpenDur 63.87µs 2015-11-29T03:44:36.181-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:36.214-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6250000 2015-11-29T03:44:36.234-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:36.295-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6260000 2015-11-29T03:44:36.305-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2250000 QueuedCount 50000 2015-11-29T03:44:36.366-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6270000 2015-11-29T03:44:36.441-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6280000 2015-11-29T03:44:36.518-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6290000 2015-11-29T03:44:36.526-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2260000 QueuedCount 50000 2015-11-29T03:44:36.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6300000 2015-11-29T03:44:36.608-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:36.697-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6310000 2015-11-29T03:44:36.807-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2270000 QueuedCount 50000 2015-11-29T03:44:36.814-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6320000 2015-11-29T03:44:36.953-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6330000 2015-11-29T03:44:37.049-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:37.075-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2280000 QueuedCount 50000 2015-11-29T03:44:37.082-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6340000 2015-11-29T03:44:37.216-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6350000 2015-11-29T03:44:37.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6360000 2015-11-29T03:44:37.449-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:352175509, Disk:661516288, ExtraSnapshotData:0, Fragmentation:46.76238281830484% 2015-11-29T03:44:37.449-08:00 [Info] CompactionDaemon: Compacting index instance:16481390354720717219 2015-11-29T03:44:37.471-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 819376. Slice Id 0, IndexInstId 16481390354720717219, IndexDefnId 16481390354720717219 2015-11-29T03:44:37.573-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6370000 2015-11-29T03:44:37.751-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6380000 2015-11-29T03:44:37.908-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6390000 2015-11-29T03:44:38.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6400000 2015-11-29T03:44:38.242-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6410000 2015-11-29T03:44:38.277-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2290000 QueuedCount 50000 2015-11-29T03:44:38.315-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:38.348-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6420000 2015-11-29T03:44:38.468-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6430000 2015-11-29T03:44:38.49-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2300000 QueuedCount 50000 2015-11-29T03:44:38.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6440000 2015-11-29T03:44:38.592-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:38.648-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2310000 QueuedCount 50000 2015-11-29T03:44:38.684-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6450000 2015-11-29T03:44:38.795-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6460000 2015-11-29T03:44:38.851-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2320000 QueuedCount 50000 2015-11-29T03:44:38.923-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6470000 2015-11-29T03:44:39.101-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6480000 2015-11-29T03:44:39.264-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6490000 2015-11-29T03:44:39.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6500000 2015-11-29T03:44:39.569-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6510000 2015-11-29T03:44:39.726-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6520000 2015-11-29T03:44:39.863-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6530000 2015-11-29T03:44:40.007-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6540000 2015-11-29T03:44:40.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2330000 QueuedCount 41427 2015-11-29T03:44:40.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6550000 2015-11-29T03:44:40.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2340000 QueuedCount 31427 2015-11-29T03:44:40.286-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2350000 QueuedCount 21427 2015-11-29T03:44:40.295-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6560000 2015-11-29T03:44:40.395-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2360000 QueuedCount 11427 2015-11-29T03:44:40.427-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6570000 2015-11-29T03:44:40.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6580000 2015-11-29T03:44:40.707-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6590000 2015-11-29T03:44:40.836-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6600000 2015-11-29T03:44:40.971-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6610000 2015-11-29T03:44:41.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2370000 QueuedCount 1427 2015-11-29T03:44:41.108-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6620000 2015-11-29T03:44:41.242-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6630000 2015-11-29T03:44:41.372-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6640000 2015-11-29T03:44:41.387-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.474µs CommitTime 266.626393ms TotalFlushTime 1m10.166624157s TotalCommitTime 7.978377247s 2015-11-29T03:44:41.387-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1197371, 1197371, 15 committed:true 2015-11-29T03:44:41.387-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1197371, 1197371, 15 committed:true) SnapCreateDur 292.435353ms SnapOpenDur 56.834µs 2015-11-29T03:44:41.425-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:41.453-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:41.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6650000 2015-11-29T03:44:41.495-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:41.542-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6660000 2015-11-29T03:44:41.594-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2380000 QueuedCount 50000 2015-11-29T03:44:41.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6670000 2015-11-29T03:44:41.662-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:41.663-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6680000 2015-11-29T03:44:41.734-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6690000 2015-11-29T03:44:41.783-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2390000 QueuedCount 50000 2015-11-29T03:44:41.798-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6700000 2015-11-29T03:44:41.866-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6710000 2015-11-29T03:44:41.887-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:41.944-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6720000 2015-11-29T03:44:41.964-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2400000 QueuedCount 50000 2015-11-29T03:44:42.043-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6730000 2015-11-29T03:44:42.057-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:42.148-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6740000 2015-11-29T03:44:42.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2410000 QueuedCount 50000 2015-11-29T03:44:42.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6750000 2015-11-29T03:44:42.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6760000 2015-11-29T03:44:42.517-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6770000 2015-11-29T03:44:42.652-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6780000 2015-11-29T03:44:42.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6790000 2015-11-29T03:44:42.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6800000 2015-11-29T03:44:43.026-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6810000 2015-11-29T03:44:43.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:43.1-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2420000 QueuedCount 50000 2015-11-29T03:44:43.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6820000 2015-11-29T03:44:43.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6830000 2015-11-29T03:44:43.225-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2430000 QueuedCount 50000 2015-11-29T03:44:43.282-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:43.309-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6840000 2015-11-29T03:44:43.41-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6850000 2015-11-29T03:44:43.44-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2440000 QueuedCount 50000 2015-11-29T03:44:43.514-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6860000 2015-11-29T03:44:43.62-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6870000 2015-11-29T03:44:43.662-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2450000 QueuedCount 50000 2015-11-29T03:44:43.676-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:43.726-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6880000 2015-11-29T03:44:43.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6890000 2015-11-29T03:44:43.985-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6900000 2015-11-29T03:44:44.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6910000 2015-11-29T03:44:44.27-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6920000 2015-11-29T03:44:44.407-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6930000 2015-11-29T03:44:44.529-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6940000 2015-11-29T03:44:44.59-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2460000 QueuedCount 50000 2015-11-29T03:44:44.619-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6950000 2015-11-29T03:44:44.708-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6960000 2015-11-29T03:44:44.709-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2470000 QueuedCount 50000 2015-11-29T03:44:44.815-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2480000 QueuedCount 42083 2015-11-29T03:44:44.827-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6970000 2015-11-29T03:44:44.925-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2490000 QueuedCount 32083 2015-11-29T03:44:44.963-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6980000 2015-11-29T03:44:45.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6990000 2015-11-29T03:44:45.234-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7000000 2015-11-29T03:44:45.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7010000 2015-11-29T03:44:45.511-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7020000 2015-11-29T03:44:45.552-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2500000 QueuedCount 22083 2015-11-29T03:44:45.65-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7030000 2015-11-29T03:44:45.65-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2510000 QueuedCount 12083 2015-11-29T03:44:45.742-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2520000 QueuedCount 2083 2015-11-29T03:44:45.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7040000 2015-11-29T03:44:45.902-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7050000 2015-11-29T03:44:46.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7060000 2015-11-29T03:44:46.16-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7070000 2015-11-29T03:44:46.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7080000 2015-11-29T03:44:46.421-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7090000 2015-11-29T03:44:46.552-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7100000 2015-11-29T03:44:46.647-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.203µs CommitTime 857.247653ms TotalFlushTime 1m14.292833644s TotalCommitTime 8.8356249s 2015-11-29T03:44:46.647-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1274036, 1274036, 16 committed:true 2015-11-29T03:44:46.647-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1274036, 1274036, 16 committed:true) SnapCreateDur 883.671511ms SnapOpenDur 63.097µs 2015-11-29T03:44:46.684-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7110000 2015-11-29T03:44:46.686-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:46.723-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:46.761-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7120000 2015-11-29T03:44:46.838-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7130000 2015-11-29T03:44:46.919-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7140000 2015-11-29T03:44:47.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7150000 2015-11-29T03:44:47.115-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7160000 2015-11-29T03:44:47.225-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:47.244-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7170000 2015-11-29T03:44:47.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7180000 2015-11-29T03:44:47.415-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2530000 QueuedCount 50000 2015-11-29T03:44:47.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7190000 2015-11-29T03:44:47.576-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7200000 2015-11-29T03:44:47.686-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2540000 QueuedCount 50000 2015-11-29T03:44:47.691-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7210000 2015-11-29T03:44:47.696-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:47.792-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7220000 2015-11-29T03:44:47.889-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2550000 QueuedCount 50000 2015-11-29T03:44:47.891-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7230000 2015-11-29T03:44:47.988-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7240000 2015-11-29T03:44:48.011-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:48.089-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7250000 2015-11-29T03:44:48.096-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2560000 QueuedCount 50000 2015-11-29T03:44:48.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7260000 2015-11-29T03:44:48.348-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7270000 2015-11-29T03:44:48.485-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7280000 2015-11-29T03:44:48.612-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7290000 2015-11-29T03:44:48.737-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7300000 2015-11-29T03:44:48.859-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7310000 2015-11-29T03:44:48.979-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7320000 2015-11-29T03:44:49.07-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7330000 2015-11-29T03:44:49.085-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2570000 QueuedCount 50000 2015-11-29T03:44:49.099-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:49.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7340000 2015-11-29T03:44:49.204-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2580000 QueuedCount 50000 2015-11-29T03:44:49.255-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7350000 2015-11-29T03:44:49.318-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2590000 QueuedCount 46249 2015-11-29T03:44:49.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7360000 2015-11-29T03:44:49.427-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2600000 QueuedCount 36249 2015-11-29T03:44:49.537-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7370000 2015-11-29T03:44:49.682-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7380000 2015-11-29T03:44:49.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7390000 2015-11-29T03:44:49.975-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7400000 2015-11-29T03:44:50.071-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2610000 QueuedCount 26249 2015-11-29T03:44:50.128-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7410000 2015-11-29T03:44:50.161-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2620000 QueuedCount 16249 2015-11-29T03:44:50.255-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2630000 QueuedCount 6249 2015-11-29T03:44:50.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7420000 2015-11-29T03:44:50.425-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7430000 2015-11-29T03:44:50.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7440000 2015-11-29T03:44:50.697-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7450000 2015-11-29T03:44:50.787-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.715µs CommitTime 458.415574ms TotalFlushTime 1m17.780909159s TotalCommitTime 9.294040474s 2015-11-29T03:44:50.787-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1331048, 1331048, 17 committed:true 2015-11-29T03:44:50.788-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1331048, 1331048, 17 committed:true) SnapCreateDur 469.679084ms SnapOpenDur 42.872µs 2015-11-29T03:44:50.82-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7460000 2015-11-29T03:44:50.824-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:50.866-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:50.896-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7470000 2015-11-29T03:44:50.914-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2640000 QueuedCount 50000 2015-11-29T03:44:50.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7480000 2015-11-29T03:44:51.021-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7490000 2015-11-29T03:44:51.083-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7500000 2015-11-29T03:44:51.115-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2650000 QueuedCount 50000 2015-11-29T03:44:51.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7510000 2015-11-29T03:44:51.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7520000 2015-11-29T03:44:51.52-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:51.611-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2660000 QueuedCount 50000 2015-11-29T03:44:51.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7530000 2015-11-29T03:44:51.731-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7540000 2015-11-29T03:44:51.848-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7550000 2015-11-29T03:44:51.885-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2670000 QueuedCount 50000 2015-11-29T03:44:51.959-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7560000 2015-11-29T03:44:52.091-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7570000 2015-11-29T03:44:52.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7580000 2015-11-29T03:44:52.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7590000 2015-11-29T03:44:52.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7600000 2015-11-29T03:44:52.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7610000 2015-11-29T03:44:52.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7620000 2015-11-29T03:44:52.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7630000 2015-11-29T03:44:52.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7640000 2015-11-29T03:44:52.974-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2680000 QueuedCount 50000 2015-11-29T03:44:53.034-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7650000 2015-11-29T03:44:53.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7660000 2015-11-29T03:44:53.153-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:53.24-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2690000 QueuedCount 50000 2015-11-29T03:44:53.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7670000 2015-11-29T03:44:53.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7680000 2015-11-29T03:44:53.496-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7690000 2015-11-29T03:44:53.506-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2700000 QueuedCount 50000 2015-11-29T03:44:53.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7700000 2015-11-29T03:44:53.645-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:53.729-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7710000 2015-11-29T03:44:53.747-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2710000 QueuedCount 50000 2015-11-29T03:44:53.828-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7720000 2015-11-29T03:44:53.935-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7730000 2015-11-29T03:44:54.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7740000 2015-11-29T03:44:54.177-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7750000 2015-11-29T03:44:54.308-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7760000 2015-11-29T03:44:54.438-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7770000 2015-11-29T03:44:54.571-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7780000 2015-11-29T03:44:54.704-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7790000 2015-11-29T03:44:54.772-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2720000 QueuedCount 50000 2015-11-29T03:44:54.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:54.808-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7800000 2015-11-29T03:44:54.89-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7810000 2015-11-29T03:44:54.909-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2730000 QueuedCount 50000 2015-11-29T03:44:54.996-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7820000 2015-11-29T03:44:55.039-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2740000 QueuedCount 41836 2015-11-29T03:44:55.124-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7830000 2015-11-29T03:44:55.17-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2750000 QueuedCount 31836 2015-11-29T03:44:55.254-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7840000 2015-11-29T03:44:55.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7850000 2015-11-29T03:44:55.514-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7860000 2015-11-29T03:44:55.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7870000 2015-11-29T03:44:55.773-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7880000 2015-11-29T03:44:55.876-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2760000 QueuedCount 21836 2015-11-29T03:44:55.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7890000 2015-11-29T03:44:56.007-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7900000 2015-11-29T03:44:56.055-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2770000 QueuedCount 11836 2015-11-29T03:44:56.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7910000 2015-11-29T03:44:56.226-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7920000 2015-11-29T03:44:56.254-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2780000 QueuedCount 1836 2015-11-29T03:44:56.341-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7930000 2015-11-29T03:44:56.45-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7940000 2015-11-29T03:44:56.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7950000 2015-11-29T03:44:56.667-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7960000 2015-11-29T03:44:56.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7970000 2015-11-29T03:44:56.888-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7980000 2015-11-29T03:44:57.008-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7990000 2015-11-29T03:44:57.126-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.53µs CommitTime 802.962091ms TotalFlushTime 1m22.997708085s TotalCommitTime 10.097002565s 2015-11-29T03:44:57.127-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1404716, 1404716, 18 committed:true 2015-11-29T03:44:57.127-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1404716, 1404716, 18 committed:true) SnapCreateDur 828.874417ms SnapOpenDur 85.203µs 2015-11-29T03:44:57.127-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8000000 2015-11-29T03:44:57.159-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:57.19-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:57.217-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8010000 2015-11-29T03:44:57.223-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:57.263-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:57.287-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8020000 2015-11-29T03:44:57.332-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2790000 QueuedCount 50000 2015-11-29T03:44:57.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8030000 2015-11-29T03:44:57.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8040000 2015-11-29T03:44:57.486-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8050000 2015-11-29T03:44:57.549-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2800000 QueuedCount 50000 2015-11-29T03:44:57.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8060000 2015-11-29T03:44:57.636-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8070000 2015-11-29T03:44:57.638-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:57.736-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8080000 2015-11-29T03:44:57.783-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2810000 QueuedCount 50000 2015-11-29T03:44:57.845-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8090000 2015-11-29T03:44:57.95-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8100000 2015-11-29T03:44:58.006-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2820000 QueuedCount 50000 2015-11-29T03:44:58.056-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:58.063-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8110000 2015-11-29T03:44:58.192-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8120000 2015-11-29T03:44:58.313-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8130000 2015-11-29T03:44:58.436-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8140000 2015-11-29T03:44:58.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8150000 2015-11-29T03:44:58.691-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8160000 2015-11-29T03:44:58.817-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8170000 2015-11-29T03:44:58.934-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8180000 2015-11-29T03:44:59.004-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2830000 QueuedCount 50000 2015-11-29T03:44:59.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8190000 2015-11-29T03:44:59.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8200000 2015-11-29T03:44:59.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:59.211-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2840000 QueuedCount 50000 2015-11-29T03:44:59.217-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8210000 2015-11-29T03:44:59.32-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8220000 2015-11-29T03:44:59.424-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8230000 2015-11-29T03:44:59.441-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2850000 QueuedCount 50000 2015-11-29T03:44:59.459-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:44:59.533-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8240000 2015-11-29T03:44:59.641-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8250000 2015-11-29T03:44:59.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2860000 QueuedCount 50000 2015-11-29T03:44:59.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8260000 2015-11-29T03:44:59.858-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8270000 2015-11-29T03:44:59.983-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8280000 2015-11-29T03:45:00.108-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8290000 2015-11-29T03:45:00.236-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8300000 2015-11-29T03:45:00.369-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8310000 2015-11-29T03:45:00.512-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8320000 2015-11-29T03:45:00.641-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8330000 2015-11-29T03:45:00.681-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:00.742-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8340000 2015-11-29T03:45:00.757-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2870000 QueuedCount 50000 2015-11-29T03:45:00.829-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8350000 2015-11-29T03:45:00.868-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2880000 QueuedCount 46327 2015-11-29T03:45:00.945-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8360000 2015-11-29T03:45:00.978-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2890000 QueuedCount 36327 2015-11-29T03:45:01.068-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8370000 2015-11-29T03:45:01.091-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2900000 QueuedCount 26327 2015-11-29T03:45:01.204-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8380000 2015-11-29T03:45:01.329-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8390000 2015-11-29T03:45:01.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8400000 2015-11-29T03:45:01.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8410000 2015-11-29T03:45:01.723-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8420000 2015-11-29T03:45:01.723-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2910000 QueuedCount 16327 2015-11-29T03:45:01.821-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2920000 QueuedCount 6327 2015-11-29T03:45:01.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8430000 2015-11-29T03:45:01.979-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8440000 2015-11-29T03:45:02.103-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8450000 2015-11-29T03:45:02.233-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8460000 2015-11-29T03:45:02.364-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8470000 2015-11-29T03:45:02.494-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8480000 2015-11-29T03:45:02.608-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.83µs CommitTime 694.221843ms TotalFlushTime 1m27.504178233s TotalCommitTime 10.791224408s 2015-11-29T03:45:02.608-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1477606, 1477606, 19 committed:true 2015-11-29T03:45:02.609-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1477606, 1477606, 19 committed:true) SnapCreateDur 720.124691ms SnapOpenDur 55.945µs 2015-11-29T03:45:02.625-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8490000 2015-11-29T03:45:02.643-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:02.677-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:02.704-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8500000 2015-11-29T03:45:02.716-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:02.721-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2930000 QueuedCount 41063 2015-11-29T03:45:02.775-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8510000 2015-11-29T03:45:02.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8520000 2015-11-29T03:45:02.901-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8530000 2015-11-29T03:45:02.923-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2940000 QueuedCount 50000 2015-11-29T03:45:02.968-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8540000 2015-11-29T03:45:02.973-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:03.039-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8550000 2015-11-29T03:45:03.11-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8560000 2015-11-29T03:45:03.126-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2950000 QueuedCount 50000 2015-11-29T03:45:03.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8570000 2015-11-29T03:45:03.256-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:03.296-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8580000 2015-11-29T03:45:03.343-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2960000 QueuedCount 50000 2015-11-29T03:45:03.397-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8590000 2015-11-29T03:45:03.497-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8600000 2015-11-29T03:45:03.623-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8610000 2015-11-29T03:45:03.751-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8620000 2015-11-29T03:45:03.886-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8630000 2015-11-29T03:45:04.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8640000 2015-11-29T03:45:04.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8650000 2015-11-29T03:45:04.27-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8660000 2015-11-29T03:45:04.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8670000 2015-11-29T03:45:04.431-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2970000 QueuedCount 50000 2015-11-29T03:45:04.434-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:04.5-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8680000 2015-11-29T03:45:04.594-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8690000 2015-11-29T03:45:04.601-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2980000 QueuedCount 50000 2015-11-29T03:45:04.682-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:04.692-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8700000 2015-11-29T03:45:04.751-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 2990000 QueuedCount 50000 2015-11-29T03:45:04.779-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8710000 2015-11-29T03:45:04.874-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8720000 2015-11-29T03:45:04.926-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:04.957-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3000000 QueuedCount 50000 2015-11-29T03:45:04.978-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8730000 2015-11-29T03:45:05.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8740000 2015-11-29T03:45:05.219-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8750000 2015-11-29T03:45:06.024-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3010000 QueuedCount 50000 2015-11-29T03:45:06.07-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8760000 2015-11-29T03:45:06.09-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:06.242-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3020000 QueuedCount 50000 2015-11-29T03:45:06.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8770000 2015-11-29T03:45:06.48-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3030000 QueuedCount 47754 2015-11-29T03:45:06.67-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3040000 QueuedCount 37754 2015-11-29T03:45:07.368-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3050000 QueuedCount 27754 2015-11-29T03:45:07.449-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5518750752,"bucket-1:by_email_0:avg_ts_items_count":141327,"bucket-1:by_email_0:build_progress":15,"bucket-1:by_email_0:data_size":466805635,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":1033461760,"bucket-1:by_email_0:flush_queue_size":19526,"bucket-1:by_email_0:frag_percent":54,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":150429652,"bucket-1:by_email_0:items_count":1477606,"bucket-1:by_email_0:num_commits":19,"bucket-1:by_email_0:num_compactions":1,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":3048646,"bucket-1:by_email_0:num_docs_pending":11245299,"bucket-1:by_email_0:num_docs_queued":5706055,"bucket-1:by_email_0:num_flush_queued":3077754,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":19,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":5481913882,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"19 10791224408 7101718768151123600","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"3058231 27650030831 71983186307840711","bucket-1:by_email_0:timings/storage_handle_open":"19 1194272 135261396274","bucket-1:by_email_0:timings/storage_info":"77 1553341 438106922875","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"19 9795810 6001647217572","bucket-1:by_email_0:timings/storage_meta_set":"19 11848987 8548836155057","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"3089542 60532569334 -3630001421998550012","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5699782,"bucket-1:num_mutations_queued":8777536,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":344,"memory_quota":104857600000,"memory_used":1161863168,"needs_restart":false,"num_connections":0,"timings/stats_response":"1366 153700450 640737858701752"} 2015-11-29T03:45:07.467-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3060000 QueuedCount 17754 2015-11-29T03:45:07.567-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3070000 QueuedCount 7754 2015-11-29T03:45:08.173-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.871µs CommitTime 511.830581ms TotalFlushTime 1m32.248049441s TotalCommitTime 11.303054989s 2015-11-29T03:45:08.173-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1554573, 1554573, 20 committed:true 2015-11-29T03:45:08.173-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1554573, 1554573, 20 committed:true) SnapCreateDur 524.991326ms SnapOpenDur 40.55µs 2015-11-29T03:45:08.21-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:08.222-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8780000 2015-11-29T03:45:08.248-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:08.258-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3080000 QueuedCount 30393 2015-11-29T03:45:08.303-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8790000 2015-11-29T03:45:08.367-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8800000 2015-11-29T03:45:08.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8810000 2015-11-29T03:45:08.479-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3090000 QueuedCount 50000 2015-11-29T03:45:08.493-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8820000 2015-11-29T03:45:08.517-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:08.562-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8830000 2015-11-29T03:45:08.623-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8840000 2015-11-29T03:45:08.689-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8850000 2015-11-29T03:45:08.694-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3100000 QueuedCount 50000 2015-11-29T03:45:08.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8860000 2015-11-29T03:45:08.919-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3110000 QueuedCount 50000 2015-11-29T03:45:10.009-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3120000 QueuedCount 49999 2015-11-29T03:45:10.059-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:10.149-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3130000 QueuedCount 50000 2015-11-29T03:45:10.219-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8870000 2015-11-29T03:45:10.275-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3140000 QueuedCount 50000 2015-11-29T03:45:10.31-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8880000 2015-11-29T03:45:10.427-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:10.479-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3150000 QueuedCount 50000 2015-11-29T03:45:10.498-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8890000 2015-11-29T03:45:11.511-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3160000 QueuedCount 49999 2015-11-29T03:45:11.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8900000 2015-11-29T03:45:11.542-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:11.592-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8910000 2015-11-29T03:45:11.634-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3170000 QueuedCount 49999 2015-11-29T03:45:11.717-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8920000 2015-11-29T03:45:11.746-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3180000 QueuedCount 46285 2015-11-29T03:45:11.849-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3190000 QueuedCount 36285 2015-11-29T03:45:12.507-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3200000 QueuedCount 26285 2015-11-29T03:45:12.602-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3210000 QueuedCount 16285 2015-11-29T03:45:12.699-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3220000 QueuedCount 6285 2015-11-29T03:45:13.139-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.514µs CommitTime 371.792757ms TotalFlushTime 1m36.537035718s TotalCommitTime 11.674847746s 2015-11-29T03:45:13.139-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1629604, 1629604, 21 committed:true 2015-11-29T03:45:13.139-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1629604, 1629604, 21 committed:true) SnapCreateDur 381.699785ms SnapOpenDur 77.882µs 2015-11-29T03:45:13.177-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:13.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:13.218-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8930000 2015-11-29T03:45:13.249-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3230000 QueuedCount 46230 2015-11-29T03:45:13.289-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8940000 2015-11-29T03:45:13.3-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:13.355-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8950000 2015-11-29T03:45:13.415-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8960000 2015-11-29T03:45:13.448-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3240000 QueuedCount 50000 2015-11-29T03:45:13.475-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8970000 2015-11-29T03:45:13.538-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8980000 2015-11-29T03:45:13.638-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:13.654-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3250000 QueuedCount 49184 2015-11-29T03:45:13.749-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8990000 2015-11-29T03:45:13.859-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3260000 QueuedCount 50000 2015-11-29T03:45:13.931-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:14.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9000000 2015-11-29T03:45:14.947-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3270000 QueuedCount 50000 2015-11-29T03:45:14.998-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:15.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9010000 2015-11-29T03:45:15.071-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3280000 QueuedCount 50000 2015-11-29T03:45:15.136-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:15.193-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9020000 2015-11-29T03:45:15.197-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3290000 QueuedCount 50000 2015-11-29T03:45:15.267-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:15.314-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3300000 QueuedCount 50000 2015-11-29T03:45:15.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9030000 2015-11-29T03:45:15.96-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:15.966-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3310000 QueuedCount 49353 2015-11-29T03:45:16.061-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3320000 QueuedCount 50000 2015-11-29T03:45:16.064-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9040000 2015-11-29T03:45:16.156-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:16.169-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3330000 QueuedCount 48959 2015-11-29T03:45:16.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9050000 2015-11-29T03:45:16.276-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3340000 QueuedCount 50000 2015-11-29T03:45:16.337-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9060000 2015-11-29T03:45:16.349-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:16.875-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3350000 QueuedCount 50000 2015-11-29T03:45:16.945-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9070000 2015-11-29T03:45:16.973-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3360000 QueuedCount 50000 2015-11-29T03:45:17.004-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9080000 2015-11-29T03:45:17.019-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:17.069-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9090000 2015-11-29T03:45:17.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3370000 QueuedCount 49999 2015-11-29T03:45:17.158-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9100000 2015-11-29T03:45:17.18-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3380000 QueuedCount 50000 2015-11-29T03:45:17.739-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3390000 QueuedCount 40714 2015-11-29T03:45:17.818-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3400000 QueuedCount 30714 2015-11-29T03:45:17.901-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3410000 QueuedCount 20714 2015-11-29T03:45:17.986-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3420000 QueuedCount 10714 2015-11-29T03:45:18.075-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3430000 QueuedCount 714 2015-11-29T03:45:18.655-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.123µs CommitTime 557.962344ms TotalFlushTime 1m41.158964998s TotalCommitTime 12.23281009s 2015-11-29T03:45:18.655-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1731889, 1731889, 22 committed:true 2015-11-29T03:45:18.656-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1731889, 1731889, 22 committed:true) SnapCreateDur 567.596014ms SnapOpenDur 45.711µs 2015-11-29T03:45:18.691-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:18.722-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:18.725-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9110000 2015-11-29T03:45:18.754-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:18.788-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:18.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9120000 2015-11-29T03:45:18.872-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9130000 2015-11-29T03:45:18.923-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3440000 QueuedCount 50000 2015-11-29T03:45:18.94-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9140000 2015-11-29T03:45:18.976-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:19.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9150000 2015-11-29T03:45:19.137-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9160000 2015-11-29T03:45:19.139-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3450000 QueuedCount 50000 2015-11-29T03:45:19.343-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:19.417-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3460000 QueuedCount 50000 2015-11-29T03:45:19.503-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9170000 2015-11-29T03:45:19.637-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3470000 QueuedCount 50000 2015-11-29T03:45:19.654-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9180000 2015-11-29T03:45:19.663-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:20.619-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9190000 2015-11-29T03:45:20.623-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3480000 QueuedCount 50000 2015-11-29T03:45:20.751-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:20.774-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9200000 2015-11-29T03:45:20.844-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3490000 QueuedCount 50000 2015-11-29T03:45:20.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9210000 2015-11-29T03:45:21.075-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:21.086-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3500000 QueuedCount 49446 2015-11-29T03:45:21.291-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9220000 2015-11-29T03:45:21.32-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3510000 QueuedCount 50000 2015-11-29T03:45:24.401-08:00 [Info] CompactionDaemon: Finished compacting index instance:16481390354720717219 2015-11-29T03:45:24.425-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:24.567-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3520000 QueuedCount 50000 2015-11-29T03:45:24.667-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9230000 2015-11-29T03:45:24.803-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3530000 QueuedCount 50000 2015-11-29T03:45:25.007-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3540000 QueuedCount 40258 2015-11-29T03:45:25.195-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3550000 QueuedCount 30258 2015-11-29T03:45:25.939-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3560000 QueuedCount 20258 2015-11-29T03:45:26.027-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3570000 QueuedCount 10258 2015-11-29T03:45:26.114-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3580000 QueuedCount 258 2015-11-29T03:45:26.871-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.783µs CommitTime 724.852084ms TotalFlushTime 1m48.237155837s TotalCommitTime 12.957662174s 2015-11-29T03:45:26.871-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1806928, 1806928, 23 committed:true 2015-11-29T03:45:26.871-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1806928, 1806928, 23 committed:true) SnapCreateDur 751.101943ms SnapOpenDur 93.38µs 2015-11-29T03:45:26.913-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:26.933-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9240000 2015-11-29T03:45:26.967-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:27.021-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9250000 2015-11-29T03:45:27.087-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9260000 2015-11-29T03:45:27.108-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3590000 QueuedCount 50000 2015-11-29T03:45:27.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9270000 2015-11-29T03:45:27.227-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9280000 2015-11-29T03:45:27.262-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_email_0_16481390354720717219_0.index/data.fdb.0', errno = 2: 'No such file or directory' 2015-11-29T03:45:27.307-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9290000 2015-11-29T03:45:27.332-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3600000 QueuedCount 50000 2015-11-29T03:45:27.347-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:27.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9300000 2015-11-29T03:45:27.468-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9310000 2015-11-29T03:45:27.545-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9320000 2015-11-29T03:45:27.561-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3610000 QueuedCount 50000 2015-11-29T03:45:27.81-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3620000 QueuedCount 50000 2015-11-29T03:45:28.838-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:28.909-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9330000 2015-11-29T03:45:28.955-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3630000 QueuedCount 50000 2015-11-29T03:45:29.038-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9340000 2015-11-29T03:45:29.194-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3640000 QueuedCount 50000 2015-11-29T03:45:29.211-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:29.412-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9350000 2015-11-29T03:45:29.448-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3650000 QueuedCount 50000 2015-11-29T03:45:29.57-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:29.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9360000 2015-11-29T03:45:29.738-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3660000 QueuedCount 50000 2015-11-29T03:45:30.943-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3670000 QueuedCount 47230 2015-11-29T03:45:31.149-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3680000 QueuedCount 37230 2015-11-29T03:45:31.355-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3690000 QueuedCount 27230 2015-11-29T03:45:31.567-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3700000 QueuedCount 17230 2015-11-29T03:45:32.339-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3710000 QueuedCount 7230 2015-11-29T03:45:33.1-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 16.98µs CommitTime 654.105273ms TotalFlushTime 1m53.408389985s TotalCommitTime 13.611767447s 2015-11-29T03:45:33.1-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1876107, 1876107, 24 committed:true 2015-11-29T03:45:33.101-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1876107, 1876107, 24 committed:true) SnapCreateDur 680.110909ms SnapOpenDur 90.293µs 2015-11-29T03:45:33.138-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9370000 2015-11-29T03:45:33.139-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:33.178-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:33.197-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3720000 QueuedCount 20830 2015-11-29T03:45:33.225-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9380000 2015-11-29T03:45:33.225-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:33.307-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9390000 2015-11-29T03:45:33.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9400000 2015-11-29T03:45:33.435-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:33.436-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3730000 QueuedCount 49950 2015-11-29T03:45:33.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9410000 2015-11-29T03:45:33.668-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9420000 2015-11-29T03:45:33.696-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3740000 QueuedCount 50000 2015-11-29T03:45:33.956-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3750000 QueuedCount 50000 2015-11-29T03:45:33.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:34.079-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9430000 2015-11-29T03:45:34.271-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9440000 2015-11-29T03:45:35.091-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3760000 QueuedCount 50000 2015-11-29T03:45:35.176-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9450000 2015-11-29T03:45:35.255-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:35.318-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3770000 QueuedCount 50000 2015-11-29T03:45:35.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9460000 2015-11-29T03:45:35.569-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3780000 QueuedCount 50000 2015-11-29T03:45:35.628-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9470000 2015-11-29T03:45:35.788-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3790000 QueuedCount 42031 2015-11-29T03:45:36.699-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3800000 QueuedCount 32031 2015-11-29T03:45:36.795-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3810000 QueuedCount 22031 2015-11-29T03:45:36.896-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3820000 QueuedCount 12031 2015-11-29T03:45:37-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3830000 QueuedCount 2031 2015-11-29T03:45:37.998-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 21.55µs CommitTime 941.751397ms TotalFlushTime 1m57.001294423s TotalCommitTime 14.553518844s 2015-11-29T03:45:37.998-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 1934306, 1934306, 25 committed:true 2015-11-29T03:45:37.998-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 1934306, 1934306, 25 committed:true) SnapCreateDur 969.380337ms SnapOpenDur 84.432µs 2015-11-29T03:45:38.04-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:38.087-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:38.12-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9480000 2015-11-29T03:45:38.132-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:38.197-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9490000 2015-11-29T03:45:38.216-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3840000 QueuedCount 50000 2015-11-29T03:45:38.268-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9500000 2015-11-29T03:45:38.336-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9510000 2015-11-29T03:45:38.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9520000 2015-11-29T03:45:38.434-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3850000 QueuedCount 50000 2015-11-29T03:45:38.476-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9530000 2015-11-29T03:45:38.496-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:38.677-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3860000 QueuedCount 50000 2015-11-29T03:45:38.791-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9540000 2015-11-29T03:45:38.881-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:38.901-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9550000 2015-11-29T03:45:38.908-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3870000 QueuedCount 50000 2015-11-29T03:45:39.793-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3880000 QueuedCount 50000 2015-11-29T03:45:39.833-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9560000 2015-11-29T03:45:39.88-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:39.973-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3890000 QueuedCount 50000 2015-11-29T03:45:40.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9570000 2015-11-29T03:45:40.234-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3900000 QueuedCount 50000 2015-11-29T03:45:40.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:40.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9580000 2015-11-29T03:45:40.491-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3910000 QueuedCount 50000 2015-11-29T03:45:40.606-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9590000 2015-11-29T03:45:41.573-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3920000 QueuedCount 45827 2015-11-29T03:45:41.688-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3930000 QueuedCount 35827 2015-11-29T03:45:41.792-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3940000 QueuedCount 25827 2015-11-29T03:45:41.899-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3950000 QueuedCount 15827 2015-11-29T03:45:42.565-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3960000 QueuedCount 5827 2015-11-29T03:45:42.877-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.44µs CommitTime 237.187572ms TotalFlushTime 2m1.296573098s TotalCommitTime 14.790706416s 2015-11-29T03:45:42.877-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2001592, 2001592, 26 committed:true 2015-11-29T03:45:42.877-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2001592, 2001592, 26 committed:true) SnapCreateDur 250.451918ms SnapOpenDur 69.872µs 2015-11-29T03:45:42.91-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:42.944-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:42.958-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9600000 2015-11-29T03:45:42.99-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:42.998-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3970000 QueuedCount 49568 2015-11-29T03:45:43.027-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9610000 2015-11-29T03:45:43.101-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9620000 2015-11-29T03:45:43.162-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9630000 2015-11-29T03:45:43.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9640000 2015-11-29T03:45:43.242-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3980000 QueuedCount 50000 2015-11-29T03:45:43.299-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9650000 2015-11-29T03:45:43.435-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9660000 2015-11-29T03:45:43.477-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 3990000 QueuedCount 50000 2015-11-29T03:45:43.628-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:43.688-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9670000 2015-11-29T03:45:43.714-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4000000 QueuedCount 50000 2015-11-29T03:45:44.9-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9680000 2015-11-29T03:45:44.903-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4010000 QueuedCount 50000 2015-11-29T03:45:45.009-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:45.026-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9690000 2015-11-29T03:45:45.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4020000 QueuedCount 50000 2015-11-29T03:45:45.12-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9700000 2015-11-29T03:45:45.171-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4030000 QueuedCount 50000 2015-11-29T03:45:45.227-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:45.296-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4040000 QueuedCount 50000 2015-11-29T03:45:45.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9710000 2015-11-29T03:45:45.433-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:46.416-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4050000 QueuedCount 50000 2015-11-29T03:45:46.64-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4060000 QueuedCount 48715 2015-11-29T03:45:46.847-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4070000 QueuedCount 38715 2015-11-29T03:45:47.058-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4080000 QueuedCount 28715 2015-11-29T03:45:47.85-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4090000 QueuedCount 18715 2015-11-29T03:45:47.947-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4100000 QueuedCount 8715 2015-11-29T03:45:48.783-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.574µs CommitTime 711.679555ms TotalFlushTime 2m6.12677397s TotalCommitTime 15.502385971s 2015-11-29T03:45:48.783-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2073329, 2073329, 27 committed:true 2015-11-29T03:45:48.783-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2073329, 2073329, 27 committed:true) SnapCreateDur 738.901375ms SnapOpenDur 57.602µs 2015-11-29T03:45:48.819-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:48.851-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4110000 QueuedCount 19692 2015-11-29T03:45:48.855-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:48.898-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9720000 2015-11-29T03:45:48.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:48.98-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9730000 2015-11-29T03:45:49.052-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9740000 2015-11-29T03:45:49.101-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:49.107-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4120000 QueuedCount 49660 2015-11-29T03:45:49.132-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9750000 2015-11-29T03:45:49.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9760000 2015-11-29T03:45:49.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9770000 2015-11-29T03:45:49.334-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4130000 QueuedCount 50000 2015-11-29T03:45:49.37-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9780000 2015-11-29T03:45:49.449-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9790000 2015-11-29T03:45:49.515-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:49.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9800000 2015-11-29T03:45:49.567-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4140000 QueuedCount 50000 2015-11-29T03:45:49.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9810000 2015-11-29T03:45:49.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9820000 2015-11-29T03:45:50.666-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4150000 QueuedCount 50000 2015-11-29T03:45:50.735-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:50.789-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4160000 QueuedCount 50000 2015-11-29T03:45:50.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9830000 2015-11-29T03:45:51.029-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4170000 QueuedCount 49541 2015-11-29T03:45:51.24-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4180000 QueuedCount 39541 2015-11-29T03:45:52.142-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4190000 QueuedCount 29541 2015-11-29T03:45:52.242-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4200000 QueuedCount 19541 2015-11-29T03:45:52.342-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4210000 QueuedCount 9541 2015-11-29T03:45:53.435-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 13.157µs CommitTime 958.167981ms TotalFlushTime 2m9.526250856s TotalCommitTime 16.460553952s 2015-11-29T03:45:53.435-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2129337, 2129337, 28 committed:true 2015-11-29T03:45:53.435-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2129337, 2129337, 28 committed:true) SnapCreateDur 985.610272ms SnapOpenDur 66.067µs 2015-11-29T03:45:53.473-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4220000 QueuedCount 12727 2015-11-29T03:45:53.474-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:53.484-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9840000 2015-11-29T03:45:53.515-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:53.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:53.572-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9850000 2015-11-29T03:45:53.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9860000 2015-11-29T03:45:53.715-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4230000 QueuedCount 50000 2015-11-29T03:45:53.734-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9870000 2015-11-29T03:45:53.809-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9880000 2015-11-29T03:45:53.889-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9890000 2015-11-29T03:45:53.902-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:53.935-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4240000 QueuedCount 50000 2015-11-29T03:45:54.088-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9900000 2015-11-29T03:45:54.181-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4250000 QueuedCount 50000 2015-11-29T03:45:54.312-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9910000 2015-11-29T03:45:54.354-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:54.401-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:658160411, Disk:1638682624, ExtraSnapshotData:0, Fragmentation:59.836004766228605% 2015-11-29T03:45:54.401-08:00 [Info] CompactionDaemon: Compacting index instance:16481390354720717219 2015-11-29T03:45:54.423-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 1876107. Slice Id 0, IndexInstId 16481390354720717219, IndexDefnId 16481390354720717219 2015-11-29T03:45:55.522-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4260000 QueuedCount 50000 2015-11-29T03:45:55.678-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9920000 2015-11-29T03:45:55.757-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4270000 QueuedCount 50000 2015-11-29T03:45:55.784-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:55.896-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9930000 2015-11-29T03:45:55.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4280000 QueuedCount 50000 2015-11-29T03:45:56.2-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4290000 QueuedCount 43132 2015-11-29T03:45:56.416-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4300000 QueuedCount 33132 2015-11-29T03:45:57.262-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4310000 QueuedCount 23132 2015-11-29T03:45:57.36-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4320000 QueuedCount 13132 2015-11-29T03:45:57.458-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4330000 QueuedCount 3132 2015-11-29T03:45:58.432-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.223µs CommitTime 905.354558ms TotalFlushTime 2m13.284201569s TotalCommitTime 17.36590851s 2015-11-29T03:45:58.432-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2186332, 2186332, 29 committed:true 2015-11-29T03:45:58.432-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2186332, 2186332, 29 committed:true) SnapCreateDur 934.376561ms SnapOpenDur 44.868µs 2015-11-29T03:45:58.465-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:58.486-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9940000 2015-11-29T03:45:58.5-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:58.535-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:58.553-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4340000 QueuedCount 35573 2015-11-29T03:45:58.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9950000 2015-11-29T03:45:58.569-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:58.629-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9960000 2015-11-29T03:45:58.693-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9970000 2015-11-29T03:45:58.756-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9980000 2015-11-29T03:45:58.757-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4350000 QueuedCount 50000 2015-11-29T03:45:58.823-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9990000 2015-11-29T03:45:58.832-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:58.891-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000000 2015-11-29T03:45:58.963-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4360000 QueuedCount 50000 2015-11-29T03:45:59.071-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10010000 2015-11-29T03:45:59.138-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:45:59.188-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4370000 QueuedCount 50000 2015-11-29T03:46:00.302-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10020000 2015-11-29T03:46:00.311-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4380000 QueuedCount 50000 2015-11-29T03:46:00.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:00.529-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4390000 QueuedCount 50000 2015-11-29T03:46:00.543-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10030000 2015-11-29T03:46:00.657-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:00.748-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4400000 QueuedCount 50000 2015-11-29T03:46:00.847-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10040000 2015-11-29T03:46:00.971-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4410000 QueuedCount 50000 2015-11-29T03:46:01.902-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:01.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10050000 2015-11-29T03:46:01.932-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4420000 QueuedCount 50000 2015-11-29T03:46:02-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10060000 2015-11-29T03:46:02.05-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4430000 QueuedCount 50000 2015-11-29T03:46:02.149-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10070000 2015-11-29T03:46:02.171-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4440000 QueuedCount 50000 2015-11-29T03:46:02.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10080000 2015-11-29T03:46:02.28-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4450000 QueuedCount 45482 2015-11-29T03:46:02.931-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4460000 QueuedCount 35482 2015-11-29T03:46:03.028-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4470000 QueuedCount 25482 2015-11-29T03:46:03.129-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4480000 QueuedCount 15482 2015-11-29T03:46:03.219-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4490000 QueuedCount 5482 2015-11-29T03:46:04.42-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 15.186µs CommitTime 1.119804749s TotalFlushTime 2m17.788481738s TotalCommitTime 18.485713259s 2015-11-29T03:46:04.42-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2267666, 2267666, 30 committed:true 2015-11-29T03:46:04.42-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2267666, 2267666, 30 committed:true) SnapCreateDur 1.146452077s SnapOpenDur 44.37µs 2015-11-29T03:46:04.464-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:04.502-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:04.519-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10090000 2015-11-29T03:46:04.556-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4500000 QueuedCount 50000 2015-11-29T03:46:04.578-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10100000 2015-11-29T03:46:04.64-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10110000 2015-11-29T03:46:04.686-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:04.708-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10120000 2015-11-29T03:46:04.765-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4510000 QueuedCount 50000 2015-11-29T03:46:04.987-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:04.989-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4520000 QueuedCount 49890 2015-11-29T03:46:05.258-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4530000 QueuedCount 50000 2015-11-29T03:46:05.339-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:05.397-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10130000 2015-11-29T03:46:06.34-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4540000 QueuedCount 50000 2015-11-29T03:46:06.439-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:06.454-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4550000 QueuedCount 48614 2015-11-29T03:46:06.575-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4560000 QueuedCount 50000 2015-11-29T03:46:06.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10140000 2015-11-29T03:46:06.697-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4570000 QueuedCount 50000 2015-11-29T03:46:06.7-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:06.714-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10150000 2015-11-29T03:46:06.776-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10160000 2015-11-29T03:46:07.398-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4580000 QueuedCount 50000 2015-11-29T03:46:07.45-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5524667921,"bucket-1:by_email_0:avg_ts_items_count":140672,"bucket-1:by_email_0:build_progress":22,"bucket-1:by_email_0:data_size":704535765,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":1862270976,"bucket-1:by_email_0:flush_queue_size":50038,"bucket-1:by_email_0:frag_percent":62,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":227094465,"bucket-1:by_email_0:items_count":2267666,"bucket-1:by_email_0:num_commits":30,"bucket-1:by_email_0:num_compactions":2,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":4583536,"bucket-1:by_email_0:num_docs_pending":9866429,"bucket-1:by_email_0:num_docs_queued":5550035,"bucket-1:by_email_0:num_flush_queued":4632213,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":30,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":5988158081,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"30 18485713259 -5238881820130797941","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"4582176 44111842634 4226922283071466380","bucket-1:by_email_0:timings/storage_handle_open":"30 1667985 158543579369","bucket-1:by_email_0:timings/storage_info":"121 2791149 695238061493","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"31 17146546 11050355128826","bucket-1:by_email_0:timings/storage_meta_set":"30 19013470 13866166963774","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"4622148 90821325081 -3292350154997634299","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5532604,"bucket-1:num_mutations_queued":10164781,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":374,"memory_quota":104857600000,"memory_used":1039335424,"needs_restart":false,"num_connections":0,"timings/stats_response":"1438 183084283 653158020778157"} 2015-11-29T03:46:07.566-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:07.625-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4590000 QueuedCount 50000 2015-11-29T03:46:07.655-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10170000 2015-11-29T03:46:07.86-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4600000 QueuedCount 50000 2015-11-29T03:46:07.899-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10180000 2015-11-29T03:46:08.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4610000 QueuedCount 43453 2015-11-29T03:46:09.063-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4620000 QueuedCount 33453 2015-11-29T03:46:09.175-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4630000 QueuedCount 23453 2015-11-29T03:46:09.278-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4640000 QueuedCount 13453 2015-11-29T03:46:09.384-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4650000 QueuedCount 3453 2015-11-29T03:46:10.458-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.073µs CommitTime 999.612605ms TotalFlushTime 2m22.43834114s TotalCommitTime 19.485325864s 2015-11-29T03:46:10.458-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2346511, 2346511, 31 committed:true 2015-11-29T03:46:10.458-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2346511, 2346511, 31 committed:true) SnapCreateDur 1.028064923s SnapOpenDur 84.981µs 2015-11-29T03:46:10.495-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:10.518-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:10.548-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:10.556-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10190000 2015-11-29T03:46:10.587-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:10.63-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10200000 2015-11-29T03:46:10.637-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4660000 QueuedCount 50000 2015-11-29T03:46:10.692-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10210000 2015-11-29T03:46:10.761-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10220000 2015-11-29T03:46:10.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10230000 2015-11-29T03:46:10.868-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4670000 QueuedCount 50000 2015-11-29T03:46:10.9-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10240000 2015-11-29T03:46:10.935-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:10.976-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10250000 2015-11-29T03:46:11.047-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10260000 2015-11-29T03:46:11.117-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10270000 2015-11-29T03:46:11.127-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4680000 QueuedCount 50000 2015-11-29T03:46:11.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10280000 2015-11-29T03:46:11.254-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10290000 2015-11-29T03:46:11.275-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:11.336-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4690000 QueuedCount 50000 2015-11-29T03:46:12.322-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4700000 QueuedCount 50000 2015-11-29T03:46:12.378-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:12.514-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10300000 2015-11-29T03:46:12.543-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4710000 QueuedCount 50000 2015-11-29T03:46:12.574-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10310000 2015-11-29T03:46:12.634-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10320000 2015-11-29T03:46:12.698-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10330000 2015-11-29T03:46:12.713-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:12.761-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4720000 QueuedCount 50000 2015-11-29T03:46:12.882-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10340000 2015-11-29T03:46:12.992-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4730000 QueuedCount 50000 2015-11-29T03:46:14.205-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4740000 QueuedCount 41950 2015-11-29T03:46:14.317-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4750000 QueuedCount 31950 2015-11-29T03:46:14.434-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4760000 QueuedCount 21950 2015-11-29T03:46:14.553-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4770000 QueuedCount 11950 2015-11-29T03:46:15.228-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4780000 QueuedCount 1950 2015-11-29T03:46:15.445-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.608µs CommitTime 182.427421ms TotalFlushTime 2m26.943003645s TotalCommitTime 19.667753285s 2015-11-29T03:46:15.445-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2410803, 2410803, 32 committed:true 2015-11-29T03:46:15.445-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2410803, 2410803, 32 committed:true) SnapCreateDur 195.833684ms SnapOpenDur 41.576µs 2015-11-29T03:46:15.48-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:15.516-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:15.532-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10350000 2015-11-29T03:46:15.552-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:15.604-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10360000 2015-11-29T03:46:15.658-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4790000 QueuedCount 50000 2015-11-29T03:46:15.668-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10370000 2015-11-29T03:46:15.732-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10380000 2015-11-29T03:46:15.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:15.803-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10390000 2015-11-29T03:46:15.867-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10400000 2015-11-29T03:46:15.889-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4800000 QueuedCount 50000 2015-11-29T03:46:15.931-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10410000 2015-11-29T03:46:16.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10420000 2015-11-29T03:46:16.124-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4810000 QueuedCount 50000 2015-11-29T03:46:16.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:16.351-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4820000 QueuedCount 50000 2015-11-29T03:46:16.455-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10430000 2015-11-29T03:46:17.535-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4830000 QueuedCount 50000 2015-11-29T03:46:17.567-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10440000 2015-11-29T03:46:17.588-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:17.754-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4840000 QueuedCount 50000 2015-11-29T03:46:17.789-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10450000 2015-11-29T03:46:18.007-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4850000 QueuedCount 50000 2015-11-29T03:46:18.035-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10460000 2015-11-29T03:46:18.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10470000 2015-11-29T03:46:18.185-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:18.247-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4860000 QueuedCount 50000 2015-11-29T03:46:19.708-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4870000 QueuedCount 50000 2015-11-29T03:46:19.937-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4880000 QueuedCount 50000 2015-11-29T03:46:20.14-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4890000 QueuedCount 41531 2015-11-29T03:46:20.341-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4900000 QueuedCount 31531 2015-11-29T03:46:21.211-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4910000 QueuedCount 21531 2015-11-29T03:46:21.31-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4920000 QueuedCount 11531 2015-11-29T03:46:21.414-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4930000 QueuedCount 1531 2015-11-29T03:46:21.86-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.936µs CommitTime 412.929298ms TotalFlushTime 2m32.543868493s TotalCommitTime 20.080682583s 2015-11-29T03:46:21.86-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2485684, 2485684, 33 committed:true 2015-11-29T03:46:21.86-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2485684, 2485684, 33 committed:true) SnapCreateDur 427.798366ms SnapOpenDur 44.49µs 2015-11-29T03:46:21.901-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:21.938-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:21.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10480000 2015-11-29T03:46:21.97-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:22.029-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10490000 2015-11-29T03:46:22.053-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:22.07-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4940000 QueuedCount 49067 2015-11-29T03:46:22.096-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10500000 2015-11-29T03:46:22.16-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10510000 2015-11-29T03:46:22.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10520000 2015-11-29T03:46:22.273-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4950000 QueuedCount 50000 2015-11-29T03:46:22.284-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:22.29-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10530000 2015-11-29T03:46:22.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10540000 2015-11-29T03:46:22.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10550000 2015-11-29T03:46:22.493-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10560000 2015-11-29T03:46:22.5-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4960000 QueuedCount 50000 2015-11-29T03:46:22.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10570000 2015-11-29T03:46:22.592-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:22.63-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10580000 2015-11-29T03:46:22.697-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10590000 2015-11-29T03:46:22.709-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4970000 QueuedCount 50000 2015-11-29T03:46:22.77-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10600000 2015-11-29T03:46:22.864-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10610000 2015-11-29T03:46:22.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10620000 2015-11-29T03:46:23.063-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10630000 2015-11-29T03:46:23.669-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:23.677-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4980000 QueuedCount 49577 2015-11-29T03:46:23.906-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 4990000 QueuedCount 50000 2015-11-29T03:46:24.143-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5000000 QueuedCount 50000 2015-11-29T03:46:24.277-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5010000 QueuedCount 40656 2015-11-29T03:46:25.594-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5020000 QueuedCount 30656 2015-11-29T03:46:25.766-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5030000 QueuedCount 20656 2015-11-29T03:46:25.969-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5040000 QueuedCount 10656 2015-11-29T03:46:26.168-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5050000 QueuedCount 656 2015-11-29T03:46:26.932-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.318µs CommitTime 738.144353ms TotalFlushTime 2m36.600497748s TotalCommitTime 20.818826936s 2015-11-29T03:46:26.932-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2546176, 2546176, 34 committed:true 2015-11-29T03:46:26.932-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2546176, 2546176, 34 committed:true) SnapCreateDur 753.451254ms SnapOpenDur 48.408µs 2015-11-29T03:46:26.97-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:27.008-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:27.043-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:27.05-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10640000 2015-11-29T03:46:27.114-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10650000 2015-11-29T03:46:27.155-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5060000 QueuedCount 50000 2015-11-29T03:46:27.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10660000 2015-11-29T03:46:27.247-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10670000 2015-11-29T03:46:27.268-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:27.367-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5070000 QueuedCount 50000 2015-11-29T03:46:27.56-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:27.566-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5080000 QueuedCount 49746 2015-11-29T03:46:27.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10680000 2015-11-29T03:46:27.808-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5090000 QueuedCount 50000 2015-11-29T03:46:28.877-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:28.912-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10690000 2015-11-29T03:46:28.974-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5100000 QueuedCount 50000 2015-11-29T03:46:28.975-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10700000 2015-11-29T03:46:29.201-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5110000 QueuedCount 50000 2015-11-29T03:46:29.413-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5120000 QueuedCount 44741 2015-11-29T03:46:29.613-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5130000 QueuedCount 34741 2015-11-29T03:46:31.376-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5140000 QueuedCount 24741 2015-11-29T03:46:32.257-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5150000 QueuedCount 14741 2015-11-29T03:46:32.458-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5160000 QueuedCount 4741 2015-11-29T03:46:33.44-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 19.26µs CommitTime 853.824165ms TotalFlushTime 2m41.944371176s TotalCommitTime 21.672651101s 2015-11-29T03:46:33.44-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2603814, 2603814, 35 committed:true 2015-11-29T03:46:33.44-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2603814, 2603814, 35 committed:true) SnapCreateDur 880.511368ms SnapOpenDur 54.163µs 2015-11-29T03:46:33.472-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.503-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.534-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.565-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.574-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5170000 QueuedCount 39420 2015-11-29T03:46:33.602-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10710000 2015-11-29T03:46:33.643-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.674-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10720000 2015-11-29T03:46:33.737-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10730000 2015-11-29T03:46:33.8-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10740000 2015-11-29T03:46:33.803-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5180000 QueuedCount 50000 2015-11-29T03:46:33.893-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10750000 2015-11-29T03:46:33.909-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:33.962-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10760000 2015-11-29T03:46:34.01-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5190000 QueuedCount 50000 2015-11-29T03:46:34.027-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10770000 2015-11-29T03:46:34.423-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10780000 2015-11-29T03:46:34.532-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10790000 2015-11-29T03:46:34.564-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5200000 QueuedCount 49175 2015-11-29T03:46:35.664-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5210000 QueuedCount 39175 2015-11-29T03:46:35.791-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5220000 QueuedCount 29175 2015-11-29T03:46:35.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5230000 QueuedCount 19175 2015-11-29T03:46:36.053-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5240000 QueuedCount 9175 2015-11-29T03:46:36.993-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.976µs CommitTime 171.501247ms TotalFlushTime 2m45.154831998s TotalCommitTime 21.844152348s 2015-11-29T03:46:36.993-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2645915, 2645915, 36 committed:true 2015-11-29T03:46:36.993-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2645915, 2645915, 36 committed:true) SnapCreateDur 192.901117ms SnapOpenDur 46.906µs 2015-11-29T03:46:37.026-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:37.027-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5250000 QueuedCount 11858 2015-11-29T03:46:37.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:37.068-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10800000 2015-11-29T03:46:37.089-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:37.12-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:37.146-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10810000 2015-11-29T03:46:37.188-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5260000 QueuedCount 50000 2015-11-29T03:46:37.208-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10820000 2015-11-29T03:46:37.267-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10830000 2015-11-29T03:46:37.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10840000 2015-11-29T03:46:37.334-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:37.397-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10850000 2015-11-29T03:46:37.398-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5270000 QueuedCount 50000 2015-11-29T03:46:37.484-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10860000 2015-11-29T03:46:39.094-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5280000 QueuedCount 50000 2015-11-29T03:46:39.329-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5290000 QueuedCount 50000 2015-11-29T03:46:40.175-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:40.341-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5300000 QueuedCount 50000 2015-11-29T03:46:40.365-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10870000 2015-11-29T03:46:40.429-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10880000 2015-11-29T03:46:40.498-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5310000 QueuedCount 50000 2015-11-29T03:46:40.716-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5320000 QueuedCount 44530 2015-11-29T03:46:40.923-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5330000 QueuedCount 34530 2015-11-29T03:46:41.777-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5340000 QueuedCount 24530 2015-11-29T03:46:41.887-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5350000 QueuedCount 14530 2015-11-29T03:46:41.996-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5360000 QueuedCount 4530 2015-11-29T03:46:43.036-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 19.013µs CommitTime 957.439722ms TotalFlushTime 2m49.967679208s TotalCommitTime 22.80159207s 2015-11-29T03:46:43.036-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2704390, 2704390, 37 committed:true 2015-11-29T03:46:43.037-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2704390, 2704390, 37 committed:true) SnapCreateDur 983.37006ms SnapOpenDur 55.75µs 2015-11-29T03:46:43.073-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10890000 2015-11-29T03:46:43.077-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.111-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.142-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.18-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10900000 2015-11-29T03:46:43.186-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5370000 QueuedCount 50000 2015-11-29T03:46:43.211-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10910000 2015-11-29T03:46:43.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10920000 2015-11-29T03:46:43.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10930000 2015-11-29T03:46:43.377-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5380000 QueuedCount 50000 2015-11-29T03:46:43.418-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10940000 2015-11-29T03:46:43.457-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.485-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10950000 2015-11-29T03:46:43.558-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10960000 2015-11-29T03:46:43.607-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5390000 QueuedCount 50000 2015-11-29T03:46:43.623-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10970000 2015-11-29T03:46:43.754-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10980000 2015-11-29T03:46:43.796-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:43.829-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5400000 QueuedCount 50000 2015-11-29T03:46:43.914-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10990000 2015-11-29T03:46:44.983-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5410000 QueuedCount 50000 2015-11-29T03:46:45.125-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11000000 2015-11-29T03:46:45.38-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:45.494-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5420000 QueuedCount 50000 2015-11-29T03:46:45.608-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11010000 2015-11-29T03:46:45.726-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5430000 QueuedCount 50000 2015-11-29T03:46:45.883-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11020000 2015-11-29T03:46:45.993-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5440000 QueuedCount 46328 2015-11-29T03:46:46.947-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5450000 QueuedCount 36328 2015-11-29T03:46:47.053-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5460000 QueuedCount 26328 2015-11-29T03:46:47.163-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5470000 QueuedCount 16328 2015-11-29T03:46:47.273-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5480000 QueuedCount 6328 2015-11-29T03:46:48.079-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.844µs CommitTime 720.264943ms TotalFlushTime 2m54.023543306s TotalCommitTime 23.521857013s 2015-11-29T03:46:48.08-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2765012, 2765012, 38 committed:true 2015-11-29T03:46:48.08-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2765012, 2765012, 38 committed:true) SnapCreateDur 733.11282ms SnapOpenDur 53.491µs 2015-11-29T03:46:48.12-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.158-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.183-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11030000 2015-11-29T03:46:48.19-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.196-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5490000 QueuedCount 46441 2015-11-29T03:46:48.25-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11040000 2015-11-29T03:46:48.275-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.295-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5500000 QueuedCount 48058 2015-11-29T03:46:48.313-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11050000 2015-11-29T03:46:48.371-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11060000 2015-11-29T03:46:48.396-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5510000 QueuedCount 50000 2015-11-29T03:46:48.408-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.439-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11070000 2015-11-29T03:46:48.507-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5520000 QueuedCount 50000 2015-11-29T03:46:48.57-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:48.655-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11080000 2015-11-29T03:46:49.143-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5530000 QueuedCount 49999 2015-11-29T03:46:49.226-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11090000 2015-11-29T03:46:49.243-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5540000 QueuedCount 50000 2015-11-29T03:46:49.315-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:49.35-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5550000 QueuedCount 50000 2015-11-29T03:46:49.375-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11100000 2015-11-29T03:46:49.585-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5560000 QueuedCount 50000 2015-11-29T03:46:49.612-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11110000 2015-11-29T03:46:49.727-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11120000 2015-11-29T03:46:49.75-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:49.805-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11130000 2015-11-29T03:46:49.898-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11140000 2015-11-29T03:46:49.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11150000 2015-11-29T03:46:50.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11160000 2015-11-29T03:46:50.665-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5570000 QueuedCount 50000 2015-11-29T03:46:50.896-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5580000 QueuedCount 50000 2015-11-29T03:46:50.99-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:51.162-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5590000 QueuedCount 50000 2015-11-29T03:46:51.342-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5600000 QueuedCount 49193 2015-11-29T03:46:52.019-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5610000 QueuedCount 39193 2015-11-29T03:46:52.105-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5620000 QueuedCount 29193 2015-11-29T03:46:52.196-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5630000 QueuedCount 19193 2015-11-29T03:46:52.287-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5640000 QueuedCount 9193 2015-11-29T03:46:53.563-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.703µs CommitTime 1.15480693s TotalFlushTime 2m58.010472643s TotalCommitTime 24.676663943s 2015-11-29T03:46:53.563-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2846733, 2846733, 39 committed:true 2015-11-29T03:46:53.563-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2846733, 2846733, 39 committed:true) SnapCreateDur 1.180716013s SnapOpenDur 54.688µs 2015-11-29T03:46:53.602-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:53.609-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5650000 QueuedCount 15672 2015-11-29T03:46:53.628-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11170000 2015-11-29T03:46:53.64-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:53.678-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:53.703-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11180000 2015-11-29T03:46:53.765-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11190000 2015-11-29T03:46:53.824-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11200000 2015-11-29T03:46:53.831-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5660000 QueuedCount 50000 2015-11-29T03:46:53.89-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11210000 2015-11-29T03:46:53.952-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:53.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11220000 2015-11-29T03:46:54.024-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11230000 2015-11-29T03:46:54.052-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5670000 QueuedCount 50000 2015-11-29T03:46:54.096-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11240000 2015-11-29T03:46:54.167-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11250000 2015-11-29T03:46:54.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11260000 2015-11-29T03:46:54.274-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5680000 QueuedCount 50000 2015-11-29T03:46:54.325-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11270000 2015-11-29T03:46:54.326-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:54.415-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11280000 2015-11-29T03:46:55.251-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5690000 QueuedCount 50000 2015-11-29T03:46:55.336-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11290000 2015-11-29T03:46:55.476-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5700000 QueuedCount 50000 2015-11-29T03:46:55.585-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11300000 2015-11-29T03:46:55.606-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:55.699-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5710000 QueuedCount 50000 2015-11-29T03:46:55.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11310000 2015-11-29T03:46:55.943-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5720000 QueuedCount 50000 2015-11-29T03:46:56.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11320000 2015-11-29T03:46:56.185-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5730000 QueuedCount 50000 2015-11-29T03:46:57.134-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11330000 2015-11-29T03:46:57.183-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:46:57.262-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5740000 QueuedCount 50000 2015-11-29T03:46:57.501-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5750000 QueuedCount 50000 2015-11-29T03:46:57.744-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5760000 QueuedCount 50000 2015-11-29T03:46:57.972-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5770000 QueuedCount 42476 2015-11-29T03:46:58.957-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5780000 QueuedCount 32476 2015-11-29T03:46:59.071-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5790000 QueuedCount 22476 2015-11-29T03:46:59.189-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5800000 QueuedCount 12476 2015-11-29T03:46:59.302-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5810000 QueuedCount 2476 2015-11-29T03:47:00.084-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 11.254µs CommitTime 163.415067ms TotalFlushTime 3m3.945005395s TotalCommitTime 24.84007901s 2015-11-29T03:47:00.084-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2929067, 2929067, 40 committed:true 2015-11-29T03:47:00.084-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2929067, 2929067, 40 committed:true) SnapCreateDur 176.30753ms SnapOpenDur 58.101µs 2015-11-29T03:47:00.12-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.157-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.179-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11340000 2015-11-29T03:47:00.189-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.246-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11350000 2015-11-29T03:47:00.263-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.283-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5820000 QueuedCount 48938 2015-11-29T03:47:00.315-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11360000 2015-11-29T03:47:00.375-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11370000 2015-11-29T03:47:00.435-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11380000 2015-11-29T03:47:00.497-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11390000 2015-11-29T03:47:00.508-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5830000 QueuedCount 50000 2015-11-29T03:47:00.566-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11400000 2015-11-29T03:47:00.584-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.637-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11410000 2015-11-29T03:47:00.754-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5840000 QueuedCount 50000 2015-11-29T03:47:00.905-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:00.988-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5850000 QueuedCount 50000 2015-11-29T03:47:02.152-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5860000 QueuedCount 49999 2015-11-29T03:47:02.235-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:02.291-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11420000 2015-11-29T03:47:02.385-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11430000 2015-11-29T03:47:02.385-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5870000 QueuedCount 50000 2015-11-29T03:47:02.451-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11440000 2015-11-29T03:47:02.519-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11450000 2015-11-29T03:47:02.611-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5880000 QueuedCount 50000 2015-11-29T03:47:02.866-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5890000 QueuedCount 45017 2015-11-29T03:47:03.758-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5900000 QueuedCount 35017 2015-11-29T03:47:03.87-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5910000 QueuedCount 25017 2015-11-29T03:47:03.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5920000 QueuedCount 15017 2015-11-29T03:47:04.102-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5930000 QueuedCount 5017 2015-11-29T03:47:04.889-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.296µs CommitTime 127.475366ms TotalFlushTime 3m8.329044158s TotalCommitTime 24.967554376s 2015-11-29T03:47:04.889-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 2990560, 2990560, 41 committed:true 2015-11-29T03:47:04.889-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 2990560, 2990560, 41 committed:true) SnapCreateDur 137.746675ms SnapOpenDur 37.423µs 2015-11-29T03:47:04.93-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:04.964-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:04.993-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11460000 2015-11-29T03:47:04.995-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:05.001-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5940000 QueuedCount 39687 2015-11-29T03:47:05.027-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:05.067-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11470000 2015-11-29T03:47:05.133-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11480000 2015-11-29T03:47:05.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11490000 2015-11-29T03:47:05.211-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5950000 QueuedCount 50000 2015-11-29T03:47:05.264-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:05.266-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11500000 2015-11-29T03:47:05.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11510000 2015-11-29T03:47:05.411-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11520000 2015-11-29T03:47:05.439-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5960000 QueuedCount 50000 2015-11-29T03:47:05.517-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11530000 2015-11-29T03:47:05.531-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:05.701-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5970000 QueuedCount 50000 2015-11-29T03:47:05.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11540000 2015-11-29T03:47:05.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11550000 2015-11-29T03:47:06.746-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5980000 QueuedCount 50000 2015-11-29T03:47:06.784-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:06.841-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11560000 2015-11-29T03:47:06.874-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 5990000 QueuedCount 50000 2015-11-29T03:47:06.906-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11570000 2015-11-29T03:47:06.965-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11580000 2015-11-29T03:47:06.983-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:06.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6000000 QueuedCount 49768 2015-11-29T03:47:07.033-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11590000 2015-11-29T03:47:07.1-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11600000 2015-11-29T03:47:07.121-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6010000 QueuedCount 50000 2015-11-29T03:47:07.179-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11610000 2015-11-29T03:47:07.283-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11620000 2015-11-29T03:47:07.408-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11630000 2015-11-29T03:47:07.45-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5371440240,"bucket-1:by_email_0:avg_ts_items_count":136905,"bucket-1:by_email_0:build_progress":30,"bucket-1:by_email_0:data_size":930156480,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":2935582720,"bucket-1:by_email_0:flush_queue_size":50012,"bucket-1:by_email_0:frag_percent":68,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":299390556,"bucket-1:by_email_0:items_count":2990560,"bucket-1:by_email_0:num_commits":41,"bucket-1:by_email_0:num_compactions":2,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":6033027,"bucket-1:by_email_0:num_docs_pending":8435990,"bucket-1:by_email_0:num_docs_queued":5530983,"bucket-1:by_email_0:num_flush_queued":6065816,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":41,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":4805029458,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"41 24967554376 79425285363566850","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"6015805 58902735069 4227107177148041201","bucket-1:by_email_0:timings/storage_handle_open":"41 2034103 171812073179","bucket-1:by_email_0:timings/storage_info":"165 4237770 1095245964178","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"42 22656694 14124804904670","bucket-1:by_email_0:timings/storage_meta_set":"41 25112771 17747422366443","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"6063041 124216899313 -3490513083654278915","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5567561,"bucket-1:num_mutations_queued":11633366,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":383,"memory_quota":104857600000,"memory_used":3145445376,"needs_restart":false,"num_connections":0,"timings/stats_response":"1510 211922175 665623284997145"} 2015-11-29T03:47:08.102-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:08.151-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6020000 QueuedCount 50000 2015-11-29T03:47:08.27-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6030000 QueuedCount 50000 2015-11-29T03:47:08.381-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6040000 QueuedCount 40996 2015-11-29T03:47:08.492-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6050000 QueuedCount 30996 2015-11-29T03:47:09.193-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6060000 QueuedCount 20996 2015-11-29T03:47:09.283-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6070000 QueuedCount 10996 2015-11-29T03:47:09.38-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6080000 QueuedCount 996 2015-11-29T03:47:10.519-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.864µs CommitTime 1.1008912s TotalFlushTime 3m12.577215132s TotalCommitTime 26.068445576s 2015-11-29T03:47:10.519-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3064484, 3064484, 42 committed:true 2015-11-29T03:47:10.519-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3064484, 3064484, 42 committed:true) SnapCreateDur 1.12698607s SnapOpenDur 74.457µs 2015-11-29T03:47:10.552-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:10.588-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:10.624-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:10.644-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11640000 2015-11-29T03:47:10.704-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:10.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11650000 2015-11-29T03:47:10.741-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6090000 QueuedCount 50000 2015-11-29T03:47:10.774-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11660000 2015-11-29T03:47:10.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11670000 2015-11-29T03:47:10.966-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6100000 QueuedCount 50000 2015-11-29T03:47:11.076-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:11.146-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11680000 2015-11-29T03:47:11.22-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6110000 QueuedCount 50000 2015-11-29T03:47:11.364-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11690000 2015-11-29T03:47:11.451-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:11.46-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6120000 QueuedCount 49540 2015-11-29T03:47:12.513-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11700000 2015-11-29T03:47:12.629-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6130000 QueuedCount 50000 2015-11-29T03:47:12.701-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:12.758-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11710000 2015-11-29T03:47:12.827-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6140000 QueuedCount 50000 2015-11-29T03:47:13.034-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11720000 2015-11-29T03:47:13.057-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:13.072-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6150000 QueuedCount 49289 2015-11-29T03:47:13.103-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11730000 2015-11-29T03:47:13.316-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6160000 QueuedCount 50000 2015-11-29T03:47:13.347-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11740000 2015-11-29T03:47:15.771-08:00 [Info] CompactionDaemon: Finished compacting index instance:16481390354720717219 2015-11-29T03:47:15.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:15.943-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6170000 QueuedCount 50000 2015-11-29T03:47:16.05-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11750000 2015-11-29T03:47:16.16-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6180000 QueuedCount 50000 2015-11-29T03:47:16.361-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6190000 QueuedCount 40615 2015-11-29T03:47:16.574-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6200000 QueuedCount 30615 2015-11-29T03:47:17.423-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6210000 QueuedCount 20615 2015-11-29T03:47:17.527-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6220000 QueuedCount 10615 2015-11-29T03:47:17.635-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6230000 QueuedCount 615 2015-11-29T03:47:18.207-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.734µs CommitTime 551.300932ms TotalFlushTime 3m19.322693671s TotalCommitTime 26.619746508s 2015-11-29T03:47:18.207-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3140011, 3140011, 43 committed:true 2015-11-29T03:47:18.207-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3140011, 3140011, 43 committed:true) SnapCreateDur 563.969481ms SnapOpenDur 41.548µs 2015-11-29T03:47:18.245-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:18.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11760000 2015-11-29T03:47:18.291-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:18.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11770000 2015-11-29T03:47:18.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11780000 2015-11-29T03:47:18.434-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6240000 QueuedCount 50000 2015-11-29T03:47:18.457-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11790000 2015-11-29T03:47:18.523-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11800000 2015-11-29T03:47:18.59-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11810000 2015-11-29T03:47:18.619-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:18.643-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6250000 QueuedCount 50000 2015-11-29T03:47:18.662-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11820000 2015-11-29T03:47:18.73-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11830000 2015-11-29T03:47:18.865-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11840000 2015-11-29T03:47:18.865-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6260000 QueuedCount 50000 2015-11-29T03:47:19.083-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:19.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11850000 2015-11-29T03:47:19.125-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6270000 QueuedCount 50000 2015-11-29T03:47:20.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11860000 2015-11-29T03:47:20.203-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6280000 QueuedCount 50000 2015-11-29T03:47:20.236-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:20.258-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11870000 2015-11-29T03:47:20.344-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11880000 2015-11-29T03:47:20.411-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6290000 QueuedCount 50000 2015-11-29T03:47:20.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11890000 2015-11-29T03:47:20.519-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11900000 2015-11-29T03:47:20.603-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11910000 2015-11-29T03:47:20.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:20.66-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6300000 QueuedCount 50000 2015-11-29T03:47:20.704-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11920000 2015-11-29T03:47:20.813-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11930000 2015-11-29T03:47:20.913-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6310000 QueuedCount 50000 2015-11-29T03:47:20.913-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:20.939-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11940000 2015-11-29T03:47:21.1-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11950000 2015-11-29T03:47:21.265-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11960000 2015-11-29T03:47:21.43-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11970000 2015-11-29T03:47:21.589-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11980000 2015-11-29T03:47:21.74-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11990000 2015-11-29T03:47:21.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12000000 2015-11-29T03:47:21.975-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12010000 2015-11-29T03:47:22.023-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6320000 QueuedCount 50000 2015-11-29T03:47:22.128-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12020000 2015-11-29T03:47:22.24-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6330000 QueuedCount 40848 2015-11-29T03:47:22.315-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12030000 2015-11-29T03:47:22.46-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6340000 QueuedCount 30848 2015-11-29T03:47:22.5-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12040000 2015-11-29T03:47:22.675-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6350000 QueuedCount 20848 2015-11-29T03:47:22.683-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12050000 2015-11-29T03:47:22.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12060000 2015-11-29T03:47:22.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12070000 2015-11-29T03:47:23.148-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12080000 2015-11-29T03:47:23.459-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6360000 QueuedCount 10848 2015-11-29T03:47:23.566-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6370000 QueuedCount 848 2015-11-29T03:47:24.404-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 19.07µs CommitTime 794.697836ms TotalFlushTime 3m24.376389631s TotalCommitTime 27.414444344s 2015-11-29T03:47:24.404-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3210678, 3210678, 44 committed:true 2015-11-29T03:47:28.232-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 791 2015-11-29T03:47:28.262-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 791 2015-11-29T03:47:28.292-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 791 2015-11-29T03:47:28.322-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 791 2015-11-29T03:47:28.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 791 2015-11-29T03:47:28.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 791 2015-11-29T03:47:28.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 791 2015-11-29T03:47:28.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 791 2015-11-29T03:47:28.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 791 2015-11-29T03:47:28.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 791 2015-11-29T03:47:28.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 791 2015-11-29T03:47:28.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 791 2015-11-29T03:47:28.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 791 2015-11-29T03:47:28.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 791 2015-11-29T03:47:28.652-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 791 2015-11-29T03:47:28.682-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 791 2015-11-29T03:47:28.712-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 791 2015-11-29T03:47:28.742-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 791 2015-11-29T03:47:28.772-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 791 2015-11-29T03:47:28.802-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 791 2015-11-29T03:47:28.832-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 791 2015-11-29T03:47:28.862-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 791 2015-11-29T03:47:28.892-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 791 2015-11-29T03:47:28.922-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 791 2015-11-29T03:47:28.952-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 791 2015-11-29T03:47:28.982-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 791 2015-11-29T03:47:29.012-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 791 2015-11-29T03:47:29.042-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 791 2015-11-29T03:47:29.072-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 791 2015-11-29T03:47:29.102-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 791 2015-11-29T03:47:29.132-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 791 2015-11-29T03:47:29.162-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 791 2015-11-29T03:47:29.192-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 791 2015-11-29T03:47:29.222-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 791 2015-11-29T03:47:29.252-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 791 2015-11-29T03:47:29.282-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 791 2015-11-29T03:47:29.312-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 791 2015-11-29T03:47:29.342-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 791 2015-11-29T03:47:29.372-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 791 2015-11-29T03:47:29.402-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 791 2015-11-29T03:47:29.432-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 791 2015-11-29T03:47:29.462-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 791 2015-11-29T03:47:29.492-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 791 2015-11-29T03:47:29.522-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 791 2015-11-29T03:47:29.552-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 791 2015-11-29T03:47:29.582-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 791 2015-11-29T03:47:29.612-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 791 2015-11-29T03:47:29.642-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 791 2015-11-29T03:47:29.672-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 791 2015-11-29T03:47:29.702-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 791 2015-11-29T03:47:29.732-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 791 2015-11-29T03:47:29.762-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 791 2015-11-29T03:47:29.792-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 791 2015-11-29T03:47:29.822-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 791 2015-11-29T03:47:29.852-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 791 2015-11-29T03:47:29.882-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 791 2015-11-29T03:47:29.912-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 791 2015-11-29T03:47:29.914-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3210678, 3210678, 44 committed:true) SnapCreateDur 821.105558ms SnapOpenDur 5.509969438s 2015-11-29T03:47:29.943-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 791 2015-11-29T03:47:29.972-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 791 2015-11-29T03:47:30.002-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 791 2015-11-29T03:47:30.007-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_email_0_16481390354720717219_0.index/data.fdb.1', errno = 2: 'No such file or directory' 2015-11-29T03:47:30.032-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 791 2015-11-29T03:47:30.062-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 791 2015-11-29T03:47:30.092-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 791 2015-11-29T03:47:30.112-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6380000 QueuedCount 2488 2015-11-29T03:47:30.122-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 791 2015-11-29T03:47:30.152-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 791 2015-11-29T03:47:30.182-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 791 2015-11-29T03:47:30.212-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 791 2015-11-29T03:47:30.242-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 791 2015-11-29T03:47:30.272-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 791 2015-11-29T03:47:30.302-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 791 2015-11-29T03:47:30.332-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 791 2015-11-29T03:47:30.362-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 791 2015-11-29T03:47:30.392-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 791 2015-11-29T03:47:30.422-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 791 2015-11-29T03:47:30.452-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 791 2015-11-29T03:47:30.482-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 791 2015-11-29T03:47:30.512-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 791 2015-11-29T03:47:30.542-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 791 2015-11-29T03:47:30.572-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 791 2015-11-29T03:47:30.602-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 791 2015-11-29T03:47:30.632-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 791 2015-11-29T03:47:30.662-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 791 2015-11-29T03:47:30.68-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.69µs CommitTime 487.578803ms TotalFlushTime 3m24.585869703s TotalCommitTime 27.902023147s 2015-11-29T03:47:30.68-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3216522, 3216522, 45 committed:true 2015-11-29T03:47:30.68-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3216522, 3216522, 45 committed:true) SnapCreateDur 513.755972ms SnapOpenDur 62.609µs 2015-11-29T03:47:30.692-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 791 2015-11-29T03:47:30.721-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:30.722-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 791 2015-11-29T03:47:30.752-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 791 2015-11-29T03:47:30.757-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:30.782-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 791 2015-11-29T03:47:30.805-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:30.812-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 791 2015-11-29T03:47:30.842-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 791 2015-11-29T03:47:30.872-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 791 2015-11-29T03:47:30.902-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 791 2015-11-29T03:47:30.905-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6390000 QueuedCount 50000 2015-11-29T03:47:30.922-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:30.932-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 791 2015-11-29T03:47:30.962-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 791 2015-11-29T03:47:30.992-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 791 2015-11-29T03:47:31.022-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 791 2015-11-29T03:47:31.052-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 791 2015-11-29T03:47:31.082-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 791 2015-11-29T03:47:31.112-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 791 2015-11-29T03:47:31.142-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 791 2015-11-29T03:47:31.146-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6400000 QueuedCount 50000 2015-11-29T03:47:31.172-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 791 2015-11-29T03:47:31.202-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 791 2015-11-29T03:47:31.232-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 791 2015-11-29T03:47:31.262-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 791 2015-11-29T03:47:31.292-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 791 2015-11-29T03:47:31.322-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 791 2015-11-29T03:47:31.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 791 2015-11-29T03:47:31.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 791 2015-11-29T03:47:31.404-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:31.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 791 2015-11-29T03:47:31.416-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6410000 QueuedCount 49472 2015-11-29T03:47:31.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 791 2015-11-29T03:47:31.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 791 2015-11-29T03:47:31.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 791 2015-11-29T03:47:31.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 791 2015-11-29T03:47:31.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 791 2015-11-29T03:47:31.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 791 2015-11-29T03:47:31.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 791 2015-11-29T03:47:31.652-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 791 2015-11-29T03:47:31.682-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 791 2015-11-29T03:47:31.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6420000 QueuedCount 50000 2015-11-29T03:47:31.712-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 791 2015-11-29T03:47:31.742-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 791 2015-11-29T03:47:31.772-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 791 2015-11-29T03:47:31.802-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 791 2015-11-29T03:47:31.832-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 791 2015-11-29T03:47:31.862-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 791 2015-11-29T03:47:31.892-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 791 2015-11-29T03:47:31.922-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 791 2015-11-29T03:47:31.952-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 791 2015-11-29T03:47:31.982-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 791 2015-11-29T03:47:32.012-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 791 2015-11-29T03:47:32.042-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 791 2015-11-29T03:47:32.072-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 791 2015-11-29T03:47:32.102-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 791 2015-11-29T03:47:32.132-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 791 2015-11-29T03:47:32.162-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 791 2015-11-29T03:47:32.192-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 791 2015-11-29T03:47:32.222-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 791 2015-11-29T03:47:32.252-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 791 2015-11-29T03:47:32.282-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 791 2015-11-29T03:47:32.312-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 791 2015-11-29T03:47:32.342-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 791 2015-11-29T03:47:32.372-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 791 2015-11-29T03:47:32.402-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 791 2015-11-29T03:47:32.432-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 791 2015-11-29T03:47:32.462-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 791 2015-11-29T03:47:32.492-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 791 2015-11-29T03:47:32.522-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 791 2015-11-29T03:47:32.552-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 791 2015-11-29T03:47:32.582-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 791 2015-11-29T03:47:32.612-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 791 2015-11-29T03:47:32.642-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 791 2015-11-29T03:47:32.672-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 791 2015-11-29T03:47:32.702-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 791 2015-11-29T03:47:32.732-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 791 2015-11-29T03:47:32.762-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 791 2015-11-29T03:47:32.792-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 791 2015-11-29T03:47:32.822-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 791 2015-11-29T03:47:32.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:32.97-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6430000 QueuedCount 50000 2015-11-29T03:47:33.009-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12090000 2015-11-29T03:47:33.091-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:33.175-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12100000 2015-11-29T03:47:33.212-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6440000 QueuedCount 50000 2015-11-29T03:47:33.249-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12110000 2015-11-29T03:47:33.322-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12120000 2015-11-29T03:47:33.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12130000 2015-11-29T03:47:33.419-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:33.455-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6450000 QueuedCount 50000 2015-11-29T03:47:33.479-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12140000 2015-11-29T03:47:33.56-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12150000 2015-11-29T03:47:33.637-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12160000 2015-11-29T03:47:33.698-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6460000 QueuedCount 50000 2015-11-29T03:47:33.715-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12170000 2015-11-29T03:47:33.727-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:34.966-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6470000 QueuedCount 50000 2015-11-29T03:47:35.038-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:35.114-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6480000 QueuedCount 50000 2015-11-29T03:47:35.293-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6490000 QueuedCount 48749 2015-11-29T03:47:35.502-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6500000 QueuedCount 38749 2015-11-29T03:47:36.494-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6510000 QueuedCount 28749 2015-11-29T03:47:36.6-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6520000 QueuedCount 18749 2015-11-29T03:47:36.706-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6530000 QueuedCount 8749 2015-11-29T03:47:37.935-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 17.64µs CommitTime 1.112417235s TotalFlushTime 3m30.242783816s TotalCommitTime 29.014440382s 2015-11-29T03:47:37.935-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3294631, 3294631, 46 committed:true 2015-11-29T03:47:37.935-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3294631, 3294631, 46 committed:true) SnapCreateDur 1.138690963s SnapOpenDur 50.471µs 2015-11-29T03:47:37.974-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:37.99-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6540000 QueuedCount 12135 2015-11-29T03:47:38.016-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:38.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:38.158-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:38.24-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6550000 QueuedCount 50000 2015-11-29T03:47:38.473-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6560000 QueuedCount 50000 2015-11-29T03:47:38.505-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:38.724-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6570000 QueuedCount 50000 2015-11-29T03:47:38.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 805 2015-11-29T03:47:38.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 805 2015-11-29T03:47:38.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 805 2015-11-29T03:47:38.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 805 2015-11-29T03:47:38.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 805 2015-11-29T03:47:38.877-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:38.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 805 2015-11-29T03:47:38.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 805 2015-11-29T03:47:38.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 805 2015-11-29T03:47:38.977-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6580000 QueuedCount 50000 2015-11-29T03:47:38.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 805 2015-11-29T03:47:39.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 805 2015-11-29T03:47:39.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 805 2015-11-29T03:47:39.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 805 2015-11-29T03:47:39.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 805 2015-11-29T03:47:39.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 805 2015-11-29T03:47:39.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 805 2015-11-29T03:47:39.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 805 2015-11-29T03:47:39.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 805 2015-11-29T03:47:39.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 805 2015-11-29T03:47:39.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 805 2015-11-29T03:47:39.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 805 2015-11-29T03:47:39.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 805 2015-11-29T03:47:39.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 805 2015-11-29T03:47:39.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 805 2015-11-29T03:47:39.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 805 2015-11-29T03:47:39.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 805 2015-11-29T03:47:39.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 805 2015-11-29T03:47:39.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 805 2015-11-29T03:47:39.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 805 2015-11-29T03:47:39.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 805 2015-11-29T03:47:39.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 805 2015-11-29T03:47:39.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 805 2015-11-29T03:47:39.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 805 2015-11-29T03:47:39.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 805 2015-11-29T03:47:39.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 805 2015-11-29T03:47:39.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 805 2015-11-29T03:47:39.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 805 2015-11-29T03:47:39.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 805 2015-11-29T03:47:39.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 805 2015-11-29T03:47:39.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 805 2015-11-29T03:47:39.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 805 2015-11-29T03:47:39.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 805 2015-11-29T03:47:39.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 805 2015-11-29T03:47:40.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 805 2015-11-29T03:47:40.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 805 2015-11-29T03:47:40.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 805 2015-11-29T03:47:40.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 805 2015-11-29T03:47:40.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 805 2015-11-29T03:47:40.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 805 2015-11-29T03:47:40.162-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6590000 QueuedCount 50000 2015-11-29T03:47:40.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 805 2015-11-29T03:47:40.19-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:40.399-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6600000 QueuedCount 49996 2015-11-29T03:47:40.457-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12180000 2015-11-29T03:47:40.648-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6610000 QueuedCount 50000 2015-11-29T03:47:40.898-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6620000 QueuedCount 48327 2015-11-29T03:47:41.781-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6630000 QueuedCount 38327 2015-11-29T03:47:41.881-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6640000 QueuedCount 28327 2015-11-29T03:47:41.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6650000 QueuedCount 18327 2015-11-29T03:47:42.091-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6660000 QueuedCount 8327 2015-11-29T03:47:43.227-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.097µs CommitTime 449.109866ms TotalFlushTime 3m34.655001196s TotalCommitTime 29.463550248s 2015-11-29T03:47:43.227-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3358488, 3358488, 47 committed:true 2015-11-29T03:47:43.227-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3358488, 3358488, 47 committed:true) SnapCreateDur 475.096432ms SnapOpenDur 92.277µs 2015-11-29T03:47:43.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:43.306-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6670000 QueuedCount 28692 2015-11-29T03:47:43.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12190000 2015-11-29T03:47:43.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12200000 2015-11-29T03:47:43.422-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:43.475-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12210000 2015-11-29T03:47:43.542-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6680000 QueuedCount 50000 2015-11-29T03:47:43.548-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12220000 2015-11-29T03:47:43.624-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12230000 2015-11-29T03:47:43.699-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12240000 2015-11-29T03:47:43.766-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6690000 QueuedCount 50000 2015-11-29T03:47:43.774-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12250000 2015-11-29T03:47:43.848-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12260000 2015-11-29T03:47:43.854-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:43.999-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6700000 QueuedCount 50000 2015-11-29T03:47:44.048-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12270000 2015-11-29T03:47:45.111-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6710000 QueuedCount 50000 2015-11-29T03:47:45.113-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:45.144-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12280000 2015-11-29T03:47:45.229-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6720000 QueuedCount 50000 2015-11-29T03:47:45.267-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12290000 2015-11-29T03:47:45.292-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:45.346-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6730000 QueuedCount 50000 2015-11-29T03:47:45.39-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12300000 2015-11-29T03:47:45.466-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6740000 QueuedCount 50000 2015-11-29T03:47:45.483-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12310000 2015-11-29T03:47:45.581-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6750000 QueuedCount 40919 2015-11-29T03:47:45.771-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:1054901890, Disk:2867118080, ExtraSnapshotData:0, Fragmentation:63.2068906628359% 2015-11-29T03:47:45.771-08:00 [Info] CompactionDaemon: Compacting index instance:16481390354720717219 2015-11-29T03:47:46.19-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 3140011. Slice Id 0, IndexInstId 16481390354720717219, IndexDefnId 16481390354720717219 2015-11-29T03:47:46.628-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6760000 QueuedCount 30919 2015-11-29T03:47:46.798-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6770000 QueuedCount 20919 2015-11-29T03:47:47.014-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6780000 QueuedCount 10919 2015-11-29T03:47:47.211-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6790000 QueuedCount 919 2015-11-29T03:47:48.045-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.503µs CommitTime 799.066024ms TotalFlushTime 3m38.389815493s TotalCommitTime 30.262616272s 2015-11-29T03:47:48.045-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3419172, 3419172, 48 committed:true 2015-11-29T03:47:48.045-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3419172, 3419172, 48 committed:true) SnapCreateDur 814.397519ms SnapOpenDur 45.16µs 2015-11-29T03:47:48.083-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:48.127-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:48.148-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12320000 2015-11-29T03:47:48.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12330000 2015-11-29T03:47:48.238-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:48.277-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12340000 2015-11-29T03:47:48.279-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6800000 QueuedCount 50000 2015-11-29T03:47:48.342-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12350000 2015-11-29T03:47:48.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12360000 2015-11-29T03:47:48.466-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12370000 2015-11-29T03:47:48.5-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6810000 QueuedCount 50000 2015-11-29T03:47:48.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12380000 2015-11-29T03:47:48.66-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:48.701-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6820000 QueuedCount 50000 2015-11-29T03:47:48.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12390000 2015-11-29T03:47:48.938-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6830000 QueuedCount 50000 2015-11-29T03:47:48.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12400000 2015-11-29T03:47:50.074-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:50.169-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6840000 QueuedCount 50000 2015-11-29T03:47:50.392-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6850000 QueuedCount 50000 2015-11-29T03:47:50.398-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:50.441-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12410000 2015-11-29T03:47:50.62-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6860000 QueuedCount 50000 2015-11-29T03:47:50.835-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6870000 QueuedCount 44423 2015-11-29T03:47:51.828-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6880000 QueuedCount 34423 2015-11-29T03:47:51.93-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6890000 QueuedCount 24423 2015-11-29T03:47:52.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6900000 QueuedCount 14423 2015-11-29T03:47:52.139-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6910000 QueuedCount 4423 2015-11-29T03:47:52.826-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.298µs CommitTime 618.654856ms TotalFlushTime 3m42.243071623s TotalCommitTime 30.881271128s 2015-11-29T03:47:52.826-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3480172, 3480172, 49 committed:true 2015-11-29T03:47:52.826-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3480172, 3480172, 49 committed:true) SnapCreateDur 631.228988ms SnapOpenDur 69.347µs 2015-11-29T03:47:52.861-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:52.881-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12420000 2015-11-29T03:47:52.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:52.939-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:52.954-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12430000 2015-11-29T03:47:52.974-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6920000 QueuedCount 50000 2015-11-29T03:47:53.015-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12440000 2015-11-29T03:47:53.075-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12450000 2015-11-29T03:47:53.136-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12460000 2015-11-29T03:47:53.178-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6930000 QueuedCount 50000 2015-11-29T03:47:53.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12470000 2015-11-29T03:47:53.218-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:53.265-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12480000 2015-11-29T03:47:53.328-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12490000 2015-11-29T03:47:53.385-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6940000 QueuedCount 50000 2015-11-29T03:47:53.452-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12500000 2015-11-29T03:47:53.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:53.639-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6950000 QueuedCount 50000 2015-11-29T03:47:54.647-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6960000 QueuedCount 50000 2015-11-29T03:47:54.664-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:54.856-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6970000 QueuedCount 50000 2015-11-29T03:47:54.988-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:55.08-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12510000 2015-11-29T03:47:55.085-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6980000 QueuedCount 50000 2015-11-29T03:47:55.309-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 6990000 QueuedCount 50000 2015-11-29T03:47:55.331-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:55.472-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12520000 2015-11-29T03:47:56.442-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7000000 QueuedCount 50000 2015-11-29T03:47:56.554-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12530000 2015-11-29T03:47:56.591-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:56.653-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7010000 QueuedCount 50000 2015-11-29T03:47:56.793-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12540000 2015-11-29T03:47:56.865-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7020000 QueuedCount 50000 2015-11-29T03:47:57.065-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7030000 QueuedCount 42286 2015-11-29T03:47:57.828-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7040000 QueuedCount 32286 2015-11-29T03:47:57.924-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7050000 QueuedCount 22286 2015-11-29T03:47:58.027-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7060000 QueuedCount 12286 2015-11-29T03:47:58.141-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7070000 QueuedCount 2286 2015-11-29T03:47:58.805-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.171µs CommitTime 617.358972ms TotalFlushTime 3m47.198119079s TotalCommitTime 31.4986301s 2015-11-29T03:47:58.805-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3557857, 3557857, 50 committed:true 2015-11-29T03:47:58.805-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3557857, 3557857, 50 committed:true) SnapCreateDur 630.00829ms SnapOpenDur 39.92µs 2015-11-29T03:47:58.84-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:58.867-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12550000 2015-11-29T03:47:58.875-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:58.917-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:58.942-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12560000 2015-11-29T03:47:58.986-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7080000 QueuedCount 50000 2015-11-29T03:47:59.001-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12570000 2015-11-29T03:47:59.064-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12580000 2015-11-29T03:47:59.132-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12590000 2015-11-29T03:47:59.191-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7090000 QueuedCount 50000 2015-11-29T03:47:59.197-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12600000 2015-11-29T03:47:59.257-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12610000 2015-11-29T03:47:59.319-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12620000 2015-11-29T03:47:59.348-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:47:59.385-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12630000 2015-11-29T03:47:59.389-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7100000 QueuedCount 50000 2015-11-29T03:47:59.476-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12640000 2015-11-29T03:47:59.611-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7110000 QueuedCount 50000 2015-11-29T03:47:59.635-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12650000 2015-11-29T03:48:00.709-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:00.758-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7120000 QueuedCount 50000 2015-11-29T03:48:00.838-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12660000 2015-11-29T03:48:00.874-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7130000 QueuedCount 50000 2015-11-29T03:48:00.909-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:00.989-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12670000 2015-11-29T03:48:00.998-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7140000 QueuedCount 50000 2015-11-29T03:48:01.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12680000 2015-11-29T03:48:01.213-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7150000 QueuedCount 50000 2015-11-29T03:48:01.239-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:02.164-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12690000 2015-11-29T03:48:02.203-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7160000 QueuedCount 50000 2015-11-29T03:48:02.423-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:02.429-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7170000 QueuedCount 49680 2015-11-29T03:48:02.497-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12700000 2015-11-29T03:48:02.643-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7180000 QueuedCount 50000 2015-11-29T03:48:02.872-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7190000 QueuedCount 50000 2015-11-29T03:48:03.858-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7200000 QueuedCount 40161 2015-11-29T03:48:03.962-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7210000 QueuedCount 30161 2015-11-29T03:48:04.067-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7220000 QueuedCount 20161 2015-11-29T03:48:04.182-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7230000 QueuedCount 10161 2015-11-29T03:48:04.827-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7240000 QueuedCount 161 2015-11-29T03:48:05.277-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 12.287µs CommitTime 416.087896ms TotalFlushTime 3m52.863038366s TotalCommitTime 31.914717996s 2015-11-29T03:48:05.278-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3641200, 3641200, 51 committed:true 2015-11-29T03:48:05.278-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3641200, 3641200, 51 committed:true) SnapCreateDur 442.134579ms SnapOpenDur 74.68µs 2015-11-29T03:48:05.317-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:05.328-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12710000 2015-11-29T03:48:05.352-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:05.388-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:05.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12720000 2015-11-29T03:48:05.473-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12730000 2015-11-29T03:48:05.533-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7250000 QueuedCount 50000 2015-11-29T03:48:05.535-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12740000 2015-11-29T03:48:05.598-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12750000 2015-11-29T03:48:05.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:05.668-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12760000 2015-11-29T03:48:05.734-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7260000 QueuedCount 50000 2015-11-29T03:48:05.735-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12770000 2015-11-29T03:48:05.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12780000 2015-11-29T03:48:05.926-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12790000 2015-11-29T03:48:05.949-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7270000 QueuedCount 50000 2015-11-29T03:48:05.967-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:06.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12800000 2015-11-29T03:48:06.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7280000 QueuedCount 50000 2015-11-29T03:48:07.346-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12810000 2015-11-29T03:48:07.372-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7290000 QueuedCount 50000 2015-11-29T03:48:07.448-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:07.45-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5986069804,"bucket-1:by_email_0:avg_ts_items_count":154201,"bucket-1:by_email_0:build_progress":36,"bucket-1:by_email_0:data_size":1140831821,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":3392352256,"bucket-1:by_email_0:flush_queue_size":49877,"bucket-1:by_email_0:frag_percent":66,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":364886595,"bucket-1:by_email_0:items_count":3641200,"bucket-1:by_email_0:num_commits":51,"bucket-1:by_email_0:num_compactions":3,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":7320834,"bucket-1:by_email_0:num_docs_pending":7189686,"bucket-1:by_email_0:num_docs_queued":5489480,"bucket-1:by_email_0:num_flush_queued":7343309,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":51,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":6472851535,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"51 31914717996 5479270532436807272","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"7293434 73614781726 6260953741241814316","bucket-1:by_email_0:timings/storage_handle_open":"51 5512295675 -6534103817475623483","bucket-1:by_email_0:timings/storage_info":"205 4983576 1161553994242","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"53 425805221 158318341101980361","bucket-1:by_email_0:timings/storage_meta_set":"51 31601979 22452249176357","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"7335222 152284704895 -3181917536176882927","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5467003,"bucket-1:num_mutations_queued":12810312,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":400,"memory_quota":104857600000,"memory_used":1665654784,"needs_restart":false,"num_connections":0,"timings/stats_response":"1582 238957657 676186324480481"} 2015-11-29T03:48:07.599-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7300000 QueuedCount 50000 2015-11-29T03:48:07.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12820000 2015-11-29T03:48:07.842-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7310000 QueuedCount 49782 2015-11-29T03:48:08.044-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7320000 QueuedCount 39782 2015-11-29T03:48:09.014-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7330000 QueuedCount 29782 2015-11-29T03:48:09.123-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7340000 QueuedCount 19782 2015-11-29T03:48:09.229-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7350000 QueuedCount 9782 2015-11-29T03:48:10.018-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.922µs CommitTime 668.024344ms TotalFlushTime 3m56.645736924s TotalCommitTime 32.58274234s 2015-11-29T03:48:10.018-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3700510, 3700510, 52 committed:true 2015-11-29T03:48:10.018-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3700510, 3700510, 52 committed:true) SnapCreateDur 680.546634ms SnapOpenDur 41.114µs 2015-11-29T03:48:10.045-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7360000 QueuedCount 7412 2015-11-29T03:48:10.052-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.07-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12830000 2015-11-29T03:48:10.086-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.12-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.145-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12840000 2015-11-29T03:48:10.152-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12850000 2015-11-29T03:48:10.25-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7370000 QueuedCount 50000 2015-11-29T03:48:10.279-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12860000 2015-11-29T03:48:10.344-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12870000 2015-11-29T03:48:10.397-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.409-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12880000 2015-11-29T03:48:10.446-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7380000 QueuedCount 50000 2015-11-29T03:48:10.477-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12890000 2015-11-29T03:48:10.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12900000 2015-11-29T03:48:10.652-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7390000 QueuedCount 50000 2015-11-29T03:48:10.68-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:10.695-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12910000 2015-11-29T03:48:10.782-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7400000 QueuedCount 50000 2015-11-29T03:48:10.817-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12920000 2015-11-29T03:48:11.565-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:11.612-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7410000 QueuedCount 50000 2015-11-29T03:48:11.718-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12930000 2015-11-29T03:48:11.835-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7420000 QueuedCount 50000 2015-11-29T03:48:11.992-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12940000 2015-11-29T03:48:12.062-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7430000 QueuedCount 50000 2015-11-29T03:48:12.172-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:12.236-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12950000 2015-11-29T03:48:12.286-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7440000 QueuedCount 50000 2015-11-29T03:48:13.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12960000 2015-11-29T03:48:13.586-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7450000 QueuedCount 50000 2015-11-29T03:48:13.794-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:13.808-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7460000 QueuedCount 49280 2015-11-29T03:48:13.867-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12970000 2015-11-29T03:48:14.021-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12980000 2015-11-29T03:48:14.032-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7470000 QueuedCount 50000 2015-11-29T03:48:14.261-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7480000 QueuedCount 48027 2015-11-29T03:48:15.178-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7490000 QueuedCount 38027 2015-11-29T03:48:15.278-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7500000 QueuedCount 28027 2015-11-29T03:48:15.381-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7510000 QueuedCount 18027 2015-11-29T03:48:15.488-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7520000 QueuedCount 8027 2015-11-29T03:48:16.302-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.647µs CommitTime 191.283003ms TotalFlushTime 4m2.332199247s TotalCommitTime 32.774025343s 2015-11-29T03:48:16.303-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3783476, 3783476, 53 committed:true 2015-11-29T03:48:16.303-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3783476, 3783476, 53 committed:true) SnapCreateDur 201.370794ms SnapOpenDur 48.55µs 2015-11-29T03:48:16.339-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:16.376-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:16.402-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12990000 2015-11-29T03:48:16.409-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:16.476-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13000000 2015-11-29T03:48:16.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13010000 2015-11-29T03:48:16.621-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13020000 2015-11-29T03:48:16.697-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13030000 2015-11-29T03:48:16.835-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13040000 2015-11-29T03:48:16.887-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7530000 QueuedCount 49999 2015-11-29T03:48:17.134-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.906133% blocked 2015-11-29T03:48:17.256-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13050000 2015-11-29T03:48:17.27-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7540000 QueuedCount 50000 2015-11-29T03:48:17.305-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:17.497-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7550000 QueuedCount 50000 2015-11-29T03:48:17.563-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13060000 2015-11-29T03:48:17.734-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:17.762-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7560000 QueuedCount 50000 2015-11-29T03:48:17.955-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13070000 2015-11-29T03:48:18.944-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7570000 QueuedCount 50000 2015-11-29T03:48:18.962-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.905538% blocked 2015-11-29T03:48:19.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:19.055-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.906446% blocked 2015-11-29T03:48:19.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13080000 2015-11-29T03:48:19.068-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7580000 QueuedCount 50000 2015-11-29T03:48:19.247-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13090000 2015-11-29T03:48:19.255-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7590000 QueuedCount 50000 2015-11-29T03:48:19.473-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7600000 QueuedCount 46063 2015-11-29T03:48:19.67-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7610000 QueuedCount 36063 2015-11-29T03:48:20.442-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7620000 QueuedCount 26063 2015-11-29T03:48:20.541-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7630000 QueuedCount 16063 2015-11-29T03:48:20.645-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7640000 QueuedCount 6063 2015-11-29T03:48:21.325-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.196µs CommitTime 584.984438ms TotalFlushTime 4m6.492627831s TotalCommitTime 33.359009781s 2015-11-29T03:48:21.325-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3841556, 3841556, 54 committed:true 2015-11-29T03:48:21.325-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3841556, 3841556, 54 committed:true) SnapCreateDur 602.438626ms SnapOpenDur 49.179µs 2015-11-29T03:48:21.363-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:21.366-08:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.914078% blocked 2015-11-29T03:48:21.386-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13100000 2015-11-29T03:48:21.4-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:21.437-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:21.451-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7650000 QueuedCount 48030 2015-11-29T03:48:21.463-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13110000 2015-11-29T03:48:21.524-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13120000 2015-11-29T03:48:21.587-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13130000 2015-11-29T03:48:21.65-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13140000 2015-11-29T03:48:21.652-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7660000 QueuedCount 50000 2015-11-29T03:48:21.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13150000 2015-11-29T03:48:21.778-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13160000 2015-11-29T03:48:21.779-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:21.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13170000 2015-11-29T03:48:21.865-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7670000 QueuedCount 50000 2015-11-29T03:48:21.921-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13180000 2015-11-29T03:48:21.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13190000 2015-11-29T03:48:22.058-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13200000 2015-11-29T03:48:22.088-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7680000 QueuedCount 50000 2015-11-29T03:48:22.128-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13210000 2015-11-29T03:48:22.184-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:22.199-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13220000 2015-11-29T03:48:22.273-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13230000 2015-11-29T03:48:22.353-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13240000 2015-11-29T03:48:22.432-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13250000 2015-11-29T03:48:22.511-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13260000 2015-11-29T03:48:23.34-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7690000 QueuedCount 50000 2015-11-29T03:48:23.585-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7700000 QueuedCount 50000 2015-11-29T03:48:23.599-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:23.64-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13270000 2015-11-29T03:48:23.704-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13280000 2015-11-29T03:48:23.738-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7710000 QueuedCount 50000 2015-11-29T03:48:23.774-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13290000 2015-11-29T03:48:23.842-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13300000 2015-11-29T03:48:23.875-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:23.914-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13310000 2015-11-29T03:48:23.956-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7720000 QueuedCount 50000 2015-11-29T03:48:23.981-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13320000 2015-11-29T03:48:24.05-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13330000 2015-11-29T03:48:24.121-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13340000 2015-11-29T03:48:24.204-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13350000 2015-11-29T03:48:24.297-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13360000 2015-11-29T03:48:24.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13370000 2015-11-29T03:48:25.042-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7730000 QueuedCount 50000 2015-11-29T03:48:25.06-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:25.213-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7740000 QueuedCount 50000 2015-11-29T03:48:25.438-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7750000 QueuedCount 48322 2015-11-29T03:48:25.638-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7760000 QueuedCount 38322 2015-11-29T03:48:25.834-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7770000 QueuedCount 28322 2015-11-29T03:48:26.958-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7780000 QueuedCount 18322 2015-11-29T03:48:27.068-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7790000 QueuedCount 8322 2015-11-29T03:48:28.051-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.403µs CommitTime 860.076493ms TotalFlushTime 4m12.002506231s TotalCommitTime 34.219086274s 2015-11-29T03:48:28.051-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3916981, 3916981, 55 committed:true 2015-11-29T03:48:28.051-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3916981, 3916981, 55 committed:true) SnapCreateDur 886.563514ms SnapOpenDur 58.421µs 2015-11-29T03:48:28.092-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:28.115-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7800000 QueuedCount 21538 2015-11-29T03:48:28.128-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:28.165-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:28.215-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13380000 2015-11-29T03:48:28.282-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13390000 2015-11-29T03:48:28.361-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13400000 2015-11-29T03:48:28.441-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13410000 2015-11-29T03:48:29.17-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7810000 QueuedCount 50000 2015-11-29T03:48:29.375-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:29.491-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7820000 QueuedCount 50000 2015-11-29T03:48:29.728-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7830000 QueuedCount 50000 2015-11-29T03:48:29.766-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:30.02-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7840000 QueuedCount 50000 2015-11-29T03:48:31.08-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:31.115-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7850000 QueuedCount 50000 2015-11-29T03:48:31.348-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7860000 QueuedCount 50000 2015-11-29T03:48:31.569-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7870000 QueuedCount 46662 2015-11-29T03:48:31.782-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7880000 QueuedCount 36662 2015-11-29T03:48:32.706-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7890000 QueuedCount 26662 2015-11-29T03:48:32.808-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7900000 QueuedCount 16662 2015-11-29T03:48:32.912-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7910000 QueuedCount 6662 2015-11-29T03:48:33.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 924 2015-11-29T03:48:33.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 924 2015-11-29T03:48:33.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 924 2015-11-29T03:48:33.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 924 2015-11-29T03:48:33.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 924 2015-11-29T03:48:33.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 924 2015-11-29T03:48:33.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 924 2015-11-29T03:48:33.678-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.921µs CommitTime 674.37574ms TotalFlushTime 4m16.630412843s TotalCommitTime 34.893462014s 2015-11-29T03:48:33.678-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 3975454, 3975454, 56 committed:true 2015-11-29T03:48:33.678-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 3975454, 3975454, 56 committed:true) SnapCreateDur 687.011338ms SnapOpenDur 45.635µs 2015-11-29T03:48:33.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 924 2015-11-29T03:48:33.715-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:33.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 924 2015-11-29T03:48:33.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:33.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 924 2015-11-29T03:48:33.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 924 2015-11-29T03:48:33.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 924 2015-11-29T03:48:33.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 924 2015-11-29T03:48:33.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 924 2015-11-29T03:48:33.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 924 2015-11-29T03:48:33.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 924 2015-11-29T03:48:33.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 924 2015-11-29T03:48:33.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 924 2015-11-29T03:48:34.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 924 2015-11-29T03:48:34.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 924 2015-11-29T03:48:34.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 924 2015-11-29T03:48:34.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 924 2015-11-29T03:48:34.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 924 2015-11-29T03:48:34.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 924 2015-11-29T03:48:34.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 924 2015-11-29T03:48:34.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 924 2015-11-29T03:48:34.262-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7920000 QueuedCount 50000 2015-11-29T03:48:34.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 924 2015-11-29T03:48:34.284-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:34.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 924 2015-11-29T03:48:34.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 924 2015-11-29T03:48:34.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 924 2015-11-29T03:48:34.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 924 2015-11-29T03:48:34.743-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 924 2015-11-29T03:48:34.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 924 2015-11-29T03:48:34.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 924 2015-11-29T03:48:34.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 924 2015-11-29T03:48:34.816-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7930000 QueuedCount 50000 2015-11-29T03:48:34.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 924 2015-11-29T03:48:34.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 924 2015-11-29T03:48:34.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 924 2015-11-29T03:48:34.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 924 2015-11-29T03:48:34.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 924 2015-11-29T03:48:34.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 924 2015-11-29T03:48:34.992-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:35.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 924 2015-11-29T03:48:35.027-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7940000 QueuedCount 50000 2015-11-29T03:48:35.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 924 2015-11-29T03:48:35.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 924 2015-11-29T03:48:35.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 924 2015-11-29T03:48:35.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 924 2015-11-29T03:48:35.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 924 2015-11-29T03:48:35.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 924 2015-11-29T03:48:35.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 924 2015-11-29T03:48:35.242-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7950000 QueuedCount 50000 2015-11-29T03:48:35.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 924 2015-11-29T03:48:35.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 924 2015-11-29T03:48:35.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 924 2015-11-29T03:48:35.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 924 2015-11-29T03:48:35.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 924 2015-11-29T03:48:35.384-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:35.447-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13420000 2015-11-29T03:48:35.532-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13430000 2015-11-29T03:48:35.632-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13440000 2015-11-29T03:48:35.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13450000 2015-11-29T03:48:35.88-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13460000 2015-11-29T03:48:36.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13470000 2015-11-29T03:48:36.14-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13480000 2015-11-29T03:48:36.222-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7960000 QueuedCount 50000 2015-11-29T03:48:36.254-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13490000 2015-11-29T03:48:36.331-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7970000 QueuedCount 50000 2015-11-29T03:48:36.342-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13500000 2015-11-29T03:48:36.431-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13510000 2015-11-29T03:48:36.47-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7980000 QueuedCount 50000 2015-11-29T03:48:36.528-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13520000 2015-11-29T03:48:36.619-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:36.63-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13530000 2015-11-29T03:48:36.692-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 7990000 QueuedCount 50000 2015-11-29T03:48:36.722-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13540000 2015-11-29T03:48:36.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13550000 2015-11-29T03:48:37.911-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8000000 QueuedCount 49999 2015-11-29T03:48:38.046-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8010000 QueuedCount 50000 2015-11-29T03:48:38.176-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8020000 QueuedCount 44186 2015-11-29T03:48:38.289-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8030000 QueuedCount 34186 2015-11-29T03:48:38.402-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8040000 QueuedCount 24186 2015-11-29T03:48:39.109-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8050000 QueuedCount 14186 2015-11-29T03:48:39.21-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8060000 QueuedCount 4186 2015-11-29T03:48:40.206-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.937µs CommitTime 924.770215ms TotalFlushTime 4m21.938592708s TotalCommitTime 35.818232229s 2015-11-29T03:48:40.206-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4047962, 4047962, 57 committed:true 2015-11-29T03:48:40.206-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4047962, 4047962, 57 committed:true) SnapCreateDur 951.173128ms SnapOpenDur 97.347µs 2015-11-29T03:48:40.248-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:40.287-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:40.363-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:40.367-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8070000 QueuedCount 49751 2015-11-29T03:48:40.616-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8080000 QueuedCount 50000 2015-11-29T03:48:40.786-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:40.87-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8090000 QueuedCount 50000 2015-11-29T03:48:41.03-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13560000 2015-11-29T03:48:41.096-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8100000 QueuedCount 50000 2015-11-29T03:48:41.143-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:41.212-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13570000 2015-11-29T03:48:42.22-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8110000 QueuedCount 50000 2015-11-29T03:48:42.302-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13580000 2015-11-29T03:48:42.404-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:42.448-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8120000 QueuedCount 50000 2015-11-29T03:48:42.608-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13590000 2015-11-29T03:48:42.696-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8130000 QueuedCount 50000 2015-11-29T03:48:42.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13600000 2015-11-29T03:48:42.867-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13610000 2015-11-29T03:48:42.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8140000 QueuedCount 46414 2015-11-29T03:48:43.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8150000 QueuedCount 36414 2015-11-29T03:48:44.027-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8160000 QueuedCount 26414 2015-11-29T03:48:44.137-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8170000 QueuedCount 16414 2015-11-29T03:48:44.246-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8180000 QueuedCount 6414 2015-11-29T03:48:45.16-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.501µs CommitTime 829.596873ms TotalFlushTime 4m25.737965124s TotalCommitTime 36.647829102s 2015-11-29T03:48:45.16-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4108074, 4108074, 58 committed:true 2015-11-29T03:48:45.16-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4108074, 4108074, 58 committed:true) SnapCreateDur 842.364684ms SnapOpenDur 82.897µs 2015-11-29T03:48:45.201-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:45.24-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:45.26-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13620000 2015-11-29T03:48:45.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13630000 2015-11-29T03:48:45.412-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13640000 2015-11-29T03:48:45.485-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13650000 2015-11-29T03:48:46.132-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8190000 QueuedCount 50000 2015-11-29T03:48:46.257-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:46.347-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8200000 QueuedCount 50000 2015-11-29T03:48:46.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13660000 2015-11-29T03:48:46.58-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8210000 QueuedCount 50000 2015-11-29T03:48:46.674-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:46.7-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13670000 2015-11-29T03:48:46.803-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8220000 QueuedCount 50000 2015-11-29T03:48:46.941-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13680000 2015-11-29T03:48:47.974-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8230000 QueuedCount 50000 2015-11-29T03:48:47.981-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:48.079-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13690000 2015-11-29T03:48:48.105-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8240000 QueuedCount 50000 2015-11-29T03:48:48.301-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8250000 QueuedCount 46366 2015-11-29T03:48:48.513-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8260000 QueuedCount 36366 2015-11-29T03:48:49.378-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8270000 QueuedCount 26366 2015-11-29T03:48:49.478-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8280000 QueuedCount 16366 2015-11-29T03:48:49.581-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8290000 QueuedCount 6366 2015-11-29T03:48:50.508-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 17.593µs CommitTime 824.060128ms TotalFlushTime 4m29.988164121s TotalCommitTime 37.47188923s 2015-11-29T03:48:50.509-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4162088, 4162088, 59 committed:true 2015-11-29T03:48:50.509-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4162088, 4162088, 59 committed:true) SnapCreateDur 850.217325ms SnapOpenDur 61.49µs 2015-11-29T03:48:50.544-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:50.569-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13700000 2015-11-29T03:48:50.578-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:50.611-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8300000 QueuedCount 39191 2015-11-29T03:48:50.617-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:50.645-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13710000 2015-11-29T03:48:50.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13720000 2015-11-29T03:48:50.765-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13730000 2015-11-29T03:48:50.821-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8310000 QueuedCount 50000 2015-11-29T03:48:50.825-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13740000 2015-11-29T03:48:50.88-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:50.886-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13750000 2015-11-29T03:48:50.951-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13760000 2015-11-29T03:48:50.959-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8320000 QueuedCount 50000 2015-11-29T03:48:51.012-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13770000 2015-11-29T03:48:51.089-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:51.112-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8330000 QueuedCount 50000 2015-11-29T03:48:51.193-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13780000 2015-11-29T03:48:52.122-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8340000 QueuedCount 50000 2015-11-29T03:48:52.183-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:52.238-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8350000 QueuedCount 50000 2015-11-29T03:48:52.25-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13790000 2015-11-29T03:48:52.304-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13800000 2015-11-29T03:48:52.351-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8360000 QueuedCount 49999 2015-11-29T03:48:52.364-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:52.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13810000 2015-11-29T03:48:52.526-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8370000 QueuedCount 50000 2015-11-29T03:48:52.635-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:53.624-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8380000 QueuedCount 50000 2015-11-29T03:48:53.656-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13820000 2015-11-29T03:48:53.745-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8390000 QueuedCount 50000 2015-11-29T03:48:53.754-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:53.811-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13830000 2015-11-29T03:48:53.863-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8400000 QueuedCount 50000 2015-11-29T03:48:53.904-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13840000 2015-11-29T03:48:54.014-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8410000 QueuedCount 46604 2015-11-29T03:48:54.224-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8420000 QueuedCount 36604 2015-11-29T03:48:55.163-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8430000 QueuedCount 26604 2015-11-29T03:48:55.272-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8440000 QueuedCount 16604 2015-11-29T03:48:55.378-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8450000 QueuedCount 6604 2015-11-29T03:48:56.552-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 9.033µs CommitTime 1.070759408s TotalFlushTime 4m34.646429279s TotalCommitTime 38.542648638s 2015-11-29T03:48:56.552-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4241494, 4241494, 60 committed:true 2015-11-29T03:48:56.552-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4241494, 4241494, 60 committed:true) SnapCreateDur 1.096576204s SnapOpenDur 73.15µs 2015-11-29T03:48:56.587-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:56.615-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13850000 2015-11-29T03:48:56.623-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:56.667-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8460000 QueuedCount 50000 2015-11-29T03:48:56.686-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13860000 2015-11-29T03:48:56.707-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:56.75-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13870000 2015-11-29T03:48:56.792-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8470000 QueuedCount 50000 2015-11-29T03:48:56.81-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13880000 2015-11-29T03:48:56.868-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13890000 2015-11-29T03:48:56.911-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8480000 QueuedCount 50000 2015-11-29T03:48:56.926-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13900000 2015-11-29T03:48:56.985-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13910000 2015-11-29T03:48:57.032-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8490000 QueuedCount 50000 2015-11-29T03:48:57.044-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13920000 2015-11-29T03:48:57.063-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:57.17-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13930000 2015-11-29T03:48:58.065-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8500000 QueuedCount 50000 2015-11-29T03:48:58.186-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8510000 QueuedCount 50000 2015-11-29T03:48:58.193-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13940000 2015-11-29T03:48:58.29-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:58.3-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8520000 QueuedCount 49034 2015-11-29T03:48:58.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13950000 2015-11-29T03:48:58.419-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8530000 QueuedCount 49999 2015-11-29T03:48:58.5-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13960000 2015-11-29T03:48:58.527-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:58.536-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8540000 QueuedCount 49152 2015-11-29T03:48:59.165-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13970000 2015-11-29T03:48:59.209-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8550000 QueuedCount 50000 2015-11-29T03:48:59.253-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13980000 2015-11-29T03:48:59.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:48:59.378-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8560000 QueuedCount 50000 2015-11-29T03:48:59.613-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8570000 QueuedCount 50000 2015-11-29T03:48:59.839-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8580000 QueuedCount 43006 2015-11-29T03:49:00.739-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8590000 QueuedCount 33006 2015-11-29T03:49:00.85-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8600000 QueuedCount 23006 2015-11-29T03:49:00.962-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8610000 QueuedCount 13006 2015-11-29T03:49:01.072-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8620000 QueuedCount 3006 2015-11-29T03:49:01.863-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 16.653µs CommitTime 177.534191ms TotalFlushTime 4m39.47799828s TotalCommitTime 38.720182829s 2015-11-29T03:49:01.863-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4323432, 4323432, 61 committed:true 2015-11-29T03:49:01.863-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4323432, 4323432, 61 committed:true) SnapCreateDur 190.197686ms SnapOpenDur 46.604µs 2015-11-29T03:49:01.898-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:01.926-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13990000 2015-11-29T03:49:01.934-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:01.969-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:02.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14000000 2015-11-29T03:49:02.065-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14010000 2015-11-29T03:49:02.076-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8630000 QueuedCount 50000 2015-11-29T03:49:02.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14020000 2015-11-29T03:49:02.177-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14030000 2015-11-29T03:49:02.232-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14040000 2015-11-29T03:49:02.262-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:02.273-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8640000 QueuedCount 49421 2015-11-29T03:49:02.296-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14050000 2015-11-29T03:49:02.364-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14060000 2015-11-29T03:49:02.46-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14070000 2015-11-29T03:49:02.515-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8650000 QueuedCount 50000 2015-11-29T03:49:02.672-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14080000 2015-11-29T03:49:02.736-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8660000 QueuedCount 50000 2015-11-29T03:49:02.768-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:03.663-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14090000 2015-11-29T03:49:03.705-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8670000 QueuedCount 50000 2015-11-29T03:49:03.781-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14100000 2015-11-29T03:49:03.814-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8680000 QueuedCount 50000 2015-11-29T03:49:03.825-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:03.93-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14110000 2015-11-29T03:49:03.932-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8690000 QueuedCount 50000 2015-11-29T03:49:04.114-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:04.164-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8700000 QueuedCount 50000 2015-11-29T03:49:04.2-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14120000 2015-11-29T03:49:04.288-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:04.333-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:05.375-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8710000 QueuedCount 50000 2015-11-29T03:49:05.385-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14130000 2015-11-29T03:49:05.499-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8720000 QueuedCount 46357 2015-11-29T03:49:05.616-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8730000 QueuedCount 36357 2015-11-29T03:49:05.73-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8740000 QueuedCount 26357 2015-11-29T03:49:06.438-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8750000 QueuedCount 16357 2015-11-29T03:49:06.535-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8760000 QueuedCount 6357 2015-11-29T03:49:07.014-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.08µs CommitTime 394.218131ms TotalFlushTime 4m43.934906322s TotalCommitTime 39.11440096s 2015-11-29T03:49:07.014-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4393946, 4393946, 62 committed:true 2015-11-29T03:49:07.014-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4393946, 4393946, 62 committed:true) SnapCreateDur 407.049605ms SnapOpenDur 47.593µs 2015-11-29T03:49:07.046-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:07.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:07.071-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8770000 QueuedCount 7538 2015-11-29T03:49:07.071-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14140000 2015-11-29T03:49:07.113-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:07.15-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14150000 2015-11-29T03:49:07.184-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8780000 QueuedCount 50000 2015-11-29T03:49:07.213-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14160000 2015-11-29T03:49:07.269-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:07.277-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14170000 2015-11-29T03:49:07.343-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14180000 2015-11-29T03:49:07.384-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8790000 QueuedCount 50000 2015-11-29T03:49:07.406-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14190000 2015-11-29T03:49:07.451-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5341337569,"bucket-1:by_email_0:avg_ts_items_count":148350,"bucket-1:by_email_0:build_progress":43,"bucket-1:by_email_0:data_size":1353054789,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":4662304768,"bucket-1:by_email_0:flush_queue_size":50038,"bucket-1:by_email_0:frag_percent":70,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":433863264,"bucket-1:by_email_0:items_count":4323432,"bucket-1:by_email_0:num_commits":62,"bucket-1:by_email_0:num_compactions":3,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":8711139,"bucket-1:by_email_0:num_docs_pending":5910165,"bucket-1:by_email_0:num_docs_queued":5378696,"bucket-1:by_email_0:num_flush_queued":8843257,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":62,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":5151412194,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"62 39114400960 -7391948774239944662","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"8793221 87994428868 6371165475722561640","bucket-1:by_email_0:timings/storage_handle_open":"62 5512692310 -6534103800890110382","bucket-1:by_email_0:timings/storage_info":"249 6339739 1502981392107","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"64 430595952 158320685191000872","bucket-1:by_email_0:timings/storage_meta_set":"62 37607268 26128511007814","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"8814446 185639325795 -2589298230874402025","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5353613,"bucket-1:num_mutations_queued":14196837,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":418,"memory_quota":104857600000,"memory_used":3034931200,"needs_restart":false,"num_connections":0,"timings/stats_response":"1653 266408089 687350960636565"} 2015-11-29T03:49:07.472-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14200000 2015-11-29T03:49:07.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14210000 2015-11-29T03:49:07.593-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8800000 QueuedCount 50000 2015-11-29T03:49:07.607-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14220000 2015-11-29T03:49:07.749-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:07.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14230000 2015-11-29T03:49:08.54-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8810000 QueuedCount 50000 2015-11-29T03:49:08.585-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14240000 2015-11-29T03:49:08.588-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:08.638-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:08.651-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8820000 QueuedCount 48758 2015-11-29T03:49:08.767-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8830000 QueuedCount 50000 2015-11-29T03:49:08.913-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:09.001-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8840000 QueuedCount 50000 2015-11-29T03:49:09.116-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:09.188-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14250000 2015-11-29T03:49:10.213-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:10.237-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8850000 QueuedCount 49999 2015-11-29T03:49:10.331-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14260000 2015-11-29T03:49:10.386-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8860000 QueuedCount 49555 2015-11-29T03:49:10.431-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14270000 2015-11-29T03:49:10.602-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8870000 QueuedCount 39555 2015-11-29T03:49:10.805-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8880000 QueuedCount 29555 2015-11-29T03:49:11.007-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8890000 QueuedCount 19555 2015-11-29T03:49:11.832-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8900000 QueuedCount 9555 2015-11-29T03:49:12.436-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.325µs CommitTime 485.711772ms TotalFlushTime 4m48.581763395s TotalCommitTime 39.600112732s 2015-11-29T03:49:12.436-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4464652, 4464652, 63 committed:true 2015-11-29T03:49:12.436-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4464652, 4464652, 63 committed:true) SnapCreateDur 498.415929ms SnapOpenDur 52.49µs 2015-11-29T03:49:12.473-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:12.473-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8910000 QueuedCount 16006 2015-11-29T03:49:12.52-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14280000 2015-11-29T03:49:12.522-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:12.588-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14290000 2015-11-29T03:49:12.65-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14300000 2015-11-29T03:49:12.694-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8920000 QueuedCount 50000 2015-11-29T03:49:12.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14310000 2015-11-29T03:49:12.776-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14320000 2015-11-29T03:49:12.84-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14330000 2015-11-29T03:49:12.903-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14340000 2015-11-29T03:49:12.909-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8930000 QueuedCount 50000 2015-11-29T03:49:12.988-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:13.15-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8940000 QueuedCount 50000 2015-11-29T03:49:13.175-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:13.207-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14350000 2015-11-29T03:49:13.376-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:13.459-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8950000 QueuedCount 49999 2015-11-29T03:49:13.483-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14360000 2015-11-29T03:49:13.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:14.938-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:14.993-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8960000 QueuedCount 50000 2015-11-29T03:49:15.017-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14370000 2015-11-29T03:49:15.123-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:15.132-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8970000 QueuedCount 49332 2015-11-29T03:49:15.171-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14380000 2015-11-29T03:49:15.324-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8980000 QueuedCount 50000 2015-11-29T03:49:15.371-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:15.539-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 8990000 QueuedCount 42887 2015-11-29T03:49:16.589-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9000000 QueuedCount 32887 2015-11-29T03:49:16.704-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9010000 QueuedCount 22887 2015-11-29T03:49:16.814-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9020000 QueuedCount 12887 2015-11-29T03:49:16.927-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9030000 QueuedCount 2887 2015-11-29T03:49:17.787-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.644µs CommitTime 201.777553ms TotalFlushTime 4m53.468172055s TotalCommitTime 39.801890285s 2015-11-29T03:49:17.788-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4526163, 4526163, 64 committed:true 2015-11-29T03:49:17.788-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4526163, 4526163, 64 committed:true) SnapCreateDur 214.776475ms SnapOpenDur 44.609µs 2015-11-29T03:49:17.82-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:17.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14390000 2015-11-29T03:49:17.857-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:17.88-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:17.912-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:17.926-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14400000 2015-11-29T03:49:17.975-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9040000 QueuedCount 50000 2015-11-29T03:49:18-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14410000 2015-11-29T03:49:18.058-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14420000 2015-11-29T03:49:18.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14430000 2015-11-29T03:49:18.182-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14440000 2015-11-29T03:49:18.185-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9050000 QueuedCount 50000 2015-11-29T03:49:18.245-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14450000 2015-11-29T03:49:18.304-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:18.326-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:18.408-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9060000 QueuedCount 50000 2015-11-29T03:49:18.679-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:18.713-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9070000 QueuedCount 50000 2015-11-29T03:49:19.967-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9080000 QueuedCount 49999 2015-11-29T03:49:20.1-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9090000 QueuedCount 50000 2015-11-29T03:49:20.256-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:20.316-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9100000 QueuedCount 50000 2015-11-29T03:49:20.526-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14460000 2015-11-29T03:49:20.553-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9110000 QueuedCount 50000 2015-11-29T03:49:20.633-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:21.633-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9120000 QueuedCount 45796 2015-11-29T03:49:21.743-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9130000 QueuedCount 35796 2015-11-29T03:49:21.857-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9140000 QueuedCount 25796 2015-11-29T03:49:21.968-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9150000 QueuedCount 15796 2015-11-29T03:49:22.715-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9160000 QueuedCount 5796 2015-11-29T03:49:23.1-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.688µs CommitTime 315.037716ms TotalFlushTime 4m58.153360151s TotalCommitTime 40.116928001s 2015-11-29T03:49:23.1-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4592053, 4592053, 65 committed:true 2015-11-29T03:49:23.1-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4592053, 4592053, 65 committed:true) SnapCreateDur 325.500165ms SnapOpenDur 44.16µs 2015-11-29T03:49:23.128-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.156-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.168-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9170000 QueuedCount 11770 2015-11-29T03:49:23.177-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14470000 2015-11-29T03:49:23.183-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.214-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.242-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.252-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14480000 2015-11-29T03:49:23.269-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.282-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9180000 QueuedCount 36320 2015-11-29T03:49:23.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.32-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.354-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14490000 2015-11-29T03:49:23.36-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.396-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9190000 QueuedCount 50000 2015-11-29T03:49:23.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14500000 2015-11-29T03:49:23.471-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:23.482-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14510000 2015-11-29T03:49:23.505-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9200000 QueuedCount 50000 2015-11-29T03:49:24.206-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14520000 2015-11-29T03:49:24.214-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9210000 QueuedCount 50000 2015-11-29T03:49:24.32-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14530000 2015-11-29T03:49:24.371-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9220000 QueuedCount 50000 2015-11-29T03:49:24.467-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14540000 2015-11-29T03:49:24.505-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:24.654-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9230000 QueuedCount 50000 2015-11-29T03:49:24.714-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14550000 2015-11-29T03:49:24.812-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14560000 2015-11-29T03:49:24.884-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9240000 QueuedCount 50000 2015-11-29T03:49:25.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14570000 2015-11-29T03:49:26.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9250000 QueuedCount 50000 2015-11-29T03:49:26.076-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:26.147-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14580000 2015-11-29T03:49:26.303-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9260000 QueuedCount 50000 2015-11-29T03:49:26.419-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14590000 2015-11-29T03:49:26.538-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9270000 QueuedCount 50000 2015-11-29T03:49:26.78-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9280000 QueuedCount 41779 2015-11-29T03:49:27.805-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9290000 QueuedCount 31779 2015-11-29T03:49:27.916-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9300000 QueuedCount 21779 2015-11-29T03:49:28.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9310000 QueuedCount 11779 2015-11-29T03:49:28.305-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9320000 QueuedCount 1779 2015-11-29T03:49:29.51-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 13.747µs CommitTime 1.149998988s TotalFlushTime 5m3.075330404s TotalCommitTime 41.266926989s 2015-11-29T03:49:29.511-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4670369, 4670369, 66 committed:true 2015-11-29T03:49:29.511-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4670369, 4670369, 66 committed:true) SnapCreateDur 1.176114278s SnapOpenDur 44.802µs 2015-11-29T03:49:29.537-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.563-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14600000 2015-11-29T03:49:29.591-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.615-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.615-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9330000 QueuedCount 16953 2015-11-29T03:49:29.64-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.656-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14610000 2015-11-29T03:49:29.668-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.695-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.721-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9340000 QueuedCount 35786 2015-11-29T03:49:29.721-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.733-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14620000 2015-11-29T03:49:29.798-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14630000 2015-11-29T03:49:29.828-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9350000 QueuedCount 50000 2015-11-29T03:49:29.838-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:29.861-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14640000 2015-11-29T03:49:29.914-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14650000 2015-11-29T03:49:29.931-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9360000 QueuedCount 50000 2015-11-29T03:49:29.973-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14660000 2015-11-29T03:49:30.058-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14670000 2015-11-29T03:49:30.141-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14680000 2015-11-29T03:49:30.223-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14690000 2015-11-29T03:49:30.307-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14700000 2015-11-29T03:49:30.392-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14710000 2015-11-29T03:49:30.474-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14720000 2015-11-29T03:49:30.553-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14730000 2015-11-29T03:49:30.568-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:30.606-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9370000 QueuedCount 50000 2015-11-29T03:49:30.618-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14740000 2015-11-29T03:49:30.647-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:30.67-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:30.72-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9380000 QueuedCount 50000 2015-11-29T03:49:30.72-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14750000 2015-11-29T03:49:30.769-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:30.787-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14760000 2015-11-29T03:49:30.86-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14770000 2015-11-29T03:49:30.947-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14780000 2015-11-29T03:49:30.95-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9390000 QueuedCount 50000 2015-11-29T03:49:31.021-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14790000 2015-11-29T03:49:31.081-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:31.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14800000 2015-11-29T03:49:31.183-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9400000 QueuedCount 50000 2015-11-29T03:49:32.085-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9410000 QueuedCount 41881 2015-11-29T03:49:32.191-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9420000 QueuedCount 31881 2015-11-29T03:49:32.299-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9430000 QueuedCount 21881 2015-11-29T03:49:32.41-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9440000 QueuedCount 11881 2015-11-29T03:49:33.137-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9450000 QueuedCount 1881 2015-11-29T03:49:33.438-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 15.493µs CommitTime 263.334059ms TotalFlushTime 5m6.556921983s TotalCommitTime 41.530261048s 2015-11-29T03:49:33.438-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4734610, 4734610, 67 committed:true 2015-11-29T03:49:33.438-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4734610, 4734610, 67 committed:true) SnapCreateDur 274.262353ms SnapOpenDur 47.23µs 2015-11-29T03:49:33.466-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:33.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:33.517-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:33.554-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:33.664-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9460000 QueuedCount 50000 2015-11-29T03:49:33.846-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:33.91-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9470000 QueuedCount 50000 2015-11-29T03:49:34.158-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9480000 QueuedCount 50000 2015-11-29T03:49:34.205-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:34.381-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:34.386-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9490000 QueuedCount 49765 2015-11-29T03:49:35.555-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9500000 QueuedCount 50000 2015-11-29T03:49:35.574-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:35.594-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:35.626-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:35.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9510000 QueuedCount 50000 2015-11-29T03:49:35.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:35.846-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9520000 QueuedCount 50000 2015-11-29T03:49:35.944-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:36.083-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9530000 QueuedCount 50000 2015-11-29T03:49:37.034-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:37.074-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14810000 2015-11-29T03:49:37.097-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9540000 QueuedCount 49545 2015-11-29T03:49:37.206-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9550000 QueuedCount 39545 2015-11-29T03:49:37.312-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9560000 QueuedCount 29545 2015-11-29T03:49:37.419-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9570000 QueuedCount 19545 2015-11-29T03:49:38.12-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9580000 QueuedCount 9545 2015-11-29T03:49:38.984-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 7.383µs CommitTime 745.960265ms TotalFlushTime 5m11.032145799s TotalCommitTime 42.276221313s 2015-11-29T03:49:38.985-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4802873, 4802873, 68 committed:true 2015-11-29T03:49:38.985-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4802873, 4802873, 68 committed:true) SnapCreateDur 772.085855ms SnapOpenDur 59.009µs 2015-11-29T03:49:39.006-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.014-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9590000 QueuedCount 335 2015-11-29T03:49:39.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.062-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.104-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14820000 2015-11-29T03:49:39.11-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.176-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14830000 2015-11-29T03:49:39.237-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14840000 2015-11-29T03:49:39.237-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9600000 QueuedCount 50000 2015-11-29T03:49:39.297-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14850000 2015-11-29T03:49:39.36-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14860000 2015-11-29T03:49:39.416-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.425-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14870000 2015-11-29T03:49:39.44-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9610000 QueuedCount 50000 2015-11-29T03:49:39.49-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14880000 2015-11-29T03:49:39.607-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.655-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9620000 QueuedCount 50000 2015-11-29T03:49:39.783-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.805-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:39.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14890000 2015-11-29T03:49:39.881-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9630000 QueuedCount 50000 2015-11-29T03:49:40.808-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:40.818-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9640000 QueuedCount 49013 2015-11-29T03:49:40.905-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14900000 2015-11-29T03:49:40.936-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9650000 QueuedCount 50000 2015-11-29T03:49:40.991-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:41.049-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9660000 QueuedCount 50000 2015-11-29T03:49:41.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14910000 2015-11-29T03:49:41.066-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:41.168-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9670000 QueuedCount 50000 2015-11-29T03:49:41.171-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14920000 2015-11-29T03:49:41.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14930000 2015-11-29T03:49:41.872-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9680000 QueuedCount 50000 2015-11-29T03:49:41.888-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:41.942-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14940000 2015-11-29T03:49:41.973-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9690000 QueuedCount 50000 2015-11-29T03:49:42.061-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14950000 2015-11-29T03:49:42.122-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9700000 QueuedCount 50000 2015-11-29T03:49:42.284-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:42.349-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9710000 QueuedCount 50000 2015-11-29T03:49:42.394-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14960000 2015-11-29T03:49:43.216-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9720000 QueuedCount 50000 2015-11-29T03:49:43.277-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14970000 2015-11-29T03:49:43.448-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9730000 QueuedCount 50000 2015-11-29T03:49:43.677-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9740000 QueuedCount 42352 2015-11-29T03:49:43.893-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9750000 QueuedCount 32352 2015-11-29T03:49:44.83-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9760000 QueuedCount 22352 2015-11-29T03:49:44.933-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9770000 QueuedCount 12352 2015-11-29T03:49:45.055-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9780000 QueuedCount 2352 2015-11-29T03:49:45.758-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.677µs CommitTime 656.445974ms TotalFlushTime 5m16.758681957s TotalCommitTime 42.932667287s 2015-11-29T03:49:45.758-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4898672, 4898672, 69 committed:true 2015-11-29T03:49:45.758-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4898672, 4898672, 69 committed:true) SnapCreateDur 669.559436ms SnapOpenDur 40.15µs 2015-11-29T03:49:45.801-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.834-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.841-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14980000 2015-11-29T03:49:45.858-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.884-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.911-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14990000 2015-11-29T03:49:45.934-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:45.967-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9790000 QueuedCount 50000 2015-11-29T03:49:45.99-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15000000 2015-11-29T03:49:46.055-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15010000 2015-11-29T03:49:46.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15020000 2015-11-29T03:49:46.155-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9800000 QueuedCount 50000 2015-11-29T03:49:46.189-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:46.218-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15030000 2015-11-29T03:49:46.31-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9810000 QueuedCount 50000 2015-11-29T03:49:46.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15040000 2015-11-29T03:49:46.412-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9820000 QueuedCount 50000 2015-11-29T03:49:46.428-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15050000 2015-11-29T03:49:47.029-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:47.032-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15060000 2015-11-29T03:49:47.079-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9830000 QueuedCount 50000 2015-11-29T03:49:47.278-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15070000 2015-11-29T03:49:47.297-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9840000 QueuedCount 50000 2015-11-29T03:49:47.476-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:47.545-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9850000 QueuedCount 50000 2015-11-29T03:49:47.783-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9860000 QueuedCount 45571 2015-11-29T03:49:48.758-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9870000 QueuedCount 35571 2015-11-29T03:49:48.861-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9880000 QueuedCount 25571 2015-11-29T03:49:48.969-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9890000 QueuedCount 15571 2015-11-29T03:49:49.077-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9900000 QueuedCount 5571 2015-11-29T03:49:50.174-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 24.031µs CommitTime 419.313178ms TotalFlushTime 5m20.480136445s TotalCommitTime 43.351980465s 2015-11-29T03:49:50.175-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 4960212, 4960212, 70 committed:true 2015-11-29T03:49:50.175-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 4960212, 4960212, 70 committed:true) SnapCreateDur 445.732591ms SnapOpenDur 73.422µs 2015-11-29T03:49:50.202-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.223-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.247-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.278-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.286-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9910000 QueuedCount 16833 2015-11-29T03:49:50.307-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15080000 2015-11-29T03:49:50.332-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.367-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.405-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15090000 2015-11-29T03:49:50.471-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15100000 2015-11-29T03:49:50.503-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9920000 QueuedCount 50000 2015-11-29T03:49:50.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15110000 2015-11-29T03:49:50.606-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15120000 2015-11-29T03:49:50.68-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15130000 2015-11-29T03:49:50.721-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9930000 QueuedCount 50000 2015-11-29T03:49:50.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15140000 2015-11-29T03:49:50.807-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15150000 2015-11-29T03:49:50.823-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:50.876-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15160000 2015-11-29T03:49:50.931-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9940000 QueuedCount 50000 2015-11-29T03:49:50.94-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15170000 2015-11-29T03:49:51.002-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15180000 2015-11-29T03:49:51.066-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15190000 2015-11-29T03:49:51.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15200000 2015-11-29T03:49:51.246-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15210000 2015-11-29T03:49:51.339-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15220000 2015-11-29T03:49:51.846-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9950000 QueuedCount 49999 2015-11-29T03:49:51.966-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:52.036-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9960000 QueuedCount 50000 2015-11-29T03:49:52.1-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:52.154-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:52.26-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9970000 QueuedCount 50000 2015-11-29T03:49:52.364-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:52.492-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9980000 QueuedCount 50000 2015-11-29T03:49:52.555-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:53.666-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 9990000 QueuedCount 48170 2015-11-29T03:49:53.77-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10000000 QueuedCount 38170 2015-11-29T03:49:53.878-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10010000 QueuedCount 28170 2015-11-29T03:49:53.996-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10020000 QueuedCount 18170 2015-11-29T03:49:54.739-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10030000 QueuedCount 8170 2015-11-29T03:49:55.131-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.742µs CommitTime 306.45359ms TotalFlushTime 5m24.845217193s TotalCommitTime 43.658434055s 2015-11-29T03:49:55.131-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5025996, 5025996, 71 committed:true 2015-11-29T03:49:55.131-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5025996, 5025996, 71 committed:true) SnapCreateDur 317.040608ms SnapOpenDur 41.991µs 2015-11-29T03:49:55.161-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.185-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.193-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10040000 QueuedCount 8983 2015-11-29T03:49:55.214-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.251-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.278-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.326-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15230000 2015-11-29T03:49:55.386-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15240000 2015-11-29T03:49:55.407-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10050000 QueuedCount 50000 2015-11-29T03:49:55.444-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:55.51-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15250000 2015-11-29T03:49:55.626-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10060000 QueuedCount 50000 2015-11-29T03:49:55.636-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15260000 2015-11-29T03:49:55.79-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15270000 2015-11-29T03:49:55.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15280000 2015-11-29T03:49:55.881-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10070000 QueuedCount 50000 2015-11-29T03:49:55.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15290000 2015-11-29T03:49:55.984-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15300000 2015-11-29T03:49:56.048-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15310000 2015-11-29T03:49:56.1-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:56.118-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15320000 2015-11-29T03:49:56.121-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:56.209-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15330000 2015-11-29T03:49:56.296-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15340000 2015-11-29T03:49:56.377-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15350000 2015-11-29T03:49:56.461-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15360000 2015-11-29T03:49:56.549-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15370000 2015-11-29T03:49:56.638-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15380000 2015-11-29T03:49:57.295-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10080000 QueuedCount 50000 2015-11-29T03:49:57.37-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:57.391-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:57.512-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:57.521-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10090000 QueuedCount 49540 2015-11-29T03:49:57.756-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10100000 QueuedCount 50000 2015-11-29T03:49:57.994-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10110000 QueuedCount 50000 2015-11-29T03:49:58.041-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:49:58.216-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10120000 QueuedCount 42427 2015-11-29T03:49:59.211-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10130000 QueuedCount 32427 2015-11-29T03:49:59.318-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10140000 QueuedCount 22427 2015-11-29T03:49:59.491-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10150000 QueuedCount 12427 2015-11-29T03:49:59.609-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10160000 QueuedCount 2427 2015-11-29T03:50:01.036-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 11.636µs CommitTime 456.438264ms TotalFlushTime 5m29.974730503s TotalCommitTime 44.114872319s 2015-11-29T03:50:01.037-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5088031, 5088031, 72 committed:true 2015-11-29T03:50:01.037-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5088031, 5088031, 72 committed:true) SnapCreateDur 483.339777ms SnapOpenDur 134.31µs 2015-11-29T03:50:01.058-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:01.084-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:01.11-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:01.14-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:01.172-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:01.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 903 2015-11-29T03:50:01.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 903 2015-11-29T03:50:01.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 903 2015-11-29T03:50:01.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 903 2015-11-29T03:50:01.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 903 2015-11-29T03:50:01.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 903 2015-11-29T03:50:01.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 903 2015-11-29T03:50:01.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 903 2015-11-29T03:50:01.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 903 2015-11-29T03:50:01.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 903 2015-11-29T03:50:01.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 903 2015-11-29T03:50:02.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 903 2015-11-29T03:50:02.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 903 2015-11-29T03:50:02.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 903 2015-11-29T03:50:02.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 903 2015-11-29T03:50:02.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 903 2015-11-29T03:50:02.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 903 2015-11-29T03:50:02.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 903 2015-11-29T03:50:02.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 903 2015-11-29T03:50:02.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 903 2015-11-29T03:50:02.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 903 2015-11-29T03:50:02.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 903 2015-11-29T03:50:02.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 903 2015-11-29T03:50:02.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 903 2015-11-29T03:50:02.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 903 2015-11-29T03:50:02.44-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10170000 QueuedCount 50000 2015-11-29T03:50:02.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 903 2015-11-29T03:50:02.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 903 2015-11-29T03:50:02.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 903 2015-11-29T03:50:02.535-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:02.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 903 2015-11-29T03:50:02.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 903 2015-11-29T03:50:02.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 903 2015-11-29T03:50:02.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 903 2015-11-29T03:50:02.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 903 2015-11-29T03:50:02.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 903 2015-11-29T03:50:02.705-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10180000 QueuedCount 50000 2015-11-29T03:50:02.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 903 2015-11-29T03:50:02.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 903 2015-11-29T03:50:02.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 903 2015-11-29T03:50:02.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 903 2015-11-29T03:50:02.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 903 2015-11-29T03:50:02.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 903 2015-11-29T03:50:02.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 903 2015-11-29T03:50:02.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 903 2015-11-29T03:50:02.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 903 2015-11-29T03:50:02.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 903 2015-11-29T03:50:02.992-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10190000 QueuedCount 50000 2015-11-29T03:50:03.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 903 2015-11-29T03:50:03.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 903 2015-11-29T03:50:03.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 903 2015-11-29T03:50:03.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 903 2015-11-29T03:50:03.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 903 2015-11-29T03:50:03.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 903 2015-11-29T03:50:03.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 903 2015-11-29T03:50:03.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 903 2015-11-29T03:50:03.25-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10200000 QueuedCount 50000 2015-11-29T03:50:03.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 903 2015-11-29T03:50:03.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 903 2015-11-29T03:50:03.295-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:03.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 903 2015-11-29T03:50:03.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 903 2015-11-29T03:50:03.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 903 2015-11-29T03:50:03.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 903 2015-11-29T03:50:03.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 903 2015-11-29T03:50:03.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 903 2015-11-29T03:50:03.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 903 2015-11-29T03:50:03.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 903 2015-11-29T03:50:03.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 903 2015-11-29T03:50:03.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 903 2015-11-29T03:50:03.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 903 2015-11-29T03:50:03.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 903 2015-11-29T03:50:03.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 903 2015-11-29T03:50:03.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 903 2015-11-29T03:50:03.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 903 2015-11-29T03:50:03.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 903 2015-11-29T03:50:03.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 903 2015-11-29T03:50:03.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 903 2015-11-29T03:50:03.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 903 2015-11-29T03:50:03.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 903 2015-11-29T03:50:03.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 903 2015-11-29T03:50:03.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 903 2015-11-29T03:50:03.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 903 2015-11-29T03:50:04.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 903 2015-11-29T03:50:04.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 903 2015-11-29T03:50:04.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 903 2015-11-29T03:50:04.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 903 2015-11-29T03:50:04.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 903 2015-11-29T03:50:04.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 903 2015-11-29T03:50:04.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 903 2015-11-29T03:50:04.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 903 2015-11-29T03:50:04.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 903 2015-11-29T03:50:04.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 903 2015-11-29T03:50:04.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 903 2015-11-29T03:50:04.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 903 2015-11-29T03:50:04.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 903 2015-11-29T03:50:04.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 903 2015-11-29T03:50:04.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 903 2015-11-29T03:50:04.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 903 2015-11-29T03:50:04.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 903 2015-11-29T03:50:04.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 903 2015-11-29T03:50:04.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 903 2015-11-29T03:50:04.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 903 2015-11-29T03:50:04.587-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10210000 QueuedCount 50000 2015-11-29T03:50:04.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 903 2015-11-29T03:50:04.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 903 2015-11-29T03:50:04.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 903 2015-11-29T03:50:04.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 903 2015-11-29T03:50:04.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 903 2015-11-29T03:50:04.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 903 2015-11-29T03:50:04.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 903 2015-11-29T03:50:04.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 903 2015-11-29T03:50:04.824-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10220000 QueuedCount 50000 2015-11-29T03:50:04.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 903 2015-11-29T03:50:04.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 903 2015-11-29T03:50:04.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 903 2015-11-29T03:50:04.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 903 2015-11-29T03:50:04.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 903 2015-11-29T03:50:04.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 903 2015-11-29T03:50:05.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 903 2015-11-29T03:50:05.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 903 2015-11-29T03:50:05.069-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10230000 QueuedCount 50000 2015-11-29T03:50:05.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 903 2015-11-29T03:50:05.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 903 2015-11-29T03:50:05.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 903 2015-11-29T03:50:05.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 903 2015-11-29T03:50:05.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 903 2015-11-29T03:50:05.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 903 2015-11-29T03:50:05.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 903 2015-11-29T03:50:05.284-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10240000 QueuedCount 40380 2015-11-29T03:50:05.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 903 2015-11-29T03:50:05.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 903 2015-11-29T03:50:05.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 903 2015-11-29T03:50:05.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 903 2015-11-29T03:50:05.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 903 2015-11-29T03:50:05.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 903 2015-11-29T03:50:05.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 903 2015-11-29T03:50:05.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 903 2015-11-29T03:50:05.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 903 2015-11-29T03:50:05.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 903 2015-11-29T03:50:05.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 903 2015-11-29T03:50:05.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 903 2015-11-29T03:50:05.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 903 2015-11-29T03:50:05.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 903 2015-11-29T03:50:05.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 903 2015-11-29T03:50:05.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 903 2015-11-29T03:50:05.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 903 2015-11-29T03:50:05.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 903 2015-11-29T03:50:05.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 903 2015-11-29T03:50:05.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 903 2015-11-29T03:50:05.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 903 2015-11-29T03:50:05.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 903 2015-11-29T03:50:05.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 903 2015-11-29T03:50:05.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 903 2015-11-29T03:50:06.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 903 2015-11-29T03:50:06.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 903 2015-11-29T03:50:06.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 903 2015-11-29T03:50:06.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 903 2015-11-29T03:50:06.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 903 2015-11-29T03:50:06.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 903 2015-11-29T03:50:06.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 903 2015-11-29T03:50:06.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 903 2015-11-29T03:50:06.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 903 2015-11-29T03:50:06.264-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10250000 QueuedCount 30380 2015-11-29T03:50:06.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 903 2015-11-29T03:50:06.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 903 2015-11-29T03:50:06.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 903 2015-11-29T03:50:06.372-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10260000 QueuedCount 20380 2015-11-29T03:50:06.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 903 2015-11-29T03:50:06.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 903 2015-11-29T03:50:06.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 903 2015-11-29T03:50:06.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 903 2015-11-29T03:50:06.479-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10270000 QueuedCount 10380 2015-11-29T03:50:06.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 903 2015-11-29T03:50:06.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 903 2015-11-29T03:50:06.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 903 2015-11-29T03:50:06.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 903 2015-11-29T03:50:06.593-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10280000 QueuedCount 380 2015-11-29T03:50:06.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 903 2015-11-29T03:50:06.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 903 2015-11-29T03:50:06.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 903 2015-11-29T03:50:06.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 903 2015-11-29T03:50:06.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 903 2015-11-29T03:50:06.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 903 2015-11-29T03:50:06.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 903 2015-11-29T03:50:06.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 903 2015-11-29T03:50:06.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 903 2015-11-29T03:50:06.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 903 2015-11-29T03:50:06.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 903 2015-11-29T03:50:06.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 903 2015-11-29T03:50:06.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 903 2015-11-29T03:50:07.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 903 2015-11-29T03:50:07.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 903 2015-11-29T03:50:07.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 903 2015-11-29T03:50:07.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 903 2015-11-29T03:50:07.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 903 2015-11-29T03:50:07.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 903 2015-11-29T03:50:07.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 903 2015-11-29T03:50:07.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 903 2015-11-29T03:50:07.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 903 2015-11-29T03:50:07.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 903 2015-11-29T03:50:07.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 903 2015-11-29T03:50:07.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 903 2015-11-29T03:50:07.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 903 2015-11-29T03:50:07.372-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.227µs CommitTime 759.87ms TotalFlushTime 5m35.221503382s TotalCommitTime 44.874742319s 2015-11-29T03:50:07.372-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5146971, 5146971, 73 committed:true 2015-11-29T03:50:07.372-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5146971, 5146971, 73 committed:true) SnapCreateDur 772.691569ms SnapOpenDur 62.742µs 2015-11-29T03:50:07.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 903 2015-11-29T03:50:07.405-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:07.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 903 2015-11-29T03:50:07.444-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:07.451-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5914613597,"bucket-1:by_email_0:avg_ts_items_count":124641,"bucket-1:by_email_0:build_progress":51,"bucket-1:by_email_0:data_size":1594869511,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":6264176640,"bucket-1:by_email_0:flush_queue_size":29699,"bucket-1:by_email_0:frag_percent":74,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":511843089,"bucket-1:by_email_0:items_count":5088031,"bucket-1:by_email_0:num_commits":73,"bucket-1:by_email_0:num_compactions":3,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":10251818,"bucket-1:by_email_0:num_docs_pending":4614709,"bucket-1:by_email_0:num_docs_queued":5133473,"bucket-1:by_email_0:num_flush_queued":10312552,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":73,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":6335520151,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"73 44874742319 -3581373722801600207","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"10282856 102239738671 6371339086547247475","bucket-1:by_email_0:timings/storage_handle_open":"73 5513048380 -6534103788671600906","bucket-1:by_email_0:timings/storage_info":"293 7288988 1637976303266","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"75 435283466 158323028379651894","bucket-1:by_email_0:timings/storage_meta_set":"73 44029994 30558440803396","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"10296365 220734661349 290410705851308695","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":5072737,"bucket-1:num_mutations_queued":15385289,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":372,"memory_quota":104857600000,"memory_used":6361378816,"needs_restart":false,"num_connections":0,"timings/stats_response":"1725 292956034 697546165912762"} 2015-11-29T03:50:07.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 903 2015-11-29T03:50:07.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 903 2015-11-29T03:50:07.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 903 2015-11-29T03:50:07.527-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:07.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 903 2015-11-29T03:50:07.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 903 2015-11-29T03:50:07.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 903 2015-11-29T03:50:07.61-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10290000 QueuedCount 50000 2015-11-29T03:50:07.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 903 2015-11-29T03:50:07.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 903 2015-11-29T03:50:07.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 903 2015-11-29T03:50:07.723-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:07.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 903 2015-11-29T03:50:07.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 903 2015-11-29T03:50:07.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 903 2015-11-29T03:50:07.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 903 2015-11-29T03:50:07.832-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10300000 QueuedCount 50000 2015-11-29T03:50:07.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 903 2015-11-29T03:50:07.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 903 2015-11-29T03:50:07.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 903 2015-11-29T03:50:07.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 903 2015-11-29T03:50:07.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 903 2015-11-29T03:50:07.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 903 2015-11-29T03:50:08.01-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:08.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 903 2015-11-29T03:50:08.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 903 2015-11-29T03:50:08.059-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10310000 QueuedCount 50000 2015-11-29T03:50:08.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 903 2015-11-29T03:50:08.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 903 2015-11-29T03:50:08.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 903 2015-11-29T03:50:08.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 903 2015-11-29T03:50:08.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 903 2015-11-29T03:50:08.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 903 2015-11-29T03:50:08.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 903 2015-11-29T03:50:08.297-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10320000 QueuedCount 50000 2015-11-29T03:50:08.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 903 2015-11-29T03:50:08.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 903 2015-11-29T03:50:08.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 903 2015-11-29T03:50:08.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 903 2015-11-29T03:50:08.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 903 2015-11-29T03:50:08.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 903 2015-11-29T03:50:08.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 903 2015-11-29T03:50:08.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 903 2015-11-29T03:50:08.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 903 2015-11-29T03:50:08.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 903 2015-11-29T03:50:08.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 903 2015-11-29T03:50:08.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 903 2015-11-29T03:50:08.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 903 2015-11-29T03:50:08.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 903 2015-11-29T03:50:08.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 903 2015-11-29T03:50:08.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 903 2015-11-29T03:50:08.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 903 2015-11-29T03:50:08.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 903 2015-11-29T03:50:08.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 903 2015-11-29T03:50:08.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 903 2015-11-29T03:50:08.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 903 2015-11-29T03:50:08.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 903 2015-11-29T03:50:08.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 903 2015-11-29T03:50:08.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 903 2015-11-29T03:50:09.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 903 2015-11-29T03:50:09.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 903 2015-11-29T03:50:09.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 903 2015-11-29T03:50:09.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 903 2015-11-29T03:50:09.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 903 2015-11-29T03:50:09.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 903 2015-11-29T03:50:09.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 903 2015-11-29T03:50:09.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 903 2015-11-29T03:50:09.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 903 2015-11-29T03:50:09.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 903 2015-11-29T03:50:09.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 903 2015-11-29T03:50:09.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 903 2015-11-29T03:50:09.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 903 2015-11-29T03:50:09.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 903 2015-11-29T03:50:09.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 903 2015-11-29T03:50:09.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 903 2015-11-29T03:50:09.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 903 2015-11-29T03:50:09.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 903 2015-11-29T03:50:09.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 903 2015-11-29T03:50:09.583-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10330000 QueuedCount 50000 2015-11-29T03:50:09.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 903 2015-11-29T03:50:09.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 903 2015-11-29T03:50:09.648-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 903 2015-11-29T03:50:09.678-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 903 2015-11-29T03:50:09.708-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 903 2015-11-29T03:50:09.738-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 903 2015-11-29T03:50:09.768-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 903 2015-11-29T03:50:09.773-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:09.798-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 903 2015-11-29T03:50:09.812-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10340000 QueuedCount 50000 2015-11-29T03:50:09.828-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 903 2015-11-29T03:50:09.858-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 903 2015-11-29T03:50:09.888-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 903 2015-11-29T03:50:09.918-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 903 2015-11-29T03:50:09.948-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 903 2015-11-29T03:50:09.978-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 903 2015-11-29T03:50:10.008-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 903 2015-11-29T03:50:10.029-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10350000 QueuedCount 50000 2015-11-29T03:50:10.038-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 903 2015-11-29T03:50:10.068-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 903 2015-11-29T03:50:10.098-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 903 2015-11-29T03:50:10.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 903 2015-11-29T03:50:10.158-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 903 2015-11-29T03:50:10.173-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10360000 QueuedCount 50000 2015-11-29T03:50:10.188-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 903 2015-11-29T03:50:10.218-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 903 2015-11-29T03:50:10.248-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 903 2015-11-29T03:50:10.278-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 903 2015-11-29T03:50:10.308-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 903 2015-11-29T03:50:10.338-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 903 2015-11-29T03:50:10.368-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 903 2015-11-29T03:50:10.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 903 2015-11-29T03:50:10.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 903 2015-11-29T03:50:10.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 903 2015-11-29T03:50:10.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 903 2015-11-29T03:50:10.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 903 2015-11-29T03:50:10.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 903 2015-11-29T03:50:10.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 903 2015-11-29T03:50:10.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 903 2015-11-29T03:50:10.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 903 2015-11-29T03:50:10.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 903 2015-11-29T03:50:10.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 903 2015-11-29T03:50:10.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 903 2015-11-29T03:50:10.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 903 2015-11-29T03:50:10.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 903 2015-11-29T03:50:10.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 903 2015-11-29T03:50:10.838-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10370000 QueuedCount 45130 2015-11-29T03:50:10.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 903 2015-11-29T03:50:10.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 903 2015-11-29T03:50:10.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 903 2015-11-29T03:50:10.928-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10380000 QueuedCount 35130 2015-11-29T03:50:10.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 903 2015-11-29T03:50:10.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 903 2015-11-29T03:50:10.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 903 2015-11-29T03:50:11.02-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10390000 QueuedCount 25130 2015-11-29T03:50:11.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 903 2015-11-29T03:50:11.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 903 2015-11-29T03:50:11.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 903 2015-11-29T03:50:11.115-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10400000 QueuedCount 15130 2015-11-29T03:50:11.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 903 2015-11-29T03:50:11.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 903 2015-11-29T03:50:11.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 903 2015-11-29T03:50:11.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 903 2015-11-29T03:50:11.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 903 2015-11-29T03:50:11.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 903 2015-11-29T03:50:11.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 903 2015-11-29T03:50:11.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 903 2015-11-29T03:50:11.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 903 2015-11-29T03:50:11.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 903 2015-11-29T03:50:11.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 903 2015-11-29T03:50:11.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 903 2015-11-29T03:50:11.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 903 2015-11-29T03:50:11.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 903 2015-11-29T03:50:11.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 903 2015-11-29T03:50:11.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 903 2015-11-29T03:50:11.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 903 2015-11-29T03:50:11.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 903 2015-11-29T03:50:11.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 903 2015-11-29T03:50:11.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 903 2015-11-29T03:50:11.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 903 2015-11-29T03:50:11.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 903 2015-11-29T03:50:11.754-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10410000 QueuedCount 5130 2015-11-29T03:50:11.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 903 2015-11-29T03:50:11.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 903 2015-11-29T03:50:11.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 903 2015-11-29T03:50:11.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 903 2015-11-29T03:50:11.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 903 2015-11-29T03:50:11.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 903 2015-11-29T03:50:11.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 903 2015-11-29T03:50:11.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 903 2015-11-29T03:50:12.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 903 2015-11-29T03:50:12.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 903 2015-11-29T03:50:12.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 903 2015-11-29T03:50:12.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 903 2015-11-29T03:50:12.138-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 903 2015-11-29T03:50:12.168-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 903 2015-11-29T03:50:12.182-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.144µs CommitTime 366.61448ms TotalFlushTime 5m39.328649888s TotalCommitTime 45.241356799s 2015-11-29T03:50:12.182-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5214422, 5214422, 74 committed:true 2015-11-29T03:50:12.182-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5214422, 5214422, 74 committed:true) SnapCreateDur 377.21575ms SnapOpenDur 54.27µs 2015-11-29T03:50:12.198-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 903 2015-11-29T03:50:12.21-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.228-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 903 2015-11-29T03:50:12.235-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.258-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 903 2015-11-29T03:50:12.26-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.288-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 903 2015-11-29T03:50:12.289-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.305-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10420000 QueuedCount 20000 2015-11-29T03:50:12.318-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 903 2015-11-29T03:50:12.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.347-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.348-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 903 2015-11-29T03:50:12.378-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 903 2015-11-29T03:50:12.38-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.405-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.408-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 903 2015-11-29T03:50:12.438-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 903 2015-11-29T03:50:12.468-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 903 2015-11-29T03:50:12.498-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 903 2015-11-29T03:50:12.528-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 903 2015-11-29T03:50:12.528-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10430000 QueuedCount 50000 2015-11-29T03:50:12.558-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 903 2015-11-29T03:50:12.588-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 903 2015-11-29T03:50:12.618-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 903 2015-11-29T03:50:12.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:12.759-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10440000 QueuedCount 50000 2015-11-29T03:50:12.797-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15390000 2015-11-29T03:50:12.995-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10450000 QueuedCount 50000 2015-11-29T03:50:13.94-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10460000 QueuedCount 49999 2015-11-29T03:50:13.996-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:14.058-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10470000 QueuedCount 50000 2015-11-29T03:50:14.119-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15400000 2015-11-29T03:50:14.181-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10480000 QueuedCount 50000 2015-11-29T03:50:14.207-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15410000 2015-11-29T03:50:14.263-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15420000 2015-11-29T03:50:14.304-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10490000 QueuedCount 50000 2015-11-29T03:50:14.322-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15430000 2015-11-29T03:50:14.353-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:14.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15440000 2015-11-29T03:50:14.464-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15450000 2015-11-29T03:50:14.548-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15460000 2015-11-29T03:50:14.639-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15470000 2015-11-29T03:50:14.724-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15480000 2015-11-29T03:50:14.801-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15490000 2015-11-29T03:50:14.882-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15500000 2015-11-29T03:50:14.96-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15510000 2015-11-29T03:50:15.035-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15520000 2015-11-29T03:50:15.099-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15530000 2015-11-29T03:50:15.169-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15540000 2015-11-29T03:50:15.187-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10500000 QueuedCount 50000 2015-11-29T03:50:15.229-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15550000 2015-11-29T03:50:15.293-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15560000 2015-11-29T03:50:15.362-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15570000 2015-11-29T03:50:15.418-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10510000 QueuedCount 50000 2015-11-29T03:50:15.44-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15580000 2015-11-29T03:50:15.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15590000 2015-11-29T03:50:15.596-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15600000 2015-11-29T03:50:15.677-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10520000 QueuedCount 50000 2015-11-29T03:50:15.677-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15610000 2015-11-29T03:50:15.748-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15620000 2015-11-29T03:50:15.791-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:15.82-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15630000 2015-11-29T03:50:15.902-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15640000 2015-11-29T03:50:15.957-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10530000 QueuedCount 50000 2015-11-29T03:50:15.983-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15650000 2015-11-29T03:50:16.053-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15660000 2015-11-29T03:50:16.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15670000 2015-11-29T03:50:16.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15680000 2015-11-29T03:50:16.284-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15690000 2015-11-29T03:50:16.369-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15700000 2015-11-29T03:50:16.456-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15710000 2015-11-29T03:50:16.546-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15720000 2015-11-29T03:50:16.64-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15730000 2015-11-29T03:50:16.733-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15740000 2015-11-29T03:50:16.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15750000 2015-11-29T03:50:16.919-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15760000 2015-11-29T03:50:16.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10540000 QueuedCount 50000 2015-11-29T03:50:16.985-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15770000 2015-11-29T03:50:17.05-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15780000 2015-11-29T03:50:17.11-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10550000 QueuedCount 50000 2015-11-29T03:50:17.113-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15790000 2015-11-29T03:50:17.192-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15800000 2015-11-29T03:50:17.256-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10560000 QueuedCount 42055 2015-11-29T03:50:17.283-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15810000 2015-11-29T03:50:17.464-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10570000 QueuedCount 32055 2015-11-29T03:50:22.279-08:00 [Info] CompactionDaemon: Finished compacting index instance:16481390354720717219 2015-11-29T03:50:22.291-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10580000 QueuedCount 22055 2015-11-29T03:50:22.352-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 633 2015-11-29T03:50:22.382-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 633 2015-11-29T03:50:22.412-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 633 2015-11-29T03:50:22.442-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 633 2015-11-29T03:50:22.472-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 633 2015-11-29T03:50:22.483-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10590000 QueuedCount 12055 2015-11-29T03:50:22.502-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 633 2015-11-29T03:50:22.532-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 633 2015-11-29T03:50:22.562-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 633 2015-11-29T03:50:22.592-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 633 2015-11-29T03:50:22.622-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 633 2015-11-29T03:50:22.652-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 633 2015-11-29T03:50:22.682-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 633 2015-11-29T03:50:22.691-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10600000 QueuedCount 2055 2015-11-29T03:50:22.712-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 633 2015-11-29T03:50:22.742-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 633 2015-11-29T03:50:22.772-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 633 2015-11-29T03:50:22.802-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 633 2015-11-29T03:50:22.832-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 633 2015-11-29T03:50:22.862-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 633 2015-11-29T03:50:22.892-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 633 2015-11-29T03:50:22.922-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 633 2015-11-29T03:50:22.952-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 633 2015-11-29T03:50:22.982-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 633 2015-11-29T03:50:23.012-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 633 2015-11-29T03:50:23.042-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 633 2015-11-29T03:50:23.072-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 633 2015-11-29T03:50:23.102-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 633 2015-11-29T03:50:23.132-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 633 2015-11-29T03:50:23.162-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 633 2015-11-29T03:50:23.192-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 633 2015-11-29T03:50:23.222-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 633 2015-11-29T03:50:23.252-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 633 2015-11-29T03:50:23.282-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 633 2015-11-29T03:50:23.312-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 633 2015-11-29T03:50:23.342-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 633 2015-11-29T03:50:23.372-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 633 2015-11-29T03:50:23.402-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 633 2015-11-29T03:50:23.432-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 633 2015-11-29T03:50:23.462-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 633 2015-11-29T03:50:23.484-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 9.217µs CommitTime 720.07163ms TotalFlushTime 5m49.487006733s TotalCommitTime 45.961428429s 2015-11-29T03:50:23.484-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5307548, 5307548, 75 committed:true 2015-11-29T03:50:23.484-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5307548, 5307548, 75 committed:true) SnapCreateDur 746.568161ms SnapOpenDur 47.549µs 2015-11-29T03:50:23.492-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 633 2015-11-29T03:50:23.548-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15820000 2015-11-29T03:50:23.683-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10610000 QueuedCount 12884 2015-11-29T03:50:23.891-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10620000 QueuedCount 2884 2015-11-29T03:50:24.728-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 9.85µs CommitTime 749.813168ms TotalFlushTime 5m49.901476131s TotalCommitTime 46.711241597s 2015-11-29T03:50:24.728-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5318003, 5318003, 76 committed:true 2015-11-29T03:50:28.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 205 2015-11-29T03:50:28.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 205 2015-11-29T03:50:28.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 205 2015-11-29T03:50:28.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 205 2015-11-29T03:50:28.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 205 2015-11-29T03:50:28.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 205 2015-11-29T03:50:28.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 205 2015-11-29T03:50:28.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 205 2015-11-29T03:50:28.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 205 2015-11-29T03:50:28.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 205 2015-11-29T03:50:28.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 205 2015-11-29T03:50:28.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 205 2015-11-29T03:50:29.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 205 2015-11-29T03:50:29.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 205 2015-11-29T03:50:29.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 205 2015-11-29T03:50:29.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 205 2015-11-29T03:50:29.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 205 2015-11-29T03:50:29.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 205 2015-11-29T03:50:29.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 205 2015-11-29T03:50:29.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 205 2015-11-29T03:50:29.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 205 2015-11-29T03:50:29.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 205 2015-11-29T03:50:29.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 205 2015-11-29T03:50:29.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 205 2015-11-29T03:50:29.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 205 2015-11-29T03:50:29.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 205 2015-11-29T03:50:29.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 205 2015-11-29T03:50:29.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 205 2015-11-29T03:50:29.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 205 2015-11-29T03:50:29.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 205 2015-11-29T03:50:29.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 205 2015-11-29T03:50:29.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 205 2015-11-29T03:50:29.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 205 2015-11-29T03:50:29.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 205 2015-11-29T03:50:29.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 205 2015-11-29T03:50:29.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 205 2015-11-29T03:50:29.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 205 2015-11-29T03:50:29.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 205 2015-11-29T03:50:29.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 205 2015-11-29T03:50:29.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 205 2015-11-29T03:50:29.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 205 2015-11-29T03:50:29.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 205 2015-11-29T03:50:29.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 205 2015-11-29T03:50:29.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 205 2015-11-29T03:50:29.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 205 2015-11-29T03:50:29.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 205 2015-11-29T03:50:30.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 205 2015-11-29T03:50:30.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 205 2015-11-29T03:50:30.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 205 2015-11-29T03:50:30.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 205 2015-11-29T03:50:30.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 205 2015-11-29T03:50:30.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 205 2015-11-29T03:50:30.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 205 2015-11-29T03:50:30.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 205 2015-11-29T03:50:30.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 205 2015-11-29T03:50:30.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 205 2015-11-29T03:50:30.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 205 2015-11-29T03:50:30.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 205 2015-11-29T03:50:30.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 205 2015-11-29T03:50:30.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 205 2015-11-29T03:50:30.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 205 2015-11-29T03:50:30.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 205 2015-11-29T03:50:30.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 205 2015-11-29T03:50:30.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 205 2015-11-29T03:50:30.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 205 2015-11-29T03:50:30.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 205 2015-11-29T03:50:30.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 205 2015-11-29T03:50:30.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 205 2015-11-29T03:50:30.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 205 2015-11-29T03:50:30.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 205 2015-11-29T03:50:30.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 205 2015-11-29T03:50:30.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 205 2015-11-29T03:50:30.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 205 2015-11-29T03:50:30.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 205 2015-11-29T03:50:30.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 205 2015-11-29T03:50:30.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 205 2015-11-29T03:50:30.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 205 2015-11-29T03:50:30.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 205 2015-11-29T03:50:30.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 205 2015-11-29T03:50:31.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 205 2015-11-29T03:50:31.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 205 2015-11-29T03:50:31.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 205 2015-11-29T03:50:31.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 205 2015-11-29T03:50:31.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 205 2015-11-29T03:50:31.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 205 2015-11-29T03:50:31.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 205 2015-11-29T03:50:31.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 205 2015-11-29T03:50:31.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 205 2015-11-29T03:50:31.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 205 2015-11-29T03:50:31.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 205 2015-11-29T03:50:31.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 205 2015-11-29T03:50:31.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 205 2015-11-29T03:50:31.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 205 2015-11-29T03:50:31.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 205 2015-11-29T03:50:31.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 205 2015-11-29T03:50:31.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 205 2015-11-29T03:50:31.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 205 2015-11-29T03:50:31.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 205 2015-11-29T03:50:31.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 205 2015-11-29T03:50:31.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 205 2015-11-29T03:50:31.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 205 2015-11-29T03:50:31.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 205 2015-11-29T03:50:31.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 205 2015-11-29T03:50:31.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 205 2015-11-29T03:50:31.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 205 2015-11-29T03:50:31.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 205 2015-11-29T03:50:31.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 205 2015-11-29T03:50:31.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 205 2015-11-29T03:50:31.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 205 2015-11-29T03:50:31.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 205 2015-11-29T03:50:31.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 205 2015-11-29T03:50:31.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 205 2015-11-29T03:50:32.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 205 2015-11-29T03:50:32.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 205 2015-11-29T03:50:32.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 205 2015-11-29T03:50:32.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 205 2015-11-29T03:50:32.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 205 2015-11-29T03:50:32.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 205 2015-11-29T03:50:32.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 205 2015-11-29T03:50:32.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 205 2015-11-29T03:50:32.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 205 2015-11-29T03:50:32.257-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5318003, 5318003, 76 committed:true) SnapCreateDur 776.162421ms SnapOpenDur 7.528912209s 2015-11-29T03:50:32.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 205 2015-11-29T03:50:32.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 205 2015-11-29T03:50:32.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 205 2015-11-29T03:50:32.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 205 2015-11-29T03:50:32.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 205 2015-11-29T03:50:32.414-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10630000 QueuedCount 4281 2015-11-29T03:50:32.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 205 2015-11-29T03:50:32.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 205 2015-11-29T03:50:32.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 205 2015-11-29T03:50:32.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 205 2015-11-29T03:50:32.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 205 2015-11-29T03:50:32.554-08:00 [Error] ForestDB Error (data.fdb.0/main) errcode: -1, msg: Error in REMOVE on a database file '/data/@2i/bucket-1_by_email_0_16481390354720717219_0.index/data.fdb.2', errno = 2: 'No such file or directory' 2015-11-29T03:50:32.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 205 2015-11-29T03:50:32.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 205 2015-11-29T03:50:32.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 205 2015-11-29T03:50:32.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 205 2015-11-29T03:50:32.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 205 2015-11-29T03:50:32.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 205 2015-11-29T03:50:32.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 205 2015-11-29T03:50:32.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 205 2015-11-29T03:50:32.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 205 2015-11-29T03:50:32.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 205 2015-11-29T03:50:32.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 205 2015-11-29T03:50:32.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 205 2015-11-29T03:50:32.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 205 2015-11-29T03:50:32.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 205 2015-11-29T03:50:32.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 205 2015-11-29T03:50:33.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 205 2015-11-29T03:50:33.031-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.16µs CommitTime 505.194858ms TotalFlushTime 5m50.104304807s TotalCommitTime 47.216436455s 2015-11-29T03:50:33.031-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5323611, 5323611, 77 committed:true 2015-11-29T03:50:33.031-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5323611, 5323611, 77 committed:true) SnapCreateDur 531.916432ms SnapOpenDur 139.797µs 2015-11-29T03:50:33.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 205 2015-11-29T03:50:33.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 205 2015-11-29T03:50:33.093-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 205 2015-11-29T03:50:33.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 205 2015-11-29T03:50:33.162-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 205 2015-11-29T03:50:33.196-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 205 2015-11-29T03:50:33.212-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10640000 QueuedCount 48929 2015-11-29T03:50:33.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 205 2015-11-29T03:50:33.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 205 2015-11-29T03:50:33.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 205 2015-11-29T03:50:33.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 205 2015-11-29T03:50:33.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 205 2015-11-29T03:50:33.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 205 2015-11-29T03:50:33.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 205 2015-11-29T03:50:33.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 205 2015-11-29T03:50:33.464-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10650000 QueuedCount 50000 2015-11-29T03:50:33.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 205 2015-11-29T03:50:33.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 205 2015-11-29T03:50:33.522-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 205 2015-11-29T03:50:33.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 205 2015-11-29T03:50:33.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 205 2015-11-29T03:50:33.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 205 2015-11-29T03:50:33.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 205 2015-11-29T03:50:33.663-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.685-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:33.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 205 2015-11-29T03:50:33.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 205 2015-11-29T03:50:33.722-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10660000 QueuedCount 50000 2015-11-29T03:50:33.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 205 2015-11-29T03:50:33.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 205 2015-11-29T03:50:33.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 205 2015-11-29T03:50:33.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 205 2015-11-29T03:50:33.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 205 2015-11-29T03:50:33.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 205 2015-11-29T03:50:33.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 205 2015-11-29T03:50:33.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 205 2015-11-29T03:50:33.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 205 2015-11-29T03:50:34.007-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10670000 QueuedCount 50000 2015-11-29T03:50:34.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 205 2015-11-29T03:50:34.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 205 2015-11-29T03:50:34.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 205 2015-11-29T03:50:34.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 205 2015-11-29T03:50:34.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 205 2015-11-29T03:50:34.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 205 2015-11-29T03:50:34.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 205 2015-11-29T03:50:34.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 205 2015-11-29T03:50:34.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 205 2015-11-29T03:50:34.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 205 2015-11-29T03:50:34.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 205 2015-11-29T03:50:34.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 205 2015-11-29T03:50:34.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 205 2015-11-29T03:50:34.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 205 2015-11-29T03:50:34.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 205 2015-11-29T03:50:34.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 205 2015-11-29T03:50:34.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 205 2015-11-29T03:50:34.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 205 2015-11-29T03:50:34.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 205 2015-11-29T03:50:34.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 205 2015-11-29T03:50:34.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 205 2015-11-29T03:50:34.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 205 2015-11-29T03:50:34.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 205 2015-11-29T03:50:34.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 205 2015-11-29T03:50:34.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 205 2015-11-29T03:50:35.128-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 205 2015-11-29T03:50:35.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 205 2015-11-29T03:50:35.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 205 2015-11-29T03:50:35.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 205 2015-11-29T03:50:35.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 205 2015-11-29T03:50:35.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 205 2015-11-29T03:50:35.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 205 2015-11-29T03:50:35.306-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10680000 QueuedCount 50000 2015-11-29T03:50:35.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 205 2015-11-29T03:50:35.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 205 2015-11-29T03:50:35.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 205 2015-11-29T03:50:35.407-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:35.424-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10690000 QueuedCount 48348 2015-11-29T03:50:35.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 205 2015-11-29T03:50:35.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 205 2015-11-29T03:50:35.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 205 2015-11-29T03:50:35.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 205 2015-11-29T03:50:35.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 205 2015-11-29T03:50:35.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 205 2015-11-29T03:50:35.593-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10700000 QueuedCount 50000 2015-11-29T03:50:35.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 205 2015-11-29T03:50:35.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 205 2015-11-29T03:50:35.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 205 2015-11-29T03:50:35.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 205 2015-11-29T03:50:35.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 205 2015-11-29T03:50:35.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 205 2015-11-29T03:50:35.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 205 2015-11-29T03:50:35.814-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10710000 QueuedCount 50000 2015-11-29T03:50:35.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 205 2015-11-29T03:50:35.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 205 2015-11-29T03:50:35.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 205 2015-11-29T03:50:35.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 205 2015-11-29T03:50:35.916-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:35.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 205 2015-11-29T03:50:35.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 205 2015-11-29T03:50:35.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 205 2015-11-29T03:50:36.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 205 2015-11-29T03:50:36.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 205 2015-11-29T03:50:36.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 205 2015-11-29T03:50:36.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 205 2015-11-29T03:50:36.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 205 2015-11-29T03:50:36.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 205 2015-11-29T03:50:36.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 205 2015-11-29T03:50:36.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 205 2015-11-29T03:50:36.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 205 2015-11-29T03:50:36.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 205 2015-11-29T03:50:36.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 205 2015-11-29T03:50:36.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 205 2015-11-29T03:50:36.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 205 2015-11-29T03:50:36.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 205 2015-11-29T03:50:36.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 205 2015-11-29T03:50:36.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 205 2015-11-29T03:50:36.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 205 2015-11-29T03:50:36.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 205 2015-11-29T03:50:36.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 205 2015-11-29T03:50:36.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 205 2015-11-29T03:50:36.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 205 2015-11-29T03:50:36.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 205 2015-11-29T03:50:36.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 205 2015-11-29T03:50:36.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 205 2015-11-29T03:50:36.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 205 2015-11-29T03:50:36.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 205 2015-11-29T03:50:36.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 205 2015-11-29T03:50:36.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 205 2015-11-29T03:50:36.858-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10720000 QueuedCount 50000 2015-11-29T03:50:36.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 205 2015-11-29T03:50:36.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 205 2015-11-29T03:50:36.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 205 2015-11-29T03:50:36.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 205 2015-11-29T03:50:36.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 205 2015-11-29T03:50:36.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:37.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 205 2015-11-29T03:50:37.045-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:37.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 205 2015-11-29T03:50:37.076-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10730000 QueuedCount 50000 2015-11-29T03:50:37.151-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15830000 2015-11-29T03:50:37.327-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10740000 QueuedCount 50000 2015-11-29T03:50:37.435-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:37.547-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15840000 2015-11-29T03:50:37.569-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10750000 QueuedCount 45208 2015-11-29T03:50:37.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15850000 2015-11-29T03:50:38.701-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10760000 QueuedCount 35208 2015-11-29T03:50:38.896-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10770000 QueuedCount 25208 2015-11-29T03:50:39.128-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10780000 QueuedCount 15208 2015-11-29T03:50:39.33-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10790000 QueuedCount 5208 2015-11-29T03:50:40.574-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.643µs CommitTime 1.111278012s TotalFlushTime 5m56.04970858s TotalCommitTime 48.327714467s 2015-11-29T03:50:40.574-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5404279, 5404279, 78 committed:true 2015-11-29T03:50:40.574-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5404279, 5404279, 78 committed:true) SnapCreateDur 1.13393847s SnapOpenDur 42.224µs 2015-11-29T03:50:40.621-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:40.626-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15860000 2015-11-29T03:50:40.703-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:40.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15870000 2015-11-29T03:50:40.728-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10800000 QueuedCount 50000 2015-11-29T03:50:40.789-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15880000 2015-11-29T03:50:40.866-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15890000 2015-11-29T03:50:40.946-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15900000 2015-11-29T03:50:40.954-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10810000 QueuedCount 50000 2015-11-29T03:50:40.964-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:41.03-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15910000 2015-11-29T03:50:41.106-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15920000 2015-11-29T03:50:41.183-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10820000 QueuedCount 50000 2015-11-29T03:50:41.187-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15930000 2015-11-29T03:50:41.263-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15940000 2015-11-29T03:50:41.274-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:41.36-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15950000 2015-11-29T03:50:41.427-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10830000 QueuedCount 50000 2015-11-29T03:50:41.45-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15960000 2015-11-29T03:50:41.544-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15970000 2015-11-29T03:50:41.682-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15980000 2015-11-29T03:50:41.856-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 15990000 2015-11-29T03:50:42.038-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16000000 2015-11-29T03:50:42.58-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:42.589-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10840000 QueuedCount 49133 2015-11-29T03:50:42.715-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10850000 QueuedCount 50000 2015-11-29T03:50:42.827-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10860000 QueuedCount 41368 2015-11-29T03:50:42.94-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10870000 QueuedCount 31368 2015-11-29T03:50:43.698-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10880000 QueuedCount 21368 2015-11-29T03:50:43.787-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10890000 QueuedCount 11368 2015-11-29T03:50:43.875-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10900000 QueuedCount 1368 2015-11-29T03:50:44.39-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.591µs CommitTime 487.944251ms TotalFlushTime 5m59.160397862s TotalCommitTime 48.815658718s 2015-11-29T03:50:44.39-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5457071, 5457071, 79 committed:true 2015-11-29T03:50:44.39-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5457071, 5457071, 79 committed:true) SnapCreateDur 497.899695ms SnapOpenDur 56.298µs 2015-11-29T03:50:44.444-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:44.613-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10910000 QueuedCount 50000 2015-11-29T03:50:44.724-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:44.846-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10920000 QueuedCount 50000 2015-11-29T03:50:45.105-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10930000 QueuedCount 50000 2015-11-29T03:50:45.16-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:45.398-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10940000 QueuedCount 50000 2015-11-29T03:50:46.577-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.598-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.62-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.646-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10950000 QueuedCount 50000 2015-11-29T03:50:46.65-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.671-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.767-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.768-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10960000 QueuedCount 49891 2015-11-29T03:50:46.855-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:46.895-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10970000 QueuedCount 50000 2015-11-29T03:50:46.939-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:47.154-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10980000 QueuedCount 50000 2015-11-29T03:50:47.176-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:47.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 987 2015-11-29T03:50:47.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 987 2015-11-29T03:50:47.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 987 2015-11-29T03:50:47.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 987 2015-11-29T03:50:47.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 987 2015-11-29T03:50:47.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 987 2015-11-29T03:50:47.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 987 2015-11-29T03:50:47.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 987 2015-11-29T03:50:47.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 987 2015-11-29T03:50:47.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 987 2015-11-29T03:50:47.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 987 2015-11-29T03:50:47.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 987 2015-11-29T03:50:47.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 987 2015-11-29T03:50:47.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 987 2015-11-29T03:50:47.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 987 2015-11-29T03:50:47.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 987 2015-11-29T03:50:47.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 987 2015-11-29T03:50:47.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 987 2015-11-29T03:50:47.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 987 2015-11-29T03:50:47.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 987 2015-11-29T03:50:47.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 987 2015-11-29T03:50:47.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 987 2015-11-29T03:50:47.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 987 2015-11-29T03:50:47.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 987 2015-11-29T03:50:47.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 987 2015-11-29T03:50:47.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 987 2015-11-29T03:50:47.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 987 2015-11-29T03:50:48.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 987 2015-11-29T03:50:48.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 987 2015-11-29T03:50:48.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 987 2015-11-29T03:50:48.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 987 2015-11-29T03:50:48.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 987 2015-11-29T03:50:48.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 987 2015-11-29T03:50:48.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 987 2015-11-29T03:50:48.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 987 2015-11-29T03:50:48.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 987 2015-11-29T03:50:48.272-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 10990000 QueuedCount 50000 2015-11-29T03:50:48.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 987 2015-11-29T03:50:48.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 987 2015-11-29T03:50:48.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 987 2015-11-29T03:50:48.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 987 2015-11-29T03:50:48.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 987 2015-11-29T03:50:48.401-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11000000 QueuedCount 50000 2015-11-29T03:50:48.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 987 2015-11-29T03:50:48.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 987 2015-11-29T03:50:48.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 987 2015-11-29T03:50:48.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 987 2015-11-29T03:50:48.52-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11010000 QueuedCount 50000 2015-11-29T03:50:48.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 987 2015-11-29T03:50:48.559-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:48.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 987 2015-11-29T03:50:48.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 987 2015-11-29T03:50:48.636-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11020000 QueuedCount 50000 2015-11-29T03:50:48.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 987 2015-11-29T03:50:48.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 987 2015-11-29T03:50:48.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 987 2015-11-29T03:50:48.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 987 2015-11-29T03:50:48.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 987 2015-11-29T03:50:48.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 987 2015-11-29T03:50:48.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 987 2015-11-29T03:50:48.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 987 2015-11-29T03:50:48.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 987 2015-11-29T03:50:48.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 987 2015-11-29T03:50:48.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 987 2015-11-29T03:50:48.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 987 2015-11-29T03:50:48.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 987 2015-11-29T03:50:49.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 987 2015-11-29T03:50:49.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 987 2015-11-29T03:50:49.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 987 2015-11-29T03:50:49.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 987 2015-11-29T03:50:49.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 987 2015-11-29T03:50:49.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 987 2015-11-29T03:50:49.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 987 2015-11-29T03:50:49.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 987 2015-11-29T03:50:49.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 987 2015-11-29T03:50:49.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 987 2015-11-29T03:50:49.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 987 2015-11-29T03:50:49.332-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11030000 QueuedCount 45456 2015-11-29T03:50:49.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 987 2015-11-29T03:50:49.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 987 2015-11-29T03:50:49.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 987 2015-11-29T03:50:49.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 987 2015-11-29T03:50:49.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 987 2015-11-29T03:50:49.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 987 2015-11-29T03:50:49.526-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11040000 QueuedCount 35456 2015-11-29T03:50:49.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 987 2015-11-29T03:50:49.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 987 2015-11-29T03:50:49.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 987 2015-11-29T03:50:49.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 987 2015-11-29T03:50:49.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 987 2015-11-29T03:50:49.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 987 2015-11-29T03:50:49.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 987 2015-11-29T03:50:49.721-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11050000 QueuedCount 25456 2015-11-29T03:50:49.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 987 2015-11-29T03:50:49.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 987 2015-11-29T03:50:49.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 987 2015-11-29T03:50:49.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 987 2015-11-29T03:50:49.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 987 2015-11-29T03:50:49.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 987 2015-11-29T03:50:49.924-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11060000 QueuedCount 15456 2015-11-29T03:50:49.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 987 2015-11-29T03:50:49.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 987 2015-11-29T03:50:49.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 987 2015-11-29T03:50:50.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 987 2015-11-29T03:50:50.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 987 2015-11-29T03:50:50.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 987 2015-11-29T03:50:50.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 987 2015-11-29T03:50:50.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 987 2015-11-29T03:50:50.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 987 2015-11-29T03:50:50.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 987 2015-11-29T03:50:50.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 987 2015-11-29T03:50:50.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 987 2015-11-29T03:50:50.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 987 2015-11-29T03:50:50.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 987 2015-11-29T03:50:50.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 987 2015-11-29T03:50:50.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 987 2015-11-29T03:50:50.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 987 2015-11-29T03:50:50.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 987 2015-11-29T03:50:50.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 987 2015-11-29T03:50:50.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 987 2015-11-29T03:50:50.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 987 2015-11-29T03:50:50.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 987 2015-11-29T03:50:50.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 987 2015-11-29T03:50:50.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 987 2015-11-29T03:50:50.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 987 2015-11-29T03:50:50.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 987 2015-11-29T03:50:50.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 987 2015-11-29T03:50:50.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 987 2015-11-29T03:50:50.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 987 2015-11-29T03:50:50.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 987 2015-11-29T03:50:50.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 987 2015-11-29T03:50:50.838-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11070000 QueuedCount 5456 2015-11-29T03:50:50.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 987 2015-11-29T03:50:50.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 987 2015-11-29T03:50:50.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 987 2015-11-29T03:50:50.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 987 2015-11-29T03:50:50.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 987 2015-11-29T03:50:51.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 987 2015-11-29T03:50:51.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 987 2015-11-29T03:50:51.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 987 2015-11-29T03:50:51.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 987 2015-11-29T03:50:51.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 987 2015-11-29T03:50:51.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 987 2015-11-29T03:50:51.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 987 2015-11-29T03:50:51.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 987 2015-11-29T03:50:51.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 987 2015-11-29T03:50:51.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 987 2015-11-29T03:50:51.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 987 2015-11-29T03:50:51.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 987 2015-11-29T03:50:51.359-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 8.303µs CommitTime 440.884107ms TotalFlushTime 6m5.2359157s TotalCommitTime 49.256542825s 2015-11-29T03:50:51.359-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5544476, 5544476, 80 committed:true 2015-11-29T03:50:51.359-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5544476, 5544476, 80 committed:true) SnapCreateDur 453.925618ms SnapOpenDur 85.44µs 2015-11-29T03:50:51.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 987 2015-11-29T03:50:51.386-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:51.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 987 2015-11-29T03:50:51.41-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:51.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 987 2015-11-29T03:50:51.453-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:51.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 987 2015-11-29T03:50:51.482-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:51.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 987 2015-11-29T03:50:51.49-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11080000 QueuedCount 28403 2015-11-29T03:50:51.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 987 2015-11-29T03:50:51.53-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:51.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 987 2015-11-29T03:50:51.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 987 2015-11-29T03:50:51.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 987 2015-11-29T03:50:51.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 987 2015-11-29T03:50:51.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 987 2015-11-29T03:50:51.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 987 2015-11-29T03:50:51.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 987 2015-11-29T03:50:51.749-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11090000 QueuedCount 50000 2015-11-29T03:50:51.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 987 2015-11-29T03:50:51.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 987 2015-11-29T03:50:51.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 987 2015-11-29T03:50:51.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 987 2015-11-29T03:50:51.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 987 2015-11-29T03:50:51.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 987 2015-11-29T03:50:51.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 987 2015-11-29T03:50:51.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 987 2015-11-29T03:50:51.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 987 2015-11-29T03:50:52.008-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11100000 QueuedCount 50000 2015-11-29T03:50:52.009-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:52.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 987 2015-11-29T03:50:52.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 987 2015-11-29T03:50:52.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 987 2015-11-29T03:50:52.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 987 2015-11-29T03:50:52.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 987 2015-11-29T03:50:52.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 987 2015-11-29T03:50:52.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 987 2015-11-29T03:50:52.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 987 2015-11-29T03:50:52.265-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11110000 QueuedCount 50000 2015-11-29T03:50:52.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 987 2015-11-29T03:50:52.279-08:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 16481390354720717219 Data:1754654211, Disk:5900230656, ExtraSnapshotData:0, Fragmentation:70.26126073197366% 2015-11-29T03:50:52.279-08:00 [Info] CompactionDaemon: Compacting index instance:16481390354720717219 2015-11-29T03:50:52.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 987 2015-11-29T03:50:52.301-08:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 5318003. Slice Id 0, IndexInstId 16481390354720717219, IndexDefnId 16481390354720717219 2015-11-29T03:50:52.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 987 2015-11-29T03:50:52.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 987 2015-11-29T03:50:52.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 987 2015-11-29T03:50:52.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 987 2015-11-29T03:50:52.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 987 2015-11-29T03:50:52.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 987 2015-11-29T03:50:52.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 987 2015-11-29T03:50:52.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 987 2015-11-29T03:50:52.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 987 2015-11-29T03:50:52.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 987 2015-11-29T03:50:52.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 987 2015-11-29T03:50:52.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 987 2015-11-29T03:50:52.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 987 2015-11-29T03:50:52.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 987 2015-11-29T03:50:52.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 987 2015-11-29T03:50:52.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 987 2015-11-29T03:50:52.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 987 2015-11-29T03:50:52.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 987 2015-11-29T03:50:52.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 987 2015-11-29T03:50:52.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 987 2015-11-29T03:50:52.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 987 2015-11-29T03:50:52.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 987 2015-11-29T03:50:52.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 987 2015-11-29T03:50:53.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 987 2015-11-29T03:50:53.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 987 2015-11-29T03:50:53.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 987 2015-11-29T03:50:53.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 987 2015-11-29T03:50:53.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 987 2015-11-29T03:50:53.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 987 2015-11-29T03:50:53.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 987 2015-11-29T03:50:53.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 987 2015-11-29T03:50:53.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 987 2015-11-29T03:50:53.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 987 2015-11-29T03:50:53.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 987 2015-11-29T03:50:53.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 987 2015-11-29T03:50:53.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 987 2015-11-29T03:50:53.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 987 2015-11-29T03:50:53.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 987 2015-11-29T03:50:53.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 987 2015-11-29T03:50:53.495-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:53.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 987 2015-11-29T03:50:53.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 987 2015-11-29T03:50:53.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 987 2015-11-29T03:50:53.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 987 2015-11-29T03:50:53.618-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:53.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 987 2015-11-29T03:50:53.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 987 2015-11-29T03:50:53.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 987 2015-11-29T03:50:53.696-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11120000 QueuedCount 50000 2015-11-29T03:50:53.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 987 2015-11-29T03:50:53.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 987 2015-11-29T03:50:53.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 987 2015-11-29T03:50:53.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 987 2015-11-29T03:50:53.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 987 2015-11-29T03:50:53.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 987 2015-11-29T03:50:53.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 987 2015-11-29T03:50:53.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 987 2015-11-29T03:50:53.933-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11130000 QueuedCount 50000 2015-11-29T03:50:53.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 987 2015-11-29T03:50:53.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 987 2015-11-29T03:50:54.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 987 2015-11-29T03:50:54.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 987 2015-11-29T03:50:54.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 987 2015-11-29T03:50:54.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 987 2015-11-29T03:50:54.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 987 2015-11-29T03:50:54.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 987 2015-11-29T03:50:54.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 987 2015-11-29T03:50:54.191-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11140000 QueuedCount 50000 2015-11-29T03:50:54.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 987 2015-11-29T03:50:54.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 987 2015-11-29T03:50:54.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 987 2015-11-29T03:50:54.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 987 2015-11-29T03:50:54.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 987 2015-11-29T03:50:54.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 987 2015-11-29T03:50:54.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 987 2015-11-29T03:50:54.422-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11150000 QueuedCount 44228 2015-11-29T03:50:54.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 987 2015-11-29T03:50:54.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 987 2015-11-29T03:50:54.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 987 2015-11-29T03:50:54.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 987 2015-11-29T03:50:54.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 987 2015-11-29T03:50:54.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 987 2015-11-29T03:50:54.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 987 2015-11-29T03:50:54.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 987 2015-11-29T03:50:54.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 987 2015-11-29T03:50:54.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 987 2015-11-29T03:50:54.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 987 2015-11-29T03:50:54.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 987 2015-11-29T03:50:54.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 987 2015-11-29T03:50:54.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 987 2015-11-29T03:50:54.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 987 2015-11-29T03:50:54.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 987 2015-11-29T03:50:54.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 987 2015-11-29T03:50:54.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 987 2015-11-29T03:50:54.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 987 2015-11-29T03:50:54.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 987 2015-11-29T03:50:55.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 987 2015-11-29T03:50:55.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 987 2015-11-29T03:50:55.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 987 2015-11-29T03:50:55.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 987 2015-11-29T03:50:55.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 987 2015-11-29T03:50:55.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 987 2015-11-29T03:50:55.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 987 2015-11-29T03:50:55.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 987 2015-11-29T03:50:55.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 987 2015-11-29T03:50:55.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 987 2015-11-29T03:50:55.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 987 2015-11-29T03:50:55.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 987 2015-11-29T03:50:55.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 987 2015-11-29T03:50:55.393-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11160000 QueuedCount 34228 2015-11-29T03:50:55.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 987 2015-11-29T03:50:55.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 987 2015-11-29T03:50:55.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 987 2015-11-29T03:50:55.506-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11170000 QueuedCount 24228 2015-11-29T03:50:55.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 987 2015-11-29T03:50:55.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 987 2015-11-29T03:50:55.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 987 2015-11-29T03:50:55.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 987 2015-11-29T03:50:55.623-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11180000 QueuedCount 14228 2015-11-29T03:50:55.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 987 2015-11-29T03:50:55.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 987 2015-11-29T03:50:55.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 987 2015-11-29T03:50:55.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 987 2015-11-29T03:50:55.738-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11190000 QueuedCount 4228 2015-11-29T03:50:55.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 987 2015-11-29T03:50:55.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 987 2015-11-29T03:50:55.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 987 2015-11-29T03:50:55.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 987 2015-11-29T03:50:55.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 987 2015-11-29T03:50:55.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 987 2015-11-29T03:50:55.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 987 2015-11-29T03:50:55.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 987 2015-11-29T03:50:55.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 987 2015-11-29T03:50:56.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 987 2015-11-29T03:50:56.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 987 2015-11-29T03:50:56.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 987 2015-11-29T03:50:56.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 987 2015-11-29T03:50:56.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 987 2015-11-29T03:50:56.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 987 2015-11-29T03:50:56.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 987 2015-11-29T03:50:56.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 987 2015-11-29T03:50:56.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 987 2015-11-29T03:50:56.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 987 2015-11-29T03:50:56.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 987 2015-11-29T03:50:56.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 987 2015-11-29T03:50:56.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 987 2015-11-29T03:50:56.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 987 2015-11-29T03:50:56.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 987 2015-11-29T03:50:56.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 987 2015-11-29T03:50:56.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 987 2015-11-29T03:50:56.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 987 2015-11-29T03:50:56.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 987 2015-11-29T03:50:56.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 987 2015-11-29T03:50:56.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 987 2015-11-29T03:50:56.636-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.94µs CommitTime 199.44033ms TotalFlushTime 6m9.961327019s TotalCommitTime 49.455983155s 2015-11-29T03:50:56.636-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5603958, 5603958, 81 committed:true 2015-11-29T03:50:56.636-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5603958, 5603958, 81 committed:true) SnapCreateDur 210.538492ms SnapOpenDur 50.211µs 2015-11-29T03:50:56.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 987 2015-11-29T03:50:56.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 987 2015-11-29T03:50:56.685-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:56.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 987 2015-11-29T03:50:56.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 987 2015-11-29T03:50:56.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 987 2015-11-29T03:50:56.799-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11200000 QueuedCount 50000 2015-11-29T03:50:56.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 987 2015-11-29T03:50:56.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 987 2015-11-29T03:50:56.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 987 2015-11-29T03:50:56.867-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:56.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 987 2015-11-29T03:50:56.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 987 2015-11-29T03:50:56.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 987 2015-11-29T03:50:56.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 987 2015-11-29T03:50:57.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 987 2015-11-29T03:50:57.029-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11210000 QueuedCount 50000 2015-11-29T03:50:57.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 987 2015-11-29T03:50:57.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 987 2015-11-29T03:50:57.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 987 2015-11-29T03:50:57.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 987 2015-11-29T03:50:57.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 987 2015-11-29T03:50:57.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 987 2015-11-29T03:50:57.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 987 2015-11-29T03:50:57.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 987 2015-11-29T03:50:57.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 987 2015-11-29T03:50:57.291-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11220000 QueuedCount 50000 2015-11-29T03:50:57.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 987 2015-11-29T03:50:57.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 987 2015-11-29T03:50:57.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 987 2015-11-29T03:50:57.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 987 2015-11-29T03:50:57.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 987 2015-11-29T03:50:57.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 987 2015-11-29T03:50:57.487-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:57.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 987 2015-11-29T03:50:57.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 987 2015-11-29T03:50:57.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 987 2015-11-29T03:50:57.563-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11230000 QueuedCount 50000 2015-11-29T03:50:57.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 987 2015-11-29T03:50:57.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 987 2015-11-29T03:50:57.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 987 2015-11-29T03:50:57.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 987 2015-11-29T03:50:57.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 987 2015-11-29T03:50:57.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 987 2015-11-29T03:50:57.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 987 2015-11-29T03:50:57.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 987 2015-11-29T03:50:57.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 987 2015-11-29T03:50:57.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 987 2015-11-29T03:50:57.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 987 2015-11-29T03:50:57.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 987 2015-11-29T03:50:57.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 987 2015-11-29T03:50:57.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 987 2015-11-29T03:50:57.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 987 2015-11-29T03:50:58.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 987 2015-11-29T03:50:58.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 987 2015-11-29T03:50:58.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 987 2015-11-29T03:50:58.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 987 2015-11-29T03:50:58.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 987 2015-11-29T03:50:58.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 987 2015-11-29T03:50:58.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 987 2015-11-29T03:50:58.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 987 2015-11-29T03:50:58.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 987 2015-11-29T03:50:58.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 987 2015-11-29T03:50:58.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 987 2015-11-29T03:50:58.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 987 2015-11-29T03:50:58.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 987 2015-11-29T03:50:58.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 987 2015-11-29T03:50:58.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 987 2015-11-29T03:50:58.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 987 2015-11-29T03:50:58.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 987 2015-11-29T03:50:58.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 987 2015-11-29T03:50:58.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 987 2015-11-29T03:50:58.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 987 2015-11-29T03:50:58.615-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:58.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 987 2015-11-29T03:50:58.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 987 2015-11-29T03:50:58.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 987 2015-11-29T03:50:58.714-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11240000 QueuedCount 50000 2015-11-29T03:50:58.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 987 2015-11-29T03:50:58.745-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:50:58.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 987 2015-11-29T03:50:58.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 987 2015-11-29T03:50:58.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 987 2015-11-29T03:50:58.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 987 2015-11-29T03:50:58.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 987 2015-11-29T03:50:58.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 987 2015-11-29T03:50:58.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 987 2015-11-29T03:50:58.942-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11250000 QueuedCount 50000 2015-11-29T03:50:58.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 987 2015-11-29T03:50:58.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 987 2015-11-29T03:50:59.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 987 2015-11-29T03:50:59.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 987 2015-11-29T03:50:59.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 987 2015-11-29T03:50:59.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 987 2015-11-29T03:50:59.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 987 2015-11-29T03:50:59.142-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11260000 QueuedCount 40550 2015-11-29T03:50:59.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 987 2015-11-29T03:50:59.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 987 2015-11-29T03:50:59.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 987 2015-11-29T03:50:59.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 987 2015-11-29T03:50:59.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 987 2015-11-29T03:50:59.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 987 2015-11-29T03:50:59.347-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11270000 QueuedCount 30550 2015-11-29T03:50:59.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 987 2015-11-29T03:50:59.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 987 2015-11-29T03:50:59.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 987 2015-11-29T03:50:59.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 987 2015-11-29T03:50:59.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 987 2015-11-29T03:50:59.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 987 2015-11-29T03:50:59.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 987 2015-11-29T03:50:59.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 987 2015-11-29T03:50:59.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 987 2015-11-29T03:50:59.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 987 2015-11-29T03:50:59.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 987 2015-11-29T03:50:59.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 987 2015-11-29T03:50:59.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 987 2015-11-29T03:50:59.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 987 2015-11-29T03:50:59.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 987 2015-11-29T03:50:59.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 987 2015-11-29T03:50:59.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 987 2015-11-29T03:50:59.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 987 2015-11-29T03:50:59.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 987 2015-11-29T03:50:59.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 987 2015-11-29T03:50:59.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 987 2015-11-29T03:50:59.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 987 2015-11-29T03:51:00.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 987 2015-11-29T03:51:00.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 987 2015-11-29T03:51:00.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 987 2015-11-29T03:51:00.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 987 2015-11-29T03:51:00.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 987 2015-11-29T03:51:00.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 987 2015-11-29T03:51:00.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 987 2015-11-29T03:51:00.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 987 2015-11-29T03:51:00.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 987 2015-11-29T03:51:00.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 987 2015-11-29T03:51:00.293-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11280000 QueuedCount 20550 2015-11-29T03:51:00.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 987 2015-11-29T03:51:00.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 987 2015-11-29T03:51:00.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 987 2015-11-29T03:51:00.396-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11290000 QueuedCount 10550 2015-11-29T03:51:00.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 987 2015-11-29T03:51:00.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 987 2015-11-29T03:51:00.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 987 2015-11-29T03:51:00.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 987 2015-11-29T03:51:00.502-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11300000 QueuedCount 550 2015-11-29T03:51:00.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 987 2015-11-29T03:51:00.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 987 2015-11-29T03:51:00.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 987 2015-11-29T03:51:00.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 987 2015-11-29T03:51:00.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 987 2015-11-29T03:51:00.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18480 Milliseconds Vbucket 987 2015-11-29T03:51:00.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18510 Milliseconds Vbucket 987 2015-11-29T03:51:00.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18540 Milliseconds Vbucket 987 2015-11-29T03:51:00.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18570 Milliseconds Vbucket 987 2015-11-29T03:51:00.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18600 Milliseconds Vbucket 987 2015-11-29T03:51:00.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18630 Milliseconds Vbucket 987 2015-11-29T03:51:00.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18660 Milliseconds Vbucket 987 2015-11-29T03:51:00.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18690 Milliseconds Vbucket 987 2015-11-29T03:51:00.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18720 Milliseconds Vbucket 987 2015-11-29T03:51:00.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18750 Milliseconds Vbucket 987 2015-11-29T03:51:00.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18780 Milliseconds Vbucket 987 2015-11-29T03:51:00.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18810 Milliseconds Vbucket 987 2015-11-29T03:51:01.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18840 Milliseconds Vbucket 987 2015-11-29T03:51:01.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18870 Milliseconds Vbucket 987 2015-11-29T03:51:01.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18900 Milliseconds Vbucket 987 2015-11-29T03:51:01.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18930 Milliseconds Vbucket 987 2015-11-29T03:51:01.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18960 Milliseconds Vbucket 987 2015-11-29T03:51:01.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18990 Milliseconds Vbucket 987 2015-11-29T03:51:01.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19020 Milliseconds Vbucket 987 2015-11-29T03:51:01.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19050 Milliseconds Vbucket 987 2015-11-29T03:51:01.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19080 Milliseconds Vbucket 987 2015-11-29T03:51:01.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19110 Milliseconds Vbucket 987 2015-11-29T03:51:01.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19140 Milliseconds Vbucket 987 2015-11-29T03:51:01.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19170 Milliseconds Vbucket 987 2015-11-29T03:51:01.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19200 Milliseconds Vbucket 987 2015-11-29T03:51:01.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19230 Milliseconds Vbucket 987 2015-11-29T03:51:01.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19260 Milliseconds Vbucket 987 2015-11-29T03:51:01.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19290 Milliseconds Vbucket 987 2015-11-29T03:51:01.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19320 Milliseconds Vbucket 987 2015-11-29T03:51:01.526-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.437µs CommitTime 984.870473ms TotalFlushTime 6m13.56085865s TotalCommitTime 50.440853628s 2015-11-29T03:51:01.526-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5657173, 5657173, 82 committed:true 2015-11-29T03:51:01.526-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5657173, 5657173, 82 committed:true) SnapCreateDur 1.011334817s SnapOpenDur 61.443µs 2015-11-29T03:51:01.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19350 Milliseconds Vbucket 987 2015-11-29T03:51:01.557-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19380 Milliseconds Vbucket 987 2015-11-29T03:51:01.582-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19410 Milliseconds Vbucket 987 2015-11-29T03:51:01.611-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19440 Milliseconds Vbucket 987 2015-11-29T03:51:01.632-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19470 Milliseconds Vbucket 987 2015-11-29T03:51:01.663-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.687-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19500 Milliseconds Vbucket 987 2015-11-29T03:51:01.712-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:01.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19530 Milliseconds Vbucket 987 2015-11-29T03:51:01.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19560 Milliseconds Vbucket 987 2015-11-29T03:51:01.75-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11310000 QueuedCount 49308 2015-11-29T03:51:01.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19590 Milliseconds Vbucket 987 2015-11-29T03:51:01.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19620 Milliseconds Vbucket 987 2015-11-29T03:51:01.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19650 Milliseconds Vbucket 987 2015-11-29T03:51:01.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19680 Milliseconds Vbucket 987 2015-11-29T03:51:01.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19710 Milliseconds Vbucket 987 2015-11-29T03:51:01.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19740 Milliseconds Vbucket 987 2015-11-29T03:51:01.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19770 Milliseconds Vbucket 987 2015-11-29T03:51:01.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11320000 QueuedCount 50000 2015-11-29T03:51:01.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19800 Milliseconds Vbucket 987 2015-11-29T03:51:02.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19830 Milliseconds Vbucket 987 2015-11-29T03:51:02.039-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:02.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19860 Milliseconds Vbucket 987 2015-11-29T03:51:02.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19890 Milliseconds Vbucket 987 2015-11-29T03:51:02.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19920 Milliseconds Vbucket 987 2015-11-29T03:51:02.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19950 Milliseconds Vbucket 987 2015-11-29T03:51:02.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19980 Milliseconds Vbucket 987 2015-11-29T03:51:02.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20010 Milliseconds Vbucket 987 2015-11-29T03:51:02.217-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11330000 QueuedCount 50000 2015-11-29T03:51:02.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20040 Milliseconds Vbucket 987 2015-11-29T03:51:02.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20070 Milliseconds Vbucket 987 2015-11-29T03:51:02.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20100 Milliseconds Vbucket 987 2015-11-29T03:51:02.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20130 Milliseconds Vbucket 987 2015-11-29T03:51:02.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20160 Milliseconds Vbucket 987 2015-11-29T03:51:02.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20190 Milliseconds Vbucket 987 2015-11-29T03:51:02.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20220 Milliseconds Vbucket 987 2015-11-29T03:51:02.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20250 Milliseconds Vbucket 987 2015-11-29T03:51:02.453-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11340000 QueuedCount 50000 2015-11-29T03:51:02.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20280 Milliseconds Vbucket 987 2015-11-29T03:51:02.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20310 Milliseconds Vbucket 987 2015-11-29T03:51:02.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20340 Milliseconds Vbucket 987 2015-11-29T03:51:02.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20370 Milliseconds Vbucket 987 2015-11-29T03:51:02.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20400 Milliseconds Vbucket 987 2015-11-29T03:51:02.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20430 Milliseconds Vbucket 987 2015-11-29T03:51:02.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20460 Milliseconds Vbucket 987 2015-11-29T03:51:02.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20490 Milliseconds Vbucket 987 2015-11-29T03:51:02.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20520 Milliseconds Vbucket 987 2015-11-29T03:51:02.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20550 Milliseconds Vbucket 987 2015-11-29T03:51:02.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20580 Milliseconds Vbucket 987 2015-11-29T03:51:02.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20610 Milliseconds Vbucket 987 2015-11-29T03:51:02.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20640 Milliseconds Vbucket 987 2015-11-29T03:51:02.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20670 Milliseconds Vbucket 987 2015-11-29T03:51:02.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20700 Milliseconds Vbucket 987 2015-11-29T03:51:02.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20730 Milliseconds Vbucket 987 2015-11-29T03:51:02.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20760 Milliseconds Vbucket 987 2015-11-29T03:51:02.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20790 Milliseconds Vbucket 987 2015-11-29T03:51:03.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20820 Milliseconds Vbucket 987 2015-11-29T03:51:03.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20850 Milliseconds Vbucket 987 2015-11-29T03:51:03.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20880 Milliseconds Vbucket 987 2015-11-29T03:51:03.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20910 Milliseconds Vbucket 987 2015-11-29T03:51:03.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20940 Milliseconds Vbucket 987 2015-11-29T03:51:03.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20970 Milliseconds Vbucket 987 2015-11-29T03:51:03.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21000 Milliseconds Vbucket 987 2015-11-29T03:51:03.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21030 Milliseconds Vbucket 987 2015-11-29T03:51:03.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21060 Milliseconds Vbucket 987 2015-11-29T03:51:03.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21090 Milliseconds Vbucket 987 2015-11-29T03:51:03.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21120 Milliseconds Vbucket 987 2015-11-29T03:51:03.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21150 Milliseconds Vbucket 987 2015-11-29T03:51:03.369-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21180 Milliseconds Vbucket 987 2015-11-29T03:51:03.399-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21210 Milliseconds Vbucket 987 2015-11-29T03:51:03.429-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21240 Milliseconds Vbucket 987 2015-11-29T03:51:03.459-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21270 Milliseconds Vbucket 987 2015-11-29T03:51:03.489-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21300 Milliseconds Vbucket 987 2015-11-29T03:51:03.519-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21330 Milliseconds Vbucket 987 2015-11-29T03:51:03.549-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21360 Milliseconds Vbucket 987 2015-11-29T03:51:03.579-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21390 Milliseconds Vbucket 987 2015-11-29T03:51:03.609-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21420 Milliseconds Vbucket 987 2015-11-29T03:51:03.617-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11350000 QueuedCount 50000 2015-11-29T03:51:03.639-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21450 Milliseconds Vbucket 987 2015-11-29T03:51:03.661-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:03.669-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21480 Milliseconds Vbucket 987 2015-11-29T03:51:03.699-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21510 Milliseconds Vbucket 987 2015-11-29T03:51:03.729-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21540 Milliseconds Vbucket 987 2015-11-29T03:51:03.759-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21570 Milliseconds Vbucket 987 2015-11-29T03:51:03.76-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11360000 QueuedCount 50000 2015-11-29T03:51:03.789-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21600 Milliseconds Vbucket 987 2015-11-29T03:51:03.819-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21630 Milliseconds Vbucket 987 2015-11-29T03:51:03.849-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21660 Milliseconds Vbucket 987 2015-11-29T03:51:03.879-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21690 Milliseconds Vbucket 987 2015-11-29T03:51:03.909-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21720 Milliseconds Vbucket 987 2015-11-29T03:51:03.931-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:03.939-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21750 Milliseconds Vbucket 987 2015-11-29T03:51:03.969-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21780 Milliseconds Vbucket 987 2015-11-29T03:51:03.999-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21810 Milliseconds Vbucket 987 2015-11-29T03:51:04.002-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11370000 QueuedCount 47545 2015-11-29T03:51:04.029-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21840 Milliseconds Vbucket 987 2015-11-29T03:51:04.059-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21870 Milliseconds Vbucket 987 2015-11-29T03:51:04.089-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21900 Milliseconds Vbucket 987 2015-11-29T03:51:04.119-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21930 Milliseconds Vbucket 987 2015-11-29T03:51:04.149-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21960 Milliseconds Vbucket 987 2015-11-29T03:51:04.179-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21990 Milliseconds Vbucket 987 2015-11-29T03:51:04.206-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11380000 QueuedCount 37545 2015-11-29T03:51:04.209-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22020 Milliseconds Vbucket 987 2015-11-29T03:51:04.239-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22050 Milliseconds Vbucket 987 2015-11-29T03:51:04.269-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22080 Milliseconds Vbucket 987 2015-11-29T03:51:04.299-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22110 Milliseconds Vbucket 987 2015-11-29T03:51:04.329-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22140 Milliseconds Vbucket 987 2015-11-29T03:51:04.359-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22170 Milliseconds Vbucket 987 2015-11-29T03:51:04.389-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22200 Milliseconds Vbucket 987 2015-11-29T03:51:04.419-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22230 Milliseconds Vbucket 987 2015-11-29T03:51:04.449-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22260 Milliseconds Vbucket 987 2015-11-29T03:51:04.479-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22290 Milliseconds Vbucket 987 2015-11-29T03:51:04.509-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22320 Milliseconds Vbucket 987 2015-11-29T03:51:04.539-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22350 Milliseconds Vbucket 987 2015-11-29T03:51:04.569-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22380 Milliseconds Vbucket 987 2015-11-29T03:51:04.599-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22410 Milliseconds Vbucket 987 2015-11-29T03:51:04.629-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22440 Milliseconds Vbucket 987 2015-11-29T03:51:04.659-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22470 Milliseconds Vbucket 987 2015-11-29T03:51:04.689-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22500 Milliseconds Vbucket 987 2015-11-29T03:51:04.719-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22530 Milliseconds Vbucket 987 2015-11-29T03:51:04.749-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22560 Milliseconds Vbucket 987 2015-11-29T03:51:04.779-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22590 Milliseconds Vbucket 987 2015-11-29T03:51:04.809-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22620 Milliseconds Vbucket 987 2015-11-29T03:51:04.839-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22650 Milliseconds Vbucket 987 2015-11-29T03:51:04.869-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22680 Milliseconds Vbucket 987 2015-11-29T03:51:04.899-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22710 Milliseconds Vbucket 987 2015-11-29T03:51:04.929-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22740 Milliseconds Vbucket 987 2015-11-29T03:51:04.959-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22770 Milliseconds Vbucket 987 2015-11-29T03:51:04.989-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22800 Milliseconds Vbucket 987 2015-11-29T03:51:05.019-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22830 Milliseconds Vbucket 987 2015-11-29T03:51:05.049-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22860 Milliseconds Vbucket 987 2015-11-29T03:51:05.079-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22890 Milliseconds Vbucket 987 2015-11-29T03:51:05.109-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22920 Milliseconds Vbucket 987 2015-11-29T03:51:05.139-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22950 Milliseconds Vbucket 987 2015-11-29T03:51:05.169-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22980 Milliseconds Vbucket 987 2015-11-29T03:51:05.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11390000 QueuedCount 27545 2015-11-29T03:51:05.199-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23010 Milliseconds Vbucket 987 2015-11-29T03:51:05.229-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23040 Milliseconds Vbucket 987 2015-11-29T03:51:05.259-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23070 Milliseconds Vbucket 987 2015-11-29T03:51:05.274-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11400000 QueuedCount 17545 2015-11-29T03:51:05.289-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23100 Milliseconds Vbucket 987 2015-11-29T03:51:05.319-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23130 Milliseconds Vbucket 987 2015-11-29T03:51:05.349-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23160 Milliseconds Vbucket 987 2015-11-29T03:51:05.379-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11410000 QueuedCount 7545 2015-11-29T03:51:05.379-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23190 Milliseconds Vbucket 987 2015-11-29T03:51:05.409-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23220 Milliseconds Vbucket 987 2015-11-29T03:51:05.439-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23250 Milliseconds Vbucket 987 2015-11-29T03:51:05.469-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23280 Milliseconds Vbucket 987 2015-11-29T03:51:05.499-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23310 Milliseconds Vbucket 987 2015-11-29T03:51:05.529-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23340 Milliseconds Vbucket 987 2015-11-29T03:51:05.559-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23370 Milliseconds Vbucket 987 2015-11-29T03:51:05.589-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23400 Milliseconds Vbucket 987 2015-11-29T03:51:05.619-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23430 Milliseconds Vbucket 987 2015-11-29T03:51:05.649-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23460 Milliseconds Vbucket 987 2015-11-29T03:51:05.679-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23490 Milliseconds Vbucket 987 2015-11-29T03:51:05.709-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23520 Milliseconds Vbucket 987 2015-11-29T03:51:05.739-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23550 Milliseconds Vbucket 987 2015-11-29T03:51:05.769-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23580 Milliseconds Vbucket 987 2015-11-29T03:51:05.799-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23610 Milliseconds Vbucket 987 2015-11-29T03:51:05.829-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23640 Milliseconds Vbucket 987 2015-11-29T03:51:05.859-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23670 Milliseconds Vbucket 987 2015-11-29T03:51:05.889-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23700 Milliseconds Vbucket 987 2015-11-29T03:51:05.919-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23730 Milliseconds Vbucket 987 2015-11-29T03:51:05.949-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23760 Milliseconds Vbucket 987 2015-11-29T03:51:05.979-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23790 Milliseconds Vbucket 987 2015-11-29T03:51:06.009-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23820 Milliseconds Vbucket 987 2015-11-29T03:51:06.039-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23850 Milliseconds Vbucket 987 2015-11-29T03:51:06.069-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23880 Milliseconds Vbucket 987 2015-11-29T03:51:06.099-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23910 Milliseconds Vbucket 987 2015-11-29T03:51:06.129-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23940 Milliseconds Vbucket 987 2015-11-29T03:51:06.159-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23970 Milliseconds Vbucket 987 2015-11-29T03:51:06.189-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24000 Milliseconds Vbucket 987 2015-11-29T03:51:06.219-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24030 Milliseconds Vbucket 987 2015-11-29T03:51:06.246-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.574µs CommitTime 770.822342ms TotalFlushTime 6m17.219218182s TotalCommitTime 51.21167597s 2015-11-29T03:51:06.246-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5715787, 5715787, 83 committed:true 2015-11-29T03:51:06.246-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5715787, 5715787, 83 committed:true) SnapCreateDur 783.550235ms SnapOpenDur 53.123µs 2015-11-29T03:51:06.249-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24060 Milliseconds Vbucket 987 2015-11-29T03:51:06.279-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:06.279-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24090 Milliseconds Vbucket 987 2015-11-29T03:51:06.309-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24120 Milliseconds Vbucket 987 2015-11-29T03:51:06.319-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:06.327-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11420000 QueuedCount 30580 2015-11-29T03:51:06.339-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24150 Milliseconds Vbucket 987 2015-11-29T03:51:06.348-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:06.388-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16010000 2015-11-29T03:51:06.459-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16020000 2015-11-29T03:51:06.577-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11430000 QueuedCount 50000 2015-11-29T03:51:06.587-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16030000 2015-11-29T03:51:06.712-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16040000 2015-11-29T03:51:06.782-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16050000 2015-11-29T03:51:06.798-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:06.833-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11440000 QueuedCount 50000 2015-11-29T03:51:06.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16060000 2015-11-29T03:51:07.032-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16070000 2015-11-29T03:51:07.064-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11450000 QueuedCount 50000 2015-11-29T03:51:07.452-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":4987540837,"bucket-1:by_email_0:avg_ts_items_count":117425,"bucket-1:by_email_0:build_progress":57,"bucket-1:by_email_0:data_size":1793999476,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":6275186688,"bucket-1:by_email_0:flush_queue_size":50034,"bucket-1:by_email_0:frag_percent":71,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":570946392,"bucket-1:by_email_0:items_count":5657173,"bucket-1:by_email_0:num_commits":83,"bucket-1:by_email_0:num_compactions":4,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":11416997,"bucket-1:by_email_0:num_docs_pending":3991531,"bucket-1:by_email_0:num_docs_queued":4591472,"bucket-1:by_email_0:num_flush_queued":11509031,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":83,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":4719814302,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"83 51211675970 1160297822518691668","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"11458998 118396367076 1249729353815112122","bucket-1:by_email_0:timings/storage_handle_open":"83 13042349695 -5190169422840629059","bucket-1:by_email_0:timings/storage_info":"333 7913961 1686646391703","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"86 441296303 158326656534864871","bucket-1:by_email_0:timings/storage_meta_set":"83 49777939 34293558500797","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"11472534 245954764275 -1199566190955872993","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":4568604,"bucket-1:num_mutations_queued":16077602,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":328,"memory_quota":104857600000,"memory_used":2351988736,"needs_restart":false,"num_connections":0,"timings/stats_response":"1797 319154483 707300975151377"} 2015-11-29T03:51:08.407-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11460000 QueuedCount 50000 2015-11-29T03:51:08.542-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:08.603-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11470000 QueuedCount 50000 2015-11-29T03:51:08.686-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16080000 2015-11-29T03:51:08.809-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16090000 2015-11-29T03:51:08.843-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11480000 QueuedCount 50000 2015-11-29T03:51:08.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16100000 2015-11-29T03:51:08.998-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:09.082-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11490000 QueuedCount 50000 2015-11-29T03:51:09.144-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16110000 2015-11-29T03:51:09.322-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11500000 QueuedCount 49519 2015-11-29T03:51:10.885-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11510000 QueuedCount 39519 2015-11-29T03:51:11.093-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11520000 QueuedCount 29519 2015-11-29T03:51:11.297-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11530000 QueuedCount 19519 2015-11-29T03:51:11.499-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11540000 QueuedCount 9519 2015-11-29T03:51:13.192-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 19.013µs CommitTime 794.129008ms TotalFlushTime 6m23.00451767s TotalCommitTime 52.005804978s 2015-11-29T03:51:13.192-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5781243, 5781243, 84 committed:true 2015-11-29T03:51:13.192-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5781243, 5781243, 84 committed:true) SnapCreateDur 820.360682ms SnapOpenDur 76.054µs 2015-11-29T03:51:13.222-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:13.225-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11550000 QueuedCount 8596 2015-11-29T03:51:13.266-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:13.266-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16120000 2015-11-29T03:51:13.338-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16130000 2015-11-29T03:51:13.398-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16140000 2015-11-29T03:51:13.439-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11560000 QueuedCount 50000 2015-11-29T03:51:13.458-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16150000 2015-11-29T03:51:13.463-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:13.522-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16160000 2015-11-29T03:51:13.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16170000 2015-11-29T03:51:13.643-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16180000 2015-11-29T03:51:13.648-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11570000 QueuedCount 50000 2015-11-29T03:51:13.849-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:13.884-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11580000 QueuedCount 50000 2015-11-29T03:51:14.107-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:14.159-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11590000 QueuedCount 50000 2015-11-29T03:51:15.544-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16190000 2015-11-29T03:51:15.651-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11600000 QueuedCount 50000 2015-11-29T03:51:16.246-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16200000 2015-11-29T03:51:16.741-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16210000 2015-11-29T03:51:16.769-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11610000 QueuedCount 50000 2015-11-29T03:51:16.979-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11620000 QueuedCount 42270 2015-11-29T03:51:17.184-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11630000 QueuedCount 32270 2015-11-29T03:51:18.161-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11640000 QueuedCount 22270 2015-11-29T03:51:18.264-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11650000 QueuedCount 12270 2015-11-29T03:51:18.37-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11660000 QueuedCount 2270 2015-11-29T03:51:19.118-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 9.222µs CommitTime 703.523889ms TotalFlushTime 6m27.945963517s TotalCommitTime 52.709328867s 2015-11-29T03:51:19.118-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5837408, 5837408, 85 committed:true 2015-11-29T03:51:19.118-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5837408, 5837408, 85 committed:true) SnapCreateDur 716.157491ms SnapOpenDur 73.172µs 2015-11-29T03:51:19.287-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11670000 QueuedCount 2896 2015-11-29T03:51:19.824-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 11.07µs CommitTime 448.439479ms TotalFlushTime 6m28.13397573s TotalCommitTime 53.157768346s 2015-11-29T03:51:19.824-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5842721, 5842721, 86 committed:true 2015-11-29T03:51:19.824-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5842721, 5842721, 86 committed:true) SnapCreateDur 474.659973ms SnapOpenDur 71.627µs 2015-11-29T03:51:19.857-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:19.885-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:19.902-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16220000 2015-11-29T03:51:19.913-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:19.938-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:19.967-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:19.98-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16230000 2015-11-29T03:51:19.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.007-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11680000 QueuedCount 37390 2015-11-29T03:51:20.052-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16240000 2015-11-29T03:51:20.095-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.121-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16250000 2015-11-29T03:51:20.186-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16260000 2015-11-29T03:51:20.221-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11690000 QueuedCount 50000 2015-11-29T03:51:20.267-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.292-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.402-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.466-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16270000 2015-11-29T03:51:20.469-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11700000 QueuedCount 50000 2015-11-29T03:51:20.532-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16280000 2015-11-29T03:51:20.644-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.667-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:20.702-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11710000 QueuedCount 50000 2015-11-29T03:51:21.957-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16290000 2015-11-29T03:51:22.666-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11720000 QueuedCount 50000 2015-11-29T03:51:22.833-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16300000 2015-11-29T03:51:22.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16310000 2015-11-29T03:51:22.906-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:22.914-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11730000 QueuedCount 49598 2015-11-29T03:51:22.961-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16320000 2015-11-29T03:51:23.024-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16330000 2015-11-29T03:51:23.089-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16340000 2015-11-29T03:51:23.131-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11740000 QueuedCount 50000 2015-11-29T03:51:23.158-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16350000 2015-11-29T03:51:23.226-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16360000 2015-11-29T03:51:23.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16370000 2015-11-29T03:51:23.356-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11750000 QueuedCount 50000 2015-11-29T03:51:24.337-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:24.34-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11760000 QueuedCount 49815 2015-11-29T03:51:24.564-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11770000 QueuedCount 50000 2015-11-29T03:51:24.807-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11780000 QueuedCount 50000 2015-11-29T03:51:25.034-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11790000 QueuedCount 45026 2015-11-29T03:51:26.16-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11800000 QueuedCount 35026 2015-11-29T03:51:26.264-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11810000 QueuedCount 25026 2015-11-29T03:51:26.379-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11820000 QueuedCount 15026 2015-11-29T03:51:26.492-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11830000 QueuedCount 5026 2015-11-29T03:51:27.433-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.546µs CommitTime 872.146804ms TotalFlushTime 6m34.467549229s TotalCommitTime 54.02991515s 2015-11-29T03:51:27.434-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5923064, 5923064, 87 committed:true 2015-11-29T03:51:27.434-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5923064, 5923064, 87 committed:true) SnapCreateDur 885.194678ms SnapOpenDur 51.038µs 2015-11-29T03:51:27.463-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:27.493-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:27.52-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:27.564-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:27.592-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16380000 2015-11-29T03:51:27.642-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11840000 QueuedCount 50000 2015-11-29T03:51:27.683-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16390000 2015-11-29T03:51:27.861-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11850000 QueuedCount 50000 2015-11-29T03:51:27.864-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16400000 2015-11-29T03:51:28.055-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:28.092-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11860000 QueuedCount 50000 2015-11-29T03:51:28.138-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16410000 2015-11-29T03:51:28.327-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11870000 QueuedCount 50000 2015-11-29T03:51:28.384-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16420000 2015-11-29T03:51:29.526-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:29.551-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11880000 QueuedCount 50000 2015-11-29T03:51:29.561-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16430000 2015-11-29T03:51:29.62-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16440000 2015-11-29T03:51:29.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11890000 QueuedCount 50000 2015-11-29T03:51:29.709-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16450000 2015-11-29T03:51:29.802-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11900000 QueuedCount 43526 2015-11-29T03:51:29.916-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11910000 QueuedCount 33526 2015-11-29T03:51:30.676-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11920000 QueuedCount 23526 2015-11-29T03:51:30.771-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11930000 QueuedCount 13526 2015-11-29T03:51:30.863-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11940000 QueuedCount 3526 2015-11-29T03:51:31.507-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.808µs CommitTime 598.824113ms TotalFlushTime 6m37.713658171s TotalCommitTime 54.628739263s 2015-11-29T03:51:31.507-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 5977389, 5977389, 88 committed:true 2015-11-29T03:51:31.507-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 5977389, 5977389, 88 committed:true) SnapCreateDur 608.85897ms SnapOpenDur 55.774µs 2015-11-29T03:51:31.539-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:31.571-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:31.604-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:31.613-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16460000 2015-11-29T03:51:31.637-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:31.687-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16470000 2015-11-29T03:51:31.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16480000 2015-11-29T03:51:31.848-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16490000 2015-11-29T03:51:31.928-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16500000 2015-11-29T03:51:32.568-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11950000 QueuedCount 50000 2015-11-29T03:51:32.828-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11960000 QueuedCount 50000 2015-11-29T03:51:32.854-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:33.098-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11970000 QueuedCount 50000 2015-11-29T03:51:33.198-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:33.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16510000 2015-11-29T03:51:33.347-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11980000 QueuedCount 50000 2015-11-29T03:51:33.434-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:33.507-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16520000 2015-11-29T03:51:34.347-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 11990000 QueuedCount 50000 2015-11-29T03:51:34.454-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:34.469-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16530000 2015-11-29T03:51:34.57-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12000000 QueuedCount 50000 2015-11-29T03:51:34.713-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16540000 2015-11-29T03:51:34.742-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:34.812-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12010000 QueuedCount 50000 2015-11-29T03:51:34.992-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16550000 2015-11-29T03:51:35.086-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12020000 QueuedCount 50000 2015-11-29T03:51:35.121-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16560000 2015-11-29T03:51:35.203-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16570000 2015-11-29T03:51:35.288-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16580000 2015-11-29T03:51:35.373-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16590000 2015-11-29T03:51:35.456-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16600000 2015-11-29T03:51:35.54-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16610000 2015-11-29T03:51:35.624-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16620000 2015-11-29T03:51:35.704-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16630000 2015-11-29T03:51:35.786-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16640000 2015-11-29T03:51:35.87-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16650000 2015-11-29T03:51:35.952-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16660000 2015-11-29T03:51:36.036-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16670000 2015-11-29T03:51:36.121-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16680000 2015-11-29T03:51:36.213-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16690000 2015-11-29T03:51:36.302-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16700000 2015-11-29T03:51:36.391-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16710000 2015-11-29T03:51:36.48-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16720000 2015-11-29T03:51:36.567-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16730000 2015-11-29T03:51:36.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16740000 2015-11-29T03:51:36.743-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16750000 2015-11-29T03:51:36.83-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16760000 2015-11-29T03:51:36.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16770000 2015-11-29T03:51:37.01-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16780000 2015-11-29T03:51:37.094-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16790000 2015-11-29T03:51:37.178-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16800000 2015-11-29T03:51:37.245-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12030000 QueuedCount 40010 2015-11-29T03:51:37.265-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16810000 2015-11-29T03:51:37.349-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16820000 2015-11-29T03:51:37.436-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16830000 2015-11-29T03:51:37.441-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12040000 QueuedCount 30010 2015-11-29T03:51:37.528-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16840000 2015-11-29T03:51:37.619-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16850000 2015-11-29T03:51:37.653-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12050000 QueuedCount 20010 2015-11-29T03:51:37.706-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16860000 2015-11-29T03:51:37.803-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16870000 2015-11-29T03:51:37.855-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12060000 QueuedCount 10010 2015-11-29T03:51:37.894-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16880000 2015-11-29T03:51:37.982-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16890000 2015-11-29T03:51:38.065-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16900000 2015-11-29T03:51:38.154-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16910000 2015-11-29T03:51:38.241-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16920000 2015-11-29T03:51:38.327-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16930000 2015-11-29T03:51:38.771-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12070000 QueuedCount 10 2015-11-29T03:51:39.399-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 10.54µs CommitTime 594.850121ms TotalFlushTime 6m44.634591729s TotalCommitTime 55.223589384s 2015-11-29T03:51:39.399-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6039188, 6039188, 89 committed:true 2015-11-29T03:51:39.399-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6039188, 6039188, 89 committed:true) SnapCreateDur 622.276733ms SnapOpenDur 59.66µs 2015-11-29T03:51:39.432-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:39.455-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:39.48-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:39.514-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:39.627-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:39.64-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12080000 QueuedCount 49327 2015-11-29T03:51:39.869-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12090000 QueuedCount 50000 2015-11-29T03:51:40.113-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12100000 QueuedCount 50000 2015-11-29T03:51:40.204-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:40.35-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12110000 QueuedCount 50000 2015-11-29T03:51:41.401-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12120000 QueuedCount 50000 2015-11-29T03:51:41.831-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12130000 QueuedCount 42328 2015-11-29T03:51:42.696-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12140000 QueuedCount 32328 2015-11-29T03:51:42.898-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12150000 QueuedCount 22328 2015-11-29T03:51:43.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 861 2015-11-29T03:51:43.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 861 2015-11-29T03:51:43.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 861 2015-11-29T03:51:43.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 861 2015-11-29T03:51:43.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 861 2015-11-29T03:51:43.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 861 2015-11-29T03:51:43.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 861 2015-11-29T03:51:43.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 861 2015-11-29T03:51:43.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 861 2015-11-29T03:51:43.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 861 2015-11-29T03:51:43.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 861 2015-11-29T03:51:43.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 861 2015-11-29T03:51:43.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 861 2015-11-29T03:51:43.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 861 2015-11-29T03:51:43.815-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12160000 QueuedCount 12328 2015-11-29T03:51:43.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 861 2015-11-29T03:51:43.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 861 2015-11-29T03:51:43.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 861 2015-11-29T03:51:43.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 861 2015-11-29T03:51:43.917-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12170000 QueuedCount 2328 2015-11-29T03:51:43.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 861 2015-11-29T03:51:43.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 861 2015-11-29T03:51:43.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 861 2015-11-29T03:51:44.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 861 2015-11-29T03:51:44.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 861 2015-11-29T03:51:44.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 861 2015-11-29T03:51:44.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 861 2015-11-29T03:51:44.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 861 2015-11-29T03:51:44.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 861 2015-11-29T03:51:44.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 861 2015-11-29T03:51:44.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 861 2015-11-29T03:51:44.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 861 2015-11-29T03:51:44.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 861 2015-11-29T03:51:44.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 861 2015-11-29T03:51:44.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 861 2015-11-29T03:51:44.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 861 2015-11-29T03:51:44.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 861 2015-11-29T03:51:44.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 861 2015-11-29T03:51:44.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 861 2015-11-29T03:51:44.487-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.208µs CommitTime 529.69658ms TotalFlushTime 6m48.918931392s TotalCommitTime 55.753285964s 2015-11-29T03:51:44.487-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6090112, 6090112, 90 committed:true 2015-11-29T03:51:44.487-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6090112, 6090112, 90 committed:true) SnapCreateDur 542.340523ms SnapOpenDur 51.501µs 2015-11-29T03:51:44.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 861 2015-11-29T03:51:44.512-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:44.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 861 2015-11-29T03:51:44.542-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:44.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 861 2015-11-29T03:51:44.576-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:44.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 861 2015-11-29T03:51:44.621-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:44.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 861 2015-11-29T03:51:44.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 861 2015-11-29T03:51:44.684-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12180000 QueuedCount 50000 2015-11-29T03:51:44.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 861 2015-11-29T03:51:44.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 861 2015-11-29T03:51:44.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 861 2015-11-29T03:51:44.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 861 2015-11-29T03:51:44.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 861 2015-11-29T03:51:44.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 861 2015-11-29T03:51:44.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 861 2015-11-29T03:51:44.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 861 2015-11-29T03:51:44.91-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12190000 QueuedCount 50000 2015-11-29T03:51:44.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 861 2015-11-29T03:51:44.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 861 2015-11-29T03:51:44.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 861 2015-11-29T03:51:45.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 861 2015-11-29T03:51:45.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 861 2015-11-29T03:51:45.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 861 2015-11-29T03:51:45.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 861 2015-11-29T03:51:45.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 861 2015-11-29T03:51:45.157-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12200000 QueuedCount 50000 2015-11-29T03:51:45.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 861 2015-11-29T03:51:45.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 861 2015-11-29T03:51:45.202-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:45.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 861 2015-11-29T03:51:45.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 861 2015-11-29T03:51:45.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 861 2015-11-29T03:51:45.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 861 2015-11-29T03:51:45.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 861 2015-11-29T03:51:45.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 861 2015-11-29T03:51:45.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 861 2015-11-29T03:51:45.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 861 2015-11-29T03:51:45.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 861 2015-11-29T03:51:45.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 861 2015-11-29T03:51:45.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 861 2015-11-29T03:51:45.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 861 2015-11-29T03:51:45.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 861 2015-11-29T03:51:45.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 861 2015-11-29T03:51:45.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 861 2015-11-29T03:51:45.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 861 2015-11-29T03:51:45.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 861 2015-11-29T03:51:45.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 861 2015-11-29T03:51:45.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 861 2015-11-29T03:51:45.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 861 2015-11-29T03:51:45.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 861 2015-11-29T03:51:45.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 861 2015-11-29T03:51:45.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 861 2015-11-29T03:51:45.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 861 2015-11-29T03:51:45.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 861 2015-11-29T03:51:45.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 861 2015-11-29T03:51:46.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 861 2015-11-29T03:51:46.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 861 2015-11-29T03:51:46.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 861 2015-11-29T03:51:46.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 861 2015-11-29T03:51:46.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 861 2015-11-29T03:51:46.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 861 2015-11-29T03:51:46.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 861 2015-11-29T03:51:46.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 861 2015-11-29T03:51:46.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 861 2015-11-29T03:51:46.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 861 2015-11-29T03:51:46.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 861 2015-11-29T03:51:46.313-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12210000 QueuedCount 50000 2015-11-29T03:51:46.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 861 2015-11-29T03:51:46.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 861 2015-11-29T03:51:46.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 861 2015-11-29T03:51:46.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 861 2015-11-29T03:51:46.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 861 2015-11-29T03:51:46.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 861 2015-11-29T03:51:46.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 861 2015-11-29T03:51:46.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 861 2015-11-29T03:51:46.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 861 2015-11-29T03:51:46.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 861 2015-11-29T03:51:46.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 861 2015-11-29T03:51:46.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 861 2015-11-29T03:51:46.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 861 2015-11-29T03:51:46.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 861 2015-11-29T03:51:46.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 861 2015-11-29T03:51:46.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 861 2015-11-29T03:51:46.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 861 2015-11-29T03:51:46.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 861 2015-11-29T03:51:46.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 861 2015-11-29T03:51:46.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 861 2015-11-29T03:51:46.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 861 2015-11-29T03:51:46.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 861 2015-11-29T03:51:46.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 861 2015-11-29T03:51:47.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 861 2015-11-29T03:51:47.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 861 2015-11-29T03:51:47.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 861 2015-11-29T03:51:47.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 861 2015-11-29T03:51:47.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 861 2015-11-29T03:51:47.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 861 2015-11-29T03:51:47.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 861 2015-11-29T03:51:47.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 861 2015-11-29T03:51:47.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 861 2015-11-29T03:51:47.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 861 2015-11-29T03:51:47.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 861 2015-11-29T03:51:47.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 861 2015-11-29T03:51:47.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 861 2015-11-29T03:51:47.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 861 2015-11-29T03:51:47.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 861 2015-11-29T03:51:47.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 861 2015-11-29T03:51:47.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 861 2015-11-29T03:51:47.529-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:47.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 861 2015-11-29T03:51:47.551-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12220000 QueuedCount 49641 2015-11-29T03:51:47.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 861 2015-11-29T03:51:47.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 861 2015-11-29T03:51:47.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 861 2015-11-29T03:51:47.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 861 2015-11-29T03:51:47.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 861 2015-11-29T03:51:47.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 861 2015-11-29T03:51:47.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 861 2015-11-29T03:51:47.774-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12230000 QueuedCount 46806 2015-11-29T03:51:47.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 861 2015-11-29T03:51:47.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 861 2015-11-29T03:51:47.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 861 2015-11-29T03:51:47.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 861 2015-11-29T03:51:47.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 861 2015-11-29T03:51:47.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 861 2015-11-29T03:51:47.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 861 2015-11-29T03:51:47.98-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12240000 QueuedCount 36806 2015-11-29T03:51:47.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 861 2015-11-29T03:51:48.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 861 2015-11-29T03:51:48.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 861 2015-11-29T03:51:48.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 861 2015-11-29T03:51:48.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 861 2015-11-29T03:51:48.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 861 2015-11-29T03:51:48.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 861 2015-11-29T03:51:48.18-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12250000 QueuedCount 26806 2015-11-29T03:51:48.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 861 2015-11-29T03:51:48.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 861 2015-11-29T03:51:48.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 861 2015-11-29T03:51:48.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 861 2015-11-29T03:51:48.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 861 2015-11-29T03:51:48.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 861 2015-11-29T03:51:48.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 861 2015-11-29T03:51:48.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 861 2015-11-29T03:51:48.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 861 2015-11-29T03:51:48.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 861 2015-11-29T03:51:48.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 861 2015-11-29T03:51:48.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 861 2015-11-29T03:51:48.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 861 2015-11-29T03:51:48.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 861 2015-11-29T03:51:48.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 861 2015-11-29T03:51:48.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 861 2015-11-29T03:51:48.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 861 2015-11-29T03:51:48.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 861 2015-11-29T03:51:48.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 861 2015-11-29T03:51:48.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 861 2015-11-29T03:51:48.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 861 2015-11-29T03:51:48.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 861 2015-11-29T03:51:48.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 861 2015-11-29T03:51:48.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 861 2015-11-29T03:51:48.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 861 2015-11-29T03:51:48.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 861 2015-11-29T03:51:48.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 861 2015-11-29T03:51:48.998-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12260000 QueuedCount 16806 2015-11-29T03:51:49.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 861 2015-11-29T03:51:49.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 861 2015-11-29T03:51:49.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 861 2015-11-29T03:51:49.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 861 2015-11-29T03:51:49.104-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12270000 QueuedCount 6806 2015-11-29T03:51:49.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 861 2015-11-29T03:51:49.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 861 2015-11-29T03:51:49.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 861 2015-11-29T03:51:49.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 861 2015-11-29T03:51:49.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 861 2015-11-29T03:51:49.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 861 2015-11-29T03:51:49.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 861 2015-11-29T03:51:49.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 861 2015-11-29T03:51:49.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 861 2015-11-29T03:51:49.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 861 2015-11-29T03:51:49.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 861 2015-11-29T03:51:49.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 861 2015-11-29T03:51:49.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 861 2015-11-29T03:51:49.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 861 2015-11-29T03:51:49.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 861 2015-11-29T03:51:49.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 861 2015-11-29T03:51:49.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 861 2015-11-29T03:51:49.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 861 2015-11-29T03:51:49.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 861 2015-11-29T03:51:49.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 861 2015-11-29T03:51:49.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 861 2015-11-29T03:51:49.73-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.109µs CommitTime 537.557858ms TotalFlushTime 6m53.346178125s TotalCommitTime 56.290843822s 2015-11-29T03:51:49.73-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6141901, 6141901, 91 committed:true 2015-11-29T03:51:49.73-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6141901, 6141901, 91 committed:true) SnapCreateDur 550.239087ms SnapOpenDur 55.744µs 2015-11-29T03:51:49.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:49.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 861 2015-11-29T03:51:49.777-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:49.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 861 2015-11-29T03:51:49.814-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:49.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 861 2015-11-29T03:51:49.821-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12280000 QueuedCount 19924 2015-11-29T03:51:49.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 861 2015-11-29T03:51:49.847-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:49.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 861 2015-11-29T03:51:49.881-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:49.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 861 2015-11-29T03:51:49.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 861 2015-11-29T03:51:49.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 861 2015-11-29T03:51:49.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 861 2015-11-29T03:51:50.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 861 2015-11-29T03:51:50.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 861 2015-11-29T03:51:50.066-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12290000 QueuedCount 50000 2015-11-29T03:51:50.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 861 2015-11-29T03:51:50.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 861 2015-11-29T03:51:50.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 861 2015-11-29T03:51:50.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 861 2015-11-29T03:51:50.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 861 2015-11-29T03:51:50.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 861 2015-11-29T03:51:50.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 861 2015-11-29T03:51:50.288-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12300000 QueuedCount 50000 2015-11-29T03:51:50.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 861 2015-11-29T03:51:50.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 861 2015-11-29T03:51:50.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 861 2015-11-29T03:51:50.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 861 2015-11-29T03:51:50.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 861 2015-11-29T03:51:50.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 861 2015-11-29T03:51:50.458-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:50.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 861 2015-11-29T03:51:50.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 861 2015-11-29T03:51:50.513-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12310000 QueuedCount 49999 2015-11-29T03:51:50.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 861 2015-11-29T03:51:50.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 861 2015-11-29T03:51:50.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 861 2015-11-29T03:51:50.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 861 2015-11-29T03:51:50.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 861 2015-11-29T03:51:50.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 861 2015-11-29T03:51:50.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 861 2015-11-29T03:51:50.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 861 2015-11-29T03:51:50.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 861 2015-11-29T03:51:50.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 861 2015-11-29T03:51:50.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 861 2015-11-29T03:51:50.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 861 2015-11-29T03:51:50.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 861 2015-11-29T03:51:50.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 861 2015-11-29T03:51:50.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 861 2015-11-29T03:51:50.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 861 2015-11-29T03:51:51.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 861 2015-11-29T03:51:51.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 861 2015-11-29T03:51:51.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 861 2015-11-29T03:51:51.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 861 2015-11-29T03:51:51.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 861 2015-11-29T03:51:51.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 861 2015-11-29T03:51:51.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 861 2015-11-29T03:51:51.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 861 2015-11-29T03:51:51.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 861 2015-11-29T03:51:51.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 861 2015-11-29T03:51:51.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 861 2015-11-29T03:51:51.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 861 2015-11-29T03:51:51.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 861 2015-11-29T03:51:51.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 861 2015-11-29T03:51:51.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 861 2015-11-29T03:51:51.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 861 2015-11-29T03:51:51.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 861 2015-11-29T03:51:51.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 861 2015-11-29T03:51:51.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 861 2015-11-29T03:51:51.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 861 2015-11-29T03:51:51.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 861 2015-11-29T03:51:51.622-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12320000 QueuedCount 50000 2015-11-29T03:51:51.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 861 2015-11-29T03:51:51.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 861 2015-11-29T03:51:51.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 861 2015-11-29T03:51:51.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 861 2015-11-29T03:51:51.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 861 2015-11-29T03:51:51.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 861 2015-11-29T03:51:51.806-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12330000 QueuedCount 50000 2015-11-29T03:51:51.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 861 2015-11-29T03:51:51.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 861 2015-11-29T03:51:51.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 861 2015-11-29T03:51:51.91-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:51.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 861 2015-11-29T03:51:51.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 861 2015-11-29T03:51:51.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 861 2015-11-29T03:51:52.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 861 2015-11-29T03:51:52.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 861 2015-11-29T03:51:52.038-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12340000 QueuedCount 50000 2015-11-29T03:51:52.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 861 2015-11-29T03:51:52.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 861 2015-11-29T03:51:52.117-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:52.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 861 2015-11-29T03:51:52.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 861 2015-11-29T03:51:52.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 861 2015-11-29T03:51:52.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 861 2015-11-29T03:51:52.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 861 2015-11-29T03:51:52.271-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:52.275-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12350000 QueuedCount 49830 2015-11-29T03:51:52.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 861 2015-11-29T03:51:52.293-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:52.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 861 2015-11-29T03:51:52.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 861 2015-11-29T03:51:52.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 861 2015-11-29T03:51:52.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 861 2015-11-29T03:51:52.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 861 2015-11-29T03:51:52.433-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:52.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 861 2015-11-29T03:51:52.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 861 2015-11-29T03:51:52.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 861 2015-11-29T03:51:52.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 861 2015-11-29T03:51:52.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 861 2015-11-29T03:51:52.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 861 2015-11-29T03:51:52.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 861 2015-11-29T03:51:52.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 861 2015-11-29T03:51:52.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 861 2015-11-29T03:51:52.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 861 2015-11-29T03:51:52.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 861 2015-11-29T03:51:52.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 861 2015-11-29T03:51:52.817-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 861 2015-11-29T03:51:52.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 861 2015-11-29T03:51:52.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 861 2015-11-29T03:51:52.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 861 2015-11-29T03:51:52.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 861 2015-11-29T03:51:52.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 861 2015-11-29T03:51:52.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 861 2015-11-29T03:51:53.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 861 2015-11-29T03:51:53.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 861 2015-11-29T03:51:53.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 861 2015-11-29T03:51:53.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 861 2015-11-29T03:51:53.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 861 2015-11-29T03:51:53.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 861 2015-11-29T03:51:53.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 861 2015-11-29T03:51:53.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 861 2015-11-29T03:51:53.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 861 2015-11-29T03:51:53.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 861 2015-11-29T03:51:53.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 861 2015-11-29T03:51:53.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 861 2015-11-29T03:51:53.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 861 2015-11-29T03:51:53.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 861 2015-11-29T03:51:53.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 861 2015-11-29T03:51:53.467-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:53.467-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12360000 QueuedCount 49961 2015-11-29T03:51:53.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 861 2015-11-29T03:51:53.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 861 2015-11-29T03:51:53.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 861 2015-11-29T03:51:53.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 861 2015-11-29T03:51:53.586-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12370000 QueuedCount 47500 2015-11-29T03:51:53.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 861 2015-11-29T03:51:53.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 861 2015-11-29T03:51:53.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 861 2015-11-29T03:51:53.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 861 2015-11-29T03:51:53.694-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12380000 QueuedCount 37500 2015-11-29T03:51:53.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 861 2015-11-29T03:51:53.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 861 2015-11-29T03:51:53.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 861 2015-11-29T03:51:53.803-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12390000 QueuedCount 27500 2015-11-29T03:51:53.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 861 2015-11-29T03:51:53.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 861 2015-11-29T03:51:53.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 861 2015-11-29T03:51:53.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 861 2015-11-29T03:51:53.909-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12400000 QueuedCount 17500 2015-11-29T03:51:53.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 861 2015-11-29T03:51:53.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 861 2015-11-29T03:51:53.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 861 2015-11-29T03:51:54.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 861 2015-11-29T03:51:54.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 861 2015-11-29T03:51:54.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 861 2015-11-29T03:51:54.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 861 2015-11-29T03:51:54.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 861 2015-11-29T03:51:54.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 861 2015-11-29T03:51:54.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 861 2015-11-29T03:51:54.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 861 2015-11-29T03:51:54.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 861 2015-11-29T03:51:54.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 861 2015-11-29T03:51:54.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 861 2015-11-29T03:51:54.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 861 2015-11-29T03:51:54.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 861 2015-11-29T03:51:54.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 861 2015-11-29T03:51:54.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 861 2015-11-29T03:51:54.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 861 2015-11-29T03:51:54.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 861 2015-11-29T03:51:54.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 861 2015-11-29T03:51:54.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 861 2015-11-29T03:51:54.572-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12410000 QueuedCount 7500 2015-11-29T03:51:54.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 861 2015-11-29T03:51:54.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 861 2015-11-29T03:51:54.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 861 2015-11-29T03:51:54.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 861 2015-11-29T03:51:54.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 861 2015-11-29T03:51:54.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 861 2015-11-29T03:51:54.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 861 2015-11-29T03:51:54.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 861 2015-11-29T03:51:54.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 861 2015-11-29T03:51:54.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 861 2015-11-29T03:51:54.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 861 2015-11-29T03:51:54.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 861 2015-11-29T03:51:54.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 861 2015-11-29T03:51:54.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 861 2015-11-29T03:51:55.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 861 2015-11-29T03:51:55.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 861 2015-11-29T03:51:55.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 861 2015-11-29T03:51:55.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 861 2015-11-29T03:51:55.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 861 2015-11-29T03:51:55.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 861 2015-11-29T03:51:55.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 861 2015-11-29T03:51:55.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 861 2015-11-29T03:51:55.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 861 2015-11-29T03:51:55.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 861 2015-11-29T03:51:55.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 861 2015-11-29T03:51:55.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 861 2015-11-29T03:51:55.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 861 2015-11-29T03:51:55.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 861 2015-11-29T03:51:55.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 861 2015-11-29T03:51:55.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 861 2015-11-29T03:51:55.469-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.553µs CommitTime 803.251627ms TotalFlushTime 6m57.908038691s TotalCommitTime 57.094095449s 2015-11-29T03:51:55.469-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6211520, 6211520, 92 committed:true 2015-11-29T03:51:55.469-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6211520, 6211520, 92 committed:true) SnapCreateDur 830.161336ms SnapOpenDur 47.797µs 2015-11-29T03:51:55.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 861 2015-11-29T03:51:55.491-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:55.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 861 2015-11-29T03:51:55.528-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:55.542-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12420000 QueuedCount 15686 2015-11-29T03:51:55.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 861 2015-11-29T03:51:55.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 861 2015-11-29T03:51:55.58-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:55.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 861 2015-11-29T03:51:55.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 861 2015-11-29T03:51:55.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 861 2015-11-29T03:51:55.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 861 2015-11-29T03:51:55.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 861 2015-11-29T03:51:55.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 861 2015-11-29T03:51:55.765-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12430000 QueuedCount 50000 2015-11-29T03:51:55.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 861 2015-11-29T03:51:55.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 861 2015-11-29T03:51:55.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 861 2015-11-29T03:51:55.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 861 2015-11-29T03:51:55.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 861 2015-11-29T03:51:55.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 861 2015-11-29T03:51:55.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 861 2015-11-29T03:51:55.985-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12440000 QueuedCount 50000 2015-11-29T03:51:55.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 861 2015-11-29T03:51:56.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 861 2015-11-29T03:51:56.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 861 2015-11-29T03:51:56.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 861 2015-11-29T03:51:56.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 861 2015-11-29T03:51:56.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 861 2015-11-29T03:51:56.174-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:56.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 861 2015-11-29T03:51:56.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 861 2015-11-29T03:51:56.21-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12450000 QueuedCount 50000 2015-11-29T03:51:56.221-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:56.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 861 2015-11-29T03:51:56.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 861 2015-11-29T03:51:56.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 861 2015-11-29T03:51:56.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 861 2015-11-29T03:51:56.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 861 2015-11-29T03:51:56.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 861 2015-11-29T03:51:56.392-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:56.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 861 2015-11-29T03:51:56.438-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:56.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 861 2015-11-29T03:51:56.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 861 2015-11-29T03:51:56.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 861 2015-11-29T03:51:56.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 861 2015-11-29T03:51:56.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 861 2015-11-29T03:51:56.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 861 2015-11-29T03:51:56.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 861 2015-11-29T03:51:56.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 861 2015-11-29T03:51:56.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 861 2015-11-29T03:51:56.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 861 2015-11-29T03:51:56.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 861 2015-11-29T03:51:56.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 861 2015-11-29T03:51:56.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 861 2015-11-29T03:51:56.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 861 2015-11-29T03:51:56.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18480 Milliseconds Vbucket 861 2015-11-29T03:51:56.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18510 Milliseconds Vbucket 861 2015-11-29T03:51:56.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18540 Milliseconds Vbucket 861 2015-11-29T03:51:56.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18570 Milliseconds Vbucket 861 2015-11-29T03:51:56.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18600 Milliseconds Vbucket 861 2015-11-29T03:51:57.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18630 Milliseconds Vbucket 861 2015-11-29T03:51:57.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18660 Milliseconds Vbucket 861 2015-11-29T03:51:57.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18690 Milliseconds Vbucket 861 2015-11-29T03:51:57.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18720 Milliseconds Vbucket 861 2015-11-29T03:51:57.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18750 Milliseconds Vbucket 861 2015-11-29T03:51:57.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18780 Milliseconds Vbucket 861 2015-11-29T03:51:57.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18810 Milliseconds Vbucket 861 2015-11-29T03:51:57.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18840 Milliseconds Vbucket 861 2015-11-29T03:51:57.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18870 Milliseconds Vbucket 861 2015-11-29T03:51:57.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18900 Milliseconds Vbucket 861 2015-11-29T03:51:57.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18930 Milliseconds Vbucket 861 2015-11-29T03:51:57.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18960 Milliseconds Vbucket 861 2015-11-29T03:51:57.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18990 Milliseconds Vbucket 861 2015-11-29T03:51:57.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19020 Milliseconds Vbucket 861 2015-11-29T03:51:57.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19050 Milliseconds Vbucket 861 2015-11-29T03:51:57.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19080 Milliseconds Vbucket 861 2015-11-29T03:51:57.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19110 Milliseconds Vbucket 861 2015-11-29T03:51:57.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19140 Milliseconds Vbucket 861 2015-11-29T03:51:57.532-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12460000 QueuedCount 50000 2015-11-29T03:51:57.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19170 Milliseconds Vbucket 861 2015-11-29T03:51:57.579-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:57.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19200 Milliseconds Vbucket 861 2015-11-29T03:51:57.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19230 Milliseconds Vbucket 861 2015-11-29T03:51:57.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19260 Milliseconds Vbucket 861 2015-11-29T03:51:57.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19290 Milliseconds Vbucket 861 2015-11-29T03:51:57.678-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:57.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19320 Milliseconds Vbucket 861 2015-11-29T03:51:57.709-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12470000 QueuedCount 50000 2015-11-29T03:51:57.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19350 Milliseconds Vbucket 861 2015-11-29T03:51:57.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19380 Milliseconds Vbucket 861 2015-11-29T03:51:57.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19410 Milliseconds Vbucket 861 2015-11-29T03:51:57.808-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:57.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19440 Milliseconds Vbucket 861 2015-11-29T03:51:57.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19470 Milliseconds Vbucket 861 2015-11-29T03:51:57.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19500 Milliseconds Vbucket 861 2015-11-29T03:51:57.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19530 Milliseconds Vbucket 861 2015-11-29T03:51:57.933-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12480000 QueuedCount 50000 2015-11-29T03:51:57.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19560 Milliseconds Vbucket 861 2015-11-29T03:51:57.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19590 Milliseconds Vbucket 861 2015-11-29T03:51:58.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19620 Milliseconds Vbucket 861 2015-11-29T03:51:58.006-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:58.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19650 Milliseconds Vbucket 861 2015-11-29T03:51:58.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19680 Milliseconds Vbucket 861 2015-11-29T03:51:58.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19710 Milliseconds Vbucket 861 2015-11-29T03:51:58.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19740 Milliseconds Vbucket 861 2015-11-29T03:51:58.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19770 Milliseconds Vbucket 861 2015-11-29T03:51:58.159-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:58.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12490000 QueuedCount 49374 2015-11-29T03:51:58.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19800 Milliseconds Vbucket 861 2015-11-29T03:51:58.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19830 Milliseconds Vbucket 861 2015-11-29T03:51:58.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19860 Milliseconds Vbucket 861 2015-11-29T03:51:58.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19890 Milliseconds Vbucket 861 2015-11-29T03:51:58.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19920 Milliseconds Vbucket 861 2015-11-29T03:51:58.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19950 Milliseconds Vbucket 861 2015-11-29T03:51:58.347-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:58.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19980 Milliseconds Vbucket 861 2015-11-29T03:51:58.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20010 Milliseconds Vbucket 861 2015-11-29T03:51:58.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20040 Milliseconds Vbucket 861 2015-11-29T03:51:58.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20070 Milliseconds Vbucket 861 2015-11-29T03:51:58.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20100 Milliseconds Vbucket 861 2015-11-29T03:51:58.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20130 Milliseconds Vbucket 861 2015-11-29T03:51:58.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20160 Milliseconds Vbucket 861 2015-11-29T03:51:58.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20190 Milliseconds Vbucket 861 2015-11-29T03:51:58.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20220 Milliseconds Vbucket 861 2015-11-29T03:51:58.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20250 Milliseconds Vbucket 861 2015-11-29T03:51:58.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20280 Milliseconds Vbucket 861 2015-11-29T03:51:58.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20310 Milliseconds Vbucket 861 2015-11-29T03:51:58.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20340 Milliseconds Vbucket 861 2015-11-29T03:51:58.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20370 Milliseconds Vbucket 861 2015-11-29T03:51:58.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20400 Milliseconds Vbucket 861 2015-11-29T03:51:58.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20430 Milliseconds Vbucket 861 2015-11-29T03:51:58.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20460 Milliseconds Vbucket 861 2015-11-29T03:51:58.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20490 Milliseconds Vbucket 861 2015-11-29T03:51:58.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20520 Milliseconds Vbucket 861 2015-11-29T03:51:58.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20550 Milliseconds Vbucket 861 2015-11-29T03:51:58.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20580 Milliseconds Vbucket 861 2015-11-29T03:51:58.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20610 Milliseconds Vbucket 861 2015-11-29T03:51:59.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20640 Milliseconds Vbucket 861 2015-11-29T03:51:59.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20670 Milliseconds Vbucket 861 2015-11-29T03:51:59.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20700 Milliseconds Vbucket 861 2015-11-29T03:51:59.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20730 Milliseconds Vbucket 861 2015-11-29T03:51:59.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20760 Milliseconds Vbucket 861 2015-11-29T03:51:59.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20790 Milliseconds Vbucket 861 2015-11-29T03:51:59.202-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12500000 QueuedCount 50000 2015-11-29T03:51:59.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20820 Milliseconds Vbucket 861 2015-11-29T03:51:59.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20850 Milliseconds Vbucket 861 2015-11-29T03:51:59.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20880 Milliseconds Vbucket 861 2015-11-29T03:51:59.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20910 Milliseconds Vbucket 861 2015-11-29T03:51:59.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20940 Milliseconds Vbucket 861 2015-11-29T03:51:59.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20970 Milliseconds Vbucket 861 2015-11-29T03:51:59.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21000 Milliseconds Vbucket 861 2015-11-29T03:51:59.414-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12510000 QueuedCount 50000 2015-11-29T03:51:59.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21030 Milliseconds Vbucket 861 2015-11-29T03:51:59.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21060 Milliseconds Vbucket 861 2015-11-29T03:51:59.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21090 Milliseconds Vbucket 861 2015-11-29T03:51:59.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21120 Milliseconds Vbucket 861 2015-11-29T03:51:59.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21150 Milliseconds Vbucket 861 2015-11-29T03:51:59.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21180 Milliseconds Vbucket 861 2015-11-29T03:51:59.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21210 Milliseconds Vbucket 861 2015-11-29T03:51:59.616-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:51:59.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21240 Milliseconds Vbucket 861 2015-11-29T03:51:59.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21270 Milliseconds Vbucket 861 2015-11-29T03:51:59.658-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12520000 QueuedCount 50000 2015-11-29T03:51:59.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21300 Milliseconds Vbucket 861 2015-11-29T03:51:59.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21330 Milliseconds Vbucket 861 2015-11-29T03:51:59.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21360 Milliseconds Vbucket 861 2015-11-29T03:51:59.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21390 Milliseconds Vbucket 861 2015-11-29T03:51:59.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21420 Milliseconds Vbucket 861 2015-11-29T03:51:59.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21450 Milliseconds Vbucket 861 2015-11-29T03:51:59.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21480 Milliseconds Vbucket 861 2015-11-29T03:51:59.881-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12530000 QueuedCount 50000 2015-11-29T03:51:59.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21510 Milliseconds Vbucket 861 2015-11-29T03:51:59.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21540 Milliseconds Vbucket 861 2015-11-29T03:51:59.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21570 Milliseconds Vbucket 861 2015-11-29T03:51:59.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21600 Milliseconds Vbucket 861 2015-11-29T03:52:00.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21630 Milliseconds Vbucket 861 2015-11-29T03:52:00.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21660 Milliseconds Vbucket 861 2015-11-29T03:52:00.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21690 Milliseconds Vbucket 861 2015-11-29T03:52:00.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21720 Milliseconds Vbucket 861 2015-11-29T03:52:00.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21750 Milliseconds Vbucket 861 2015-11-29T03:52:00.147-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12540000 QueuedCount 50000 2015-11-29T03:52:00.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21780 Milliseconds Vbucket 861 2015-11-29T03:52:00.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21810 Milliseconds Vbucket 861 2015-11-29T03:52:00.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21840 Milliseconds Vbucket 861 2015-11-29T03:52:00.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21870 Milliseconds Vbucket 861 2015-11-29T03:52:00.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21900 Milliseconds Vbucket 861 2015-11-29T03:52:00.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21930 Milliseconds Vbucket 861 2015-11-29T03:52:00.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21960 Milliseconds Vbucket 861 2015-11-29T03:52:00.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21990 Milliseconds Vbucket 861 2015-11-29T03:52:00.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22020 Milliseconds Vbucket 861 2015-11-29T03:52:00.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22050 Milliseconds Vbucket 861 2015-11-29T03:52:00.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22080 Milliseconds Vbucket 861 2015-11-29T03:52:00.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22110 Milliseconds Vbucket 861 2015-11-29T03:52:00.526-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22140 Milliseconds Vbucket 861 2015-11-29T03:52:00.556-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22170 Milliseconds Vbucket 861 2015-11-29T03:52:00.586-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22200 Milliseconds Vbucket 861 2015-11-29T03:52:00.616-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22230 Milliseconds Vbucket 861 2015-11-29T03:52:00.646-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22260 Milliseconds Vbucket 861 2015-11-29T03:52:00.676-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22290 Milliseconds Vbucket 861 2015-11-29T03:52:00.706-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22320 Milliseconds Vbucket 861 2015-11-29T03:52:00.736-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22350 Milliseconds Vbucket 861 2015-11-29T03:52:00.766-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22380 Milliseconds Vbucket 861 2015-11-29T03:52:00.796-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22410 Milliseconds Vbucket 861 2015-11-29T03:52:00.826-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22440 Milliseconds Vbucket 861 2015-11-29T03:52:00.856-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22470 Milliseconds Vbucket 861 2015-11-29T03:52:00.886-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22500 Milliseconds Vbucket 861 2015-11-29T03:52:00.916-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22530 Milliseconds Vbucket 861 2015-11-29T03:52:00.946-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22560 Milliseconds Vbucket 861 2015-11-29T03:52:00.976-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22590 Milliseconds Vbucket 861 2015-11-29T03:52:01.006-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22620 Milliseconds Vbucket 861 2015-11-29T03:52:01.036-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22650 Milliseconds Vbucket 861 2015-11-29T03:52:01.066-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22680 Milliseconds Vbucket 861 2015-11-29T03:52:01.096-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22710 Milliseconds Vbucket 861 2015-11-29T03:52:01.126-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22740 Milliseconds Vbucket 861 2015-11-29T03:52:01.142-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12550000 QueuedCount 48709 2015-11-29T03:52:01.156-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22770 Milliseconds Vbucket 861 2015-11-29T03:52:01.186-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22800 Milliseconds Vbucket 861 2015-11-29T03:52:01.216-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22830 Milliseconds Vbucket 861 2015-11-29T03:52:01.244-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12560000 QueuedCount 38709 2015-11-29T03:52:01.246-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22860 Milliseconds Vbucket 861 2015-11-29T03:52:01.276-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22890 Milliseconds Vbucket 861 2015-11-29T03:52:01.306-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22920 Milliseconds Vbucket 861 2015-11-29T03:52:01.336-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22950 Milliseconds Vbucket 861 2015-11-29T03:52:01.358-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12570000 QueuedCount 28709 2015-11-29T03:52:01.366-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 22980 Milliseconds Vbucket 861 2015-11-29T03:52:01.396-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23010 Milliseconds Vbucket 861 2015-11-29T03:52:01.426-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23040 Milliseconds Vbucket 861 2015-11-29T03:52:01.456-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23070 Milliseconds Vbucket 861 2015-11-29T03:52:01.462-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12580000 QueuedCount 18709 2015-11-29T03:52:01.486-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23100 Milliseconds Vbucket 861 2015-11-29T03:52:01.516-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23130 Milliseconds Vbucket 861 2015-11-29T03:52:01.546-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23160 Milliseconds Vbucket 861 2015-11-29T03:52:01.576-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23190 Milliseconds Vbucket 861 2015-11-29T03:52:01.606-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23220 Milliseconds Vbucket 861 2015-11-29T03:52:01.636-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23250 Milliseconds Vbucket 861 2015-11-29T03:52:01.666-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23280 Milliseconds Vbucket 861 2015-11-29T03:52:01.696-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23310 Milliseconds Vbucket 861 2015-11-29T03:52:01.726-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23340 Milliseconds Vbucket 861 2015-11-29T03:52:01.756-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23370 Milliseconds Vbucket 861 2015-11-29T03:52:01.786-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23400 Milliseconds Vbucket 861 2015-11-29T03:52:01.816-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23430 Milliseconds Vbucket 861 2015-11-29T03:52:01.846-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23460 Milliseconds Vbucket 861 2015-11-29T03:52:01.876-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23490 Milliseconds Vbucket 861 2015-11-29T03:52:01.906-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23520 Milliseconds Vbucket 861 2015-11-29T03:52:01.936-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23550 Milliseconds Vbucket 861 2015-11-29T03:52:01.966-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23580 Milliseconds Vbucket 861 2015-11-29T03:52:01.996-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23610 Milliseconds Vbucket 861 2015-11-29T03:52:02.026-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23640 Milliseconds Vbucket 861 2015-11-29T03:52:02.056-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23670 Milliseconds Vbucket 861 2015-11-29T03:52:02.086-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23700 Milliseconds Vbucket 861 2015-11-29T03:52:02.116-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23730 Milliseconds Vbucket 861 2015-11-29T03:52:02.14-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12590000 QueuedCount 8709 2015-11-29T03:52:02.146-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23760 Milliseconds Vbucket 861 2015-11-29T03:52:02.176-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23790 Milliseconds Vbucket 861 2015-11-29T03:52:02.206-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23820 Milliseconds Vbucket 861 2015-11-29T03:52:02.236-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23850 Milliseconds Vbucket 861 2015-11-29T03:52:02.266-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23880 Milliseconds Vbucket 861 2015-11-29T03:52:02.296-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23910 Milliseconds Vbucket 861 2015-11-29T03:52:02.326-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23940 Milliseconds Vbucket 861 2015-11-29T03:52:02.356-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 23970 Milliseconds Vbucket 861 2015-11-29T03:52:02.386-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24000 Milliseconds Vbucket 861 2015-11-29T03:52:02.416-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24030 Milliseconds Vbucket 861 2015-11-29T03:52:02.446-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24060 Milliseconds Vbucket 861 2015-11-29T03:52:02.476-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24090 Milliseconds Vbucket 861 2015-11-29T03:52:02.506-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24120 Milliseconds Vbucket 861 2015-11-29T03:52:02.536-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24150 Milliseconds Vbucket 861 2015-11-29T03:52:02.566-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24180 Milliseconds Vbucket 861 2015-11-29T03:52:02.596-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24210 Milliseconds Vbucket 861 2015-11-29T03:52:02.626-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24240 Milliseconds Vbucket 861 2015-11-29T03:52:02.656-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24270 Milliseconds Vbucket 861 2015-11-29T03:52:02.686-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24300 Milliseconds Vbucket 861 2015-11-29T03:52:02.695-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 6.89µs CommitTime 458.011941ms TotalFlushTime 7m4.167700517s TotalCommitTime 57.55210739s 2015-11-29T03:52:02.696-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6301730, 6301730, 93 committed:true 2015-11-29T03:52:02.696-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6301730, 6301730, 93 committed:true) SnapCreateDur 468.019111ms SnapOpenDur 61.099µs 2015-11-29T03:52:02.716-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24330 Milliseconds Vbucket 861 2015-11-29T03:52:02.746-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24360 Milliseconds Vbucket 861 2015-11-29T03:52:02.746-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:02.756-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12600000 QueuedCount 30572 2015-11-29T03:52:02.776-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24390 Milliseconds Vbucket 861 2015-11-29T03:52:02.782-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:02.806-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24420 Milliseconds Vbucket 861 2015-11-29T03:52:02.836-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24450 Milliseconds Vbucket 861 2015-11-29T03:52:02.857-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:02.866-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24480 Milliseconds Vbucket 861 2015-11-29T03:52:02.894-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:02.896-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24510 Milliseconds Vbucket 861 2015-11-29T03:52:02.926-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24540 Milliseconds Vbucket 861 2015-11-29T03:52:02.956-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24570 Milliseconds Vbucket 861 2015-11-29T03:52:02.972-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12610000 QueuedCount 50000 2015-11-29T03:52:02.986-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24600 Milliseconds Vbucket 861 2015-11-29T03:52:03.016-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24630 Milliseconds Vbucket 861 2015-11-29T03:52:03.046-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24660 Milliseconds Vbucket 861 2015-11-29T03:52:03.076-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24690 Milliseconds Vbucket 861 2015-11-29T03:52:03.106-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24720 Milliseconds Vbucket 861 2015-11-29T03:52:03.136-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24750 Milliseconds Vbucket 861 2015-11-29T03:52:03.166-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24780 Milliseconds Vbucket 861 2015-11-29T03:52:03.196-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24810 Milliseconds Vbucket 861 2015-11-29T03:52:03.197-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:03.198-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12620000 QueuedCount 49935 2015-11-29T03:52:03.226-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24840 Milliseconds Vbucket 861 2015-11-29T03:52:03.256-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24870 Milliseconds Vbucket 861 2015-11-29T03:52:03.286-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24900 Milliseconds Vbucket 861 2015-11-29T03:52:03.316-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24930 Milliseconds Vbucket 861 2015-11-29T03:52:03.346-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24960 Milliseconds Vbucket 861 2015-11-29T03:52:03.376-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 24990 Milliseconds Vbucket 861 2015-11-29T03:52:03.406-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25020 Milliseconds Vbucket 861 2015-11-29T03:52:03.43-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12630000 QueuedCount 50000 2015-11-29T03:52:03.436-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25050 Milliseconds Vbucket 861 2015-11-29T03:52:03.466-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25080 Milliseconds Vbucket 861 2015-11-29T03:52:03.494-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:03.496-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 25110 Milliseconds Vbucket 861 2015-11-29T03:52:03.625-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:04.588-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12640000 QueuedCount 50000 2015-11-29T03:52:04.593-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:04.654-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:04.658-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16940000 2015-11-29T03:52:04.709-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12650000 QueuedCount 50000 2015-11-29T03:52:04.783-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16950000 2015-11-29T03:52:04.82-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12660000 QueuedCount 45001 2015-11-29T03:52:04.928-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12670000 QueuedCount 35001 2015-11-29T03:52:05.043-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12680000 QueuedCount 25001 2015-11-29T03:52:05.76-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12690000 QueuedCount 15001 2015-11-29T03:52:05.849-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12700000 QueuedCount 5001 2015-11-29T03:52:06.47-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.95µs CommitTime 562.707065ms TotalFlushTime 7m7.140770692s TotalCommitTime 58.114814455s 2015-11-29T03:52:06.47-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6354723, 6354723, 94 committed:true 2015-11-29T03:52:06.47-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6354723, 6354723, 94 committed:true) SnapCreateDur 573.356865ms SnapOpenDur 46.565µs 2015-11-29T03:52:06.493-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:06.524-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:06.575-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:06.607-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12710000 QueuedCount 50000 2015-11-29T03:52:06.635-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16960000 2015-11-29T03:52:06.814-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12720000 QueuedCount 50000 2015-11-29T03:52:06.993-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:07.024-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16970000 2015-11-29T03:52:07.031-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12730000 QueuedCount 50000 2015-11-29T03:52:07.243-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16980000 2015-11-29T03:52:07.285-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12740000 QueuedCount 50000 2015-11-29T03:52:07.37-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:07.452-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5095849470,"bucket-1:by_email_0:avg_ts_items_count":129472,"bucket-1:by_email_0:build_progress":63,"bucket-1:by_email_0:data_size":2004656627,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":8098848768,"bucket-1:by_email_0:flush_queue_size":50042,"bucket-1:by_email_0:frag_percent":75,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":635800662,"bucket-1:by_email_0:items_count":6301730,"bucket-1:by_email_0:num_commits":94,"bucket-1:by_email_0:num_compactions":4,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":12688481,"bucket-1:by_email_0:num_docs_pending":3062956,"bucket-1:by_email_0:num_docs_queued":4248563,"bucket-1:by_email_0:num_flush_queued":12796370,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":94,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":3774630947,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"94 58114814455 5701233838015490719","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"12746329 131963896633 1249903531049901341","bucket-1:by_email_0:timings/storage_handle_open":"94 13042745659 -5190169407910605215","bucket-1:by_email_0:timings/storage_info":"377 9117657 1938314397369","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"97 446207209 158329216059452069","bucket-1:by_email_0:timings/storage_meta_set":"94 55161150 37461814207570","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"12750406 280634065904 -225316392201077758","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":4187592,"bucket-1:num_mutations_queued":16983921,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":305,"memory_quota":104857600000,"memory_used":3679924224,"needs_restart":false,"num_connections":0,"timings/stats_response":"1869 346327188 717926428683728"} 2015-11-29T03:52:08.518-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12750000 QueuedCount 50000 2015-11-29T03:52:08.56-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:08.569-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 16990000 2015-11-29T03:52:08.582-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:08.657-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12760000 QueuedCount 50000 2015-11-29T03:52:08.662-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:08.721-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17000000 2015-11-29T03:52:08.74-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:08.795-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17010000 2015-11-29T03:52:08.858-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12770000 QueuedCount 50000 2015-11-29T03:52:08.892-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17020000 2015-11-29T03:52:09.228-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:10.03-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:10.042-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12780000 QueuedCount 49524 2015-11-29T03:52:11.302-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12790000 QueuedCount 50000 2015-11-29T03:52:11.443-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12800000 QueuedCount 46299 2015-11-29T03:52:11.567-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12810000 QueuedCount 36299 2015-11-29T03:52:11.693-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12820000 QueuedCount 26299 2015-11-29T03:52:12.449-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12830000 QueuedCount 16299 2015-11-29T03:52:12.552-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12840000 QueuedCount 6299 2015-11-29T03:52:13.226-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.618µs CommitTime 587.919263ms TotalFlushTime 7m12.971138341s TotalCommitTime 58.702733718s 2015-11-29T03:52:13.226-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6424879, 6424879, 95 committed:true 2015-11-29T03:52:13.226-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6424879, 6424879, 95 committed:true) SnapCreateDur 601.242561ms SnapOpenDur 55.658µs 2015-11-29T03:52:13.277-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:13.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17030000 2015-11-29T03:52:13.341-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12850000 QueuedCount 50000 2015-11-29T03:52:13.403-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:13.492-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17040000 2015-11-29T03:52:13.545-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12860000 QueuedCount 50000 2015-11-29T03:52:13.705-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17050000 2015-11-29T03:52:13.758-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:13.763-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12870000 QueuedCount 49769 2015-11-29T03:52:13.779-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:13.837-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17060000 2015-11-29T03:52:13.927-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:14.002-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12880000 QueuedCount 50000 2015-11-29T03:52:14.039-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:14.14-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17070000 2015-11-29T03:52:15.105-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:15.109-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12890000 QueuedCount 49577 2015-11-29T03:52:15.198-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17080000 2015-11-29T03:52:15.23-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12900000 QueuedCount 48681 2015-11-29T03:52:15.27-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17090000 2015-11-29T03:52:15.336-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12910000 QueuedCount 38681 2015-11-29T03:52:15.352-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17100000 2015-11-29T03:52:15.433-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17110000 2015-11-29T03:52:15.442-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12920000 QueuedCount 28681 2015-11-29T03:52:15.515-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17120000 2015-11-29T03:52:15.599-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17130000 2015-11-29T03:52:15.685-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17140000 2015-11-29T03:52:15.767-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17150000 2015-11-29T03:52:15.851-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17160000 2015-11-29T03:52:15.929-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17170000 2015-11-29T03:52:16.014-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17180000 2015-11-29T03:52:16.144-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12930000 QueuedCount 18681 2015-11-29T03:52:16.232-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12940000 QueuedCount 8681 2015-11-29T03:52:16.787-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.796µs CommitTime 473.57468ms TotalFlushTime 7m15.849988211s TotalCommitTime 59.176308398s 2015-11-29T03:52:16.787-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6475898, 6475898, 96 committed:true 2015-11-29T03:52:16.787-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6475898, 6475898, 96 committed:true) SnapCreateDur 483.705872ms SnapOpenDur 41.856µs 2015-11-29T03:52:16.817-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.837-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.865-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.888-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.919-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.943-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:16.969-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:17.179-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12950000 QueuedCount 49999 2015-11-29T03:52:17.857-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12960000 QueuedCount 50000 2015-11-29T03:52:17.975-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:18.095-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12970000 QueuedCount 50000 2015-11-29T03:52:18.369-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12980000 QueuedCount 50000 2015-11-29T03:52:18.601-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:19.557-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 12990000 QueuedCount 50000 2015-11-29T03:52:19.561-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:20.258-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:20.352-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13000000 QueuedCount 50000 2015-11-29T03:52:20.564-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13010000 QueuedCount 42072 2015-11-29T03:52:20.772-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13020000 QueuedCount 32072 2015-11-29T03:52:20.981-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13030000 QueuedCount 22072 2015-11-29T03:52:21.063-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 903 2015-11-29T03:52:21.093-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 903 2015-11-29T03:52:21.123-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 903 2015-11-29T03:52:21.153-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 903 2015-11-29T03:52:21.183-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 903 2015-11-29T03:52:21.213-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 903 2015-11-29T03:52:21.243-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 903 2015-11-29T03:52:21.273-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 903 2015-11-29T03:52:21.303-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 903 2015-11-29T03:52:21.333-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 903 2015-11-29T03:52:21.363-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 903 2015-11-29T03:52:21.393-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 903 2015-11-29T03:52:21.423-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 903 2015-11-29T03:52:21.453-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 903 2015-11-29T03:52:21.483-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 903 2015-11-29T03:52:21.513-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 903 2015-11-29T03:52:21.543-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 903 2015-11-29T03:52:21.573-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 903 2015-11-29T03:52:21.603-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 903 2015-11-29T03:52:21.633-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 903 2015-11-29T03:52:21.663-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 903 2015-11-29T03:52:21.693-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 903 2015-11-29T03:52:21.723-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 903 2015-11-29T03:52:21.753-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 903 2015-11-29T03:52:21.783-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 903 2015-11-29T03:52:21.813-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 903 2015-11-29T03:52:21.843-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 903 2015-11-29T03:52:21.866-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13040000 QueuedCount 12072 2015-11-29T03:52:21.873-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 903 2015-11-29T03:52:21.903-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 903 2015-11-29T03:52:21.933-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 903 2015-11-29T03:52:21.963-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 903 2015-11-29T03:52:21.972-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13050000 QueuedCount 2072 2015-11-29T03:52:21.993-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 903 2015-11-29T03:52:22.023-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 903 2015-11-29T03:52:22.053-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 903 2015-11-29T03:52:22.083-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 903 2015-11-29T03:52:22.113-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 903 2015-11-29T03:52:22.143-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 903 2015-11-29T03:52:22.173-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 903 2015-11-29T03:52:22.203-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 903 2015-11-29T03:52:22.233-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 903 2015-11-29T03:52:22.263-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 903 2015-11-29T03:52:22.293-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 903 2015-11-29T03:52:22.323-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 903 2015-11-29T03:52:22.353-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 903 2015-11-29T03:52:22.383-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 903 2015-11-29T03:52:22.413-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 903 2015-11-29T03:52:22.443-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 903 2015-11-29T03:52:22.473-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 903 2015-11-29T03:52:22.503-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 903 2015-11-29T03:52:22.533-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 903 2015-11-29T03:52:22.563-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 903 2015-11-29T03:52:22.593-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 903 2015-11-29T03:52:22.623-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 903 2015-11-29T03:52:22.653-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 903 2015-11-29T03:52:22.683-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 903 2015-11-29T03:52:22.713-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 903 2015-11-29T03:52:22.743-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 903 2015-11-29T03:52:22.773-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 903 2015-11-29T03:52:22.803-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 903 2015-11-29T03:52:22.833-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 903 2015-11-29T03:52:22.863-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 903 2015-11-29T03:52:22.893-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 903 2015-11-29T03:52:22.923-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 903 2015-11-29T03:52:22.94-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.625µs CommitTime 912.215667ms TotalFlushTime 7m20.796952086s TotalCommitTime 1m0.088524065s 2015-11-29T03:52:22.941-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6527144, 6527144, 97 committed:true 2015-11-29T03:52:22.941-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6527144, 6527144, 97 committed:true) SnapCreateDur 938.739505ms SnapOpenDur 53.814µs 2015-11-29T03:52:22.953-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 903 2015-11-29T03:52:22.971-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:22.983-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 903 2015-11-29T03:52:22.994-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.013-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 903 2015-11-29T03:52:23.023-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.043-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 903 2015-11-29T03:52:23.044-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.069-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.073-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 903 2015-11-29T03:52:23.101-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.103-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 903 2015-11-29T03:52:23.118-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13060000 QueuedCount 29036 2015-11-29T03:52:23.133-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.133-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 903 2015-11-29T03:52:23.157-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.163-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 903 2015-11-29T03:52:23.193-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 903 2015-11-29T03:52:23.223-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 903 2015-11-29T03:52:23.253-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 903 2015-11-29T03:52:23.283-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 903 2015-11-29T03:52:23.313-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 903 2015-11-29T03:52:23.343-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 903 2015-11-29T03:52:23.35-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13070000 QueuedCount 50000 2015-11-29T03:52:23.373-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 903 2015-11-29T03:52:23.403-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 903 2015-11-29T03:52:23.433-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 903 2015-11-29T03:52:23.463-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 903 2015-11-29T03:52:23.493-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 903 2015-11-29T03:52:23.523-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 903 2015-11-29T03:52:23.553-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 903 2015-11-29T03:52:23.57-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13080000 QueuedCount 50000 2015-11-29T03:52:23.575-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:23.583-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 903 2015-11-29T03:52:23.679-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17190000 2015-11-29T03:52:23.784-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13090000 QueuedCount 50000 2015-11-29T03:52:24.969-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17200000 2015-11-29T03:52:24.997-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13100000 QueuedCount 50000 2015-11-29T03:52:25.061-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17210000 2015-11-29T03:52:25.124-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17220000 2015-11-29T03:52:25.125-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13110000 QueuedCount 50000 2015-11-29T03:52:25.141-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:25.189-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17230000 2015-11-29T03:52:25.25-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17240000 2015-11-29T03:52:25.319-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17250000 2015-11-29T03:52:25.327-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13120000 QueuedCount 50000 2015-11-29T03:52:25.381-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17260000 2015-11-29T03:52:25.558-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13130000 QueuedCount 50000 2015-11-29T03:52:26.671-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:26.672-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13140000 QueuedCount 49890 2015-11-29T03:52:26.893-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13150000 QueuedCount 50000 2015-11-29T03:52:27.123-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13160000 QueuedCount 50000 2015-11-29T03:52:27.362-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13170000 QueuedCount 48867 2015-11-29T03:52:28.535-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13180000 QueuedCount 38867 2015-11-29T03:52:28.654-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13190000 QueuedCount 28867 2015-11-29T03:52:28.767-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13200000 QueuedCount 18867 2015-11-29T03:52:28.882-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13210000 QueuedCount 8867 2015-11-29T03:52:30.398-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 919 2015-11-29T03:52:30.428-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 919 2015-11-29T03:52:30.458-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 919 2015-11-29T03:52:30.488-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 919 2015-11-29T03:52:30.518-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 919 2015-11-29T03:52:30.548-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 919 2015-11-29T03:52:30.578-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 919 2015-11-29T03:52:30.608-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 919 2015-11-29T03:52:30.638-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 919 2015-11-29T03:52:30.668-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 919 2015-11-29T03:52:30.698-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 919 2015-11-29T03:52:30.728-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 919 2015-11-29T03:52:30.758-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 919 2015-11-29T03:52:30.788-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 919 2015-11-29T03:52:30.818-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 919 2015-11-29T03:52:30.848-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 919 2015-11-29T03:52:30.878-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 919 2015-11-29T03:52:30.908-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 919 2015-11-29T03:52:30.938-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 919 2015-11-29T03:52:30.968-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 919 2015-11-29T03:52:30.998-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 919 2015-11-29T03:52:31.028-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 919 2015-11-29T03:52:31.058-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 919 2015-11-29T03:52:31.088-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 919 2015-11-29T03:52:31.118-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 919 2015-11-29T03:52:31.148-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 919 2015-11-29T03:52:31.178-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 919 2015-11-29T03:52:31.208-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 919 2015-11-29T03:52:31.238-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 919 2015-11-29T03:52:31.268-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 919 2015-11-29T03:52:31.298-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 919 2015-11-29T03:52:31.328-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 919 2015-11-29T03:52:31.358-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 919 2015-11-29T03:52:31.388-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 919 2015-11-29T03:52:31.418-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 919 2015-11-29T03:52:31.448-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 919 2015-11-29T03:52:31.478-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 919 2015-11-29T03:52:31.506-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 18.164µs CommitTime 1.818490445s TotalFlushTime 7m27.102259835s TotalCommitTime 1m1.90701451s 2015-11-29T03:52:31.506-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6609205, 6609205, 98 committed:true 2015-11-29T03:52:31.506-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6609205, 6609205, 98 committed:true) SnapCreateDur 1.847840042s SnapOpenDur 84.083µs 2015-11-29T03:52:31.508-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 919 2015-11-29T03:52:31.538-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 919 2015-11-29T03:52:31.552-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:31.561-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13220000 QueuedCount 24339 2015-11-29T03:52:31.568-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 919 2015-11-29T03:52:31.596-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:31.598-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 919 2015-11-29T03:52:31.628-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 919 2015-11-29T03:52:31.658-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 919 2015-11-29T03:52:31.688-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 919 2015-11-29T03:52:31.718-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 919 2015-11-29T03:52:31.748-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 919 2015-11-29T03:52:31.778-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 919 2015-11-29T03:52:31.784-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13230000 QueuedCount 50000 2015-11-29T03:52:31.808-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 919 2015-11-29T03:52:31.838-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 919 2015-11-29T03:52:31.868-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 919 2015-11-29T03:52:31.898-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 919 2015-11-29T03:52:31.928-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 919 2015-11-29T03:52:31.958-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 919 2015-11-29T03:52:31.988-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 919 2015-11-29T03:52:32.018-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 919 2015-11-29T03:52:32.041-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13240000 QueuedCount 50000 2015-11-29T03:52:32.048-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 919 2015-11-29T03:52:32.078-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 919 2015-11-29T03:52:32.108-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 919 2015-11-29T03:52:32.117-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:32.349-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13250000 QueuedCount 50000 2015-11-29T03:52:32.354-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17270000 2015-11-29T03:52:32.592-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13260000 QueuedCount 50000 2015-11-29T03:52:33.694-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13270000 QueuedCount 50000 2015-11-29T03:52:33.797-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13280000 QueuedCount 41175 2015-11-29T03:52:33.902-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13290000 QueuedCount 31175 2015-11-29T03:52:34.01-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13300000 QueuedCount 21175 2015-11-29T03:52:34.74-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13310000 QueuedCount 11175 2015-11-29T03:52:34.825-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13320000 QueuedCount 1175 2015-11-29T03:52:35.893-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 11.706µs CommitTime 1.029056215s TotalFlushTime 7m30.204874312s TotalCommitTime 1m2.936070725s 2015-11-29T03:52:35.893-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6659288, 6659288, 99 committed:true 2015-11-29T03:52:35.893-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6659288, 6659288, 99 committed:true) SnapCreateDur 1.055781284s SnapOpenDur 64.346µs 2015-11-29T03:52:35.939-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:35.981-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:36.004-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:36.028-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:36.104-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17280000 2015-11-29T03:52:36.109-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13330000 QueuedCount 50000 2015-11-29T03:52:36.167-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17290000 2015-11-29T03:52:36.329-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13340000 QueuedCount 50000 2015-11-29T03:52:36.554-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13350000 QueuedCount 50000 2015-11-29T03:52:36.636-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:36.71-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17300000 2015-11-29T03:52:36.779-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13360000 QueuedCount 50000 2015-11-29T03:52:37.758-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:37.818-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13370000 QueuedCount 50000 2015-11-29T03:52:37.855-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17310000 2015-11-29T03:52:37.996-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13380000 QueuedCount 50000 2015-11-29T03:52:38.226-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13390000 QueuedCount 46156 2015-11-29T03:52:38.442-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13400000 QueuedCount 36156 2015-11-29T03:52:39.38-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13410000 QueuedCount 26156 2015-11-29T03:52:39.489-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13420000 QueuedCount 16156 2015-11-29T03:52:39.602-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13430000 QueuedCount 6156 2015-11-29T03:52:40.418-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.735µs CommitTime 723.002869ms TotalFlushTime 7m33.767584282s TotalCommitTime 1m3.659073594s 2015-11-29T03:52:40.418-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6715921, 6715921, 100 committed:true 2015-11-29T03:52:40.418-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6715921, 6715921, 100 committed:true) SnapCreateDur 735.68068ms SnapOpenDur 58.162µs 2015-11-29T03:52:40.456-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:40.493-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:40.526-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13440000 QueuedCount 42511 2015-11-29T03:52:40.529-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:40.561-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17320000 2015-11-29T03:52:40.625-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17330000 2015-11-29T03:52:40.696-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17340000 2015-11-29T03:52:40.793-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13450000 QueuedCount 50000 2015-11-29T03:52:40.918-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17350000 2015-11-29T03:52:40.955-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:41.026-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17360000 2015-11-29T03:52:41.08-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13460000 QueuedCount 50000 2015-11-29T03:52:41.304-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13470000 QueuedCount 50000 2015-11-29T03:52:41.33-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17370000 2015-11-29T03:52:41.441-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:42.531-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13480000 QueuedCount 50000 2015-11-29T03:52:42.536-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17380000 2015-11-29T03:52:42.673-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13490000 QueuedCount 50000 2015-11-29T03:52:42.686-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17390000 2015-11-29T03:52:42.752-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:42.801-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13500000 QueuedCount 50000 2015-11-29T03:52:42.807-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17400000 2015-11-29T03:52:42.869-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:42.873-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17410000 2015-11-29T03:52:42.938-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17420000 2015-11-29T03:52:43.013-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17430000 2015-11-29T03:52:43.016-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13510000 QueuedCount 47165 2015-11-29T03:52:43.097-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17440000 2015-11-29T03:52:43.189-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17450000 2015-11-29T03:52:43.278-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17460000 2015-11-29T03:52:44.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13520000 QueuedCount 37165 2015-11-29T03:52:44.185-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13530000 QueuedCount 27165 2015-11-29T03:52:44.29-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13540000 QueuedCount 17165 2015-11-29T03:52:44.397-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13550000 QueuedCount 7165 2015-11-29T03:52:45.295-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 3.707µs CommitTime 804.669497ms TotalFlushTime 7m37.584858529s TotalCommitTime 1m4.463743091s 2015-11-29T03:52:45.295-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6775414, 6775414, 101 committed:true 2015-11-29T03:52:45.295-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6775414, 6775414, 101 committed:true) SnapCreateDur 817.299486ms SnapOpenDur 41.031µs 2015-11-29T03:52:45.325-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.351-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.373-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.383-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13560000 QueuedCount 13683 2015-11-29T03:52:45.403-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.427-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.46-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.472-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17470000 2015-11-29T03:52:45.491-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:45.542-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17480000 2015-11-29T03:52:45.629-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13570000 QueuedCount 50000 2015-11-29T03:52:45.858-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13580000 QueuedCount 50000 2015-11-29T03:52:46.013-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:46.081-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13590000 QueuedCount 50000 2015-11-29T03:52:46.272-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17490000 2015-11-29T03:52:47.185-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13600000 QueuedCount 49999 2015-11-29T03:52:47.227-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:47.365-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:47.378-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13610000 QueuedCount 49351 2015-11-29T03:52:47.39-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17500000 2015-11-29T03:52:47.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17510000 2015-11-29T03:52:47.603-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:47.609-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13620000 QueuedCount 49663 2015-11-29T03:52:47.694-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:47.847-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13630000 QueuedCount 50000 2015-11-29T03:52:47.871-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:48.09-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13640000 QueuedCount 50000 2015-11-29T03:52:49.146-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13650000 QueuedCount 48415 2015-11-29T03:52:49.25-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13660000 QueuedCount 38415 2015-11-29T03:52:49.354-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13670000 QueuedCount 28415 2015-11-29T03:52:49.459-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13680000 QueuedCount 18415 2015-11-29T03:52:50.117-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13690000 QueuedCount 8415 2015-11-29T03:52:50.696-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.527µs CommitTime 488.068296ms TotalFlushTime 7m42.154044928s TotalCommitTime 1m4.951811387s 2015-11-29T03:52:50.696-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6845374, 6845374, 102 committed:true 2015-11-29T03:52:50.696-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6845374, 6845374, 102 committed:true) SnapCreateDur 498.133796ms SnapOpenDur 39.964µs 2015-11-29T03:52:50.721-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:50.761-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13700000 QueuedCount 26038 2015-11-29T03:52:50.765-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17520000 2015-11-29T03:52:50.769-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:50.861-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17530000 2015-11-29T03:52:51.022-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13710000 QueuedCount 50000 2015-11-29T03:52:51.167-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:51.253-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13720000 QueuedCount 50000 2015-11-29T03:52:51.317-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17540000 2015-11-29T03:52:51.485-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:51.49-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13730000 QueuedCount 49700 2015-11-29T03:52:51.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17550000 2015-11-29T03:52:51.656-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:51.677-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:51.694-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17560000 2015-11-29T03:52:51.707-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13740000 QueuedCount 50000 2015-11-29T03:52:52.782-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13750000 QueuedCount 50000 2015-11-29T03:52:52.885-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:53.022-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13760000 QueuedCount 50000 2015-11-29T03:52:53.028-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17570000 2015-11-29T03:52:53.093-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17580000 2015-11-29T03:52:53.165-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17590000 2015-11-29T03:52:53.232-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13770000 QueuedCount 45294 2015-11-29T03:52:53.248-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17600000 2015-11-29T03:52:53.433-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13780000 QueuedCount 35294 2015-11-29T03:52:54.319-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13790000 QueuedCount 25294 2015-11-29T03:52:54.421-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13800000 QueuedCount 15294 2015-11-29T03:52:54.525-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13810000 QueuedCount 5294 2015-11-29T03:52:55.359-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.341µs CommitTime 759.531836ms TotalFlushTime 7m45.773434329s TotalCommitTime 1m5.711343223s 2015-11-29T03:52:55.359-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6903159, 6903159, 103 committed:true 2015-11-29T03:52:55.359-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6903159, 6903159, 103 committed:true) SnapCreateDur 772.103171ms SnapOpenDur 44.704µs 2015-11-29T03:52:55.382-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:55.412-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:55.448-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:55.47-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:55.475-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13820000 QueuedCount 26480 2015-11-29T03:52:55.622-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:55.699-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13830000 QueuedCount 50000 2015-11-29T03:52:55.922-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13840000 QueuedCount 50000 2015-11-29T03:52:56.145-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13850000 QueuedCount 50000 2015-11-29T03:52:57.271-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13860000 QueuedCount 50000 2015-11-29T03:52:57.294-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:57.503-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13870000 QueuedCount 50000 2015-11-29T03:52:57.805-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13880000 QueuedCount 50000 2015-11-29T03:52:57.855-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:58.043-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:52:58.055-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13890000 QueuedCount 49409 2015-11-29T03:52:58.274-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 980 2015-11-29T03:52:58.304-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 980 2015-11-29T03:52:58.334-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 980 2015-11-29T03:52:58.364-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 980 2015-11-29T03:52:58.394-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 980 2015-11-29T03:52:58.424-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 980 2015-11-29T03:52:58.454-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 980 2015-11-29T03:52:58.484-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 980 2015-11-29T03:52:58.514-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 980 2015-11-29T03:52:58.544-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 980 2015-11-29T03:52:58.574-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 980 2015-11-29T03:52:58.604-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 980 2015-11-29T03:52:58.634-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 980 2015-11-29T03:52:58.664-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 980 2015-11-29T03:52:58.694-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 980 2015-11-29T03:52:58.724-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 980 2015-11-29T03:52:58.754-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 980 2015-11-29T03:52:58.784-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 980 2015-11-29T03:52:58.814-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 980 2015-11-29T03:52:58.844-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 980 2015-11-29T03:52:58.874-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 980 2015-11-29T03:52:58.904-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 980 2015-11-29T03:52:58.934-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 980 2015-11-29T03:52:58.964-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 980 2015-11-29T03:52:58.994-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 980 2015-11-29T03:52:59.024-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 980 2015-11-29T03:52:59.054-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 980 2015-11-29T03:52:59.084-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 980 2015-11-29T03:52:59.114-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 980 2015-11-29T03:52:59.136-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13900000 QueuedCount 47271 2015-11-29T03:52:59.144-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 980 2015-11-29T03:52:59.174-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 980 2015-11-29T03:52:59.204-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 980 2015-11-29T03:52:59.234-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 980 2015-11-29T03:52:59.237-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13910000 QueuedCount 37271 2015-11-29T03:52:59.264-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 980 2015-11-29T03:52:59.294-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 980 2015-11-29T03:52:59.324-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 980 2015-11-29T03:52:59.351-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13920000 QueuedCount 27271 2015-11-29T03:52:59.354-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 980 2015-11-29T03:52:59.384-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 980 2015-11-29T03:52:59.414-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 980 2015-11-29T03:52:59.444-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 980 2015-11-29T03:52:59.459-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13930000 QueuedCount 17271 2015-11-29T03:52:59.474-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 980 2015-11-29T03:52:59.504-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 980 2015-11-29T03:52:59.534-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 980 2015-11-29T03:52:59.564-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 980 2015-11-29T03:52:59.594-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 980 2015-11-29T03:52:59.624-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 980 2015-11-29T03:52:59.654-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 980 2015-11-29T03:52:59.684-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 980 2015-11-29T03:52:59.714-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 980 2015-11-29T03:52:59.744-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 980 2015-11-29T03:52:59.774-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 980 2015-11-29T03:52:59.804-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 980 2015-11-29T03:52:59.834-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 980 2015-11-29T03:52:59.864-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 980 2015-11-29T03:52:59.894-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 980 2015-11-29T03:52:59.927-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 980 2015-11-29T03:52:59.954-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 980 2015-11-29T03:52:59.984-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 980 2015-11-29T03:53:00.014-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 980 2015-11-29T03:53:00.044-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 980 2015-11-29T03:53:00.074-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 980 2015-11-29T03:53:00.104-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 980 2015-11-29T03:53:00.134-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 980 2015-11-29T03:53:00.164-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 980 2015-11-29T03:53:00.17-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13940000 QueuedCount 7271 2015-11-29T03:53:00.194-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 980 2015-11-29T03:53:00.224-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 980 2015-11-29T03:53:00.254-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 980 2015-11-29T03:53:00.284-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 980 2015-11-29T03:53:00.314-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 980 2015-11-29T03:53:00.344-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 980 2015-11-29T03:53:00.374-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 980 2015-11-29T03:53:00.404-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 980 2015-11-29T03:53:00.434-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 980 2015-11-29T03:53:00.464-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 980 2015-11-29T03:53:00.494-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 980 2015-11-29T03:53:00.524-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 980 2015-11-29T03:53:00.554-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 980 2015-11-29T03:53:00.584-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 980 2015-11-29T03:53:00.599-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 5.482µs CommitTime 354.115558ms TotalFlushTime 7m50.300660593s TotalCommitTime 1m6.065458781s 2015-11-29T03:53:00.599-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 6968385, 6968385, 104 committed:true 2015-11-29T03:53:00.599-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 6968385, 6968385, 104 committed:true) SnapCreateDur 363.965945ms SnapOpenDur 46.104µs 2015-11-29T03:53:00.614-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 980 2015-11-29T03:53:00.637-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:00.644-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 980 2015-11-29T03:53:00.665-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:00.674-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 980 2015-11-29T03:53:00.687-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13950000 QueuedCount 23071 2015-11-29T03:53:00.698-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:00.723-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:00.753-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:00.757-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17610000 2015-11-29T03:53:00.821-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17620000 2015-11-29T03:53:00.882-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17630000 2015-11-29T03:53:00.898-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13960000 QueuedCount 50000 2015-11-29T03:53:01.119-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13970000 QueuedCount 50000 2015-11-29T03:53:01.122-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17640000 2015-11-29T03:53:01.244-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17650000 2015-11-29T03:53:01.313-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13980000 QueuedCount 50000 2015-11-29T03:53:01.359-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:01.453-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17660000 2015-11-29T03:53:01.525-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17670000 2015-11-29T03:53:01.611-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17680000 2015-11-29T03:53:01.689-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17690000 2015-11-29T03:53:01.764-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17700000 2015-11-29T03:53:01.841-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17710000 2015-11-29T03:53:01.919-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17720000 2015-11-29T03:53:01.997-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17730000 2015-11-29T03:53:02.076-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17740000 2015-11-29T03:53:02.161-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17750000 2015-11-29T03:53:02.252-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17760000 2015-11-29T03:53:02.34-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17770000 2015-11-29T03:53:02.43-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17780000 2015-11-29T03:53:02.52-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17790000 2015-11-29T03:53:02.605-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17800000 2015-11-29T03:53:02.687-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17810000 2015-11-29T03:53:02.77-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17820000 2015-11-29T03:53:02.853-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17830000 2015-11-29T03:53:02.936-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17840000 2015-11-29T03:53:03.023-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17850000 2015-11-29T03:53:03.112-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17860000 2015-11-29T03:53:03.198-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17870000 2015-11-29T03:53:03.292-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 13990000 QueuedCount 50000 2015-11-29T03:53:03.292-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17880000 2015-11-29T03:53:03.389-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17890000 2015-11-29T03:53:03.484-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17900000 2015-11-29T03:53:03.582-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17910000 2015-11-29T03:53:03.681-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17920000 2015-11-29T03:53:03.781-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17930000 2015-11-29T03:53:03.879-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17940000 2015-11-29T03:53:03.997-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17950000 2015-11-29T03:53:04.116-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17960000 2015-11-29T03:53:04.241-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17970000 2015-11-29T03:53:04.332-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17980000 2015-11-29T03:53:04.396-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14000000 QueuedCount 50000 2015-11-29T03:53:04.42-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 17990000 2015-11-29T03:53:04.507-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18000000 2015-11-29T03:53:04.594-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18010000 2015-11-29T03:53:04.608-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14010000 QueuedCount 49999 2015-11-29T03:53:04.688-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:04.707-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18020000 2015-11-29T03:53:04.805-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18030000 2015-11-29T03:53:04.826-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14020000 QueuedCount 50000 2015-11-29T03:53:04.906-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18040000 2015-11-29T03:53:05.024-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18050000 2015-11-29T03:53:05.157-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18060000 2015-11-29T03:53:05.289-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18070000 2015-11-29T03:53:05.421-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18080000 2015-11-29T03:53:05.55-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18090000 2015-11-29T03:53:05.682-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18100000 2015-11-29T03:53:05.815-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18110000 2015-11-29T03:53:05.942-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18120000 2015-11-29T03:53:06.051-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14030000 QueuedCount 46256 2015-11-29T03:53:06.074-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18130000 2015-11-29T03:53:06.172-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14040000 QueuedCount 36256 2015-11-29T03:53:06.201-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18140000 2015-11-29T03:53:06.284-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14050000 QueuedCount 26256 2015-11-29T03:53:06.33-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18150000 2015-11-29T03:53:06.398-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14060000 QueuedCount 16256 2015-11-29T03:53:06.461-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18160000 2015-11-29T03:53:06.516-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14070000 QueuedCount 6256 2015-11-29T03:53:06.591-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18170000 2015-11-29T03:53:06.725-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18180000 2015-11-29T03:53:06.852-08:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 18190000 2015-11-29T03:53:07.452-08:00 [Info] PeriodicStats = {"bucket-1:by_email_0:avg_scan_latency":0,"bucket-1:by_email_0:avg_scan_wait_latency":0,"bucket-1:by_email_0:avg_ts_interval":5084980822,"bucket-1:by_email_0:avg_ts_items_count":127790,"bucket-1:by_email_0:build_progress":70,"bucket-1:by_email_0:data_size":2214120340,"bucket-1:by_email_0:delete_bytes":0,"bucket-1:by_email_0:disk_size":10240106496,"bucket-1:by_email_0:flush_queue_size":0,"bucket-1:by_email_0:frag_percent":78,"bucket-1:by_email_0:get_bytes":0,"bucket-1:by_email_0:insert_bytes":706944942,"bucket-1:by_email_0:items_count":6968385,"bucket-1:by_email_0:num_commits":104,"bucket-1:by_email_0:num_compactions":4,"bucket-1:by_email_0:num_completed_requests":0,"bucket-1:by_email_0:num_docs_indexed":14063643,"bucket-1:by_email_0:num_docs_pending":1952649,"bucket-1:by_email_0:num_docs_queued":3983708,"bucket-1:by_email_0:num_flush_queued":14076256,"bucket-1:by_email_0:num_last_snapshot_reply":0,"bucket-1:by_email_0:num_requests":0,"bucket-1:by_email_0:num_rows_returned":0,"bucket-1:by_email_0:num_snapshot_waiters":0,"bucket-1:by_email_0:num_snapshots":104,"bucket-1:by_email_0:scan_bytes_read":0,"bucket-1:by_email_0:scan_wait_duration":0,"bucket-1:by_email_0:since_last_snapshot":5239580995,"bucket-1:by_email_0:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_0:timings/storage_commit":"104 66065458781 -4866863335183826143","bucket-1:by_email_0:timings/storage_del":"0 0 0","bucket-1:by_email_0:timings/storage_get":"14076256 145245213966 1250073625994544054","bucket-1:by_email_0:timings/storage_handle_open":"104 13043076461 -5190169396204598369","bucket-1:by_email_0:timings/storage_info":"420 10003961 2065511468495","bucket-1:by_email_0:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_0:timings/storage_meta_get":"108 451061231 158331679264785645","bucket-1:by_email_0:timings/storage_meta_set":"105 60323048 40401017767350","bucket-1:by_email_0:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_0:timings/storage_set":"14064652 314567313395 2297098125794469467","bucket-1:by_email_0:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_0:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_0:total_scan_duration":0,"bucket-1:mutation_queue_size":4117071,"bucket-1:num_mutations_queued":18193327,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":295,"memory_quota":104857600000,"memory_used":6243471360,"needs_restart":false,"num_connections":0,"timings/stats_response":"1941 373365085 728413551263557"} 2015-11-29T03:53:07.803-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 4.181µs CommitTime 544.953994ms TotalFlushTime 7m56.699309065s TotalCommitTime 1m6.610412775s 2015-11-29T03:53:07.803-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 7032326, 7032326, 105 committed:true 2015-11-29T03:53:07.803-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 7032326, 7032326, 105 committed:true) SnapCreateDur 555.66634ms SnapOpenDur 55.335µs 2015-11-29T03:53:07.836-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:07.858-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:07.867-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14080000 QueuedCount 9835 2015-11-29T03:53:07.891-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:07.925-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:07.95-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:07.979-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:08.002-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:08.029-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:08.041-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14090000 QueuedCount 47037 2015-11-29T03:53:08.27-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14100000 QueuedCount 50000 2015-11-29T03:53:08.426-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:08.511-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14110000 QueuedCount 50000 2015-11-29T03:53:09.624-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14120000 QueuedCount 50000 2015-11-29T03:53:09.741-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14130000 QueuedCount 50000 2015-11-29T03:53:09.833-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:09.869-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14140000 QueuedCount 50000 2015-11-29T03:53:10.041-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14150000 QueuedCount 50000 2015-11-29T03:53:11.283-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14160000 QueuedCount 50000 2015-11-29T03:53:11.399-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14170000 QueuedCount 47295 2015-11-29T03:53:11.509-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14180000 QueuedCount 37295 2015-11-29T03:53:11.625-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14190000 QueuedCount 27295 2015-11-29T03:53:11.735-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14200000 QueuedCount 17295 2015-11-29T03:53:11.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 111 2015-11-29T03:53:11.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 111 2015-11-29T03:53:11.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 111 2015-11-29T03:53:11.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 111 2015-11-29T03:53:12.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 111 2015-11-29T03:53:12.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 111 2015-11-29T03:53:12.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 111 2015-11-29T03:53:12.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 111 2015-11-29T03:53:12.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 111 2015-11-29T03:53:12.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 111 2015-11-29T03:53:12.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 111 2015-11-29T03:53:12.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 111 2015-11-29T03:53:12.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 111 2015-11-29T03:53:12.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 111 2015-11-29T03:53:12.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 111 2015-11-29T03:53:12.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 111 2015-11-29T03:53:12.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 111 2015-11-29T03:53:12.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 111 2015-11-29T03:53:12.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 111 2015-11-29T03:53:12.471-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14210000 QueuedCount 7295 2015-11-29T03:53:12.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 111 2015-11-29T03:53:12.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 111 2015-11-29T03:53:12.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 111 2015-11-29T03:53:12.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 111 2015-11-29T03:53:12.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 111 2015-11-29T03:53:12.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 111 2015-11-29T03:53:12.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 111 2015-11-29T03:53:12.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 111 2015-11-29T03:53:12.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 111 2015-11-29T03:53:12.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 111 2015-11-29T03:53:12.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 111 2015-11-29T03:53:12.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 111 2015-11-29T03:53:12.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 111 2015-11-29T03:53:12.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 111 2015-11-29T03:53:12.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 111 2015-11-29T03:53:12.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 111 2015-11-29T03:53:12.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 111 2015-11-29T03:53:12.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 111 2015-11-29T03:53:13.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 111 2015-11-29T03:53:13.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 111 2015-11-29T03:53:13.066-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 13.63µs CommitTime 503.332039ms TotalFlushTime 8m1.15975666s TotalCommitTime 1m7.113744814s 2015-11-29T03:53:13.066-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 7101545, 7101545, 106 committed:true 2015-11-29T03:53:13.066-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 7101545, 7101545, 106 committed:true) SnapCreateDur 516.005558ms SnapOpenDur 59.543µs 2015-11-29T03:53:13.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 111 2015-11-29T03:53:13.102-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 111 2015-11-29T03:53:13.123-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 111 2015-11-29T03:53:13.15-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.151-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14220000 QueuedCount 20668 2015-11-29T03:53:13.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 111 2015-11-29T03:53:13.179-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 111 2015-11-29T03:53:13.2-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.221-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 111 2015-11-29T03:53:13.244-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 111 2015-11-29T03:53:13.276-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 111 2015-11-29T03:53:13.306-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 111 2015-11-29T03:53:13.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 111 2015-11-29T03:53:13.37-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14230000 QueuedCount 50000 2015-11-29T03:53:13.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 111 2015-11-29T03:53:13.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 111 2015-11-29T03:53:13.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 111 2015-11-29T03:53:13.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 111 2015-11-29T03:53:13.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 111 2015-11-29T03:53:13.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 111 2015-11-29T03:53:13.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 111 2015-11-29T03:53:13.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 111 2015-11-29T03:53:13.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 111 2015-11-29T03:53:13.619-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14240000 QueuedCount 50000 2015-11-29T03:53:13.622-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:13.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 111 2015-11-29T03:53:13.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 111 2015-11-29T03:53:13.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 111 2015-11-29T03:53:13.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 111 2015-11-29T03:53:13.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 111 2015-11-29T03:53:13.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 111 2015-11-29T03:53:13.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 111 2015-11-29T03:53:13.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 111 2015-11-29T03:53:13.856-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14250000 QueuedCount 50000 2015-11-29T03:53:13.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 111 2015-11-29T03:53:13.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 111 2015-11-29T03:53:13.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 111 2015-11-29T03:53:13.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 111 2015-11-29T03:53:14.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 111 2015-11-29T03:53:14.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 111 2015-11-29T03:53:14.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 111 2015-11-29T03:53:14.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 111 2015-11-29T03:53:14.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 111 2015-11-29T03:53:14.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 111 2015-11-29T03:53:14.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 111 2015-11-29T03:53:14.215-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 111 2015-11-29T03:53:14.245-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 111 2015-11-29T03:53:14.275-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 111 2015-11-29T03:53:14.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 111 2015-11-29T03:53:14.335-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 111 2015-11-29T03:53:14.365-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 111 2015-11-29T03:53:14.395-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 111 2015-11-29T03:53:14.425-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 111 2015-11-29T03:53:14.455-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 111 2015-11-29T03:53:14.485-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 111 2015-11-29T03:53:14.515-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 111 2015-11-29T03:53:14.545-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 111 2015-11-29T03:53:14.575-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 111 2015-11-29T03:53:14.605-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 111 2015-11-29T03:53:14.635-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 111 2015-11-29T03:53:14.665-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 111 2015-11-29T03:53:14.695-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 111 2015-11-29T03:53:14.725-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 111 2015-11-29T03:53:14.755-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 111 2015-11-29T03:53:14.785-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 111 2015-11-29T03:53:14.815-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 111 2015-11-29T03:53:14.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 111 2015-11-29T03:53:14.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 111 2015-11-29T03:53:14.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 111 2015-11-29T03:53:14.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 111 2015-11-29T03:53:14.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 111 2015-11-29T03:53:14.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 111 2015-11-29T03:53:15.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 111 2015-11-29T03:53:15.034-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14260000 QueuedCount 49999 2015-11-29T03:53:15.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 111 2015-11-29T03:53:15.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 111 2015-11-29T03:53:15.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 111 2015-11-29T03:53:15.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 111 2015-11-29T03:53:15.162-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14270000 QueuedCount 50000 2015-11-29T03:53:15.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 111 2015-11-29T03:53:15.187-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:15.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 111 2015-11-29T03:53:15.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 111 2015-11-29T03:53:15.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 111 2015-11-29T03:53:15.279-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14280000 QueuedCount 49999 2015-11-29T03:53:15.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 111 2015-11-29T03:53:15.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 111 2015-11-29T03:53:15.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 111 2015-11-29T03:53:15.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 111 2015-11-29T03:53:15.399-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14290000 QueuedCount 50000 2015-11-29T03:53:15.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 111 2015-11-29T03:53:15.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 111 2015-11-29T03:53:15.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 111 2015-11-29T03:53:15.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 111 2015-11-29T03:53:15.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 111 2015-11-29T03:53:15.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 111 2015-11-29T03:53:15.574-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14300000 QueuedCount 44793 2015-11-29T03:53:15.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 111 2015-11-29T03:53:15.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 111 2015-11-29T03:53:15.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 111 2015-11-29T03:53:15.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 111 2015-11-29T03:53:15.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 111 2015-11-29T03:53:15.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 111 2015-11-29T03:53:15.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 111 2015-11-29T03:53:15.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 111 2015-11-29T03:53:15.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 111 2015-11-29T03:53:15.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 111 2015-11-29T03:53:15.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 111 2015-11-29T03:53:15.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 111 2015-11-29T03:53:15.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 111 2015-11-29T03:53:15.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 111 2015-11-29T03:53:16.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 111 2015-11-29T03:53:16.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 111 2015-11-29T03:53:16.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 111 2015-11-29T03:53:16.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 111 2015-11-29T03:53:16.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 111 2015-11-29T03:53:16.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 111 2015-11-29T03:53:16.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 111 2015-11-29T03:53:16.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 111 2015-11-29T03:53:16.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 111 2015-11-29T03:53:16.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 111 2015-11-29T03:53:16.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 111 2015-11-29T03:53:16.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 111 2015-11-29T03:53:16.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 111 2015-11-29T03:53:16.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 111 2015-11-29T03:53:16.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 111 2015-11-29T03:53:16.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 111 2015-11-29T03:53:16.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 111 2015-11-29T03:53:16.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 111 2015-11-29T03:53:16.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 111 2015-11-29T03:53:16.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 111 2015-11-29T03:53:16.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 111 2015-11-29T03:53:16.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 111 2015-11-29T03:53:16.659-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14310000 QueuedCount 34793 2015-11-29T03:53:16.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 111 2015-11-29T03:53:16.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 111 2015-11-29T03:53:16.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 111 2015-11-29T03:53:16.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 111 2015-11-29T03:53:16.781-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14320000 QueuedCount 24793 2015-11-29T03:53:16.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 111 2015-11-29T03:53:16.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 111 2015-11-29T03:53:16.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 111 2015-11-29T03:53:16.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 111 2015-11-29T03:53:16.893-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14330000 QueuedCount 14793 2015-11-29T03:53:16.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 111 2015-11-29T03:53:16.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 111 2015-11-29T03:53:16.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 111 2015-11-29T03:53:17.004-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14340000 QueuedCount 4793 2015-11-29T03:53:17.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 111 2015-11-29T03:53:17.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 111 2015-11-29T03:53:17.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 111 2015-11-29T03:53:17.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 111 2015-11-29T03:53:17.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 111 2015-11-29T03:53:17.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 111 2015-11-29T03:53:17.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 111 2015-11-29T03:53:17.215-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 111 2015-11-29T03:53:17.245-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 111 2015-11-29T03:53:17.275-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 111 2015-11-29T03:53:17.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 111 2015-11-29T03:53:17.335-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 111 2015-11-29T03:53:17.365-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 111 2015-11-29T03:53:17.395-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 111 2015-11-29T03:53:17.425-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 111 2015-11-29T03:53:17.455-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 111 2015-11-29T03:53:17.485-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 111 2015-11-29T03:53:17.515-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 111 2015-11-29T03:53:17.545-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 111 2015-11-29T03:53:17.575-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 111 2015-11-29T03:53:17.605-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 111 2015-11-29T03:53:17.635-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 111 2015-11-29T03:53:17.665-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 111 2015-11-29T03:53:17.695-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 111 2015-11-29T03:53:17.725-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 111 2015-11-29T03:53:17.755-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 111 2015-11-29T03:53:17.785-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 111 2015-11-29T03:53:17.815-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 111 2015-11-29T03:53:17.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 111 2015-11-29T03:53:17.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 111 2015-11-29T03:53:17.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 111 2015-11-29T03:53:17.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 111 2015-11-29T03:53:17.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 111 2015-11-29T03:53:17.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 111 2015-11-29T03:53:18.016-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 2.365µs CommitTime 320.297383ms TotalFlushTime 8m5.515352364s TotalCommitTime 1m7.434042197s 2015-11-29T03:53:18.016-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 7164973, 7164973, 107 committed:true 2015-11-29T03:53:18.016-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 7164973, 7164973, 107 committed:true) SnapCreateDur 333.080694ms SnapOpenDur 51.509µs 2015-11-29T03:53:18.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 111 2015-11-29T03:53:18.042-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 111 2015-11-29T03:53:18.073-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 111 2015-11-29T03:53:18.089-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14350000 QueuedCount 9127 2015-11-29T03:53:18.096-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 111 2015-11-29T03:53:18.12-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 111 2015-11-29T03:53:18.157-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 111 2015-11-29T03:53:18.182-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.202-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 111 2015-11-29T03:53:18.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 111 2015-11-29T03:53:18.244-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:18.248-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14360000 QueuedCount 48562 2015-11-29T03:53:18.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 111 2015-11-29T03:53:18.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 111 2015-11-29T03:53:18.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 111 2015-11-29T03:53:18.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 111 2015-11-29T03:53:18.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 111 2015-11-29T03:53:18.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 111 2015-11-29T03:53:18.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 111 2015-11-29T03:53:18.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 111 2015-11-29T03:53:18.486-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14370000 QueuedCount 50000 2015-11-29T03:53:18.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 111 2015-11-29T03:53:18.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 111 2015-11-29T03:53:18.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 111 2015-11-29T03:53:18.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 111 2015-11-29T03:53:18.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 111 2015-11-29T03:53:18.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 111 2015-11-29T03:53:18.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 111 2015-11-29T03:53:18.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 111 2015-11-29T03:53:18.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 111 2015-11-29T03:53:18.76-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14380000 QueuedCount 50000 2015-11-29T03:53:18.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 111 2015-11-29T03:53:18.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 111 2015-11-29T03:53:18.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 111 2015-11-29T03:53:18.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 111 2015-11-29T03:53:18.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 111 2015-11-29T03:53:18.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 111 2015-11-29T03:53:18.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 111 2015-11-29T03:53:18.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 111 2015-11-29T03:53:19.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 111 2015-11-29T03:53:19.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 111 2015-11-29T03:53:19.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 111 2015-11-29T03:53:19.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 111 2015-11-29T03:53:19.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 111 2015-11-29T03:53:19.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 111 2015-11-29T03:53:19.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 111 2015-11-29T03:53:19.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 111 2015-11-29T03:53:19.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 111 2015-11-29T03:53:19.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 111 2015-11-29T03:53:19.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 111 2015-11-29T03:53:19.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 111 2015-11-29T03:53:19.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 111 2015-11-29T03:53:19.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 111 2015-11-29T03:53:19.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 111 2015-11-29T03:53:19.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 111 2015-11-29T03:53:19.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 111 2015-11-29T03:53:19.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 111 2015-11-29T03:53:19.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 111 2015-11-29T03:53:19.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 111 2015-11-29T03:53:19.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 111 2015-11-29T03:53:19.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 111 2015-11-29T03:53:19.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 111 2015-11-29T03:53:19.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 111 2015-11-29T03:53:19.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 111 2015-11-29T03:53:19.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 111 2015-11-29T03:53:19.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 111 2015-11-29T03:53:19.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 111 2015-11-29T03:53:19.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 111 2015-11-29T03:53:19.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 111 2015-11-29T03:53:19.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 111 2015-11-29T03:53:19.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 111 2015-11-29T03:53:19.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 111 2015-11-29T03:53:20.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 111 2015-11-29T03:53:20.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 111 2015-11-29T03:53:20.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 111 2015-11-29T03:53:20.074-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14390000 QueuedCount 50000 2015-11-29T03:53:20.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 111 2015-11-29T03:53:20.103-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:20.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 111 2015-11-29T03:53:20.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 111 2015-11-29T03:53:20.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 111 2015-11-29T03:53:20.215-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 111 2015-11-29T03:53:20.245-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 111 2015-11-29T03:53:20.275-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 111 2015-11-29T03:53:20.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 111 2015-11-29T03:53:20.313-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14400000 QueuedCount 50000 2015-11-29T03:53:20.335-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 111 2015-11-29T03:53:20.361-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:20.365-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 111 2015-11-29T03:53:20.395-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 111 2015-11-29T03:53:20.425-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 111 2015-11-29T03:53:20.455-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 111 2015-11-29T03:53:20.485-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 111 2015-11-29T03:53:20.515-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 111 2015-11-29T03:53:20.531-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14410000 QueuedCount 43607 2015-11-29T03:53:20.545-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 111 2015-11-29T03:53:20.575-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 111 2015-11-29T03:53:20.605-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 111 2015-11-29T03:53:20.635-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 111 2015-11-29T03:53:20.665-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 111 2015-11-29T03:53:20.695-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 111 2015-11-29T03:53:20.713-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14420000 QueuedCount 33607 2015-11-29T03:53:20.725-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 111 2015-11-29T03:53:20.755-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 111 2015-11-29T03:53:20.785-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 111 2015-11-29T03:53:20.815-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 111 2015-11-29T03:53:20.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 111 2015-11-29T03:53:20.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 111 2015-11-29T03:53:20.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 111 2015-11-29T03:53:20.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 111 2015-11-29T03:53:20.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 111 2015-11-29T03:53:20.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 111 2015-11-29T03:53:21.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 111 2015-11-29T03:53:21.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 111 2015-11-29T03:53:21.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 111 2015-11-29T03:53:21.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 111 2015-11-29T03:53:21.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 111 2015-11-29T03:53:21.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 111 2015-11-29T03:53:21.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 111 2015-11-29T03:53:21.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 111 2015-11-29T03:53:21.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 111 2015-11-29T03:53:21.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 111 2015-11-29T03:53:21.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 111 2015-11-29T03:53:21.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 111 2015-11-29T03:53:21.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 111 2015-11-29T03:53:21.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 111 2015-11-29T03:53:21.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 111 2015-11-29T03:53:21.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 111 2015-11-29T03:53:21.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 111 2015-11-29T03:53:21.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 111 2015-11-29T03:53:21.556-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14430000 QueuedCount 23607 2015-11-29T03:53:21.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 111 2015-11-29T03:53:21.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 111 2015-11-29T03:53:21.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 111 2015-11-29T03:53:21.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 111 2015-11-29T03:53:21.663-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14440000 QueuedCount 13607 2015-11-29T03:53:21.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 111 2015-11-29T03:53:21.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 111 2015-11-29T03:53:21.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 111 2015-11-29T03:53:21.775-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14450000 QueuedCount 3607 2015-11-29T03:53:21.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 111 2015-11-29T03:53:21.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 111 2015-11-29T03:53:21.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 111 2015-11-29T03:53:21.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 111 2015-11-29T03:53:21.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 111 2015-11-29T03:53:21.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 111 2015-11-29T03:53:21.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 111 2015-11-29T03:53:21.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 111 2015-11-29T03:53:22.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 111 2015-11-29T03:53:22.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 111 2015-11-29T03:53:22.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 111 2015-11-29T03:53:22.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 111 2015-11-29T03:53:22.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 111 2015-11-29T03:53:22.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 111 2015-11-29T03:53:22.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 111 2015-11-29T03:53:22.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 111 2015-11-29T03:53:22.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 111 2015-11-29T03:53:22.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 111 2015-11-29T03:53:22.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 111 2015-11-29T03:53:22.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 111 2015-11-29T03:53:22.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 111 2015-11-29T03:53:22.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 111 2015-11-29T03:53:22.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 111 2015-11-29T03:53:22.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 111 2015-11-29T03:53:22.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 111 2015-11-29T03:53:22.518-08:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 16481390354720717219 FlushTime 1.83µs CommitTime 687.296151ms TotalFlushTime 8m9.063262473s TotalCommitTime 1m8.121338348s 2015-11-29T03:53:22.518-08:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 16481390354720717219 Creating New Snapshot SnapshotInfo: seqnos: 7218651, 7218651, 108 committed:true 2015-11-29T03:53:22.518-08:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 16481390354720717219 PartitionId: 0 SliceId: 0 Crc64: 4279115336838403801 (SnapshotInfo: seqnos: 7218651, 7218651, 108 committed:true) SnapCreateDur 700.295807ms SnapOpenDur 45.93µs 2015-11-29T03:53:22.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 111 2015-11-29T03:53:22.547-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 111 2015-11-29T03:53:22.569-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 111 2015-11-29T03:53:22.599-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 111 2015-11-29T03:53:22.645-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 111 2015-11-29T03:53:22.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 111 2015-11-29T03:53:22.681-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14460000 QueuedCount 50000 2015-11-29T03:53:22.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 111 2015-11-29T03:53:22.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 111 2015-11-29T03:53:22.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 111 2015-11-29T03:53:22.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 111 2015-11-29T03:53:22.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 111 2015-11-29T03:53:22.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 111 2015-11-29T03:53:22.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 111 2015-11-29T03:53:22.899-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.908-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14470000 QueuedCount 49552 2015-11-29T03:53:22.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 111 2015-11-29T03:53:22.92-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:22.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 111 2015-11-29T03:53:22.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 111 2015-11-29T03:53:23.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 111 2015-11-29T03:53:23.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 111 2015-11-29T03:53:23.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 111 2015-11-29T03:53:23.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 111 2015-11-29T03:53:23.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 111 2015-11-29T03:53:23.14-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14480000 QueuedCount 50000 2015-11-29T03:53:23.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 111 2015-11-29T03:53:23.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 111 2015-11-29T03:53:23.215-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 111 2015-11-29T03:53:23.245-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 111 2015-11-29T03:53:23.275-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 111 2015-11-29T03:53:23.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 111 2015-11-29T03:53:23.318-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:23.335-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 111 2015-11-29T03:53:23.365-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 111 2015-11-29T03:53:23.389-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14490000 QueuedCount 50000 2015-11-29T03:53:23.395-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 111 2015-11-29T03:53:23.425-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 111 2015-11-29T03:53:23.455-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 111 2015-11-29T03:53:23.485-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 111 2015-11-29T03:53:23.497-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:23.515-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 111 2015-11-29T03:53:23.545-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 111 2015-11-29T03:53:23.575-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 111 2015-11-29T03:53:23.605-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 111 2015-11-29T03:53:23.635-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 111 2015-11-29T03:53:23.665-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 111 2015-11-29T03:53:23.695-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 111 2015-11-29T03:53:23.725-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 111 2015-11-29T03:53:23.755-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 111 2015-11-29T03:53:23.785-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 111 2015-11-29T03:53:23.815-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 111 2015-11-29T03:53:23.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 111 2015-11-29T03:53:23.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 111 2015-11-29T03:53:23.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 111 2015-11-29T03:53:23.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 111 2015-11-29T03:53:23.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 111 2015-11-29T03:53:23.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 111 2015-11-29T03:53:24.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 111 2015-11-29T03:53:24.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 111 2015-11-29T03:53:24.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 111 2015-11-29T03:53:24.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 111 2015-11-29T03:53:24.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 111 2015-11-29T03:53:24.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 111 2015-11-29T03:53:24.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 111 2015-11-29T03:53:24.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 111 2015-11-29T03:53:24.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 111 2015-11-29T03:53:24.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 111 2015-11-29T03:53:24.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 111 2015-11-29T03:53:24.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 111 2015-11-29T03:53:24.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 111 2015-11-29T03:53:24.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 111 2015-11-29T03:53:24.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 111 2015-11-29T03:53:24.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 111 2015-11-29T03:53:24.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 111 2015-11-29T03:53:24.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 111 2015-11-29T03:53:24.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 111 2015-11-29T03:53:24.57-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14500000 QueuedCount 50000 2015-11-29T03:53:24.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 111 2015-11-29T03:53:24.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 111 2015-11-29T03:53:24.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 111 2015-11-29T03:53:24.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 111 2015-11-29T03:53:24.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 111 2015-11-29T03:53:24.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 111 2015-11-29T03:53:24.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 111 2015-11-29T03:53:24.781-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:24.798-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14510000 QueuedCount 49162 2015-11-29T03:53:24.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 111 2015-11-29T03:53:24.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 111 2015-11-29T03:53:24.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 111 2015-11-29T03:53:24.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 111 2015-11-29T03:53:24.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 111 2015-11-29T03:53:24.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 111 2015-11-29T03:53:24.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 111 2015-11-29T03:53:24.988-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:25.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 111 2015-11-29T03:53:25.033-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14520000 QueuedCount 50000 2015-11-29T03:53:25.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 111 2015-11-29T03:53:25.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 111 2015-11-29T03:53:25.105-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 111 2015-11-29T03:53:25.135-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 111 2015-11-29T03:53:25.148-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:25.165-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 111 2015-11-29T03:53:25.195-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 111 2015-11-29T03:53:25.225-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 111 2015-11-29T03:53:25.255-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 111 2015-11-29T03:53:25.285-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 111 2015-11-29T03:53:25.298-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14530000 QueuedCount 50000 2015-11-29T03:53:25.315-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 111 2015-11-29T03:53:25.33-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:25.345-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 111 2015-11-29T03:53:25.375-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18480 Milliseconds Vbucket 111 2015-11-29T03:53:25.405-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18510 Milliseconds Vbucket 111 2015-11-29T03:53:25.435-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18540 Milliseconds Vbucket 111 2015-11-29T03:53:25.465-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18570 Milliseconds Vbucket 111 2015-11-29T03:53:25.495-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18600 Milliseconds Vbucket 111 2015-11-29T03:53:25.525-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18630 Milliseconds Vbucket 111 2015-11-29T03:53:25.555-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18660 Milliseconds Vbucket 111 2015-11-29T03:53:25.585-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18690 Milliseconds Vbucket 111 2015-11-29T03:53:25.615-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18720 Milliseconds Vbucket 111 2015-11-29T03:53:25.645-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18750 Milliseconds Vbucket 111 2015-11-29T03:53:25.675-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18780 Milliseconds Vbucket 111 2015-11-29T03:53:25.705-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18810 Milliseconds Vbucket 111 2015-11-29T03:53:25.735-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18840 Milliseconds Vbucket 111 2015-11-29T03:53:25.765-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18870 Milliseconds Vbucket 111 2015-11-29T03:53:25.795-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18900 Milliseconds Vbucket 111 2015-11-29T03:53:25.825-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18930 Milliseconds Vbucket 111 2015-11-29T03:53:25.855-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18960 Milliseconds Vbucket 111 2015-11-29T03:53:25.885-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18990 Milliseconds Vbucket 111 2015-11-29T03:53:25.915-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19020 Milliseconds Vbucket 111 2015-11-29T03:53:25.945-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19050 Milliseconds Vbucket 111 2015-11-29T03:53:25.975-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19080 Milliseconds Vbucket 111 2015-11-29T03:53:26.005-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19110 Milliseconds Vbucket 111 2015-11-29T03:53:26.035-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19140 Milliseconds Vbucket 111 2015-11-29T03:53:26.065-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19170 Milliseconds Vbucket 111 2015-11-29T03:53:26.095-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19200 Milliseconds Vbucket 111 2015-11-29T03:53:26.125-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19230 Milliseconds Vbucket 111 2015-11-29T03:53:26.155-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19260 Milliseconds Vbucket 111 2015-11-29T03:53:26.185-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19290 Milliseconds Vbucket 111 2015-11-29T03:53:26.215-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19320 Milliseconds Vbucket 111 2015-11-29T03:53:26.245-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19350 Milliseconds Vbucket 111 2015-11-29T03:53:26.275-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19380 Milliseconds Vbucket 111 2015-11-29T03:53:26.305-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19410 Milliseconds Vbucket 111 2015-11-29T03:53:26.335-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19440 Milliseconds Vbucket 111 2015-11-29T03:53:26.365-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19470 Milliseconds Vbucket 111 2015-11-29T03:53:26.395-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19500 Milliseconds Vbucket 111 2015-11-29T03:53:26.425-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19530 Milliseconds Vbucket 111 2015-11-29T03:53:26.455-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19560 Milliseconds Vbucket 111 2015-11-29T03:53:26.485-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19590 Milliseconds Vbucket 111 2015-11-29T03:53:26.515-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19620 Milliseconds Vbucket 111 2015-11-29T03:53:26.545-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19650 Milliseconds Vbucket 111 2015-11-29T03:53:26.575-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19680 Milliseconds Vbucket 111 2015-11-29T03:53:26.605-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19710 Milliseconds Vbucket 111 2015-11-29T03:53:26.635-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19740 Milliseconds Vbucket 111 2015-11-29T03:53:26.665-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19770 Milliseconds Vbucket 111 2015-11-29T03:53:26.695-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19800 Milliseconds Vbucket 111 2015-11-29T03:53:26.725-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19830 Milliseconds Vbucket 111 2015-11-29T03:53:26.741-08:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2015-11-29T03:53:26.755-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19860 Milliseconds Vbucket 111 2015-11-29T03:53:26.785-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19890 Milliseconds Vbucket 111 2015-11-29T03:53:26.815-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19920 Milliseconds Vbucket 111 2015-11-29T03:53:26.845-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19950 Milliseconds Vbucket 111 2015-11-29T03:53:26.875-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 19980 Milliseconds Vbucket 111 2015-11-29T03:53:26.905-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20010 Milliseconds Vbucket 111 2015-11-29T03:53:26.935-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20040 Milliseconds Vbucket 111 2015-11-29T03:53:26.939-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14540000 QueuedCount 50000 2015-11-29T03:53:26.965-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20070 Milliseconds Vbucket 111 2015-11-29T03:53:26.995-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20100 Milliseconds Vbucket 111 2015-11-29T03:53:27.025-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20130 Milliseconds Vbucket 111 2015-11-29T03:53:27.055-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20160 Milliseconds Vbucket 111 2015-11-29T03:53:27.085-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20190 Milliseconds Vbucket 111 2015-11-29T03:53:27.091-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14550000 QueuedCount 43618 2015-11-29T03:53:27.115-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20220 Milliseconds Vbucket 111 2015-11-29T03:53:27.145-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20250 Milliseconds Vbucket 111 2015-11-29T03:53:27.175-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20280 Milliseconds Vbucket 111 2015-11-29T03:53:27.205-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20310 Milliseconds Vbucket 111 2015-11-29T03:53:27.235-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20340 Milliseconds Vbucket 111 2015-11-29T03:53:27.265-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20370 Milliseconds Vbucket 111 2015-11-29T03:53:27.275-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14560000 QueuedCount 33618 2015-11-29T03:53:27.295-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20400 Milliseconds Vbucket 111 2015-11-29T03:53:27.325-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20430 Milliseconds Vbucket 111 2015-11-29T03:53:27.355-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20460 Milliseconds Vbucket 111 2015-11-29T03:53:27.385-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20490 Milliseconds Vbucket 111 2015-11-29T03:53:27.415-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20520 Milliseconds Vbucket 111 2015-11-29T03:53:27.445-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20550 Milliseconds Vbucket 111 2015-11-29T03:53:27.475-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20580 Milliseconds Vbucket 111 2015-11-29T03:53:27.488-08:00 [Info] logWriterStat:: 16481390354720717219 FlushedCount 14570000 QueuedCount 23618 2015-11-29T03:53:27.505-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20610 Milliseconds Vbucket 111 2015-11-29T03:53:27.535-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20640 Milliseconds Vbucket 111 2015-11-29T03:53:27.565-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20670 Milliseconds Vbucket 111 2015-11-29T03:53:27.595-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20700 Milliseconds Vbucket 111 2015-11-29T03:53:27.625-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20730 Milliseconds Vbucket 111 2015-11-29T03:53:27.655-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20760 Milliseconds Vbucket 111 2015-11-29T03:53:27.685-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20790 Milliseconds Vbucket 111 2015-11-29T03:53:27.715-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20820 Milliseconds Vbucket 111 2015-11-29T03:53:27.745-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20850 Milliseconds Vbucket 111 2015-11-29T03:53:27.775-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20880 Milliseconds Vbucket 111 2015-11-29T03:53:27.805-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20910 Milliseconds Vbucket 111 2015-11-29T03:53:27.835-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20940 Milliseconds Vbucket 111 2015-11-29T03:53:27.865-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 20970 Milliseconds Vbucket 111 2015-11-29T03:53:27.895-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21000 Milliseconds Vbucket 111 2015-11-29T03:53:27.925-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21030 Milliseconds Vbucket 111 2015-11-29T03:53:27.955-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21060 Milliseconds Vbucket 111 2015-11-29T03:53:27.985-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21090 Milliseconds Vbucket 111 2015-11-29T03:53:28.015-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21120 Milliseconds Vbucket 111 2015-11-29T03:53:28.045-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21150 Milliseconds Vbucket 111 2015-11-29T03:53:28.075-08:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 21180 Milliseconds Vbucket 111 2015-11-29T03:53:28.105-08:00 [Warn] Indexer::