2016-03-24T05:55:12.447-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2016-03-24T05:55:12.478-07:00 [Info] Indexer::NewIndexer Status INIT 2016-03-24T05:55:12.481-07:00 [Info] Setting maxcpus = 4 2016-03-24T05:55:12.482-07:00 [Info] Setting buffer block size to 16384 bytes 2016-03-24T05:55:12.482-07:00 [Info] Setting log level to Info 2016-03-24T05:55:12.482-07:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2016-03-24T05:55:12.543-07:00 [Info] [Queryport ":9101"] started ... 2016-03-24T05:55:12.547-07:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.log_level":"info","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2016-03-24T05:55:12.547-07:00 [Info] Setting maxcpus = 4 2016-03-24T05:55:12.547-07:00 [Info] Setting log level to Info 2016-03-24T05:55:15.711-07:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2016-03-24T05:55:15.727-07:00 [Info] ClustMgr:handleSetLocalValue Key IndexerId Value e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.742-07:00 [Info] Indexer Id e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.794-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.796-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.796-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:55:15.796-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.796-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.798-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.798-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:55:15.798-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.798-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.799-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.799-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:55:15.799-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.799-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.801-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.801-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:55:15.801-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.831-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.831-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.831-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:55:15.831-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.831-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.832-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.832-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:55:15.832-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.832-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.833-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.833-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:55:15.833-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.833-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:15.834-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:15.834-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:55:15.834-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:15.834-07:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2016-03-24T05:55:15.834-07:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2016-03-24T05:55:15.834-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2016-03-24T05:55:15.834-07:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2016-03-24T05:55:15.834-07:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2016-03-24T05:55:15.834-07:00 [Info] Indexer::NewIndexer Status ACTIVE 2016-03-24T05:55:15.834-07:00 [Info] CompactionManager: Refreshing settings 2016-03-24T05:55:22.45-07:00 [Info] New settings received: {"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.log_level":"info","indexer.settings.compaction.min_frag":30,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.max_cpu_percent":400,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.memory_quota":104857600000} 2016-03-24T05:55:22.45-07:00 [Info] Setting maxcpus = 4 2016-03-24T05:55:22.45-07:00 [Info] Setting log level to Info 2016-03-24T05:55:22.45-07:00 [Info] CompactionManager: Refreshing settings 2016-03-24T05:55:22.489-07:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2016-03-24T05:55:22.49-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:55:22.49-07:00 [Info] Setting log level to Info 2016-03-24T05:55:22.49-07:00 [Info] CompactionManager: Refreshing settings [goport] 2016/03/24 05:55:23 got new line on a stdin; terminating. 2016-03-24T05:55:33.061-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2016-03-24T05:55:33.093-07:00 [Info] Indexer::NewIndexer Status INIT 2016-03-24T05:55:33.108-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:55:33.108-07:00 [Info] Setting buffer block size to 16384 bytes 2016-03-24T05:55:33.108-07:00 [Info] Setting log level to Info 2016-03-24T05:55:33.108-07:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2016-03-24T05:55:33.172-07:00 [Info] [Queryport ":9101"] started ... 2016-03-24T05:55:33.178-07:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2016-03-24T05:55:33.178-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:55:33.178-07:00 [Info] Setting log level to Info 2016-03-24T05:55:36.506-07:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2016-03-24T05:55:36.507-07:00 [Info] Indexer Id e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.535-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.537-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.537-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:55:36.537-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.537-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.538-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.538-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:55:36.538-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.538-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.54-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.54-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:55:36.54-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.54-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.542-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.542-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:55:36.542-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.579-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.58-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.58-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:55:36.58-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.58-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.581-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.581-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:55:36.581-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.581-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.582-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.582-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:55:36.582-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.582-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:55:36.582-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:55:36.582-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:55:36.582-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:55:36.582-07:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2016-03-24T05:55:36.582-07:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2016-03-24T05:55:36.582-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2016-03-24T05:55:36.582-07:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2016-03-24T05:55:36.583-07:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2016-03-24T05:55:36.583-07:00 [Info] Indexer::NewIndexer Status ACTIVE 2016-03-24T05:55:36.583-07:00 [Info] CompactionManager: Refreshing settings 2016-03-24T05:56:36.507-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":143360,"needs_restart":false,"num_connections":0,"timings/stats_response":"65 3957118 308964649166"} [goport] 2016/03/24 05:57:31 got new line on a stdin; terminating. 2016-03-24T05:57:43.765-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2016-03-24T05:57:43.798-07:00 [Info] Indexer::NewIndexer Status INIT 2016-03-24T05:57:43.815-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:57:43.815-07:00 [Info] Setting buffer block size to 16384 bytes 2016-03-24T05:57:43.815-07:00 [Info] Setting log level to Info 2016-03-24T05:57:43.815-07:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2016-03-24T05:57:43.881-07:00 [Info] [Queryport ":9101"] started ... 2016-03-24T05:57:43.886-07:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2016-03-24T05:57:43.886-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:57:43.886-07:00 [Info] Setting log level to Info 2016-03-24T05:57:47-07:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2016-03-24T05:57:47-07:00 [Info] Indexer Id e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.034-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.036-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.036-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:57:47.036-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.036-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.038-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.038-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:57:47.038-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.038-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.039-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.039-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:57:47.039-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.039-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.04-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.04-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:57:47.041-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.063-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.064-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.064-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:57:47.064-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.064-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.064-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.064-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:57:47.064-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.064-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.065-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.065-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:57:47.065-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.065-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:47.066-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:47.066-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:57:47.066-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:47.066-07:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2016-03-24T05:57:47.066-07:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2016-03-24T05:57:47.066-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2016-03-24T05:57:47.066-07:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2016-03-24T05:57:47.066-07:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2016-03-24T05:57:47.066-07:00 [Info] Indexer::NewIndexer Status ACTIVE 2016-03-24T05:57:47.066-07:00 [Info] CompactionManager: Refreshing settings [goport] 2016/03/24 05:57:47 got new line on a stdin; terminating. 2016-03-24T05:57:47.335-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2016-03-24T05:57:47.367-07:00 [Info] Indexer::NewIndexer Status INIT 2016-03-24T05:57:47.371-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:57:47.371-07:00 [Info] Setting buffer block size to 16384 bytes 2016-03-24T05:57:47.371-07:00 [Info] Setting log level to Info 2016-03-24T05:57:47.371-07:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2016-03-24T05:57:47.433-07:00 [Error] [Queryport ":9101"] failed starting listen tcp :9101: bind: address already in use !! 2016-03-24T05:57:47.433-07:00 [Fatal] Indexer::NewIndexer Scan Coordinator Init Error%!(EXTRA *indexer.MsgError=listen tcp :9101: bind: address already in use) 2016-03-24T05:57:47.433-07:00 [Warn] Indexer Failure to Init listen tcp :9101: bind: address already in use 2016-03-24T05:57:47.433-07:00 [Info] Indexer exiting normally 2016-03-24T05:57:52.57-07:00 [Info] Indexer started with command line: [/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=9100 -scanPort=9101 -httpPort=9102 -streamInitPort=9103 -streamCatchupPort=9104 -streamMaintPort=9105 -storageDir=/data/@2i -diagDir=/opt/couchbase/var/lib/couchbase/crash] 2016-03-24T05:57:52.602-07:00 [Info] Indexer::NewIndexer Status INIT 2016-03-24T05:57:52.607-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:57:52.607-07:00 [Info] Setting buffer block size to 16384 bytes 2016-03-24T05:57:52.607-07:00 [Info] Setting log level to Info 2016-03-24T05:57:52.607-07:00 [Info] Indexer::NewIndexer Starting with Vbuckets 1024 2016-03-24T05:57:52.668-07:00 [Info] [Queryport ":9101"] started ... 2016-03-24T05:57:52.673-07:00 [Info] New settings received: {"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":1048576,"indexer.settings.cpuProfFname":"","indexer.settings.cpuProfile":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":10000,"indexer.settings.max_cpu_percent":2400,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfFname":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":104857600000,"indexer.settings.persisted_snapshot.interval":3000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.sliceBufSize":50000,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.wal_size":40960,"projector.settings.log_level":"info","queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":1000} 2016-03-24T05:57:52.673-07:00 [Info] Setting maxcpus = 24 2016-03-24T05:57:52.673-07:00 [Info] Setting log level to Info 2016-03-24T05:57:55.806-07:00 [Info] ClustMgr:handleGetLocalValue Key IndexerId 2016-03-24T05:57:55.806-07:00 [Info] Indexer Id e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.838-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.84-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.84-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:57:55.84-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.84-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.842-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.842-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:57:55.842-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.842-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.843-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.843-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:57:55.843-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.843-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.845-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.845-07:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:57:55.845-07:00 [Info] KVSender::closeMutationStream MAINT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.874-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.875-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.70:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.875-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.70:9999 2016-03-24T05:57:55.875-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.875-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.875-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.71:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.875-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.71:9999 2016-03-24T05:57:55.876-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.876-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.876-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.72:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.876-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.72:9999 2016-03-24T05:57:55.876-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.876-07:00 [Info] KVSender::sendShutdownTopic Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a 2016-03-24T05:57:55.877-07:00 [Fatal] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 172.23.100.73:9999 Topic INIT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a. Err projector.topicMissing 2016-03-24T05:57:55.877-07:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 172.23.100.73:9999 2016-03-24T05:57:55.877-07:00 [Info] KVSender::closeMutationStream INIT_STREAM Treating projector.topicMissing As Success 2016-03-24T05:57:55.877-07:00 [Info] ClustMgr:handleGetGlobalTopology &{map[]} 2016-03-24T05:57:55.877-07:00 [Info] Indexer::initFromPersistedState Recovered IndexInstMap 2016-03-24T05:57:55.877-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap 2016-03-24T05:57:55.877-07:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap 2016-03-24T05:57:55.877-07:00 [Info] ClustMgr:handleIndexerReady &{52 [] {false false false false} 0} 2016-03-24T05:57:55.877-07:00 [Info] Indexer::NewIndexer Status ACTIVE 2016-03-24T05:57:55.878-07:00 [Info] CompactionManager: Refreshing settings 2016-03-24T05:58:55.806-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"71 4287218 331837113240"} 2016-03-24T05:59:55.806-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"143 25887086 309102260590380"} 2016-03-24T06:00:55.806-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"215 29717362 309312433387828"} 2016-03-24T06:01:55.807-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"286 50695669 610045018621169"} 2016-03-24T06:02:55.807-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"358 54490754 610256831912180"} 2016-03-24T06:03:55.807-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"430 58334519 610470691749099"} 2016-03-24T06:04:55.808-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"502 62262055 610694656370693"} 2016-03-24T06:05:55.825-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"574 66025240 610899704839790"} 2016-03-24T06:06:55.826-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"646 69913328 611116870891034"} 2016-03-24T06:07:55.844-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"718 73964755 611354700629571"} 2016-03-24T06:08:55.844-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"790 77817474 611570871932946"} 2016-03-24T06:09:55.861-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"862 81533573 611767503218051"} 2016-03-24T06:10:55.861-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"933 85535214 612000855283852"} 2016-03-24T06:11:55.894-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1005 89500030 612225488149996"} 2016-03-24T06:12:55.894-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1078 93533449 612461041625649"} 2016-03-24T06:13:55.894-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1150 97389194 612684411652570"} 2016-03-24T06:14:55.912-07:00 [Info] PeriodicStats = {"memory_quota":104857600000,"memory_used":192512,"needs_restart":false,"num_connections":0,"timings/stats_response":"1222 101174102 612894453692476"} 2016-03-24T06:15:42.859-07:00 [Info] clustMgrAgent::OnIndexCreate Notification Received for Create Index DefnId: 1061207747814546192 Name: by_email_name_street Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email` `name` `street`] PartitionScheme: SINGLE PartitionKey: WhereExpr: 2016-03-24T06:15:42.86-07:00 [Info] Indexer::handleCreateIndex InstId: 1061207747814546192 Defn: DefnId: 1061207747814546192 Name: by_email_name_street Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email` `name` `street`] PartitionScheme: SINGLE PartitionKey: WhereExpr: State: INDEX_STATE_CREATED Stream: NIL_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1} 2016-03-24T06:15:42.894-07:00 [Info] Indexer::initPartnInstance Initialized Partition: Index: 1061207747814546192 Partition: PartitionId: 1 Endpoints: [:9105] 2016-03-24T06:15:42.903-07:00 [Info] ForestDBSlice:NewForestDBSlice Created New Slice Id 0 IndexInstId 1061207747814546192 WriterThreads 1 2016-03-24T06:15:42.903-07:00 [Info] Indexer::initPartnInstance Initialized Slice: Index: 1061207747814546192 Slice: SliceId: 0 File: /data/@2i/bucket-1_by_email_name_street_1061207747814546192_0.index Index: 1061207747814546192 2016-03-24T06:15:42.903-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 1061207747814546192 Name: by_email_name_street Bucket: bucket-1 State: INDEX_STATE_CREATED Stream: NIL_STREAM 2016-03-24T06:15:42.903-07:00 [Info] MutationMgr::handleUpdateIndexPartnMap Message: MsgUpdatePartnMap InstanceId: 1061207747814546192 PartitionId: 0 Endpoints: [:9105] 2016-03-24T06:15:42.91-07:00 [Info] clustMgrAgent::OnIndexCreate Success for Create Index DefnId: 1061207747814546192 Name: by_email_name_street Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email` `name` `street`] PartitionScheme: SINGLE PartitionKey: WhereExpr: 2016-03-24T06:15:42.919-07:00 [Info] clustMgrAgent::OnIndexBuild Notification Received for Build Index [1061207747814546192] 2016-03-24T06:15:42.919-07:00 [Info] Indexer::handleBuildIndex [1061207747814546192] 2016-03-24T06:15:43.005-07:00 [Info] DCPT[secidx:getseqnos-32:9b:6a:db:92:bb:68:70] ##abba feed started ... 2016-03-24T06:15:43.008-07:00 [Info] DCPT[secidx:getseqnos-48:14:9a:52:f3:9c:1d:b3] ##abba feed started ... 2016-03-24T06:15:43.011-07:00 [Info] DCPT[secidx:getseqnos-97:3d:41:bd:c7:b1:d4:d0] ##abba feed started ... 2016-03-24T06:15:43.013-07:00 [Info] DCPT[secidx:getseqnos-e7:7d:da:eb:6a:f1:e5:51] ##abba feed started ... 2016-03-24T06:15:43.014-07:00 [Info] {bucket,feeds} "bucket-1" created for dcp_seqno cache... 2016-03-24T06:15:43.018-07:00 [Info] Indexer::handleBuildIndex Added Index: [1061207747814546192] to Stream: MAINT_STREAM State: INDEX_STATE_INITIAL 2016-03-24T06:15:43.018-07:00 [Info] MutationMgr::handleUpdateIndexInstMap Message: MsgUpdateInstMap InstanceId: 1061207747814546192 Name: by_email_name_street Bucket: bucket-1 State: INDEX_STATE_INITIAL Stream: MAINT_STREAM 2016-03-24T06:15:43.018-07:00 [Info] Timekeeper::handleStreamOpen Stream MAINT_STREAM State Changed to ACTIVE 2016-03-24T06:15:43.018-07:00 [Info] StreamState::initBucketInStream New Bucket bucket-1 Added for Stream MAINT_STREAM 2016-03-24T06:15:43.018-07:00 [Info] Timekeeper::addIndextoStream IndexCount map[MAINT_STREAM:map[bucket-1:1]] 2016-03-24T06:15:43.018-07:00 [Info] Timekeeper::addIndextoStream add BuildInfo index 1061207747814546192 stream MAINT_STREAM bucket bucket-1 state INDEX_STATE_INITIAL 2016-03-24T06:15:43.018-07:00 [Info] Timekeeper::startTimer MAINT_STREAM bucket-1 2016-03-24T06:15:43.018-07:00 [Info] MutationMgr::handleOpenStream Message: MsgStreamUpdate Type: OPEN_STREAM Stream: MAINT_STREAM Bucket: bucket-1 BuildTS: [0=19535,1=19515,2=19515,3=19535,4=19550,5=19525,6=19525,7=19550,8=19525,9=19550,10=19550,11=19525,12=19515,13=19535,14=19535,15=19515,16=19535,17=19515,18=19515,19=19535,20=19550,21=19525,22=19525,23=19550,24=19525,25=19550,26=19550,27=19525,28=19515,29=19535,30=19535,31=19515,32=19535,33=19515,34=19515,35=19535,36=19550,37=19525,38=19525,39=19550,40=19525,41=19550,42=19550,43=19525,44=19515,45=19535,46=19535,47=19515,48=19535,49=19515,50=19515,51=19535,52=19550,53=19525,54=19525,55=19550,56=19525,57=19550,58=19550,59=19525,60=19515,61=19535,62=19535,63=19515,64=19525,65=19550,66=19550,67=19525,68=19515,69=19535,70=19535,71=19515,72=19535,73=19515,74=19515,75=19535,76=19550,77=19525,78=19525,79=19550,80=19525,81=19550,82=19550,83=19525,84=19515,85=19535,86=19535,87=19515,88=19535,89=19515,90=19515,91=19535,92=19550,93=19525,94=19525,95=19550,96=19525,97=19550,98=19550,99=19525,100=19515,101=19535,102=19535,103=19515,104=19535,105=19515,106=19515,107=19535,108=19550,109=19525,110=19525,111=19550,112=19525,113=19550,114=19550,115=19525,116=19515,117=19535,118=19535,119=19515,120=19535,121=19515,122=19515,123=19535,124=19550,125=19525,126=19525,127=19550,128=19515,129=19535,130=19535,131=19515,132=19525,133=19550,134=19550,135=19525,136=19550,137=19525,138=19525,139=19550,140=19535,141=19515,142=19515,143=19535,144=19515,145=19535,146=19535,147=19515,148=19525,149=19550,150=19550,151=19525,152=19550,153=19525,154=19525,155=19550,156=19535,157=19515,158=19515,159=19535,160=19515,161=19535,162=19535,163=19515,164=19525,165=19550,166=19550,167=19525,168=19550,169=19525,170=19525,171=19550,172=19535,173=19515,174=19515,175=19535,176=19515,177=19535,178=19535,179=19515,180=19525,181=19550,182=19550,183=19525,184=19550,185=19525,186=19525,187=19550,188=19535,189=19515,190=19515,191=19535,192=19550,193=19525,194=19525,195=19550,196=19535,197=19515,198=19515,199=19535,200=19515,201=19535,202=19535,203=19515,204=19525,205=19550,206=19550,207=19525,208=19550,209=19525,210=19525,211=19550,212=19535,213=19515,214=19515,215=19535,216=19515,217=19535,218=19535,219=19515,220=19525,221=19550,222=19550,223=19525,224=19550,225=19525,226=19525,227=19550,228=19535,229=19515,230=19515,231=19535,232=19515,233=19535,234=19535,235=19515,236=19525,237=19550,238=19550,239=19525,240=19550,241=19525,242=19525,243=19550,244=19535,245=19515,246=19515,247=19535,248=19515,249=19535,250=19535,251=19515,252=19525,253=19550,254=19550,255=19525,256=19525,257=19550,258=19550,259=19525,260=19516,261=19535,262=19535,263=19515,264=19535,265=19515,266=19515,267=19535,268=19550,269=19525,270=19525,271=19550,272=19525,273=19550,274=19550,275=19525,276=19515,277=19535,278=19535,279=19515,280=19535,281=19515,282=19515,283=19535,284=19550,285=19525,286=19525,287=19550,288=19525,289=19550,290=19550,291=19525,292=19515,293=19535,294=19535,295=19515,296=19535,297=19515,298=19515,299=19535,300=19550,301=19525,302=19525,303=19550,304=19525,305=19550,306=19550,307=19525,308=19515,309=19535,310=19535,311=19515,312=19535,313=19515,314=19515,315=19535,316=19550,317=19525,318=19525,319=19550,320=19535,321=19515,322=19515,323=19535,324=19550,325=19525,326=19525,327=19550,328=19525,329=19550,330=19550,331=19525,332=19515,333=19535,334=19535,335=19515,336=19535,337=19515,338=19515,339=19535,340=19550,341=19525,342=19525,343=19550,344=19525,345=19550,346=19550,347=19525,348=19515,349=19535,350=19535,351=19515,352=19535,353=19515,354=19515,355=19535,356=19550,357=19525,358=19525,359=19550,360=19525,361=19550,362=19550,363=19525,364=19515,365=19535,366=19535,367=19515,368=19535,369=19515,370=19515,371=19535,372=19550,373=19525,374=19525,375=19550,376=19525,377=19550,378=19550,379=19525,380=19515,381=19535,382=19535,383=19515,384=19550,385=19525,386=19525,387=19550,388=19535,389=19515,390=19515,391=19535,392=19515,393=19535,394=19535,395=19515,396=19525,397=19550,398=19550,399=19525,400=19550,401=19525,402=19525,403=19550,404=19535,405=19515,406=19515,407=19535,408=19515,409=19535,410=19535,411=19515,412=19525,413=19550,414=19550,415=19525,416=19550,417=19525,418=19525,419=19550,420=19535,421=19515,422=19515,423=19535,424=19515,425=19535,426=19535,427=19515,428=19525,429=19550,430=19549,431=19525,432=19550,433=19525,434=19525,435=19550,436=19535,437=19515,438=19515,439=19535,440=19515,441=19535,442=19535,443=19515,444=19525,445=19550,446=19550,447=19525,448=19515,449=19535,450=19535,451=19515,452=19525,453=19550,454=19550,455=19525,456=19550,457=19525,458=19525,459=19550,460=19535,461=19515,462=19515,463=19535,464=19515,465=19535,466=19535,467=19515,468=19525,469=19550,470=19550,471=19525,472=19550,473=19525,474=19525,475=19550,476=19535,477=19515,478=19515,479=19535,480=19515,481=19535,482=19535,483=19515,484=19525,485=19550,486=19550,487=19525,488=19550,489=19525,490=19525,491=19550,492=19535,493=19515,494=19515,495=19535,496=19515,497=19535,498=19535,499=19515,500=19525,501=19550,502=19550,503=19525,504=19550,505=19525,506=19525,507=19550,508=19535,509=19515,510=19515,511=19535,512=19515,513=19535,514=19535,515=19515,516=19525,517=19550,518=19550,519=19525,520=19550,521=19525,522=19525,523=19550,524=19535,525=19515,526=19515,527=19535,528=19515,529=19535,530=19535,531=19515,532=19525,533=19550,534=19550,535=19525,536=19550,537=19525,538=19525,539=19550,540=19535,541=19515,542=19515,543=19535,544=19515,545=19535,546=19535,547=19515,548=19525,549=19550,550=19550,551=19525,552=19549,553=19525,554=19525,555=19550,556=19535,557=19515,558=19515,559=19535,560=19515,561=19535,562=19535,563=19515,564=19525,565=19550,566=19550,567=19525,568=19550,569=19525,570=19525,571=19550,572=19535,573=19515,574=19515,575=19535,576=19550,577=19525,578=19525,579=19550,580=19535,581=19515,582=19515,583=19535,584=19515,585=19535,586=19535,587=19515,588=19525,589=19550,590=19550,591=19525,592=19550,593=19525,594=19525,595=19550,596=19535,597=19515,598=19515,599=19535,600=19515,601=19535,602=19535,603=19515,604=19525,605=19550,606=19550,607=19525,608=19550,609=19525,610=19525,611=19550,612=19535,613=19515,614=19515,615=19535,616=19515,617=19535,618=19535,619=19515,620=19525,621=19550,622=19550,623=19525,624=19550,625=19525,626=19525,627=19550,628=19535,629=19515,630=19515,631=19535,632=19515,633=19535,634=19535,635=19515,636=19525,637=19550,638=19550,639=19525,640=19535,641=19515,642=19516,643=19535,644=19550,645=19525,646=19525,647=19550,648=19525,649=19550,650=19550,651=19525,652=19515,653=19535,654=19535,655=19515,656=19535,657=19515,658=19515,659=19535,660=19550,661=19525,662=19525,663=19550,664=19525,665=19550,666=19550,667=19525,668=19515,669=19535,670=19535,671=19515,672=19535,673=19515,674=19515,675=19535,676=19550,677=19525,678=19525,679=19550,680=19525,681=19550,682=19550,683=19525,684=19515,685=19535,686=19535,687=19515,688=19535,689=19515,690=19515,691=19535,692=19550,693=19525,694=19525,695=19550,696=19525,697=19550,698=19550,699=19525,700=19515,701=19535,702=19535,703=19515,704=19525,705=19550,706=19550,707=19525,708=19515,709=19535,710=19535,711=19515,712=19535,713=19515,714=19515,715=19535,716=19550,717=19525,718=19525,719=19550,720=19525,721=19550,722=19550,723=19525,724=19515,725=19535,726=19535,727=19515,728=19535,729=19515,730=19515,731=19535,732=19550,733=19525,734=19525,735=19550,736=19525,737=19550,738=19550,739=19525,740=19515,741=19535,742=19535,743=19515,744=19535,745=19515,746=19515,747=19535,748=19550,749=19525,750=19525,751=19550,752=19525,753=19550,754=19550,755=19525,756=19515,757=19535,758=19535,759=19515,760=19535,761=19515,762=19515,763=19535,764=19550,765=19525,766=19525,767=19550,768=19550,769=19525,770=19525,771=19550,772=19535,773=19515,774=19515,775=19535,776=19515,777=19535,778=19535,779=19515,780=19525,781=19550,782=19550,783=19525,784=19550,785=19525,786=19525,787=19550,788=19535,789=19515,790=19515,791=19535,792=19515,793=19535,794=19535,795=19515,796=19525,797=19550,798=19550,799=19525,800=19550,801=19525,802=19525,803=19550,804=19535,805=19515,806=19515,807=19535,808=19515,809=19535,810=19535,811=19515,812=19525,813=19550,814=19550,815=19525,816=19550,817=19525,818=19525,819=19550,820=19535,821=19515,822=19515,823=19535,824=19515,825=19535,826=19535,827=19515,828=19525,8 29=19550,830=19550,831=19525,832=19515,833=19535,834=19535,835=19515,836=19525,837=19550,838=19550,839=19525,840=19550,841=19525,842=19525,843=19550,844=19535,845=19515,846=19515,847=19535,848=19515,849=19535,850=19535,851=19515,852=19525,853=19550,854=19550,855=19525,856=19550,857=19525,858=19525,859=19550,860=19535,861=19515,862=19515,863=19535,864=19515,865=19535,866=19535,867=19515,868=19525,869=19550,870=19550,871=19525,872=19550,873=19525,874=19525,875=19550,876=19535,877=19515,878=19515,879=19535,880=19515,881=19535,882=19535,883=19515,884=19525,885=19550,886=19550,887=19525,888=19550,889=19525,890=19525,891=19550,892=19535,893=19515,894=19515,895=19535,896=19525,897=19550,898=19550,899=19525,900=19515,901=19535,902=19535,903=19515,904=19535,905=19515,906=19515,907=19535,908=19550,909=19525,910=19525,911=19550,912=19525,913=19550,914=19550,915=19525,916=19515,917=19535,918=19535,919=19515,920=19535,921=19515,922=19515,923=19535,924=19550,925=19525,926=19525,927=19550,928=19525,929=19550,930=19550,931=19525,932=19515,933=19535,934=19535,935=19515,936=19535,937=19515,938=19515,939=19535,940=19550,941=19525,942=19525,943=19550,944=19525,945=19550,946=19550,947=19525,948=19515,949=19535,950=19535,951=19515,952=19535,953=19515,954=19515,955=19535,956=19550,957=19525,958=19525,959=19550,960=19535,961=19515,962=19515,963=19535,964=19550,965=19525,966=19525,967=19550,968=19525,969=19550,970=19550,971=19525,972=19515,973=19535,974=19535,975=19515,976=19535,977=19515,978=19515,979=19535,980=19550,981=19525,982=19525,983=19550,984=19525,985=19550,986=19550,987=19525,988=19515,989=19535,990=19535,991=19515,992=19535,993=19515,994=19515,995=19535,996=19550,997=19525,998=19525,999=19550,1000=19525,1001=19550,1002=19550,1003=19525,1004=19515,1005=19535,1006=19535,1007=19515,1008=19535,1009=19515,1010=19515,1011=19535,1012=19550,1013=19525,1014=19525,1015=19550,1016=19525,1017=19550,1018=19550,1019=19525,1020=19515,1021=19535,1022=19535,1023=19515] IndexList: [ InstId: 1061207747814546192 Defn: DefnId: 1061207747814546192 Name: by_email_name_street Using: forestdb Bucket: bucket-1 IsPrimary: false SecExprs: [`email` `name` `street`] PartitionScheme: SINGLE PartitionKey: WhereExpr: State: INDEX_STATE_INITIAL Stream: MAINT_STREAM PartitionContainer: &{map[1:{1 [:9105]}] 1}] RestartTs: 2016-03-24T06:15:43.034-07:00 [Info] MutationMgr:: Set maxVbQueueLength 10000 2016-03-24T06:15:43.035-07:00 [Info] DATP[->dataport ":9105"] started ... 2016-03-24T06:15:43.035-07:00 [Info] MutationStreamReader::startWorkers Starting All Stream Workers MAINT_STREAM 2016-03-24T06:15:43.035-07:00 [Info] MutationStreamReader::startMutationStreamWorker Stream Worker 0 Started for Stream MAINT_STREAM. 2016-03-24T06:15:43.035-07:00 [Info] ClustMgr:handleUpdateTopologyForIndex &{47 [{1061207747814546192 {1061207747814546192 by_email_name_street forestdb bucket-1 33f1d288e0dcbab114d5649334bf7caa false [`email` `name` `street`] N1QL SINGLE false [e4:ca:9:4d:61:5e:f:8a]} 2 1 0xc20b97b590 []}] {true true false true} 0} 2016-03-24T06:15:43.036-07:00 [Info] clustMgrAgent::OnIndexBuild returns for Build Index [1061207747814546192] 2016-03-24T06:15:43.544-07:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 Instances [indexInstance: singlePartn: > ] 2016-03-24T06:15:43.565-07:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.70:36896" +1 2016-03-24T06:15:43.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 0 76176862848613 0 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1 274137560215418 0 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 2 221771064850163 0 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 3 219433936890789 0 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 4 143751736501985 0 2016-03-24T06:15:43.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 5 213436911280030 0 2016-03-24T06:15:43.793-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 7 162342664542224 0 2016-03-24T06:15:43.793-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 8 60567506448795 0 2016-03-24T06:15:43.795-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 6 245391080537131 0 2016-03-24T06:15:43.816-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 9 165140897024921 0 2016-03-24T06:15:43.816-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 10 7124185708344 0 2016-03-24T06:15:43.816-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 11 206005778886322 0 2016-03-24T06:15:43.824-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 12 107998093696873 0 2016-03-24T06:15:43.84-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1 QueuedCount 3 2016-03-24T06:15:43.842-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:43.843-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 13 79207387482501 0 2016-03-24T06:15:43.843-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 14 37848909125537 0 2016-03-24T06:15:43.848-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 15 278990661737973 0 2016-03-24T06:15:43.866-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 16 12841722452901 0 2016-03-24T06:15:43.891-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 17 245532021292100 0 2016-03-24T06:15:43.899-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 19 4504410763540 0 2016-03-24T06:15:43.9-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 18 105534021874420 0 2016-03-24T06:15:43.907-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 20 65867044609680 0 2016-03-24T06:15:43.907-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 21 43187935793050 0 2016-03-24T06:15:43.919-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 23 238095541968718 0 2016-03-24T06:15:43.921-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 22 209272590869297 0 2016-03-24T06:15:43.923-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 24 11086975080666 0 2016-03-24T06:15:43.934-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 26 171027909111025 0 2016-03-24T06:15:43.936-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 25 40007306667005 0 2016-03-24T06:15:43.943-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 27 61089963589589 0 2016-03-24T06:15:43.943-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 28 262393512948221 0 2016-03-24T06:15:43.948-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 29 188711644250152 0 2016-03-24T06:15:43.948-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 30 247647049258602 0 2016-03-24T06:15:43.958-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 31 144748595690052 0 2016-03-24T06:15:43.958-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 32 127553461134495 0 2016-03-24T06:15:43.964-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 33 136216675507951 0 2016-03-24T06:15:43.964-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 34 265768312504779 0 2016-03-24T06:15:43.965-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 35 106202110992354 0 2016-03-24T06:15:43.971-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 37 174207745639773 0 2016-03-24T06:15:43.972-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 36 233914887551996 0 2016-03-24T06:15:43.981-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 39 88121734407879 0 2016-03-24T06:15:43.983-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 38 131087922905729 0 2016-03-24T06:15:43.993-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 40 138056012430438 0 2016-03-24T06:15:43.993-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 41 236699129517412 0 2016-03-24T06:15:43.998-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 42 211585862114692 0 2016-03-24T06:15:43.998-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 43 225828654441999 0 2016-03-24T06:15:44.008-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 44 18712831960823 0 2016-03-24T06:15:44.015-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 46 122760881251157 0 2016-03-24T06:15:44.015-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 47 60447507070700 0 2016-03-24T06:15:44.016-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 45 42541576560435 0 2016-03-24T06:15:44.023-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 48 89508150287230 0 2016-03-24T06:15:44.023-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 49 53170407063380 0 2016-03-24T06:15:44.031-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 52 137920352268828 0 2016-03-24T06:15:44.032-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 50 38537105173483 0 2016-03-24T06:15:44.032-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 51 158351056572420 0 2016-03-24T06:15:44.039-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 53 204625552938271 0 2016-03-24T06:15:44.039-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 54 219855863425356 0 2016-03-24T06:15:44.048-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 55 180740990769701 0 2016-03-24T06:15:44.048-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 56 255719409646342 0 2016-03-24T06:15:44.057-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:44.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 57 68656701957939 0 2016-03-24T06:15:44.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 58 258608018250588 0 2016-03-24T06:15:44.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 59 225010692002059 0 2016-03-24T06:15:44.089-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 62 13465303340645 0 2016-03-24T06:15:44.089-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 63 224278958147004 0 2016-03-24T06:15:44.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 60 215058515725984 0 2016-03-24T06:15:44.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 61 57929103688440 0 2016-03-24T06:15:44.097-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 64 220796218766995 0 2016-03-24T06:15:44.097-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 65 117200474190068 0 2016-03-24T06:15:44.098-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 66 243596719144896 0 2016-03-24T06:15:44.104-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 67 173367488792115 0 2016-03-24T06:15:44.104-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 68 255420042735919 0 2016-03-24T06:15:44.11-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 69 197396580729986 0 2016-03-24T06:15:44.11-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 70 256324904085663 0 2016-03-24T06:15:44.113-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 71 10972933617632 0 2016-03-24T06:15:44.114-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 72 114093833765650 0 2016-03-24T06:15:44.114-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 73 120311298531608 0 2016-03-24T06:15:44.118-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 74 260593217622160 0 2016-03-24T06:15:44.118-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 75 279547957896471 0 2016-03-24T06:15:44.123-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 76 70412823012829 0 2016-03-24T06:15:44.123-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 77 27126463609598 0 2016-03-24T06:15:44.123-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 78 228875007489452 0 2016-03-24T06:15:44.128-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 79 51525543501571 0 2016-03-24T06:15:44.128-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 80 235926010578011 0 2016-03-24T06:15:44.128-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 81 100851622160887 0 2016-03-24T06:15:44.133-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 82 279333184760399 0 2016-03-24T06:15:44.133-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 83 245569831767510 0 2016-03-24T06:15:44.138-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 84 146898800232922 0 2016-03-24T06:15:44.138-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 85 212585346643118 0 2016-03-24T06:15:44.138-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 86 219496160676983 0 2016-03-24T06:15:44.143-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 87 205174426943014 0 2016-03-24T06:15:44.143-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 88 229812928422162 0 2016-03-24T06:15:44.147-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 89 98033773075933 0 2016-03-24T06:15:44.147-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 90 149194201958136 0 2016-03-24T06:15:44.148-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 91 127755057234743 0 2016-03-24T06:15:44.153-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 93 49634427507826 0 2016-03-24T06:15:44.154-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 92 123267011122616 0 2016-03-24T06:15:44.159-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 94 241947472330518 0 2016-03-24T06:15:44.159-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 95 181856788607228 0 2016-03-24T06:15:44.164-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 96 3681655675076 0 2016-03-24T06:15:44.164-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 97 210527804409725 0 2016-03-24T06:15:44.174-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 98 24746674445891 0 2016-03-24T06:15:44.178-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 99 42712040656446 0 2016-03-24T06:15:44.178-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 100 11206264316522 0 2016-03-24T06:15:44.178-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 101 53471635421758 0 2016-03-24T06:15:44.181-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 102 131891280632924 0 2016-03-24T06:15:44.181-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 103 216814524967406 0 2016-03-24T06:15:44.181-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 104 10175218950654 0 2016-03-24T06:15:44.185-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 105 187633557172422 0 2016-03-24T06:15:44.185-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 106 33053331913281 0 2016-03-24T06:15:44.191-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 107 195797999252268 0 2016-03-24T06:15:44.191-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 108 144282784204809 0 2016-03-24T06:15:44.197-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 109 60550116434851 0 2016-03-24T06:15:44.197-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 110 173451418885907 0 2016-03-24T06:15:44.199-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 111 186350624276455 0 2016-03-24T06:15:44.204-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 112 180801592083003 0 2016-03-24T06:15:44.204-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 113 217107312955511 0 2016-03-24T06:15:44.204-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 114 125862998532191 0 2016-03-24T06:15:44.209-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 115 17250453691332 0 2016-03-24T06:15:44.209-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 116 241585951015254 0 2016-03-24T06:15:44.213-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 117 114154993245756 0 2016-03-24T06:15:44.221-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 118 236941534720393 0 2016-03-24T06:15:44.221-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 119 72270591225729 0 2016-03-24T06:15:44.221-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 120 41294900782456 0 2016-03-24T06:15:44.225-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 121 249766941459201 0 2016-03-24T06:15:44.225-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 122 208309783216102 0 2016-03-24T06:15:44.227-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 124 167769990789085 0 2016-03-24T06:15:44.229-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 123 18825668294183 0 2016-03-24T06:15:44.234-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 125 187405838372423 0 2016-03-24T06:15:44.234-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 126 69318049680749 0 2016-03-24T06:15:44.238-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 127 222343941473362 0 2016-03-24T06:15:44.238-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 128 59328433470084 0 2016-03-24T06:15:44.24-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 129 93954557071690 0 2016-03-24T06:15:44.24-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 130 53894123064157 0 2016-03-24T06:15:44.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 131 162302205443258 0 2016-03-24T06:15:44.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 132 13356320304815 0 2016-03-24T06:15:44.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 133 117135892186625 0 2016-03-24T06:15:44.249-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 134 74009953591281 0 2016-03-24T06:15:44.249-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 135 227616160371361 0 2016-03-24T06:15:44.26-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 136 121169050498331 0 2016-03-24T06:15:44.26-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 137 153581265535837 0 2016-03-24T06:15:44.26-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 138 235291939763742 0 2016-03-24T06:15:44.262-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:44.262-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 139 157539346853484 0 2016-03-24T06:15:44.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 140 15291816242000 0 2016-03-24T06:15:44.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 141 239937891780985 0 2016-03-24T06:15:44.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 142 110835577644693 0 2016-03-24T06:15:44.272-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 143 81455257579137 0 2016-03-24T06:15:44.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 145 37457920127542 0 2016-03-24T06:15:44.278-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 144 278072048831495 0 2016-03-24T06:15:44.284-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 149 146811993888208 0 2016-03-24T06:15:44.284-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 150 234647618700079 0 2016-03-24T06:15:44.284-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 147 28919664297127 0 2016-03-24T06:15:44.284-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 148 59131161558930 0 2016-03-24T06:15:44.284-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 146 167688045882499 0 2016-03-24T06:15:44.285-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 151 71485468039791 0 2016-03-24T06:15:44.285-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 153 262909492570908 0 2016-03-24T06:15:44.285-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 154 165610533324855 0 2016-03-24T06:15:44.286-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 152 126192641543180 0 2016-03-24T06:15:44.286-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 155 51883898187493 0 2016-03-24T06:15:44.291-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 156 50857917098895 0 2016-03-24T06:15:44.291-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 157 26315830581498 0 2016-03-24T06:15:44.291-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 158 197725115492101 0 2016-03-24T06:15:44.291-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 159 224854417268237 0 2016-03-24T06:15:44.296-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 160 142715908968967 0 2016-03-24T06:15:44.296-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 161 140807070026514 0 2016-03-24T06:15:44.298-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 162 68801237803727 0 2016-03-24T06:15:44.298-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 163 209964179543058 0 2016-03-24T06:15:44.298-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 164 232880030396153 0 2016-03-24T06:15:44.302-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 166 155788768034426 0 2016-03-24T06:15:44.303-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 165 85535194210571 0 2016-03-24T06:15:44.308-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 167 189753959981660 0 2016-03-24T06:15:44.308-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 168 196502155831118 0 2016-03-24T06:15:44.308-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 169 141107785379961 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 173 109950437127604 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 174 37085057114457 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 170 162717393086540 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 172 149846195389099 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 171 243135835199975 0 2016-03-24T06:15:44.315-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 175 25026312277908 0 2016-03-24T06:15:44.328-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 176 277468495756 0 2016-03-24T06:15:44.328-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 177 187013860718588 0 2016-03-24T06:15:44.328-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 178 101232253769126 0 2016-03-24T06:15:44.329-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 180 48754867927690 0 2016-03-24T06:15:44.329-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 181 107435729682617 0 2016-03-24T06:15:44.329-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 182 7296322612412 0 2016-03-24T06:15:44.33-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 179 105133367088597 0 2016-03-24T06:15:44.331-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 183 255887271292027 0 2016-03-24T06:15:44.337-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 185 122746127913313 0 2016-03-24T06:15:44.337-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 186 223050216697948 0 2016-03-24T06:15:44.338-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 188 260458522752285 0 2016-03-24T06:15:44.338-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 184 73282795772025 0 2016-03-24T06:15:44.338-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 187 98954836940440 0 2016-03-24T06:15:44.342-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 189 221047346265791 0 2016-03-24T06:15:44.342-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 190 15325447810605 0 2016-03-24T06:15:44.351-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 193 37322566637588 0 2016-03-24T06:15:44.352-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 191 240749707372872 0 2016-03-24T06:15:44.352-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 192 152220795008735 0 2016-03-24T06:15:44.365-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 194 61920162685781 0 2016-03-24T06:15:44.365-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 195 121664139011097 0 2016-03-24T06:15:44.368-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 196 14009356758496 0 2016-03-24T06:15:44.382-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 197 98457157626214 0 2016-03-24T06:15:44.383-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 198 151675048967108 0 2016-03-24T06:15:44.383-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 199 176167356637138 0 2016-03-24T06:15:44.385-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 201 237314207893296 0 2016-03-24T06:15:44.385-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 203 149919438542353 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 200 118841097631480 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 202 135841738012107 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 204 178846909383482 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 206 51569897631136 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 207 178166333278374 0 2016-03-24T06:15:44.386-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 209 95909226576934 0 2016-03-24T06:15:44.387-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 205 115853613524119 0 2016-03-24T06:15:44.387-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 208 129668193481849 0 2016-03-24T06:15:44.388-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 210 129959604923359 0 2016-03-24T06:15:44.388-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 211 152837956720501 0 2016-03-24T06:15:44.388-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 212 1135169123931 0 2016-03-24T06:15:44.39-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 213 233401252576102 0 2016-03-24T06:15:44.39-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 214 96004122289918 0 2016-03-24T06:15:44.391-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 216 167725950239025 0 2016-03-24T06:15:44.391-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 217 215342030764336 0 2016-03-24T06:15:44.393-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 215 194369787890046 0 2016-03-24T06:15:44.397-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 218 127646628934178 0 2016-03-24T06:15:44.397-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 219 35952511638477 0 2016-03-24T06:15:44.397-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 220 83816109642015 0 2016-03-24T06:15:44.4-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 222 212659581765095 0 2016-03-24T06:15:44.4-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 223 159118508734834 0 2016-03-24T06:15:44.4-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 224 56840169229211 0 2016-03-24T06:15:44.402-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 221 128766972228000 0 2016-03-24T06:15:44.408-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 225 52140477860971 0 2016-03-24T06:15:44.408-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 226 213745289671605 0 2016-03-24T06:15:44.408-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 227 3844170389582 0 2016-03-24T06:15:44.408-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 228 181513450318953 0 2016-03-24T06:15:44.411-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 229 147737302608211 0 2016-03-24T06:15:44.412-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 230 258578158541190 0 2016-03-24T06:15:44.414-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000 2016-03-24T06:15:44.414-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 231 173893604216596 0 2016-03-24T06:15:44.414-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 232 93591272078144 0 2016-03-24T06:15:44.414-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 233 277252582442190 0 2016-03-24T06:15:44.418-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 234 244291255462410 0 2016-03-24T06:15:44.418-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 235 125133072827400 0 2016-03-24T06:15:44.423-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 236 235877330735306 0 2016-03-24T06:15:44.423-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 237 89527169495949 0 2016-03-24T06:15:44.445-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 238 108927115154033 0 2016-03-24T06:15:44.447-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 239 13030710875072 0 2016-03-24T06:15:44.447-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 240 235601658078159 0 2016-03-24T06:15:44.447-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 241 179717385112354 0 2016-03-24T06:15:44.447-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 242 115964151382722 0 2016-03-24T06:15:44.449-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 243 229323944902823 0 2016-03-24T06:15:44.449-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 244 97656613684454 0 2016-03-24T06:15:44.45-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 245 23989312914305 0 2016-03-24T06:15:44.45-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 246 94272889476039 0 2016-03-24T06:15:44.451-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 247 248037770924857 0 2016-03-24T06:15:44.451-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 248 11519468585440 0 2016-03-24T06:15:44.452-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 249 259100596531328 0 2016-03-24T06:15:44.46-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 250 98976734259321 0 2016-03-24T06:15:44.462-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:44.47-07:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.70:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 InstanceIds [1061207747814546192] 2016-03-24T06:15:44.47-07:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 Instances [indexInstance: singlePartn: > ] 2016-03-24T06:15:44.476-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 251 52042675045221 0 2016-03-24T06:15:44.476-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 252 237863524219061 0 2016-03-24T06:15:44.476-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 253 162755999136045 0 2016-03-24T06:15:44.477-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 254 258231206638021 0 2016-03-24T06:15:44.477-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 255 177977721460258 0 2016-03-24T06:15:44.524-07:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.71:45167" +2 2016-03-24T06:15:44.65-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 10000 QueuedCount 3423 2016-03-24T06:15:44.654-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:44.765-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 256 55811933141863 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 257 99672792429820 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 258 71915037592989 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 261 235813933415482 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 262 164330607709736 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 264 145861264704575 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 259 273209313687002 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 260 122999713823942 0 2016-03-24T06:15:44.766-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 263 119284198950710 0 2016-03-24T06:15:44.784-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 265 172748550874981 0 2016-03-24T06:15:44.784-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 266 212311077210557 0 2016-03-24T06:15:44.784-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 267 50138972439350 0 2016-03-24T06:15:44.791-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 268 183798736293810 0 2016-03-24T06:15:44.803-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 269 27487660128022 0 2016-03-24T06:15:44.803-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 270 181828888509590 0 2016-03-24T06:15:44.803-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 271 264884907433219 0 2016-03-24T06:15:44.805-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 20000 2016-03-24T06:15:44.814-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 272 33776083788698 0 2016-03-24T06:15:44.814-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 273 45614358781515 0 2016-03-24T06:15:44.831-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 274 184541659154404 0 2016-03-24T06:15:44.831-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 275 252802185780290 0 2016-03-24T06:15:44.831-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 276 92770627301082 0 2016-03-24T06:15:44.853-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 277 149990910380318 0 2016-03-24T06:15:44.855-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:44.861-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 278 206781448487195 0 2016-03-24T06:15:44.861-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 279 81901384833047 0 2016-03-24T06:15:44.864-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 280 235202810537292 0 2016-03-24T06:15:44.864-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 281 167106865644757 0 2016-03-24T06:15:44.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 282 122652927947846 0 2016-03-24T06:15:44.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 283 78413020162272 0 2016-03-24T06:15:44.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 284 261672688970766 0 2016-03-24T06:15:44.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 285 234829272315505 0 2016-03-24T06:15:44.884-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 286 261485324870278 0 2016-03-24T06:15:44.884-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 287 59574581378305 0 2016-03-24T06:15:44.884-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 288 233946261001181 0 2016-03-24T06:15:44.884-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 289 27736569959511 0 2016-03-24T06:15:44.89-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 290 67255292414846 0 2016-03-24T06:15:44.89-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 291 235030504859377 0 2016-03-24T06:15:44.89-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 292 3853668778042 0 2016-03-24T06:15:44.903-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 293 83631533169603 0 2016-03-24T06:15:44.903-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 294 136364950314098 0 2016-03-24T06:15:44.903-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 295 166236254808462 0 2016-03-24T06:15:44.903-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 296 280963560417150 0 2016-03-24T06:15:44.91-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 300 185522143840862 0 2016-03-24T06:15:44.911-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 298 200245637201787 0 2016-03-24T06:15:44.911-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 299 106306248704647 0 2016-03-24T06:15:44.911-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 297 106856689024625 0 2016-03-24T06:15:44.914-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 301 271141642761180 0 2016-03-24T06:15:44.923-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 302 155966554960851 0 2016-03-24T06:15:44.923-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 303 117535300899206 0 2016-03-24T06:15:44.923-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 304 278549303200714 0 2016-03-24T06:15:44.932-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 306 40420397085877 0 2016-03-24T06:15:44.932-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 307 85195728754083 0 2016-03-24T06:15:44.933-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 305 217702619794601 0 2016-03-24T06:15:44.94-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 308 137292491286903 0 2016-03-24T06:15:44.94-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 309 50993497991833 0 2016-03-24T06:15:44.952-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 313 217304837059796 0 2016-03-24T06:15:44.953-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 311 30861552550232 0 2016-03-24T06:15:44.953-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 310 220366437727744 0 2016-03-24T06:15:44.953-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 312 94935522013197 0 2016-03-24T06:15:44.962-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 314 254290869631197 0 2016-03-24T06:15:44.962-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 315 131137576737120 0 2016-03-24T06:15:44.962-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 316 47770369768056 0 2016-03-24T06:15:44.964-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 317 51687253909850 0 2016-03-24T06:15:44.98-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 318 124025391275973 0 2016-03-24T06:15:44.98-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 319 87798766188478 0 2016-03-24T06:15:44.98-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 320 175380209476061 0 2016-03-24T06:15:44.98-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 321 251983250299260 0 2016-03-24T06:15:44.985-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 325 126550747604270 0 2016-03-24T06:15:44.987-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 322 47739366636727 0 2016-03-24T06:15:44.987-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 323 210639845665942 0 2016-03-24T06:15:44.987-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 324 103830412259118 0 2016-03-24T06:15:44.99-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 326 160418253306473 0 2016-03-24T06:15:44.99-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 327 74919396679247 0 2016-03-24T06:15:45.003-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 328 136184455231919 0 2016-03-24T06:15:45.004-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 329 253022076271013 0 2016-03-24T06:15:45.008-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 332 32384776947146 0 2016-03-24T06:15:45.008-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 333 165440981193679 0 2016-03-24T06:15:45.01-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 330 252349644234671 0 2016-03-24T06:15:45.01-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 331 172758787982393 0 2016-03-24T06:15:45.011-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 337 190225781335427 0 2016-03-24T06:15:45.013-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 334 101622514129683 0 2016-03-24T06:15:45.013-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 335 11657713921325 0 2016-03-24T06:15:45.013-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 336 90057588129943 0 2016-03-24T06:15:45.015-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 338 155345943780188 0 2016-03-24T06:15:45.015-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 339 91892728573230 0 2016-03-24T06:15:45.019-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 341 169826450296205 0 2016-03-24T06:15:45.019-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 342 45406755723725 0 2016-03-24T06:15:45.019-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 343 139087699521303 0 2016-03-24T06:15:45.02-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 340 88862162654335 0 2016-03-24T06:15:45.024-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 346 62495809728557 0 2016-03-24T06:15:45.026-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 344 118607942451493 0 2016-03-24T06:15:45.026-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 345 155880049618570 0 2016-03-24T06:15:45.029-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 347 137815076571162 0 2016-03-24T06:15:45.029-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 348 225712883762999 0 2016-03-24T06:15:45.039-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 350 159823408593014 0 2016-03-24T06:15:45.04-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 349 180079572469698 0 2016-03-24T06:15:45.043-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 352 215079451143469 0 2016-03-24T06:15:45.043-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 353 51568505991575 0 2016-03-24T06:15:45.044-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 351 86898433058886 0 2016-03-24T06:15:45.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 354 188948585722736 0 2016-03-24T06:15:45.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 355 133299414377883 0 2016-03-24T06:15:45.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 356 265218175345859 0 2016-03-24T06:15:45.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 357 41681018178292 0 2016-03-24T06:15:45.048-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 20000 QueuedCount 5011 2016-03-24T06:15:45.053-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 358 236867816139048 0 2016-03-24T06:15:45.053-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 359 253578215045927 0 2016-03-24T06:15:45.053-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 360 178559371752240 0 2016-03-24T06:15:45.053-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 30000 2016-03-24T06:15:45.056-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 361 195768612257348 0 2016-03-24T06:15:45.056-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 362 203035065955736 0 2016-03-24T06:15:45.058-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:45.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 363 80647927311769 0 2016-03-24T06:15:45.062-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 364 123407909283022 0 2016-03-24T06:15:45.062-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 365 46042291648805 0 2016-03-24T06:15:45.064-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 366 262357839033129 0 2016-03-24T06:15:45.064-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 367 175385069702298 0 2016-03-24T06:15:45.064-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 368 181083235411436 0 2016-03-24T06:15:45.069-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 369 173220200929364 0 2016-03-24T06:15:45.069-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 370 212928881786610 0 2016-03-24T06:15:45.069-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 371 137162491525155 0 2016-03-24T06:15:45.074-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 372 28588760554027 0 2016-03-24T06:15:45.074-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 373 186572007233716 0 2016-03-24T06:15:45.074-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 374 95889833384101 0 2016-03-24T06:15:45.074-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 375 251935881249489 0 2016-03-24T06:15:45.078-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 377 162981091874980 0 2016-03-24T06:15:45.079-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 376 16011675527426 0 2016-03-24T06:15:45.084-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 378 221906562640567 0 2016-03-24T06:15:45.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 381 211032840964280 0 2016-03-24T06:15:45.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 379 1117862116548 0 2016-03-24T06:15:45.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 380 230935410503090 0 2016-03-24T06:15:45.09-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 382 735680936981 0 2016-03-24T06:15:45.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 383 117431253197656 0 2016-03-24T06:15:45.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 384 233700496903764 0 2016-03-24T06:15:45.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 385 157859634696941 0 2016-03-24T06:15:45.093-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 386 218166545722731 0 2016-03-24T06:15:45.103-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 387 68999243655552 0 2016-03-24T06:15:45.11-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 388 24230634604966 0 2016-03-24T06:15:45.111-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 390 152741000312929 0 2016-03-24T06:15:45.112-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 389 115144411249719 0 2016-03-24T06:15:45.119-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 392 242292836580879 0 2016-03-24T06:15:45.119-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 393 177651119976422 0 2016-03-24T06:15:45.119-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 391 60266040772711 0 2016-03-24T06:15:45.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 395 47389419674934 0 2016-03-24T06:15:45.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 396 147850459742273 0 2016-03-24T06:15:45.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 397 97014359489435 0 2016-03-24T06:15:45.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 394 177092152383810 0 2016-03-24T06:15:45.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 398 241994011032833 0 2016-03-24T06:15:45.121-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 399 102068562184936 0 2016-03-24T06:15:45.121-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 400 125378223336533 0 2016-03-24T06:15:45.121-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 401 164145225683661 0 2016-03-24T06:15:45.129-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 402 90223414397519 0 2016-03-24T06:15:45.129-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 403 269588485145210 0 2016-03-24T06:15:45.13-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 404 136064463373729 0 2016-03-24T06:15:45.13-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 405 81632983860149 0 2016-03-24T06:15:45.13-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 406 11351313244242 0 2016-03-24T06:15:45.146-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 407 163522274367039 0 2016-03-24T06:15:45.147-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 408 149886620338950 0 2016-03-24T06:15:45.147-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 409 43375255049991 0 2016-03-24T06:15:45.148-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 416 86168358190012 0 2016-03-24T06:15:45.148-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 417 164104471096556 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 414 260028933422457 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 415 227644715293474 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 410 18792132710869 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 411 109376159155948 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 412 10616890899262 0 2016-03-24T06:15:45.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 413 44532656994184 0 2016-03-24T06:15:45.15-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 419 107257089470670 0 2016-03-24T06:15:45.15-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 420 267043547251059 0 2016-03-24T06:15:45.15-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 418 247957656748099 0 2016-03-24T06:15:45.158-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 424 51903177181144 0 2016-03-24T06:15:45.159-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 421 141354179958242 0 2016-03-24T06:15:45.159-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 422 140674729244248 0 2016-03-24T06:15:45.159-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 423 201619619066609 0 2016-03-24T06:15:45.163-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 425 160618141964097 0 2016-03-24T06:15:45.163-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 426 62169184614218 0 2016-03-24T06:15:45.163-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 427 29851440425474 0 2016-03-24T06:15:45.169-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 429 67953904335528 0 2016-03-24T06:15:45.169-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 428 97687037090500 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 431 186525685696831 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 430 279362272204185 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 432 241661423422041 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 433 279882006690355 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 434 146192895694627 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 435 11764749977814 0 2016-03-24T06:15:45.17-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 436 147752756153542 0 2016-03-24T06:15:45.171-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 437 130596102710446 0 2016-03-24T06:15:45.171-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 438 122736019701562 0 2016-03-24T06:15:45.175-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 440 127624559784325 0 2016-03-24T06:15:45.175-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 442 78792229169449 0 2016-03-24T06:15:45.175-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 441 181300070306120 0 2016-03-24T06:15:45.175-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 443 139322563086773 0 2016-03-24T06:15:45.176-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 439 150393735109648 0 2016-03-24T06:15:45.183-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 444 38944920784304 0 2016-03-24T06:15:45.184-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 445 143539413088466 0 2016-03-24T06:15:45.184-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 446 195372919040993 0 2016-03-24T06:15:45.184-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 447 13473883667566 0 2016-03-24T06:15:45.186-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 448 54224868428608 0 2016-03-24T06:15:45.186-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 449 182130448774791 0 2016-03-24T06:15:45.186-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 451 94881737973403 0 2016-03-24T06:15:45.186-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 452 35673046165660 0 2016-03-24T06:15:45.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 450 53625560721319 0 2016-03-24T06:15:45.197-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 453 220197211924010 0 2016-03-24T06:15:45.197-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 454 257669264927274 0 2016-03-24T06:15:45.198-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 457 134779244813841 0 2016-03-24T06:15:45.199-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 455 56398466694469 0 2016-03-24T06:15:45.199-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 456 9555206442008 0 2016-03-24T06:15:45.2-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 458 275254278207888 0 2016-03-24T06:15:45.201-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 459 228869923113437 0 2016-03-24T06:15:45.201-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 460 152790662691203 0 2016-03-24T06:15:45.201-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 461 223657638981773 0 2016-03-24T06:15:45.213-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 463 47081146612120 0 2016-03-24T06:15:45.213-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 465 167862966929638 0 2016-03-24T06:15:45.213-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 466 233803815434533 0 2016-03-24T06:15:45.213-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 467 125767583493452 0 2016-03-24T06:15:45.215-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 462 218894617846377 0 2016-03-24T06:15:45.215-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 464 241676781732635 0 2016-03-24T06:15:45.229-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 468 181300421177141 0 2016-03-24T06:15:45.229-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 469 209371728473456 0 2016-03-24T06:15:45.231-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 470 109961440627311 0 2016-03-24T06:15:45.242-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 472 250296059160035 0 2016-03-24T06:15:45.242-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 473 127213743888686 0 2016-03-24T06:15:45.243-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 471 16976637185840 0 2016-03-24T06:15:45.243-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 474 61717241147494 0 2016-03-24T06:15:45.245-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 40000 2016-03-24T06:15:45.245-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 475 271896995122131 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 476 22450389992745 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 477 149702984935489 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 482 20004038643124 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 484 268955442289231 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 479 1637747279184 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 480 99535490202602 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 481 90683531027617 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 483 237636230475369 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 478 213471400622733 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 485 67297310606660 0 2016-03-24T06:15:45.247-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 486 52409172147251 0 2016-03-24T06:15:45.25-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 487 257962127915897 0 2016-03-24T06:15:45.254-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 488 226709619186444 0 2016-03-24T06:15:45.259-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 489 234513422169685 0 2016-03-24T06:15:45.263-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 490 104036298385472 0 2016-03-24T06:15:45.264-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:45.264-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 491 106231925609288 0 2016-03-24T06:15:45.264-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 492 261668271054185 0 2016-03-24T06:15:45.264-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 493 260112490838758 0 2016-03-24T06:15:45.275-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 494 125611601283852 0 2016-03-24T06:15:45.275-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 495 242794092408453 0 2016-03-24T06:15:45.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 498 92211577874107 0 2016-03-24T06:15:45.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 499 18468304738426 0 2016-03-24T06:15:45.278-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 496 276095688412632 0 2016-03-24T06:15:45.278-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 497 173329786123641 0 2016-03-24T06:15:45.307-07:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.71:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 InstanceIds [1061207747814546192] 2016-03-24T06:15:45.308-07:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 Instances [indexInstance: singlePartn: > ] 2016-03-24T06:15:45.309-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 503 210116130563472 0 2016-03-24T06:15:45.31-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 501 74775093769110 0 2016-03-24T06:15:45.31-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 502 255064465668718 0 2016-03-24T06:15:45.31-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 500 161939548606623 0 2016-03-24T06:15:45.31-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 504 127030824255893 0 2016-03-24T06:15:45.311-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 505 147508637122721 0 2016-03-24T06:15:45.312-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 506 45185590504961 0 2016-03-24T06:15:45.312-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 508 244114868078380 0 2016-03-24T06:15:45.312-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 509 73697870231265 0 2016-03-24T06:15:45.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 507 21177967774913 0 2016-03-24T06:15:45.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 510 258175963002422 0 2016-03-24T06:15:45.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 511 74248150793651 0 2016-03-24T06:15:45.337-07:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.72:60538" +3 2016-03-24T06:15:45.435-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 50000 2016-03-24T06:15:45.463-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:45.574-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 514 184404440191392 0 2016-03-24T06:15:45.574-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 512 143966615558944 0 2016-03-24T06:15:45.574-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 513 193659510515818 0 2016-03-24T06:15:45.598-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 521 109924078244499 0 2016-03-24T06:15:45.598-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 515 266394744533835 0 2016-03-24T06:15:45.598-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 516 48946698196714 0 2016-03-24T06:15:45.598-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 517 80854430492899 0 2016-03-24T06:15:45.599-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 60000 2016-03-24T06:15:45.599-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 518 81258703261205 0 2016-03-24T06:15:45.599-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 519 89071517458146 0 2016-03-24T06:15:45.599-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 520 143009813002528 0 2016-03-24T06:15:45.622-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 524 227804742153584 0 2016-03-24T06:15:45.624-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 522 31553993881745 0 2016-03-24T06:15:45.624-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 523 22211279437974 0 2016-03-24T06:15:45.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 525 102027885216079 0 2016-03-24T06:15:45.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 526 8421118926240 0 2016-03-24T06:15:45.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 527 218092865680437 0 2016-03-24T06:15:45.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 530 122359246781483 0 2016-03-24T06:15:45.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 528 227785181132785 0 2016-03-24T06:15:45.681-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 529 112567663129214 0 2016-03-24T06:15:45.681-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 531 89295433883139 0 2016-03-24T06:15:45.683-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 532 225932438029561 0 2016-03-24T06:15:45.684-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 533 247194885916339 0 2016-03-24T06:15:45.699-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:45.704-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 534 35252868126514 0 2016-03-24T06:15:45.717-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 535 80003500167023 0 2016-03-24T06:15:45.717-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 536 178379900730773 0 2016-03-24T06:15:45.72-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 537 90821254640128 0 2016-03-24T06:15:45.729-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 539 106452412857791 0 2016-03-24T06:15:45.729-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 540 67301420835381 0 2016-03-24T06:15:45.73-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 538 6415761344600 0 2016-03-24T06:15:45.738-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 541 61063234808210 0 2016-03-24T06:15:45.738-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 542 73792555620823 0 2016-03-24T06:15:45.74-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 543 1400579052557 0 2016-03-24T06:15:45.744-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 70000 2016-03-24T06:15:45.745-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 544 215624907289030 0 2016-03-24T06:15:45.745-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 545 231428310122220 0 2016-03-24T06:15:45.754-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 546 55182227005835 0 2016-03-24T06:15:45.754-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 547 65841146304767 0 2016-03-24T06:15:45.76-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 548 24371332051092 0 2016-03-24T06:15:45.76-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 549 100740307887361 0 2016-03-24T06:15:45.77-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 551 254983584433039 0 2016-03-24T06:15:45.771-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 550 40448322368993 0 2016-03-24T06:15:45.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 552 164638355249203 0 2016-03-24T06:15:45.775-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 553 106659296711559 0 2016-03-24T06:15:45.784-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 554 246065966506576 0 2016-03-24T06:15:45.784-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 555 226972677815706 0 2016-03-24T06:15:45.797-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 556 70423048818411 0 2016-03-24T06:15:45.805-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 557 236688115729881 0 2016-03-24T06:15:45.805-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 558 33588428911526 0 2016-03-24T06:15:45.808-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 559 85814687969969 0 2016-03-24T06:15:45.808-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 560 24241144550584 0 2016-03-24T06:15:45.814-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 561 71357282612311 0 2016-03-24T06:15:45.814-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 562 180855294747138 0 2016-03-24T06:15:45.824-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 563 51949494667557 0 2016-03-24T06:15:45.824-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 564 272418000618980 0 2016-03-24T06:15:45.837-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 565 225955775301448 0 2016-03-24T06:15:45.837-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 566 52137948120595 0 2016-03-24T06:15:45.839-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 567 262150132463494 0 2016-03-24T06:15:45.839-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 568 267237929841184 0 2016-03-24T06:15:45.843-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 569 161785610145889 0 2016-03-24T06:15:45.85-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 570 235628162443063 0 2016-03-24T06:15:45.85-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 571 33032119139965 0 2016-03-24T06:15:45.853-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 572 91383920002481 0 2016-03-24T06:15:45.853-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 573 55764544393780 0 2016-03-24T06:15:45.854-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 574 129058687517974 0 2016-03-24T06:15:45.859-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 80000 2016-03-24T06:15:45.86-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 575 213867525627784 0 2016-03-24T06:15:45.86-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 576 233594193559832 0 2016-03-24T06:15:45.862-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:45.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 578 222306423852189 0 2016-03-24T06:15:45.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 579 182265857519823 0 2016-03-24T06:15:45.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 577 113946121837627 0 2016-03-24T06:15:45.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 580 84273194711897 0 2016-03-24T06:15:45.873-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 581 88552569663195 0 2016-03-24T06:15:45.874-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 582 43539979048468 0 2016-03-24T06:15:45.874-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 583 135404481449846 0 2016-03-24T06:15:45.879-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 584 196640076635155 0 2016-03-24T06:15:45.888-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 585 20684959948148 0 2016-03-24T06:15:45.888-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 586 105718692072555 0 2016-03-24T06:15:45.888-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 30000 QueuedCount 44074 2016-03-24T06:15:45.892-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 587 49837213434671 0 2016-03-24T06:15:45.892-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 588 86452903592406 0 2016-03-24T06:15:45.898-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 589 248200957736397 0 2016-03-24T06:15:45.898-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 590 131442955831938 0 2016-03-24T06:15:45.906-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 591 170830246543295 0 2016-03-24T06:15:45.906-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 592 251217678592227 0 2016-03-24T06:15:45.912-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 593 77133636321342 0 2016-03-24T06:15:45.912-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 594 257060078491033 0 2016-03-24T06:15:45.912-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 595 235010624300044 0 2016-03-24T06:15:45.915-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 596 19734321076246 0 2016-03-24T06:15:45.915-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 597 131845339443814 0 2016-03-24T06:15:45.92-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 598 177306459909287 0 2016-03-24T06:15:45.92-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 599 171986279003723 0 2016-03-24T06:15:45.924-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 600 212683509015437 0 2016-03-24T06:15:45.933-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 602 263482901584483 0 2016-03-24T06:15:45.934-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 601 146523928374184 0 2016-03-24T06:15:45.936-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 603 190060577709541 0 2016-03-24T06:15:45.936-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 604 87419726527646 0 2016-03-24T06:15:45.936-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 605 41623661165240 0 2016-03-24T06:15:45.944-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 606 19522457945340 0 2016-03-24T06:15:45.944-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 607 249431835311279 0 2016-03-24T06:15:45.95-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 609 59955379470747 0 2016-03-24T06:15:45.951-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 608 210661562264703 0 2016-03-24T06:15:45.96-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 610 183329978599730 0 2016-03-24T06:15:45.96-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 611 151041993714445 0 2016-03-24T06:15:45.96-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 612 178876736173972 0 2016-03-24T06:15:45.964-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 613 165665524751892 0 2016-03-24T06:15:45.964-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 614 75609774943830 0 2016-03-24T06:15:45.967-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 615 21126418278550 0 2016-03-24T06:15:45.967-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 616 64132548282302 0 2016-03-24T06:15:45.973-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 617 153082137030611 0 2016-03-24T06:15:45.973-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 618 202671114824475 0 2016-03-24T06:15:45.973-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 619 47055746285672 0 2016-03-24T06:15:45.974-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 620 213443068182892 0 2016-03-24T06:15:45.974-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 621 83771302703269 0 2016-03-24T06:15:45.978-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 90000 2016-03-24T06:15:45.99-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 623 223507685149777 0 2016-03-24T06:15:45.99-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 624 271970384095562 0 2016-03-24T06:15:45.991-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 622 20461924086911 0 2016-03-24T06:15:45.994-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 625 215533126596043 0 2016-03-24T06:15:45.994-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 626 138363326878723 0 2016-03-24T06:15:45.994-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 627 247886159869277 0 2016-03-24T06:15:45.995-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 628 52334606152941 0 2016-03-24T06:15:45.995-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 629 121793236680355 0 2016-03-24T06:15:46.002-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 630 36516799007230 0 2016-03-24T06:15:46.002-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 631 79670104980504 0 2016-03-24T06:15:46.002-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 632 629097705377 0 2016-03-24T06:15:46.009-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 633 246744285316417 0 2016-03-24T06:15:46.014-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 634 65046773090184 0 2016-03-24T06:15:46.014-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 635 37606909586699 0 2016-03-24T06:15:46.02-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 636 25472230623272 0 2016-03-24T06:15:46.02-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 637 33337688318691 0 2016-03-24T06:15:46.027-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 638 194091051327687 0 2016-03-24T06:15:46.028-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 639 137771571862242 0 2016-03-24T06:15:46.032-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 640 112062739487345 0 2016-03-24T06:15:46.032-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 641 73318585661781 0 2016-03-24T06:15:46.037-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 642 180302501828422 0 2016-03-24T06:15:46.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 643 159813976697290 0 2016-03-24T06:15:46.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 644 274696368080076 0 2016-03-24T06:15:46.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 645 213292278769171 0 2016-03-24T06:15:46.049-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 646 231129080665372 0 2016-03-24T06:15:46.049-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 647 199370863168153 0 2016-03-24T06:15:46.054-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 648 85790464311101 0 2016-03-24T06:15:46.054-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 649 268105119788959 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 651 232930273962280 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 654 261248508252072 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 656 224121331257458 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 657 120630556269652 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 650 38101362703881 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 655 120371443920810 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 652 7269710182199 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 653 76548384853581 0 2016-03-24T06:15:46.058-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 658 107067501468568 0 2016-03-24T06:15:46.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 659 74487054790394 0 2016-03-24T06:15:46.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 660 63510259420797 0 2016-03-24T06:15:46.061-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 661 27666479150659 0 2016-03-24T06:15:46.063-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 662 242989716036835 0 2016-03-24T06:15:46.063-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 663 271225894473039 0 2016-03-24T06:15:46.065-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 665 236653824005607 0 2016-03-24T06:15:46.065-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 664 125212105309389 0 2016-03-24T06:15:46.066-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 666 171268334658320 0 2016-03-24T06:15:46.066-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 667 105976366510741 0 2016-03-24T06:15:46.067-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 670 217246006094343 0 2016-03-24T06:15:46.068-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 668 25753634166096 0 2016-03-24T06:15:46.068-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 669 9138421038087 0 2016-03-24T06:15:46.072-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 671 239110034701603 0 2016-03-24T06:15:46.072-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 672 136559691653340 0 2016-03-24T06:15:46.079-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 673 94711044190496 0 2016-03-24T06:15:46.079-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 674 143685371831361 0 2016-03-24T06:15:46.081-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 675 62652851167438 0 2016-03-24T06:15:46.085-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 676 25214738615424 0 2016-03-24T06:15:46.086-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 100000 2016-03-24T06:15:46.088-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 677 98572791029754 0 2016-03-24T06:15:46.088-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 678 265833314217815 0 2016-03-24T06:15:46.091-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 679 86615791864903 0 2016-03-24T06:15:46.091-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 680 201789447053889 0 2016-03-24T06:15:46.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 681 106547966516360 0 2016-03-24T06:15:46.097-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 682 62350495686928 0 2016-03-24T06:15:46.098-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 683 38035585641160 0 2016-03-24T06:15:46.099-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 684 131558996894315 0 2016-03-24T06:15:46.099-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 685 220058078251699 0 2016-03-24T06:15:46.099-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 686 177282199151012 0 2016-03-24T06:15:46.099-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 687 190296367868602 0 2016-03-24T06:15:46.115-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 40000 QueuedCount 50000 2016-03-24T06:15:46.117-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 688 112611605091488 0 2016-03-24T06:15:46.117-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 689 38455869335583 0 2016-03-24T06:15:46.119-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 690 77727252127537 0 2016-03-24T06:15:46.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 691 231032807513776 0 2016-03-24T06:15:46.12-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 692 159460486201111 0 2016-03-24T06:15:46.126-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 693 138098326380570 0 2016-03-24T06:15:46.128-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 694 80512733492449 0 2016-03-24T06:15:46.128-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 695 199667307771407 0 2016-03-24T06:15:46.13-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 696 75072240876024 0 2016-03-24T06:15:46.135-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 698 61233619358683 0 2016-03-24T06:15:46.135-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 699 262043544151925 0 2016-03-24T06:15:46.136-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 697 16967462864859 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 704 113086780907056 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 705 13145781041241 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 700 55633679745333 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 701 7544000448509 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 702 140287415567888 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 703 270943469037589 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 706 205491325251045 0 2016-03-24T06:15:46.137-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 708 78488731517741 0 2016-03-24T06:15:46.138-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 707 175076720370604 0 2016-03-24T06:15:46.142-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 709 152672819457941 0 2016-03-24T06:15:46.142-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 710 195035086649540 0 2016-03-24T06:15:46.145-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 711 198233199484343 0 2016-03-24T06:15:46.145-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 712 199604770174780 0 2016-03-24T06:15:46.145-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 713 80390372570144 0 2016-03-24T06:15:46.148-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 716 236078951233816 0 2016-03-24T06:15:46.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 714 8052184138579 0 2016-03-24T06:15:46.149-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 715 210324342803404 0 2016-03-24T06:15:46.153-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 719 197503725374603 0 2016-03-24T06:15:46.154-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 717 82546503393891 0 2016-03-24T06:15:46.154-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 718 21092545848631 0 2016-03-24T06:15:46.155-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 720 263698052137920 0 2016-03-24T06:15:46.155-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 721 62559879143257 0 2016-03-24T06:15:46.155-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 722 30067321098872 0 2016-03-24T06:15:46.156-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 723 55719502616528 0 2016-03-24T06:15:46.156-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 724 102330591733106 0 2016-03-24T06:15:46.16-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 725 23091451140601 0 2016-03-24T06:15:46.164-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 728 275145071638141 0 2016-03-24T06:15:46.165-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 726 254309040417474 0 2016-03-24T06:15:46.165-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 727 134748927875374 0 2016-03-24T06:15:46.171-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 729 9428530467154 0 2016-03-24T06:15:46.177-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 730 32949839458406 0 2016-03-24T06:15:46.186-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 731 211720069976448 0 2016-03-24T06:15:46.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 732 49308094900590 0 2016-03-24T06:15:46.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 735 33623870861450 0 2016-03-24T06:15:46.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 736 188566507587491 0 2016-03-24T06:15:46.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 733 245286309165637 0 2016-03-24T06:15:46.187-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 734 117543627501140 0 2016-03-24T06:15:46.193-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 110000 2016-03-24T06:15:46.194-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 737 261689136070459 0 2016-03-24T06:15:46.207-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 739 257136773421166 0 2016-03-24T06:15:46.207-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 740 219264490401662 0 2016-03-24T06:15:46.208-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 738 217143558904699 0 2016-03-24T06:15:46.227-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 741 226418060978059 0 2016-03-24T06:15:46.227-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 742 94854655545017 0 2016-03-24T06:15:46.227-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 743 201981473366593 0 2016-03-24T06:15:46.227-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 744 57145392035243 0 2016-03-24T06:15:46.229-07:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.72:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 InstanceIds [1061207747814546192] 2016-03-24T06:15:46.23-07:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 Instances [indexInstance: singlePartn: > ] 2016-03-24T06:15:46.231-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 746 109206809642723 0 2016-03-24T06:15:46.231-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 751 276221637776741 0 2016-03-24T06:15:46.232-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 745 120537614647773 0 2016-03-24T06:15:46.232-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 747 1819197852099 0 2016-03-24T06:15:46.232-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 748 86796470020583 0 2016-03-24T06:15:46.232-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 749 263759715496869 0 2016-03-24T06:15:46.232-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 750 218974902210545 0 2016-03-24T06:15:46.241-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 752 92985673267723 0 2016-03-24T06:15:46.241-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 753 38109646871469 0 2016-03-24T06:15:46.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 754 226195840554269 0 2016-03-24T06:15:46.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 755 223452026093436 0 2016-03-24T06:15:46.248-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 756 254820942685623 0 2016-03-24T06:15:46.276-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 757 155057609067778 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 762 278272099529113 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 763 247462369605143 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 759 212889487757573 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 760 190800180934194 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 764 51348365040391 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 765 81770686238873 0 2016-03-24T06:15:46.277-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 766 104882766210050 0 2016-03-24T06:15:46.278-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 758 142121835972407 0 2016-03-24T06:15:46.278-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 761 149395730113356 0 2016-03-24T06:15:46.281-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 767 180852770198324 0 2016-03-24T06:15:46.373-07:00 [Info] DATP[->dataport ":9105"] new connection "172.23.100.73:33454" +4 2016-03-24T06:15:46.392-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 120000 2016-03-24T06:15:46.54-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 130000 2016-03-24T06:15:46.693-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 140000 2016-03-24T06:15:46.746-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:46.804-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 150000 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 771 136644332903649 0 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 772 2555184847402 0 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 773 157937843455744 0 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 768 77646871535975 0 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 769 266271740205027 0 2016-03-24T06:15:46.846-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 770 234779034493776 0 2016-03-24T06:15:46.861-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 50000 QueuedCount 49999 2016-03-24T06:15:46.87-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 774 13714627014097 0 2016-03-24T06:15:46.896-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 160000 2016-03-24T06:15:46.902-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 775 52861097009336 0 2016-03-24T06:15:46.902-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 776 181510065441889 0 2016-03-24T06:15:46.902-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 777 188558665654674 0 2016-03-24T06:15:46.922-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 779 79831129557426 0 2016-03-24T06:15:46.922-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 780 277897798783877 0 2016-03-24T06:15:46.922-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 781 128986046556061 0 2016-03-24T06:15:46.923-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 778 227375239959809 0 2016-03-24T06:15:46.925-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 782 86221490964473 0 2016-03-24T06:15:46.939-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 783 165612660978617 0 2016-03-24T06:15:46.939-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 784 226885431630391 0 2016-03-24T06:15:46.939-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 785 62869309512802 0 2016-03-24T06:15:46.939-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 786 260711530768103 0 2016-03-24T06:15:46.955-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 787 123164869440831 0 2016-03-24T06:15:46.975-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 788 105065393543168 0 2016-03-24T06:15:46.975-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 789 275255691329553 0 2016-03-24T06:15:46.975-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 790 215063190990784 0 2016-03-24T06:15:46.975-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 791 191024443508651 0 2016-03-24T06:15:46.98-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 792 6774814235600 0 2016-03-24T06:15:46.981-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 793 267429666728602 0 2016-03-24T06:15:46.981-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 794 127451683511898 0 2016-03-24T06:15:46.981-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 795 15309944077259 0 2016-03-24T06:15:46.989-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 170000 2016-03-24T06:15:47.004-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 796 201674080482949 0 2016-03-24T06:15:47.007-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 60000 QueuedCount 50000 2016-03-24T06:15:47.01-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 797 226056009907249 0 2016-03-24T06:15:47.014-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:47.017-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 798 24107535304396 0 2016-03-24T06:15:47.017-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 799 112009638022021 0 2016-03-24T06:15:47.017-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 800 251311075600212 0 2016-03-24T06:15:47.037-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 801 247680334430245 0 2016-03-24T06:15:47.037-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 802 62099069664493 0 2016-03-24T06:15:47.037-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 803 16493066797140 0 2016-03-24T06:15:47.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 804 96623647449091 0 2016-03-24T06:15:47.047-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 805 248873207804692 0 2016-03-24T06:15:47.053-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 806 34471566858944 0 2016-03-24T06:15:47.053-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 807 150579995091992 0 2016-03-24T06:15:47.063-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 808 746083175557 0 2016-03-24T06:15:47.063-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 809 261321396380958 0 2016-03-24T06:15:47.063-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 810 89356037545340 0 2016-03-24T06:15:47.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 811 144774153584660 0 2016-03-24T06:15:47.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 812 81126187473765 0 2016-03-24T06:15:47.092-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 813 149399140332230 0 2016-03-24T06:15:47.099-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 814 144339487582527 0 2016-03-24T06:15:47.117-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 815 19335879156215 0 2016-03-24T06:15:47.117-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 816 32576472145159 0 2016-03-24T06:15:47.117-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 818 244216137312766 0 2016-03-24T06:15:47.119-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 817 51341263493020 0 2016-03-24T06:15:47.119-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 180000 2016-03-24T06:15:47.144-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 819 67577745975533 0 2016-03-24T06:15:47.144-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 820 42608538103030 0 2016-03-24T06:15:47.144-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 821 72743099027282 0 2016-03-24T06:15:47.158-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 822 227265218308322 0 2016-03-24T06:15:47.178-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 824 162821508476290 0 2016-03-24T06:15:47.178-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 825 219874895245496 0 2016-03-24T06:15:47.179-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 823 111179174251353 0 2016-03-24T06:15:47.194-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 827 215922077363718 0 2016-03-24T06:15:47.195-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 826 270041931232092 0 2016-03-24T06:15:47.201-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 828 51154732093012 0 2016-03-24T06:15:47.208-07:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.100.73:9999 Topic MAINT_STREAM_TOPIC_e4:ca:9:4d:61:5e:f:8a bucket-1 InstanceIds [1061207747814546192] 2016-03-24T06:15:47.209-07:00 [Info] Indexer::sendStreamUpdateForBuildIndex Stream Request Success For Stream MAINT_STREAM Bucket bucket-1. 2016-03-24T06:15:47.212-07:00 [Info] Indexer::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2016-03-24T06:15:47.212-07:00 [Info] Timekeeper::handleStreamRequestDone StreamId MAINT_STREAM Bucket bucket-1 2016-03-24T06:15:47.212-07:00 [Info] Timekeeper::handleStreamRequestDone Call RepairStream to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2016-03-24T06:15:47.212-07:00 [Info] Timekeeper::handleStreamRequestDone Call RepairMissingStreamBegin to check for vbucket for repair. StreamId MAINT_STREAM bucket bucket-1 2016-03-24T06:15:47.212-07:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM 2016-03-24T06:15:47.233-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 829 196234236454659 0 2016-03-24T06:15:47.233-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 830 48314278059858 0 2016-03-24T06:15:47.233-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 831 5252166443126 0 2016-03-24T06:15:47.239-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 832 139746735990133 0 2016-03-24T06:15:47.24-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 833 15495253340713 0 2016-03-24T06:15:47.24-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 834 91515984927741 0 2016-03-24T06:15:47.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 835 123837313850337 0 2016-03-24T06:15:47.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 836 94263574573145 0 2016-03-24T06:15:47.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 837 124786934118710 0 2016-03-24T06:15:47.268-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 838 22154971929203 0 2016-03-24T06:15:47.288-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 839 119815032555026 0 2016-03-24T06:15:47.288-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 840 180015551052778 0 2016-03-24T06:15:47.288-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 841 182176951984139 0 2016-03-24T06:15:47.292-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 842 144837672269168 0 2016-03-24T06:15:47.292-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 843 247146042951105 0 2016-03-24T06:15:47.292-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 844 187495244234981 0 2016-03-24T06:15:47.292-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 845 155100375355926 0 2016-03-24T06:15:47.298-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 190000 2016-03-24T06:15:47.311-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 849 221019799277221 0 2016-03-24T06:15:47.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 846 213037947615068 0 2016-03-24T06:15:47.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 847 247624881246981 0 2016-03-24T06:15:47.313-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 848 100856747557599 0 2016-03-24T06:15:47.322-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 850 60425555190948 0 2016-03-24T06:15:47.322-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 851 53618791542648 0 2016-03-24T06:15:47.331-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 852 255163605281452 0 2016-03-24T06:15:47.331-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 853 65879777028570 0 2016-03-24T06:15:47.366-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 856 24469188294662 0 2016-03-24T06:15:47.366-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 857 269610800621417 0 2016-03-24T06:15:47.367-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 854 157162047304481 0 2016-03-24T06:15:47.367-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 855 55381811297477 0 2016-03-24T06:15:47.387-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 858 7963801636828 0 2016-03-24T06:15:47.389-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 859 68451266854756 0 2016-03-24T06:15:47.389-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 860 250098345457107 0 2016-03-24T06:15:47.419-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 864 215598640088668 0 2016-03-24T06:15:47.419-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 861 190879776454219 0 2016-03-24T06:15:47.419-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 862 88105028643107 0 2016-03-24T06:15:47.419-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 863 62864398415577 0 2016-03-24T06:15:47.429-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 865 182823763243817 0 2016-03-24T06:15:47.429-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 866 114373271340576 0 2016-03-24T06:15:47.441-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 867 177333751862970 0 2016-03-24T06:15:47.441-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 868 123395478029262 0 2016-03-24T06:15:47.441-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 869 233709689691373 0 2016-03-24T06:15:47.441-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 870 141030866742179 0 2016-03-24T06:15:47.456-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 200000 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 871 25092724689773 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 872 122751072124079 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 873 211599289400693 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 874 28915896515961 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 875 32139327983129 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 876 163710717761115 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 877 102793637214048 0 2016-03-24T06:15:47.457-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 878 81983992467366 0 2016-03-24T06:15:47.463-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 879 110864217250330 0 2016-03-24T06:15:47.463-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 880 226743448617771 0 2016-03-24T06:15:47.464-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 881 90833756593947 0 2016-03-24T06:15:47.478-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 884 100975331823202 0 2016-03-24T06:15:47.478-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 885 105504347322858 0 2016-03-24T06:15:47.479-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 882 159155216458372 0 2016-03-24T06:15:47.479-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 883 114620119850235 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 886 249741975644954 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 887 157964690079089 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 888 159154074122051 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 889 265495532661524 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 891 129399538686757 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 892 196332873015894 0 2016-03-24T06:15:47.503-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 893 97810265585586 0 2016-03-24T06:15:47.505-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 890 44325835056744 0 2016-03-24T06:15:47.519-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 894 255240642659122 0 2016-03-24T06:15:47.519-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 895 60580120539978 0 2016-03-24T06:15:47.521-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 896 264963469206425 0 2016-03-24T06:15:47.521-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 897 105345715582879 0 2016-03-24T06:15:47.528-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 898 54447342958518 0 2016-03-24T06:15:47.528-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 899 100652085108870 0 2016-03-24T06:15:47.552-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 900 77227148945453 0 2016-03-24T06:15:47.552-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 901 197404288952674 0 2016-03-24T06:15:47.578-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 902 234316373118426 0 2016-03-24T06:15:47.578-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 903 174979346436543 0 2016-03-24T06:15:47.579-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 904 216303251741061 0 2016-03-24T06:15:47.579-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 905 23451579227345 0 2016-03-24T06:15:47.581-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 906 280774454295350 0 2016-03-24T06:15:47.599-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 908 142730451687598 0 2016-03-24T06:15:47.6-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 907 244738352585317 0 2016-03-24T06:15:47.602-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 911 205363964756117 0 2016-03-24T06:15:47.602-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 909 38707701063377 0 2016-03-24T06:15:47.602-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 910 175948124030864 0 2016-03-24T06:15:47.603-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 912 99084987375924 0 2016-03-24T06:15:47.603-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 913 262592125828304 0 2016-03-24T06:15:47.609-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 210000 2016-03-24T06:15:47.619-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 914 222216699794070 0 2016-03-24T06:15:47.619-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 919 56775202630828 0 2016-03-24T06:15:47.62-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 915 52265353010373 0 2016-03-24T06:15:47.62-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 916 194994324712522 0 2016-03-24T06:15:47.621-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 917 152066374486786 0 2016-03-24T06:15:47.621-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 918 125887282055142 0 2016-03-24T06:15:47.632-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 920 230088424526630 0 2016-03-24T06:15:47.632-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 921 173722533186105 0 2016-03-24T06:15:47.636-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 922 61261336760883 0 2016-03-24T06:15:47.636-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 923 253862232111959 0 2016-03-24T06:15:47.636-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 924 195534655494224 0 2016-03-24T06:15:47.653-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 929 109709960286307 0 2016-03-24T06:15:47.653-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 926 128750862183389 0 2016-03-24T06:15:47.654-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 925 72284603421605 0 2016-03-24T06:15:47.654-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 927 201259099545853 0 2016-03-24T06:15:47.654-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 928 213499083599325 0 2016-03-24T06:15:47.661-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 930 196129010005315 0 2016-03-24T06:15:47.662-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 931 220227936089474 0 2016-03-24T06:15:47.662-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 932 190543301600528 0 2016-03-24T06:15:47.662-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 933 102801257600825 0 2016-03-24T06:15:47.662-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 934 94916899709520 0 2016-03-24T06:15:47.665-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 936 80847823412920 0 2016-03-24T06:15:47.666-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 935 689739146739 0 2016-03-24T06:15:47.679-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 937 103756699770347 0 2016-03-24T06:15:47.679-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 938 113344780584470 0 2016-03-24T06:15:47.679-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 939 208955348770472 0 2016-03-24T06:15:47.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 940 218356694292150 0 2016-03-24T06:15:47.68-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 941 273764533708428 0 2016-03-24T06:15:47.706-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 943 128294966218090 0 2016-03-24T06:15:47.707-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 942 75359750804432 0 2016-03-24T06:15:47.709-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 944 249806696651578 0 2016-03-24T06:15:47.71-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 945 253150399165390 0 2016-03-24T06:15:47.71-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 946 161626986551794 0 2016-03-24T06:15:47.722-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 947 60366231104944 0 2016-03-24T06:15:47.734-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 948 145789016176199 0 2016-03-24T06:15:47.734-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 949 158026076356183 0 2016-03-24T06:15:47.734-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 950 87983060265560 0 2016-03-24T06:15:47.734-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 951 97925687876152 0 2016-03-24T06:15:47.745-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 952 207107931977111 0 2016-03-24T06:15:47.745-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 953 50297338147557 0 2016-03-24T06:15:47.745-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 954 224850812783692 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 956 112425341687886 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 959 40680275519599 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 960 140641571103060 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 961 281002742647294 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 963 33285734777639 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 955 60297337105076 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 957 14211315899990 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 958 45965126296759 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 962 108723892584956 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 965 95628842481793 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 966 98483980860356 0 2016-03-24T06:15:47.746-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 968 91601919014646 0 2016-03-24T06:15:47.747-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 964 137233076670283 0 2016-03-24T06:15:47.747-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 967 105752940724333 0 2016-03-24T06:15:47.753-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 220000 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 971 7053126291322 0 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 973 168680945627102 0 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 974 235085512065580 0 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 969 214243584784920 0 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 970 185085938064087 0 2016-03-24T06:15:47.758-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 972 80613057246618 0 2016-03-24T06:15:47.762-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 975 94710516812513 0 2016-03-24T06:15:47.762-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 976 153804689041381 0 2016-03-24T06:15:47.762-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 977 100669403676630 0 2016-03-24T06:15:47.773-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 979 216954912833165 0 2016-03-24T06:15:47.773-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 980 46364629594596 0 2016-03-24T06:15:47.774-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 978 72715517846251 0 2016-03-24T06:15:47.775-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 981 183413079529094 0 2016-03-24T06:15:47.775-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 982 204366432278121 0 2016-03-24T06:15:47.78-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 984 132813615358273 0 2016-03-24T06:15:47.781-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 983 113799058250818 0 2016-03-24T06:15:47.785-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 985 141154650266276 0 2016-03-24T06:15:47.786-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 987 14514857701935 0 2016-03-24T06:15:47.786-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 988 85583188192897 0 2016-03-24T06:15:47.786-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 990 55633908194043 0 2016-03-24T06:15:47.786-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 986 90093076831614 0 2016-03-24T06:15:47.786-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 989 204353971149 0 2016-03-24T06:15:47.795-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 991 262268913311922 0 2016-03-24T06:15:47.795-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 992 132986128933743 0 2016-03-24T06:15:47.803-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 994 124756178252158 0 2016-03-24T06:15:47.803-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 995 89201402866297 0 2016-03-24T06:15:47.804-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 993 40794581494275 0 2016-03-24T06:15:47.806-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 996 166373306747994 0 2016-03-24T06:15:47.818-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 997 102323323215261 0 2016-03-24T06:15:47.819-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 998 228928706549575 0 2016-03-24T06:15:47.82-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 999 9150278016923 0 2016-03-24T06:15:47.82-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1000 123174040904891 0 2016-03-24T06:15:47.82-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1001 254406127119470 0 2016-03-24T06:15:47.822-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1002 163968137971055 0 2016-03-24T06:15:47.84-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1004 122927254758856 0 2016-03-24T06:15:47.84-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1003 235666945136498 0 2016-03-24T06:15:47.846-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 230000 2016-03-24T06:15:47.848-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 70000 QueuedCount 50000 2016-03-24T06:15:47.849-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1005 247898270713505 0 2016-03-24T06:15:47.849-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1006 138598646620080 0 2016-03-24T06:15:47.852-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:47.855-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1007 104497002592950 0 2016-03-24T06:15:47.868-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1012 273404993524972 0 2016-03-24T06:15:47.868-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1015 260025402834701 0 2016-03-24T06:15:47.868-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1009 93333671741525 0 2016-03-24T06:15:47.868-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1011 98806626927573 0 2016-03-24T06:15:47.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1013 176592829800152 0 2016-03-24T06:15:47.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1016 123548214801171 0 2016-03-24T06:15:47.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1008 153830957179956 0 2016-03-24T06:15:47.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1010 231873898711623 0 2016-03-24T06:15:47.869-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1014 188163455938551 0 2016-03-24T06:15:47.87-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1017 231278464988123 0 2016-03-24T06:15:47.879-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1018 260649513029490 0 2016-03-24T06:15:47.882-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1020 39089472359294 0 2016-03-24T06:15:47.882-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1021 96968535362842 0 2016-03-24T06:15:47.882-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1022 221652224049657 0 2016-03-24T06:15:47.882-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1023 261891219018270 0 2016-03-24T06:15:47.882-07:00 [Info] TK StreamBegin MAINT_STREAM bucket-1 1019 240793547045030 0 2016-03-24T06:15:47.943-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 240000 2016-03-24T06:15:47.995-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 80000 QueuedCount 50000 2016-03-24T06:15:48.047-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 250000 2016-03-24T06:15:48.187-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 260000 2016-03-24T06:15:48.213-07:00 [Info] StreamState::adjustNonSnapAlignedVbs Bucket bucket-1 StreamId MAINT_STREAM Vbuckets []. 2016-03-24T06:15:48.213-07:00 [Info] Timekeeper::repairStream Nothing to repair for Stream MAINT_STREAM and Bucket bucket-1 2016-03-24T06:15:48.334-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 270000 2016-03-24T06:15:48.507-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 280000 2016-03-24T06:15:48.554-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:48.619-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 290000 2016-03-24T06:15:48.691-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 90000 QueuedCount 50000 2016-03-24T06:15:48.732-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 300000 2016-03-24T06:15:48.852-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 310000 2016-03-24T06:15:48.963-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 100000 QueuedCount 49008 2016-03-24T06:15:48.985-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 320000 2016-03-24T06:15:49.145-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 330000 2016-03-24T06:15:49.213-07:00 [Info] timekeeper.repairMissingStreamBegin stream MAINT_STREAM done 2016-03-24T06:15:49.302-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 340000 2016-03-24T06:15:49.459-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 350000 2016-03-24T06:15:49.62-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 360000 2016-03-24T06:15:49.781-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 370000 2016-03-24T06:15:49.857-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 110000 QueuedCount 39008 2016-03-24T06:15:49.927-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 380000 2016-03-24T06:15:50.091-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 120000 QueuedCount 29008 2016-03-24T06:15:50.113-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 390000 2016-03-24T06:15:50.265-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 400000 2016-03-24T06:15:50.425-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 410000 2016-03-24T06:15:50.582-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 420000 2016-03-24T06:15:50.735-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 430000 2016-03-24T06:15:50.881-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 440000 2016-03-24T06:15:50.95-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 130000 QueuedCount 19008 2016-03-24T06:15:51.024-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 450000 2016-03-24T06:15:51.1-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 140000 QueuedCount 9008 2016-03-24T06:15:51.167-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 460000 2016-03-24T06:15:51.312-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 470000 2016-03-24T06:15:51.451-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 480000 2016-03-24T06:15:51.589-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 490000 2016-03-24T06:15:51.741-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 500000 2016-03-24T06:15:51.907-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 510000 2016-03-24T06:15:52.073-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 520000 2016-03-24T06:15:52.098-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.700085807s CommitTime 460.277334ms TotalFlushTime 6.743738915s TotalCommitTime 460.277334ms 2016-03-24T06:15:52.099-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 149008, 149008, 1 committed:true 2016-03-24T06:15:52.099-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 5718989737366458901 (SnapshotInfo: seqnos: 149008, 149008, 1 committed:true) SnapCreateDur 3.163122405s SnapOpenDur 222.445µs 2016-03-24T06:15:52.149-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:52.154-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 150000 QueuedCount 20723 2016-03-24T06:15:52.173-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 530000 2016-03-24T06:15:52.187-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:52.277-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:52.306-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 540000 2016-03-24T06:15:52.383-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 550000 2016-03-24T06:15:52.464-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:52.489-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 160000 QueuedCount 50000 2016-03-24T06:15:52.497-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 560000 2016-03-24T06:15:52.614-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 570000 2016-03-24T06:15:52.734-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 580000 2016-03-24T06:15:52.883-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 590000 2016-03-24T06:15:53.038-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 600000 2016-03-24T06:15:53.199-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 610000 2016-03-24T06:15:53.35-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 620000 2016-03-24T06:15:53.468-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 170000 QueuedCount 50000 2016-03-24T06:15:53.487-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 630000 2016-03-24T06:15:53.534-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:53.581-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 640000 2016-03-24T06:15:53.616-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 180000 QueuedCount 50000 2016-03-24T06:15:53.679-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 650000 2016-03-24T06:15:53.78-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 660000 2016-03-24T06:15:53.919-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 670000 2016-03-24T06:15:54.059-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 680000 2016-03-24T06:15:54.206-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 690000 2016-03-24T06:15:54.366-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 700000 2016-03-24T06:15:54.524-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 710000 2016-03-24T06:15:54.6-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 190000 QueuedCount 50000 2016-03-24T06:15:54.668-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 720000 2016-03-24T06:15:54.793-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:54.798-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 730000 2016-03-24T06:15:54.928-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 740000 2016-03-24T06:15:54.953-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 200000 QueuedCount 50000 2016-03-24T06:15:55.052-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 750000 2016-03-24T06:15:55.18-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 760000 2016-03-24T06:15:55.287-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 210000 QueuedCount 50000 2016-03-24T06:15:55.293-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 770000 2016-03-24T06:15:55.432-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 780000 2016-03-24T06:15:55.569-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 790000 2016-03-24T06:15:55.713-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 800000 2016-03-24T06:15:55.842-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 810000 2016-03-24T06:15:55.912-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":0,"bucket-1:by_email_name_street:avg_ts_items_count":0,"bucket-1:by_email_name_street:build_progress":1,"bucket-1:by_email_name_street:data_size":66712898,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":55193600,"bucket-1:by_email_name_street:flush_queue_size":46774,"bucket-1:by_email_name_street:frag_percent":0,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":29080147,"bucket-1:by_email_name_street:items_count":149008,"bucket-1:by_email_name_street:num_commits":1,"bucket-1:by_email_name_street:num_compactions":0,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":224551,"bucket-1:by_email_name_street:num_docs_pending":19324785,"bucket-1:by_email_name_street:num_docs_queued":450664,"bucket-1:by_email_name_street:num_flush_queued":260656,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":1,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":0,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"1 460277334 211855224194147556","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"213884 1710670497 2712463620784629","bucket-1:by_email_name_street:timings/storage_handle_open":"1 71583 5124125889","bucket-1:by_email_name_street:timings/storage_info":"5 466641 180286623343","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_set":"1 186720 34864358400","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"427766 8364118611 4003558251323828665","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":554718,"bucket-1:num_mutations_queued":815374,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":38,"memory_quota":104857600000,"memory_used":68431872,"needs_restart":false,"num_connections":0,"timings/stats_response":"1294 110537088 615767823110424"} 2016-03-24T06:15:55.913-07:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 1061207747814546192 Data:76699980, Disk:55193600, ExtraSnapshotData:0, Fragmentation:0% 2016-03-24T06:15:56.054-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 820000 2016-03-24T06:15:56.084-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 220000 QueuedCount 40656 2016-03-24T06:15:56.193-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 830000 2016-03-24T06:15:56.318-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 230000 QueuedCount 30656 2016-03-24T06:15:56.327-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 840000 2016-03-24T06:15:56.451-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 850000 2016-03-24T06:15:56.591-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 860000 2016-03-24T06:15:56.724-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 870000 2016-03-24T06:15:56.874-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 880000 2016-03-24T06:15:57.024-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 890000 2016-03-24T06:15:57.178-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 900000 2016-03-24T06:15:57.284-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 240000 QueuedCount 20656 2016-03-24T06:15:57.322-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 910000 2016-03-24T06:15:57.417-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 250000 QueuedCount 10656 2016-03-24T06:15:57.46-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 920000 2016-03-24T06:15:57.597-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 930000 2016-03-24T06:15:57.737-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 940000 2016-03-24T06:15:57.879-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 950000 2016-03-24T06:15:57.986-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 260000 QueuedCount 656 2016-03-24T06:15:58.023-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 960000 2016-03-24T06:15:58.167-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 970000 2016-03-24T06:15:58.309-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 980000 2016-03-24T06:15:58.464-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 990000 2016-03-24T06:15:58.528-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 4.04µs CommitTime 521.651442ms TotalFlushTime 12.382438625s TotalCommitTime 981.928776ms 2016-03-24T06:15:58.529-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 260656, 260656, 2 committed:true 2016-03-24T06:15:58.529-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 260656, 260656, 2 committed:true) SnapCreateDur 527.660648ms SnapOpenDur 90.493µs 2016-03-24T06:15:58.564-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:58.587-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1000000 2016-03-24T06:15:58.603-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:58.643-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:58.657-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1010000 2016-03-24T06:15:58.713-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 270000 QueuedCount 50000 2016-03-24T06:15:58.723-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1020000 2016-03-24T06:15:58.727-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:58.795-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1030000 2016-03-24T06:15:58.863-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1040000 2016-03-24T06:15:58.934-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1050000 2016-03-24T06:15:58.957-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 280000 QueuedCount 50000 2016-03-24T06:15:59.017-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1060000 2016-03-24T06:15:59.151-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1070000 2016-03-24T06:15:59.304-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1080000 2016-03-24T06:15:59.447-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1090000 2016-03-24T06:15:59.586-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1100000 2016-03-24T06:15:59.608-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:59.681-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1110000 2016-03-24T06:15:59.702-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 290000 QueuedCount 50000 2016-03-24T06:15:59.774-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1120000 2016-03-24T06:15:59.78-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:15:59.835-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 300000 QueuedCount 50000 2016-03-24T06:15:59.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1130000 2016-03-24T06:16:00.011-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1140000 2016-03-24T06:16:00.166-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1150000 2016-03-24T06:16:00.314-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1160000 2016-03-24T06:16:00.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1170000 2016-03-24T06:16:00.628-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1180000 2016-03-24T06:16:00.77-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1190000 2016-03-24T06:16:00.838-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:00.86-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 310000 QueuedCount 50000 2016-03-24T06:16:00.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1200000 2016-03-24T06:16:00.967-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1210000 2016-03-24T06:16:01.09-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1220000 2016-03-24T06:16:01.097-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 320000 QueuedCount 50000 2016-03-24T06:16:01.246-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1230000 2016-03-24T06:16:01.415-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1240000 2016-03-24T06:16:01.582-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1250000 2016-03-24T06:16:01.746-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1260000 2016-03-24T06:16:01.885-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1270000 2016-03-24T06:16:02.027-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1280000 2016-03-24T06:16:02.326-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 330000 QueuedCount 41006 2016-03-24T06:16:02.345-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1290000 2016-03-24T06:16:02.501-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1300000 2016-03-24T06:16:02.507-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 340000 QueuedCount 31006 2016-03-24T06:16:02.647-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1310000 2016-03-24T06:16:02.785-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1320000 2016-03-24T06:16:02.92-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1330000 2016-03-24T06:16:03.05-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1340000 2016-03-24T06:16:03.179-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1350000 2016-03-24T06:16:03.198-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 350000 QueuedCount 21006 2016-03-24T06:16:03.309-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1360000 2016-03-24T06:16:03.343-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 360000 QueuedCount 11006 2016-03-24T06:16:03.445-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1370000 2016-03-24T06:16:03.581-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1380000 2016-03-24T06:16:03.715-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1390000 2016-03-24T06:16:03.851-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1400000 2016-03-24T06:16:03.945-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 370000 QueuedCount 1006 2016-03-24T06:16:03.977-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1410000 2016-03-24T06:16:04.101-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1420000 2016-03-24T06:16:04.211-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.086µs CommitTime 241.039306ms TotalFlushTime 17.658571383s TotalCommitTime 1.222968082s 2016-03-24T06:16:04.211-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 371006, 371006, 3 committed:true 2016-03-24T06:16:04.211-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 371006, 371006, 3 committed:true) SnapCreateDur 245.867347ms SnapOpenDur 50.206µs 2016-03-24T06:16:04.226-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1430000 2016-03-24T06:16:04.244-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:04.278-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:04.298-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1440000 2016-03-24T06:16:04.312-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:04.343-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 380000 QueuedCount 39298 2016-03-24T06:16:04.349-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:04.358-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1450000 2016-03-24T06:16:04.397-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:04.426-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1460000 2016-03-24T06:16:04.472-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 390000 QueuedCount 50000 2016-03-24T06:16:04.48-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1470000 2016-03-24T06:16:04.546-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1480000 2016-03-24T06:16:04.625-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1490000 2016-03-24T06:16:04.721-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1500000 2016-03-24T06:16:04.845-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1510000 2016-03-24T06:16:04.959-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1520000 2016-03-24T06:16:05.048-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:05.052-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1530000 2016-03-24T06:16:05.097-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 400000 QueuedCount 50000 2016-03-24T06:16:05.145-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1540000 2016-03-24T06:16:05.23-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1550000 2016-03-24T06:16:05.331-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1560000 2016-03-24T06:16:05.352-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 410000 QueuedCount 50000 2016-03-24T06:16:05.448-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1570000 2016-03-24T06:16:05.589-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1580000 2016-03-24T06:16:05.732-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1590000 2016-03-24T06:16:05.878-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1600000 2016-03-24T06:16:06.02-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1610000 2016-03-24T06:16:06.133-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:06.164-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1620000 2016-03-24T06:16:06.277-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1630000 2016-03-24T06:16:06.358-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 420000 QueuedCount 50000 2016-03-24T06:16:06.4-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1640000 2016-03-24T06:16:06.521-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1650000 2016-03-24T06:16:06.671-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1660000 2016-03-24T06:16:06.679-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 430000 QueuedCount 46031 2016-03-24T06:16:06.83-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1670000 2016-03-24T06:16:06.977-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1680000 2016-03-24T06:16:07.121-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1690000 2016-03-24T06:16:07.267-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1700000 2016-03-24T06:16:07.414-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1710000 2016-03-24T06:16:07.558-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1720000 2016-03-24T06:16:07.711-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1730000 2016-03-24T06:16:07.746-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 440000 QueuedCount 36031 2016-03-24T06:16:07.842-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1740000 2016-03-24T06:16:07.878-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 450000 QueuedCount 26031 2016-03-24T06:16:07.981-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1750000 2016-03-24T06:16:08.148-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1760000 2016-03-24T06:16:08.324-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1770000 2016-03-24T06:16:08.499-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1780000 2016-03-24T06:16:08.669-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1790000 2016-03-24T06:16:08.833-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1800000 2016-03-24T06:16:08.916-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 460000 QueuedCount 16031 2016-03-24T06:16:08.974-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1810000 2016-03-24T06:16:09.064-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 470000 QueuedCount 6031 2016-03-24T06:16:09.121-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1820000 2016-03-24T06:16:09.264-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1830000 2016-03-24T06:16:09.403-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1840000 2016-03-24T06:16:09.549-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1850000 2016-03-24T06:16:09.691-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1860000 2016-03-24T06:16:09.861-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1870000 2016-03-24T06:16:09.933-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.644µs CommitTime 265.738029ms TotalFlushTime 22.933702669s TotalCommitTime 1.488706111s 2016-03-24T06:16:09.933-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 476031, 476031, 4 committed:true 2016-03-24T06:16:09.933-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 476031, 476031, 4 committed:true) SnapCreateDur 281.499571ms SnapOpenDur 71.996µs 2016-03-24T06:16:09.971-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:10.004-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1880000 2016-03-24T06:16:10.008-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:10.011-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 480000 QueuedCount 23227 2016-03-24T06:16:10.042-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:10.082-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:10.082-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1890000 2016-03-24T06:16:10.142-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1900000 2016-03-24T06:16:10.16-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 490000 QueuedCount 50000 2016-03-24T06:16:10.194-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1910000 2016-03-24T06:16:10.251-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1920000 2016-03-24T06:16:10.309-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1930000 2016-03-24T06:16:10.405-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1940000 2016-03-24T06:16:10.534-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1950000 2016-03-24T06:16:10.674-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1960000 2016-03-24T06:16:10.81-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1970000 2016-03-24T06:16:10.937-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1980000 2016-03-24T06:16:11.062-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 1990000 2016-03-24T06:16:11.102-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 500000 QueuedCount 50000 2016-03-24T06:16:11.119-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:11.159-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2000000 2016-03-24T06:16:11.251-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 510000 QueuedCount 50000 2016-03-24T06:16:11.257-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2010000 2016-03-24T06:16:11.355-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2020000 2016-03-24T06:16:11.515-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2030000 2016-03-24T06:16:11.689-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2040000 2016-03-24T06:16:11.859-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2050000 2016-03-24T06:16:12.016-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2060000 2016-03-24T06:16:12.192-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2070000 2016-03-24T06:16:12.298-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:12.317-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 520000 QueuedCount 48490 2016-03-24T06:16:12.327-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2080000 2016-03-24T06:16:12.419-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2090000 2016-03-24T06:16:12.531-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2100000 2016-03-24T06:16:12.558-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 530000 QueuedCount 50000 2016-03-24T06:16:12.655-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2110000 2016-03-24T06:16:12.785-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2120000 2016-03-24T06:16:12.932-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2130000 2016-03-24T06:16:13.081-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2140000 2016-03-24T06:16:13.228-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2150000 2016-03-24T06:16:13.374-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2160000 2016-03-24T06:16:13.523-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2170000 2016-03-24T06:16:13.664-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2180000 2016-03-24T06:16:13.71-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 540000 QueuedCount 44551 2016-03-24T06:16:13.797-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2190000 2016-03-24T06:16:13.841-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 550000 QueuedCount 34551 2016-03-24T06:16:13.921-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2200000 2016-03-24T06:16:14.058-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2210000 2016-03-24T06:16:14.192-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2220000 2016-03-24T06:16:14.343-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2230000 2016-03-24T06:16:14.49-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2240000 2016-03-24T06:16:14.64-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2250000 2016-03-24T06:16:14.787-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2260000 2016-03-24T06:16:14.908-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 560000 QueuedCount 24551 2016-03-24T06:16:14.928-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2270000 2016-03-24T06:16:15.052-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 570000 QueuedCount 14551 2016-03-24T06:16:15.064-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2280000 2016-03-24T06:16:15.199-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2290000 2016-03-24T06:16:15.322-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2300000 2016-03-24T06:16:15.445-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2310000 2016-03-24T06:16:15.567-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2320000 2016-03-24T06:16:15.677-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 580000 QueuedCount 4551 2016-03-24T06:16:15.698-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2330000 2016-03-24T06:16:15.835-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2340000 2016-03-24T06:16:16-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2350000 2016-03-24T06:16:16.166-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2360000 2016-03-24T06:16:16.212-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 5.657µs CommitTime 459.421545ms TotalFlushTime 28.575870639s TotalCommitTime 1.948127656s 2016-03-24T06:16:16.213-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 584551, 584551, 5 committed:true 2016-03-24T06:16:16.213-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 584551, 584551, 5 committed:true) SnapCreateDur 480.16757ms SnapOpenDur 107.912µs 2016-03-24T06:16:16.251-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:16.288-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:16.293-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2370000 2016-03-24T06:16:16.326-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:16.376-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 590000 QueuedCount 50000 2016-03-24T06:16:16.379-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2380000 2016-03-24T06:16:16.41-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:16.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2390000 2016-03-24T06:16:16.52-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2400000 2016-03-24T06:16:16.586-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2410000 2016-03-24T06:16:16.61-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 600000 QueuedCount 50000 2016-03-24T06:16:16.658-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2420000 2016-03-24T06:16:16.739-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2430000 2016-03-24T06:16:16.874-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2440000 2016-03-24T06:16:17.017-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2450000 2016-03-24T06:16:17.163-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2460000 2016-03-24T06:16:17.299-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2470000 2016-03-24T06:16:17.605-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2480000 2016-03-24T06:16:17.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 610000 QueuedCount 50000 2016-03-24T06:16:17.718-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2490000 2016-03-24T06:16:17.747-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:17.838-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2500000 2016-03-24T06:16:17.966-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2510000 2016-03-24T06:16:17.993-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 620000 QueuedCount 50000 2016-03-24T06:16:18.087-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2520000 2016-03-24T06:16:18.223-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2530000 2016-03-24T06:16:18.442-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2540000 2016-03-24T06:16:18.612-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2550000 2016-03-24T06:16:18.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2560000 2016-03-24T06:16:18.909-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2570000 2016-03-24T06:16:19.031-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 630000 QueuedCount 45215 2016-03-24T06:16:19.049-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2580000 2016-03-24T06:16:19.179-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 640000 QueuedCount 35215 2016-03-24T06:16:19.188-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2590000 2016-03-24T06:16:19.334-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2600000 2016-03-24T06:16:19.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2610000 2016-03-24T06:16:19.615-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2620000 2016-03-24T06:16:19.757-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2630000 2016-03-24T06:16:19.801-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 650000 QueuedCount 25215 2016-03-24T06:16:19.894-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2640000 2016-03-24T06:16:19.924-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 660000 QueuedCount 15215 2016-03-24T06:16:20.03-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2650000 2016-03-24T06:16:20.165-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2660000 2016-03-24T06:16:20.298-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2670000 2016-03-24T06:16:20.428-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2680000 2016-03-24T06:16:20.488-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 670000 QueuedCount 5215 2016-03-24T06:16:20.556-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2690000 2016-03-24T06:16:20.683-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2700000 2016-03-24T06:16:20.799-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.231µs CommitTime 243.653117ms TotalFlushTime 32.760520129s TotalCommitTime 2.191780773s 2016-03-24T06:16:20.799-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 675215, 675215, 6 committed:true 2016-03-24T06:16:20.799-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 675215, 675215, 6 committed:true) SnapCreateDur 253.642025ms SnapOpenDur 44.959µs 2016-03-24T06:16:20.813-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2710000 2016-03-24T06:16:20.834-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:20.87-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:20.898-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2720000 2016-03-24T06:16:20.904-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:20.949-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:20.952-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 680000 QueuedCount 49876 2016-03-24T06:16:20.966-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2730000 2016-03-24T06:16:21.033-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2740000 2016-03-24T06:16:21.103-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2750000 2016-03-24T06:16:21.179-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2760000 2016-03-24T06:16:21.249-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2770000 2016-03-24T06:16:21.277-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 690000 QueuedCount 50000 2016-03-24T06:16:21.342-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2780000 2016-03-24T06:16:21.422-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:21.477-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2790000 2016-03-24T06:16:21.663-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2800000 2016-03-24T06:16:21.848-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2810000 2016-03-24T06:16:22.037-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2820000 2016-03-24T06:16:22.226-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2830000 2016-03-24T06:16:22.364-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2840000 2016-03-24T06:16:22.38-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 700000 QueuedCount 50000 2016-03-24T06:16:22.465-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2850000 2016-03-24T06:16:22.534-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 710000 QueuedCount 50000 2016-03-24T06:16:22.554-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:22.567-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2860000 2016-03-24T06:16:22.68-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2870000 2016-03-24T06:16:22.824-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2880000 2016-03-24T06:16:22.966-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2890000 2016-03-24T06:16:23.107-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2900000 2016-03-24T06:16:23.191-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 720000 QueuedCount 50000 2016-03-24T06:16:23.214-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2910000 2016-03-24T06:16:23.314-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2920000 2016-03-24T06:16:23.334-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:23.405-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 730000 QueuedCount 50000 2016-03-24T06:16:23.437-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2930000 2016-03-24T06:16:23.55-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2940000 2016-03-24T06:16:23.664-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2950000 2016-03-24T06:16:23.793-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2960000 2016-03-24T06:16:23.953-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2970000 2016-03-24T06:16:24.128-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2980000 2016-03-24T06:16:24.3-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 2990000 2016-03-24T06:16:24.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3000000 2016-03-24T06:16:24.493-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 740000 QueuedCount 50000 2016-03-24T06:16:24.572-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3010000 2016-03-24T06:16:24.644-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 750000 QueuedCount 41785 2016-03-24T06:16:24.721-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3020000 2016-03-24T06:16:24.859-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3030000 2016-03-24T06:16:24.998-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3040000 2016-03-24T06:16:25.136-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3050000 2016-03-24T06:16:25.277-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3060000 2016-03-24T06:16:25.285-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 760000 QueuedCount 31785 2016-03-24T06:16:25.409-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 770000 QueuedCount 21785 2016-03-24T06:16:25.416-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3070000 2016-03-24T06:16:25.554-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3080000 2016-03-24T06:16:25.692-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3090000 2016-03-24T06:16:25.828-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3100000 2016-03-24T06:16:25.913-07:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 1061207747814546192 Data:286658827, Disk:331407360, ExtraSnapshotData:0, Fragmentation:13.50257670801276% 2016-03-24T06:16:25.958-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3110000 2016-03-24T06:16:25.998-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 780000 QueuedCount 11785 2016-03-24T06:16:26.09-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3120000 2016-03-24T06:16:26.103-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 790000 QueuedCount 1785 2016-03-24T06:16:26.218-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3130000 2016-03-24T06:16:26.342-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3140000 2016-03-24T06:16:26.468-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3150000 2016-03-24T06:16:26.594-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3160000 2016-03-24T06:16:26.723-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3170000 2016-03-24T06:16:26.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3180000 2016-03-24T06:16:26.882-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.366µs CommitTime 725.435105ms TotalFlushTime 37.897710006s TotalCommitTime 2.917215878s 2016-03-24T06:16:26.882-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 791785, 791785, 7 committed:true 2016-03-24T06:16:26.882-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 791785, 791785, 7 committed:true) SnapCreateDur 749.518932ms SnapOpenDur 43.12µs 2016-03-24T06:16:26.923-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:26.957-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:26.982-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3190000 2016-03-24T06:16:27-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:27.043-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:27.072-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3200000 2016-03-24T06:16:27.137-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 800000 QueuedCount 50000 2016-03-24T06:16:27.144-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3210000 2016-03-24T06:16:27.22-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3220000 2016-03-24T06:16:27.298-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3230000 2016-03-24T06:16:27.38-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3240000 2016-03-24T06:16:27.421-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 810000 QueuedCount 50000 2016-03-24T06:16:27.431-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:27.48-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3250000 2016-03-24T06:16:27.641-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3260000 2016-03-24T06:16:27.818-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3270000 2016-03-24T06:16:28.003-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3280000 2016-03-24T06:16:28.19-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3290000 2016-03-24T06:16:28.347-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3300000 2016-03-24T06:16:28.451-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3310000 2016-03-24T06:16:28.473-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 820000 QueuedCount 50000 2016-03-24T06:16:28.544-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:28.563-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3320000 2016-03-24T06:16:28.626-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 830000 QueuedCount 50000 2016-03-24T06:16:28.654-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3330000 2016-03-24T06:16:28.79-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3340000 2016-03-24T06:16:28.931-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3350000 2016-03-24T06:16:29.067-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3360000 2016-03-24T06:16:29.215-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3370000 2016-03-24T06:16:29.358-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3380000 2016-03-24T06:16:29.479-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 840000 QueuedCount 48153 2016-03-24T06:16:29.503-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3390000 2016-03-24T06:16:29.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3400000 2016-03-24T06:16:29.737-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 850000 QueuedCount 38153 2016-03-24T06:16:29.877-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3410000 2016-03-24T06:16:30.064-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3420000 2016-03-24T06:16:30.248-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3430000 2016-03-24T06:16:30.397-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3440000 2016-03-24T06:16:30.541-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3450000 2016-03-24T06:16:30.673-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 860000 QueuedCount 28153 2016-03-24T06:16:30.693-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3460000 2016-03-24T06:16:30.805-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 870000 QueuedCount 18153 2016-03-24T06:16:30.835-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3470000 2016-03-24T06:16:30.976-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3480000 2016-03-24T06:16:31.115-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3490000 2016-03-24T06:16:31.251-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3500000 2016-03-24T06:16:31.391-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3510000 2016-03-24T06:16:31.437-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 880000 QueuedCount 8153 2016-03-24T06:16:31.532-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3520000 2016-03-24T06:16:31.669-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3530000 2016-03-24T06:16:31.806-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3540000 2016-03-24T06:16:31.932-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3550000 2016-03-24T06:16:31.964-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 4.557µs CommitTime 409.477511ms TotalFlushTime 42.377072764s TotalCommitTime 3.326693389s 2016-03-24T06:16:31.964-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 888153, 888153, 8 committed:true 2016-03-24T06:16:31.964-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 888153, 888153, 8 committed:true) SnapCreateDur 421.903595ms SnapOpenDur 54.462µs 2016-03-24T06:16:31.998-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:32.032-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:32.034-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3560000 2016-03-24T06:16:32.039-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 890000 QueuedCount 25168 2016-03-24T06:16:32.067-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:32.108-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3570000 2016-03-24T06:16:32.154-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:32.173-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3580000 2016-03-24T06:16:32.245-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3590000 2016-03-24T06:16:32.323-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3600000 2016-03-24T06:16:32.358-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 900000 QueuedCount 50000 2016-03-24T06:16:32.413-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3610000 2016-03-24T06:16:32.515-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3620000 2016-03-24T06:16:32.601-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:32.647-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3630000 2016-03-24T06:16:32.828-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3640000 2016-03-24T06:16:33.011-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3650000 2016-03-24T06:16:33.189-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3660000 2016-03-24T06:16:33.349-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3670000 2016-03-24T06:16:33.503-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3680000 2016-03-24T06:16:33.508-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 910000 QueuedCount 50000 2016-03-24T06:16:33.609-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3690000 2016-03-24T06:16:33.691-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 920000 QueuedCount 50000 2016-03-24T06:16:33.72-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3700000 2016-03-24T06:16:33.753-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:33.844-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3710000 2016-03-24T06:16:33.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3720000 2016-03-24T06:16:34.163-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3730000 2016-03-24T06:16:34.335-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3740000 2016-03-24T06:16:34.495-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3750000 2016-03-24T06:16:34.646-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3760000 2016-03-24T06:16:34.679-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 930000 QueuedCount 50000 2016-03-24T06:16:34.753-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3770000 2016-03-24T06:16:34.812-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 940000 QueuedCount 45622 2016-03-24T06:16:34.888-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3780000 2016-03-24T06:16:35.029-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3790000 2016-03-24T06:16:35.169-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3800000 2016-03-24T06:16:35.305-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3810000 2016-03-24T06:16:35.447-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3820000 2016-03-24T06:16:35.453-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 950000 QueuedCount 35622 2016-03-24T06:16:35.574-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 960000 QueuedCount 25622 2016-03-24T06:16:35.591-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3830000 2016-03-24T06:16:35.704-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 970000 QueuedCount 15622 2016-03-24T06:16:35.735-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3840000 2016-03-24T06:16:35.88-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3850000 2016-03-24T06:16:36.009-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3860000 2016-03-24T06:16:36.154-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3870000 2016-03-24T06:16:36.25-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 980000 QueuedCount 5622 2016-03-24T06:16:36.294-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3880000 2016-03-24T06:16:36.423-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3890000 2016-03-24T06:16:36.552-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3900000 2016-03-24T06:16:36.678-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3910000 2016-03-24T06:16:36.812-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3920000 2016-03-24T06:16:36.979-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3930000 2016-03-24T06:16:37.123-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3940000 2016-03-24T06:16:37.259-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 6.683µs CommitTime 915.913416ms TotalFlushTime 46.560691749s TotalCommitTime 4.242606805s 2016-03-24T06:16:37.259-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 985622, 985622, 9 committed:true 2016-03-24T06:16:37.259-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 985622, 985622, 9 committed:true) SnapCreateDur 941.333914ms SnapOpenDur 46.307µs 2016-03-24T06:16:37.269-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3950000 2016-03-24T06:16:37.303-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:37.361-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:37.363-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3960000 2016-03-24T06:16:37.364-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 990000 QueuedCount 40074 2016-03-24T06:16:37.44-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3970000 2016-03-24T06:16:37.514-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3980000 2016-03-24T06:16:37.59-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 3990000 2016-03-24T06:16:37.59-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1000000 QueuedCount 50000 2016-03-24T06:16:37.667-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4000000 2016-03-24T06:16:37.748-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4010000 2016-03-24T06:16:37.86-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4020000 2016-03-24T06:16:38.039-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4030000 2016-03-24T06:16:38.221-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4040000 2016-03-24T06:16:38.377-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4050000 2016-03-24T06:16:38.535-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4060000 2016-03-24T06:16:38.612-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:38.642-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1010000 QueuedCount 50000 2016-03-24T06:16:38.656-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4070000 2016-03-24T06:16:38.755-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4080000 2016-03-24T06:16:38.791-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1020000 QueuedCount 50000 2016-03-24T06:16:38.832-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:38.856-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4090000 2016-03-24T06:16:38.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4100000 2016-03-24T06:16:39.112-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4110000 2016-03-24T06:16:39.251-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4120000 2016-03-24T06:16:39.389-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4130000 2016-03-24T06:16:39.45-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1030000 QueuedCount 50000 2016-03-24T06:16:39.496-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4140000 2016-03-24T06:16:39.599-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4150000 2016-03-24T06:16:39.689-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1040000 QueuedCount 46410 2016-03-24T06:16:39.749-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4160000 2016-03-24T06:16:39.927-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4170000 2016-03-24T06:16:40.103-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4180000 2016-03-24T06:16:40.27-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4190000 2016-03-24T06:16:40.418-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4200000 2016-03-24T06:16:40.561-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4210000 2016-03-24T06:16:40.67-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1050000 QueuedCount 36410 2016-03-24T06:16:40.715-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4220000 2016-03-24T06:16:40.801-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1060000 QueuedCount 26410 2016-03-24T06:16:40.852-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4230000 2016-03-24T06:16:40.995-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4240000 2016-03-24T06:16:41.135-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4250000 2016-03-24T06:16:41.273-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4260000 2016-03-24T06:16:41.404-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4270000 2016-03-24T06:16:41.463-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1070000 QueuedCount 16410 2016-03-24T06:16:41.538-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4280000 2016-03-24T06:16:41.588-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1080000 QueuedCount 6410 2016-03-24T06:16:41.672-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4290000 2016-03-24T06:16:41.803-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4300000 2016-03-24T06:16:41.928-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4310000 2016-03-24T06:16:42.046-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4320000 2016-03-24T06:16:42.173-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4330000 2016-03-24T06:16:42.213-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.631µs CommitTime 520.625975ms TotalFlushTime 50.805714758s TotalCommitTime 4.76323278s 2016-03-24T06:16:42.213-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1086410, 1086410, 10 committed:true 2016-03-24T06:16:42.213-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1086410, 1086410, 10 committed:true) SnapCreateDur 533.059798ms SnapOpenDur 35.706µs 2016-03-24T06:16:42.25-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:42.277-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4340000 2016-03-24T06:16:42.292-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:42.33-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1090000 QueuedCount 48933 2016-03-24T06:16:42.33-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:42.344-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4350000 2016-03-24T06:16:42.404-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4360000 2016-03-24T06:16:42.462-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4370000 2016-03-24T06:16:42.466-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1100000 QueuedCount 50000 2016-03-24T06:16:42.491-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:42.527-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4380000 2016-03-24T06:16:42.603-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4390000 2016-03-24T06:16:42.712-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4400000 2016-03-24T06:16:42.84-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4410000 2016-03-24T06:16:42.976-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4420000 2016-03-24T06:16:43.06-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1110000 QueuedCount 50000 2016-03-24T06:16:43.081-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4430000 2016-03-24T06:16:43.153-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:43.184-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4440000 2016-03-24T06:16:43.283-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1120000 QueuedCount 50000 2016-03-24T06:16:43.288-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4450000 2016-03-24T06:16:43.396-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4460000 2016-03-24T06:16:43.526-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4470000 2016-03-24T06:16:43.658-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4480000 2016-03-24T06:16:43.794-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4490000 2016-03-24T06:16:43.969-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4500000 2016-03-24T06:16:44.145-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4510000 2016-03-24T06:16:44.306-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4520000 2016-03-24T06:16:44.335-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:44.361-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1130000 QueuedCount 50000 2016-03-24T06:16:44.406-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4530000 2016-03-24T06:16:44.507-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4540000 2016-03-24T06:16:44.518-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1140000 QueuedCount 50000 2016-03-24T06:16:44.628-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4550000 2016-03-24T06:16:44.778-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4560000 2016-03-24T06:16:44.93-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4570000 2016-03-24T06:16:45.072-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4580000 2016-03-24T06:16:45.225-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1150000 QueuedCount 42654 2016-03-24T06:16:45.234-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4590000 2016-03-24T06:16:45.35-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1160000 QueuedCount 32654 2016-03-24T06:16:45.389-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4600000 2016-03-24T06:16:45.537-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4610000 2016-03-24T06:16:45.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4620000 2016-03-24T06:16:45.84-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4630000 2016-03-24T06:16:45.98-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1170000 QueuedCount 22654 2016-03-24T06:16:45.982-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4640000 2016-03-24T06:16:46.086-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1180000 QueuedCount 12654 2016-03-24T06:16:46.123-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4650000 2016-03-24T06:16:46.259-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4660000 2016-03-24T06:16:46.393-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4670000 2016-03-24T06:16:46.527-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4680000 2016-03-24T06:16:46.657-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1190000 QueuedCount 2654 2016-03-24T06:16:46.663-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4690000 2016-03-24T06:16:46.798-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4700000 2016-03-24T06:16:46.882-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.353µs CommitTime 177.796677ms TotalFlushTime 55.127262574s TotalCommitTime 4.941029457s 2016-03-24T06:16:46.882-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1192654, 1192654, 11 committed:true 2016-03-24T06:16:46.882-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1192654, 1192654, 11 committed:true) SnapCreateDur 189.448217ms SnapOpenDur 39.418µs 2016-03-24T06:16:47.14-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:47.141-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4710000 2016-03-24T06:16:47.176-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:47.209-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:47.219-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4720000 2016-03-24T06:16:47.284-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4730000 2016-03-24T06:16:47.298-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1200000 QueuedCount 50000 2016-03-24T06:16:47.317-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:47.35-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4740000 2016-03-24T06:16:47.416-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4750000 2016-03-24T06:16:47.486-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4760000 2016-03-24T06:16:47.56-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1210000 QueuedCount 50000 2016-03-24T06:16:47.57-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4770000 2016-03-24T06:16:47.687-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4780000 2016-03-24T06:16:47.847-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4790000 2016-03-24T06:16:48.015-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4800000 2016-03-24T06:16:48.182-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4810000 2016-03-24T06:16:48.331-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4820000 2016-03-24T06:16:48.485-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:48.487-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4830000 2016-03-24T06:16:48.599-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4840000 2016-03-24T06:16:48.607-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1220000 QueuedCount 50000 2016-03-24T06:16:48.712-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4850000 2016-03-24T06:16:48.823-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:48.826-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4860000 2016-03-24T06:16:48.883-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1230000 QueuedCount 50000 2016-03-24T06:16:48.928-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:48.949-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4870000 2016-03-24T06:16:49.098-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4880000 2016-03-24T06:16:49.243-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4890000 2016-03-24T06:16:49.394-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4900000 2016-03-24T06:16:49.542-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4910000 2016-03-24T06:16:49.661-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4920000 2016-03-24T06:16:49.685-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1240000 QueuedCount 50000 2016-03-24T06:16:49.741-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:49.767-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4930000 2016-03-24T06:16:49.831-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1250000 QueuedCount 50000 2016-03-24T06:16:49.862-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4940000 2016-03-24T06:16:49.989-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4950000 2016-03-24T06:16:50.126-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4960000 2016-03-24T06:16:50.258-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4970000 2016-03-24T06:16:50.387-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4980000 2016-03-24T06:16:50.506-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1260000 QueuedCount 46298 2016-03-24T06:16:50.513-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 4990000 2016-03-24T06:16:50.632-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1270000 QueuedCount 36298 2016-03-24T06:16:50.651-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5000000 2016-03-24T06:16:50.781-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5010000 2016-03-24T06:16:50.911-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5020000 2016-03-24T06:16:51.042-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5030000 2016-03-24T06:16:51.169-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1280000 QueuedCount 26298 2016-03-24T06:16:51.176-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5040000 2016-03-24T06:16:51.273-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1290000 QueuedCount 16298 2016-03-24T06:16:51.314-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5050000 2016-03-24T06:16:51.449-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5060000 2016-03-24T06:16:51.582-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5070000 2016-03-24T06:16:51.719-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5080000 2016-03-24T06:16:51.813-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1300000 QueuedCount 6298 2016-03-24T06:16:51.855-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5090000 2016-03-24T06:16:51.995-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5100000 2016-03-24T06:16:52.136-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5110000 2016-03-24T06:16:52.227-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.248µs CommitTime 335.595466ms TotalFlushTime 59.952893268s TotalCommitTime 5.276624923s 2016-03-24T06:16:52.227-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1306298, 1306298, 12 committed:true 2016-03-24T06:16:52.227-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1306298, 1306298, 12 committed:true) SnapCreateDur 345.493821ms SnapOpenDur 58.441µs 2016-03-24T06:16:52.263-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:52.268-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5120000 2016-03-24T06:16:52.298-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1310000 QueuedCount 25808 2016-03-24T06:16:52.298-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:52.336-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:52.346-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5130000 2016-03-24T06:16:52.382-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:52.413-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5140000 2016-03-24T06:16:52.432-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1320000 QueuedCount 50000 2016-03-24T06:16:52.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5150000 2016-03-24T06:16:52.532-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5160000 2016-03-24T06:16:52.615-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5170000 2016-03-24T06:16:52.722-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5180000 2016-03-24T06:16:52.849-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5190000 2016-03-24T06:16:52.978-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5200000 2016-03-24T06:16:53.074-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1330000 QueuedCount 50000 2016-03-24T06:16:53.084-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5210000 2016-03-24T06:16:53.089-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:53.168-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5220000 2016-03-24T06:16:53.197-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1340000 QueuedCount 50000 2016-03-24T06:16:53.256-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5230000 2016-03-24T06:16:53.27-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:53.378-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5240000 2016-03-24T06:16:53.516-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5250000 2016-03-24T06:16:53.65-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5260000 2016-03-24T06:16:53.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5270000 2016-03-24T06:16:53.788-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1350000 QueuedCount 50000 2016-03-24T06:16:53.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5280000 2016-03-24T06:16:53.973-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5290000 2016-03-24T06:16:54.032-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1360000 QueuedCount 50000 2016-03-24T06:16:54.077-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:54.094-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5300000 2016-03-24T06:16:54.213-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5310000 2016-03-24T06:16:54.365-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5320000 2016-03-24T06:16:54.53-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5330000 2016-03-24T06:16:54.709-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5340000 2016-03-24T06:16:54.863-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5350000 2016-03-24T06:16:55.017-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5360000 2016-03-24T06:16:55.101-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1370000 QueuedCount 50000 2016-03-24T06:16:55.133-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5370000 2016-03-24T06:16:55.223-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:55.237-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5380000 2016-03-24T06:16:55.254-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1380000 QueuedCount 50000 2016-03-24T06:16:55.327-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5390000 2016-03-24T06:16:55.445-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5400000 2016-03-24T06:16:55.583-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5410000 2016-03-24T06:16:55.721-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5420000 2016-03-24T06:16:55.857-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5430000 2016-03-24T06:16:55.913-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5126933428,"bucket-1:by_email_name_street:avg_ts_items_count":108460,"bucket-1:by_email_name_street:build_progress":7,"bucket-1:by_email_name_street:data_size":497732817,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":789004288,"bucket-1:by_email_name_street:flush_queue_size":50042,"bucket-1:by_email_name_street:frag_percent":36,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":209411679,"bucket-1:by_email_name_street:items_count":1306298,"bucket-1:by_email_name_street:num_commits":12,"bucket-1:by_email_name_street:num_compactions":0,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":1411552,"bucket-1:by_email_name_street:num_docs_pending":14666247,"bucket-1:by_email_name_street:num_docs_queued":3922201,"bucket-1:by_email_name_street:num_flush_queued":1438307,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":12,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5344448649,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"12 5276624923 2831239785849201423","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"1388266 10863182593 9192400766000171","bucket-1:by_email_name_street:timings/storage_handle_open":"12 473038 21912586650","bucket-1:by_email_name_street:timings/storage_info":"49 881000 196710069584","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"11 3861643 1621578322525","bucket-1:by_email_name_street:timings/storage_meta_set":"12 5645298 3297432208446","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"2776533 51283571477 8860486825001833907","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":3995391,"bucket-1:num_mutations_queued":5433660,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":257,"memory_quota":104857600000,"memory_used":557989888,"needs_restart":false,"num_connections":0,"timings/stats_response":"1366 139535488 627861039766952"} 2016-03-24T06:16:55.913-07:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 1061207747814546192 Data:507607609, Disk:789004288, ExtraSnapshotData:0, Fragmentation:35.66478449861099% 2016-03-24T06:16:55.913-07:00 [Info] CompactionDaemon: Compacting index instance:1061207747814546192 2016-03-24T06:16:55.933-07:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 888153. Slice Id 0, IndexInstId 1061207747814546192, IndexDefnId 1061207747814546192 2016-03-24T06:16:55.935-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1390000 QueuedCount 50000 2016-03-24T06:16:55.986-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5440000 2016-03-24T06:16:56.154-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5450000 2016-03-24T06:16:56.33-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5460000 2016-03-24T06:16:56.444-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5470000 2016-03-24T06:16:56.51-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1400000 QueuedCount 50000 2016-03-24T06:16:56.564-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5480000 2016-03-24T06:16:56.712-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5490000 2016-03-24T06:16:56.741-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1410000 QueuedCount 45261 2016-03-24T06:16:56.866-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5500000 2016-03-24T06:16:57.02-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5510000 2016-03-24T06:16:57.174-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5520000 2016-03-24T06:16:57.317-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5530000 2016-03-24T06:16:57.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5540000 2016-03-24T06:16:57.595-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5550000 2016-03-24T06:16:57.637-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1420000 QueuedCount 35261 2016-03-24T06:16:57.732-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5560000 2016-03-24T06:16:57.782-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1430000 QueuedCount 25261 2016-03-24T06:16:57.879-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5570000 2016-03-24T06:16:58.023-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5580000 2016-03-24T06:16:58.165-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5590000 2016-03-24T06:16:58.305-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5600000 2016-03-24T06:16:58.439-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5610000 2016-03-24T06:16:58.456-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1440000 QueuedCount 15261 2016-03-24T06:16:58.569-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1450000 QueuedCount 5261 2016-03-24T06:16:58.579-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5620000 2016-03-24T06:16:58.709-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5630000 2016-03-24T06:16:58.841-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5640000 2016-03-24T06:16:58.979-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5650000 2016-03-24T06:16:59.123-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5660000 2016-03-24T06:16:59.249-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5670000 2016-03-24T06:16:59.37-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5680000 2016-03-24T06:16:59.452-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 6.33µs CommitTime 321.906416ms TotalFlushTime 1m6.602686516s TotalCommitTime 5.598531339s 2016-03-24T06:16:59.452-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1455261, 1455261, 13 committed:true 2016-03-24T06:16:59.452-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1455261, 1455261, 13 committed:true) SnapCreateDur 348.584951ms SnapOpenDur 64.163µs 2016-03-24T06:16:59.503-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:59.504-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5690000 2016-03-24T06:16:59.544-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:16:59.579-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5700000 2016-03-24T06:16:59.612-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1460000 QueuedCount 49995 2016-03-24T06:16:59.645-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5710000 2016-03-24T06:16:59.706-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5720000 2016-03-24T06:16:59.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5730000 2016-03-24T06:16:59.844-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5740000 2016-03-24T06:16:59.882-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1470000 QueuedCount 50000 2016-03-24T06:16:59.917-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5750000 2016-03-24T06:16:59.986-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:00.009-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5760000 2016-03-24T06:17:00.13-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5770000 2016-03-24T06:17:00.259-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5780000 2016-03-24T06:17:00.384-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5790000 2016-03-24T06:17:00.51-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5800000 2016-03-24T06:17:00.637-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5810000 2016-03-24T06:17:00.766-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5820000 2016-03-24T06:17:00.895-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5830000 2016-03-24T06:17:00.95-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1480000 QueuedCount 50000 2016-03-24T06:17:00.988-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5840000 2016-03-24T06:17:01.08-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5850000 2016-03-24T06:17:01.099-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1490000 QueuedCount 50000 2016-03-24T06:17:01.173-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5860000 2016-03-24T06:17:01.293-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5870000 2016-03-24T06:17:01.425-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5880000 2016-03-24T06:17:01.551-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5890000 2016-03-24T06:17:01.682-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5900000 2016-03-24T06:17:01.734-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:01.782-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1500000 QueuedCount 50000 2016-03-24T06:17:01.786-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5910000 2016-03-24T06:17:01.879-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5920000 2016-03-24T06:17:01.92-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1510000 QueuedCount 50000 2016-03-24T06:17:01.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5930000 2016-03-24T06:17:02.087-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5940000 2016-03-24T06:17:02.218-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5950000 2016-03-24T06:17:02.347-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5960000 2016-03-24T06:17:02.474-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5970000 2016-03-24T06:17:02.562-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1520000 QueuedCount 46130 2016-03-24T06:17:02.605-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5980000 2016-03-24T06:17:02.673-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1530000 QueuedCount 36130 2016-03-24T06:17:02.737-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 5990000 2016-03-24T06:17:02.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6000000 2016-03-24T06:17:03.003-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6010000 2016-03-24T06:17:03.131-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6020000 2016-03-24T06:17:03.266-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6030000 2016-03-24T06:17:03.271-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1540000 QueuedCount 26130 2016-03-24T06:17:03.382-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1550000 QueuedCount 16130 2016-03-24T06:17:03.402-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6040000 2016-03-24T06:17:03.539-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6050000 2016-03-24T06:17:03.67-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6060000 2016-03-24T06:17:03.804-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6070000 2016-03-24T06:17:03.95-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6080000 2016-03-24T06:17:03.971-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1560000 QueuedCount 6130 2016-03-24T06:17:04.097-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6090000 2016-03-24T06:17:04.228-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6100000 2016-03-24T06:17:04.364-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6110000 2016-03-24T06:17:04.442-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.025µs CommitTime 309.157131ms TotalFlushTime 1m11.113953576s TotalCommitTime 5.90768847s 2016-03-24T06:17:04.442-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1566130, 1566130, 14 committed:true 2016-03-24T06:17:04.442-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1566130, 1566130, 14 committed:true) SnapCreateDur 319.783597ms SnapOpenDur 43.663µs 2016-03-24T06:17:04.477-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:04.483-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6120000 2016-03-24T06:17:04.512-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:04.546-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:04.558-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6130000 2016-03-24T06:17:04.562-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1570000 QueuedCount 38273 2016-03-24T06:17:04.622-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6140000 2016-03-24T06:17:04.634-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:04.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6150000 2016-03-24T06:17:04.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6160000 2016-03-24T06:17:04.845-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6170000 2016-03-24T06:17:04.949-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6180000 2016-03-24T06:17:05.06-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6190000 2016-03-24T06:17:05.172-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6200000 2016-03-24T06:17:05.288-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6210000 2016-03-24T06:17:05.402-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6220000 2016-03-24T06:17:05.516-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6230000 2016-03-24T06:17:05.63-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6240000 2016-03-24T06:17:05.697-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1580000 QueuedCount 50000 2016-03-24T06:17:05.728-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6250000 2016-03-24T06:17:05.824-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6260000 2016-03-24T06:17:05.935-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6270000 2016-03-24T06:17:06.049-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6280000 2016-03-24T06:17:06.163-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6290000 2016-03-24T06:17:06.285-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6300000 2016-03-24T06:17:06.403-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6310000 2016-03-24T06:17:06.521-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6320000 2016-03-24T06:17:06.639-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6330000 2016-03-24T06:17:06.756-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6340000 2016-03-24T06:17:06.871-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6350000 2016-03-24T06:17:06.905-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:06.909-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1590000 QueuedCount 49692 2016-03-24T06:17:06.961-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6360000 2016-03-24T06:17:07.064-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6370000 2016-03-24T06:17:07.153-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1600000 QueuedCount 50000 2016-03-24T06:17:07.168-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6380000 2016-03-24T06:17:07.264-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6390000 2016-03-24T06:17:07.38-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6400000 2016-03-24T06:17:07.501-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6410000 2016-03-24T06:17:07.624-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6420000 2016-03-24T06:17:07.747-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6430000 2016-03-24T06:17:07.877-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6440000 2016-03-24T06:17:08.007-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6450000 2016-03-24T06:17:08.139-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6460000 2016-03-24T06:17:08.271-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6470000 2016-03-24T06:17:08.292-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1610000 QueuedCount 45445 2016-03-24T06:17:08.401-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6480000 2016-03-24T06:17:08.429-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1620000 QueuedCount 35445 2016-03-24T06:17:08.524-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6490000 2016-03-24T06:17:08.636-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6500000 2016-03-24T06:17:08.75-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6510000 2016-03-24T06:17:08.863-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6520000 2016-03-24T06:17:08.977-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6530000 2016-03-24T06:17:09.093-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6540000 2016-03-24T06:17:09.121-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1630000 QueuedCount 25445 2016-03-24T06:17:09.211-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6550000 2016-03-24T06:17:09.247-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1640000 QueuedCount 15445 2016-03-24T06:17:09.338-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6560000 2016-03-24T06:17:09.478-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6570000 2016-03-24T06:17:09.607-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6580000 2016-03-24T06:17:09.743-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6590000 2016-03-24T06:17:09.873-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6600000 2016-03-24T06:17:09.906-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1650000 QueuedCount 5445 2016-03-24T06:17:10.008-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6610000 2016-03-24T06:17:10.14-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6620000 2016-03-24T06:17:10.252-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 4.395µs CommitTime 277.506758ms TotalFlushTime 1m16.499663646s TotalCommitTime 6.185195228s 2016-03-24T06:17:10.252-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1655445, 1655445, 15 committed:true 2016-03-24T06:17:10.252-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1655445, 1655445, 15 committed:true) SnapCreateDur 287.730275ms SnapOpenDur 56.917µs 2016-03-24T06:17:10.277-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6630000 2016-03-24T06:17:10.286-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:10.322-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:10.352-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6640000 2016-03-24T06:17:10.357-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:10.389-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1660000 QueuedCount 47825 2016-03-24T06:17:10.391-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:10.422-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6650000 2016-03-24T06:17:10.479-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6660000 2016-03-24T06:17:10.538-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6670000 2016-03-24T06:17:10.605-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6680000 2016-03-24T06:17:10.655-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1670000 QueuedCount 50000 2016-03-24T06:17:10.686-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6690000 2016-03-24T06:17:10.727-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:10.778-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6700000 2016-03-24T06:17:10.903-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6710000 2016-03-24T06:17:11.037-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6720000 2016-03-24T06:17:11.17-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6730000 2016-03-24T06:17:11.306-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6740000 2016-03-24T06:17:11.439-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6750000 2016-03-24T06:17:11.573-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6760000 2016-03-24T06:17:11.649-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1680000 QueuedCount 50000 2016-03-24T06:17:11.672-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6770000 2016-03-24T06:17:11.741-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:11.772-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6780000 2016-03-24T06:17:11.791-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1690000 QueuedCount 50000 2016-03-24T06:17:11.864-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6790000 2016-03-24T06:17:11.992-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6800000 2016-03-24T06:17:12.138-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6810000 2016-03-24T06:17:12.288-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6820000 2016-03-24T06:17:12.433-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6830000 2016-03-24T06:17:12.581-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6840000 2016-03-24T06:17:12.735-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6850000 2016-03-24T06:17:12.87-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6860000 2016-03-24T06:17:12.9-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1700000 QueuedCount 50000 2016-03-24T06:17:12.913-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:12.968-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6870000 2016-03-24T06:17:13.056-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1710000 QueuedCount 50000 2016-03-24T06:17:13.062-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6880000 2016-03-24T06:17:13.184-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6890000 2016-03-24T06:17:13.32-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6900000 2016-03-24T06:17:13.456-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6910000 2016-03-24T06:17:13.581-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6920000 2016-03-24T06:17:13.707-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6930000 2016-03-24T06:17:13.775-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1720000 QueuedCount 42660 2016-03-24T06:17:13.842-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6940000 2016-03-24T06:17:13.899-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1730000 QueuedCount 32660 2016-03-24T06:17:13.983-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6950000 2016-03-24T06:17:14.128-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6960000 2016-03-24T06:17:14.263-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6970000 2016-03-24T06:17:14.39-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6980000 2016-03-24T06:17:14.52-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 6990000 2016-03-24T06:17:14.553-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1740000 QueuedCount 22660 2016-03-24T06:17:14.651-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7000000 2016-03-24T06:17:14.678-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1750000 QueuedCount 12660 2016-03-24T06:17:14.785-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7010000 2016-03-24T06:17:14.925-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7020000 2016-03-24T06:17:15.062-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7030000 2016-03-24T06:17:15.206-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7040000 2016-03-24T06:17:15.31-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1760000 QueuedCount 2660 2016-03-24T06:17:15.349-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7050000 2016-03-24T06:17:15.489-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7060000 2016-03-24T06:17:15.625-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7070000 2016-03-24T06:17:15.764-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7080000 2016-03-24T06:17:15.847-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.496µs CommitTime 475.986323ms TotalFlushTime 1m21.438342252s TotalCommitTime 6.661181551s 2016-03-24T06:17:15.847-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1762660, 1762660, 16 committed:true 2016-03-24T06:17:15.847-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1762660, 1762660, 16 committed:true) SnapCreateDur 501.892012ms SnapOpenDur 75.906µs 2016-03-24T06:17:15.882-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:15.89-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7090000 2016-03-24T06:17:15.914-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:15.949-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:15.965-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7100000 2016-03-24T06:17:15.987-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:16.035-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7110000 2016-03-24T06:17:16.065-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1770000 QueuedCount 50000 2016-03-24T06:17:16.104-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7120000 2016-03-24T06:17:16.167-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7130000 2016-03-24T06:17:16.199-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:16.241-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7140000 2016-03-24T06:17:16.322-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7150000 2016-03-24T06:17:16.333-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1780000 QueuedCount 50000 2016-03-24T06:17:16.413-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7160000 2016-03-24T06:17:16.551-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7170000 2016-03-24T06:17:16.683-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7180000 2016-03-24T06:17:16.816-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7190000 2016-03-24T06:17:16.951-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7200000 2016-03-24T06:17:17.085-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7210000 2016-03-24T06:17:17.221-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7220000 2016-03-24T06:17:17.304-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:17.311-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1790000 QueuedCount 49445 2016-03-24T06:17:17.315-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7230000 2016-03-24T06:17:17.401-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7240000 2016-03-24T06:17:17.454-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1800000 QueuedCount 50000 2016-03-24T06:17:17.493-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7250000 2016-03-24T06:17:17.503-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:17.627-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7260000 2016-03-24T06:17:17.768-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7270000 2016-03-24T06:17:17.911-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7280000 2016-03-24T06:17:18.049-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7290000 2016-03-24T06:17:18.155-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7300000 2016-03-24T06:17:18.187-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1810000 QueuedCount 50000 2016-03-24T06:17:18.256-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7310000 2016-03-24T06:17:18.356-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7320000 2016-03-24T06:17:18.361-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:18.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7330000 2016-03-24T06:17:18.512-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1820000 QueuedCount 50000 2016-03-24T06:17:18.598-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7340000 2016-03-24T06:17:18.716-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7350000 2016-03-24T06:17:18.849-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7360000 2016-03-24T06:17:18.967-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7370000 2016-03-24T06:17:19.085-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7380000 2016-03-24T06:17:19.204-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7390000 2016-03-24T06:17:19.328-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7400000 2016-03-24T06:17:19.452-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7410000 2016-03-24T06:17:19.568-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7420000 2016-03-24T06:17:19.623-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1830000 QueuedCount 49284 2016-03-24T06:17:19.676-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7430000 2016-03-24T06:17:19.867-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1840000 QueuedCount 39284 2016-03-24T06:17:20.779-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1850000 QueuedCount 29284 2016-03-24T06:17:20.906-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1860000 QueuedCount 19284 2016-03-24T06:17:21.596-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1870000 QueuedCount 9284 2016-03-24T06:17:22.181-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 6.989µs CommitTime 445.629525ms TotalFlushTime 1m27.118614079s TotalCommitTime 7.106811076s 2016-03-24T06:17:22.181-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1879284, 1879284, 17 committed:true 2016-03-24T06:17:22.181-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1879284, 1879284, 17 committed:true) SnapCreateDur 458.024588ms SnapOpenDur 52.073µs 2016-03-24T06:17:22.228-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1880000 QueuedCount 28251 2016-03-24T06:17:22.233-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:22.28-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7440000 2016-03-24T06:17:22.338-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7450000 2016-03-24T06:17:22.398-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7460000 2016-03-24T06:17:22.461-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7470000 2016-03-24T06:17:22.466-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:22.489-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1890000 QueuedCount 50000 2016-03-24T06:17:22.531-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7480000 2016-03-24T06:17:22.597-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7490000 2016-03-24T06:17:22.677-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7500000 2016-03-24T06:17:23.578-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1900000 QueuedCount 50000 2016-03-24T06:17:23.645-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:23.729-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1910000 QueuedCount 50000 2016-03-24T06:17:23.738-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7510000 2016-03-24T06:17:24.127-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7520000 2016-03-24T06:17:24.164-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1920000 QueuedCount 48852 2016-03-24T06:17:25.181-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1930000 QueuedCount 38852 2016-03-24T06:17:25.318-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1940000 QueuedCount 28852 2016-03-24T06:17:26.021-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1950000 QueuedCount 18852 2016-03-24T06:17:26.167-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1960000 QueuedCount 8852 2016-03-24T06:17:27.549-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 14.513µs CommitTime 703.018891ms TotalFlushTime 1m31.613019547s TotalCommitTime 7.809829967s 2016-03-24T06:17:27.549-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 1968852, 1968852, 18 committed:true 2016-03-24T06:17:27.549-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 1968852, 1968852, 18 committed:true) SnapCreateDur 735.178518ms SnapOpenDur 63.554µs 2016-03-24T06:17:27.589-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:27.608-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1970000 QueuedCount 14584 2016-03-24T06:17:27.629-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:27.642-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7530000 2016-03-24T06:17:27.703-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:27.709-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7540000 2016-03-24T06:17:27.774-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7550000 2016-03-24T06:17:27.836-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7560000 2016-03-24T06:17:27.908-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1980000 QueuedCount 50000 2016-03-24T06:17:27.913-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7570000 2016-03-24T06:17:27.992-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7580000 2016-03-24T06:17:28.103-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:28.186-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7590000 2016-03-24T06:17:29.141-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 1990000 QueuedCount 50000 2016-03-24T06:17:29.272-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:29.346-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7600000 2016-03-24T06:17:29.373-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2000000 QueuedCount 50000 2016-03-24T06:17:29.718-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7610000 2016-03-24T06:17:30.621-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2010000 QueuedCount 48845 2016-03-24T06:17:31.702-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2020000 QueuedCount 38845 2016-03-24T06:17:32.422-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2030000 QueuedCount 28845 2016-03-24T06:17:33.716-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2040000 QueuedCount 18845 2016-03-24T06:17:33.867-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2050000 QueuedCount 8845 2016-03-24T06:17:34.79-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 879 2016-03-24T06:17:34.82-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 879 2016-03-24T06:17:34.85-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 879 2016-03-24T06:17:34.88-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 879 2016-03-24T06:17:34.91-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 879 2016-03-24T06:17:34.939-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.59µs CommitTime 350.137114ms TotalFlushTime 1m38.433287009s TotalCommitTime 8.159967081s 2016-03-24T06:17:34.939-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2058845, 2058845, 19 committed:true 2016-03-24T06:17:34.94-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2058845, 2058845, 19 committed:true) SnapCreateDur 362.368902ms SnapOpenDur 35.719µs 2016-03-24T06:17:34.94-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 879 2016-03-24T06:17:34.99-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2060000 QueuedCount 10164 2016-03-24T06:17:35.024-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7620000 2016-03-24T06:17:35.269-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2070000 QueuedCount 164 2016-03-24T06:17:36.045-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.82µs CommitTime 746.244982ms TotalFlushTime 1m38.731034769s TotalCommitTime 8.906212063s 2016-03-24T06:17:36.045-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2070164, 2070164, 20 committed:true 2016-03-24T06:17:36.045-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2070164, 2070164, 20 committed:true) SnapCreateDur 771.025912ms SnapOpenDur 74.651µs 2016-03-24T06:17:36.086-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:36.1-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7630000 2016-03-24T06:17:36.125-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:36.163-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:36.178-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7640000 2016-03-24T06:17:36.24-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7650000 2016-03-24T06:17:36.303-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7660000 2016-03-24T06:17:36.324-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2080000 QueuedCount 50000 2016-03-24T06:17:36.366-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7670000 2016-03-24T06:17:36.43-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:36.434-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7680000 2016-03-24T06:17:36.58-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2090000 QueuedCount 50000 2016-03-24T06:17:37.491-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7690000 2016-03-24T06:17:37.564-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:37.632-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2100000 QueuedCount 50000 2016-03-24T06:17:37.935-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2110000 QueuedCount 50000 2016-03-24T06:17:38.862-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:38.883-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7700000 2016-03-24T06:17:39.062-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2120000 QueuedCount 50000 2016-03-24T06:17:39.154-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7710000 2016-03-24T06:17:39.212-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:39.221-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7720000 2016-03-24T06:17:39.364-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2130000 QueuedCount 50000 2016-03-24T06:17:40.399-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7730000 2016-03-24T06:17:40.521-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7740000 2016-03-24T06:17:40.541-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:40.544-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2140000 QueuedCount 49898 2016-03-24T06:17:40.8-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7750000 2016-03-24T06:17:40.871-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2150000 QueuedCount 50000 2016-03-24T06:17:42.06-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2160000 QueuedCount 45602 2016-03-24T06:17:42.312-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2170000 QueuedCount 35602 2016-03-24T06:17:43.251-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2180000 QueuedCount 25602 2016-03-24T06:17:43.38-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2190000 QueuedCount 15602 2016-03-24T06:17:44.071-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2200000 QueuedCount 5602 2016-03-24T06:17:44.597-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.866µs CommitTime 441.373363ms TotalFlushTime 1m46.488106259s TotalCommitTime 9.347585426s 2016-03-24T06:17:44.598-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2205602, 2205602, 21 committed:true 2016-03-24T06:17:44.598-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2205602, 2205602, 21 committed:true) SnapCreateDur 453.648019ms SnapOpenDur 47.648µs 2016-03-24T06:17:44.635-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:44.647-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7760000 2016-03-24T06:17:44.668-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:44.703-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:44.717-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7770000 2016-03-24T06:17:44.735-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2210000 QueuedCount 49962 2016-03-24T06:17:44.75-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:44.785-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7780000 2016-03-24T06:17:44.847-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7790000 2016-03-24T06:17:44.906-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7800000 2016-03-24T06:17:44.968-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7810000 2016-03-24T06:17:44.998-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2220000 QueuedCount 50000 2016-03-24T06:17:45.129-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7820000 2016-03-24T06:17:45.149-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:46.183-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2230000 QueuedCount 50000 2016-03-24T06:17:46.396-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7830000 2016-03-24T06:17:46.493-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:46.499-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2240000 QueuedCount 49763 2016-03-24T06:17:46.638-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7840000 2016-03-24T06:17:47.617-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2250000 QueuedCount 50000 2016-03-24T06:17:47.691-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7850000 2016-03-24T06:17:47.763-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2260000 QueuedCount 45985 2016-03-24T06:17:48.473-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2270000 QueuedCount 35985 2016-03-24T06:17:48.595-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2280000 QueuedCount 25985 2016-03-24T06:17:49.168-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2290000 QueuedCount 15985 2016-03-24T06:17:49.269-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2300000 QueuedCount 5985 2016-03-24T06:17:49.894-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.687µs CommitTime 543.268371ms TotalFlushTime 1m51.025899743s TotalCommitTime 9.890853797s 2016-03-24T06:17:49.894-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2305985, 2305985, 22 committed:true 2016-03-24T06:17:49.894-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2305985, 2305985, 22 committed:true) SnapCreateDur 552.715989ms SnapOpenDur 62.042µs 2016-03-24T06:17:49.933-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:49.969-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:49.971-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2310000 QueuedCount 27462 2016-03-24T06:17:49.979-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7860000 2016-03-24T06:17:50.003-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:50.037-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:50.048-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7870000 2016-03-24T06:17:50.119-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7880000 2016-03-24T06:17:50.18-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7890000 2016-03-24T06:17:50.182-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2320000 QueuedCount 50000 2016-03-24T06:17:50.243-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7900000 2016-03-24T06:17:50.31-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7910000 2016-03-24T06:17:50.387-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7920000 2016-03-24T06:17:51.251-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7930000 2016-03-24T06:17:51.265-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2330000 QueuedCount 50000 2016-03-24T06:17:51.356-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:51.364-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7940000 2016-03-24T06:17:51.584-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2340000 QueuedCount 50000 2016-03-24T06:17:51.802-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7950000 2016-03-24T06:17:52.714-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2350000 QueuedCount 50000 2016-03-24T06:17:52.986-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2360000 QueuedCount 50000 2016-03-24T06:17:53.024-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:17:53.094-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7960000 2016-03-24T06:17:54.031-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2370000 QueuedCount 50000 2016-03-24T06:17:54.209-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7970000 2016-03-24T06:17:54.318-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2380000 QueuedCount 50000 2016-03-24T06:17:54.448-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7980000 2016-03-24T06:17:55.913-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5741412134,"bucket-1:by_email_name_street:avg_ts_items_count":97366,"bucket-1:by_email_name_street:build_progress":12,"bucket-1:by_email_name_street:data_size":882443513,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":1794924544,"bucket-1:by_email_name_street:flush_queue_size":46948,"bucket-1:by_email_name_street:frag_percent":50,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":365581231,"bucket-1:by_email_name_street:items_count":2305985,"bucket-1:by_email_name_street:num_commits":22,"bucket-1:by_email_name_street:num_compactions":1,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":2411329,"bucket-1:by_email_name_street:num_docs_pending":12010062,"bucket-1:by_email_name_street:num_docs_queued":5578609,"bucket-1:by_email_name_street:num_flush_queued":2434855,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":22,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5296454501,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"22 9890853797 5196264413487996769","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"2387907 20156418206 142241439140346014","bucket-1:by_email_name_street:timings/storage_handle_open":"22 828629 35489445633","bucket-1:by_email_name_street:timings/storage_info":"89 1579427 280903446997","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"22 9420907 4991877966043","bucket-1:by_email_name_street:timings/storage_meta_set":"22 11302727 7207424238227","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"4775814 93837644616 -3954030183472685406","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5555081,"bucket-1:num_mutations_queued":7989936,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":371,"memory_quota":104857600000,"memory_used":2756476928,"needs_restart":false,"num_connections":0,"timings/stats_response":"1438 171253437 657158328368373"} 2016-03-24T06:17:58.092-07:00 [Info] CompactionDaemon: Finished compacting index instance:1061207747814546192 2016-03-24T06:17:58.141-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2390000 QueuedCount 44855 2016-03-24T06:17:58.393-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2400000 QueuedCount 34855 2016-03-24T06:17:59.394-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2410000 QueuedCount 24855 2016-03-24T06:17:59.524-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2420000 QueuedCount 14855 2016-03-24T06:17:59.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 911 2016-03-24T06:17:59.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 911 2016-03-24T06:17:59.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 911 2016-03-24T06:17:59.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 911 2016-03-24T06:17:59.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 911 2016-03-24T06:17:59.676-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 911 2016-03-24T06:17:59.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 911 2016-03-24T06:17:59.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 911 2016-03-24T06:17:59.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 911 2016-03-24T06:17:59.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 911 2016-03-24T06:17:59.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 911 2016-03-24T06:17:59.856-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 911 2016-03-24T06:17:59.886-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 911 2016-03-24T06:17:59.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 911 2016-03-24T06:17:59.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 911 2016-03-24T06:17:59.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 911 2016-03-24T06:18:00.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 911 2016-03-24T06:18:00.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 911 2016-03-24T06:18:00.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 911 2016-03-24T06:18:00.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 911 2016-03-24T06:18:00.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 911 2016-03-24T06:18:00.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 911 2016-03-24T06:18:00.186-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 911 2016-03-24T06:18:00.216-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 911 2016-03-24T06:18:00.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 911 2016-03-24T06:18:00.264-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2430000 QueuedCount 4855 2016-03-24T06:18:00.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 911 2016-03-24T06:18:00.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 911 2016-03-24T06:18:00.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 911 2016-03-24T06:18:00.366-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 911 2016-03-24T06:18:00.396-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 911 2016-03-24T06:18:00.426-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 911 2016-03-24T06:18:00.456-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 911 2016-03-24T06:18:00.486-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 911 2016-03-24T06:18:00.516-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 911 2016-03-24T06:18:00.546-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 911 2016-03-24T06:18:00.563-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.628µs CommitTime 241.828106ms TotalFlushTime 2m1.134719712s TotalCommitTime 10.132681903s 2016-03-24T06:18:00.564-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2434855, 2434855, 23 committed:true 2016-03-24T06:18:00.564-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2434855, 2434855, 23 committed:true) SnapCreateDur 251.501372ms SnapOpenDur 55.734µs 2016-03-24T06:18:00.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 911 2016-03-24T06:18:00.607-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 7990000 2016-03-24T06:18:00.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2440000 QueuedCount 8503 2016-03-24T06:18:01.702-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 9.32µs CommitTime 746.59056ms TotalFlushTime 2m1.4604457s TotalCommitTime 10.879272463s 2016-03-24T06:18:01.702-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2448503, 2448503, 24 committed:true 2016-03-24T06:18:01.702-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2448503, 2448503, 24 committed:true) SnapCreateDur 771.670288ms SnapOpenDur 54.206µs 2016-03-24T06:18:01.742-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:01.774-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2450000 QueuedCount 22040 2016-03-24T06:18:01.779-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8000000 2016-03-24T06:18:01.783-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:01.807-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:01.857-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:01.872-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8010000 2016-03-24T06:18:01.953-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8020000 2016-03-24T06:18:02.033-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8030000 2016-03-24T06:18:02.1-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2460000 QueuedCount 50000 2016-03-24T06:18:02.121-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8040000 2016-03-24T06:18:02.17-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:02.212-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8050000 2016-03-24T06:18:03.426-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2470000 QueuedCount 50000 2016-03-24T06:18:03.462-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8060000 2016-03-24T06:18:03.592-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:03.618-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2480000 QueuedCount 50000 2016-03-24T06:18:03.623-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8070000 2016-03-24T06:18:03.807-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:03.841-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8080000 2016-03-24T06:18:04.873-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2490000 QueuedCount 50000 2016-03-24T06:18:05.015-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:05.031-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2500000 QueuedCount 48888 2016-03-24T06:18:05.056-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8090000 2016-03-24T06:18:06.152-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2510000 QueuedCount 50000 2016-03-24T06:18:06.197-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:06.298-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8100000 2016-03-24T06:18:06.451-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2520000 QueuedCount 50000 2016-03-24T06:18:06.583-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8110000 2016-03-24T06:18:06.761-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2530000 QueuedCount 46070 2016-03-24T06:18:07.782-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2540000 QueuedCount 36070 2016-03-24T06:18:07.919-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2550000 QueuedCount 26070 2016-03-24T06:18:08.647-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2560000 QueuedCount 16070 2016-03-24T06:18:08.775-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2570000 QueuedCount 6070 2016-03-24T06:18:09.973-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 11.293µs CommitTime 617.616475ms TotalFlushTime 2m8.774227302s TotalCommitTime 11.496888938s 2016-03-24T06:18:09.973-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2576070, 2576070, 25 committed:true 2016-03-24T06:18:09.973-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2576070, 2576070, 25 committed:true) SnapCreateDur 642.795413ms SnapOpenDur 86.58µs 2016-03-24T06:18:10.016-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:10.06-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:10.062-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8120000 2016-03-24T06:18:10.102-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:10.122-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2580000 QueuedCount 38619 2016-03-24T06:18:10.151-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8130000 2016-03-24T06:18:10.207-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:10.229-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8140000 2016-03-24T06:18:10.301-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8150000 2016-03-24T06:18:10.379-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8160000 2016-03-24T06:18:10.414-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2590000 QueuedCount 50000 2016-03-24T06:18:10.456-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8170000 2016-03-24T06:18:10.534-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8180000 2016-03-24T06:18:11.363-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:11.408-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2600000 QueuedCount 50000 2016-03-24T06:18:11.417-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8190000 2016-03-24T06:18:11.714-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2610000 QueuedCount 50000 2016-03-24T06:18:12.773-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2620000 QueuedCount 42249 2016-03-24T06:18:12.904-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2630000 QueuedCount 32249 2016-03-24T06:18:13.607-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2640000 QueuedCount 22249 2016-03-24T06:18:13.713-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2650000 QueuedCount 12249 2016-03-24T06:18:14.316-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2660000 QueuedCount 2249 2016-03-24T06:18:14.589-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.794µs CommitTime 232.64592ms TotalFlushTime 2m12.958758874s TotalCommitTime 11.729534858s 2016-03-24T06:18:14.589-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2662249, 2662249, 26 committed:true 2016-03-24T06:18:14.589-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2662249, 2662249, 26 committed:true) SnapCreateDur 242.475309ms SnapOpenDur 32.499µs 2016-03-24T06:18:14.626-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:14.643-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8200000 2016-03-24T06:18:14.662-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:14.699-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:14.711-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8210000 2016-03-24T06:18:14.772-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8220000 2016-03-24T06:18:14.81-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2670000 QueuedCount 50000 2016-03-24T06:18:14.83-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8230000 2016-03-24T06:18:14.89-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8240000 2016-03-24T06:18:14.951-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8250000 2016-03-24T06:18:15.017-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8260000 2016-03-24T06:18:15.081-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2680000 QueuedCount 50000 2016-03-24T06:18:15.223-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8270000 2016-03-24T06:18:16.13-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:16.262-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2690000 QueuedCount 50000 2016-03-24T06:18:16.596-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8280000 2016-03-24T06:18:16.675-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2700000 QueuedCount 50000 2016-03-24T06:18:17.841-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8290000 2016-03-24T06:18:17.905-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2710000 QueuedCount 50000 2016-03-24T06:18:17.97-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:18.084-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8300000 2016-03-24T06:18:18.222-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2720000 QueuedCount 50000 2016-03-24T06:18:19.419-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8310000 2016-03-24T06:18:19.499-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2730000 QueuedCount 50000 2016-03-24T06:18:19.795-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2740000 QueuedCount 44648 2016-03-24T06:18:20.806-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2750000 QueuedCount 34648 2016-03-24T06:18:20.939-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2760000 QueuedCount 24648 2016-03-24T06:18:21.666-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2770000 QueuedCount 14648 2016-03-24T06:18:21.79-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2780000 QueuedCount 4648 2016-03-24T06:18:22.494-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 10.425µs CommitTime 633.858572ms TotalFlushTime 2m19.883979008s TotalCommitTime 12.36339343s 2016-03-24T06:18:22.494-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2784648, 2784648, 27 committed:true 2016-03-24T06:18:22.494-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2784648, 2784648, 27 committed:true) SnapCreateDur 643.751026ms SnapOpenDur 50.486µs 2016-03-24T06:18:22.527-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:22.559-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:22.581-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8320000 2016-03-24T06:18:22.591-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:22.623-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:22.65-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2790000 QueuedCount 45358 2016-03-24T06:18:22.651-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8330000 2016-03-24T06:18:22.713-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8340000 2016-03-24T06:18:22.731-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:22.778-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8350000 2016-03-24T06:18:22.837-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8360000 2016-03-24T06:18:22.898-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8370000 2016-03-24T06:18:22.912-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2800000 QueuedCount 50000 2016-03-24T06:18:22.957-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8380000 2016-03-24T06:18:23.889-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8390000 2016-03-24T06:18:23.942-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2810000 QueuedCount 50000 2016-03-24T06:18:24.015-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8400000 2016-03-24T06:18:24.032-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:24.273-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2820000 QueuedCount 50000 2016-03-24T06:18:24.274-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8410000 2016-03-24T06:18:25.55-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2830000 QueuedCount 48004 2016-03-24T06:18:25.709-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2840000 QueuedCount 38004 2016-03-24T06:18:26.453-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2850000 QueuedCount 28004 2016-03-24T06:18:26.585-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2860000 QueuedCount 18004 2016-03-24T06:18:27.22-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2870000 QueuedCount 8004 2016-03-24T06:18:27.736-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 5.683µs CommitTime 416.032215ms TotalFlushTime 2m24.50427453s TotalCommitTime 12.779425645s 2016-03-24T06:18:27.736-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2878004, 2878004, 28 committed:true 2016-03-24T06:18:27.736-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2878004, 2878004, 28 committed:true) SnapCreateDur 425.881934ms SnapOpenDur 50.18µs 2016-03-24T06:18:27.773-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:27.808-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:27.813-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2880000 QueuedCount 28073 2016-03-24T06:18:27.828-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8420000 2016-03-24T06:18:27.85-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:27.897-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8430000 2016-03-24T06:18:27.945-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2890000 QueuedCount 50000 2016-03-24T06:18:27.959-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8440000 2016-03-24T06:18:28.001-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:28.024-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8450000 2016-03-24T06:18:28.086-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8460000 2016-03-24T06:18:28.092-07:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 1061207747814546192 Data:1080291755, Disk:2395529216, ExtraSnapshotData:0, Fragmentation:54.90383720705162% 2016-03-24T06:18:28.092-07:00 [Info] CompactionDaemon: Compacting index instance:1061207747814546192 2016-03-24T06:18:28.113-07:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 2448503. Slice Id 0, IndexInstId 1061207747814546192, IndexDefnId 1061207747814546192 2016-03-24T06:18:28.159-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8470000 2016-03-24T06:18:29.251-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2900000 QueuedCount 50000 2016-03-24T06:18:29.343-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8480000 2016-03-24T06:18:29.567-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8490000 2016-03-24T06:18:29.582-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2910000 QueuedCount 50000 2016-03-24T06:18:29.59-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:29.883-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8500000 2016-03-24T06:18:30.813-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2920000 QueuedCount 50000 2016-03-24T06:18:30.963-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2930000 QueuedCount 42433 2016-03-24T06:18:31.74-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2940000 QueuedCount 32433 2016-03-24T06:18:31.848-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2950000 QueuedCount 22433 2016-03-24T06:18:32.495-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2960000 QueuedCount 12433 2016-03-24T06:18:32.603-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2970000 QueuedCount 2433 2016-03-24T06:18:33.093-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 6.538µs CommitTime 447.036403ms TotalFlushTime 2m29.220737286s TotalCommitTime 13.226462048s 2016-03-24T06:18:33.093-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 2972433, 2972433, 29 committed:true 2016-03-24T06:18:33.093-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 2972433, 2972433, 29 committed:true) SnapCreateDur 456.944147ms SnapOpenDur 51.062µs 2016-03-24T06:18:33.126-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:33.159-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8510000 2016-03-24T06:18:33.161-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:33.199-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:33.229-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8520000 2016-03-24T06:18:33.234-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:33.299-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8530000 2016-03-24T06:18:33.312-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2980000 QueuedCount 50000 2016-03-24T06:18:33.364-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8540000 2016-03-24T06:18:33.434-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8550000 2016-03-24T06:18:33.506-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8560000 2016-03-24T06:18:33.577-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8570000 2016-03-24T06:18:33.579-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:33.584-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 2990000 QueuedCount 49796 2016-03-24T06:18:35.235-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3000000 QueuedCount 50000 2016-03-24T06:18:35.271-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8580000 2016-03-24T06:18:35.364-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:35.58-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3010000 QueuedCount 50000 2016-03-24T06:18:36.206-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8590000 2016-03-24T06:18:36.355-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3020000 QueuedCount 48501 2016-03-24T06:18:36.606-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3030000 QueuedCount 38501 2016-03-24T06:18:38.058-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3040000 QueuedCount 28501 2016-03-24T06:18:38.237-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3050000 QueuedCount 18501 2016-03-24T06:18:39.218-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3060000 QueuedCount 8501 2016-03-24T06:18:40.372-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 14.83µs CommitTime 1.018125926s TotalFlushTime 2m35.252592723s TotalCommitTime 14.244587974s 2016-03-24T06:18:40.372-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3068501, 3068501, 30 committed:true 2016-03-24T06:18:40.372-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3068501, 3068501, 30 committed:true) SnapCreateDur 1.043219915s SnapOpenDur 72.297µs 2016-03-24T06:18:40.432-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3070000 QueuedCount 12972 2016-03-24T06:18:40.48-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8600000 2016-03-24T06:18:40.682-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3080000 QueuedCount 2972 2016-03-24T06:18:41.585-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.827µs CommitTime 800.844551ms TotalFlushTime 2m35.600401211s TotalCommitTime 15.045432525s 2016-03-24T06:18:41.585-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3082972, 3082972, 31 committed:true 2016-03-24T06:18:41.585-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3082972, 3082972, 31 committed:true) SnapCreateDur 825.673296ms SnapOpenDur 48.662µs 2016-03-24T06:18:41.621-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:41.659-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:41.664-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8610000 2016-03-24T06:18:41.697-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:41.723-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3090000 QueuedCount 44446 2016-03-24T06:18:41.736-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8620000 2016-03-24T06:18:41.793-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8630000 2016-03-24T06:18:41.811-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:41.856-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8640000 2016-03-24T06:18:41.916-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8650000 2016-03-24T06:18:41.966-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3100000 QueuedCount 50000 2016-03-24T06:18:41.97-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8660000 2016-03-24T06:18:42.03-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8670000 2016-03-24T06:18:43.17-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8680000 2016-03-24T06:18:43.177-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3110000 QueuedCount 50000 2016-03-24T06:18:43.179-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:43.265-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8690000 2016-03-24T06:18:43.684-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3120000 QueuedCount 50000 2016-03-24T06:18:44.359-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8700000 2016-03-24T06:18:45.387-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:45.473-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3130000 QueuedCount 50000 2016-03-24T06:18:45.56-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8710000 2016-03-24T06:18:45.941-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3140000 QueuedCount 50000 2016-03-24T06:18:47.6-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3150000 QueuedCount 41487 2016-03-24T06:18:47.742-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3160000 QueuedCount 31487 2016-03-24T06:18:48.455-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3170000 QueuedCount 21487 2016-03-24T06:18:48.582-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3180000 QueuedCount 11487 2016-03-24T06:18:49.21-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3190000 QueuedCount 1487 2016-03-24T06:18:49.548-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.357µs CommitTime 302.983682ms TotalFlushTime 2m43.065243316s TotalCommitTime 15.348416207s 2016-03-24T06:18:49.548-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3191487, 3191487, 32 committed:true 2016-03-24T06:18:49.548-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3191487, 3191487, 32 committed:true) SnapCreateDur 313.332035ms SnapOpenDur 62.313µs 2016-03-24T06:18:49.597-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:49.616-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8720000 2016-03-24T06:18:49.644-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:49.68-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3200000 QueuedCount 50000 2016-03-24T06:18:49.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8730000 2016-03-24T06:18:49.749-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8740000 2016-03-24T06:18:49.816-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8750000 2016-03-24T06:18:49.825-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:49.884-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8760000 2016-03-24T06:18:49.895-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3210000 QueuedCount 50000 2016-03-24T06:18:49.949-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8770000 2016-03-24T06:18:51.071-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:51.089-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3220000 QueuedCount 48724 2016-03-24T06:18:51.189-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8780000 2016-03-24T06:18:51.317-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3230000 QueuedCount 49602 2016-03-24T06:18:52.486-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3240000 QueuedCount 39602 2016-03-24T06:18:52.664-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3250000 QueuedCount 29602 2016-03-24T06:18:53.699-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3260000 QueuedCount 19602 2016-03-24T06:18:53.828-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3270000 QueuedCount 9602 2016-03-24T06:18:54.771-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 10.547µs CommitTime 285.432385ms TotalFlushTime 2m47.850382551s TotalCommitTime 15.633848592s 2016-03-24T06:18:54.771-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3279602, 3279602, 33 committed:true 2016-03-24T06:18:54.771-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3279602, 3279602, 33 committed:true) SnapCreateDur 295.583198ms SnapOpenDur 42.295µs 2016-03-24T06:18:54.804-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:54.81-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3280000 QueuedCount 10314 2016-03-24T06:18:54.828-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8790000 2016-03-24T06:18:54.839-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:54.882-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:54.904-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8800000 2016-03-24T06:18:54.962-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8810000 2016-03-24T06:18:55.096-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3290000 QueuedCount 50000 2016-03-24T06:18:55.106-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:55.402-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3300000 QueuedCount 50000 2016-03-24T06:18:55.914-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5563164247,"bucket-1:by_email_name_street:avg_ts_items_count":85074,"bucket-1:by_email_name_street:build_progress":16,"bucket-1:by_email_name_street:data_size":1227173019,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":3026944000,"bucket-1:by_email_name_street:flush_queue_size":50028,"bucket-1:by_email_name_street:frag_percent":59,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":505195692,"bucket-1:by_email_name_street:items_count":3279602,"bucket-1:by_email_name_street:num_commits":33,"bucket-1:by_email_name_street:num_compactions":2,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":3340358,"bucket-1:by_email_name_street:num_docs_pending":11180715,"bucket-1:by_email_name_street:num_docs_queued":5478927,"bucket-1:by_email_name_street:num_flush_queued":3350110,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":33,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5222892672,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"33 15633848592 8873621137752407874","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"3300083 31633602997 7080299617713992349","bucket-1:by_email_name_street:timings/storage_handle_open":"33 1207429 49341064195","bucket-1:by_email_name_street:timings/storage_info":"133 2406818 362494206382","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"34 14804921 7652819783373","bucket-1:by_email_name_street:timings/storage_meta_set":"33 16318569 10041434517877","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"6600164 133524524409 1521207259688091623","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5469200,"bucket-1:num_mutations_queued":8819283,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":395,"memory_quota":104857600000,"memory_used":2049138688,"needs_restart":false,"num_connections":0,"timings/stats_response":"1510 199442771 668604349802413"} 2016-03-24T06:18:56.528-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:18:56.578-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8820000 2016-03-24T06:18:56.674-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3310000 QueuedCount 50000 2016-03-24T06:18:56.763-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8830000 2016-03-24T06:18:56.983-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3320000 QueuedCount 48925 2016-03-24T06:18:58.114-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3330000 QueuedCount 38925 2016-03-24T06:18:58.265-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3340000 QueuedCount 28925 2016-03-24T06:18:58.973-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3350000 QueuedCount 18925 2016-03-24T06:18:59.09-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3360000 QueuedCount 8925 2016-03-24T06:19:01.213-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.796µs CommitTime 670.401801ms TotalFlushTime 2m53.399743313s TotalCommitTime 16.304250393s 2016-03-24T06:19:01.213-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3368925, 3368925, 34 committed:true 2016-03-24T06:19:01.213-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3368925, 3368925, 34 committed:true) SnapCreateDur 687.703303ms SnapOpenDur 73.805µs 2016-03-24T06:19:01.249-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:01.261-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3370000 QueuedCount 13076 2016-03-24T06:19:01.267-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8840000 2016-03-24T06:19:01.281-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:01.313-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:01.344-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8850000 2016-03-24T06:19:01.346-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:01.39-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:01.413-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8860000 2016-03-24T06:19:01.438-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3380000 QueuedCount 50000 2016-03-24T06:19:01.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8870000 2016-03-24T06:19:01.532-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8880000 2016-03-24T06:19:01.599-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8890000 2016-03-24T06:19:02.559-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:02.561-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3390000 QueuedCount 49913 2016-03-24T06:19:02.653-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8900000 2016-03-24T06:19:02.714-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3400000 QueuedCount 50000 2016-03-24T06:19:02.776-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8910000 2016-03-24T06:19:03.48-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3410000 QueuedCount 43420 2016-03-24T06:19:04.207-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3420000 QueuedCount 33420 2016-03-24T06:19:04.454-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3430000 QueuedCount 23420 2016-03-24T06:19:05.332-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3440000 QueuedCount 13420 2016-03-24T06:19:05.458-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3450000 QueuedCount 3420 2016-03-24T06:19:06.242-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.183µs CommitTime 208.067407ms TotalFlushTime 2m58.092418679s TotalCommitTime 16.5123178s 2016-03-24T06:19:06.242-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3453420, 3453420, 35 committed:true 2016-03-24T06:19:06.242-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3453420, 3453420, 35 committed:true) SnapCreateDur 218.245208ms SnapOpenDur 48.144µs 2016-03-24T06:19:06.276-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:06.313-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:06.334-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8920000 2016-03-24T06:19:06.349-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:06.405-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8930000 2016-03-24T06:19:06.434-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3460000 QueuedCount 50000 2016-03-24T06:19:06.443-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:06.475-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8940000 2016-03-24T06:19:06.534-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8950000 2016-03-24T06:19:06.683-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8960000 2016-03-24T06:19:06.719-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3470000 QueuedCount 50000 2016-03-24T06:19:06.868-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8970000 2016-03-24T06:19:07.843-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:07.925-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3480000 QueuedCount 50000 2016-03-24T06:19:08.075-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8980000 2016-03-24T06:19:08.199-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 8990000 2016-03-24T06:19:08.2-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3490000 QueuedCount 49174 2016-03-24T06:19:09.228-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3500000 QueuedCount 39174 2016-03-24T06:19:09.362-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3510000 QueuedCount 29174 2016-03-24T06:19:10.091-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3520000 QueuedCount 19174 2016-03-24T06:19:10.232-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3530000 QueuedCount 9174 2016-03-24T06:19:11.133-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 9.49µs CommitTime 257.481134ms TotalFlushTime 3m2.552498793s TotalCommitTime 16.769798934s 2016-03-24T06:19:11.133-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3539174, 3539174, 36 committed:true 2016-03-24T06:19:11.133-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3539174, 3539174, 36 committed:true) SnapCreateDur 275.226017ms SnapOpenDur 42.056µs 2016-03-24T06:19:11.167-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3540000 QueuedCount 13548 2016-03-24T06:19:11.17-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:11.187-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9000000 2016-03-24T06:19:11.222-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:11.261-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9010000 2016-03-24T06:19:11.295-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3550000 QueuedCount 50000 2016-03-24T06:19:11.324-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9020000 2016-03-24T06:19:11.387-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9030000 2016-03-24T06:19:11.463-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9040000 2016-03-24T06:19:11.475-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:11.539-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9050000 2016-03-24T06:19:11.624-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9060000 2016-03-24T06:19:12.506-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3560000 QueuedCount 50000 2016-03-24T06:19:12.742-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9070000 2016-03-24T06:19:12.776-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3570000 QueuedCount 50000 2016-03-24T06:19:12.977-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9080000 2016-03-24T06:19:12.98-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:13.99-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3580000 QueuedCount 50000 2016-03-24T06:19:15.145-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9090000 2016-03-24T06:19:15.155-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3590000 QueuedCount 48206 2016-03-24T06:19:15.302-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3600000 QueuedCount 38206 2016-03-24T06:19:16.017-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3610000 QueuedCount 28206 2016-03-24T06:19:16.133-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3620000 QueuedCount 18206 2016-03-24T06:19:16.766-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3630000 QueuedCount 8206 2016-03-24T06:19:18-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.994µs CommitTime 1.106301662s TotalFlushTime 3m8.112664341s TotalCommitTime 17.876100596s 2016-03-24T06:19:18-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3638206, 3638206, 37 committed:true 2016-03-24T06:19:18-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3638206, 3638206, 37 committed:true) SnapCreateDur 1.132384968s SnapOpenDur 51.912µs 2016-03-24T06:19:18.364-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3640000 QueuedCount 9120 2016-03-24T06:19:19.439-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.504µs CommitTime 820.997097ms TotalFlushTime 3m8.668703184s TotalCommitTime 18.697097693s 2016-03-24T06:19:19.439-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3649120, 3649120, 38 committed:true 2016-03-24T06:19:19.439-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3649120, 3649120, 38 committed:true) SnapCreateDur 846.803801ms SnapOpenDur 72.513µs 2016-03-24T06:19:19.474-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:19.485-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3650000 QueuedCount 10313 2016-03-24T06:19:19.51-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:19.542-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9100000 2016-03-24T06:19:19.549-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:19.611-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9110000 2016-03-24T06:19:19.663-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:19.674-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9120000 2016-03-24T06:19:19.739-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9130000 2016-03-24T06:19:19.771-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3660000 QueuedCount 50000 2016-03-24T06:19:19.801-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9140000 2016-03-24T06:19:19.866-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9150000 2016-03-24T06:19:21.054-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3670000 QueuedCount 50000 2016-03-24T06:19:21.068-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9160000 2016-03-24T06:19:21.072-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:21.169-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9170000 2016-03-24T06:19:21.268-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3680000 QueuedCount 50000 2016-03-24T06:19:21.318-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:21.6-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3690000 QueuedCount 50000 2016-03-24T06:19:22.624-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:22.676-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9180000 2016-03-24T06:19:22.73-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3700000 QueuedCount 50000 2016-03-24T06:19:22.86-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9190000 2016-03-24T06:19:22.905-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:23.007-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3710000 QueuedCount 50000 2016-03-24T06:19:24.034-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9200000 2016-03-24T06:19:24.522-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3720000 QueuedCount 50000 2016-03-24T06:19:24.628-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:24.706-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9210000 2016-03-24T06:19:24.852-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3730000 QueuedCount 50000 2016-03-24T06:19:25.988-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9220000 2016-03-24T06:19:26.083-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3740000 QueuedCount 47664 2016-03-24T06:19:26.248-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3750000 QueuedCount 37664 2016-03-24T06:19:27.012-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3760000 QueuedCount 27664 2016-03-24T06:19:27.247-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3770000 QueuedCount 17664 2016-03-24T06:19:28.243-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3780000 QueuedCount 7664 2016-03-24T06:19:29.49-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 15.137µs CommitTime 1.086667469s TotalFlushTime 3m17.283385121s TotalCommitTime 19.783765162s 2016-03-24T06:19:29.49-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3787664, 3787664, 39 committed:true 2016-03-24T06:19:29.49-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3787664, 3787664, 39 committed:true) SnapCreateDur 1.114683093s SnapOpenDur 53.899µs 2016-03-24T06:19:29.526-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:29.552-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9230000 2016-03-24T06:19:29.562-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:29.571-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3790000 QueuedCount 26435 2016-03-24T06:19:29.598-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:29.628-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9240000 2016-03-24T06:19:29.681-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:29.692-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9250000 2016-03-24T06:19:29.752-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9260000 2016-03-24T06:19:29.814-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9270000 2016-03-24T06:19:29.837-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3800000 QueuedCount 50000 2016-03-24T06:19:29.88-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9280000 2016-03-24T06:19:31.082-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3810000 QueuedCount 48994 2016-03-24T06:19:31.224-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3820000 QueuedCount 38994 2016-03-24T06:19:31.94-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3830000 QueuedCount 28994 2016-03-24T06:19:32.067-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3840000 QueuedCount 18994 2016-03-24T06:19:32.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3850000 QueuedCount 8994 2016-03-24T06:19:33.176-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 9.497µs CommitTime 367.922512ms TotalFlushTime 3m20.476445601s TotalCommitTime 20.151687674s 2016-03-24T06:19:33.176-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3858994, 3858994, 40 committed:true 2016-03-24T06:19:33.176-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3858994, 3858994, 40 committed:true) SnapCreateDur 377.360171ms SnapOpenDur 47.278µs 2016-03-24T06:19:33.214-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:33.223-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3860000 QueuedCount 13021 2016-03-24T06:19:33.249-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:33.256-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9290000 2016-03-24T06:19:33.285-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:33.326-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9300000 2016-03-24T06:19:33.385-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9310000 2016-03-24T06:19:33.454-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:33.454-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9320000 2016-03-24T06:19:33.486-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3870000 QueuedCount 50000 2016-03-24T06:19:33.524-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9330000 2016-03-24T06:19:33.59-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9340000 2016-03-24T06:19:33.66-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9350000 2016-03-24T06:19:33.731-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9360000 2016-03-24T06:19:34.806-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3880000 QueuedCount 50000 2016-03-24T06:19:34.824-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:35-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3890000 QueuedCount 50000 2016-03-24T06:19:36.181-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3900000 QueuedCount 44879 2016-03-24T06:19:36.317-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3910000 QueuedCount 34879 2016-03-24T06:19:36.46-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3920000 QueuedCount 24879 2016-03-24T06:19:37.218-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3930000 QueuedCount 14879 2016-03-24T06:19:37.343-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3940000 QueuedCount 4879 2016-03-24T06:19:38.227-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.825µs CommitTime 273.185943ms TotalFlushTime 3m25.101544131s TotalCommitTime 20.424873617s 2016-03-24T06:19:38.228-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 3944879, 3944879, 41 committed:true 2016-03-24T06:19:38.228-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 3944879, 3944879, 41 committed:true) SnapCreateDur 283.206327ms SnapOpenDur 41.255µs 2016-03-24T06:19:38.268-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9370000 2016-03-24T06:19:38.269-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:38.32-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:38.341-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9380000 2016-03-24T06:19:38.421-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9390000 2016-03-24T06:19:38.501-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9400000 2016-03-24T06:19:38.566-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9410000 2016-03-24T06:19:38.58-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3950000 QueuedCount 50000 2016-03-24T06:19:38.632-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9420000 2016-03-24T06:19:38.891-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3960000 QueuedCount 50000 2016-03-24T06:19:38.906-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9430000 2016-03-24T06:19:39.03-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:40.08-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9440000 2016-03-24T06:19:40.153-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3970000 QueuedCount 50000 2016-03-24T06:19:40.389-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:40.462-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3980000 QueuedCount 50000 2016-03-24T06:19:41.629-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 3990000 QueuedCount 48692 2016-03-24T06:19:41.77-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4000000 QueuedCount 38692 2016-03-24T06:19:42.513-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4010000 QueuedCount 28692 2016-03-24T06:19:42.659-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4020000 QueuedCount 18692 2016-03-24T06:19:43.268-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4030000 QueuedCount 8692 2016-03-24T06:19:43.829-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 11.796µs CommitTime 459.126025ms TotalFlushTime 3m30.023489706s TotalCommitTime 20.883999642s 2016-03-24T06:19:43.829-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4038692, 4038692, 42 committed:true 2016-03-24T06:19:43.829-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4038692, 4038692, 42 committed:true) SnapCreateDur 468.868105ms SnapOpenDur 59.5µs 2016-03-24T06:19:43.864-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:43.897-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4040000 QueuedCount 23576 2016-03-24T06:19:43.899-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9450000 2016-03-24T06:19:43.9-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:43.942-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:43.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9460000 2016-03-24T06:19:44.032-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9470000 2016-03-24T06:19:44.092-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9480000 2016-03-24T06:19:44.154-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9490000 2016-03-24T06:19:44.157-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4050000 QueuedCount 50000 2016-03-24T06:19:44.2-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:44.222-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9500000 2016-03-24T06:19:44.285-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9510000 2016-03-24T06:19:44.35-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9520000 2016-03-24T06:19:45.235-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4060000 QueuedCount 50000 2016-03-24T06:19:45.285-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9530000 2016-03-24T06:19:45.315-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:45.371-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4070000 QueuedCount 50000 2016-03-24T06:19:46.555-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4080000 QueuedCount 50000 2016-03-24T06:19:46.563-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:46.7-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9540000 2016-03-24T06:19:46.895-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4090000 QueuedCount 50000 2016-03-24T06:19:47.041-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9550000 2016-03-24T06:19:47.23-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4100000 QueuedCount 49660 2016-03-24T06:19:48.282-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4110000 QueuedCount 39660 2016-03-24T06:19:48.425-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4120000 QueuedCount 29660 2016-03-24T06:19:49.166-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4130000 QueuedCount 19660 2016-03-24T06:19:49.296-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4140000 QueuedCount 9660 2016-03-24T06:19:50.357-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.692µs CommitTime 406.455664ms TotalFlushTime 3m35.908298957s TotalCommitTime 21.290455306s 2016-03-24T06:19:50.357-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4149660, 4149660, 43 committed:true 2016-03-24T06:19:50.357-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4149660, 4149660, 43 committed:true) SnapCreateDur 416.535011ms SnapOpenDur 51.417µs 2016-03-24T06:19:50.392-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:50.425-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:50.437-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9560000 2016-03-24T06:19:50.459-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:50.494-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:50.512-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9570000 2016-03-24T06:19:50.564-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4150000 QueuedCount 50000 2016-03-24T06:19:50.596-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9580000 2016-03-24T06:19:50.679-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9590000 2016-03-24T06:19:50.76-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9600000 2016-03-24T06:19:50.849-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9610000 2016-03-24T06:19:50.937-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9620000 2016-03-24T06:19:51.074-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9630000 2016-03-24T06:19:51.194-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4160000 QueuedCount 50000 2016-03-24T06:19:51.264-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:51.494-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4170000 QueuedCount 50000 2016-03-24T06:19:52.489-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9640000 2016-03-24T06:19:52.551-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:52.616-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4180000 QueuedCount 50000 2016-03-24T06:19:52.699-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9650000 2016-03-24T06:19:52.771-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4190000 QueuedCount 49999 2016-03-24T06:19:54.062-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4200000 QueuedCount 40030 2016-03-24T06:19:54.339-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4210000 QueuedCount 30030 2016-03-24T06:19:55.324-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4220000 QueuedCount 20030 2016-03-24T06:19:55.466-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4230000 QueuedCount 10030 2016-03-24T06:19:55.914-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5956964920,"bucket-1:by_email_name_street:avg_ts_items_count":100075,"bucket-1:by_email_name_street:build_progress":20,"bucket-1:by_email_name_street:data_size":1547924528,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":4300685312,"bucket-1:by_email_name_street:flush_queue_size":8449,"bucket-1:by_email_name_street:frag_percent":64,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":637242195,"bucket-1:by_email_name_street:items_count":4149660,"bucket-1:by_email_name_street:num_commits":43,"bucket-1:by_email_name_street:num_compactions":2,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":4198457,"bucket-1:by_email_name_street:num_docs_pending":10368890,"bucket-1:by_email_name_street:num_docs_queued":5432653,"bucket-1:by_email_name_street:num_flush_queued":4240030,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":43,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":6527674263,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"43 21290455306 -5349309544223044008","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"4231582 40262291867 7170540514938373553","bucket-1:by_email_name_street:timings/storage_handle_open":"43 1535015 60404487159","bucket-1:by_email_name_street:timings/storage_info":"173 2965793 404872936261","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"44 19063871 9793689711361","bucket-1:by_email_name_street:timings/storage_meta_set":"43 21176941 12936528747433","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"8463163 176515389231 9061209929414131131","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5418433,"bucket-1:num_mutations_queued":9658463,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":414,"memory_quota":104857600000,"memory_used":4405567488,"needs_restart":false,"num_connections":0,"timings/stats_response":"1581 227316189 679953392773529"} 2016-03-24T06:19:56.237-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4240000 QueuedCount 30 2016-03-24T06:19:57.068-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 12.79µs CommitTime 801.14772ms TotalFlushTime 3m41.62317112s TotalCommitTime 22.091603026s 2016-03-24T06:19:57.068-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4240030, 4240030, 44 committed:true 2016-03-24T06:19:57.069-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4240030, 4240030, 44 committed:true) SnapCreateDur 826.775588ms SnapOpenDur 73.065µs 2016-03-24T06:19:57.104-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:57.119-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9660000 2016-03-24T06:19:57.139-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:57.175-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:57.192-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9670000 2016-03-24T06:19:57.257-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9680000 2016-03-24T06:19:57.296-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:57.309-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4250000 QueuedCount 49365 2016-03-24T06:19:57.323-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9690000 2016-03-24T06:19:57.38-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9700000 2016-03-24T06:19:57.439-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9710000 2016-03-24T06:19:57.501-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9720000 2016-03-24T06:19:57.567-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9730000 2016-03-24T06:19:57.588-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4260000 QueuedCount 50000 2016-03-24T06:19:58.629-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9740000 2016-03-24T06:19:58.696-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:19:58.756-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4270000 QueuedCount 50000 2016-03-24T06:19:58.837-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9750000 2016-03-24T06:19:58.912-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4280000 QueuedCount 50000 2016-03-24T06:20:00.13-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4290000 QueuedCount 41815 2016-03-24T06:20:00.352-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4300000 QueuedCount 31815 2016-03-24T06:20:01.368-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4310000 QueuedCount 21815 2016-03-24T06:20:01.487-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4320000 QueuedCount 11815 2016-03-24T06:20:02.124-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4330000 QueuedCount 1815 2016-03-24T06:20:02.572-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.896µs CommitTime 417.003117ms TotalFlushTime 3m46.570729459s TotalCommitTime 22.508606143s 2016-03-24T06:20:02.573-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4331815, 4331815, 45 committed:true 2016-03-24T06:20:02.573-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4331815, 4331815, 45 committed:true) SnapCreateDur 427.11094ms SnapOpenDur 50.832µs 2016-03-24T06:20:02.619-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:02.654-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9760000 2016-03-24T06:20:02.716-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9770000 2016-03-24T06:20:02.777-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9780000 2016-03-24T06:20:02.798-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:02.818-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4340000 QueuedCount 49231 2016-03-24T06:20:02.84-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9790000 2016-03-24T06:20:02.903-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9800000 2016-03-24T06:20:02.967-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9810000 2016-03-24T06:20:03.043-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9820000 2016-03-24T06:20:03.11-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4350000 QueuedCount 50000 2016-03-24T06:20:04.158-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9830000 2016-03-24T06:20:04.2-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:04.304-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4360000 QueuedCount 50000 2016-03-24T06:20:04.399-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9840000 2016-03-24T06:20:04.602-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4370000 QueuedCount 50000 2016-03-24T06:20:05.697-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4380000 QueuedCount 41454 2016-03-24T06:20:05.829-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4390000 QueuedCount 31454 2016-03-24T06:20:06.543-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4400000 QueuedCount 21454 2016-03-24T06:20:06.657-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4410000 QueuedCount 11454 2016-03-24T06:20:07.286-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4420000 QueuedCount 1454 2016-03-24T06:20:08.207-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.636µs CommitTime 872.594323ms TotalFlushTime 3m51.130769845s TotalCommitTime 23.381200466s 2016-03-24T06:20:08.207-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4421454, 4421454, 46 committed:true 2016-03-24T06:20:08.207-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4421454, 4421454, 46 committed:true) SnapCreateDur 899.953143ms SnapOpenDur 44.691µs 2016-03-24T06:20:08.246-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:08.287-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:08.309-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9850000 2016-03-24T06:20:08.324-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:08.373-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9860000 2016-03-24T06:20:08.433-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9870000 2016-03-24T06:20:08.44-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4430000 QueuedCount 50000 2016-03-24T06:20:08.499-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9880000 2016-03-24T06:20:08.567-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9890000 2016-03-24T06:20:08.636-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9900000 2016-03-24T06:20:08.702-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9910000 2016-03-24T06:20:08.761-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4440000 QueuedCount 50000 2016-03-24T06:20:08.763-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:08.779-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9920000 2016-03-24T06:20:10.417-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9930000 2016-03-24T06:20:10.528-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4450000 QueuedCount 50000 2016-03-24T06:20:10.57-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:10.842-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4460000 QueuedCount 50000 2016-03-24T06:20:12.036-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4470000 QueuedCount 42973 2016-03-24T06:20:12.192-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4480000 QueuedCount 32973 2016-03-24T06:20:12.958-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4490000 QueuedCount 22973 2016-03-24T06:20:13.094-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4500000 QueuedCount 12973 2016-03-24T06:20:13.758-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4510000 QueuedCount 2973 2016-03-24T06:20:14.792-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 14.35µs CommitTime 973.897904ms TotalFlushTime 3m56.526294678s TotalCommitTime 24.35509837s 2016-03-24T06:20:14.792-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4512973, 4512973, 47 committed:true 2016-03-24T06:20:14.792-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4512973, 4512973, 47 committed:true) SnapCreateDur 999.724861ms SnapOpenDur 61.741µs 2016-03-24T06:20:14.83-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:14.833-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9940000 2016-03-24T06:20:14.87-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:14.904-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:14.908-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9950000 2016-03-24T06:20:14.973-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9960000 2016-03-24T06:20:15.013-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4520000 QueuedCount 50000 2016-03-24T06:20:15.033-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9970000 2016-03-24T06:20:15.095-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9980000 2016-03-24T06:20:15.143-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:15.164-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 9990000 2016-03-24T06:20:15.224-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000000 2016-03-24T06:20:15.289-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10010000 2016-03-24T06:20:15.295-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4530000 QueuedCount 50000 2016-03-24T06:20:15.362-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10020000 2016-03-24T06:20:15.474-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10030000 2016-03-24T06:20:15.598-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10040000 2016-03-24T06:20:15.727-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10050000 2016-03-24T06:20:15.855-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10060000 2016-03-24T06:20:15.984-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10070000 2016-03-24T06:20:16.107-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10080000 2016-03-24T06:20:16.231-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10090000 2016-03-24T06:20:16.361-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10100000 2016-03-24T06:20:16.492-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10110000 2016-03-24T06:20:16.549-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:16.584-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4540000 QueuedCount 50000 2016-03-24T06:20:16.749-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4550000 QueuedCount 50000 2016-03-24T06:20:17.525-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4560000 QueuedCount 40416 2016-03-24T06:20:17.659-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4570000 QueuedCount 30416 2016-03-24T06:20:18.346-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4580000 QueuedCount 20416 2016-03-24T06:20:18.457-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4590000 QueuedCount 10416 2016-03-24T06:20:19.094-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4600000 QueuedCount 416 2016-03-24T06:20:19.428-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.353µs CommitTime 312.266709ms TotalFlushTime 4m0.708184384s TotalCommitTime 24.667365079s 2016-03-24T06:20:19.428-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4600416, 4600416, 48 committed:true 2016-03-24T06:20:19.428-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4600416, 4600416, 48 committed:true) SnapCreateDur 321.70012ms SnapOpenDur 58.365µs 2016-03-24T06:20:19.462-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:19.466-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10120000 2016-03-24T06:20:19.497-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:19.532-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:19.537-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10130000 2016-03-24T06:20:19.58-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:19.713-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4610000 QueuedCount 50000 2016-03-24T06:20:20.037-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4620000 QueuedCount 50000 2016-03-24T06:20:20.044-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:21.789-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4630000 QueuedCount 50000 2016-03-24T06:20:21.957-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:22.112-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4640000 QueuedCount 50000 2016-03-24T06:20:23.254-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4650000 QueuedCount 49797 2016-03-24T06:20:23.393-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4660000 QueuedCount 39797 2016-03-24T06:20:24.182-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4670000 QueuedCount 29797 2016-03-24T06:20:24.309-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4680000 QueuedCount 19797 2016-03-24T06:20:24.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 401 2016-03-24T06:20:24.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 401 2016-03-24T06:20:24.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 401 2016-03-24T06:20:24.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 401 2016-03-24T06:20:24.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 401 2016-03-24T06:20:24.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 401 2016-03-24T06:20:24.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 401 2016-03-24T06:20:24.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 401 2016-03-24T06:20:24.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 401 2016-03-24T06:20:24.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 401 2016-03-24T06:20:24.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 401 2016-03-24T06:20:24.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 401 2016-03-24T06:20:24.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 401 2016-03-24T06:20:24.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 401 2016-03-24T06:20:25.004-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4690000 QueuedCount 9797 2016-03-24T06:20:25.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 401 2016-03-24T06:20:25.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 401 2016-03-24T06:20:25.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 401 2016-03-24T06:20:25.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 401 2016-03-24T06:20:25.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 401 2016-03-24T06:20:25.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 401 2016-03-24T06:20:25.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 401 2016-03-24T06:20:25.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 401 2016-03-24T06:20:25.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 401 2016-03-24T06:20:25.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 401 2016-03-24T06:20:25.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 401 2016-03-24T06:20:25.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 401 2016-03-24T06:20:25.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 401 2016-03-24T06:20:25.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 401 2016-03-24T06:20:25.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 401 2016-03-24T06:20:25.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 401 2016-03-24T06:20:25.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 401 2016-03-24T06:20:25.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 401 2016-03-24T06:20:25.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 401 2016-03-24T06:20:25.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 401 2016-03-24T06:20:25.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 401 2016-03-24T06:20:25.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 401 2016-03-24T06:20:25.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 401 2016-03-24T06:20:25.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 401 2016-03-24T06:20:25.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 401 2016-03-24T06:20:25.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 401 2016-03-24T06:20:25.8-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.961µs CommitTime 668.652123ms TotalFlushTime 4m6.161101295s TotalCommitTime 25.336017202s 2016-03-24T06:20:25.8-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4699797, 4699797, 49 committed:true 2016-03-24T06:20:25.8-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4699797, 4699797, 49 committed:true) SnapCreateDur 678.819809ms SnapOpenDur 58.849µs 2016-03-24T06:20:25.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 401 2016-03-24T06:20:25.828-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:25.828-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4700000 QueuedCount 5742 2016-03-24T06:20:25.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 401 2016-03-24T06:20:25.861-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:25.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 401 2016-03-24T06:20:25.906-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10140000 2016-03-24T06:20:25.911-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:25.974-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10150000 2016-03-24T06:20:26.034-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10160000 2016-03-24T06:20:26.095-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10170000 2016-03-24T06:20:26.115-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4710000 QueuedCount 50000 2016-03-24T06:20:26.153-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10180000 2016-03-24T06:20:26.215-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10190000 2016-03-24T06:20:26.279-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10200000 2016-03-24T06:20:26.346-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10210000 2016-03-24T06:20:26.374-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4720000 QueuedCount 50000 2016-03-24T06:20:26.421-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10220000 2016-03-24T06:20:27.305-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:27.395-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4730000 QueuedCount 50000 2016-03-24T06:20:27.525-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4740000 QueuedCount 47007 2016-03-24T06:20:28.216-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4750000 QueuedCount 37007 2016-03-24T06:20:28.33-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4760000 QueuedCount 27007 2016-03-24T06:20:28.987-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4770000 QueuedCount 17007 2016-03-24T06:20:29.101-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4780000 QueuedCount 7007 2016-03-24T06:20:30.453-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 20.483µs CommitTime 697.417163ms TotalFlushTime 4m9.967310112s TotalCommitTime 26.033434365s 2016-03-24T06:20:30.453-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4787007, 4787007, 50 committed:true 2016-03-24T06:20:30.453-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4787007, 4787007, 50 committed:true) SnapCreateDur 722.797259ms SnapOpenDur 57.172µs 2016-03-24T06:20:30.485-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:30.52-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:30.554-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:30.559-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4790000 QueuedCount 34536 2016-03-24T06:20:30.59-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:30.61-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10230000 2016-03-24T06:20:30.672-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10240000 2016-03-24T06:20:30.737-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10250000 2016-03-24T06:20:30.801-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10260000 2016-03-24T06:20:30.837-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4800000 QueuedCount 50000 2016-03-24T06:20:30.864-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10270000 2016-03-24T06:20:30.927-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10280000 2016-03-24T06:20:30.991-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10290000 2016-03-24T06:20:31.053-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10300000 2016-03-24T06:20:31.056-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:31.14-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10310000 2016-03-24T06:20:31.228-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10320000 2016-03-24T06:20:31.318-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10330000 2016-03-24T06:20:32.138-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4810000 QueuedCount 50000 2016-03-24T06:20:32.385-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4820000 QueuedCount 50000 2016-03-24T06:20:32.503-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:33.65-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4830000 QueuedCount 50000 2016-03-24T06:20:33.971-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4840000 QueuedCount 46716 2016-03-24T06:20:35.12-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4850000 QueuedCount 36716 2016-03-24T06:20:35.259-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4860000 QueuedCount 26716 2016-03-24T06:20:36.043-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4870000 QueuedCount 16716 2016-03-24T06:20:36.173-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4880000 QueuedCount 6716 2016-03-24T06:20:36.368-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 419 2016-03-24T06:20:36.398-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 419 2016-03-24T06:20:36.428-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 419 2016-03-24T06:20:36.458-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 419 2016-03-24T06:20:36.488-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 419 2016-03-24T06:20:36.518-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 419 2016-03-24T06:20:36.548-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 419 2016-03-24T06:20:36.578-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 419 2016-03-24T06:20:36.608-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 419 2016-03-24T06:20:36.638-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 419 2016-03-24T06:20:36.668-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 419 2016-03-24T06:20:36.698-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 419 2016-03-24T06:20:36.728-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 419 2016-03-24T06:20:36.758-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 419 2016-03-24T06:20:36.788-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 419 2016-03-24T06:20:36.818-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 419 2016-03-24T06:20:36.848-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 419 2016-03-24T06:20:36.878-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 419 2016-03-24T06:20:36.908-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 419 2016-03-24T06:20:36.938-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 419 2016-03-24T06:20:36.968-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 419 2016-03-24T06:20:36.968-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.63µs CommitTime 683.950812ms TotalFlushTime 4m15.571487913s TotalCommitTime 26.717385177s 2016-03-24T06:20:36.969-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4886716, 4886716, 51 committed:true 2016-03-24T06:20:36.969-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4886716, 4886716, 51 committed:true) SnapCreateDur 694.019959ms SnapOpenDur 57.085µs 2016-03-24T06:20:36.998-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 419 2016-03-24T06:20:37.002-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:37.028-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 419 2016-03-24T06:20:37.036-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:37.077-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:37.087-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4890000 QueuedCount 43472 2016-03-24T06:20:37.134-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10340000 2016-03-24T06:20:37.208-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10350000 2016-03-24T06:20:37.276-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10360000 2016-03-24T06:20:37.337-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10370000 2016-03-24T06:20:37.396-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10380000 2016-03-24T06:20:37.417-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4900000 QueuedCount 50000 2016-03-24T06:20:37.431-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:37.459-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10390000 2016-03-24T06:20:37.53-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10400000 2016-03-24T06:20:37.6-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10410000 2016-03-24T06:20:37.666-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10420000 2016-03-24T06:20:37.748-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10430000 2016-03-24T06:20:37.837-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10440000 2016-03-24T06:20:37.937-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10450000 2016-03-24T06:20:38.039-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10460000 2016-03-24T06:20:38.478-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10470000 2016-03-24T06:20:38.488-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4910000 QueuedCount 50000 2016-03-24T06:20:38.564-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:38.632-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4920000 QueuedCount 50000 2016-03-24T06:20:38.634-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10480000 2016-03-24T06:20:39.418-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10490000 2016-03-24T06:20:39.423-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4930000 QueuedCount 50000 2016-03-24T06:20:39.543-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4940000 QueuedCount 40638 2016-03-24T06:20:40.206-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4950000 QueuedCount 30638 2016-03-24T06:20:40.313-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4960000 QueuedCount 20638 2016-03-24T06:20:41.003-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4970000 QueuedCount 10638 2016-03-24T06:20:41.108-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4980000 QueuedCount 638 2016-03-24T06:20:42.057-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.917µs CommitTime 908.89771ms TotalFlushTime 4m19.590041468s TotalCommitTime 27.626282887s 2016-03-24T06:20:42.057-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 4980638, 4980638, 52 committed:true 2016-03-24T06:20:42.057-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 4980638, 4980638, 52 committed:true) SnapCreateDur 934.231825ms SnapOpenDur 59.362µs 2016-03-24T06:20:42.092-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:42.129-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:42.13-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10500000 2016-03-24T06:20:42.165-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:42.204-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10510000 2016-03-24T06:20:42.271-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10520000 2016-03-24T06:20:42.338-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10530000 2016-03-24T06:20:42.388-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 4990000 QueuedCount 50000 2016-03-24T06:20:42.407-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10540000 2016-03-24T06:20:42.43-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:42.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10550000 2016-03-24T06:20:42.651-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10560000 2016-03-24T06:20:42.677-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5000000 QueuedCount 50000 2016-03-24T06:20:43.781-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:43.81-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.893432% blocked 2016-03-24T06:20:43.847-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5010000 QueuedCount 50000 2016-03-24T06:20:43.975-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10570000 2016-03-24T06:20:44.012-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5020000 QueuedCount 50000 2016-03-24T06:20:44.791-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5030000 QueuedCount 40978 2016-03-24T06:20:44.904-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5040000 QueuedCount 30978 2016-03-24T06:20:45.564-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5050000 QueuedCount 20978 2016-03-24T06:20:45.676-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5060000 QueuedCount 10978 2016-03-24T06:20:46.338-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5070000 QueuedCount 978 2016-03-24T06:20:47.279-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.681µs CommitTime 895.362958ms TotalFlushTime 4m23.744821996s TotalCommitTime 28.521645845s 2016-03-24T06:20:47.279-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5070978, 5070978, 53 committed:true 2016-03-24T06:20:47.279-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5070978, 5070978, 53 committed:true) SnapCreateDur 920.680249ms SnapOpenDur 48.286µs 2016-03-24T06:20:47.314-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:47.33-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.907355% blocked 2016-03-24T06:20:47.33-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.899462% blocked 2016-03-24T06:20:47.331-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.898618% blocked 2016-03-24T06:20:47.349-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:47.384-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:47.475-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5080000 QueuedCount 50000 2016-03-24T06:20:47.661-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:47.71-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10580000 2016-03-24T06:20:47.733-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5090000 QueuedCount 50000 2016-03-24T06:20:47.808-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10590000 2016-03-24T06:20:47.889-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10600000 2016-03-24T06:20:47.97-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10610000 2016-03-24T06:20:48.057-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10620000 2016-03-24T06:20:48.147-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10630000 2016-03-24T06:20:48.24-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10640000 2016-03-24T06:20:48.335-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10650000 2016-03-24T06:20:48.444-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10660000 2016-03-24T06:20:48.566-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10670000 2016-03-24T06:20:48.693-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10680000 2016-03-24T06:20:48.799-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10690000 2016-03-24T06:20:48.865-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5100000 QueuedCount 50000 2016-03-24T06:20:48.891-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10700000 2016-03-24T06:20:48.982-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10710000 2016-03-24T06:20:49.018-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5110000 QueuedCount 50000 2016-03-24T06:20:49.084-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10720000 2016-03-24T06:20:49.21-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10730000 2016-03-24T06:20:49.336-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10740000 2016-03-24T06:20:49.462-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10750000 2016-03-24T06:20:49.593-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10760000 2016-03-24T06:20:49.72-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10770000 2016-03-24T06:20:49.812-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:20:49.816-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10780000 2016-03-24T06:20:49.839-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5120000 QueuedCount 50000 2016-03-24T06:20:49.978-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5130000 QueuedCount 50000 2016-03-24T06:20:54.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 922 2016-03-24T06:20:54.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 922 2016-03-24T06:20:54.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 922 2016-03-24T06:20:54.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 922 2016-03-24T06:20:54.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 922 2016-03-24T06:20:54.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 922 2016-03-24T06:20:55.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 922 2016-03-24T06:20:55.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 922 2016-03-24T06:20:55.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 922 2016-03-24T06:20:55.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 922 2016-03-24T06:20:55.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 922 2016-03-24T06:20:55.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 922 2016-03-24T06:20:55.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 922 2016-03-24T06:20:55.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 922 2016-03-24T06:20:55.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 922 2016-03-24T06:20:55.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 922 2016-03-24T06:20:55.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 922 2016-03-24T06:20:55.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 922 2016-03-24T06:20:55.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 922 2016-03-24T06:20:55.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 922 2016-03-24T06:20:55.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 922 2016-03-24T06:20:55.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 922 2016-03-24T06:20:55.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 922 2016-03-24T06:20:55.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 922 2016-03-24T06:20:55.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 922 2016-03-24T06:20:55.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 922 2016-03-24T06:20:55.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 922 2016-03-24T06:20:55.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 922 2016-03-24T06:20:55.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 922 2016-03-24T06:20:55.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 922 2016-03-24T06:20:55.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 922 2016-03-24T06:20:55.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 922 2016-03-24T06:20:55.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 922 2016-03-24T06:20:55.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 922 2016-03-24T06:20:55.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 922 2016-03-24T06:20:55.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 922 2016-03-24T06:20:55.915-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5356438749,"bucket-1:by_email_name_street:avg_ts_items_count":92467,"bucket-1:by_email_name_street:build_progress":25,"bucket-1:by_email_name_street:data_size":1920308832,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":5847740416,"bucket-1:by_email_name_street:flush_queue_size":50033,"bucket-1:by_email_name_street:frag_percent":67,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":786052098,"bucket-1:by_email_name_street:items_count":5070978,"bucket-1:by_email_name_street:num_commits":53,"bucket-1:by_email_name_street:num_compactions":2,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":5167749,"bucket-1:by_email_name_street:num_docs_pending":9218619,"bucket-1:by_email_name_street:num_docs_queued":5613632,"bucket-1:by_email_name_street:num_flush_queued":5182453,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":53,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5222070621,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"53 28521645845 302873149999571213","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"5132420 47986003148 7170630456265034192","bucket-1:by_email_name_street:timings/storage_handle_open":"53 1882112 72864384060","bucket-1:by_email_name_street:timings/storage_info":"213 4646422 879908848410","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"54 24186348 12706886562928","bucket-1:by_email_name_street:timings/storage_meta_set":"53 27817002 18062036607326","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"10264840 214056672800 -4613349811033361884","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5598958,"bucket-1:num_mutations_queued":10781379,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":424,"memory_quota":104857600000,"memory_used":7350525952,"needs_restart":false,"num_connections":0,"timings/stats_response":"1653 252697141 689205580941679"} 2016-03-24T06:20:55.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 922 2016-03-24T06:20:55.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 922 2016-03-24T06:20:55.967-07:00 [Info] CompactionDaemon: Finished compacting index instance:1061207747814546192 2016-03-24T06:20:55.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 922 2016-03-24T06:20:56.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 922 2016-03-24T06:20:56.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 922 2016-03-24T06:20:56.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 922 2016-03-24T06:20:56.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 922 2016-03-24T06:20:56.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 922 2016-03-24T06:20:56.163-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5140000 QueuedCount 45893 2016-03-24T06:20:56.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 922 2016-03-24T06:20:56.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 922 2016-03-24T06:20:56.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 922 2016-03-24T06:20:56.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 922 2016-03-24T06:20:56.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 922 2016-03-24T06:20:56.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 922 2016-03-24T06:20:56.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 922 2016-03-24T06:20:56.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 922 2016-03-24T06:20:56.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 922 2016-03-24T06:20:56.433-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5150000 QueuedCount 35893 2016-03-24T06:20:56.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 922 2016-03-24T06:20:56.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 922 2016-03-24T06:20:56.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 922 2016-03-24T06:20:56.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 922 2016-03-24T06:20:56.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 922 2016-03-24T06:20:56.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 922 2016-03-24T06:20:56.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 922 2016-03-24T06:20:56.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 922 2016-03-24T06:20:56.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 922 2016-03-24T06:20:56.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 922 2016-03-24T06:20:56.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 922 2016-03-24T06:20:56.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 922 2016-03-24T06:20:56.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 922 2016-03-24T06:20:56.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 922 2016-03-24T06:20:56.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 922 2016-03-24T06:20:56.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 922 2016-03-24T06:20:56.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 922 2016-03-24T06:20:56.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 922 2016-03-24T06:20:56.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 922 2016-03-24T06:20:57.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 922 2016-03-24T06:20:57.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 922 2016-03-24T06:20:57.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 922 2016-03-24T06:20:57.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 922 2016-03-24T06:20:57.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 922 2016-03-24T06:20:57.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 922 2016-03-24T06:20:57.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 922 2016-03-24T06:20:57.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 922 2016-03-24T06:20:57.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 922 2016-03-24T06:20:57.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 922 2016-03-24T06:20:57.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 922 2016-03-24T06:20:57.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 922 2016-03-24T06:20:57.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 922 2016-03-24T06:20:57.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 922 2016-03-24T06:20:57.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 922 2016-03-24T06:20:57.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 922 2016-03-24T06:20:57.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 922 2016-03-24T06:20:57.488-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5160000 QueuedCount 25893 2016-03-24T06:20:57.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 922 2016-03-24T06:20:57.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 922 2016-03-24T06:20:57.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 922 2016-03-24T06:20:57.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 922 2016-03-24T06:20:57.63-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5170000 QueuedCount 15893 2016-03-24T06:20:57.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 922 2016-03-24T06:20:57.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 922 2016-03-24T06:20:57.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 922 2016-03-24T06:20:57.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 922 2016-03-24T06:20:57.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 922 2016-03-24T06:20:57.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 922 2016-03-24T06:20:57.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 922 2016-03-24T06:20:57.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 922 2016-03-24T06:20:57.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 922 2016-03-24T06:20:57.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 922 2016-03-24T06:20:57.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 922 2016-03-24T06:20:57.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 922 2016-03-24T06:20:57.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 922 2016-03-24T06:20:58.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 922 2016-03-24T06:20:58.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 922 2016-03-24T06:20:58.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 922 2016-03-24T06:20:58.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 922 2016-03-24T06:20:58.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 922 2016-03-24T06:20:58.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 922 2016-03-24T06:20:58.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 922 2016-03-24T06:20:58.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 922 2016-03-24T06:20:58.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 922 2016-03-24T06:20:58.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 922 2016-03-24T06:20:58.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 922 2016-03-24T06:20:58.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 922 2016-03-24T06:20:58.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 922 2016-03-24T06:20:58.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 922 2016-03-24T06:20:58.415-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5180000 QueuedCount 5893 2016-03-24T06:20:58.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 922 2016-03-24T06:20:58.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 922 2016-03-24T06:20:58.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 922 2016-03-24T06:20:58.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 922 2016-03-24T06:20:58.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 922 2016-03-24T06:20:58.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 922 2016-03-24T06:20:58.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 922 2016-03-24T06:20:58.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 922 2016-03-24T06:20:58.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 922 2016-03-24T06:20:58.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 922 2016-03-24T06:20:58.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 922 2016-03-24T06:20:58.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 922 2016-03-24T06:20:58.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 922 2016-03-24T06:20:58.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 922 2016-03-24T06:20:58.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 922 2016-03-24T06:20:58.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 922 2016-03-24T06:20:58.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 922 2016-03-24T06:20:58.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 922 2016-03-24T06:20:58.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 922 2016-03-24T06:20:58.997-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.573µs CommitTime 503.458783ms TotalFlushTime 4m34.769787527s TotalCommitTime 29.025104628s 2016-03-24T06:20:58.997-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5185893, 5185893, 54 committed:true 2016-03-24T06:20:58.997-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5185893, 5185893, 54 committed:true) SnapCreateDur 513.209457ms SnapOpenDur 57.991µs 2016-03-24T06:20:59.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 922 2016-03-24T06:20:59.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 922 2016-03-24T06:20:59.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 922 2016-03-24T06:20:59.087-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5190000 QueuedCount 11336 2016-03-24T06:20:59.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 922 2016-03-24T06:20:59.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 922 2016-03-24T06:20:59.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 922 2016-03-24T06:20:59.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 922 2016-03-24T06:20:59.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 922 2016-03-24T06:20:59.254-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5200000 QueuedCount 1336 2016-03-24T06:20:59.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 922 2016-03-24T06:20:59.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 922 2016-03-24T06:20:59.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 922 2016-03-24T06:20:59.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 922 2016-03-24T06:20:59.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 922 2016-03-24T06:20:59.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 922 2016-03-24T06:20:59.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 922 2016-03-24T06:20:59.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 922 2016-03-24T06:20:59.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 922 2016-03-24T06:20:59.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 922 2016-03-24T06:20:59.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 922 2016-03-24T06:20:59.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 922 2016-03-24T06:20:59.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 922 2016-03-24T06:20:59.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 922 2016-03-24T06:20:59.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 922 2016-03-24T06:20:59.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 922 2016-03-24T06:20:59.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 922 2016-03-24T06:20:59.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 922 2016-03-24T06:20:59.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 922 2016-03-24T06:20:59.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 922 2016-03-24T06:20:59.849-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.548µs CommitTime 554.704139ms TotalFlushTime 4m35.014959905s TotalCommitTime 29.579808767s 2016-03-24T06:20:59.849-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5201336, 5201336, 55 committed:true 2016-03-24T06:20:59.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 922 2016-03-24T06:20:59.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 922 2016-03-24T06:20:59.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 922 2016-03-24T06:20:59.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 922 2016-03-24T06:20:59.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 922 2016-03-24T06:21:00.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 922 2016-03-24T06:21:00.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 922 2016-03-24T06:21:00.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 922 2016-03-24T06:21:00.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 922 2016-03-24T06:21:00.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 922 2016-03-24T06:21:00.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 922 2016-03-24T06:21:00.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 922 2016-03-24T06:21:00.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 922 2016-03-24T06:21:00.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 922 2016-03-24T06:21:00.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 922 2016-03-24T06:21:00.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 922 2016-03-24T06:21:00.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 922 2016-03-24T06:21:00.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 922 2016-03-24T06:21:00.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 922 2016-03-24T06:21:00.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 922 2016-03-24T06:21:00.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 922 2016-03-24T06:21:00.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 922 2016-03-24T06:21:00.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 922 2016-03-24T06:21:00.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 922 2016-03-24T06:21:00.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 922 2016-03-24T06:21:00.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 922 2016-03-24T06:21:00.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 922 2016-03-24T06:21:00.66-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5201336, 5201336, 55 committed:true) SnapCreateDur 565.622572ms SnapOpenDur 811.276ms 2016-03-24T06:21:00.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 922 2016-03-24T06:21:00.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 922 2016-03-24T06:21:00.703-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:00.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 922 2016-03-24T06:21:00.743-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:00.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 922 2016-03-24T06:21:00.778-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:00.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 922 2016-03-24T06:21:00.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 922 2016-03-24T06:21:00.818-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5210000 QueuedCount 50000 2016-03-24T06:21:00.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 922 2016-03-24T06:21:00.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 922 2016-03-24T06:21:00.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 922 2016-03-24T06:21:00.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 922 2016-03-24T06:21:00.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 922 2016-03-24T06:21:00.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 922 2016-03-24T06:21:01.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 922 2016-03-24T06:21:01.042-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5220000 QueuedCount 50000 2016-03-24T06:21:01.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 922 2016-03-24T06:21:01.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 922 2016-03-24T06:21:01.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 922 2016-03-24T06:21:01.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 922 2016-03-24T06:21:01.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 922 2016-03-24T06:21:01.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 922 2016-03-24T06:21:01.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 922 2016-03-24T06:21:01.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 922 2016-03-24T06:21:01.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 922 2016-03-24T06:21:01.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 922 2016-03-24T06:21:01.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 922 2016-03-24T06:21:01.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 922 2016-03-24T06:21:01.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 922 2016-03-24T06:21:01.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 922 2016-03-24T06:21:01.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 922 2016-03-24T06:21:01.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 922 2016-03-24T06:21:01.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 922 2016-03-24T06:21:01.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 922 2016-03-24T06:21:01.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 922 2016-03-24T06:21:01.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 922 2016-03-24T06:21:01.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 922 2016-03-24T06:21:01.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 922 2016-03-24T06:21:01.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 922 2016-03-24T06:21:01.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 922 2016-03-24T06:21:01.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 922 2016-03-24T06:21:01.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 922 2016-03-24T06:21:01.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 922 2016-03-24T06:21:01.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 922 2016-03-24T06:21:01.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 922 2016-03-24T06:21:01.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 922 2016-03-24T06:21:01.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 922 2016-03-24T06:21:01.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 922 2016-03-24T06:21:02.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 922 2016-03-24T06:21:02.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 922 2016-03-24T06:21:02.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 922 2016-03-24T06:21:02.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 922 2016-03-24T06:21:02.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 922 2016-03-24T06:21:02.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 922 2016-03-24T06:21:02.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 922 2016-03-24T06:21:02.194-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:02.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 922 2016-03-24T06:21:02.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 922 2016-03-24T06:21:02.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 922 2016-03-24T06:21:02.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 922 2016-03-24T06:21:02.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 922 2016-03-24T06:21:02.367-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5230000 QueuedCount 50000 2016-03-24T06:21:02.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 922 2016-03-24T06:21:02.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 922 2016-03-24T06:21:02.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 922 2016-03-24T06:21:02.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 922 2016-03-24T06:21:02.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 922 2016-03-24T06:21:02.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 922 2016-03-24T06:21:02.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 922 2016-03-24T06:21:02.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 922 2016-03-24T06:21:02.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 922 2016-03-24T06:21:02.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 922 2016-03-24T06:21:02.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 922 2016-03-24T06:21:02.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 922 2016-03-24T06:21:02.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 922 2016-03-24T06:21:02.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 922 2016-03-24T06:21:02.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 922 2016-03-24T06:21:02.812-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5240000 QueuedCount 50000 2016-03-24T06:21:02.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 922 2016-03-24T06:21:02.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 922 2016-03-24T06:21:02.882-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:02.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 922 2016-03-24T06:21:02.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 922 2016-03-24T06:21:02.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 922 2016-03-24T06:21:02.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 922 2016-03-24T06:21:03.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 922 2016-03-24T06:21:03.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 922 2016-03-24T06:21:03.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 922 2016-03-24T06:21:03.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 922 2016-03-24T06:21:03.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 922 2016-03-24T06:21:03.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 922 2016-03-24T06:21:03.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 922 2016-03-24T06:21:03.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 922 2016-03-24T06:21:03.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 922 2016-03-24T06:21:03.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 922 2016-03-24T06:21:03.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 922 2016-03-24T06:21:03.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 922 2016-03-24T06:21:03.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 922 2016-03-24T06:21:03.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 922 2016-03-24T06:21:03.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 922 2016-03-24T06:21:03.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 922 2016-03-24T06:21:03.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 922 2016-03-24T06:21:03.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 922 2016-03-24T06:21:03.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 922 2016-03-24T06:21:03.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 922 2016-03-24T06:21:03.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 922 2016-03-24T06:21:03.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 922 2016-03-24T06:21:03.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 922 2016-03-24T06:21:03.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 922 2016-03-24T06:21:03.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 922 2016-03-24T06:21:03.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 922 2016-03-24T06:21:03.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 922 2016-03-24T06:21:03.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 922 2016-03-24T06:21:03.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 922 2016-03-24T06:21:03.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 922 2016-03-24T06:21:03.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 922 2016-03-24T06:21:03.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 922 2016-03-24T06:21:03.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 922 2016-03-24T06:21:03.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 922 2016-03-24T06:21:04.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 922 2016-03-24T06:21:04.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 922 2016-03-24T06:21:04.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 922 2016-03-24T06:21:04.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 922 2016-03-24T06:21:04.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 922 2016-03-24T06:21:04.155-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5250000 QueuedCount 50000 2016-03-24T06:21:04.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 922 2016-03-24T06:21:04.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 922 2016-03-24T06:21:04.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 922 2016-03-24T06:21:04.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 922 2016-03-24T06:21:04.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 922 2016-03-24T06:21:04.301-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:04.322-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5260000 QueuedCount 48861 2016-03-24T06:21:04.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 922 2016-03-24T06:21:04.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 922 2016-03-24T06:21:04.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 922 2016-03-24T06:21:04.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 922 2016-03-24T06:21:04.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 922 2016-03-24T06:21:04.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 922 2016-03-24T06:21:04.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 922 2016-03-24T06:21:04.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 922 2016-03-24T06:21:04.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 922 2016-03-24T06:21:04.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 922 2016-03-24T06:21:04.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 922 2016-03-24T06:21:04.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 922 2016-03-24T06:21:04.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 922 2016-03-24T06:21:04.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 922 2016-03-24T06:21:04.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 922 2016-03-24T06:21:04.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 922 2016-03-24T06:21:04.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 922 2016-03-24T06:21:04.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 922 2016-03-24T06:21:04.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 922 2016-03-24T06:21:04.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 922 2016-03-24T06:21:04.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 922 2016-03-24T06:21:04.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 922 2016-03-24T06:21:04.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 922 2016-03-24T06:21:05.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 922 2016-03-24T06:21:05.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 922 2016-03-24T06:21:05.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 922 2016-03-24T06:21:05.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 922 2016-03-24T06:21:05.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 922 2016-03-24T06:21:05.152-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5270000 QueuedCount 50000 2016-03-24T06:21:05.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 922 2016-03-24T06:21:05.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15360 Milliseconds Vbucket 922 2016-03-24T06:21:05.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15390 Milliseconds Vbucket 922 2016-03-24T06:21:05.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15420 Milliseconds Vbucket 922 2016-03-24T06:21:05.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15450 Milliseconds Vbucket 922 2016-03-24T06:21:05.291-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5280000 QueuedCount 41658 2016-03-24T06:21:05.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15480 Milliseconds Vbucket 922 2016-03-24T06:21:05.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15510 Milliseconds Vbucket 922 2016-03-24T06:21:05.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15540 Milliseconds Vbucket 922 2016-03-24T06:21:05.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15570 Milliseconds Vbucket 922 2016-03-24T06:21:05.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15600 Milliseconds Vbucket 922 2016-03-24T06:21:05.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15630 Milliseconds Vbucket 922 2016-03-24T06:21:05.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15660 Milliseconds Vbucket 922 2016-03-24T06:21:05.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15690 Milliseconds Vbucket 922 2016-03-24T06:21:05.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15720 Milliseconds Vbucket 922 2016-03-24T06:21:05.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15750 Milliseconds Vbucket 922 2016-03-24T06:21:05.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15780 Milliseconds Vbucket 922 2016-03-24T06:21:05.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15810 Milliseconds Vbucket 922 2016-03-24T06:21:05.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15840 Milliseconds Vbucket 922 2016-03-24T06:21:05.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15870 Milliseconds Vbucket 922 2016-03-24T06:21:05.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15900 Milliseconds Vbucket 922 2016-03-24T06:21:05.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15930 Milliseconds Vbucket 922 2016-03-24T06:21:05.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15960 Milliseconds Vbucket 922 2016-03-24T06:21:05.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15990 Milliseconds Vbucket 922 2016-03-24T06:21:05.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16020 Milliseconds Vbucket 922 2016-03-24T06:21:05.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16050 Milliseconds Vbucket 922 2016-03-24T06:21:05.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16080 Milliseconds Vbucket 922 2016-03-24T06:21:05.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16110 Milliseconds Vbucket 922 2016-03-24T06:21:05.951-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5290000 QueuedCount 31658 2016-03-24T06:21:05.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16140 Milliseconds Vbucket 922 2016-03-24T06:21:06.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16170 Milliseconds Vbucket 922 2016-03-24T06:21:06.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16200 Milliseconds Vbucket 922 2016-03-24T06:21:06.061-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5300000 QueuedCount 21658 2016-03-24T06:21:06.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16230 Milliseconds Vbucket 922 2016-03-24T06:21:06.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16260 Milliseconds Vbucket 922 2016-03-24T06:21:06.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16290 Milliseconds Vbucket 922 2016-03-24T06:21:06.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16320 Milliseconds Vbucket 922 2016-03-24T06:21:06.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16350 Milliseconds Vbucket 922 2016-03-24T06:21:06.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16380 Milliseconds Vbucket 922 2016-03-24T06:21:06.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16410 Milliseconds Vbucket 922 2016-03-24T06:21:06.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16440 Milliseconds Vbucket 922 2016-03-24T06:21:06.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16470 Milliseconds Vbucket 922 2016-03-24T06:21:06.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16500 Milliseconds Vbucket 922 2016-03-24T06:21:06.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16530 Milliseconds Vbucket 922 2016-03-24T06:21:06.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16560 Milliseconds Vbucket 922 2016-03-24T06:21:06.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16590 Milliseconds Vbucket 922 2016-03-24T06:21:06.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16620 Milliseconds Vbucket 922 2016-03-24T06:21:06.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16650 Milliseconds Vbucket 922 2016-03-24T06:21:06.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16680 Milliseconds Vbucket 922 2016-03-24T06:21:06.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16710 Milliseconds Vbucket 922 2016-03-24T06:21:06.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16740 Milliseconds Vbucket 922 2016-03-24T06:21:06.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16770 Milliseconds Vbucket 922 2016-03-24T06:21:06.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16800 Milliseconds Vbucket 922 2016-03-24T06:21:06.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16830 Milliseconds Vbucket 922 2016-03-24T06:21:06.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16860 Milliseconds Vbucket 922 2016-03-24T06:21:06.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5310000 QueuedCount 11658 2016-03-24T06:21:06.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16890 Milliseconds Vbucket 922 2016-03-24T06:21:06.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16920 Milliseconds Vbucket 922 2016-03-24T06:21:06.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16950 Milliseconds Vbucket 922 2016-03-24T06:21:06.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 16980 Milliseconds Vbucket 922 2016-03-24T06:21:06.816-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5320000 QueuedCount 1658 2016-03-24T06:21:06.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17010 Milliseconds Vbucket 922 2016-03-24T06:21:06.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17040 Milliseconds Vbucket 922 2016-03-24T06:21:06.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17070 Milliseconds Vbucket 922 2016-03-24T06:21:06.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17100 Milliseconds Vbucket 922 2016-03-24T06:21:06.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17130 Milliseconds Vbucket 922 2016-03-24T06:21:06.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17160 Milliseconds Vbucket 922 2016-03-24T06:21:07.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17190 Milliseconds Vbucket 922 2016-03-24T06:21:07.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17220 Milliseconds Vbucket 922 2016-03-24T06:21:07.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17250 Milliseconds Vbucket 922 2016-03-24T06:21:07.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17280 Milliseconds Vbucket 922 2016-03-24T06:21:07.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17310 Milliseconds Vbucket 922 2016-03-24T06:21:07.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17340 Milliseconds Vbucket 922 2016-03-24T06:21:07.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17370 Milliseconds Vbucket 922 2016-03-24T06:21:07.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17400 Milliseconds Vbucket 922 2016-03-24T06:21:07.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17430 Milliseconds Vbucket 922 2016-03-24T06:21:07.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17460 Milliseconds Vbucket 922 2016-03-24T06:21:07.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17490 Milliseconds Vbucket 922 2016-03-24T06:21:07.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17520 Milliseconds Vbucket 922 2016-03-24T06:21:07.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17550 Milliseconds Vbucket 922 2016-03-24T06:21:07.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17580 Milliseconds Vbucket 922 2016-03-24T06:21:07.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17610 Milliseconds Vbucket 922 2016-03-24T06:21:07.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17640 Milliseconds Vbucket 922 2016-03-24T06:21:07.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17670 Milliseconds Vbucket 922 2016-03-24T06:21:07.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17700 Milliseconds Vbucket 922 2016-03-24T06:21:07.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17730 Milliseconds Vbucket 922 2016-03-24T06:21:07.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17760 Milliseconds Vbucket 922 2016-03-24T06:21:07.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17790 Milliseconds Vbucket 922 2016-03-24T06:21:07.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17820 Milliseconds Vbucket 922 2016-03-24T06:21:07.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17850 Milliseconds Vbucket 922 2016-03-24T06:21:07.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17880 Milliseconds Vbucket 922 2016-03-24T06:21:07.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17910 Milliseconds Vbucket 922 2016-03-24T06:21:07.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17940 Milliseconds Vbucket 922 2016-03-24T06:21:07.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 17970 Milliseconds Vbucket 922 2016-03-24T06:21:07.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18000 Milliseconds Vbucket 922 2016-03-24T06:21:07.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18030 Milliseconds Vbucket 922 2016-03-24T06:21:07.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18060 Milliseconds Vbucket 922 2016-03-24T06:21:07.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18090 Milliseconds Vbucket 922 2016-03-24T06:21:07.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18120 Milliseconds Vbucket 922 2016-03-24T06:21:07.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18150 Milliseconds Vbucket 922 2016-03-24T06:21:08.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18180 Milliseconds Vbucket 922 2016-03-24T06:21:08.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18210 Milliseconds Vbucket 922 2016-03-24T06:21:08.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18240 Milliseconds Vbucket 922 2016-03-24T06:21:08.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18270 Milliseconds Vbucket 922 2016-03-24T06:21:08.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18300 Milliseconds Vbucket 922 2016-03-24T06:21:08.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18330 Milliseconds Vbucket 922 2016-03-24T06:21:08.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18360 Milliseconds Vbucket 922 2016-03-24T06:21:08.208-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 11.264µs CommitTime 1.341051158s TotalFlushTime 4m40.930782337s TotalCommitTime 30.920859925s 2016-03-24T06:21:08.209-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5321658, 5321658, 56 committed:true 2016-03-24T06:21:08.209-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5321658, 5321658, 56 committed:true) SnapCreateDur 1.369716221s SnapOpenDur 51.085µs 2016-03-24T06:21:08.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18390 Milliseconds Vbucket 922 2016-03-24T06:21:08.243-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:08.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18420 Milliseconds Vbucket 922 2016-03-24T06:21:08.28-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:08.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 18450 Milliseconds Vbucket 922 2016-03-24T06:21:08.32-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:08.378-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:08.393-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10790000 2016-03-24T06:21:08.473-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10800000 2016-03-24T06:21:08.49-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5330000 QueuedCount 50000 2016-03-24T06:21:08.55-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10810000 2016-03-24T06:21:08.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10820000 2016-03-24T06:21:08.768-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10830000 2016-03-24T06:21:08.801-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5340000 QueuedCount 50000 2016-03-24T06:21:08.847-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10840000 2016-03-24T06:21:08.943-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10850000 2016-03-24T06:21:09.049-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10860000 2016-03-24T06:21:09.158-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10870000 2016-03-24T06:21:09.265-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10880000 2016-03-24T06:21:09.363-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10890000 2016-03-24T06:21:09.469-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10900000 2016-03-24T06:21:09.583-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10910000 2016-03-24T06:21:09.698-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10920000 2016-03-24T06:21:09.818-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10930000 2016-03-24T06:21:09.89-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:09.941-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5350000 QueuedCount 50000 2016-03-24T06:21:10.216-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5360000 QueuedCount 50000 2016-03-24T06:21:11.34-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5370000 QueuedCount 40877 2016-03-24T06:21:11.479-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5380000 QueuedCount 30877 2016-03-24T06:21:12.285-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5390000 QueuedCount 20877 2016-03-24T06:21:12.398-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5400000 QueuedCount 10877 2016-03-24T06:21:13.063-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5410000 QueuedCount 877 2016-03-24T06:21:13.491-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.586µs CommitTime 405.136833ms TotalFlushTime 4m45.621390487s TotalCommitTime 31.325996758s 2016-03-24T06:21:13.491-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5410877, 5410877, 57 committed:true 2016-03-24T06:21:13.491-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5410877, 5410877, 57 committed:true) SnapCreateDur 414.666252ms SnapOpenDur 60.77µs 2016-03-24T06:21:13.525-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:13.56-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:13.592-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:13.657-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:13.781-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5420000 QueuedCount 50000 2016-03-24T06:21:14.089-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5430000 QueuedCount 50000 2016-03-24T06:21:14.841-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 936 2016-03-24T06:21:14.871-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 936 2016-03-24T06:21:14.901-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 936 2016-03-24T06:21:14.931-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 936 2016-03-24T06:21:14.961-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 936 2016-03-24T06:21:14.991-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 936 2016-03-24T06:21:15.021-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 936 2016-03-24T06:21:15.051-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 936 2016-03-24T06:21:15.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 936 2016-03-24T06:21:15.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 936 2016-03-24T06:21:15.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 936 2016-03-24T06:21:15.168-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:15.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 936 2016-03-24T06:21:15.201-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 936 2016-03-24T06:21:15.231-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 936 2016-03-24T06:21:15.261-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 936 2016-03-24T06:21:15.291-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 936 2016-03-24T06:21:15.321-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 936 2016-03-24T06:21:15.332-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5440000 QueuedCount 50000 2016-03-24T06:21:15.351-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 936 2016-03-24T06:21:15.381-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 936 2016-03-24T06:21:15.411-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 936 2016-03-24T06:21:15.441-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 936 2016-03-24T06:21:15.471-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 936 2016-03-24T06:21:15.501-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 936 2016-03-24T06:21:15.531-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 936 2016-03-24T06:21:15.561-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 936 2016-03-24T06:21:15.591-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 936 2016-03-24T06:21:15.621-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 936 2016-03-24T06:21:15.644-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5450000 QueuedCount 45373 2016-03-24T06:21:15.651-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 936 2016-03-24T06:21:15.681-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 936 2016-03-24T06:21:15.711-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 936 2016-03-24T06:21:15.741-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 936 2016-03-24T06:21:15.771-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 936 2016-03-24T06:21:15.801-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 936 2016-03-24T06:21:15.831-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 936 2016-03-24T06:21:15.861-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 936 2016-03-24T06:21:15.891-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 936 2016-03-24T06:21:15.921-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 936 2016-03-24T06:21:15.951-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 936 2016-03-24T06:21:15.981-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 936 2016-03-24T06:21:16.011-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 936 2016-03-24T06:21:16.041-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 936 2016-03-24T06:21:16.071-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 936 2016-03-24T06:21:16.101-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 936 2016-03-24T06:21:16.131-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 936 2016-03-24T06:21:16.161-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 936 2016-03-24T06:21:16.191-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 936 2016-03-24T06:21:16.221-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 936 2016-03-24T06:21:16.251-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 936 2016-03-24T06:21:16.281-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 936 2016-03-24T06:21:16.311-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 936 2016-03-24T06:21:16.341-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 936 2016-03-24T06:21:16.371-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 936 2016-03-24T06:21:16.401-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 936 2016-03-24T06:21:16.431-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 936 2016-03-24T06:21:16.461-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 936 2016-03-24T06:21:16.491-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 936 2016-03-24T06:21:16.521-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 936 2016-03-24T06:21:16.551-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 936 2016-03-24T06:21:16.581-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 936 2016-03-24T06:21:16.611-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 936 2016-03-24T06:21:16.641-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 936 2016-03-24T06:21:16.671-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 936 2016-03-24T06:21:16.701-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 936 2016-03-24T06:21:16.731-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 936 2016-03-24T06:21:16.761-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 936 2016-03-24T06:21:16.779-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5460000 QueuedCount 35373 2016-03-24T06:21:16.791-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 936 2016-03-24T06:21:16.821-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 936 2016-03-24T06:21:16.851-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 936 2016-03-24T06:21:16.881-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 936 2016-03-24T06:21:16.911-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 936 2016-03-24T06:21:16.922-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5470000 QueuedCount 25373 2016-03-24T06:21:16.941-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 936 2016-03-24T06:21:16.971-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 936 2016-03-24T06:21:17.001-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 936 2016-03-24T06:21:17.031-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 936 2016-03-24T06:21:17.061-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 936 2016-03-24T06:21:17.091-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 936 2016-03-24T06:21:17.121-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 936 2016-03-24T06:21:17.151-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 936 2016-03-24T06:21:17.181-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 936 2016-03-24T06:21:17.211-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 936 2016-03-24T06:21:17.241-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 936 2016-03-24T06:21:17.271-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 936 2016-03-24T06:21:17.301-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 936 2016-03-24T06:21:17.331-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 936 2016-03-24T06:21:17.361-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 936 2016-03-24T06:21:17.391-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 936 2016-03-24T06:21:17.421-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 936 2016-03-24T06:21:17.451-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 936 2016-03-24T06:21:17.481-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 936 2016-03-24T06:21:17.511-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 936 2016-03-24T06:21:17.541-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 936 2016-03-24T06:21:17.571-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 936 2016-03-24T06:21:17.601-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 936 2016-03-24T06:21:17.618-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5480000 QueuedCount 15373 2016-03-24T06:21:17.631-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 936 2016-03-24T06:21:17.661-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 936 2016-03-24T06:21:17.691-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 936 2016-03-24T06:21:17.721-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 936 2016-03-24T06:21:17.734-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5490000 QueuedCount 5373 2016-03-24T06:21:17.751-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 936 2016-03-24T06:21:17.781-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 936 2016-03-24T06:21:17.811-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 936 2016-03-24T06:21:17.841-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 936 2016-03-24T06:21:17.871-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 936 2016-03-24T06:21:17.901-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 936 2016-03-24T06:21:17.931-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 936 2016-03-24T06:21:17.961-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 936 2016-03-24T06:21:17.991-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 936 2016-03-24T06:21:18.021-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 936 2016-03-24T06:21:18.051-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 936 2016-03-24T06:21:18.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 936 2016-03-24T06:21:18.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 936 2016-03-24T06:21:18.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 936 2016-03-24T06:21:18.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 936 2016-03-24T06:21:18.201-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 936 2016-03-24T06:21:18.231-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 936 2016-03-24T06:21:18.261-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 936 2016-03-24T06:21:18.291-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 936 2016-03-24T06:21:18.321-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 936 2016-03-24T06:21:18.351-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 936 2016-03-24T06:21:18.381-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 936 2016-03-24T06:21:18.411-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 936 2016-03-24T06:21:18.441-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 936 2016-03-24T06:21:18.471-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 936 2016-03-24T06:21:18.501-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 936 2016-03-24T06:21:18.531-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 936 2016-03-24T06:21:18.561-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 936 2016-03-24T06:21:18.591-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 936 2016-03-24T06:21:18.621-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 936 2016-03-24T06:21:18.651-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 936 2016-03-24T06:21:18.681-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 936 2016-03-24T06:21:18.711-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 936 2016-03-24T06:21:18.741-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 936 2016-03-24T06:21:18.771-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 936 2016-03-24T06:21:18.801-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 936 2016-03-24T06:21:18.831-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 936 2016-03-24T06:21:18.861-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 936 2016-03-24T06:21:18.891-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 936 2016-03-24T06:21:18.921-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 936 2016-03-24T06:21:18.951-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 936 2016-03-24T06:21:18.981-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 936 2016-03-24T06:21:19.011-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 936 2016-03-24T06:21:19.016-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 16µs CommitTime 628.358855ms TotalFlushTime 4m50.297176715s TotalCommitTime 31.954355613s 2016-03-24T06:21:19.016-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5495373, 5495373, 58 committed:true 2016-03-24T06:21:19.016-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5495373, 5495373, 58 committed:true) SnapCreateDur 653.8045ms SnapOpenDur 90.711µs 2016-03-24T06:21:19.057-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:19.097-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:19.137-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:19.156-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10940000 2016-03-24T06:21:19.228-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5500000 QueuedCount 50000 2016-03-24T06:21:19.23-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:19.243-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10950000 2016-03-24T06:21:19.317-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10960000 2016-03-24T06:21:19.39-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10970000 2016-03-24T06:21:19.469-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10980000 2016-03-24T06:21:19.532-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5510000 QueuedCount 50000 2016-03-24T06:21:19.546-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 10990000 2016-03-24T06:21:19.621-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11000000 2016-03-24T06:21:19.67-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:19.7-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11010000 2016-03-24T06:21:19.794-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11020000 2016-03-24T06:21:19.891-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11030000 2016-03-24T06:21:19.987-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11040000 2016-03-24T06:21:20.082-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11050000 2016-03-24T06:21:20.178-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11060000 2016-03-24T06:21:20.273-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11070000 2016-03-24T06:21:20.37-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11080000 2016-03-24T06:21:20.58-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5520000 QueuedCount 50000 2016-03-24T06:21:20.709-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:20.739-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5530000 QueuedCount 50000 2016-03-24T06:21:22.063-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5540000 QueuedCount 50000 2016-03-24T06:21:22.22-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5550000 QueuedCount 42157 2016-03-24T06:21:23.017-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5560000 QueuedCount 32157 2016-03-24T06:21:23.151-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5570000 QueuedCount 22157 2016-03-24T06:21:23.812-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5580000 QueuedCount 12157 2016-03-24T06:21:23.917-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5590000 QueuedCount 2157 2016-03-24T06:21:24.757-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.646µs CommitTime 804.720403ms TotalFlushTime 4m55.041857609s TotalCommitTime 32.759076016s 2016-03-24T06:21:24.757-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5592157, 5592157, 59 committed:true 2016-03-24T06:21:24.757-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5592157, 5592157, 59 committed:true) SnapCreateDur 814.842909ms SnapOpenDur 70.171µs 2016-03-24T06:21:24.794-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:24.832-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:24.875-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:25.011-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5600000 QueuedCount 50000 2016-03-24T06:21:25.045-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:25.327-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5610000 QueuedCount 50000 2016-03-24T06:21:25.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 952 2016-03-24T06:21:25.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 952 2016-03-24T06:21:25.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 952 2016-03-24T06:21:25.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 952 2016-03-24T06:21:25.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 952 2016-03-24T06:21:25.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 952 2016-03-24T06:21:25.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 952 2016-03-24T06:21:25.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 952 2016-03-24T06:21:25.967-07:00 [Info] CompactionDaemon: Checking fragmentation, IndexInstId: 1061207747814546192 Data:2112367301, Disk:5917822976, ExtraSnapshotData:0, Fragmentation:64.3049934145242% 2016-03-24T06:21:25.967-07:00 [Info] CompactionDaemon: Compacting index instance:1061207747814546192 2016-03-24T06:21:25.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 952 2016-03-24T06:21:25.99-07:00 [Info] ForestDBSlice::Compact Compacting upto SeqNum 5201336. Slice Id 0, IndexInstId 1061207747814546192, IndexDefnId 1061207747814546192 2016-03-24T06:21:26.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 952 2016-03-24T06:21:26.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 952 2016-03-24T06:21:26.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 952 2016-03-24T06:21:26.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 952 2016-03-24T06:21:26.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 952 2016-03-24T06:21:26.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 952 2016-03-24T06:21:26.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 952 2016-03-24T06:21:26.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 952 2016-03-24T06:21:26.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 952 2016-03-24T06:21:26.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 952 2016-03-24T06:21:26.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 952 2016-03-24T06:21:26.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 952 2016-03-24T06:21:26.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 952 2016-03-24T06:21:26.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 952 2016-03-24T06:21:26.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 952 2016-03-24T06:21:26.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 952 2016-03-24T06:21:26.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 952 2016-03-24T06:21:26.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 952 2016-03-24T06:21:26.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 952 2016-03-24T06:21:26.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 952 2016-03-24T06:21:26.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 952 2016-03-24T06:21:26.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 952 2016-03-24T06:21:26.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 952 2016-03-24T06:21:26.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 952 2016-03-24T06:21:26.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 952 2016-03-24T06:21:26.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 952 2016-03-24T06:21:26.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 952 2016-03-24T06:21:26.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 952 2016-03-24T06:21:26.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 952 2016-03-24T06:21:26.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 952 2016-03-24T06:21:26.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 952 2016-03-24T06:21:26.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 952 2016-03-24T06:21:26.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 952 2016-03-24T06:21:27.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 952 2016-03-24T06:21:27.024-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:27.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 952 2016-03-24T06:21:27.095-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5620000 QueuedCount 50000 2016-03-24T06:21:27.118-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11090000 2016-03-24T06:21:27.182-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11100000 2016-03-24T06:21:27.249-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11110000 2016-03-24T06:21:27.304-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5630000 QueuedCount 50000 2016-03-24T06:21:27.317-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11120000 2016-03-24T06:21:27.391-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11130000 2016-03-24T06:21:27.476-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11140000 2016-03-24T06:21:28.53-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5640000 QueuedCount 42139 2016-03-24T06:21:28.822-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5650000 QueuedCount 32139 2016-03-24T06:21:30.262-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5660000 QueuedCount 22139 2016-03-24T06:21:30.539-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5670000 QueuedCount 12139 2016-03-24T06:21:31.498-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5680000 QueuedCount 2139 2016-03-24T06:21:32.37-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 16.944µs CommitTime 814.416823ms TotalFlushTime 5m1.631701694s TotalCommitTime 33.573492839s 2016-03-24T06:21:32.37-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5682139, 5682139, 60 committed:true 2016-03-24T06:21:32.37-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5682139, 5682139, 60 committed:true) SnapCreateDur 839.933157ms SnapOpenDur 44.485µs 2016-03-24T06:21:32.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 497 2016-03-24T06:21:32.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 497 2016-03-24T06:21:32.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 497 2016-03-24T06:21:32.585-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5690000 QueuedCount 12469 2016-03-24T06:21:32.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 497 2016-03-24T06:21:32.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 497 2016-03-24T06:21:32.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 497 2016-03-24T06:21:32.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 497 2016-03-24T06:21:32.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 497 2016-03-24T06:21:32.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 497 2016-03-24T06:21:32.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 497 2016-03-24T06:21:32.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 497 2016-03-24T06:21:32.843-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5700000 QueuedCount 2469 2016-03-24T06:21:32.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 497 2016-03-24T06:21:32.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 497 2016-03-24T06:21:32.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 497 2016-03-24T06:21:32.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 497 2016-03-24T06:21:32.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 497 2016-03-24T06:21:32.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 497 2016-03-24T06:21:33.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 497 2016-03-24T06:21:33.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 497 2016-03-24T06:21:33.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 497 2016-03-24T06:21:33.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 497 2016-03-24T06:21:33.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 497 2016-03-24T06:21:33.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 497 2016-03-24T06:21:33.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 497 2016-03-24T06:21:33.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 497 2016-03-24T06:21:33.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 497 2016-03-24T06:21:33.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 497 2016-03-24T06:21:33.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 497 2016-03-24T06:21:33.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 497 2016-03-24T06:21:33.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 497 2016-03-24T06:21:33.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 497 2016-03-24T06:21:33.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 497 2016-03-24T06:21:33.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 497 2016-03-24T06:21:33.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 497 2016-03-24T06:21:33.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 497 2016-03-24T06:21:33.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 497 2016-03-24T06:21:33.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 497 2016-03-24T06:21:33.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 497 2016-03-24T06:21:33.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 497 2016-03-24T06:21:33.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 497 2016-03-24T06:21:33.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 497 2016-03-24T06:21:33.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 497 2016-03-24T06:21:33.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 497 2016-03-24T06:21:33.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 497 2016-03-24T06:21:33.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 497 2016-03-24T06:21:33.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 497 2016-03-24T06:21:33.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 497 2016-03-24T06:21:33.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 497 2016-03-24T06:21:33.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 497 2016-03-24T06:21:33.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 497 2016-03-24T06:21:34.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 497 2016-03-24T06:21:34.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 497 2016-03-24T06:21:34.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 497 2016-03-24T06:21:34.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 497 2016-03-24T06:21:34.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 497 2016-03-24T06:21:34.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 497 2016-03-24T06:21:34.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 497 2016-03-24T06:21:34.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 497 2016-03-24T06:21:34.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 497 2016-03-24T06:21:34.263-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 5.616µs CommitTime 1.333695216s TotalFlushTime 5m2.124431128s TotalCommitTime 34.907188055s 2016-03-24T06:21:34.263-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5702469, 5702469, 61 committed:true 2016-03-24T06:21:34.263-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5702469, 5702469, 61 committed:true) SnapCreateDur 1.351109028s SnapOpenDur 51.283µs 2016-03-24T06:21:34.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 497 2016-03-24T06:21:34.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 497 2016-03-24T06:21:34.316-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:34.478-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:34.507-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5710000 QueuedCount 50000 2016-03-24T06:21:34.722-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11150000 2016-03-24T06:21:34.811-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5720000 QueuedCount 50000 2016-03-24T06:21:34.815-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11160000 2016-03-24T06:21:34.879-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11170000 2016-03-24T06:21:34.953-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11180000 2016-03-24T06:21:35.036-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11190000 2016-03-24T06:21:35.122-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11200000 2016-03-24T06:21:35.212-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11210000 2016-03-24T06:21:35.303-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11220000 2016-03-24T06:21:35.402-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11230000 2016-03-24T06:21:36.058-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:36.175-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5730000 QueuedCount 50000 2016-03-24T06:21:36.484-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5740000 QueuedCount 50000 2016-03-24T06:21:36.511-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:38.208-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5750000 QueuedCount 50000 2016-03-24T06:21:38.745-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:39.636-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5760000 QueuedCount 50000 2016-03-24T06:21:40.903-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5770000 QueuedCount 50000 2016-03-24T06:21:41.181-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5780000 QueuedCount 42388 2016-03-24T06:21:43.129-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5790000 QueuedCount 32388 2016-03-24T06:21:43.402-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5800000 QueuedCount 22388 2016-03-24T06:21:44.403-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5810000 QueuedCount 12388 2016-03-24T06:21:44.546-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5820000 QueuedCount 2388 2016-03-24T06:21:44.655-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 966 2016-03-24T06:21:44.685-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 966 2016-03-24T06:21:44.715-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 966 2016-03-24T06:21:44.745-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 966 2016-03-24T06:21:44.775-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 966 2016-03-24T06:21:44.805-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 966 2016-03-24T06:21:44.835-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 966 2016-03-24T06:21:44.865-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 966 2016-03-24T06:21:44.895-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 966 2016-03-24T06:21:44.925-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 966 2016-03-24T06:21:44.955-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 966 2016-03-24T06:21:44.985-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 966 2016-03-24T06:21:45.015-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 966 2016-03-24T06:21:45.045-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 966 2016-03-24T06:21:45.075-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 966 2016-03-24T06:21:45.105-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 966 2016-03-24T06:21:45.135-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 966 2016-03-24T06:21:45.165-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 966 2016-03-24T06:21:45.195-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 966 2016-03-24T06:21:45.225-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 966 2016-03-24T06:21:45.255-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 966 2016-03-24T06:21:45.285-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 966 2016-03-24T06:21:45.315-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 966 2016-03-24T06:21:45.345-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 966 2016-03-24T06:21:45.375-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 966 2016-03-24T06:21:45.405-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 966 2016-03-24T06:21:45.423-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 4.618µs CommitTime 824.190106ms TotalFlushTime 5m12.102168379s TotalCommitTime 35.731378161s 2016-03-24T06:21:45.423-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5822388, 5822388, 62 committed:true 2016-03-24T06:21:45.423-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5822388, 5822388, 62 committed:true) SnapCreateDur 836.626885ms SnapOpenDur 47.251µs 2016-03-24T06:21:45.435-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 966 2016-03-24T06:21:45.48-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11240000 2016-03-24T06:21:45.554-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11250000 2016-03-24T06:21:45.631-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11260000 2016-03-24T06:21:45.643-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5830000 QueuedCount 10805 2016-03-24T06:21:45.704-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11270000 2016-03-24T06:21:45.783-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11280000 2016-03-24T06:21:45.874-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11290000 2016-03-24T06:21:45.9-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5840000 QueuedCount 805 2016-03-24T06:21:45.958-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11300000 2016-03-24T06:21:46.05-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11310000 2016-03-24T06:21:46.141-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11320000 2016-03-24T06:21:46.244-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11330000 2016-03-24T06:21:46.363-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11340000 2016-03-24T06:21:46.502-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11350000 2016-03-24T06:21:46.641-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11360000 2016-03-24T06:21:46.779-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11370000 2016-03-24T06:21:46.913-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11380000 2016-03-24T06:21:47.049-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11390000 2016-03-24T06:21:47.147-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.773µs CommitTime 1.199856153s TotalFlushTime 5m12.558591202s TotalCommitTime 36.931234314s 2016-03-24T06:21:47.147-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5840805, 5840805, 63 committed:true 2016-03-24T06:21:47.147-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5840805, 5840805, 63 committed:true) SnapCreateDur 1.225173243s SnapOpenDur 55.67µs 2016-03-24T06:21:47.182-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11400000 2016-03-24T06:21:47.187-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:47.224-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:47.256-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11410000 2016-03-24T06:21:47.33-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11420000 2016-03-24T06:21:47.409-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11430000 2016-03-24T06:21:47.495-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11440000 2016-03-24T06:21:47.591-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11450000 2016-03-24T06:21:48.036-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:48.277-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5850000 QueuedCount 50000 2016-03-24T06:21:48.664-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5860000 QueuedCount 50000 2016-03-24T06:21:48.696-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:49.736-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5870000 QueuedCount 50000 2016-03-24T06:21:49.948-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5880000 QueuedCount 50000 2016-03-24T06:21:51.06-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:51.19-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5890000 QueuedCount 50000 2016-03-24T06:21:51.35-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5900000 QueuedCount 48367 2016-03-24T06:21:52.166-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5910000 QueuedCount 38367 2016-03-24T06:21:52.311-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5920000 QueuedCount 28367 2016-03-24T06:21:52.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 988 2016-03-24T06:21:52.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 988 2016-03-24T06:21:52.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 988 2016-03-24T06:21:52.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 988 2016-03-24T06:21:52.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 988 2016-03-24T06:21:52.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 988 2016-03-24T06:21:52.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 988 2016-03-24T06:21:52.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 988 2016-03-24T06:21:52.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 988 2016-03-24T06:21:52.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 988 2016-03-24T06:21:52.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 988 2016-03-24T06:21:52.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 988 2016-03-24T06:21:53.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 988 2016-03-24T06:21:53.02-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5930000 QueuedCount 18367 2016-03-24T06:21:53.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 988 2016-03-24T06:21:53.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 988 2016-03-24T06:21:53.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 988 2016-03-24T06:21:53.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 988 2016-03-24T06:21:53.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 988 2016-03-24T06:21:53.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 988 2016-03-24T06:21:53.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 988 2016-03-24T06:21:53.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 988 2016-03-24T06:21:53.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 988 2016-03-24T06:21:53.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 988 2016-03-24T06:21:53.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 988 2016-03-24T06:21:53.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 988 2016-03-24T06:21:53.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 988 2016-03-24T06:21:53.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 988 2016-03-24T06:21:53.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 988 2016-03-24T06:21:53.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 988 2016-03-24T06:21:53.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 988 2016-03-24T06:21:53.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 988 2016-03-24T06:21:53.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 988 2016-03-24T06:21:53.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 988 2016-03-24T06:21:53.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 988 2016-03-24T06:21:53.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 988 2016-03-24T06:21:53.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 988 2016-03-24T06:21:53.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 988 2016-03-24T06:21:53.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 988 2016-03-24T06:21:53.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 988 2016-03-24T06:21:53.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 988 2016-03-24T06:21:53.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 988 2016-03-24T06:21:53.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 988 2016-03-24T06:21:53.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 988 2016-03-24T06:21:53.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 988 2016-03-24T06:21:53.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 988 2016-03-24T06:21:53.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 988 2016-03-24T06:21:54.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 988 2016-03-24T06:21:54.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 988 2016-03-24T06:21:54.072-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5940000 QueuedCount 8367 2016-03-24T06:21:54.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 988 2016-03-24T06:21:54.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 988 2016-03-24T06:21:54.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 988 2016-03-24T06:21:54.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 988 2016-03-24T06:21:54.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 988 2016-03-24T06:21:54.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 988 2016-03-24T06:21:54.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 988 2016-03-24T06:21:54.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 988 2016-03-24T06:21:54.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 988 2016-03-24T06:21:54.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 988 2016-03-24T06:21:54.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 988 2016-03-24T06:21:54.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 988 2016-03-24T06:21:54.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 988 2016-03-24T06:21:54.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 988 2016-03-24T06:21:54.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 988 2016-03-24T06:21:54.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 988 2016-03-24T06:21:54.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 988 2016-03-24T06:21:54.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 988 2016-03-24T06:21:54.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 988 2016-03-24T06:21:54.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 988 2016-03-24T06:21:54.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 988 2016-03-24T06:21:54.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 988 2016-03-24T06:21:54.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 988 2016-03-24T06:21:54.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 988 2016-03-24T06:21:54.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 988 2016-03-24T06:21:54.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 988 2016-03-24T06:21:54.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 988 2016-03-24T06:21:54.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 988 2016-03-24T06:21:54.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 988 2016-03-24T06:21:54.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 988 2016-03-24T06:21:54.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 988 2016-03-24T06:21:55.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 988 2016-03-24T06:21:55.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 988 2016-03-24T06:21:55.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 988 2016-03-24T06:21:55.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 988 2016-03-24T06:21:55.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 988 2016-03-24T06:21:55.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 988 2016-03-24T06:21:55.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 988 2016-03-24T06:21:55.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 988 2016-03-24T06:21:55.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 988 2016-03-24T06:21:55.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 988 2016-03-24T06:21:55.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 988 2016-03-24T06:21:55.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 988 2016-03-24T06:21:55.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 988 2016-03-24T06:21:55.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 988 2016-03-24T06:21:55.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 988 2016-03-24T06:21:55.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 988 2016-03-24T06:21:55.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 988 2016-03-24T06:21:55.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 988 2016-03-24T06:21:55.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 988 2016-03-24T06:21:55.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 988 2016-03-24T06:21:55.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 988 2016-03-24T06:21:55.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 988 2016-03-24T06:21:55.661-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 12.435µs CommitTime 451.740103ms TotalFlushTime 5m20.375074186s TotalCommitTime 37.382974417s 2016-03-24T06:21:55.661-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 5948367, 5948367, 64 committed:true 2016-03-24T06:21:55.661-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 5948367, 5948367, 64 committed:true) SnapCreateDur 464.924791ms SnapOpenDur 51.187µs 2016-03-24T06:21:55.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 988 2016-03-24T06:21:55.7-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:55.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 988 2016-03-24T06:21:55.709-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5950000 QueuedCount 13735 2016-03-24T06:21:55.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 988 2016-03-24T06:21:55.737-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:55.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 988 2016-03-24T06:21:55.774-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:55.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 988 2016-03-24T06:21:55.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 988 2016-03-24T06:21:55.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 988 2016-03-24T06:21:55.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 988 2016-03-24T06:21:55.915-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":6617490097,"bucket-1:by_email_name_street:avg_ts_items_count":80329,"bucket-1:by_email_name_street:build_progress":29,"bucket-1:by_email_name_street:data_size":2227737062,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":6525919232,"bucket-1:by_email_name_street:flush_queue_size":50006,"bucket-1:by_email_name_street:frag_percent":65,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":906094467,"bucket-1:by_email_name_street:items_count":5840805,"bucket-1:by_email_name_street:num_commits":64,"bucket-1:by_email_name_street:num_compactions":3,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":5932475,"bucket-1:by_email_name_street:num_docs_pending":8546148,"bucket-1:by_email_name_street:num_docs_queued":5521377,"bucket-1:by_email_name_street:num_flush_queued":6009205,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":64,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":8514157207,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"64 37382974417 8634035347636349149","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"5959202 61867781769 -632033947505517021","bucket-1:by_email_name_street:timings/storage_handle_open":"64 813472875 658135962118209799","bucket-1:by_email_name_street:timings/storage_info":"257 5447573 962685974263","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"66 30514908 16818513490646","bucket-1:by_email_name_street:timings/storage_meta_set":"64 33345205 21409944431703","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"11918404 253033818629 1972142372578133969","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5444646,"bucket-1:num_mutations_queued":11453850,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":418,"memory_quota":104857600000,"memory_used":3209539584,"needs_restart":false,"num_connections":0,"timings/stats_response":"1725 279160619 699239002919849"} 2016-03-24T06:21:55.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 988 2016-03-24T06:21:55.922-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:55.936-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5960000 QueuedCount 49459 2016-03-24T06:21:55.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 988 2016-03-24T06:21:55.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 988 2016-03-24T06:21:56.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 988 2016-03-24T06:21:56.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 988 2016-03-24T06:21:56.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 988 2016-03-24T06:21:56.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 988 2016-03-24T06:21:56.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 988 2016-03-24T06:21:56.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 988 2016-03-24T06:21:56.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 988 2016-03-24T06:21:56.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 988 2016-03-24T06:21:56.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 988 2016-03-24T06:21:56.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 988 2016-03-24T06:21:56.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 988 2016-03-24T06:21:56.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 988 2016-03-24T06:21:56.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 988 2016-03-24T06:21:56.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 988 2016-03-24T06:21:56.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 988 2016-03-24T06:21:56.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 988 2016-03-24T06:21:56.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 988 2016-03-24T06:21:56.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 988 2016-03-24T06:21:56.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 988 2016-03-24T06:21:56.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 988 2016-03-24T06:21:56.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 988 2016-03-24T06:21:56.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 988 2016-03-24T06:21:56.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 988 2016-03-24T06:21:56.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 988 2016-03-24T06:21:56.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 988 2016-03-24T06:21:56.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 988 2016-03-24T06:21:56.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 988 2016-03-24T06:21:56.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 988 2016-03-24T06:21:56.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 988 2016-03-24T06:21:56.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 988 2016-03-24T06:21:56.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 988 2016-03-24T06:21:56.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 988 2016-03-24T06:21:56.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 988 2016-03-24T06:21:56.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 988 2016-03-24T06:21:57.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 988 2016-03-24T06:21:57.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 988 2016-03-24T06:21:57.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 988 2016-03-24T06:21:57.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 988 2016-03-24T06:21:57.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 988 2016-03-24T06:21:57.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 988 2016-03-24T06:21:57.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 988 2016-03-24T06:21:57.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 988 2016-03-24T06:21:57.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 988 2016-03-24T06:21:57.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 988 2016-03-24T06:21:57.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 988 2016-03-24T06:21:57.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 988 2016-03-24T06:21:57.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 988 2016-03-24T06:21:57.393-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5970000 QueuedCount 50000 2016-03-24T06:21:57.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 988 2016-03-24T06:21:57.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 988 2016-03-24T06:21:57.47-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:21:57.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 988 2016-03-24T06:21:57.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 988 2016-03-24T06:21:57.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 988 2016-03-24T06:21:57.553-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5980000 QueuedCount 50000 2016-03-24T06:21:57.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 988 2016-03-24T06:21:57.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 988 2016-03-24T06:21:57.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 988 2016-03-24T06:21:57.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 988 2016-03-24T06:21:57.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 988 2016-03-24T06:21:57.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 988 2016-03-24T06:21:57.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 988 2016-03-24T06:21:57.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 988 2016-03-24T06:21:57.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 988 2016-03-24T06:21:57.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 988 2016-03-24T06:21:57.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 988 2016-03-24T06:21:57.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 988 2016-03-24T06:21:57.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 988 2016-03-24T06:21:57.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 988 2016-03-24T06:21:57.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 988 2016-03-24T06:21:58.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 988 2016-03-24T06:21:58.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 988 2016-03-24T06:21:58.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 988 2016-03-24T06:21:58.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 988 2016-03-24T06:21:58.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 988 2016-03-24T06:21:58.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 988 2016-03-24T06:21:58.198-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 988 2016-03-24T06:21:58.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 988 2016-03-24T06:21:58.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 988 2016-03-24T06:21:58.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 988 2016-03-24T06:21:58.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 988 2016-03-24T06:21:58.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 988 2016-03-24T06:21:58.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 988 2016-03-24T06:21:58.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 988 2016-03-24T06:21:58.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 988 2016-03-24T06:21:58.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 988 2016-03-24T06:21:58.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 988 2016-03-24T06:21:58.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 988 2016-03-24T06:21:58.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 988 2016-03-24T06:21:58.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 988 2016-03-24T06:21:58.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 988 2016-03-24T06:21:58.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 988 2016-03-24T06:21:58.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 988 2016-03-24T06:21:58.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 988 2016-03-24T06:21:58.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 988 2016-03-24T06:21:58.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 988 2016-03-24T06:21:58.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 988 2016-03-24T06:21:58.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 988 2016-03-24T06:21:58.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 988 2016-03-24T06:21:58.859-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 5990000 QueuedCount 49527 2016-03-24T06:21:58.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 988 2016-03-24T06:21:58.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 988 2016-03-24T06:21:58.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 988 2016-03-24T06:21:58.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 988 2016-03-24T06:21:59.004-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6000000 QueuedCount 39527 2016-03-24T06:21:59.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 988 2016-03-24T06:21:59.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 988 2016-03-24T06:21:59.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 988 2016-03-24T06:21:59.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 988 2016-03-24T06:21:59.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 988 2016-03-24T06:21:59.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 988 2016-03-24T06:21:59.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 988 2016-03-24T06:21:59.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 988 2016-03-24T06:21:59.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 988 2016-03-24T06:21:59.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 988 2016-03-24T06:21:59.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 988 2016-03-24T06:21:59.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 988 2016-03-24T06:21:59.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 988 2016-03-24T06:21:59.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 988 2016-03-24T06:21:59.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 988 2016-03-24T06:21:59.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 988 2016-03-24T06:21:59.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 988 2016-03-24T06:21:59.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 988 2016-03-24T06:21:59.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 988 2016-03-24T06:21:59.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 988 2016-03-24T06:21:59.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 988 2016-03-24T06:21:59.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 988 2016-03-24T06:21:59.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 988 2016-03-24T06:21:59.698-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 988 2016-03-24T06:21:59.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 988 2016-03-24T06:21:59.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 988 2016-03-24T06:21:59.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 988 2016-03-24T06:21:59.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 988 2016-03-24T06:21:59.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 988 2016-03-24T06:21:59.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 988 2016-03-24T06:21:59.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 988 2016-03-24T06:21:59.931-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6010000 QueuedCount 29527 2016-03-24T06:21:59.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 988 2016-03-24T06:21:59.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 988 2016-03-24T06:21:59.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 988 2016-03-24T06:22:00.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 988 2016-03-24T06:22:00.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 988 2016-03-24T06:22:00.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 988 2016-03-24T06:22:00.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 988 2016-03-24T06:22:00.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 988 2016-03-24T06:22:00.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 988 2016-03-24T06:22:00.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 988 2016-03-24T06:22:00.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 988 2016-03-24T06:22:00.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 988 2016-03-24T06:22:00.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 988 2016-03-24T06:22:00.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 988 2016-03-24T06:22:00.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 988 2016-03-24T06:22:00.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 988 2016-03-24T06:22:00.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 988 2016-03-24T06:22:00.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 988 2016-03-24T06:22:00.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 988 2016-03-24T06:22:00.491-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6020000 QueuedCount 19527 2016-03-24T06:22:00.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 988 2016-03-24T06:22:00.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 988 2016-03-24T06:22:00.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 988 2016-03-24T06:22:00.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 988 2016-03-24T06:22:00.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 988 2016-03-24T06:22:00.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 988 2016-03-24T06:22:00.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 988 2016-03-24T06:22:00.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 988 2016-03-24T06:22:00.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 988 2016-03-24T06:22:00.751-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6030000 QueuedCount 9527 2016-03-24T06:22:00.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 988 2016-03-24T06:22:00.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 988 2016-03-24T06:22:00.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 988 2016-03-24T06:22:00.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 988 2016-03-24T06:22:00.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 988 2016-03-24T06:22:00.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 988 2016-03-24T06:22:00.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 988 2016-03-24T06:22:00.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 988 2016-03-24T06:22:01.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 988 2016-03-24T06:22:01.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 988 2016-03-24T06:22:01.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 988 2016-03-24T06:22:01.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 988 2016-03-24T06:22:01.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 988 2016-03-24T06:22:01.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 988 2016-03-24T06:22:01.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 988 2016-03-24T06:22:01.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 988 2016-03-24T06:22:01.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 988 2016-03-24T06:22:01.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 988 2016-03-24T06:22:01.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 988 2016-03-24T06:22:01.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 988 2016-03-24T06:22:01.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 988 2016-03-24T06:22:01.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 988 2016-03-24T06:22:01.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 988 2016-03-24T06:22:01.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 988 2016-03-24T06:22:01.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 988 2016-03-24T06:22:01.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 988 2016-03-24T06:22:01.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 988 2016-03-24T06:22:01.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 988 2016-03-24T06:22:01.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 988 2016-03-24T06:22:01.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 988 2016-03-24T06:22:01.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 988 2016-03-24T06:22:01.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 988 2016-03-24T06:22:01.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 988 2016-03-24T06:22:01.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 988 2016-03-24T06:22:01.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 988 2016-03-24T06:22:01.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 988 2016-03-24T06:22:01.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 988 2016-03-24T06:22:01.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 988 2016-03-24T06:22:01.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 988 2016-03-24T06:22:01.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 988 2016-03-24T06:22:01.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 988 2016-03-24T06:22:02.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 988 2016-03-24T06:22:02.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 988 2016-03-24T06:22:02.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 988 2016-03-24T06:22:02.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 988 2016-03-24T06:22:02.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 988 2016-03-24T06:22:02.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 988 2016-03-24T06:22:02.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 988 2016-03-24T06:22:02.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 988 2016-03-24T06:22:02.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 988 2016-03-24T06:22:02.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 988 2016-03-24T06:22:02.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 988 2016-03-24T06:22:02.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 988 2016-03-24T06:22:02.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 988 2016-03-24T06:22:02.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 988 2016-03-24T06:22:02.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 988 2016-03-24T06:22:02.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 988 2016-03-24T06:22:02.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 988 2016-03-24T06:22:02.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 988 2016-03-24T06:22:02.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 988 2016-03-24T06:22:02.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 988 2016-03-24T06:22:02.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 988 2016-03-24T06:22:02.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 988 2016-03-24T06:22:02.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15030 Milliseconds Vbucket 988 2016-03-24T06:22:02.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15060 Milliseconds Vbucket 988 2016-03-24T06:22:02.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15090 Milliseconds Vbucket 988 2016-03-24T06:22:02.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15120 Milliseconds Vbucket 988 2016-03-24T06:22:02.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15150 Milliseconds Vbucket 988 2016-03-24T06:22:02.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15180 Milliseconds Vbucket 988 2016-03-24T06:22:02.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15210 Milliseconds Vbucket 988 2016-03-24T06:22:02.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15240 Milliseconds Vbucket 988 2016-03-24T06:22:02.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15270 Milliseconds Vbucket 988 2016-03-24T06:22:02.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15300 Milliseconds Vbucket 988 2016-03-24T06:22:02.966-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 15.556µs CommitTime 965.785249ms TotalFlushTime 5m26.492498524s TotalCommitTime 38.348759666s 2016-03-24T06:22:02.966-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6039527, 6039527, 65 committed:true 2016-03-24T06:22:02.966-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6039527, 6039527, 65 committed:true) SnapCreateDur 993.334954ms SnapOpenDur 64.196µs 2016-03-24T06:22:02.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15330 Milliseconds Vbucket 988 2016-03-24T06:22:03.004-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6040000 QueuedCount 14338 2016-03-24T06:22:03.044-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11460000 2016-03-24T06:22:03.127-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11470000 2016-03-24T06:22:03.208-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11480000 2016-03-24T06:22:03.247-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6050000 QueuedCount 4338 2016-03-24T06:22:03.294-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11490000 2016-03-24T06:22:03.385-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11500000 2016-03-24T06:22:03.479-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11510000 2016-03-24T06:22:03.574-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11520000 2016-03-24T06:22:03.669-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11530000 2016-03-24T06:22:03.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11540000 2016-03-24T06:22:03.851-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11550000 2016-03-24T06:22:03.953-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11560000 2016-03-24T06:22:04.055-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11570000 2016-03-24T06:22:04.161-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11580000 2016-03-24T06:22:04.275-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11590000 2016-03-24T06:22:04.391-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11600000 2016-03-24T06:22:04.494-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.69µs CommitTime 1.067364017s TotalFlushTime 5m26.872121909s TotalCommitTime 39.416123683s 2016-03-24T06:22:04.494-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6054338, 6054338, 66 committed:true 2016-03-24T06:22:04.494-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6054338, 6054338, 66 committed:true) SnapCreateDur 1.101336443s SnapOpenDur 38.332µs 2016-03-24T06:22:04.53-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:04.565-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:04.601-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:04.668-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6060000 QueuedCount 50000 2016-03-24T06:22:04.734-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:04.968-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6070000 QueuedCount 50000 2016-03-24T06:22:06.239-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6080000 QueuedCount 50000 2016-03-24T06:22:06.332-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:06.464-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6090000 QueuedCount 50000 2016-03-24T06:22:07.814-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6100000 QueuedCount 50000 2016-03-24T06:22:08.19-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6110000 QueuedCount 50000 2016-03-24T06:22:08.307-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:09.263-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6120000 QueuedCount 50000 2016-03-24T06:22:09.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 311 2016-03-24T06:22:09.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 311 2016-03-24T06:22:09.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 311 2016-03-24T06:22:09.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 311 2016-03-24T06:22:09.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 311 2016-03-24T06:22:09.545-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6130000 QueuedCount 50000 2016-03-24T06:22:09.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 311 2016-03-24T06:22:09.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 311 2016-03-24T06:22:09.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 311 2016-03-24T06:22:09.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 311 2016-03-24T06:22:09.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 311 2016-03-24T06:22:09.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 311 2016-03-24T06:22:09.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 311 2016-03-24T06:22:09.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 311 2016-03-24T06:22:09.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 311 2016-03-24T06:22:09.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 311 2016-03-24T06:22:09.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 311 2016-03-24T06:22:09.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 311 2016-03-24T06:22:09.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 311 2016-03-24T06:22:09.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 311 2016-03-24T06:22:09.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 311 2016-03-24T06:22:10.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 311 2016-03-24T06:22:10.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 311 2016-03-24T06:22:10.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 311 2016-03-24T06:22:10.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 311 2016-03-24T06:22:10.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 311 2016-03-24T06:22:10.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 311 2016-03-24T06:22:10.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 311 2016-03-24T06:22:10.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 311 2016-03-24T06:22:10.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 311 2016-03-24T06:22:10.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 311 2016-03-24T06:22:10.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 311 2016-03-24T06:22:10.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 311 2016-03-24T06:22:10.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 311 2016-03-24T06:22:10.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 311 2016-03-24T06:22:10.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 311 2016-03-24T06:22:10.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 311 2016-03-24T06:22:10.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 311 2016-03-24T06:22:10.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 311 2016-03-24T06:22:10.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 311 2016-03-24T06:22:10.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 311 2016-03-24T06:22:10.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 311 2016-03-24T06:22:10.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 311 2016-03-24T06:22:10.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 311 2016-03-24T06:22:10.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 311 2016-03-24T06:22:10.714-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6140000 QueuedCount 44136 2016-03-24T06:22:10.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 311 2016-03-24T06:22:10.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 311 2016-03-24T06:22:10.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 311 2016-03-24T06:22:10.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 311 2016-03-24T06:22:10.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 311 2016-03-24T06:22:10.854-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6150000 QueuedCount 34136 2016-03-24T06:22:10.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 311 2016-03-24T06:22:10.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 311 2016-03-24T06:22:10.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 311 2016-03-24T06:22:10.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 311 2016-03-24T06:22:10.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 311 2016-03-24T06:22:11.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 311 2016-03-24T06:22:11.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 311 2016-03-24T06:22:11.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 311 2016-03-24T06:22:11.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 311 2016-03-24T06:22:11.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 311 2016-03-24T06:22:11.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 311 2016-03-24T06:22:11.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 311 2016-03-24T06:22:11.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 311 2016-03-24T06:22:11.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 311 2016-03-24T06:22:11.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 311 2016-03-24T06:22:11.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 311 2016-03-24T06:22:11.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 311 2016-03-24T06:22:11.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 311 2016-03-24T06:22:11.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 311 2016-03-24T06:22:11.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 311 2016-03-24T06:22:11.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 311 2016-03-24T06:22:11.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 311 2016-03-24T06:22:11.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 311 2016-03-24T06:22:11.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 311 2016-03-24T06:22:11.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 311 2016-03-24T06:22:11.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 311 2016-03-24T06:22:11.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 311 2016-03-24T06:22:11.667-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6160000 QueuedCount 24136 2016-03-24T06:22:11.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 311 2016-03-24T06:22:11.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 311 2016-03-24T06:22:11.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 311 2016-03-24T06:22:11.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 311 2016-03-24T06:22:11.799-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6170000 QueuedCount 14136 2016-03-24T06:22:11.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 311 2016-03-24T06:22:11.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 311 2016-03-24T06:22:11.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 311 2016-03-24T06:22:11.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 311 2016-03-24T06:22:11.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 311 2016-03-24T06:22:11.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 311 2016-03-24T06:22:11.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 311 2016-03-24T06:22:12.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 311 2016-03-24T06:22:12.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 311 2016-03-24T06:22:12.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 311 2016-03-24T06:22:12.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 311 2016-03-24T06:22:12.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 311 2016-03-24T06:22:12.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 311 2016-03-24T06:22:12.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 311 2016-03-24T06:22:12.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 311 2016-03-24T06:22:12.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 311 2016-03-24T06:22:12.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 311 2016-03-24T06:22:12.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 311 2016-03-24T06:22:12.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 311 2016-03-24T06:22:12.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 311 2016-03-24T06:22:12.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 311 2016-03-24T06:22:12.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 311 2016-03-24T06:22:12.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 311 2016-03-24T06:22:12.496-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6180000 QueuedCount 4136 2016-03-24T06:22:12.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 311 2016-03-24T06:22:12.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 311 2016-03-24T06:22:12.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 311 2016-03-24T06:22:12.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 311 2016-03-24T06:22:12.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 311 2016-03-24T06:22:12.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 311 2016-03-24T06:22:12.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 311 2016-03-24T06:22:12.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 311 2016-03-24T06:22:12.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 311 2016-03-24T06:22:12.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 311 2016-03-24T06:22:12.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 311 2016-03-24T06:22:12.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 311 2016-03-24T06:22:12.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 311 2016-03-24T06:22:12.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 311 2016-03-24T06:22:12.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 311 2016-03-24T06:22:12.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 311 2016-03-24T06:22:12.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 311 2016-03-24T06:22:13.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 311 2016-03-24T06:22:13.01-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.785µs CommitTime 449.142445ms TotalFlushTime 5m34.559493941s TotalCommitTime 39.865266128s 2016-03-24T06:22:13.01-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6184136, 6184136, 67 committed:true 2016-03-24T06:22:13.01-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6184136, 6184136, 67 committed:true) SnapCreateDur 459.669173ms SnapOpenDur 62.611µs 2016-03-24T06:22:13.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 311 2016-03-24T06:22:13.05-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:13.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 311 2016-03-24T06:22:13.09-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:13.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 311 2016-03-24T06:22:13.128-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:13.186-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6190000 QueuedCount 50000 2016-03-24T06:22:13.189-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11610000 2016-03-24T06:22:13.251-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11620000 2016-03-24T06:22:13.316-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11630000 2016-03-24T06:22:13.373-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11640000 2016-03-24T06:22:13.43-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11650000 2016-03-24T06:22:13.461-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6200000 QueuedCount 50000 2016-03-24T06:22:13.493-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11660000 2016-03-24T06:22:13.555-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11670000 2016-03-24T06:22:13.622-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11680000 2016-03-24T06:22:13.703-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11690000 2016-03-24T06:22:13.79-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11700000 2016-03-24T06:22:13.884-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11710000 2016-03-24T06:22:13.98-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11720000 2016-03-24T06:22:14.083-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11730000 2016-03-24T06:22:14.188-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11740000 2016-03-24T06:22:14.305-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11750000 2016-03-24T06:22:14.418-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11760000 2016-03-24T06:22:14.446-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:14.485-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6210000 QueuedCount 50000 2016-03-24T06:22:14.493-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11770000 2016-03-24T06:22:14.56-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11780000 2016-03-24T06:22:14.624-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11790000 2016-03-24T06:22:14.638-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6220000 QueuedCount 50000 2016-03-24T06:22:14.69-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11800000 2016-03-24T06:22:14.784-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11810000 2016-03-24T06:22:16.62-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6230000 QueuedCount 45290 2016-03-24T06:22:16.871-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6240000 QueuedCount 35290 2016-03-24T06:22:17.86-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6250000 QueuedCount 25290 2016-03-24T06:22:17.989-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6260000 QueuedCount 15290 2016-03-24T06:22:18.739-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6270000 QueuedCount 5290 2016-03-24T06:22:19.262-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.597µs CommitTime 456.941565ms TotalFlushTime 5m40.211097903s TotalCommitTime 40.322207693s 2016-03-24T06:22:19.262-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6275290, 6275290, 68 committed:true 2016-03-24T06:22:19.262-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6275290, 6275290, 68 committed:true) SnapCreateDur 466.463915ms SnapOpenDur 41.273µs 2016-03-24T06:22:19.301-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:19.338-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:19.376-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:19.419-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6280000 QueuedCount 50000 2016-03-24T06:22:19.714-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6290000 QueuedCount 50000 2016-03-24T06:22:19.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 328 2016-03-24T06:22:19.819-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:19.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 328 2016-03-24T06:22:19.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 328 2016-03-24T06:22:19.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 328 2016-03-24T06:22:19.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 328 2016-03-24T06:22:19.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 328 2016-03-24T06:22:19.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 328 2016-03-24T06:22:20.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 328 2016-03-24T06:22:20.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 328 2016-03-24T06:22:20.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 328 2016-03-24T06:22:20.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 328 2016-03-24T06:22:20.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 328 2016-03-24T06:22:20.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 328 2016-03-24T06:22:20.198-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 328 2016-03-24T06:22:20.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 328 2016-03-24T06:22:20.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 328 2016-03-24T06:22:20.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 328 2016-03-24T06:22:20.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 328 2016-03-24T06:22:20.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 328 2016-03-24T06:22:20.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 328 2016-03-24T06:22:20.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 328 2016-03-24T06:22:20.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 328 2016-03-24T06:22:20.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 328 2016-03-24T06:22:20.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 328 2016-03-24T06:22:20.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 328 2016-03-24T06:22:20.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 328 2016-03-24T06:22:20.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 328 2016-03-24T06:22:20.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 328 2016-03-24T06:22:20.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 328 2016-03-24T06:22:20.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 328 2016-03-24T06:22:20.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 328 2016-03-24T06:22:20.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 328 2016-03-24T06:22:20.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 328 2016-03-24T06:22:20.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 328 2016-03-24T06:22:20.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 328 2016-03-24T06:22:20.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 328 2016-03-24T06:22:20.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 328 2016-03-24T06:22:20.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 328 2016-03-24T06:22:20.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 328 2016-03-24T06:22:20.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 328 2016-03-24T06:22:21.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 328 2016-03-24T06:22:21.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 328 2016-03-24T06:22:21.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 328 2016-03-24T06:22:21.079-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6300000 QueuedCount 50000 2016-03-24T06:22:21.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 328 2016-03-24T06:22:21.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 328 2016-03-24T06:22:21.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 328 2016-03-24T06:22:21.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 328 2016-03-24T06:22:21.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 328 2016-03-24T06:22:21.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 328 2016-03-24T06:22:21.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 328 2016-03-24T06:22:21.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 328 2016-03-24T06:22:21.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 328 2016-03-24T06:22:21.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 328 2016-03-24T06:22:21.388-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6310000 QueuedCount 50000 2016-03-24T06:22:21.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 328 2016-03-24T06:22:21.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 328 2016-03-24T06:22:21.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 328 2016-03-24T06:22:21.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 328 2016-03-24T06:22:21.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 328 2016-03-24T06:22:21.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 328 2016-03-24T06:22:21.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 328 2016-03-24T06:22:21.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 328 2016-03-24T06:22:21.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 328 2016-03-24T06:22:21.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 328 2016-03-24T06:22:21.698-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 328 2016-03-24T06:22:21.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 328 2016-03-24T06:22:21.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 328 2016-03-24T06:22:21.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 328 2016-03-24T06:22:21.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 328 2016-03-24T06:22:21.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 328 2016-03-24T06:22:21.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 328 2016-03-24T06:22:21.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 328 2016-03-24T06:22:21.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 328 2016-03-24T06:22:21.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 328 2016-03-24T06:22:21.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 328 2016-03-24T06:22:22.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 328 2016-03-24T06:22:22.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 328 2016-03-24T06:22:22.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 328 2016-03-24T06:22:22.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 328 2016-03-24T06:22:22.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 328 2016-03-24T06:22:22.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 328 2016-03-24T06:22:22.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 328 2016-03-24T06:22:22.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 328 2016-03-24T06:22:22.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 328 2016-03-24T06:22:22.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 328 2016-03-24T06:22:22.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 328 2016-03-24T06:22:22.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 328 2016-03-24T06:22:22.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 328 2016-03-24T06:22:22.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 328 2016-03-24T06:22:22.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 328 2016-03-24T06:22:22.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 328 2016-03-24T06:22:22.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 328 2016-03-24T06:22:22.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 328 2016-03-24T06:22:22.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 328 2016-03-24T06:22:22.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 328 2016-03-24T06:22:22.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 328 2016-03-24T06:22:22.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 328 2016-03-24T06:22:22.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 328 2016-03-24T06:22:22.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 328 2016-03-24T06:22:22.74-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6320000 QueuedCount 43325 2016-03-24T06:22:22.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 328 2016-03-24T06:22:22.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 328 2016-03-24T06:22:22.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 328 2016-03-24T06:22:22.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 328 2016-03-24T06:22:22.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 328 2016-03-24T06:22:22.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 328 2016-03-24T06:22:22.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 328 2016-03-24T06:22:22.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 328 2016-03-24T06:22:22.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 328 2016-03-24T06:22:22.998-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6330000 QueuedCount 33325 2016-03-24T06:22:23.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 328 2016-03-24T06:22:23.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 328 2016-03-24T06:22:23.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 328 2016-03-24T06:22:23.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 328 2016-03-24T06:22:23.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 328 2016-03-24T06:22:23.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 328 2016-03-24T06:22:23.198-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 328 2016-03-24T06:22:23.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 328 2016-03-24T06:22:23.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 328 2016-03-24T06:22:23.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 328 2016-03-24T06:22:23.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 328 2016-03-24T06:22:23.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 328 2016-03-24T06:22:23.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 328 2016-03-24T06:22:23.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 328 2016-03-24T06:22:23.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 328 2016-03-24T06:22:23.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 328 2016-03-24T06:22:23.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 328 2016-03-24T06:22:23.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 328 2016-03-24T06:22:23.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 328 2016-03-24T06:22:23.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 328 2016-03-24T06:22:23.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 328 2016-03-24T06:22:23.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 328 2016-03-24T06:22:23.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 328 2016-03-24T06:22:23.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 328 2016-03-24T06:22:23.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 328 2016-03-24T06:22:23.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 328 2016-03-24T06:22:23.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 328 2016-03-24T06:22:23.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 328 2016-03-24T06:22:23.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 328 2016-03-24T06:22:23.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 328 2016-03-24T06:22:23.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 328 2016-03-24T06:22:23.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 328 2016-03-24T06:22:23.962-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6340000 QueuedCount 23325 2016-03-24T06:22:23.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 328 2016-03-24T06:22:24.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 328 2016-03-24T06:22:24.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 328 2016-03-24T06:22:24.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 328 2016-03-24T06:22:24.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 328 2016-03-24T06:22:24.099-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6350000 QueuedCount 13325 2016-03-24T06:22:24.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 328 2016-03-24T06:22:24.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 328 2016-03-24T06:22:24.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 328 2016-03-24T06:22:24.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 328 2016-03-24T06:22:24.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 328 2016-03-24T06:22:24.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 328 2016-03-24T06:22:24.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 328 2016-03-24T06:22:24.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 328 2016-03-24T06:22:24.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 328 2016-03-24T06:22:24.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 328 2016-03-24T06:22:24.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 328 2016-03-24T06:22:24.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 328 2016-03-24T06:22:24.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 328 2016-03-24T06:22:24.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 328 2016-03-24T06:22:24.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 328 2016-03-24T06:22:24.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 328 2016-03-24T06:22:24.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 328 2016-03-24T06:22:24.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 328 2016-03-24T06:22:24.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 328 2016-03-24T06:22:24.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 328 2016-03-24T06:22:24.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 328 2016-03-24T06:22:24.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 328 2016-03-24T06:22:24.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 328 2016-03-24T06:22:24.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 328 2016-03-24T06:22:24.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 328 2016-03-24T06:22:24.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 328 2016-03-24T06:22:24.878-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6360000 QueuedCount 3325 2016-03-24T06:22:24.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 328 2016-03-24T06:22:24.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 328 2016-03-24T06:22:24.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 328 2016-03-24T06:22:24.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 328 2016-03-24T06:22:25.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 328 2016-03-24T06:22:25.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 328 2016-03-24T06:22:25.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 328 2016-03-24T06:22:25.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 328 2016-03-24T06:22:25.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 328 2016-03-24T06:22:25.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 328 2016-03-24T06:22:25.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 328 2016-03-24T06:22:25.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 328 2016-03-24T06:22:25.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 328 2016-03-24T06:22:25.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 328 2016-03-24T06:22:25.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 328 2016-03-24T06:22:25.335-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 14.892µs CommitTime 402.337125ms TotalFlushTime 5m45.644382652s TotalCommitTime 40.724544818s 2016-03-24T06:22:25.335-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6363325, 6363325, 69 committed:true 2016-03-24T06:22:25.335-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6363325, 6363325, 69 committed:true) SnapCreateDur 411.946492ms SnapOpenDur 49.734µs 2016-03-24T06:22:25.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 328 2016-03-24T06:22:25.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 328 2016-03-24T06:22:25.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 328 2016-03-24T06:22:25.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 328 2016-03-24T06:22:25.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 328 2016-03-24T06:22:25.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 328 2016-03-24T06:22:25.519-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6370000 QueuedCount 12759 2016-03-24T06:22:25.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 328 2016-03-24T06:22:25.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 328 2016-03-24T06:22:25.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 328 2016-03-24T06:22:25.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 328 2016-03-24T06:22:25.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 328 2016-03-24T06:22:25.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 328 2016-03-24T06:22:25.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 328 2016-03-24T06:22:25.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 328 2016-03-24T06:22:25.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 328 2016-03-24T06:22:25.781-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6380000 QueuedCount 2759 2016-03-24T06:22:25.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 328 2016-03-24T06:22:25.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 328 2016-03-24T06:22:25.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 328 2016-03-24T06:22:25.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 328 2016-03-24T06:22:25.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 328 2016-03-24T06:22:25.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 328 2016-03-24T06:22:25.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 328 2016-03-24T06:22:26.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 328 2016-03-24T06:22:26.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 328 2016-03-24T06:22:26.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 328 2016-03-24T06:22:26.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 328 2016-03-24T06:22:26.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 328 2016-03-24T06:22:26.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 328 2016-03-24T06:22:26.198-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 328 2016-03-24T06:22:26.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 328 2016-03-24T06:22:26.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 328 2016-03-24T06:22:26.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 328 2016-03-24T06:22:26.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 328 2016-03-24T06:22:26.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 328 2016-03-24T06:22:26.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 328 2016-03-24T06:22:26.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 328 2016-03-24T06:22:26.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 328 2016-03-24T06:22:26.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 328 2016-03-24T06:22:26.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 328 2016-03-24T06:22:26.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 328 2016-03-24T06:22:26.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 328 2016-03-24T06:22:26.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 328 2016-03-24T06:22:26.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 328 2016-03-24T06:22:26.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 328 2016-03-24T06:22:26.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 328 2016-03-24T06:22:26.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 328 2016-03-24T06:22:26.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 328 2016-03-24T06:22:26.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 328 2016-03-24T06:22:26.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 328 2016-03-24T06:22:26.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 328 2016-03-24T06:22:26.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 328 2016-03-24T06:22:26.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 328 2016-03-24T06:22:26.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 328 2016-03-24T06:22:26.921-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.427µs CommitTime 1.04063453s TotalFlushTime 5m46.120282453s TotalCommitTime 41.765179348s 2016-03-24T06:22:26.921-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6382759, 6382759, 70 committed:true 2016-03-24T06:22:26.921-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6382759, 6382759, 70 committed:true) SnapCreateDur 1.065626404s SnapOpenDur 33.99µs 2016-03-24T06:22:26.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 328 2016-03-24T06:22:26.961-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:26.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 328 2016-03-24T06:22:26.999-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:27.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 328 2016-03-24T06:22:27.036-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:27.125-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11820000 2016-03-24T06:22:27.142-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6390000 QueuedCount 50000 2016-03-24T06:22:27.419-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:27.429-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11830000 2016-03-24T06:22:27.443-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6400000 QueuedCount 50000 2016-03-24T06:22:28.723-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11840000 2016-03-24T06:22:28.811-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6410000 QueuedCount 50000 2016-03-24T06:22:28.948-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:29.115-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11850000 2016-03-24T06:22:29.151-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6420000 QueuedCount 50000 2016-03-24T06:22:30.349-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11860000 2016-03-24T06:22:30.397-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:30.403-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6430000 QueuedCount 49573 2016-03-24T06:22:30.41-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11870000 2016-03-24T06:22:30.474-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11880000 2016-03-24T06:22:30.535-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11890000 2016-03-24T06:22:30.554-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6440000 QueuedCount 50000 2016-03-24T06:22:31.342-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6450000 QueuedCount 46374 2016-03-24T06:22:31.486-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6460000 QueuedCount 36374 2016-03-24T06:22:32.16-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6470000 QueuedCount 26374 2016-03-24T06:22:32.268-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6480000 QueuedCount 16374 2016-03-24T06:22:32.935-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6490000 QueuedCount 6374 2016-03-24T06:22:33.566-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 6.113µs CommitTime 548.936933ms TotalFlushTime 5m51.954154805s TotalCommitTime 42.314116281s 2016-03-24T06:22:33.566-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6496374, 6496374, 71 committed:true 2016-03-24T06:22:33.566-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6496374, 6496374, 71 committed:true) SnapCreateDur 558.696254ms SnapOpenDur 54.41µs 2016-03-24T06:22:33.605-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:33.644-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:33.662-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6500000 QueuedCount 31608 2016-03-24T06:22:33.664-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11900000 2016-03-24T06:22:33.681-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:33.73-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11910000 2016-03-24T06:22:33.79-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11920000 2016-03-24T06:22:33.851-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11930000 2016-03-24T06:22:33.915-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11940000 2016-03-24T06:22:33.929-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6510000 QueuedCount 50000 2016-03-24T06:22:33.979-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11950000 2016-03-24T06:22:34.039-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11960000 2016-03-24T06:22:34.047-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:34.105-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11970000 2016-03-24T06:22:34.182-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11980000 2016-03-24T06:22:34.275-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 11990000 2016-03-24T06:22:34.401-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12000000 2016-03-24T06:22:34.492-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12010000 2016-03-24T06:22:34.586-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12020000 2016-03-24T06:22:34.687-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12030000 2016-03-24T06:22:34.79-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12040000 2016-03-24T06:22:35.201-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6520000 QueuedCount 50000 2016-03-24T06:22:35.348-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:35.36-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6530000 QueuedCount 49085 2016-03-24T06:22:36.587-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6540000 QueuedCount 50000 2016-03-24T06:22:36.704-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:36.867-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6550000 QueuedCount 50000 2016-03-24T06:22:37.877-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6560000 QueuedCount 49070 2016-03-24T06:22:38.005-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6570000 QueuedCount 39070 2016-03-24T06:22:38.756-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6580000 QueuedCount 29070 2016-03-24T06:22:38.861-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6590000 QueuedCount 19070 2016-03-24T06:22:39.881-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 822 2016-03-24T06:22:39.911-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 822 2016-03-24T06:22:39.941-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 822 2016-03-24T06:22:39.971-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 822 2016-03-24T06:22:40.001-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 822 2016-03-24T06:22:40.031-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 822 2016-03-24T06:22:40.061-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 822 2016-03-24T06:22:40.091-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 822 2016-03-24T06:22:40.121-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 822 2016-03-24T06:22:40.151-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 822 2016-03-24T06:22:40.154-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6600000 QueuedCount 9070 2016-03-24T06:22:40.181-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 822 2016-03-24T06:22:40.211-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 822 2016-03-24T06:22:40.241-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 822 2016-03-24T06:22:40.271-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 822 2016-03-24T06:22:40.301-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 822 2016-03-24T06:22:40.331-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 822 2016-03-24T06:22:40.361-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 822 2016-03-24T06:22:40.391-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 822 2016-03-24T06:22:40.421-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 822 2016-03-24T06:22:40.451-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 822 2016-03-24T06:22:40.481-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 822 2016-03-24T06:22:40.511-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 822 2016-03-24T06:22:40.541-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 822 2016-03-24T06:22:40.571-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 822 2016-03-24T06:22:40.601-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 822 2016-03-24T06:22:40.631-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 822 2016-03-24T06:22:40.661-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 822 2016-03-24T06:22:40.691-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 822 2016-03-24T06:22:40.721-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 822 2016-03-24T06:22:40.751-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 822 2016-03-24T06:22:40.781-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 822 2016-03-24T06:22:40.811-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 822 2016-03-24T06:22:40.841-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 822 2016-03-24T06:22:40.871-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 822 2016-03-24T06:22:40.901-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 822 2016-03-24T06:22:40.931-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 822 2016-03-24T06:22:40.961-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 822 2016-03-24T06:22:40.991-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 822 2016-03-24T06:22:41.021-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 822 2016-03-24T06:22:41.051-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 822 2016-03-24T06:22:41.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 822 2016-03-24T06:22:41.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 822 2016-03-24T06:22:41.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 822 2016-03-24T06:22:41.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 822 2016-03-24T06:22:41.201-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 822 2016-03-24T06:22:41.231-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 822 2016-03-24T06:22:41.261-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 822 2016-03-24T06:22:41.291-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 822 2016-03-24T06:22:41.321-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 822 2016-03-24T06:22:41.351-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 822 2016-03-24T06:22:41.381-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 822 2016-03-24T06:22:41.411-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 822 2016-03-24T06:22:41.423-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 15.144µs CommitTime 1.021290328s TotalFlushTime 5m58.541683602s TotalCommitTime 43.335406609s 2016-03-24T06:22:41.423-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6609070, 6609070, 72 committed:true 2016-03-24T06:22:41.423-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6609070, 6609070, 72 committed:true) SnapCreateDur 1.046654953s SnapOpenDur 64.128µs 2016-03-24T06:22:41.441-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 822 2016-03-24T06:22:41.459-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:41.471-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 822 2016-03-24T06:22:41.471-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6610000 QueuedCount 14117 2016-03-24T06:22:41.501-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 822 2016-03-24T06:22:41.501-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:41.548-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12050000 2016-03-24T06:22:41.609-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12060000 2016-03-24T06:22:41.743-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6620000 QueuedCount 50000 2016-03-24T06:22:41.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12070000 2016-03-24T06:22:41.996-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:43.071-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6630000 QueuedCount 50000 2016-03-24T06:22:43.175-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12080000 2016-03-24T06:22:43.229-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6640000 QueuedCount 50000 2016-03-24T06:22:43.295-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12090000 2016-03-24T06:22:43.38-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6650000 QueuedCount 50000 2016-03-24T06:22:43.989-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12100000 2016-03-24T06:22:44.092-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6660000 QueuedCount 41676 2016-03-24T06:22:44.203-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6670000 QueuedCount 31676 2016-03-24T06:22:44.847-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6680000 QueuedCount 21676 2016-03-24T06:22:44.957-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6690000 QueuedCount 11676 2016-03-24T06:22:45.599-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6700000 QueuedCount 1676 2016-03-24T06:22:46.133-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 9.57µs CommitTime 504.117958ms TotalFlushTime 6m2.581560601s TotalCommitTime 43.839524567s 2016-03-24T06:22:46.133-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6701676, 6701676, 73 committed:true 2016-03-24T06:22:46.133-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6701676, 6701676, 73 committed:true) SnapCreateDur 513.877929ms SnapOpenDur 42.892µs 2016-03-24T06:22:46.169-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:46.206-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:46.226-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12110000 2016-03-24T06:22:46.241-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:46.295-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12120000 2016-03-24T06:22:46.298-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6710000 QueuedCount 50000 2016-03-24T06:22:46.344-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:46.357-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12130000 2016-03-24T06:22:46.419-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12140000 2016-03-24T06:22:46.48-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12150000 2016-03-24T06:22:46.543-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12160000 2016-03-24T06:22:46.58-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6720000 QueuedCount 50000 2016-03-24T06:22:46.606-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12170000 2016-03-24T06:22:46.673-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12180000 2016-03-24T06:22:46.752-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12190000 2016-03-24T06:22:46.836-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12200000 2016-03-24T06:22:46.921-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12210000 2016-03-24T06:22:47.005-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12220000 2016-03-24T06:22:47.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6730000 QueuedCount 50000 2016-03-24T06:22:47.754-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:47.868-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6740000 QueuedCount 50000 2016-03-24T06:22:49.187-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6750000 QueuedCount 50000 2016-03-24T06:22:49.451-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6760000 QueuedCount 40244 2016-03-24T06:22:50.374-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6770000 QueuedCount 30244 2016-03-24T06:22:50.515-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6780000 QueuedCount 20244 2016-03-24T06:22:51.248-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6790000 QueuedCount 10244 2016-03-24T06:22:51.354-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6800000 QueuedCount 244 2016-03-24T06:22:52.032-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 9.897µs CommitTime 657.447696ms TotalFlushTime 6m7.632799889s TotalCommitTime 44.496972263s 2016-03-24T06:22:52.032-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6800244, 6800244, 74 committed:true 2016-03-24T06:22:52.032-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6800244, 6800244, 74 committed:true) SnapCreateDur 666.948714ms SnapOpenDur 55.531µs 2016-03-24T06:22:52.068-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:52.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 835 2016-03-24T06:22:52.103-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:52.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 835 2016-03-24T06:22:52.137-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:52.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 835 2016-03-24T06:22:52.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 835 2016-03-24T06:22:52.172-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:52.304-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12230000 2016-03-24T06:22:52.317-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6810000 QueuedCount 50000 2016-03-24T06:22:52.628-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6820000 QueuedCount 50000 2016-03-24T06:22:53.678-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:53.782-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6830000 QueuedCount 50000 2016-03-24T06:22:53.803-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12240000 2016-03-24T06:22:53.865-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12250000 2016-03-24T06:22:53.933-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12260000 2016-03-24T06:22:54.002-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12270000 2016-03-24T06:22:54.067-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6840000 QueuedCount 50000 2016-03-24T06:22:54.074-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12280000 2016-03-24T06:22:54.153-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12290000 2016-03-24T06:22:54.238-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12300000 2016-03-24T06:22:54.324-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12310000 2016-03-24T06:22:54.412-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12320000 2016-03-24T06:22:54.501-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12330000 2016-03-24T06:22:54.592-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12340000 2016-03-24T06:22:54.679-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12350000 2016-03-24T06:22:54.77-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12360000 2016-03-24T06:22:54.863-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12370000 2016-03-24T06:22:54.967-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12380000 2016-03-24T06:22:55.078-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12390000 2016-03-24T06:22:55.183-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12400000 2016-03-24T06:22:55.295-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12410000 2016-03-24T06:22:55.335-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6850000 QueuedCount 40853 2016-03-24T06:22:55.412-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12420000 2016-03-24T06:22:55.476-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6860000 QueuedCount 30853 2016-03-24T06:22:55.529-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12430000 2016-03-24T06:22:55.646-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12440000 2016-03-24T06:22:55.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12450000 2016-03-24T06:22:55.882-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12460000 2016-03-24T06:22:55.916-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":5767696588,"bucket-1:by_email_name_street:avg_ts_items_count":97021,"bucket-1:by_email_name_street:build_progress":34,"bucket-1:by_email_name_street:data_size":2573345519,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":8424198144,"bucket-1:by_email_name_street:flush_queue_size":29168,"bucket-1:by_email_name_street:frag_percent":69,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":1045812186,"bucket-1:by_email_name_street:items_count":6800244,"bucket-1:by_email_name_street:num_commits":74,"bucket-1:by_email_name_street:num_compactions":3,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":6854067,"bucket-1:by_email_name_street:num_docs_pending":7769959,"bucket-1:by_email_name_street:num_docs_queued":5375974,"bucket-1:by_email_name_street:num_flush_queued":6890853,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":74,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5899512946,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"74 44496972263 -4054643638162428149","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"6861686 70258825315 -631928903538843691","bucket-1:by_email_name_street:timings/storage_handle_open":"74 813806749 658135974191090303","bucket-1:by_email_name_street:timings/storage_info":"297 5858413 969875839079","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"76 35136633 19170011637593","bucket-1:by_email_name_street:timings/storage_meta_set":"74 37845558 23821888600020","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"13723370 294137473272 -6987105902290434394","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5571750,"bucket-1:num_mutations_queued":12462603,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":427,"memory_quota":104857600000,"memory_used":4895895552,"needs_restart":false,"num_connections":0,"timings/stats_response":"1797 304571354 708461906488882"} 2016-03-24T06:22:56.009-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12470000 2016-03-24T06:22:56.134-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12480000 2016-03-24T06:22:56.262-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12490000 2016-03-24T06:22:56.276-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6870000 QueuedCount 20853 2016-03-24T06:22:56.381-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12500000 2016-03-24T06:22:56.402-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6880000 QueuedCount 10853 2016-03-24T06:22:56.498-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12510000 2016-03-24T06:22:57.095-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6890000 QueuedCount 853 2016-03-24T06:22:57.61-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.765µs CommitTime 486.689449ms TotalFlushTime 6m12.532760203s TotalCommitTime 44.983661712s 2016-03-24T06:22:57.61-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6890853, 6890853, 75 committed:true 2016-03-24T06:22:57.61-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6890853, 6890853, 75 committed:true) SnapCreateDur 497.188625ms SnapOpenDur 44.539µs 2016-03-24T06:22:57.646-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:57.681-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:57.718-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:57.754-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6900000 QueuedCount 50000 2016-03-24T06:22:57.766-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:57.896-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6910000 QueuedCount 50000 2016-03-24T06:22:58.576-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:58.639-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6920000 QueuedCount 50000 2016-03-24T06:22:58.655-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12520000 2016-03-24T06:22:58.714-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12530000 2016-03-24T06:22:58.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12540000 2016-03-24T06:22:58.776-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6930000 QueuedCount 50000 2016-03-24T06:22:58.782-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:22:58.852-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12550000 2016-03-24T06:22:58.934-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12560000 2016-03-24T06:22:59.018-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12570000 2016-03-24T06:22:59.11-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12580000 2016-03-24T06:22:59.616-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6940000 QueuedCount 50000 2016-03-24T06:22:59.908-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6950000 QueuedCount 45678 2016-03-24T06:23:01.018-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6960000 QueuedCount 35678 2016-03-24T06:23:01.163-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6970000 QueuedCount 25678 2016-03-24T06:23:01.958-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6980000 QueuedCount 15678 2016-03-24T06:23:02.1-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 6990000 QueuedCount 5678 2016-03-24T06:23:03.095-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.554µs CommitTime 322.895265ms TotalFlushTime 6m17.519170719s TotalCommitTime 45.306556977s 2016-03-24T06:23:03.095-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 6995678, 6995678, 76 committed:true 2016-03-24T06:23:03.095-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 6995678, 6995678, 76 committed:true) SnapCreateDur 332.451117ms SnapOpenDur 58.738µs 2016-03-24T06:23:03.133-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:03.168-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:03.204-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:03.228-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7000000 QueuedCount 43135 2016-03-24T06:23:03.324-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:03.554-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7010000 QueuedCount 50000 2016-03-24T06:23:04.22-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 128 2016-03-24T06:23:04.25-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 128 2016-03-24T06:23:04.28-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 128 2016-03-24T06:23:04.31-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 128 2016-03-24T06:23:04.34-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 128 2016-03-24T06:23:04.37-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 128 2016-03-24T06:23:04.4-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 128 2016-03-24T06:23:04.43-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 128 2016-03-24T06:23:04.46-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 128 2016-03-24T06:23:04.49-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 128 2016-03-24T06:23:04.52-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 128 2016-03-24T06:23:04.55-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 128 2016-03-24T06:23:04.58-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 128 2016-03-24T06:23:04.61-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 128 2016-03-24T06:23:04.64-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 128 2016-03-24T06:23:04.67-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 128 2016-03-24T06:23:04.7-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 128 2016-03-24T06:23:04.73-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 128 2016-03-24T06:23:04.76-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 128 2016-03-24T06:23:04.79-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 128 2016-03-24T06:23:04.82-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 128 2016-03-24T06:23:04.85-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 128 2016-03-24T06:23:04.88-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 128 2016-03-24T06:23:04.91-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 128 2016-03-24T06:23:04.923-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:04.94-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 128 2016-03-24T06:23:04.954-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7020000 QueuedCount 50000 2016-03-24T06:23:04.97-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 128 2016-03-24T06:23:05-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 128 2016-03-24T06:23:05.03-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 128 2016-03-24T06:23:05.06-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 128 2016-03-24T06:23:05.09-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 128 2016-03-24T06:23:05.12-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 128 2016-03-24T06:23:05.125-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7030000 QueuedCount 50000 2016-03-24T06:23:05.15-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 128 2016-03-24T06:23:05.18-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 128 2016-03-24T06:23:05.21-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 128 2016-03-24T06:23:05.24-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 128 2016-03-24T06:23:05.27-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 128 2016-03-24T06:23:05.3-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 128 2016-03-24T06:23:05.33-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 128 2016-03-24T06:23:05.36-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 128 2016-03-24T06:23:05.39-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 128 2016-03-24T06:23:05.42-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 128 2016-03-24T06:23:05.45-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 128 2016-03-24T06:23:05.48-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 128 2016-03-24T06:23:05.51-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 128 2016-03-24T06:23:05.54-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 128 2016-03-24T06:23:05.57-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 128 2016-03-24T06:23:05.6-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 128 2016-03-24T06:23:05.63-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 128 2016-03-24T06:23:05.66-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 128 2016-03-24T06:23:05.69-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 128 2016-03-24T06:23:05.72-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 128 2016-03-24T06:23:05.75-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 128 2016-03-24T06:23:05.78-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 128 2016-03-24T06:23:05.81-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 128 2016-03-24T06:23:05.84-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 128 2016-03-24T06:23:05.87-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 128 2016-03-24T06:23:05.9-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 128 2016-03-24T06:23:05.93-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 128 2016-03-24T06:23:05.96-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 128 2016-03-24T06:23:05.99-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 128 2016-03-24T06:23:06.02-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 128 2016-03-24T06:23:06.05-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 128 2016-03-24T06:23:06.08-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 128 2016-03-24T06:23:06.11-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 128 2016-03-24T06:23:06.14-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 128 2016-03-24T06:23:06.17-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 128 2016-03-24T06:23:06.2-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 128 2016-03-24T06:23:06.23-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 128 2016-03-24T06:23:06.244-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7040000 QueuedCount 42167 2016-03-24T06:23:06.26-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 128 2016-03-24T06:23:06.29-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 128 2016-03-24T06:23:06.32-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 128 2016-03-24T06:23:06.35-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 128 2016-03-24T06:23:06.38-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 128 2016-03-24T06:23:06.382-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7050000 QueuedCount 32167 2016-03-24T06:23:06.41-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 128 2016-03-24T06:23:06.44-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 128 2016-03-24T06:23:06.47-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 128 2016-03-24T06:23:06.5-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 128 2016-03-24T06:23:06.53-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 128 2016-03-24T06:23:06.56-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 128 2016-03-24T06:23:06.59-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 128 2016-03-24T06:23:06.62-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 128 2016-03-24T06:23:06.65-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 128 2016-03-24T06:23:06.68-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 128 2016-03-24T06:23:06.71-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 128 2016-03-24T06:23:06.74-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 128 2016-03-24T06:23:06.77-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 128 2016-03-24T06:23:06.8-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 128 2016-03-24T06:23:06.83-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 128 2016-03-24T06:23:06.86-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 128 2016-03-24T06:23:06.89-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 128 2016-03-24T06:23:06.92-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 128 2016-03-24T06:23:06.95-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 128 2016-03-24T06:23:06.98-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 128 2016-03-24T06:23:07.01-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 128 2016-03-24T06:23:07.04-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 128 2016-03-24T06:23:07.07-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 128 2016-03-24T06:23:07.1-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 128 2016-03-24T06:23:07.13-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 128 2016-03-24T06:23:07.16-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 128 2016-03-24T06:23:07.19-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 128 2016-03-24T06:23:07.22-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 128 2016-03-24T06:23:07.25-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 128 2016-03-24T06:23:07.28-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 128 2016-03-24T06:23:07.31-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 128 2016-03-24T06:23:07.34-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 128 2016-03-24T06:23:07.37-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 128 2016-03-24T06:23:07.4-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 128 2016-03-24T06:23:07.43-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 128 2016-03-24T06:23:07.46-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 128 2016-03-24T06:23:07.49-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 128 2016-03-24T06:23:07.52-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 128 2016-03-24T06:23:07.55-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 128 2016-03-24T06:23:07.58-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 128 2016-03-24T06:23:07.61-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 128 2016-03-24T06:23:07.64-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 128 2016-03-24T06:23:07.67-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 128 2016-03-24T06:23:07.7-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 128 2016-03-24T06:23:07.73-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 128 2016-03-24T06:23:07.76-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 128 2016-03-24T06:23:07.79-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 128 2016-03-24T06:23:07.82-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 128 2016-03-24T06:23:07.85-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 128 2016-03-24T06:23:07.88-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 128 2016-03-24T06:23:07.91-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 128 2016-03-24T06:23:07.94-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 128 2016-03-24T06:23:07.97-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 128 2016-03-24T06:23:08-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 128 2016-03-24T06:23:08.03-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 128 2016-03-24T06:23:08.06-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 128 2016-03-24T06:23:08.09-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 128 2016-03-24T06:23:08.12-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 128 2016-03-24T06:23:08.15-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 128 2016-03-24T06:23:08.18-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 128 2016-03-24T06:23:08.21-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 128 2016-03-24T06:23:08.24-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 128 2016-03-24T06:23:08.27-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 128 2016-03-24T06:23:08.3-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 128 2016-03-24T06:23:08.33-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 128 2016-03-24T06:23:08.36-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 128 2016-03-24T06:23:08.39-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 128 2016-03-24T06:23:08.42-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 128 2016-03-24T06:23:08.43-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7060000 QueuedCount 22167 2016-03-24T06:23:08.45-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 128 2016-03-24T06:23:08.48-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 128 2016-03-24T06:23:08.51-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 128 2016-03-24T06:23:08.54-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 128 2016-03-24T06:23:08.57-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 128 2016-03-24T06:23:08.6-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 128 2016-03-24T06:23:08.63-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 128 2016-03-24T06:23:08.66-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 128 2016-03-24T06:23:08.69-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7070000 QueuedCount 12167 2016-03-24T06:23:08.69-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 128 2016-03-24T06:23:08.72-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 128 2016-03-24T06:23:08.75-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 128 2016-03-24T06:23:08.78-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 128 2016-03-24T06:23:08.81-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 128 2016-03-24T06:23:08.84-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 128 2016-03-24T06:23:08.87-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 128 2016-03-24T06:23:08.9-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 128 2016-03-24T06:23:08.93-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 128 2016-03-24T06:23:08.96-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 128 2016-03-24T06:23:08.99-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 128 2016-03-24T06:23:09.02-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 128 2016-03-24T06:23:09.05-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 128 2016-03-24T06:23:09.08-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 128 2016-03-24T06:23:09.11-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 128 2016-03-24T06:23:09.14-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 128 2016-03-24T06:23:09.17-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 128 2016-03-24T06:23:09.2-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 128 2016-03-24T06:23:09.23-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 128 2016-03-24T06:23:09.26-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 128 2016-03-24T06:23:09.29-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 128 2016-03-24T06:23:09.32-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 128 2016-03-24T06:23:09.35-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 128 2016-03-24T06:23:09.38-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 128 2016-03-24T06:23:09.41-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 128 2016-03-24T06:23:09.44-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 128 2016-03-24T06:23:09.47-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 128 2016-03-24T06:23:09.5-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 128 2016-03-24T06:23:09.53-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 128 2016-03-24T06:23:09.56-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 128 2016-03-24T06:23:09.59-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 128 2016-03-24T06:23:09.62-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 128 2016-03-24T06:23:09.65-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 128 2016-03-24T06:23:09.68-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 128 2016-03-24T06:23:09.71-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 128 2016-03-24T06:23:09.74-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 128 2016-03-24T06:23:09.77-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 128 2016-03-24T06:23:09.773-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7080000 QueuedCount 2167 2016-03-24T06:23:09.8-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 128 2016-03-24T06:23:09.83-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 128 2016-03-24T06:23:09.86-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 128 2016-03-24T06:23:09.89-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 128 2016-03-24T06:23:09.92-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 128 2016-03-24T06:23:09.95-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 128 2016-03-24T06:23:09.98-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 128 2016-03-24T06:23:10.01-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 128 2016-03-24T06:23:10.04-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 128 2016-03-24T06:23:10.07-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 128 2016-03-24T06:23:10.1-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 128 2016-03-24T06:23:10.13-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 128 2016-03-24T06:23:10.16-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 128 2016-03-24T06:23:10.19-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 128 2016-03-24T06:23:10.22-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 128 2016-03-24T06:23:10.25-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 128 2016-03-24T06:23:10.28-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 128 2016-03-24T06:23:10.31-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 128 2016-03-24T06:23:10.34-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 128 2016-03-24T06:23:10.37-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 128 2016-03-24T06:23:10.4-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 128 2016-03-24T06:23:10.43-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 128 2016-03-24T06:23:10.46-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 128 2016-03-24T06:23:10.49-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 128 2016-03-24T06:23:10.52-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 128 2016-03-24T06:23:10.55-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 128 2016-03-24T06:23:10.58-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 128 2016-03-24T06:23:10.61-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 128 2016-03-24T06:23:10.617-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 17.017µs CommitTime 782.233083ms TotalFlushTime 6m24.03881579s TotalCommitTime 46.08879006s 2016-03-24T06:23:10.617-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7082167, 7082167, 77 committed:true 2016-03-24T06:23:10.617-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7082167, 7082167, 77 committed:true) SnapCreateDur 810.074924ms SnapOpenDur 74.967µs 2016-03-24T06:23:10.64-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 128 2016-03-24T06:23:10.67-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 128 2016-03-24T06:23:10.7-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 128 2016-03-24T06:23:10.73-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 128 2016-03-24T06:23:10.76-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 128 2016-03-24T06:23:10.79-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 128 2016-03-24T06:23:10.82-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 128 2016-03-24T06:23:10.835-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7090000 QueuedCount 14299 2016-03-24T06:23:10.85-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 128 2016-03-24T06:23:10.88-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 128 2016-03-24T06:23:10.91-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 128 2016-03-24T06:23:10.94-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 128 2016-03-24T06:23:10.97-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 128 2016-03-24T06:23:11-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 128 2016-03-24T06:23:11.03-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 128 2016-03-24T06:23:11.06-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 128 2016-03-24T06:23:11.09-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 128 2016-03-24T06:23:11.1-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7100000 QueuedCount 4299 2016-03-24T06:23:11.12-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 128 2016-03-24T06:23:11.15-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 128 2016-03-24T06:23:11.18-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 128 2016-03-24T06:23:11.21-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 128 2016-03-24T06:23:11.24-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 128 2016-03-24T06:23:11.27-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 128 2016-03-24T06:23:11.3-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 128 2016-03-24T06:23:11.33-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 128 2016-03-24T06:23:11.36-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 128 2016-03-24T06:23:11.39-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 128 2016-03-24T06:23:11.42-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 128 2016-03-24T06:23:11.45-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 128 2016-03-24T06:23:11.48-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 128 2016-03-24T06:23:11.51-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 128 2016-03-24T06:23:11.54-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 128 2016-03-24T06:23:11.57-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 128 2016-03-24T06:23:11.6-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 128 2016-03-24T06:23:11.63-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 128 2016-03-24T06:23:11.66-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 128 2016-03-24T06:23:11.69-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 128 2016-03-24T06:23:11.72-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 128 2016-03-24T06:23:11.75-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 128 2016-03-24T06:23:11.78-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 128 2016-03-24T06:23:11.81-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 128 2016-03-24T06:23:11.84-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 128 2016-03-24T06:23:11.87-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 128 2016-03-24T06:23:11.9-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 128 2016-03-24T06:23:11.93-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 128 2016-03-24T06:23:11.96-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 128 2016-03-24T06:23:11.99-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 128 2016-03-24T06:23:12.02-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 128 2016-03-24T06:23:12.05-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 128 2016-03-24T06:23:12.08-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 128 2016-03-24T06:23:12.11-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 128 2016-03-24T06:23:12.14-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 128 2016-03-24T06:23:12.17-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 128 2016-03-24T06:23:12.2-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 128 2016-03-24T06:23:12.202-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.12µs CommitTime 225.048652ms TotalFlushTime 6m25.334559525s TotalCommitTime 46.313838712s 2016-03-24T06:23:12.202-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7104299, 7104299, 78 committed:true 2016-03-24T06:23:12.202-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7104299, 7104299, 78 committed:true) SnapCreateDur 237.486304ms SnapOpenDur 50.603µs 2016-03-24T06:23:12.235-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12590000 2016-03-24T06:23:12.252-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:12.311-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12600000 2016-03-24T06:23:12.339-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:12.377-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12610000 2016-03-24T06:23:12.382-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7110000 QueuedCount 50000 2016-03-24T06:23:12.446-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12620000 2016-03-24T06:23:12.514-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12630000 2016-03-24T06:23:12.579-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12640000 2016-03-24T06:23:12.643-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12650000 2016-03-24T06:23:12.663-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7120000 QueuedCount 50000 2016-03-24T06:23:12.703-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12660000 2016-03-24T06:23:12.75-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:12.767-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12670000 2016-03-24T06:23:12.846-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12680000 2016-03-24T06:23:12.928-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12690000 2016-03-24T06:23:13.011-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12700000 2016-03-24T06:23:13.089-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12710000 2016-03-24T06:23:13.176-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12720000 2016-03-24T06:23:13.263-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12730000 2016-03-24T06:23:13.369-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12740000 2016-03-24T06:23:13.474-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12750000 2016-03-24T06:23:13.578-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12760000 2016-03-24T06:23:13.879-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7130000 QueuedCount 50000 2016-03-24T06:23:14.131-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:14.179-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7140000 QueuedCount 50000 2016-03-24T06:23:15.502-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7150000 QueuedCount 50000 2016-03-24T06:23:15.597-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:15.803-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7160000 QueuedCount 50000 2016-03-24T06:23:17.105-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:17.131-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7170000 QueuedCount 50000 2016-03-24T06:23:17.464-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7180000 QueuedCount 50000 2016-03-24T06:23:18.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 145 2016-03-24T06:23:18.678-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7190000 QueuedCount 49368 2016-03-24T06:23:18.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 145 2016-03-24T06:23:18.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 145 2016-03-24T06:23:18.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 145 2016-03-24T06:23:18.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 145 2016-03-24T06:23:18.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 145 2016-03-24T06:23:18.815-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7200000 QueuedCount 39368 2016-03-24T06:23:18.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 145 2016-03-24T06:23:18.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 145 2016-03-24T06:23:18.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 145 2016-03-24T06:23:18.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 145 2016-03-24T06:23:18.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 145 2016-03-24T06:23:18.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 145 2016-03-24T06:23:19.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 145 2016-03-24T06:23:19.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 145 2016-03-24T06:23:19.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 145 2016-03-24T06:23:19.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 145 2016-03-24T06:23:19.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 145 2016-03-24T06:23:19.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 145 2016-03-24T06:23:19.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 145 2016-03-24T06:23:19.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 145 2016-03-24T06:23:19.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 145 2016-03-24T06:23:19.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 145 2016-03-24T06:23:19.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 145 2016-03-24T06:23:19.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 145 2016-03-24T06:23:19.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 145 2016-03-24T06:23:19.399-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 145 2016-03-24T06:23:19.429-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 145 2016-03-24T06:23:19.459-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 145 2016-03-24T06:23:19.489-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 145 2016-03-24T06:23:19.519-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 145 2016-03-24T06:23:19.549-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 145 2016-03-24T06:23:19.579-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 145 2016-03-24T06:23:19.581-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7210000 QueuedCount 29368 2016-03-24T06:23:19.609-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 145 2016-03-24T06:23:19.639-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 145 2016-03-24T06:23:19.669-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 145 2016-03-24T06:23:19.699-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 145 2016-03-24T06:23:19.715-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7220000 QueuedCount 19368 2016-03-24T06:23:19.729-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 145 2016-03-24T06:23:19.759-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 145 2016-03-24T06:23:19.789-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 145 2016-03-24T06:23:19.819-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 145 2016-03-24T06:23:19.849-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 145 2016-03-24T06:23:19.879-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 145 2016-03-24T06:23:19.909-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 145 2016-03-24T06:23:19.939-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 145 2016-03-24T06:23:19.969-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 145 2016-03-24T06:23:19.999-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 145 2016-03-24T06:23:20.029-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 145 2016-03-24T06:23:20.059-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 145 2016-03-24T06:23:20.089-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 145 2016-03-24T06:23:20.119-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 145 2016-03-24T06:23:20.149-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 145 2016-03-24T06:23:20.179-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 145 2016-03-24T06:23:20.209-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 145 2016-03-24T06:23:20.239-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 145 2016-03-24T06:23:20.269-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 145 2016-03-24T06:23:20.299-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 145 2016-03-24T06:23:20.329-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 145 2016-03-24T06:23:20.359-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 145 2016-03-24T06:23:20.389-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7230000 QueuedCount 9368 2016-03-24T06:23:20.389-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 145 2016-03-24T06:23:20.419-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 145 2016-03-24T06:23:20.449-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 145 2016-03-24T06:23:20.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 145 2016-03-24T06:23:20.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 145 2016-03-24T06:23:20.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 145 2016-03-24T06:23:20.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 145 2016-03-24T06:23:20.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 145 2016-03-24T06:23:20.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 145 2016-03-24T06:23:20.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 145 2016-03-24T06:23:20.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 145 2016-03-24T06:23:20.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 145 2016-03-24T06:23:20.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 145 2016-03-24T06:23:20.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 145 2016-03-24T06:23:20.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 145 2016-03-24T06:23:20.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 145 2016-03-24T06:23:20.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 145 2016-03-24T06:23:20.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 145 2016-03-24T06:23:20.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 145 2016-03-24T06:23:20.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 145 2016-03-24T06:23:20.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 145 2016-03-24T06:23:21.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 145 2016-03-24T06:23:21.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 145 2016-03-24T06:23:21.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 145 2016-03-24T06:23:21.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 145 2016-03-24T06:23:21.131-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.765µs CommitTime 622.254989ms TotalFlushTime 6m33.251933874s TotalCommitTime 46.936093701s 2016-03-24T06:23:21.131-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7239368, 7239368, 79 committed:true 2016-03-24T06:23:21.131-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7239368, 7239368, 79 committed:true) SnapCreateDur 632.429387ms SnapOpenDur 39.03µs 2016-03-24T06:23:21.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 145 2016-03-24T06:23:21.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 145 2016-03-24T06:23:21.171-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7240000 QueuedCount 17806 2016-03-24T06:23:21.171-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:21.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 145 2016-03-24T06:23:21.208-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:21.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 145 2016-03-24T06:23:21.243-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:21.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 145 2016-03-24T06:23:21.321-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12770000 2016-03-24T06:23:21.39-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12780000 2016-03-24T06:23:21.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12790000 2016-03-24T06:23:21.466-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7250000 QueuedCount 50000 2016-03-24T06:23:21.52-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12800000 2016-03-24T06:23:21.57-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:21.59-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12810000 2016-03-24T06:23:21.66-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12820000 2016-03-24T06:23:21.727-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12830000 2016-03-24T06:23:21.79-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12840000 2016-03-24T06:23:22.935-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7260000 QueuedCount 50000 2016-03-24T06:23:23.211-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7270000 QueuedCount 50000 2016-03-24T06:23:23.314-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:23.507-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7280000 QueuedCount 50000 2016-03-24T06:23:25.076-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7290000 QueuedCount 49809 2016-03-24T06:23:25.349-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7300000 QueuedCount 39809 2016-03-24T06:23:26.369-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7310000 QueuedCount 29809 2016-03-24T06:23:26.511-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7320000 QueuedCount 19809 2016-03-24T06:23:27.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 401 2016-03-24T06:23:27.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 401 2016-03-24T06:23:27.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 401 2016-03-24T06:23:27.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 401 2016-03-24T06:23:27.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 401 2016-03-24T06:23:27.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 401 2016-03-24T06:23:27.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 401 2016-03-24T06:23:27.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 401 2016-03-24T06:23:27.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 401 2016-03-24T06:23:27.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 401 2016-03-24T06:23:27.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 401 2016-03-24T06:23:27.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 401 2016-03-24T06:23:27.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 401 2016-03-24T06:23:27.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 401 2016-03-24T06:23:27.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 401 2016-03-24T06:23:27.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 401 2016-03-24T06:23:27.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 401 2016-03-24T06:23:27.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 401 2016-03-24T06:23:27.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 401 2016-03-24T06:23:27.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 401 2016-03-24T06:23:27.783-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7330000 QueuedCount 9809 2016-03-24T06:23:27.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 401 2016-03-24T06:23:27.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 401 2016-03-24T06:23:27.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 401 2016-03-24T06:23:27.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 401 2016-03-24T06:23:27.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 401 2016-03-24T06:23:27.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 401 2016-03-24T06:23:27.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 401 2016-03-24T06:23:27.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 401 2016-03-24T06:23:28.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 401 2016-03-24T06:23:28.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 401 2016-03-24T06:23:28.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 401 2016-03-24T06:23:28.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 401 2016-03-24T06:23:28.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 401 2016-03-24T06:23:28.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 401 2016-03-24T06:23:28.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 401 2016-03-24T06:23:28.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 401 2016-03-24T06:23:28.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 401 2016-03-24T06:23:28.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 401 2016-03-24T06:23:28.323-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 401 2016-03-24T06:23:28.353-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 401 2016-03-24T06:23:28.383-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 401 2016-03-24T06:23:28.413-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 401 2016-03-24T06:23:28.443-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 401 2016-03-24T06:23:28.473-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 401 2016-03-24T06:23:28.503-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 401 2016-03-24T06:23:28.533-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 401 2016-03-24T06:23:28.563-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 401 2016-03-24T06:23:28.593-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 401 2016-03-24T06:23:28.623-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 401 2016-03-24T06:23:28.653-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 401 2016-03-24T06:23:28.683-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 401 2016-03-24T06:23:28.713-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 401 2016-03-24T06:23:28.743-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 401 2016-03-24T06:23:28.773-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 401 2016-03-24T06:23:28.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 401 2016-03-24T06:23:28.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 401 2016-03-24T06:23:28.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 401 2016-03-24T06:23:28.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 401 2016-03-24T06:23:28.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 401 2016-03-24T06:23:28.953-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 401 2016-03-24T06:23:28.983-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 401 2016-03-24T06:23:29.013-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 401 2016-03-24T06:23:29.043-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 401 2016-03-24T06:23:29.073-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 401 2016-03-24T06:23:29.103-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 401 2016-03-24T06:23:29.111-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 10.99µs CommitTime 1.012895368s TotalFlushTime 6m39.979376164s TotalCommitTime 47.948989069s 2016-03-24T06:23:29.111-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7339809, 7339809, 80 committed:true 2016-03-24T06:23:29.112-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7339809, 7339809, 80 committed:true) SnapCreateDur 1.040404567s SnapOpenDur 41.871µs 2016-03-24T06:23:29.133-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 401 2016-03-24T06:23:29.14-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7340000 QueuedCount 9726 2016-03-24T06:23:29.163-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 401 2016-03-24T06:23:29.193-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 401 2016-03-24T06:23:29.223-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 401 2016-03-24T06:23:29.253-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 401 2016-03-24T06:23:29.283-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 401 2016-03-24T06:23:29.313-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 401 2016-03-24T06:23:29.343-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 401 2016-03-24T06:23:29.373-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 401 2016-03-24T06:23:29.388-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7350000 QueuedCount 6099 2016-03-24T06:23:29.403-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 401 2016-03-24T06:23:29.433-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 401 2016-03-24T06:23:29.463-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 401 2016-03-24T06:23:29.493-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 401 2016-03-24T06:23:29.523-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 401 2016-03-24T06:23:29.553-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 401 2016-03-24T06:23:29.583-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 401 2016-03-24T06:23:29.613-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 401 2016-03-24T06:23:29.643-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 401 2016-03-24T06:23:29.673-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 401 2016-03-24T06:23:29.703-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 401 2016-03-24T06:23:29.733-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 401 2016-03-24T06:23:29.763-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 401 2016-03-24T06:23:29.793-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 401 2016-03-24T06:23:29.823-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 401 2016-03-24T06:23:29.853-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 401 2016-03-24T06:23:29.883-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 401 2016-03-24T06:23:29.913-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 401 2016-03-24T06:23:29.943-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 401 2016-03-24T06:23:29.973-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 401 2016-03-24T06:23:30.003-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 401 2016-03-24T06:23:30.033-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 401 2016-03-24T06:23:30.063-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 401 2016-03-24T06:23:30.093-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 401 2016-03-24T06:23:30.123-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 401 2016-03-24T06:23:30.153-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 401 2016-03-24T06:23:30.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 401 2016-03-24T06:23:30.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 401 2016-03-24T06:23:30.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 401 2016-03-24T06:23:30.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 401 2016-03-24T06:23:30.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 401 2016-03-24T06:23:30.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 401 2016-03-24T06:23:30.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 401 2016-03-24T06:23:30.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 401 2016-03-24T06:23:30.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 401 2016-03-24T06:23:30.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 401 2016-03-24T06:23:30.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 401 2016-03-24T06:23:30.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 401 2016-03-24T06:23:30.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 401 2016-03-24T06:23:30.559-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.403µs CommitTime 984.704048ms TotalFlushTime 6m40.368866274s TotalCommitTime 48.933693117s 2016-03-24T06:23:30.559-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7356099, 7356099, 81 committed:true 2016-03-24T06:23:30.559-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7356099, 7356099, 81 committed:true) SnapCreateDur 1.009630347s SnapOpenDur 57.306µs 2016-03-24T06:23:30.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 401 2016-03-24T06:23:30.596-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:30.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 401 2016-03-24T06:23:30.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 401 2016-03-24T06:23:30.634-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:30.642-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7360000 QueuedCount 29349 2016-03-24T06:23:30.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 401 2016-03-24T06:23:30.67-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:30.715-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12850000 2016-03-24T06:23:30.773-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12860000 2016-03-24T06:23:30.826-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7370000 QueuedCount 50000 2016-03-24T06:23:30.831-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12870000 2016-03-24T06:23:30.89-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12880000 2016-03-24T06:23:30.91-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:30.955-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12890000 2016-03-24T06:23:31.021-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12900000 2016-03-24T06:23:31.109-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12910000 2016-03-24T06:23:31.233-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12920000 2016-03-24T06:23:31.373-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12930000 2016-03-24T06:23:32.796-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7380000 QueuedCount 50000 2016-03-24T06:23:32.888-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:33.114-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7390000 QueuedCount 49996 2016-03-24T06:23:34.53-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7400000 QueuedCount 50000 2016-03-24T06:23:34.785-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:34.796-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7410000 QueuedCount 49573 2016-03-24T06:23:36.154-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7420000 QueuedCount 50000 2016-03-24T06:23:36.328-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7430000 QueuedCount 50000 2016-03-24T06:23:37.173-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7440000 QueuedCount 49700 2016-03-24T06:23:37.308-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7450000 QueuedCount 39700 2016-03-24T06:23:38.001-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7460000 QueuedCount 29700 2016-03-24T06:23:38.112-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7470000 QueuedCount 19700 2016-03-24T06:23:38.817-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7480000 QueuedCount 9700 2016-03-24T06:23:39.535-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.879µs CommitTime 596.120133ms TotalFlushTime 6m48.430612933s TotalCommitTime 49.52981325s 2016-03-24T06:23:39.535-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7489700, 7489700, 82 committed:true 2016-03-24T06:23:39.535-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7489700, 7489700, 82 committed:true) SnapCreateDur 605.80806ms SnapOpenDur 41.838µs 2016-03-24T06:23:39.57-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:39.591-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:39.623-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:39.646-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:39.664-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7490000 QueuedCount 26269 2016-03-24T06:23:39.675-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:39.855-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 891 2016-03-24T06:23:39.885-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 891 2016-03-24T06:23:39.915-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 891 2016-03-24T06:23:39.945-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 891 2016-03-24T06:23:39.975-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 891 2016-03-24T06:23:40.005-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 891 2016-03-24T06:23:40.035-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 891 2016-03-24T06:23:40.065-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 891 2016-03-24T06:23:40.095-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 891 2016-03-24T06:23:40.125-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 891 2016-03-24T06:23:40.155-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 891 2016-03-24T06:23:40.185-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 891 2016-03-24T06:23:40.215-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 891 2016-03-24T06:23:40.245-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 891 2016-03-24T06:23:40.275-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 891 2016-03-24T06:23:40.305-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 891 2016-03-24T06:23:40.335-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 891 2016-03-24T06:23:40.365-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 891 2016-03-24T06:23:40.395-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 891 2016-03-24T06:23:40.425-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 891 2016-03-24T06:23:40.455-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 891 2016-03-24T06:23:40.485-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 891 2016-03-24T06:23:40.515-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 891 2016-03-24T06:23:40.545-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 891 2016-03-24T06:23:40.575-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 891 2016-03-24T06:23:40.605-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 891 2016-03-24T06:23:40.635-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 891 2016-03-24T06:23:40.665-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 891 2016-03-24T06:23:40.695-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 891 2016-03-24T06:23:40.725-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 891 2016-03-24T06:23:40.755-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 891 2016-03-24T06:23:40.785-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 891 2016-03-24T06:23:40.815-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 891 2016-03-24T06:23:40.845-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 891 2016-03-24T06:23:40.875-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 891 2016-03-24T06:23:40.905-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 891 2016-03-24T06:23:40.935-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 891 2016-03-24T06:23:40.965-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 891 2016-03-24T06:23:40.995-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 891 2016-03-24T06:23:41.025-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 891 2016-03-24T06:23:41.055-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 891 2016-03-24T06:23:41.085-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 891 2016-03-24T06:23:41.115-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 891 2016-03-24T06:23:41.145-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 891 2016-03-24T06:23:41.175-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 891 2016-03-24T06:23:41.18-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7500000 QueuedCount 50000 2016-03-24T06:23:41.205-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 891 2016-03-24T06:23:41.235-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 891 2016-03-24T06:23:41.265-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 891 2016-03-24T06:23:41.295-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 891 2016-03-24T06:23:41.3-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:41.325-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 891 2016-03-24T06:23:41.355-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 891 2016-03-24T06:23:41.385-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 891 2016-03-24T06:23:41.415-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 891 2016-03-24T06:23:41.445-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 891 2016-03-24T06:23:41.475-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 891 2016-03-24T06:23:41.504-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7510000 QueuedCount 50000 2016-03-24T06:23:41.505-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 891 2016-03-24T06:23:41.535-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 891 2016-03-24T06:23:41.565-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 891 2016-03-24T06:23:41.595-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 891 2016-03-24T06:23:41.625-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 891 2016-03-24T06:23:41.655-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 891 2016-03-24T06:23:41.685-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 891 2016-03-24T06:23:41.715-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 891 2016-03-24T06:23:41.745-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 891 2016-03-24T06:23:41.775-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 891 2016-03-24T06:23:41.805-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 891 2016-03-24T06:23:41.835-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 891 2016-03-24T06:23:41.865-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 891 2016-03-24T06:23:41.895-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 891 2016-03-24T06:23:41.925-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 891 2016-03-24T06:23:41.955-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 891 2016-03-24T06:23:41.985-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 891 2016-03-24T06:23:42.015-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 891 2016-03-24T06:23:42.045-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 891 2016-03-24T06:23:42.075-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 891 2016-03-24T06:23:42.105-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 891 2016-03-24T06:23:42.135-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 891 2016-03-24T06:23:42.165-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 891 2016-03-24T06:23:42.195-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 891 2016-03-24T06:23:42.225-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 891 2016-03-24T06:23:42.255-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 891 2016-03-24T06:23:42.285-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 891 2016-03-24T06:23:42.315-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 891 2016-03-24T06:23:42.345-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 891 2016-03-24T06:23:42.375-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 891 2016-03-24T06:23:42.405-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 891 2016-03-24T06:23:42.435-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 891 2016-03-24T06:23:42.465-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 891 2016-03-24T06:23:42.495-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 891 2016-03-24T06:23:42.525-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 891 2016-03-24T06:23:42.555-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 891 2016-03-24T06:23:42.585-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 891 2016-03-24T06:23:42.615-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 891 2016-03-24T06:23:42.645-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 891 2016-03-24T06:23:42.675-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 891 2016-03-24T06:23:42.705-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 891 2016-03-24T06:23:42.735-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 891 2016-03-24T06:23:42.765-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 891 2016-03-24T06:23:42.769-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7520000 QueuedCount 50000 2016-03-24T06:23:42.795-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 891 2016-03-24T06:23:42.825-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 891 2016-03-24T06:23:42.855-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 891 2016-03-24T06:23:42.885-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 891 2016-03-24T06:23:42.915-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 891 2016-03-24T06:23:42.945-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 891 2016-03-24T06:23:42.975-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 891 2016-03-24T06:23:43.005-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 891 2016-03-24T06:23:43.035-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 891 2016-03-24T06:23:43.065-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 891 2016-03-24T06:23:43.089-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7530000 QueuedCount 50000 2016-03-24T06:23:43.095-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 891 2016-03-24T06:23:43.125-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 891 2016-03-24T06:23:43.155-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 891 2016-03-24T06:23:43.185-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 891 2016-03-24T06:23:43.215-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 891 2016-03-24T06:23:43.245-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 891 2016-03-24T06:23:43.275-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 891 2016-03-24T06:23:43.305-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 891 2016-03-24T06:23:43.335-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 891 2016-03-24T06:23:43.365-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 891 2016-03-24T06:23:43.395-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 891 2016-03-24T06:23:43.425-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 891 2016-03-24T06:23:43.455-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 891 2016-03-24T06:23:43.485-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 891 2016-03-24T06:23:43.515-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 891 2016-03-24T06:23:43.545-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 891 2016-03-24T06:23:43.575-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 891 2016-03-24T06:23:43.605-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 891 2016-03-24T06:23:43.635-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 891 2016-03-24T06:23:43.665-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 891 2016-03-24T06:23:43.695-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 891 2016-03-24T06:23:43.725-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 891 2016-03-24T06:23:43.755-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 891 2016-03-24T06:23:43.785-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 891 2016-03-24T06:23:43.815-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 891 2016-03-24T06:23:43.845-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 891 2016-03-24T06:23:43.875-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 891 2016-03-24T06:23:43.905-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 891 2016-03-24T06:23:43.935-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 891 2016-03-24T06:23:43.965-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 891 2016-03-24T06:23:43.995-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 891 2016-03-24T06:23:44.025-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 891 2016-03-24T06:23:44.055-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 891 2016-03-24T06:23:44.085-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 891 2016-03-24T06:23:44.115-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 891 2016-03-24T06:23:44.145-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 891 2016-03-24T06:23:44.175-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 891 2016-03-24T06:23:44.205-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 891 2016-03-24T06:23:44.235-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 891 2016-03-24T06:23:44.258-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7540000 QueuedCount 40442 2016-03-24T06:23:44.265-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 891 2016-03-24T06:23:44.295-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 891 2016-03-24T06:23:44.325-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 891 2016-03-24T06:23:44.355-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 891 2016-03-24T06:23:44.385-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 891 2016-03-24T06:23:44.412-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7550000 QueuedCount 30442 2016-03-24T06:23:44.415-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 891 2016-03-24T06:23:44.445-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 891 2016-03-24T06:23:44.475-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 891 2016-03-24T06:23:44.505-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 891 2016-03-24T06:23:44.535-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 891 2016-03-24T06:23:44.565-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 891 2016-03-24T06:23:44.595-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 891 2016-03-24T06:23:44.625-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 891 2016-03-24T06:23:44.655-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 891 2016-03-24T06:23:44.685-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 891 2016-03-24T06:23:44.715-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 891 2016-03-24T06:23:44.745-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 891 2016-03-24T06:23:44.775-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 891 2016-03-24T06:23:44.805-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 891 2016-03-24T06:23:44.835-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 891 2016-03-24T06:23:44.865-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 891 2016-03-24T06:23:44.895-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 891 2016-03-24T06:23:44.925-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 891 2016-03-24T06:23:44.955-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 891 2016-03-24T06:23:44.985-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 891 2016-03-24T06:23:45.015-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 891 2016-03-24T06:23:45.045-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 891 2016-03-24T06:23:45.075-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 891 2016-03-24T06:23:45.105-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 891 2016-03-24T06:23:45.135-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 891 2016-03-24T06:23:45.165-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 891 2016-03-24T06:23:45.195-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 891 2016-03-24T06:23:45.221-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7560000 QueuedCount 20442 2016-03-24T06:23:45.225-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 891 2016-03-24T06:23:45.255-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 891 2016-03-24T06:23:45.285-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 891 2016-03-24T06:23:45.315-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 891 2016-03-24T06:23:45.336-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7570000 QueuedCount 10442 2016-03-24T06:23:45.345-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 891 2016-03-24T06:23:45.375-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 891 2016-03-24T06:23:45.405-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 891 2016-03-24T06:23:45.435-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 891 2016-03-24T06:23:45.465-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 891 2016-03-24T06:23:45.495-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 891 2016-03-24T06:23:45.525-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 891 2016-03-24T06:23:45.555-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 891 2016-03-24T06:23:45.585-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 891 2016-03-24T06:23:45.615-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 891 2016-03-24T06:23:45.645-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 891 2016-03-24T06:23:45.675-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 891 2016-03-24T06:23:45.705-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 891 2016-03-24T06:23:45.735-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 891 2016-03-24T06:23:45.765-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 891 2016-03-24T06:23:45.795-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 891 2016-03-24T06:23:45.825-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 891 2016-03-24T06:23:45.855-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 891 2016-03-24T06:23:45.885-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 891 2016-03-24T06:23:45.915-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 891 2016-03-24T06:23:45.945-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 891 2016-03-24T06:23:45.975-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 891 2016-03-24T06:23:46.005-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 891 2016-03-24T06:23:46.035-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 891 2016-03-24T06:23:46.058-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7580000 QueuedCount 442 2016-03-24T06:23:46.065-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 891 2016-03-24T06:23:46.095-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 891 2016-03-24T06:23:46.125-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 891 2016-03-24T06:23:46.155-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 891 2016-03-24T06:23:46.185-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 891 2016-03-24T06:23:46.215-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 891 2016-03-24T06:23:46.245-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 891 2016-03-24T06:23:46.275-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 891 2016-03-24T06:23:46.305-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 891 2016-03-24T06:23:46.335-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 891 2016-03-24T06:23:46.365-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 891 2016-03-24T06:23:46.395-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 891 2016-03-24T06:23:46.425-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 891 2016-03-24T06:23:46.455-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 891 2016-03-24T06:23:46.485-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 891 2016-03-24T06:23:46.515-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 891 2016-03-24T06:23:46.545-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 891 2016-03-24T06:23:46.575-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 891 2016-03-24T06:23:46.605-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 891 2016-03-24T06:23:46.635-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 891 2016-03-24T06:23:46.639-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 5.489µs CommitTime 555.058862ms TotalFlushTime 6m54.721119087s TotalCommitTime 50.084872112s 2016-03-24T06:23:46.639-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7580442, 7580442, 83 committed:true 2016-03-24T06:23:46.639-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7580442, 7580442, 83 committed:true) SnapCreateDur 565.793074ms SnapOpenDur 48.999µs 2016-03-24T06:23:46.665-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 891 2016-03-24T06:23:46.695-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 891 2016-03-24T06:23:46.725-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 891 2016-03-24T06:23:46.755-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 891 2016-03-24T06:23:46.785-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 891 2016-03-24T06:23:46.815-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 891 2016-03-24T06:23:46.845-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 891 2016-03-24T06:23:46.875-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 891 2016-03-24T06:23:46.895-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7590000 QueuedCount 1037 2016-03-24T06:23:46.905-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 891 2016-03-24T06:23:46.935-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 891 2016-03-24T06:23:46.965-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 891 2016-03-24T06:23:46.995-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 891 2016-03-24T06:23:47.025-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 891 2016-03-24T06:23:47.055-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 891 2016-03-24T06:23:47.085-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 891 2016-03-24T06:23:47.115-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 891 2016-03-24T06:23:47.145-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 891 2016-03-24T06:23:47.175-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 891 2016-03-24T06:23:47.205-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 891 2016-03-24T06:23:47.235-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 891 2016-03-24T06:23:47.265-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 891 2016-03-24T06:23:47.295-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 891 2016-03-24T06:23:47.325-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 891 2016-03-24T06:23:47.355-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 891 2016-03-24T06:23:47.385-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 891 2016-03-24T06:23:47.415-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 891 2016-03-24T06:23:47.445-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 891 2016-03-24T06:23:47.475-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 891 2016-03-24T06:23:47.505-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 891 2016-03-24T06:23:47.535-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 891 2016-03-24T06:23:47.565-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 891 2016-03-24T06:23:47.595-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 891 2016-03-24T06:23:47.598-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.28µs CommitTime 651.449797ms TotalFlushTime 6m54.970326522s TotalCommitTime 50.736321909s 2016-03-24T06:23:47.598-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7591037, 7591037, 84 committed:true 2016-03-24T06:23:47.598-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7591037, 7591037, 84 committed:true) SnapCreateDur 676.43834ms SnapOpenDur 39.438µs 2016-03-24T06:23:47.623-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.625-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 891 2016-03-24T06:23:47.647-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.655-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 891 2016-03-24T06:23:47.673-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.685-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 891 2016-03-24T06:23:47.699-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.715-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 891 2016-03-24T06:23:47.728-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.745-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 891 2016-03-24T06:23:47.752-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.756-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7600000 QueuedCount 16481 2016-03-24T06:23:47.776-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 891 2016-03-24T06:23:47.785-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.805-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 891 2016-03-24T06:23:47.82-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:47.835-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 891 2016-03-24T06:23:47.913-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12940000 2016-03-24T06:23:47.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12950000 2016-03-24T06:23:48.003-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7610000 QueuedCount 50000 2016-03-24T06:23:48.032-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12960000 2016-03-24T06:23:48.103-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12970000 2016-03-24T06:23:48.181-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12980000 2016-03-24T06:23:48.266-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 12990000 2016-03-24T06:23:48.362-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13000000 2016-03-24T06:23:48.471-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13010000 2016-03-24T06:23:48.58-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13020000 2016-03-24T06:23:48.694-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13030000 2016-03-24T06:23:49.449-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7620000 QueuedCount 50000 2016-03-24T06:23:49.587-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:49.762-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7630000 QueuedCount 50000 2016-03-24T06:23:50.888-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:50.91-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:51.06-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7640000 QueuedCount 50000 2016-03-24T06:23:51.418-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7650000 QueuedCount 49997 2016-03-24T06:23:51.419-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:51.454-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:52.453-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7660000 QueuedCount 50000 2016-03-24T06:23:52.559-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:52.614-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7670000 QueuedCount 50000 2016-03-24T06:23:53.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 901 2016-03-24T06:23:53.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 901 2016-03-24T06:23:53.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 901 2016-03-24T06:23:53.873-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7680000 QueuedCount 47666 2016-03-24T06:23:53.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 901 2016-03-24T06:23:53.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 901 2016-03-24T06:23:53.953-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 901 2016-03-24T06:23:53.983-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 901 2016-03-24T06:23:54.013-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 901 2016-03-24T06:23:54.043-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 901 2016-03-24T06:23:54.073-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 901 2016-03-24T06:23:54.103-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 901 2016-03-24T06:23:54.133-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 901 2016-03-24T06:23:54.135-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7690000 QueuedCount 37666 2016-03-24T06:23:54.163-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 901 2016-03-24T06:23:54.193-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 901 2016-03-24T06:23:54.223-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 901 2016-03-24T06:23:54.253-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 901 2016-03-24T06:23:54.283-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 901 2016-03-24T06:23:54.313-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 901 2016-03-24T06:23:54.343-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 901 2016-03-24T06:23:54.373-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 901 2016-03-24T06:23:54.403-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 901 2016-03-24T06:23:54.433-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 901 2016-03-24T06:23:54.463-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 901 2016-03-24T06:23:54.493-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 901 2016-03-24T06:23:54.523-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 901 2016-03-24T06:23:54.553-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 901 2016-03-24T06:23:54.583-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 901 2016-03-24T06:23:54.613-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 901 2016-03-24T06:23:54.643-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 901 2016-03-24T06:23:54.673-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 901 2016-03-24T06:23:54.703-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 901 2016-03-24T06:23:54.733-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 901 2016-03-24T06:23:54.763-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 901 2016-03-24T06:23:54.793-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 901 2016-03-24T06:23:54.823-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 901 2016-03-24T06:23:54.853-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 901 2016-03-24T06:23:54.883-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 901 2016-03-24T06:23:54.913-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 901 2016-03-24T06:23:54.943-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 901 2016-03-24T06:23:54.973-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 901 2016-03-24T06:23:55.003-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 901 2016-03-24T06:23:55.033-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 901 2016-03-24T06:23:55.043-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7700000 QueuedCount 27666 2016-03-24T06:23:55.063-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 901 2016-03-24T06:23:55.093-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 901 2016-03-24T06:23:55.123-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 901 2016-03-24T06:23:55.153-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 901 2016-03-24T06:23:55.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 901 2016-03-24T06:23:55.188-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7710000 QueuedCount 17666 2016-03-24T06:23:55.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 901 2016-03-24T06:23:55.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 901 2016-03-24T06:23:55.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 901 2016-03-24T06:23:55.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 901 2016-03-24T06:23:55.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 901 2016-03-24T06:23:55.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 901 2016-03-24T06:23:55.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 901 2016-03-24T06:23:55.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 901 2016-03-24T06:23:55.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 901 2016-03-24T06:23:55.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 901 2016-03-24T06:23:55.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 901 2016-03-24T06:23:55.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 901 2016-03-24T06:23:55.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 901 2016-03-24T06:23:55.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 901 2016-03-24T06:23:55.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 901 2016-03-24T06:23:55.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 901 2016-03-24T06:23:55.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 901 2016-03-24T06:23:55.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 901 2016-03-24T06:23:55.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 901 2016-03-24T06:23:55.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 901 2016-03-24T06:23:55.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 901 2016-03-24T06:23:55.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 901 2016-03-24T06:23:55.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 901 2016-03-24T06:23:55.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 901 2016-03-24T06:23:55.916-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":3920345289,"bucket-1:by_email_name_street:avg_ts_items_count":51849,"bucket-1:by_email_name_street:build_progress":38,"bucket-1:by_email_name_street:data_size":2902003327,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":10135490560,"bucket-1:by_email_name_street:flush_queue_size":13747,"bucket-1:by_email_name_street:frag_percent":71,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":1177567703,"bucket-1:by_email_name_street:items_count":7591037,"bucket-1:by_email_name_street:num_commits":84,"bucket-1:by_email_name_street:num_compactions":3,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":7716471,"bucket-1:by_email_name_street:num_docs_pending":6961459,"bucket-1:by_email_name_street:num_docs_queued":5322070,"bucket-1:by_email_name_street:num_flush_queued":7727666,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":84,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":958612091,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"84 50736321909 419656576934463461","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"7713920 78951032257 -519470658076935443","bucket-1:by_email_name_street:timings/storage_handle_open":"84 814108216 658135983852056404","bucket-1:by_email_name_street:timings/storage_info":"337 6906974 1151322053056","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"86 39228490 21037628110330","bucket-1:by_email_name_street:timings/storage_meta_set":"84 42410003 26219483629261","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"15427839 335944853849 1751248023419974677","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5310873,"bucket-1:num_mutations_queued":13038539,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":400,"memory_quota":104857600000,"memory_used":7694589952,"needs_restart":false,"num_connections":0,"timings/stats_response":"1869 331021894 718441200295212"} 2016-03-24T06:23:55.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 901 2016-03-24T06:23:55.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 901 2016-03-24T06:23:55.985-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7720000 QueuedCount 7666 2016-03-24T06:23:55.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 901 2016-03-24T06:23:56.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 901 2016-03-24T06:23:56.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 901 2016-03-24T06:23:56.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 901 2016-03-24T06:23:56.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 901 2016-03-24T06:23:56.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 901 2016-03-24T06:23:56.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 901 2016-03-24T06:23:56.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 901 2016-03-24T06:23:56.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 901 2016-03-24T06:23:56.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 901 2016-03-24T06:23:56.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 901 2016-03-24T06:23:56.323-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 901 2016-03-24T06:23:56.353-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 901 2016-03-24T06:23:56.383-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 901 2016-03-24T06:23:56.413-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 901 2016-03-24T06:23:56.443-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 901 2016-03-24T06:23:56.473-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 901 2016-03-24T06:23:56.503-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 901 2016-03-24T06:23:56.533-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 901 2016-03-24T06:23:56.563-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 901 2016-03-24T06:23:56.593-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 901 2016-03-24T06:23:56.623-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 901 2016-03-24T06:23:56.653-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 901 2016-03-24T06:23:56.683-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 901 2016-03-24T06:23:56.713-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 901 2016-03-24T06:23:56.743-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 901 2016-03-24T06:23:56.76-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 19.417µs CommitTime 666.142573ms TotalFlushTime 7m3.10662926s TotalCommitTime 51.402464482s 2016-03-24T06:23:56.76-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7727666, 7727666, 85 committed:true 2016-03-24T06:23:56.76-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7727666, 7727666, 85 committed:true) SnapCreateDur 676.388012ms SnapOpenDur 41.336µs 2016-03-24T06:23:56.773-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 901 2016-03-24T06:23:56.782-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 901 2016-03-24T06:23:56.804-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 901 2016-03-24T06:23:56.834-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7730000 QueuedCount 9383 2016-03-24T06:23:56.841-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 901 2016-03-24T06:23:56.868-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 901 2016-03-24T06:23:56.895-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.92-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:56.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 901 2016-03-24T06:23:56.966-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13040000 2016-03-24T06:23:56.966-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7740000 QueuedCount 41651 2016-03-24T06:23:56.968-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:57.035-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13050000 2016-03-24T06:23:57.099-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13060000 2016-03-24T06:23:57.178-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13070000 2016-03-24T06:23:57.256-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13080000 2016-03-24T06:23:57.335-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13090000 2016-03-24T06:23:57.416-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13100000 2016-03-24T06:23:57.496-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13110000 2016-03-24T06:23:57.575-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13120000 2016-03-24T06:23:57.659-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13130000 2016-03-24T06:23:57.75-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13140000 2016-03-24T06:23:57.798-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7750000 QueuedCount 50000 2016-03-24T06:23:57.818-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13150000 2016-03-24T06:23:57.878-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13160000 2016-03-24T06:23:57.939-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13170000 2016-03-24T06:23:57.989-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7760000 QueuedCount 50000 2016-03-24T06:23:58-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13180000 2016-03-24T06:23:58.065-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13190000 2016-03-24T06:23:58.11-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:23:58.134-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13200000 2016-03-24T06:23:58.196-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13210000 2016-03-24T06:23:58.265-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13220000 2016-03-24T06:23:58.358-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13230000 2016-03-24T06:23:58.45-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13240000 2016-03-24T06:23:58.555-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13250000 2016-03-24T06:23:58.667-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13260000 2016-03-24T06:23:59.269-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7770000 QueuedCount 50000 2016-03-24T06:23:59.346-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13270000 2016-03-24T06:23:59.419-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7780000 QueuedCount 40606 2016-03-24T06:23:59.461-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13280000 2016-03-24T06:24:00.752-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7790000 QueuedCount 30606 2016-03-24T06:24:02.083-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7800000 QueuedCount 20606 2016-03-24T06:24:03.257-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7810000 QueuedCount 10606 2016-03-24T06:24:03.391-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7820000 QueuedCount 606 2016-03-24T06:24:04.023-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 15.425µs CommitTime 601.665798ms TotalFlushTime 7m9.594984934s TotalCommitTime 52.00413028s 2016-03-24T06:24:04.023-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7820606, 7820606, 86 committed:true 2016-03-24T06:24:04.023-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7820606, 7820606, 86 committed:true) SnapCreateDur 614.068703ms SnapOpenDur 47.124µs 2016-03-24T06:24:04.288-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 8.343µs CommitTime 166.651077ms TotalFlushTime 7m9.637280784s TotalCommitTime 52.170781357s 2016-03-24T06:24:04.288-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7822390, 7822390, 87 committed:true 2016-03-24T06:24:04.288-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7822390, 7822390, 87 committed:true) SnapCreateDur 192.05215ms SnapOpenDur 71.071µs 2016-03-24T06:24:04.317-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.345-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.37-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.391-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.423-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.452-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:04.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 922 2016-03-24T06:24:04.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 922 2016-03-24T06:24:04.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 922 2016-03-24T06:24:04.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 922 2016-03-24T06:24:04.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 922 2016-03-24T06:24:04.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 922 2016-03-24T06:24:04.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 922 2016-03-24T06:24:04.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 922 2016-03-24T06:24:04.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 922 2016-03-24T06:24:04.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 922 2016-03-24T06:24:04.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 922 2016-03-24T06:24:04.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 922 2016-03-24T06:24:04.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 922 2016-03-24T06:24:04.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 922 2016-03-24T06:24:04.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 922 2016-03-24T06:24:04.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 922 2016-03-24T06:24:04.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 922 2016-03-24T06:24:05.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 922 2016-03-24T06:24:05.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 922 2016-03-24T06:24:05.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 922 2016-03-24T06:24:05.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 922 2016-03-24T06:24:05.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 922 2016-03-24T06:24:05.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 922 2016-03-24T06:24:05.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 922 2016-03-24T06:24:05.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 922 2016-03-24T06:24:05.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 922 2016-03-24T06:24:05.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 922 2016-03-24T06:24:05.323-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 922 2016-03-24T06:24:05.353-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 922 2016-03-24T06:24:05.383-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 922 2016-03-24T06:24:05.413-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 922 2016-03-24T06:24:05.443-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 922 2016-03-24T06:24:05.473-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 922 2016-03-24T06:24:05.503-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 922 2016-03-24T06:24:05.533-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 922 2016-03-24T06:24:05.563-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 922 2016-03-24T06:24:05.593-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 922 2016-03-24T06:24:05.623-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 922 2016-03-24T06:24:05.653-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 922 2016-03-24T06:24:05.683-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 922 2016-03-24T06:24:05.713-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 922 2016-03-24T06:24:05.743-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 922 2016-03-24T06:24:05.773-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 922 2016-03-24T06:24:05.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 922 2016-03-24T06:24:05.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 922 2016-03-24T06:24:05.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 922 2016-03-24T06:24:05.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 922 2016-03-24T06:24:05.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 922 2016-03-24T06:24:05.953-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 922 2016-03-24T06:24:05.983-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 922 2016-03-24T06:24:06.013-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 922 2016-03-24T06:24:06.043-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 922 2016-03-24T06:24:06.073-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 922 2016-03-24T06:24:06.103-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 922 2016-03-24T06:24:06.133-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 922 2016-03-24T06:24:06.163-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 922 2016-03-24T06:24:06.193-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 922 2016-03-24T06:24:06.223-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 922 2016-03-24T06:24:06.243-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7830000 QueuedCount 50000 2016-03-24T06:24:06.253-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 922 2016-03-24T06:24:06.283-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 922 2016-03-24T06:24:06.313-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 922 2016-03-24T06:24:06.343-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 922 2016-03-24T06:24:06.373-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 922 2016-03-24T06:24:06.403-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 922 2016-03-24T06:24:06.433-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 922 2016-03-24T06:24:06.463-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 922 2016-03-24T06:24:06.493-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 922 2016-03-24T06:24:06.523-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 922 2016-03-24T06:24:06.553-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 922 2016-03-24T06:24:06.559-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7840000 QueuedCount 50000 2016-03-24T06:24:06.583-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 922 2016-03-24T06:24:06.613-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 922 2016-03-24T06:24:06.643-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 922 2016-03-24T06:24:06.643-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:06.673-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 922 2016-03-24T06:24:06.703-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 922 2016-03-24T06:24:06.733-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 922 2016-03-24T06:24:06.763-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 922 2016-03-24T06:24:06.793-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 922 2016-03-24T06:24:06.823-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 922 2016-03-24T06:24:06.853-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 922 2016-03-24T06:24:06.883-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 922 2016-03-24T06:24:06.913-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 922 2016-03-24T06:24:06.943-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 922 2016-03-24T06:24:06.973-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 922 2016-03-24T06:24:07.003-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 922 2016-03-24T06:24:07.033-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 922 2016-03-24T06:24:07.063-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 922 2016-03-24T06:24:07.093-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 922 2016-03-24T06:24:07.123-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 922 2016-03-24T06:24:07.153-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 922 2016-03-24T06:24:07.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 922 2016-03-24T06:24:07.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 922 2016-03-24T06:24:07.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 922 2016-03-24T06:24:07.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 922 2016-03-24T06:24:07.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 922 2016-03-24T06:24:07.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 922 2016-03-24T06:24:07.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 922 2016-03-24T06:24:07.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 922 2016-03-24T06:24:07.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 922 2016-03-24T06:24:07.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 922 2016-03-24T06:24:07.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 922 2016-03-24T06:24:07.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 922 2016-03-24T06:24:07.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 922 2016-03-24T06:24:07.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 922 2016-03-24T06:24:07.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 922 2016-03-24T06:24:07.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 922 2016-03-24T06:24:07.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 922 2016-03-24T06:24:07.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 922 2016-03-24T06:24:07.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 922 2016-03-24T06:24:07.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 922 2016-03-24T06:24:07.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 922 2016-03-24T06:24:07.804-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7850000 QueuedCount 50000 2016-03-24T06:24:07.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 922 2016-03-24T06:24:07.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 922 2016-03-24T06:24:07.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 922 2016-03-24T06:24:07.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 922 2016-03-24T06:24:07.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 922 2016-03-24T06:24:07.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 922 2016-03-24T06:24:07.975-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7860000 QueuedCount 50000 2016-03-24T06:24:07.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 922 2016-03-24T06:24:08.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 922 2016-03-24T06:24:08.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 922 2016-03-24T06:24:08.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 922 2016-03-24T06:24:08.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 922 2016-03-24T06:24:08.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 922 2016-03-24T06:24:08.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 922 2016-03-24T06:24:08.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 922 2016-03-24T06:24:08.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 922 2016-03-24T06:24:08.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 922 2016-03-24T06:24:08.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 922 2016-03-24T06:24:08.323-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 922 2016-03-24T06:24:08.353-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 922 2016-03-24T06:24:08.383-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 922 2016-03-24T06:24:08.413-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 922 2016-03-24T06:24:08.443-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 922 2016-03-24T06:24:08.473-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 922 2016-03-24T06:24:08.503-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 922 2016-03-24T06:24:08.533-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 922 2016-03-24T06:24:08.563-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 922 2016-03-24T06:24:08.593-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 922 2016-03-24T06:24:08.623-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 922 2016-03-24T06:24:08.653-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 922 2016-03-24T06:24:08.683-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 922 2016-03-24T06:24:08.713-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 922 2016-03-24T06:24:08.743-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 922 2016-03-24T06:24:08.773-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 922 2016-03-24T06:24:08.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 922 2016-03-24T06:24:08.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 922 2016-03-24T06:24:08.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 922 2016-03-24T06:24:08.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 922 2016-03-24T06:24:08.895-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7870000 QueuedCount 50000 2016-03-24T06:24:08.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 922 2016-03-24T06:24:08.925-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:08.953-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 922 2016-03-24T06:24:08.983-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 922 2016-03-24T06:24:09.013-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 922 2016-03-24T06:24:09.043-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 922 2016-03-24T06:24:09.073-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 922 2016-03-24T06:24:09.103-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 922 2016-03-24T06:24:09.132-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:09.133-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 922 2016-03-24T06:24:09.163-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 922 2016-03-24T06:24:09.188-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7880000 QueuedCount 47887 2016-03-24T06:24:09.193-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 922 2016-03-24T06:24:09.223-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 922 2016-03-24T06:24:09.253-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 922 2016-03-24T06:24:09.283-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 922 2016-03-24T06:24:09.313-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 922 2016-03-24T06:24:09.343-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 922 2016-03-24T06:24:09.373-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 922 2016-03-24T06:24:09.403-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 922 2016-03-24T06:24:09.433-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 922 2016-03-24T06:24:09.463-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 922 2016-03-24T06:24:09.493-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 922 2016-03-24T06:24:09.523-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 922 2016-03-24T06:24:09.553-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 922 2016-03-24T06:24:09.583-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 922 2016-03-24T06:24:09.613-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 922 2016-03-24T06:24:09.643-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 922 2016-03-24T06:24:09.673-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 922 2016-03-24T06:24:09.703-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 922 2016-03-24T06:24:09.733-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 922 2016-03-24T06:24:09.763-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 922 2016-03-24T06:24:09.793-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 922 2016-03-24T06:24:09.823-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 922 2016-03-24T06:24:09.853-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 922 2016-03-24T06:24:09.883-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 922 2016-03-24T06:24:09.913-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 922 2016-03-24T06:24:09.943-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 922 2016-03-24T06:24:09.973-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 922 2016-03-24T06:24:10.003-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 922 2016-03-24T06:24:10.033-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 922 2016-03-24T06:24:10.063-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 922 2016-03-24T06:24:10.093-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 922 2016-03-24T06:24:10.123-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 922 2016-03-24T06:24:10.153-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 922 2016-03-24T06:24:10.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 922 2016-03-24T06:24:10.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 922 2016-03-24T06:24:10.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 922 2016-03-24T06:24:10.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 922 2016-03-24T06:24:10.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 922 2016-03-24T06:24:10.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 922 2016-03-24T06:24:10.363-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7890000 QueuedCount 37887 2016-03-24T06:24:10.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 922 2016-03-24T06:24:10.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 922 2016-03-24T06:24:10.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 922 2016-03-24T06:24:10.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 922 2016-03-24T06:24:10.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 922 2016-03-24T06:24:10.508-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7900000 QueuedCount 27887 2016-03-24T06:24:10.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 922 2016-03-24T06:24:10.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 922 2016-03-24T06:24:10.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 922 2016-03-24T06:24:10.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 922 2016-03-24T06:24:10.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 922 2016-03-24T06:24:10.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 922 2016-03-24T06:24:10.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 922 2016-03-24T06:24:10.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 922 2016-03-24T06:24:10.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 922 2016-03-24T06:24:10.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 922 2016-03-24T06:24:10.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 922 2016-03-24T06:24:10.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 922 2016-03-24T06:24:10.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 922 2016-03-24T06:24:10.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 922 2016-03-24T06:24:10.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 922 2016-03-24T06:24:10.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 922 2016-03-24T06:24:10.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 922 2016-03-24T06:24:11.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 922 2016-03-24T06:24:11.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 922 2016-03-24T06:24:11.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 922 2016-03-24T06:24:11.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 922 2016-03-24T06:24:11.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 922 2016-03-24T06:24:11.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 922 2016-03-24T06:24:11.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 922 2016-03-24T06:24:11.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 922 2016-03-24T06:24:11.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 922 2016-03-24T06:24:11.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 922 2016-03-24T06:24:11.323-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 922 2016-03-24T06:24:11.353-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 922 2016-03-24T06:24:11.359-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7910000 QueuedCount 17887 2016-03-24T06:24:11.383-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 922 2016-03-24T06:24:11.413-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 922 2016-03-24T06:24:11.443-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 922 2016-03-24T06:24:11.473-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 922 2016-03-24T06:24:11.476-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7920000 QueuedCount 7887 2016-03-24T06:24:11.503-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 922 2016-03-24T06:24:11.533-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 922 2016-03-24T06:24:11.563-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 922 2016-03-24T06:24:11.593-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 922 2016-03-24T06:24:11.623-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 922 2016-03-24T06:24:11.653-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 922 2016-03-24T06:24:11.683-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 922 2016-03-24T06:24:11.713-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 922 2016-03-24T06:24:11.743-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 922 2016-03-24T06:24:11.773-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 922 2016-03-24T06:24:11.803-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 922 2016-03-24T06:24:11.833-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 922 2016-03-24T06:24:11.863-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 922 2016-03-24T06:24:11.893-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 922 2016-03-24T06:24:11.923-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 922 2016-03-24T06:24:11.953-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 922 2016-03-24T06:24:11.983-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 922 2016-03-24T06:24:12.013-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 922 2016-03-24T06:24:12.043-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 922 2016-03-24T06:24:12.073-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 922 2016-03-24T06:24:12.103-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 922 2016-03-24T06:24:12.133-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 922 2016-03-24T06:24:12.163-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 922 2016-03-24T06:24:12.193-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 922 2016-03-24T06:24:12.223-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 922 2016-03-24T06:24:12.253-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 922 2016-03-24T06:24:12.283-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 922 2016-03-24T06:24:12.313-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 922 2016-03-24T06:24:12.343-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 922 2016-03-24T06:24:12.373-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 922 2016-03-24T06:24:12.403-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 922 2016-03-24T06:24:12.433-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 922 2016-03-24T06:24:12.463-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 922 2016-03-24T06:24:12.493-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 922 2016-03-24T06:24:12.523-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 922 2016-03-24T06:24:12.532-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.092µs CommitTime 359.568657ms TotalFlushTime 7m17.265418798s TotalCommitTime 52.530350014s 2016-03-24T06:24:12.532-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 7927887, 7927887, 88 committed:true 2016-03-24T06:24:12.532-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 7927887, 7927887, 88 committed:true) SnapCreateDur 369.466405ms SnapOpenDur 62.902µs 2016-03-24T06:24:12.553-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 922 2016-03-24T06:24:12.569-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.583-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 922 2016-03-24T06:24:12.594-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.613-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 922 2016-03-24T06:24:12.613-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7930000 QueuedCount 15977 2016-03-24T06:24:12.618-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.643-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 922 2016-03-24T06:24:12.643-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.67-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.673-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 922 2016-03-24T06:24:12.693-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.703-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 922 2016-03-24T06:24:12.718-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.733-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 922 2016-03-24T06:24:12.742-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.763-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 922 2016-03-24T06:24:12.768-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.793-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 922 2016-03-24T06:24:12.795-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.823-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 922 2016-03-24T06:24:12.853-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 922 2016-03-24T06:24:12.883-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 922 2016-03-24T06:24:12.913-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 922 2016-03-24T06:24:12.923-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:12.925-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7940000 QueuedCount 49938 2016-03-24T06:24:12.943-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 922 2016-03-24T06:24:12.973-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 922 2016-03-24T06:24:13.003-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 922 2016-03-24T06:24:13.033-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 922 2016-03-24T06:24:13.063-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 922 2016-03-24T06:24:13.093-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 922 2016-03-24T06:24:13.094-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:13.123-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 922 2016-03-24T06:24:13.153-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 922 2016-03-24T06:24:13.183-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 922 2016-03-24T06:24:13.213-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 922 2016-03-24T06:24:13.243-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 922 2016-03-24T06:24:13.273-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 922 2016-03-24T06:24:13.303-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 922 2016-03-24T06:24:13.333-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 922 2016-03-24T06:24:13.363-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 922 2016-03-24T06:24:13.393-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 922 2016-03-24T06:24:13.423-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 922 2016-03-24T06:24:13.453-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 922 2016-03-24T06:24:13.483-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 922 2016-03-24T06:24:13.513-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 922 2016-03-24T06:24:13.543-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 922 2016-03-24T06:24:13.573-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 922 2016-03-24T06:24:13.603-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 922 2016-03-24T06:24:13.633-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 922 2016-03-24T06:24:13.663-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 922 2016-03-24T06:24:13.693-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 922 2016-03-24T06:24:13.723-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 922 2016-03-24T06:24:13.753-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 922 2016-03-24T06:24:13.783-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 922 2016-03-24T06:24:13.813-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 922 2016-03-24T06:24:13.843-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 922 2016-03-24T06:24:13.873-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 922 2016-03-24T06:24:13.903-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 922 2016-03-24T06:24:13.933-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 922 2016-03-24T06:24:13.963-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 922 2016-03-24T06:24:13.993-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 922 2016-03-24T06:24:14.023-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 922 2016-03-24T06:24:14.053-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 922 2016-03-24T06:24:14.083-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 922 2016-03-24T06:24:14.113-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 922 2016-03-24T06:24:14.143-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 922 2016-03-24T06:24:14.173-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 922 2016-03-24T06:24:14.203-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 922 2016-03-24T06:24:14.233-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 922 2016-03-24T06:24:14.254-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7950000 QueuedCount 50000 2016-03-24T06:24:14.263-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 922 2016-03-24T06:24:14.281-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:14.293-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 922 2016-03-24T06:24:14.405-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7960000 QueuedCount 50000 2016-03-24T06:24:15.699-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7970000 QueuedCount 50000 2016-03-24T06:24:15.845-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7980000 QueuedCount 45393 2016-03-24T06:24:16.705-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 7990000 QueuedCount 35393 2016-03-24T06:24:16.826-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8000000 QueuedCount 25393 2016-03-24T06:24:17.539-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8010000 QueuedCount 15393 2016-03-24T06:24:17.65-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8020000 QueuedCount 5393 2016-03-24T06:24:18.435-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 22.21µs CommitTime 704.866301ms TotalFlushTime 7m22.26721396s TotalCommitTime 53.235216315s 2016-03-24T06:24:18.435-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8025393, 8025393, 89 committed:true 2016-03-24T06:24:18.435-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8025393, 8025393, 89 committed:true) SnapCreateDur 714.891593ms SnapOpenDur 238.74µs 2016-03-24T06:24:18.473-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13290000 2016-03-24T06:24:18.478-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.509-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.528-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8030000 QueuedCount 27787 2016-03-24T06:24:18.53-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.557-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13300000 2016-03-24T06:24:18.563-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.595-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.618-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.633-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13310000 2016-03-24T06:24:18.657-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:18.672-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8040000 QueuedCount 48821 2016-03-24T06:24:18.704-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13320000 2016-03-24T06:24:18.77-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13330000 2016-03-24T06:24:18.85-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13340000 2016-03-24T06:24:18.932-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13350000 2016-03-24T06:24:19.012-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13360000 2016-03-24T06:24:19.094-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13370000 2016-03-24T06:24:19.184-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13380000 2016-03-24T06:24:19.277-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13390000 2016-03-24T06:24:19.368-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13400000 2016-03-24T06:24:19.431-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:19.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13410000 2016-03-24T06:24:19.471-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8050000 QueuedCount 48801 2016-03-24T06:24:19.541-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13420000 2016-03-24T06:24:19.598-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8060000 QueuedCount 38801 2016-03-24T06:24:19.628-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13430000 2016-03-24T06:24:19.723-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13440000 2016-03-24T06:24:19.814-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13450000 2016-03-24T06:24:20.379-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8070000 QueuedCount 28801 2016-03-24T06:24:20.498-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8080000 QueuedCount 18801 2016-03-24T06:24:21.214-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8090000 QueuedCount 8801 2016-03-24T06:24:22.461-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 10.254µs CommitTime 1.118627245s TotalFlushTime 7m25.080076792s TotalCommitTime 54.35384356s 2016-03-24T06:24:22.461-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8098801, 8098801, 90 committed:true 2016-03-24T06:24:22.461-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8098801, 8098801, 90 committed:true) SnapCreateDur 1.144207316s SnapOpenDur 50.797µs 2016-03-24T06:24:22.488-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:22.515-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8100000 QueuedCount 10469 2016-03-24T06:24:22.515-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:22.539-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:22.584-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:22.812-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8110000 QueuedCount 50000 2016-03-24T06:24:22.882-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:22.928-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13460000 2016-03-24T06:24:23.121-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13470000 2016-03-24T06:24:23.207-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13480000 2016-03-24T06:24:23.29-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13490000 2016-03-24T06:24:23.38-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13500000 2016-03-24T06:24:23.47-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13510000 2016-03-24T06:24:23.562-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13520000 2016-03-24T06:24:23.65-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13530000 2016-03-24T06:24:23.735-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13540000 2016-03-24T06:24:23.823-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13550000 2016-03-24T06:24:23.912-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13560000 2016-03-24T06:24:24.003-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13570000 2016-03-24T06:24:24.099-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13580000 2016-03-24T06:24:24.201-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13590000 2016-03-24T06:24:24.21-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8120000 QueuedCount 50000 2016-03-24T06:24:24.267-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13600000 2016-03-24T06:24:24.334-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13610000 2016-03-24T06:24:24.373-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8130000 QueuedCount 50000 2016-03-24T06:24:24.401-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13620000 2016-03-24T06:24:24.455-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:25.149-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8140000 QueuedCount 45814 2016-03-24T06:24:25.267-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8150000 QueuedCount 35814 2016-03-24T06:24:25.395-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8160000 QueuedCount 25814 2016-03-24T06:24:26.151-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8170000 QueuedCount 15814 2016-03-24T06:24:26.286-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8180000 QueuedCount 5814 2016-03-24T06:24:27.421-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.56µs CommitTime 432.864268ms TotalFlushTime 7m29.437920676s TotalCommitTime 54.786707828s 2016-03-24T06:24:27.421-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8185814, 8185814, 91 committed:true 2016-03-24T06:24:27.421-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8185814, 8185814, 91 committed:true) SnapCreateDur 443.70154ms SnapOpenDur 49.011µs 2016-03-24T06:24:27.443-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:27.474-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:27.498-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:27.545-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:27.564-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8190000 QueuedCount 34055 2016-03-24T06:24:28.485-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8200000 QueuedCount 50000 2016-03-24T06:24:29.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 952 2016-03-24T06:24:29.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 952 2016-03-24T06:24:29.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 952 2016-03-24T06:24:29.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 952 2016-03-24T06:24:29.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 952 2016-03-24T06:24:29.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 952 2016-03-24T06:24:29.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 952 2016-03-24T06:24:29.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 952 2016-03-24T06:24:29.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 952 2016-03-24T06:24:29.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 952 2016-03-24T06:24:29.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 952 2016-03-24T06:24:29.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 952 2016-03-24T06:24:29.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 952 2016-03-24T06:24:29.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 952 2016-03-24T06:24:29.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 952 2016-03-24T06:24:29.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 952 2016-03-24T06:24:29.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 952 2016-03-24T06:24:29.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 952 2016-03-24T06:24:30.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 952 2016-03-24T06:24:30.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 952 2016-03-24T06:24:30.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 952 2016-03-24T06:24:30.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 952 2016-03-24T06:24:30.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 952 2016-03-24T06:24:30.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 952 2016-03-24T06:24:30.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 952 2016-03-24T06:24:30.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 952 2016-03-24T06:24:30.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 952 2016-03-24T06:24:30.289-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 952 2016-03-24T06:24:30.319-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 952 2016-03-24T06:24:30.349-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 952 2016-03-24T06:24:30.379-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 952 2016-03-24T06:24:30.409-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 952 2016-03-24T06:24:30.439-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 952 2016-03-24T06:24:30.469-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 952 2016-03-24T06:24:30.499-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 952 2016-03-24T06:24:30.529-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 952 2016-03-24T06:24:30.559-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 952 2016-03-24T06:24:30.589-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 952 2016-03-24T06:24:30.619-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 952 2016-03-24T06:24:30.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 952 2016-03-24T06:24:30.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 952 2016-03-24T06:24:30.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 952 2016-03-24T06:24:30.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 952 2016-03-24T06:24:30.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 952 2016-03-24T06:24:30.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 952 2016-03-24T06:24:30.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 952 2016-03-24T06:24:30.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 952 2016-03-24T06:24:30.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 952 2016-03-24T06:24:30.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 952 2016-03-24T06:24:30.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 952 2016-03-24T06:24:30.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 952 2016-03-24T06:24:31.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 952 2016-03-24T06:24:31.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 952 2016-03-24T06:24:31.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 952 2016-03-24T06:24:31.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 952 2016-03-24T06:24:31.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 952 2016-03-24T06:24:31.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 952 2016-03-24T06:24:31.171-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:31.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 952 2016-03-24T06:24:31.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 952 2016-03-24T06:24:31.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 952 2016-03-24T06:24:31.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 952 2016-03-24T06:24:31.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 952 2016-03-24T06:24:31.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 952 2016-03-24T06:24:31.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 952 2016-03-24T06:24:31.399-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 952 2016-03-24T06:24:31.429-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 952 2016-03-24T06:24:31.459-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 952 2016-03-24T06:24:31.481-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8210000 QueuedCount 50000 2016-03-24T06:24:31.489-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 952 2016-03-24T06:24:31.519-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 952 2016-03-24T06:24:31.549-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 952 2016-03-24T06:24:31.579-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 952 2016-03-24T06:24:31.609-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 952 2016-03-24T06:24:31.639-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 952 2016-03-24T06:24:31.669-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 952 2016-03-24T06:24:31.699-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 952 2016-03-24T06:24:31.729-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 952 2016-03-24T06:24:31.759-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 952 2016-03-24T06:24:31.789-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 952 2016-03-24T06:24:31.792-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8220000 QueuedCount 47757 2016-03-24T06:24:31.819-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 952 2016-03-24T06:24:31.849-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 952 2016-03-24T06:24:31.879-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 952 2016-03-24T06:24:31.909-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 952 2016-03-24T06:24:31.939-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 952 2016-03-24T06:24:31.969-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 952 2016-03-24T06:24:31.999-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 952 2016-03-24T06:24:32.029-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 952 2016-03-24T06:24:32.059-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 952 2016-03-24T06:24:32.089-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 952 2016-03-24T06:24:32.119-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 952 2016-03-24T06:24:32.149-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 952 2016-03-24T06:24:32.179-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 952 2016-03-24T06:24:32.209-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 952 2016-03-24T06:24:32.239-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 952 2016-03-24T06:24:32.269-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 952 2016-03-24T06:24:32.299-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 952 2016-03-24T06:24:32.329-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 952 2016-03-24T06:24:32.359-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 952 2016-03-24T06:24:32.389-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 952 2016-03-24T06:24:32.419-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 952 2016-03-24T06:24:32.449-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 952 2016-03-24T06:24:32.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 952 2016-03-24T06:24:32.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 952 2016-03-24T06:24:32.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 952 2016-03-24T06:24:32.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 952 2016-03-24T06:24:32.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 952 2016-03-24T06:24:32.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 952 2016-03-24T06:24:32.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 952 2016-03-24T06:24:32.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 952 2016-03-24T06:24:32.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 952 2016-03-24T06:24:32.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 952 2016-03-24T06:24:32.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 952 2016-03-24T06:24:32.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 952 2016-03-24T06:24:32.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 952 2016-03-24T06:24:32.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 952 2016-03-24T06:24:32.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 952 2016-03-24T06:24:32.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 952 2016-03-24T06:24:32.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 952 2016-03-24T06:24:32.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 952 2016-03-24T06:24:33.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 952 2016-03-24T06:24:33.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 952 2016-03-24T06:24:33.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 952 2016-03-24T06:24:33.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 952 2016-03-24T06:24:33.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 952 2016-03-24T06:24:33.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 952 2016-03-24T06:24:33.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 952 2016-03-24T06:24:33.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 952 2016-03-24T06:24:33.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 952 2016-03-24T06:24:33.289-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 952 2016-03-24T06:24:33.319-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 952 2016-03-24T06:24:33.349-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 952 2016-03-24T06:24:33.379-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 952 2016-03-24T06:24:33.409-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 952 2016-03-24T06:24:33.439-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 952 2016-03-24T06:24:33.469-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 952 2016-03-24T06:24:33.499-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 952 2016-03-24T06:24:33.529-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 952 2016-03-24T06:24:33.559-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 952 2016-03-24T06:24:33.589-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 952 2016-03-24T06:24:33.619-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 952 2016-03-24T06:24:33.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 952 2016-03-24T06:24:33.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 952 2016-03-24T06:24:33.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 952 2016-03-24T06:24:33.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 952 2016-03-24T06:24:33.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 952 2016-03-24T06:24:33.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 952 2016-03-24T06:24:33.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 952 2016-03-24T06:24:33.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 952 2016-03-24T06:24:33.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 952 2016-03-24T06:24:33.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 952 2016-03-24T06:24:33.938-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8230000 QueuedCount 37757 2016-03-24T06:24:33.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 952 2016-03-24T06:24:33.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 952 2016-03-24T06:24:34.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 952 2016-03-24T06:24:34.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 952 2016-03-24T06:24:34.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 952 2016-03-24T06:24:34.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 952 2016-03-24T06:24:34.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 952 2016-03-24T06:24:34.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 952 2016-03-24T06:24:34.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 952 2016-03-24T06:24:34.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 952 2016-03-24T06:24:34.24-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8240000 QueuedCount 27757 2016-03-24T06:24:34.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 952 2016-03-24T06:24:34.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 952 2016-03-24T06:24:34.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 952 2016-03-24T06:24:34.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 952 2016-03-24T06:24:34.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 952 2016-03-24T06:24:34.399-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 952 2016-03-24T06:24:34.429-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 952 2016-03-24T06:24:34.459-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 952 2016-03-24T06:24:34.489-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 952 2016-03-24T06:24:34.519-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 952 2016-03-24T06:24:34.549-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 952 2016-03-24T06:24:34.579-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 952 2016-03-24T06:24:34.609-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 952 2016-03-24T06:24:34.639-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 952 2016-03-24T06:24:34.669-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 952 2016-03-24T06:24:34.699-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 952 2016-03-24T06:24:34.729-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 952 2016-03-24T06:24:34.759-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 952 2016-03-24T06:24:34.789-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 952 2016-03-24T06:24:34.819-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 952 2016-03-24T06:24:34.849-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 952 2016-03-24T06:24:34.879-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 952 2016-03-24T06:24:34.909-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 952 2016-03-24T06:24:34.939-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 952 2016-03-24T06:24:34.969-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 952 2016-03-24T06:24:34.999-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 952 2016-03-24T06:24:35.029-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 952 2016-03-24T06:24:35.059-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 952 2016-03-24T06:24:35.089-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 952 2016-03-24T06:24:35.119-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 952 2016-03-24T06:24:35.149-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 952 2016-03-24T06:24:35.179-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 952 2016-03-24T06:24:35.209-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 952 2016-03-24T06:24:35.239-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 952 2016-03-24T06:24:35.269-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 952 2016-03-24T06:24:35.299-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 952 2016-03-24T06:24:35.329-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 952 2016-03-24T06:24:35.359-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 952 2016-03-24T06:24:35.384-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8250000 QueuedCount 17757 2016-03-24T06:24:35.389-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 952 2016-03-24T06:24:35.419-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 952 2016-03-24T06:24:35.449-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 952 2016-03-24T06:24:35.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 952 2016-03-24T06:24:35.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 952 2016-03-24T06:24:35.522-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8260000 QueuedCount 7757 2016-03-24T06:24:35.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 952 2016-03-24T06:24:35.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 952 2016-03-24T06:24:35.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 952 2016-03-24T06:24:35.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 952 2016-03-24T06:24:35.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 952 2016-03-24T06:24:35.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 952 2016-03-24T06:24:35.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 952 2016-03-24T06:24:35.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 952 2016-03-24T06:24:35.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 952 2016-03-24T06:24:35.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 952 2016-03-24T06:24:35.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 952 2016-03-24T06:24:35.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 952 2016-03-24T06:24:35.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 952 2016-03-24T06:24:35.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 952 2016-03-24T06:24:35.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 952 2016-03-24T06:24:35.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 952 2016-03-24T06:24:36.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 952 2016-03-24T06:24:36.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 952 2016-03-24T06:24:36.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 952 2016-03-24T06:24:36.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 952 2016-03-24T06:24:36.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 952 2016-03-24T06:24:36.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 952 2016-03-24T06:24:36.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 952 2016-03-24T06:24:36.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 952 2016-03-24T06:24:36.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 952 2016-03-24T06:24:36.289-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 952 2016-03-24T06:24:36.319-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 952 2016-03-24T06:24:36.349-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 952 2016-03-24T06:24:36.379-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 952 2016-03-24T06:24:36.409-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 952 2016-03-24T06:24:36.439-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 952 2016-03-24T06:24:36.469-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 952 2016-03-24T06:24:36.499-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 952 2016-03-24T06:24:36.529-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 952 2016-03-24T06:24:36.559-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 952 2016-03-24T06:24:36.589-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 952 2016-03-24T06:24:36.59-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 19.626µs CommitTime 260.853361ms TotalFlushTime 7m38.124848389s TotalCommitTime 55.047561189s 2016-03-24T06:24:36.59-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8267757, 8267757, 92 committed:true 2016-03-24T06:24:36.59-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8267757, 8267757, 92 committed:true) SnapCreateDur 271.120208ms SnapOpenDur 51.942µs 2016-03-24T06:24:36.619-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 952 2016-03-24T06:24:36.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 952 2016-03-24T06:24:36.67-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8270000 QueuedCount 1253 2016-03-24T06:24:36.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 952 2016-03-24T06:24:36.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 952 2016-03-24T06:24:36.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 952 2016-03-24T06:24:36.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 952 2016-03-24T06:24:36.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 952 2016-03-24T06:24:36.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 952 2016-03-24T06:24:36.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 952 2016-03-24T06:24:36.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 952 2016-03-24T06:24:36.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 952 2016-03-24T06:24:36.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 952 2016-03-24T06:24:36.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 952 2016-03-24T06:24:37.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 952 2016-03-24T06:24:37.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 952 2016-03-24T06:24:37.064-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 16.22µs CommitTime 334.541895ms TotalFlushTime 7m38.21482776s TotalCommitTime 55.382103084s 2016-03-24T06:24:37.064-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8271253, 8271253, 93 committed:true 2016-03-24T06:24:37.064-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8271253, 8271253, 93 committed:true) SnapCreateDur 359.555946ms SnapOpenDur 59.017µs 2016-03-24T06:24:37.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 952 2016-03-24T06:24:37.089-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 952 2016-03-24T06:24:37.113-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 952 2016-03-24T06:24:37.137-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 952 2016-03-24T06:24:37.164-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.185-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 952 2016-03-24T06:24:37.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 952 2016-03-24T06:24:37.22-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.244-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 952 2016-03-24T06:24:37.271-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.278-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8280000 QueuedCount 27630 2016-03-24T06:24:37.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 952 2016-03-24T06:24:37.292-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 952 2016-03-24T06:24:37.32-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 952 2016-03-24T06:24:37.35-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:37.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 952 2016-03-24T06:24:37.401-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13630000 2016-03-24T06:24:37.455-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8290000 QueuedCount 50000 2016-03-24T06:24:37.467-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13640000 2016-03-24T06:24:37.541-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13650000 2016-03-24T06:24:37.616-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13660000 2016-03-24T06:24:37.691-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13670000 2016-03-24T06:24:37.774-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13680000 2016-03-24T06:24:37.872-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13690000 2016-03-24T06:24:37.982-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13700000 2016-03-24T06:24:38.094-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13710000 2016-03-24T06:24:38.211-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13720000 2016-03-24T06:24:38.319-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13730000 2016-03-24T06:24:38.424-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13740000 2016-03-24T06:24:38.537-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13750000 2016-03-24T06:24:38.655-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13760000 2016-03-24T06:24:38.817-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8300000 QueuedCount 50000 2016-03-24T06:24:38.888-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:39.104-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8310000 QueuedCount 50000 2016-03-24T06:24:41.004-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8320000 QueuedCount 50000 2016-03-24T06:24:41.332-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8330000 QueuedCount 50000 2016-03-24T06:24:43.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 966 2016-03-24T06:24:43.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 966 2016-03-24T06:24:43.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 966 2016-03-24T06:24:43.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 966 2016-03-24T06:24:43.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 966 2016-03-24T06:24:43.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 966 2016-03-24T06:24:43.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 966 2016-03-24T06:24:43.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 966 2016-03-24T06:24:43.947-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:43.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 966 2016-03-24T06:24:44.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 966 2016-03-24T06:24:44.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 966 2016-03-24T06:24:44.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 966 2016-03-24T06:24:44.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 966 2016-03-24T06:24:44.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 966 2016-03-24T06:24:44.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 966 2016-03-24T06:24:44.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 966 2016-03-24T06:24:44.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 966 2016-03-24T06:24:44.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 966 2016-03-24T06:24:44.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 966 2016-03-24T06:24:44.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 966 2016-03-24T06:24:44.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 966 2016-03-24T06:24:44.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 966 2016-03-24T06:24:44.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 966 2016-03-24T06:24:44.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 966 2016-03-24T06:24:44.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 966 2016-03-24T06:24:44.459-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8340000 QueuedCount 46089 2016-03-24T06:24:44.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 966 2016-03-24T06:24:44.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 966 2016-03-24T06:24:44.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 966 2016-03-24T06:24:44.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 966 2016-03-24T06:24:44.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 966 2016-03-24T06:24:44.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 966 2016-03-24T06:24:44.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 966 2016-03-24T06:24:44.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 966 2016-03-24T06:24:44.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 966 2016-03-24T06:24:44.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 966 2016-03-24T06:24:44.766-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8350000 QueuedCount 36089 2016-03-24T06:24:44.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 966 2016-03-24T06:24:44.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 966 2016-03-24T06:24:44.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 966 2016-03-24T06:24:44.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 966 2016-03-24T06:24:44.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 966 2016-03-24T06:24:44.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 966 2016-03-24T06:24:44.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 966 2016-03-24T06:24:44.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 966 2016-03-24T06:24:45.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 966 2016-03-24T06:24:45.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 966 2016-03-24T06:24:45.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 966 2016-03-24T06:24:45.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 966 2016-03-24T06:24:45.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 966 2016-03-24T06:24:45.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 966 2016-03-24T06:24:45.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 966 2016-03-24T06:24:45.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 966 2016-03-24T06:24:45.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 966 2016-03-24T06:24:45.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 966 2016-03-24T06:24:45.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 966 2016-03-24T06:24:45.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 966 2016-03-24T06:24:45.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 966 2016-03-24T06:24:45.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 966 2016-03-24T06:24:45.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 966 2016-03-24T06:24:45.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 966 2016-03-24T06:24:45.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 966 2016-03-24T06:24:45.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 966 2016-03-24T06:24:45.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 966 2016-03-24T06:24:45.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 966 2016-03-24T06:24:45.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 966 2016-03-24T06:24:45.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 966 2016-03-24T06:24:45.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 966 2016-03-24T06:24:45.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 966 2016-03-24T06:24:45.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 966 2016-03-24T06:24:45.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 966 2016-03-24T06:24:45.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 966 2016-03-24T06:24:45.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 966 2016-03-24T06:24:45.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 966 2016-03-24T06:24:45.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 966 2016-03-24T06:24:45.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 966 2016-03-24T06:24:45.927-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8360000 QueuedCount 26089 2016-03-24T06:24:45.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 966 2016-03-24T06:24:45.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 966 2016-03-24T06:24:46.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 966 2016-03-24T06:24:46.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 966 2016-03-24T06:24:46.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 966 2016-03-24T06:24:46.084-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8370000 QueuedCount 16089 2016-03-24T06:24:46.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 966 2016-03-24T06:24:46.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 966 2016-03-24T06:24:46.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 966 2016-03-24T06:24:46.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 966 2016-03-24T06:24:46.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 966 2016-03-24T06:24:46.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 966 2016-03-24T06:24:46.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 966 2016-03-24T06:24:46.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 966 2016-03-24T06:24:46.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 966 2016-03-24T06:24:46.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 966 2016-03-24T06:24:46.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 966 2016-03-24T06:24:46.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 966 2016-03-24T06:24:46.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 966 2016-03-24T06:24:46.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 966 2016-03-24T06:24:46.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 966 2016-03-24T06:24:46.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 966 2016-03-24T06:24:46.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 966 2016-03-24T06:24:46.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 966 2016-03-24T06:24:46.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 966 2016-03-24T06:24:46.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 966 2016-03-24T06:24:46.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 966 2016-03-24T06:24:46.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 966 2016-03-24T06:24:46.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 966 2016-03-24T06:24:46.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 966 2016-03-24T06:24:46.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 966 2016-03-24T06:24:46.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 966 2016-03-24T06:24:46.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 966 2016-03-24T06:24:46.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 966 2016-03-24T06:24:46.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 966 2016-03-24T06:24:46.957-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8380000 QueuedCount 6089 2016-03-24T06:24:46.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 966 2016-03-24T06:24:47.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 966 2016-03-24T06:24:47.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 966 2016-03-24T06:24:47.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 966 2016-03-24T06:24:47.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 966 2016-03-24T06:24:47.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 966 2016-03-24T06:24:47.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 966 2016-03-24T06:24:47.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 966 2016-03-24T06:24:47.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 966 2016-03-24T06:24:47.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 966 2016-03-24T06:24:47.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 966 2016-03-24T06:24:47.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 966 2016-03-24T06:24:47.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 966 2016-03-24T06:24:47.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 966 2016-03-24T06:24:47.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 966 2016-03-24T06:24:47.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 966 2016-03-24T06:24:47.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 966 2016-03-24T06:24:47.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 966 2016-03-24T06:24:47.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 966 2016-03-24T06:24:47.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 966 2016-03-24T06:24:47.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 966 2016-03-24T06:24:47.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 966 2016-03-24T06:24:47.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 966 2016-03-24T06:24:47.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 966 2016-03-24T06:24:47.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 966 2016-03-24T06:24:47.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 966 2016-03-24T06:24:47.753-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.938µs CommitTime 695.003164ms TotalFlushTime 7m47.922572993s TotalCommitTime 56.077106248s 2016-03-24T06:24:47.753-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8386089, 8386089, 94 committed:true 2016-03-24T06:24:47.754-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8386089, 8386089, 94 committed:true) SnapCreateDur 705.728024ms SnapOpenDur 48.391µs 2016-03-24T06:24:47.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 966 2016-03-24T06:24:47.784-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:47.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 966 2016-03-24T06:24:47.814-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:47.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 966 2016-03-24T06:24:47.84-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:47.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 966 2016-03-24T06:24:47.865-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:47.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 966 2016-03-24T06:24:47.881-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8390000 QueuedCount 25584 2016-03-24T06:24:47.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 966 2016-03-24T06:24:47.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 966 2016-03-24T06:24:47.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 966 2016-03-24T06:24:47.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 966 2016-03-24T06:24:48.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 966 2016-03-24T06:24:48.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 966 2016-03-24T06:24:48.066-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:48.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 966 2016-03-24T06:24:48.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 966 2016-03-24T06:24:48.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 966 2016-03-24T06:24:48.174-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8400000 QueuedCount 50000 2016-03-24T06:24:48.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 966 2016-03-24T06:24:48.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 966 2016-03-24T06:24:48.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 966 2016-03-24T06:24:48.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 966 2016-03-24T06:24:48.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 966 2016-03-24T06:24:48.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 966 2016-03-24T06:24:48.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 966 2016-03-24T06:24:48.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 966 2016-03-24T06:24:48.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 966 2016-03-24T06:24:48.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 966 2016-03-24T06:24:48.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 966 2016-03-24T06:24:48.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 966 2016-03-24T06:24:48.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 966 2016-03-24T06:24:48.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 966 2016-03-24T06:24:48.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 966 2016-03-24T06:24:48.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 966 2016-03-24T06:24:48.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 966 2016-03-24T06:24:48.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 966 2016-03-24T06:24:48.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 966 2016-03-24T06:24:48.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 966 2016-03-24T06:24:48.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 966 2016-03-24T06:24:48.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 966 2016-03-24T06:24:48.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 966 2016-03-24T06:24:48.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 966 2016-03-24T06:24:48.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 966 2016-03-24T06:24:48.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 966 2016-03-24T06:24:48.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 966 2016-03-24T06:24:48.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 966 2016-03-24T06:24:49.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 966 2016-03-24T06:24:49.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 966 2016-03-24T06:24:49.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 966 2016-03-24T06:24:49.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 966 2016-03-24T06:24:49.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 966 2016-03-24T06:24:49.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 966 2016-03-24T06:24:49.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 966 2016-03-24T06:24:49.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 966 2016-03-24T06:24:49.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 966 2016-03-24T06:24:49.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 966 2016-03-24T06:24:49.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 966 2016-03-24T06:24:49.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 966 2016-03-24T06:24:49.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 966 2016-03-24T06:24:49.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 966 2016-03-24T06:24:49.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 966 2016-03-24T06:24:49.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 966 2016-03-24T06:24:49.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 966 2016-03-24T06:24:49.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 966 2016-03-24T06:24:49.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 966 2016-03-24T06:24:49.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 966 2016-03-24T06:24:49.6-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8410000 QueuedCount 50000 2016-03-24T06:24:49.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 966 2016-03-24T06:24:49.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 966 2016-03-24T06:24:49.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 966 2016-03-24T06:24:49.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 966 2016-03-24T06:24:49.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 966 2016-03-24T06:24:49.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 966 2016-03-24T06:24:49.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 966 2016-03-24T06:24:49.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 966 2016-03-24T06:24:49.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 966 2016-03-24T06:24:49.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 966 2016-03-24T06:24:49.895-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8420000 QueuedCount 50000 2016-03-24T06:24:49.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 966 2016-03-24T06:24:49.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 966 2016-03-24T06:24:49.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 966 2016-03-24T06:24:50.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 966 2016-03-24T06:24:50.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 966 2016-03-24T06:24:50.049-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:50.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 966 2016-03-24T06:24:50.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 966 2016-03-24T06:24:50.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 966 2016-03-24T06:24:50.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 966 2016-03-24T06:24:50.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 966 2016-03-24T06:24:50.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 966 2016-03-24T06:24:50.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 966 2016-03-24T06:24:50.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 966 2016-03-24T06:24:50.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 966 2016-03-24T06:24:50.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 966 2016-03-24T06:24:50.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 966 2016-03-24T06:24:50.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 966 2016-03-24T06:24:50.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 966 2016-03-24T06:24:50.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 966 2016-03-24T06:24:50.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 966 2016-03-24T06:24:50.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 966 2016-03-24T06:24:50.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 966 2016-03-24T06:24:50.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 966 2016-03-24T06:24:50.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 966 2016-03-24T06:24:50.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 966 2016-03-24T06:24:50.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 966 2016-03-24T06:24:50.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 966 2016-03-24T06:24:50.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 966 2016-03-24T06:24:50.754-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 966 2016-03-24T06:24:50.784-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 966 2016-03-24T06:24:50.814-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 966 2016-03-24T06:24:50.844-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 966 2016-03-24T06:24:50.874-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 966 2016-03-24T06:24:50.904-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 966 2016-03-24T06:24:50.934-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 966 2016-03-24T06:24:50.964-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 966 2016-03-24T06:24:50.994-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 966 2016-03-24T06:24:51.024-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 966 2016-03-24T06:24:51.054-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 966 2016-03-24T06:24:51.084-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 966 2016-03-24T06:24:51.114-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 966 2016-03-24T06:24:51.144-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 966 2016-03-24T06:24:51.174-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 966 2016-03-24T06:24:51.204-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 966 2016-03-24T06:24:51.234-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 966 2016-03-24T06:24:51.235-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8430000 QueuedCount 46833 2016-03-24T06:24:51.264-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 966 2016-03-24T06:24:51.294-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 966 2016-03-24T06:24:51.324-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 966 2016-03-24T06:24:51.354-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 966 2016-03-24T06:24:51.375-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8440000 QueuedCount 36833 2016-03-24T06:24:51.384-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 966 2016-03-24T06:24:51.414-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 966 2016-03-24T06:24:51.444-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 966 2016-03-24T06:24:51.474-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 966 2016-03-24T06:24:51.504-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 966 2016-03-24T06:24:51.534-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 966 2016-03-24T06:24:51.564-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 966 2016-03-24T06:24:51.594-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 966 2016-03-24T06:24:51.624-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 966 2016-03-24T06:24:51.654-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 966 2016-03-24T06:24:51.684-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 966 2016-03-24T06:24:51.714-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 966 2016-03-24T06:24:51.744-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 966 2016-03-24T06:24:51.774-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 966 2016-03-24T06:24:51.804-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 966 2016-03-24T06:24:51.834-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13110 Milliseconds Vbucket 966 2016-03-24T06:24:51.864-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13140 Milliseconds Vbucket 966 2016-03-24T06:24:51.894-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13170 Milliseconds Vbucket 966 2016-03-24T06:24:51.924-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13200 Milliseconds Vbucket 966 2016-03-24T06:24:51.954-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13230 Milliseconds Vbucket 966 2016-03-24T06:24:51.984-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13260 Milliseconds Vbucket 966 2016-03-24T06:24:52.014-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13290 Milliseconds Vbucket 966 2016-03-24T06:24:52.044-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13320 Milliseconds Vbucket 966 2016-03-24T06:24:52.074-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13350 Milliseconds Vbucket 966 2016-03-24T06:24:52.104-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13380 Milliseconds Vbucket 966 2016-03-24T06:24:52.134-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13410 Milliseconds Vbucket 966 2016-03-24T06:24:52.164-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13440 Milliseconds Vbucket 966 2016-03-24T06:24:52.194-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13470 Milliseconds Vbucket 966 2016-03-24T06:24:52.224-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13500 Milliseconds Vbucket 966 2016-03-24T06:24:52.231-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8450000 QueuedCount 26833 2016-03-24T06:24:52.254-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13530 Milliseconds Vbucket 966 2016-03-24T06:24:52.284-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13560 Milliseconds Vbucket 966 2016-03-24T06:24:52.314-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13590 Milliseconds Vbucket 966 2016-03-24T06:24:52.344-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13620 Milliseconds Vbucket 966 2016-03-24T06:24:52.348-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8460000 QueuedCount 16833 2016-03-24T06:24:52.374-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13650 Milliseconds Vbucket 966 2016-03-24T06:24:52.404-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13680 Milliseconds Vbucket 966 2016-03-24T06:24:52.434-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13710 Milliseconds Vbucket 966 2016-03-24T06:24:52.464-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13740 Milliseconds Vbucket 966 2016-03-24T06:24:52.494-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13770 Milliseconds Vbucket 966 2016-03-24T06:24:52.524-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13800 Milliseconds Vbucket 966 2016-03-24T06:24:52.554-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13830 Milliseconds Vbucket 966 2016-03-24T06:24:52.584-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13860 Milliseconds Vbucket 966 2016-03-24T06:24:52.614-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13890 Milliseconds Vbucket 966 2016-03-24T06:24:52.644-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13920 Milliseconds Vbucket 966 2016-03-24T06:24:52.674-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13950 Milliseconds Vbucket 966 2016-03-24T06:24:52.704-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13980 Milliseconds Vbucket 966 2016-03-24T06:24:52.734-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14010 Milliseconds Vbucket 966 2016-03-24T06:24:52.764-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14040 Milliseconds Vbucket 966 2016-03-24T06:24:52.794-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14070 Milliseconds Vbucket 966 2016-03-24T06:24:52.824-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14100 Milliseconds Vbucket 966 2016-03-24T06:24:52.854-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14130 Milliseconds Vbucket 966 2016-03-24T06:24:52.884-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14160 Milliseconds Vbucket 966 2016-03-24T06:24:52.914-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14190 Milliseconds Vbucket 966 2016-03-24T06:24:52.944-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14220 Milliseconds Vbucket 966 2016-03-24T06:24:52.974-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14250 Milliseconds Vbucket 966 2016-03-24T06:24:53.004-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14280 Milliseconds Vbucket 966 2016-03-24T06:24:53.034-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14310 Milliseconds Vbucket 966 2016-03-24T06:24:53.064-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14340 Milliseconds Vbucket 966 2016-03-24T06:24:53.069-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8470000 QueuedCount 6833 2016-03-24T06:24:53.094-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14370 Milliseconds Vbucket 966 2016-03-24T06:24:53.124-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14400 Milliseconds Vbucket 966 2016-03-24T06:24:53.154-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14430 Milliseconds Vbucket 966 2016-03-24T06:24:53.184-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14460 Milliseconds Vbucket 966 2016-03-24T06:24:53.214-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14490 Milliseconds Vbucket 966 2016-03-24T06:24:53.244-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14520 Milliseconds Vbucket 966 2016-03-24T06:24:53.274-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14550 Milliseconds Vbucket 966 2016-03-24T06:24:53.304-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14580 Milliseconds Vbucket 966 2016-03-24T06:24:53.334-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14610 Milliseconds Vbucket 966 2016-03-24T06:24:53.364-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14640 Milliseconds Vbucket 966 2016-03-24T06:24:53.394-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14670 Milliseconds Vbucket 966 2016-03-24T06:24:53.424-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14700 Milliseconds Vbucket 966 2016-03-24T06:24:53.454-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14730 Milliseconds Vbucket 966 2016-03-24T06:24:53.484-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14760 Milliseconds Vbucket 966 2016-03-24T06:24:53.514-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14790 Milliseconds Vbucket 966 2016-03-24T06:24:53.544-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14820 Milliseconds Vbucket 966 2016-03-24T06:24:53.574-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14850 Milliseconds Vbucket 966 2016-03-24T06:24:53.604-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14880 Milliseconds Vbucket 966 2016-03-24T06:24:53.634-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14910 Milliseconds Vbucket 966 2016-03-24T06:24:53.664-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14940 Milliseconds Vbucket 966 2016-03-24T06:24:53.687-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 3.797µs CommitTime 527.661223ms TotalFlushTime 7m53.11459704s TotalCommitTime 56.604767471s 2016-03-24T06:24:53.687-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8476833, 8476833, 95 committed:true 2016-03-24T06:24:53.687-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8476833, 8476833, 95 committed:true) SnapCreateDur 537.782136ms SnapOpenDur 46.494µs 2016-03-24T06:24:53.694-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 14970 Milliseconds Vbucket 966 2016-03-24T06:24:53.715-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.724-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 15000 Milliseconds Vbucket 966 2016-03-24T06:24:53.744-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.774-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.797-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.8-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13770000 2016-03-24T06:24:53.801-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8480000 QueuedCount 20611 2016-03-24T06:24:53.823-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.854-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:53.881-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13780000 2016-03-24T06:24:53.944-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13790000 2016-03-24T06:24:54.004-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13800000 2016-03-24T06:24:54.063-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13810000 2016-03-24T06:24:54.092-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8490000 QueuedCount 50000 2016-03-24T06:24:54.13-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13820000 2016-03-24T06:24:54.192-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13830000 2016-03-24T06:24:54.239-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:54.259-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13840000 2016-03-24T06:24:54.322-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13850000 2016-03-24T06:24:54.399-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13860000 2016-03-24T06:24:54.473-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13870000 2016-03-24T06:24:54.546-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13880000 2016-03-24T06:24:54.62-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13890000 2016-03-24T06:24:54.692-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13900000 2016-03-24T06:24:54.77-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13910000 2016-03-24T06:24:54.851-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13920000 2016-03-24T06:24:54.934-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13930000 2016-03-24T06:24:55.017-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13940000 2016-03-24T06:24:55.106-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13950000 2016-03-24T06:24:55.193-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13960000 2016-03-24T06:24:55.259-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8500000 QueuedCount 50000 2016-03-24T06:24:55.262-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13970000 2016-03-24T06:24:55.324-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13980000 2016-03-24T06:24:55.389-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 13990000 2016-03-24T06:24:55.452-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14000000 2016-03-24T06:24:55.544-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8510000 QueuedCount 50000 2016-03-24T06:24:55.917-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":6581699467,"bucket-1:by_email_name_street:avg_ts_items_count":84865,"bucket-1:by_email_name_street:build_progress":42,"bucket-1:by_email_name_street:data_size":3202629405,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":12114612224,"bucket-1:by_email_name_street:flush_queue_size":50033,"bucket-1:by_email_name_street:frag_percent":73,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":1301968902,"bucket-1:by_email_name_street:items_count":8476833,"bucket-1:by_email_name_street:num_commits":95,"bucket-1:by_email_name_street:num_compactions":3,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":8514959,"bucket-1:by_email_name_street:num_docs_pending":6225692,"bucket-1:by_email_name_street:num_docs_queued":5259349,"bucket-1:by_email_name_street:num_flush_queued":8567826,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":95,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":5933599898,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"95 56604767471 4259419847278486593","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"8517794 86603177003 -519379481762410655","bucket-1:by_email_name_street:timings/storage_handle_open":"95 814639411 658136041928082433","bucket-1:by_email_name_street:timings/storage_info":"381 7762473 1239345296013","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"97 43448570 22848451371672","bucket-1:by_email_name_street:timings/storage_meta_set":"95 47582896 29132947319218","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"17035587 380367940975 9114292786959640059","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5438076,"bucket-1:num_mutations_queued":14005870,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":361,"memory_quota":104857600000,"memory_used":11310792704,"needs_restart":false,"num_connections":0,"timings/stats_response":"1941 355698968 727153616117562"} 2016-03-24T06:24:56.945-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8520000 QueuedCount 50000 2016-03-24T06:24:56.982-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:57.113-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8530000 QueuedCount 45313 2016-03-24T06:24:57.983-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8540000 QueuedCount 35313 2016-03-24T06:24:58.121-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8550000 QueuedCount 25313 2016-03-24T06:24:58.883-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8560000 QueuedCount 15313 2016-03-24T06:24:59.002-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8570000 QueuedCount 5313 2016-03-24T06:24:59.879-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 10.644µs CommitTime 792.646715ms TotalFlushTime 7m58.329337613s TotalCommitTime 57.397414186s 2016-03-24T06:24:59.879-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8575313, 8575313, 96 committed:true 2016-03-24T06:24:59.879-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8575313, 8575313, 96 committed:true) SnapCreateDur 803.013761ms SnapOpenDur 37.054µs 2016-03-24T06:24:59.901-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:59.922-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:59.946-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:59.973-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:24:59.998-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:00.021-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:00.045-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:00.052-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8580000 QueuedCount 12110 2016-03-24T06:25:00.077-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:00.125-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:00.353-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8590000 QueuedCount 50000 2016-03-24T06:25:00.499-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 988 2016-03-24T06:25:00.529-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 988 2016-03-24T06:25:00.559-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 988 2016-03-24T06:25:00.589-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 988 2016-03-24T06:25:00.619-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 988 2016-03-24T06:25:00.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 988 2016-03-24T06:25:00.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 988 2016-03-24T06:25:00.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 988 2016-03-24T06:25:00.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 988 2016-03-24T06:25:00.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 988 2016-03-24T06:25:00.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 988 2016-03-24T06:25:00.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 988 2016-03-24T06:25:00.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 988 2016-03-24T06:25:00.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 988 2016-03-24T06:25:00.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 988 2016-03-24T06:25:00.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 988 2016-03-24T06:25:00.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 988 2016-03-24T06:25:01.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 988 2016-03-24T06:25:01.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 988 2016-03-24T06:25:01.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 988 2016-03-24T06:25:01.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 988 2016-03-24T06:25:01.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 988 2016-03-24T06:25:01.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 988 2016-03-24T06:25:01.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 988 2016-03-24T06:25:01.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 988 2016-03-24T06:25:01.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 988 2016-03-24T06:25:01.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 988 2016-03-24T06:25:01.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 988 2016-03-24T06:25:01.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 988 2016-03-24T06:25:01.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 988 2016-03-24T06:25:01.399-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 988 2016-03-24T06:25:01.429-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 988 2016-03-24T06:25:01.459-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 988 2016-03-24T06:25:01.489-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 988 2016-03-24T06:25:01.519-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 988 2016-03-24T06:25:01.549-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 988 2016-03-24T06:25:01.579-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 988 2016-03-24T06:25:01.609-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 988 2016-03-24T06:25:01.639-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 988 2016-03-24T06:25:01.669-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 988 2016-03-24T06:25:01.699-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 988 2016-03-24T06:25:01.729-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 988 2016-03-24T06:25:01.734-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8600000 QueuedCount 50000 2016-03-24T06:25:01.759-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 988 2016-03-24T06:25:01.789-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 988 2016-03-24T06:25:01.819-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 988 2016-03-24T06:25:01.849-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 988 2016-03-24T06:25:01.879-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 988 2016-03-24T06:25:01.909-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 988 2016-03-24T06:25:01.939-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 988 2016-03-24T06:25:01.969-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 988 2016-03-24T06:25:01.999-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 988 2016-03-24T06:25:02.016-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8610000 QueuedCount 50000 2016-03-24T06:25:02.029-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 988 2016-03-24T06:25:02.059-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 988 2016-03-24T06:25:02.089-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 988 2016-03-24T06:25:02.119-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 988 2016-03-24T06:25:02.146-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:02.149-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 988 2016-03-24T06:25:02.179-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 988 2016-03-24T06:25:02.209-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 988 2016-03-24T06:25:02.239-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 988 2016-03-24T06:25:02.269-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 988 2016-03-24T06:25:02.299-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 988 2016-03-24T06:25:02.329-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 988 2016-03-24T06:25:02.359-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 988 2016-03-24T06:25:02.389-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 988 2016-03-24T06:25:02.419-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 988 2016-03-24T06:25:02.449-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 988 2016-03-24T06:25:02.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 988 2016-03-24T06:25:02.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 988 2016-03-24T06:25:02.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 988 2016-03-24T06:25:02.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 988 2016-03-24T06:25:02.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 988 2016-03-24T06:25:02.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 988 2016-03-24T06:25:02.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 988 2016-03-24T06:25:02.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 988 2016-03-24T06:25:02.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 988 2016-03-24T06:25:02.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 988 2016-03-24T06:25:02.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 988 2016-03-24T06:25:02.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 988 2016-03-24T06:25:02.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 988 2016-03-24T06:25:02.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 988 2016-03-24T06:25:02.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 988 2016-03-24T06:25:02.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 988 2016-03-24T06:25:02.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 988 2016-03-24T06:25:02.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 988 2016-03-24T06:25:03.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 988 2016-03-24T06:25:03.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 988 2016-03-24T06:25:03.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 988 2016-03-24T06:25:03.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 988 2016-03-24T06:25:03.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 988 2016-03-24T06:25:03.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 988 2016-03-24T06:25:03.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 988 2016-03-24T06:25:03.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 988 2016-03-24T06:25:03.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 988 2016-03-24T06:25:03.27-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8620000 QueuedCount 50000 2016-03-24T06:25:03.289-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 988 2016-03-24T06:25:03.319-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 988 2016-03-24T06:25:03.349-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 988 2016-03-24T06:25:03.379-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 988 2016-03-24T06:25:03.409-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 988 2016-03-24T06:25:03.415-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8630000 QueuedCount 43672 2016-03-24T06:25:03.439-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 988 2016-03-24T06:25:03.469-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 988 2016-03-24T06:25:03.499-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 988 2016-03-24T06:25:03.529-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 988 2016-03-24T06:25:03.559-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 988 2016-03-24T06:25:03.589-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 988 2016-03-24T06:25:03.619-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 988 2016-03-24T06:25:03.649-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 988 2016-03-24T06:25:03.679-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 988 2016-03-24T06:25:03.709-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 988 2016-03-24T06:25:03.739-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 988 2016-03-24T06:25:03.769-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 988 2016-03-24T06:25:03.799-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 988 2016-03-24T06:25:03.829-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 988 2016-03-24T06:25:03.859-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 988 2016-03-24T06:25:03.889-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 988 2016-03-24T06:25:03.919-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 988 2016-03-24T06:25:03.949-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 988 2016-03-24T06:25:03.979-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 988 2016-03-24T06:25:04.009-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 988 2016-03-24T06:25:04.039-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 988 2016-03-24T06:25:04.069-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 988 2016-03-24T06:25:04.099-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 988 2016-03-24T06:25:04.129-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 988 2016-03-24T06:25:04.159-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 988 2016-03-24T06:25:04.181-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8640000 QueuedCount 33672 2016-03-24T06:25:04.189-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 988 2016-03-24T06:25:04.219-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 988 2016-03-24T06:25:04.249-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 988 2016-03-24T06:25:04.279-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 988 2016-03-24T06:25:04.299-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8650000 QueuedCount 23672 2016-03-24T06:25:04.309-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 988 2016-03-24T06:25:04.339-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 988 2016-03-24T06:25:04.369-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 988 2016-03-24T06:25:04.399-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 988 2016-03-24T06:25:04.429-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 988 2016-03-24T06:25:04.459-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 988 2016-03-24T06:25:04.489-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 988 2016-03-24T06:25:04.519-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 988 2016-03-24T06:25:04.549-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 988 2016-03-24T06:25:04.579-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 988 2016-03-24T06:25:04.609-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 988 2016-03-24T06:25:04.639-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 988 2016-03-24T06:25:04.669-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 988 2016-03-24T06:25:04.699-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 988 2016-03-24T06:25:04.729-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 988 2016-03-24T06:25:04.759-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 988 2016-03-24T06:25:04.789-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 988 2016-03-24T06:25:04.819-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 988 2016-03-24T06:25:04.849-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 988 2016-03-24T06:25:04.879-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 988 2016-03-24T06:25:04.909-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 988 2016-03-24T06:25:04.939-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 988 2016-03-24T06:25:04.969-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 988 2016-03-24T06:25:04.999-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 988 2016-03-24T06:25:05.024-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8660000 QueuedCount 13672 2016-03-24T06:25:05.029-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 988 2016-03-24T06:25:05.059-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 988 2016-03-24T06:25:05.089-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 988 2016-03-24T06:25:05.119-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 988 2016-03-24T06:25:05.143-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8670000 QueuedCount 3672 2016-03-24T06:25:05.149-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 988 2016-03-24T06:25:05.179-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 988 2016-03-24T06:25:05.209-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 988 2016-03-24T06:25:05.239-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 988 2016-03-24T06:25:05.269-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 988 2016-03-24T06:25:05.299-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 988 2016-03-24T06:25:05.329-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 988 2016-03-24T06:25:05.359-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 988 2016-03-24T06:25:05.389-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 988 2016-03-24T06:25:05.419-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 988 2016-03-24T06:25:05.449-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 988 2016-03-24T06:25:05.479-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 988 2016-03-24T06:25:05.509-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 988 2016-03-24T06:25:05.539-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 988 2016-03-24T06:25:05.569-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 988 2016-03-24T06:25:05.599-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 988 2016-03-24T06:25:05.629-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 988 2016-03-24T06:25:05.659-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 988 2016-03-24T06:25:05.689-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 988 2016-03-24T06:25:05.719-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 988 2016-03-24T06:25:05.749-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 988 2016-03-24T06:25:05.779-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 988 2016-03-24T06:25:05.809-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 988 2016-03-24T06:25:05.839-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 988 2016-03-24T06:25:05.869-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 988 2016-03-24T06:25:05.899-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 988 2016-03-24T06:25:05.929-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 988 2016-03-24T06:25:05.959-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 988 2016-03-24T06:25:05.989-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 988 2016-03-24T06:25:05.99-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.875µs CommitTime 783.485643ms TotalFlushTime 8m3.394299983s TotalCommitTime 58.180899829s 2016-03-24T06:25:05.99-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8673672, 8673672, 97 committed:true 2016-03-24T06:25:05.99-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8673672, 8673672, 97 committed:true) SnapCreateDur 793.995403ms SnapOpenDur 49.471µs 2016-03-24T06:25:06.019-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 988 2016-03-24T06:25:06.021-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.049-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 988 2016-03-24T06:25:06.052-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.073-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.079-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 988 2016-03-24T06:25:06.097-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.109-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 988 2016-03-24T06:25:06.118-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.139-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.139-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 988 2016-03-24T06:25:06.164-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.169-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 988 2016-03-24T06:25:06.173-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8680000 QueuedCount 20856 2016-03-24T06:25:06.185-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.199-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 988 2016-03-24T06:25:06.218-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.229-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 988 2016-03-24T06:25:06.243-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.259-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 988 2016-03-24T06:25:06.266-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:06.327-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14010000 2016-03-24T06:25:06.388-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14020000 2016-03-24T06:25:06.45-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14030000 2016-03-24T06:25:06.458-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8690000 QueuedCount 50000 2016-03-24T06:25:06.514-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14040000 2016-03-24T06:25:06.577-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14050000 2016-03-24T06:25:06.658-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14060000 2016-03-24T06:25:06.742-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14070000 2016-03-24T06:25:06.826-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14080000 2016-03-24T06:25:06.913-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14090000 2016-03-24T06:25:06.998-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14100000 2016-03-24T06:25:07.081-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14110000 2016-03-24T06:25:07.166-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14120000 2016-03-24T06:25:07.689-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:07.732-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8700000 QueuedCount 50000 2016-03-24T06:25:07.86-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14130000 2016-03-24T06:25:07.887-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8710000 QueuedCount 50000 2016-03-24T06:25:09.311-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8720000 QueuedCount 50000 2016-03-24T06:25:09.618-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8730000 QueuedCount 44053 2016-03-24T06:25:10.811-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8740000 QueuedCount 34053 2016-03-24T06:25:10.949-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8750000 QueuedCount 24053 2016-03-24T06:25:11.791-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8760000 QueuedCount 14053 2016-03-24T06:25:11.907-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8770000 QueuedCount 4053 2016-03-24T06:25:12.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 755 2016-03-24T06:25:12.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 755 2016-03-24T06:25:12.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 755 2016-03-24T06:25:13.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 755 2016-03-24T06:25:13.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 755 2016-03-24T06:25:13.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 755 2016-03-24T06:25:13.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 755 2016-03-24T06:25:13.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 755 2016-03-24T06:25:13.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 755 2016-03-24T06:25:13.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 755 2016-03-24T06:25:13.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 755 2016-03-24T06:25:13.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 755 2016-03-24T06:25:13.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 755 2016-03-24T06:25:13.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 755 2016-03-24T06:25:13.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 755 2016-03-24T06:25:13.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 755 2016-03-24T06:25:13.37-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 19.857µs CommitTime 1.374491579s TotalFlushTime 8m9.201495063s TotalCommitTime 59.555391408s 2016-03-24T06:25:13.37-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8774053, 8774053, 98 committed:true 2016-03-24T06:25:13.37-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8774053, 8774053, 98 committed:true) SnapCreateDur 1.400387019s SnapOpenDur 45.397µs 2016-03-24T06:25:13.763-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 12.096µs CommitTime 273.603153ms TotalFlushTime 8m9.271864126s TotalCommitTime 59.828994561s 2016-03-24T06:25:13.763-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8776846, 8776846, 99 committed:true 2016-03-24T06:25:13.763-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8776846, 8776846, 99 committed:true) SnapCreateDur 299.06673ms SnapOpenDur 67.474µs 2016-03-24T06:25:13.789-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.812-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14140000 2016-03-24T06:25:13.815-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.868-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.87-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8780000 QueuedCount 35938 2016-03-24T06:25:13.891-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14150000 2016-03-24T06:25:13.892-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.917-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.947-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:13.972-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14160000 2016-03-24T06:25:14.034-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14170000 2016-03-24T06:25:14.103-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14180000 2016-03-24T06:25:14.143-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:14.153-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8790000 QueuedCount 49612 2016-03-24T06:25:14.174-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14190000 2016-03-24T06:25:14.239-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14200000 2016-03-24T06:25:14.302-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14210000 2016-03-24T06:25:14.366-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14220000 2016-03-24T06:25:14.455-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14230000 2016-03-24T06:25:14.544-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14240000 2016-03-24T06:25:14.634-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14250000 2016-03-24T06:25:15.567-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8800000 QueuedCount 50000 2016-03-24T06:25:15.699-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:15.737-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8810000 QueuedCount 50000 2016-03-24T06:25:16.633-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8820000 QueuedCount 50000 2016-03-24T06:25:16.81-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8830000 QueuedCount 50000 2016-03-24T06:25:18.139-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:18.151-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8840000 QueuedCount 49516 2016-03-24T06:25:18.315-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:18.454-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8850000 QueuedCount 50000 2016-03-24T06:25:18.472-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14260000 2016-03-24T06:25:19.733-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8860000 QueuedCount 50000 2016-03-24T06:25:19.771-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:19.876-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8870000 QueuedCount 43339 2016-03-24T06:25:20.707-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8880000 QueuedCount 33339 2016-03-24T06:25:20.826-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8890000 QueuedCount 23339 2016-03-24T06:25:21.553-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8900000 QueuedCount 13339 2016-03-24T06:25:21.669-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8910000 QueuedCount 3339 2016-03-24T06:25:22.444-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 1.881µs CommitTime 721.024395ms TotalFlushTime 8m16.931652899s TotalCommitTime 1m0.550018956s 2016-03-24T06:25:22.444-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 8913339, 8913339, 100 committed:true 2016-03-24T06:25:22.444-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 8913339, 8913339, 100 committed:true) SnapCreateDur 731.245932ms SnapOpenDur 43.221µs 2016-03-24T06:25:22.48-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:22.528-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:22.528-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14270000 2016-03-24T06:25:22.556-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:22.599-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14280000 2016-03-24T06:25:22.651-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8920000 QueuedCount 50000 2016-03-24T06:25:22.657-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14290000 2016-03-24T06:25:22.708-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:22.72-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14300000 2016-03-24T06:25:22.932-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:23.007-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8930000 QueuedCount 50000 2016-03-24T06:25:24.263-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:24.268-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8940000 QueuedCount 49598 2016-03-24T06:25:24.372-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:24.415-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8950000 QueuedCount 50000 2016-03-24T06:25:24.43-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:25.43-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14310000 2016-03-24T06:25:25.481-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8960000 QueuedCount 50000 2016-03-24T06:25:25.623-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8970000 QueuedCount 50000 2016-03-24T06:25:26.515-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8980000 QueuedCount 50000 2016-03-24T06:25:26.536-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:26.663-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14320000 2016-03-24T06:25:26.694-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 8990000 QueuedCount 50000 2016-03-24T06:25:26.728-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14330000 2016-03-24T06:25:27.459-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9000000 QueuedCount 50000 2016-03-24T06:25:27.656-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9010000 QueuedCount 46587 2016-03-24T06:25:28.807-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9020000 QueuedCount 36587 2016-03-24T06:25:28.959-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9030000 QueuedCount 26587 2016-03-24T06:25:31.32-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9040000 QueuedCount 16587 2016-03-24T06:25:31.603-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9050000 QueuedCount 6587 2016-03-24T06:25:31.748-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 1019 2016-03-24T06:25:31.778-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 1019 2016-03-24T06:25:31.808-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 1019 2016-03-24T06:25:31.838-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 1019 2016-03-24T06:25:31.868-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 1019 2016-03-24T06:25:31.898-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 1019 2016-03-24T06:25:31.928-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 1019 2016-03-24T06:25:31.958-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 1019 2016-03-24T06:25:31.988-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 1019 2016-03-24T06:25:32.018-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 1019 2016-03-24T06:25:32.048-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 1019 2016-03-24T06:25:32.078-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 1019 2016-03-24T06:25:32.108-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 1019 2016-03-24T06:25:32.138-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 1019 2016-03-24T06:25:32.168-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 1019 2016-03-24T06:25:32.198-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 1019 2016-03-24T06:25:32.228-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 1019 2016-03-24T06:25:32.258-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 1019 2016-03-24T06:25:32.288-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 1019 2016-03-24T06:25:32.318-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 1019 2016-03-24T06:25:32.348-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 1019 2016-03-24T06:25:32.378-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 1019 2016-03-24T06:25:32.408-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 1019 2016-03-24T06:25:32.438-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 1019 2016-03-24T06:25:32.468-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 1019 2016-03-24T06:25:32.498-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 1019 2016-03-24T06:25:32.528-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 1019 2016-03-24T06:25:32.558-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 1019 2016-03-24T06:25:32.588-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 1019 2016-03-24T06:25:32.618-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 1019 2016-03-24T06:25:32.648-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 1019 2016-03-24T06:25:32.678-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 1019 2016-03-24T06:25:32.708-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 1019 2016-03-24T06:25:32.738-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 1019 2016-03-24T06:25:32.768-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 1019 2016-03-24T06:25:32.798-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 1019 2016-03-24T06:25:32.828-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 1019 2016-03-24T06:25:32.858-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 1019 2016-03-24T06:25:32.888-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 1019 2016-03-24T06:25:32.918-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 1019 2016-03-24T06:25:32.948-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 1019 2016-03-24T06:25:32.978-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 1019 2016-03-24T06:25:33.008-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 1019 2016-03-24T06:25:33.038-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 1019 2016-03-24T06:25:33.068-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 1019 2016-03-24T06:25:33.098-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 1019 2016-03-24T06:25:33.128-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 1019 2016-03-24T06:25:33.158-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 1019 2016-03-24T06:25:33.188-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 1019 2016-03-24T06:25:33.218-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 1019 2016-03-24T06:25:33.248-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 1019 2016-03-24T06:25:33.278-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 1019 2016-03-24T06:25:33.308-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 1019 2016-03-24T06:25:33.338-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 1019 2016-03-24T06:25:33.345-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 11.166µs CommitTime 1.531281965s TotalFlushTime 8m26.030071673s TotalCommitTime 1m2.081300921s 2016-03-24T06:25:33.345-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9056587, 9056587, 101 committed:true 2016-03-24T06:25:33.345-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9056587, 9056587, 101 committed:true) SnapCreateDur 1.557065189s SnapOpenDur 52.133µs 2016-03-24T06:25:33.446-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14340000 2016-03-24T06:25:33.534-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14350000 2016-03-24T06:25:33.633-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14360000 2016-03-24T06:25:34.525-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9060000 QueuedCount 3174 2016-03-24T06:25:35.782-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 18.484µs CommitTime 563.65897ms TotalFlushTime 8m27.841519534s TotalCommitTime 1m2.644959891s 2016-03-24T06:25:35.782-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9063174, 9063174, 102 committed:true 2016-03-24T06:25:35.782-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9063174, 9063174, 102 committed:true) SnapCreateDur 589.706229ms SnapOpenDur 43.018µs 2016-03-24T06:25:35.806-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.833-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.867-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.89-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.91-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.931-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.952-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.973-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:35.98-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9070000 QueuedCount 14160 2016-03-24T06:25:35.994-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:36.023-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:36.06-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:36.126-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14370000 2016-03-24T06:25:36.364-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9080000 QueuedCount 50000 2016-03-24T06:25:36.405-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14380000 2016-03-24T06:25:36.478-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14390000 2016-03-24T06:25:36.562-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14400000 2016-03-24T06:25:36.659-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14410000 2016-03-24T06:25:36.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14420000 2016-03-24T06:25:36.877-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14430000 2016-03-24T06:25:37.006-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14440000 2016-03-24T06:25:37.138-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14450000 2016-03-24T06:25:37.27-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14460000 2016-03-24T06:25:37.402-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14470000 2016-03-24T06:25:37.532-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14480000 2016-03-24T06:25:37.66-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14490000 2016-03-24T06:25:37.735-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:37.747-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9090000 QueuedCount 49139 2016-03-24T06:25:37.762-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14500000 2016-03-24T06:25:37.904-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9100000 QueuedCount 50000 2016-03-24T06:25:38.713-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:38.787-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9110000 QueuedCount 48700 2016-03-24T06:25:39.052-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9120000 QueuedCount 38700 2016-03-24T06:25:40.04-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9130000 QueuedCount 28700 2016-03-24T06:25:40.178-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9140000 QueuedCount 18700 2016-03-24T06:25:41.016-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9150000 QueuedCount 8700 2016-03-24T06:25:41.788-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.756µs CommitTime 664.726077ms TotalFlushTime 8m33.002338582s TotalCommitTime 1m3.309685968s 2016-03-24T06:25:41.788-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9158700, 9158700, 103 committed:true 2016-03-24T06:25:41.788-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9158700, 9158700, 103 committed:true) SnapCreateDur 674.382793ms SnapOpenDur 60.375µs 2016-03-24T06:25:41.823-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.842-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9160000 QueuedCount 11893 2016-03-24T06:25:41.851-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.88-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.909-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.932-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.955-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:41.979-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.027-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.052-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.075-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.105-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9170000 QueuedCount 50000 2016-03-24T06:25:42.138-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.31-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:42.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 818 2016-03-24T06:25:42.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 818 2016-03-24T06:25:42.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 818 2016-03-24T06:25:42.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 818 2016-03-24T06:25:42.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 818 2016-03-24T06:25:42.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 818 2016-03-24T06:25:43.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 818 2016-03-24T06:25:43.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 818 2016-03-24T06:25:43.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 818 2016-03-24T06:25:43.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 818 2016-03-24T06:25:43.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 818 2016-03-24T06:25:43.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 818 2016-03-24T06:25:43.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 818 2016-03-24T06:25:43.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 818 2016-03-24T06:25:43.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 818 2016-03-24T06:25:43.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 818 2016-03-24T06:25:43.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 818 2016-03-24T06:25:43.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 818 2016-03-24T06:25:43.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 818 2016-03-24T06:25:43.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 818 2016-03-24T06:25:43.448-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 818 2016-03-24T06:25:43.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 818 2016-03-24T06:25:43.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 818 2016-03-24T06:25:43.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 818 2016-03-24T06:25:43.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 818 2016-03-24T06:25:43.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 818 2016-03-24T06:25:43.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 818 2016-03-24T06:25:43.647-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9180000 QueuedCount 50000 2016-03-24T06:25:43.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 818 2016-03-24T06:25:43.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 818 2016-03-24T06:25:43.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 818 2016-03-24T06:25:43.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 818 2016-03-24T06:25:43.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 818 2016-03-24T06:25:43.79-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:43.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 818 2016-03-24T06:25:43.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 818 2016-03-24T06:25:43.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 818 2016-03-24T06:25:43.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 818 2016-03-24T06:25:43.917-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9190000 QueuedCount 50000 2016-03-24T06:25:43.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 818 2016-03-24T06:25:43.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 818 2016-03-24T06:25:43.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 818 2016-03-24T06:25:44.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 818 2016-03-24T06:25:44.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 818 2016-03-24T06:25:44.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 818 2016-03-24T06:25:44.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 818 2016-03-24T06:25:44.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 818 2016-03-24T06:25:44.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 818 2016-03-24T06:25:44.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 818 2016-03-24T06:25:44.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 818 2016-03-24T06:25:44.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 818 2016-03-24T06:25:44.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 818 2016-03-24T06:25:44.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 818 2016-03-24T06:25:44.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 818 2016-03-24T06:25:44.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 818 2016-03-24T06:25:44.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 818 2016-03-24T06:25:44.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 818 2016-03-24T06:25:44.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 818 2016-03-24T06:25:44.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 818 2016-03-24T06:25:44.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 818 2016-03-24T06:25:44.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 818 2016-03-24T06:25:44.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 818 2016-03-24T06:25:44.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 818 2016-03-24T06:25:44.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 818 2016-03-24T06:25:44.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 818 2016-03-24T06:25:44.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 818 2016-03-24T06:25:44.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 818 2016-03-24T06:25:44.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 818 2016-03-24T06:25:44.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 818 2016-03-24T06:25:44.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 818 2016-03-24T06:25:44.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 818 2016-03-24T06:25:44.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 818 2016-03-24T06:25:44.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 818 2016-03-24T06:25:44.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 818 2016-03-24T06:25:44.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 818 2016-03-24T06:25:45.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 818 2016-03-24T06:25:45.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 818 2016-03-24T06:25:45.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 818 2016-03-24T06:25:45.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 818 2016-03-24T06:25:45.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 818 2016-03-24T06:25:45.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 818 2016-03-24T06:25:45.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 818 2016-03-24T06:25:45.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 818 2016-03-24T06:25:45.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 818 2016-03-24T06:25:45.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 818 2016-03-24T06:25:45.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 818 2016-03-24T06:25:45.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 818 2016-03-24T06:25:45.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 818 2016-03-24T06:25:45.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 818 2016-03-24T06:25:45.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 818 2016-03-24T06:25:45.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 818 2016-03-24T06:25:45.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 818 2016-03-24T06:25:45.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 818 2016-03-24T06:25:45.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 818 2016-03-24T06:25:45.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 818 2016-03-24T06:25:45.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 818 2016-03-24T06:25:45.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 818 2016-03-24T06:25:45.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 818 2016-03-24T06:25:45.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 818 2016-03-24T06:25:45.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 818 2016-03-24T06:25:45.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 818 2016-03-24T06:25:45.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 818 2016-03-24T06:25:45.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 818 2016-03-24T06:25:45.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 818 2016-03-24T06:25:45.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 818 2016-03-24T06:25:45.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 818 2016-03-24T06:25:45.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 818 2016-03-24T06:25:45.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 818 2016-03-24T06:25:45.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 818 2016-03-24T06:25:46.023-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9200000 QueuedCount 50000 2016-03-24T06:25:46.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 818 2016-03-24T06:25:46.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 818 2016-03-24T06:25:46.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 818 2016-03-24T06:25:46.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 818 2016-03-24T06:25:46.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 818 2016-03-24T06:25:46.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 818 2016-03-24T06:25:46.199-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9210000 QueuedCount 50000 2016-03-24T06:25:46.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 818 2016-03-24T06:25:46.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 818 2016-03-24T06:25:46.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 818 2016-03-24T06:25:46.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 818 2016-03-24T06:25:46.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 818 2016-03-24T06:25:46.351-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9220000 QueuedCount 47072 2016-03-24T06:25:46.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 818 2016-03-24T06:25:46.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 818 2016-03-24T06:25:46.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 818 2016-03-24T06:25:46.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 818 2016-03-24T06:25:46.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 818 2016-03-24T06:25:46.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 818 2016-03-24T06:25:46.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 818 2016-03-24T06:25:46.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 818 2016-03-24T06:25:46.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 818 2016-03-24T06:25:46.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 818 2016-03-24T06:25:46.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 818 2016-03-24T06:25:46.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 818 2016-03-24T06:25:46.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 818 2016-03-24T06:25:46.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 818 2016-03-24T06:25:46.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 818 2016-03-24T06:25:46.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 818 2016-03-24T06:25:46.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 818 2016-03-24T06:25:46.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 818 2016-03-24T06:25:46.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 818 2016-03-24T06:25:46.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 818 2016-03-24T06:25:46.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 818 2016-03-24T06:25:46.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 818 2016-03-24T06:25:47.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 818 2016-03-24T06:25:47.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 818 2016-03-24T06:25:47.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 818 2016-03-24T06:25:47.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 818 2016-03-24T06:25:47.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 818 2016-03-24T06:25:47.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 818 2016-03-24T06:25:47.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 818 2016-03-24T06:25:47.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 818 2016-03-24T06:25:47.252-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9230000 QueuedCount 37072 2016-03-24T06:25:47.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 818 2016-03-24T06:25:47.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 818 2016-03-24T06:25:47.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 818 2016-03-24T06:25:47.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 818 2016-03-24T06:25:47.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 818 2016-03-24T06:25:47.392-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9240000 QueuedCount 27072 2016-03-24T06:25:47.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 818 2016-03-24T06:25:47.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9600 Milliseconds Vbucket 818 2016-03-24T06:25:47.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9630 Milliseconds Vbucket 818 2016-03-24T06:25:47.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9660 Milliseconds Vbucket 818 2016-03-24T06:25:47.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9690 Milliseconds Vbucket 818 2016-03-24T06:25:47.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9720 Milliseconds Vbucket 818 2016-03-24T06:25:47.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9750 Milliseconds Vbucket 818 2016-03-24T06:25:47.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9780 Milliseconds Vbucket 818 2016-03-24T06:25:47.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9810 Milliseconds Vbucket 818 2016-03-24T06:25:47.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9840 Milliseconds Vbucket 818 2016-03-24T06:25:47.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9870 Milliseconds Vbucket 818 2016-03-24T06:25:47.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9900 Milliseconds Vbucket 818 2016-03-24T06:25:47.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9930 Milliseconds Vbucket 818 2016-03-24T06:25:47.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9960 Milliseconds Vbucket 818 2016-03-24T06:25:47.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9990 Milliseconds Vbucket 818 2016-03-24T06:25:47.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10020 Milliseconds Vbucket 818 2016-03-24T06:25:47.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10050 Milliseconds Vbucket 818 2016-03-24T06:25:47.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10080 Milliseconds Vbucket 818 2016-03-24T06:25:47.947-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10110 Milliseconds Vbucket 818 2016-03-24T06:25:47.977-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10140 Milliseconds Vbucket 818 2016-03-24T06:25:48.007-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10170 Milliseconds Vbucket 818 2016-03-24T06:25:48.037-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10200 Milliseconds Vbucket 818 2016-03-24T06:25:48.067-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10230 Milliseconds Vbucket 818 2016-03-24T06:25:48.097-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10260 Milliseconds Vbucket 818 2016-03-24T06:25:48.114-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9250000 QueuedCount 17072 2016-03-24T06:25:48.127-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10290 Milliseconds Vbucket 818 2016-03-24T06:25:48.157-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10320 Milliseconds Vbucket 818 2016-03-24T06:25:48.187-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10350 Milliseconds Vbucket 818 2016-03-24T06:25:48.217-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10380 Milliseconds Vbucket 818 2016-03-24T06:25:48.232-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9260000 QueuedCount 7072 2016-03-24T06:25:48.247-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10410 Milliseconds Vbucket 818 2016-03-24T06:25:48.277-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10440 Milliseconds Vbucket 818 2016-03-24T06:25:48.307-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10470 Milliseconds Vbucket 818 2016-03-24T06:25:48.337-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10500 Milliseconds Vbucket 818 2016-03-24T06:25:48.367-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10530 Milliseconds Vbucket 818 2016-03-24T06:25:48.397-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10560 Milliseconds Vbucket 818 2016-03-24T06:25:48.427-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10590 Milliseconds Vbucket 818 2016-03-24T06:25:48.457-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10620 Milliseconds Vbucket 818 2016-03-24T06:25:48.487-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10650 Milliseconds Vbucket 818 2016-03-24T06:25:48.517-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10680 Milliseconds Vbucket 818 2016-03-24T06:25:48.547-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10710 Milliseconds Vbucket 818 2016-03-24T06:25:48.577-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10740 Milliseconds Vbucket 818 2016-03-24T06:25:48.607-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10770 Milliseconds Vbucket 818 2016-03-24T06:25:48.637-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10800 Milliseconds Vbucket 818 2016-03-24T06:25:48.667-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10830 Milliseconds Vbucket 818 2016-03-24T06:25:48.697-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10860 Milliseconds Vbucket 818 2016-03-24T06:25:48.727-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10890 Milliseconds Vbucket 818 2016-03-24T06:25:48.757-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10920 Milliseconds Vbucket 818 2016-03-24T06:25:48.787-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10950 Milliseconds Vbucket 818 2016-03-24T06:25:48.817-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 10980 Milliseconds Vbucket 818 2016-03-24T06:25:48.847-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11010 Milliseconds Vbucket 818 2016-03-24T06:25:48.877-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11040 Milliseconds Vbucket 818 2016-03-24T06:25:48.907-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11070 Milliseconds Vbucket 818 2016-03-24T06:25:48.937-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11100 Milliseconds Vbucket 818 2016-03-24T06:25:48.967-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11130 Milliseconds Vbucket 818 2016-03-24T06:25:48.997-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11160 Milliseconds Vbucket 818 2016-03-24T06:25:49.027-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11190 Milliseconds Vbucket 818 2016-03-24T06:25:49.057-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11220 Milliseconds Vbucket 818 2016-03-24T06:25:49.087-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11250 Milliseconds Vbucket 818 2016-03-24T06:25:49.117-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11280 Milliseconds Vbucket 818 2016-03-24T06:25:49.147-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11310 Milliseconds Vbucket 818 2016-03-24T06:25:49.177-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11340 Milliseconds Vbucket 818 2016-03-24T06:25:49.207-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11370 Milliseconds Vbucket 818 2016-03-24T06:25:49.237-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11400 Milliseconds Vbucket 818 2016-03-24T06:25:49.267-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11430 Milliseconds Vbucket 818 2016-03-24T06:25:49.297-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11460 Milliseconds Vbucket 818 2016-03-24T06:25:49.327-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11490 Milliseconds Vbucket 818 2016-03-24T06:25:49.357-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11520 Milliseconds Vbucket 818 2016-03-24T06:25:49.387-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 2.937µs CommitTime 467.467826ms TotalFlushTime 8m39.889481803s TotalCommitTime 1m3.777153794s 2016-03-24T06:25:49.387-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9267072, 9267072, 104 committed:true 2016-03-24T06:25:49.387-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9267072, 9267072, 104 committed:true) SnapCreateDur 477.172874ms SnapOpenDur 42.197µs 2016-03-24T06:25:49.387-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11550 Milliseconds Vbucket 818 2016-03-24T06:25:49.417-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11580 Milliseconds Vbucket 818 2016-03-24T06:25:49.447-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11610 Milliseconds Vbucket 818 2016-03-24T06:25:49.477-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11640 Milliseconds Vbucket 818 2016-03-24T06:25:49.479-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9270000 QueuedCount 12994 2016-03-24T06:25:49.507-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11670 Milliseconds Vbucket 818 2016-03-24T06:25:49.537-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11700 Milliseconds Vbucket 818 2016-03-24T06:25:49.567-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11730 Milliseconds Vbucket 818 2016-03-24T06:25:49.597-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11760 Milliseconds Vbucket 818 2016-03-24T06:25:49.627-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11790 Milliseconds Vbucket 818 2016-03-24T06:25:49.657-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11820 Milliseconds Vbucket 818 2016-03-24T06:25:49.687-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11850 Milliseconds Vbucket 818 2016-03-24T06:25:49.717-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11880 Milliseconds Vbucket 818 2016-03-24T06:25:49.747-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9280000 QueuedCount 2994 2016-03-24T06:25:49.747-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11910 Milliseconds Vbucket 818 2016-03-24T06:25:49.777-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11940 Milliseconds Vbucket 818 2016-03-24T06:25:49.807-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 11970 Milliseconds Vbucket 818 2016-03-24T06:25:49.837-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12000 Milliseconds Vbucket 818 2016-03-24T06:25:49.867-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12030 Milliseconds Vbucket 818 2016-03-24T06:25:49.897-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12060 Milliseconds Vbucket 818 2016-03-24T06:25:49.927-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12090 Milliseconds Vbucket 818 2016-03-24T06:25:49.957-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12120 Milliseconds Vbucket 818 2016-03-24T06:25:49.987-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12150 Milliseconds Vbucket 818 2016-03-24T06:25:50.017-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12180 Milliseconds Vbucket 818 2016-03-24T06:25:50.047-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12210 Milliseconds Vbucket 818 2016-03-24T06:25:50.077-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12240 Milliseconds Vbucket 818 2016-03-24T06:25:50.107-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12270 Milliseconds Vbucket 818 2016-03-24T06:25:50.137-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12300 Milliseconds Vbucket 818 2016-03-24T06:25:50.167-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12330 Milliseconds Vbucket 818 2016-03-24T06:25:50.197-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12360 Milliseconds Vbucket 818 2016-03-24T06:25:50.227-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12390 Milliseconds Vbucket 818 2016-03-24T06:25:50.257-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12420 Milliseconds Vbucket 818 2016-03-24T06:25:50.287-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12450 Milliseconds Vbucket 818 2016-03-24T06:25:50.317-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12480 Milliseconds Vbucket 818 2016-03-24T06:25:50.347-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12510 Milliseconds Vbucket 818 2016-03-24T06:25:50.377-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12540 Milliseconds Vbucket 818 2016-03-24T06:25:50.407-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12570 Milliseconds Vbucket 818 2016-03-24T06:25:50.437-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12600 Milliseconds Vbucket 818 2016-03-24T06:25:50.467-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12630 Milliseconds Vbucket 818 2016-03-24T06:25:50.497-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12660 Milliseconds Vbucket 818 2016-03-24T06:25:50.527-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12690 Milliseconds Vbucket 818 2016-03-24T06:25:50.557-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12720 Milliseconds Vbucket 818 2016-03-24T06:25:50.587-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12750 Milliseconds Vbucket 818 2016-03-24T06:25:50.617-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12780 Milliseconds Vbucket 818 2016-03-24T06:25:50.647-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12810 Milliseconds Vbucket 818 2016-03-24T06:25:50.677-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12840 Milliseconds Vbucket 818 2016-03-24T06:25:50.707-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12870 Milliseconds Vbucket 818 2016-03-24T06:25:50.737-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12900 Milliseconds Vbucket 818 2016-03-24T06:25:50.767-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12930 Milliseconds Vbucket 818 2016-03-24T06:25:50.797-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12960 Milliseconds Vbucket 818 2016-03-24T06:25:50.827-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 12990 Milliseconds Vbucket 818 2016-03-24T06:25:50.857-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13020 Milliseconds Vbucket 818 2016-03-24T06:25:50.887-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13050 Milliseconds Vbucket 818 2016-03-24T06:25:50.917-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 13080 Milliseconds Vbucket 818 2016-03-24T06:25:50.925-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 7.636µs CommitTime 1.064907873s TotalFlushTime 8m40.290166711s TotalCommitTime 1m4.842061667s 2016-03-24T06:25:50.925-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9282994, 9282994, 105 committed:true 2016-03-24T06:25:50.925-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9282994, 9282994, 105 committed:true) SnapCreateDur 1.090000879s SnapOpenDur 55.114µs 2016-03-24T06:25:50.949-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.942795% blocked 2016-03-24T06:25:50.952-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.948557% blocked 2016-03-24T06:25:50.954-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.941741% blocked 2016-03-24T06:25:50.955-07:00 [Info] DATP[->dataport ":9105"] DATP -> Indexer 0.943888% blocked 2016-03-24T06:25:50.968-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14510000 2016-03-24T06:25:50.973-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:51.041-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14520000 2016-03-24T06:25:51.108-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14530000 2016-03-24T06:25:51.172-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14540000 2016-03-24T06:25:51.173-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9290000 QueuedCount 50000 2016-03-24T06:25:51.199-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:51.241-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14550000 2016-03-24T06:25:51.308-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14560000 2016-03-24T06:25:51.378-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14570000 2016-03-24T06:25:51.442-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14580000 2016-03-24T06:25:51.488-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9300000 QueuedCount 50000 2016-03-24T06:25:52.929-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9310000 QueuedCount 50000 2016-03-24T06:25:52.943-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:53.13-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:53.192-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:53.255-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9320000 QueuedCount 50000 2016-03-24T06:25:54.62-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9330000 QueuedCount 50000 2016-03-24T06:25:54.736-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:25:54.783-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9340000 QueuedCount 50000 2016-03-24T06:25:55.658-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9350000 QueuedCount 50000 2016-03-24T06:25:55.917-07:00 [Info] PeriodicStats = {"bucket-1:by_email_name_street:avg_scan_latency":0,"bucket-1:by_email_name_street:avg_scan_wait_latency":0,"bucket-1:by_email_name_street:avg_ts_interval":4104156653,"bucket-1:by_email_name_street:avg_ts_items_count":54800,"bucket-1:by_email_name_street:build_progress":46,"bucket-1:by_email_name_street:data_size":3535668437,"bucket-1:by_email_name_street:delete_bytes":0,"bucket-1:by_email_name_street:disk_size":13969522688,"bucket-1:by_email_name_street:flush_queue_size":50035,"bucket-1:by_email_name_street:frag_percent":74,"bucket-1:by_email_name_street:get_bytes":0,"bucket-1:by_email_name_street:insert_bytes":1433099003,"bucket-1:by_email_name_street:items_count":9282994,"bucket-1:by_email_name_street:num_commits":105,"bucket-1:by_email_name_street:num_compactions":3,"bucket-1:by_email_name_street:num_completed_requests":0,"bucket-1:by_email_name_street:num_docs_indexed":9368154,"bucket-1:by_email_name_street:num_docs_pending":5415541,"bucket-1:by_email_name_street:num_docs_queued":5216305,"bucket-1:by_email_name_street:num_flush_queued":9408510,"bucket-1:by_email_name_street:num_last_snapshot_reply":0,"bucket-1:by_email_name_street:num_requests":0,"bucket-1:by_email_name_street:num_rows_returned":0,"bucket-1:by_email_name_street:num_snapshot_waiters":0,"bucket-1:by_email_name_street:num_snapshots":105,"bucket-1:by_email_name_street:scan_bytes_read":0,"bucket-1:by_email_name_street:scan_wait_duration":0,"bucket-1:by_email_name_street:since_last_snapshot":1537625386,"bucket-1:by_email_name_street:timings/storage_clone_handle":"0 0 0","bucket-1:by_email_name_street:timings/storage_commit":"105 64842061667 -6004272100022997215","bucket-1:by_email_name_street:timings/storage_del":"0 0 0","bucket-1:by_email_name_street:timings/storage_get":"9358476 94509709574 -519285947105301570","bucket-1:by_email_name_street:timings/storage_handle_open":"105 814932150 658136050973438566","bucket-1:by_email_name_street:timings/storage_info":"421 8165363 1247218360253","bucket-1:by_email_name_street:timings/storage_iterator_next":"0 0 0","bucket-1:by_email_name_street:timings/storage_meta_get":"107 47977902 25182781761060","bucket-1:by_email_name_street:timings/storage_meta_set":"105 53619038 33621949740216","bucket-1:by_email_name_street:timings/storage_new_iterator":"0 0 0","bucket-1:by_email_name_street:timings/storage_set":"18716952 421604085951 -781491308464118323","bucket-1:by_email_name_street:timings/storage_snapshot_close":"0 0 0","bucket-1:by_email_name_street:timings/storage_snapshot_create":"0 0 0","bucket-1:by_email_name_street:total_scan_duration":0,"bucket-1:mutation_queue_size":5175980,"bucket-1:num_mutations_queued":14584457,"bucket-1:num_nonalign_ts":0,"bucket-1:ts_queue_size":313,"memory_quota":104857600000,"memory_used":15058743296,"needs_restart":false,"num_connections":0,"timings/stats_response":"2013 382144016 737178539173132"} 2016-03-24T06:25:55.964-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9360000 QueuedCount 50000 2016-03-24T06:25:56.481-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5010 Milliseconds Vbucket 828 2016-03-24T06:25:56.511-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5040 Milliseconds Vbucket 828 2016-03-24T06:25:56.541-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5070 Milliseconds Vbucket 828 2016-03-24T06:25:56.571-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5100 Milliseconds Vbucket 828 2016-03-24T06:25:56.601-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5130 Milliseconds Vbucket 828 2016-03-24T06:25:56.631-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5160 Milliseconds Vbucket 828 2016-03-24T06:25:56.661-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5190 Milliseconds Vbucket 828 2016-03-24T06:25:56.691-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5220 Milliseconds Vbucket 828 2016-03-24T06:25:56.721-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5250 Milliseconds Vbucket 828 2016-03-24T06:25:56.751-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5280 Milliseconds Vbucket 828 2016-03-24T06:25:56.781-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5310 Milliseconds Vbucket 828 2016-03-24T06:25:56.811-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5340 Milliseconds Vbucket 828 2016-03-24T06:25:56.841-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5370 Milliseconds Vbucket 828 2016-03-24T06:25:56.871-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5400 Milliseconds Vbucket 828 2016-03-24T06:25:56.901-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5430 Milliseconds Vbucket 828 2016-03-24T06:25:56.931-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5460 Milliseconds Vbucket 828 2016-03-24T06:25:56.961-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5490 Milliseconds Vbucket 828 2016-03-24T06:25:56.991-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5520 Milliseconds Vbucket 828 2016-03-24T06:25:57.021-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5550 Milliseconds Vbucket 828 2016-03-24T06:25:57.051-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5580 Milliseconds Vbucket 828 2016-03-24T06:25:57.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5610 Milliseconds Vbucket 828 2016-03-24T06:25:57.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5640 Milliseconds Vbucket 828 2016-03-24T06:25:57.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5670 Milliseconds Vbucket 828 2016-03-24T06:25:57.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5700 Milliseconds Vbucket 828 2016-03-24T06:25:57.201-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5730 Milliseconds Vbucket 828 2016-03-24T06:25:57.225-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9370000 QueuedCount 44380 2016-03-24T06:25:57.231-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5760 Milliseconds Vbucket 828 2016-03-24T06:25:57.261-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5790 Milliseconds Vbucket 828 2016-03-24T06:25:57.291-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5820 Milliseconds Vbucket 828 2016-03-24T06:25:57.321-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5850 Milliseconds Vbucket 828 2016-03-24T06:25:57.351-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5880 Milliseconds Vbucket 828 2016-03-24T06:25:57.363-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9380000 QueuedCount 34380 2016-03-24T06:25:57.381-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5910 Milliseconds Vbucket 828 2016-03-24T06:25:57.411-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5940 Milliseconds Vbucket 828 2016-03-24T06:25:57.441-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 5970 Milliseconds Vbucket 828 2016-03-24T06:25:57.471-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6000 Milliseconds Vbucket 828 2016-03-24T06:25:57.501-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6030 Milliseconds Vbucket 828 2016-03-24T06:25:57.531-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6060 Milliseconds Vbucket 828 2016-03-24T06:25:57.561-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6090 Milliseconds Vbucket 828 2016-03-24T06:25:57.591-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6120 Milliseconds Vbucket 828 2016-03-24T06:25:57.621-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6150 Milliseconds Vbucket 828 2016-03-24T06:25:57.651-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6180 Milliseconds Vbucket 828 2016-03-24T06:25:57.681-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6210 Milliseconds Vbucket 828 2016-03-24T06:25:57.711-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6240 Milliseconds Vbucket 828 2016-03-24T06:25:57.741-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6270 Milliseconds Vbucket 828 2016-03-24T06:25:57.771-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6300 Milliseconds Vbucket 828 2016-03-24T06:25:57.801-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6330 Milliseconds Vbucket 828 2016-03-24T06:25:57.831-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6360 Milliseconds Vbucket 828 2016-03-24T06:25:57.861-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6390 Milliseconds Vbucket 828 2016-03-24T06:25:57.891-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6420 Milliseconds Vbucket 828 2016-03-24T06:25:57.921-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6450 Milliseconds Vbucket 828 2016-03-24T06:25:57.951-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6480 Milliseconds Vbucket 828 2016-03-24T06:25:57.981-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6510 Milliseconds Vbucket 828 2016-03-24T06:25:58.011-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6540 Milliseconds Vbucket 828 2016-03-24T06:25:58.041-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6570 Milliseconds Vbucket 828 2016-03-24T06:25:58.071-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6600 Milliseconds Vbucket 828 2016-03-24T06:25:58.101-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6630 Milliseconds Vbucket 828 2016-03-24T06:25:58.131-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6660 Milliseconds Vbucket 828 2016-03-24T06:25:58.161-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6690 Milliseconds Vbucket 828 2016-03-24T06:25:58.183-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9390000 QueuedCount 24380 2016-03-24T06:25:58.191-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6720 Milliseconds Vbucket 828 2016-03-24T06:25:58.221-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6750 Milliseconds Vbucket 828 2016-03-24T06:25:58.251-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6780 Milliseconds Vbucket 828 2016-03-24T06:25:58.281-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6810 Milliseconds Vbucket 828 2016-03-24T06:25:58.301-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9400000 QueuedCount 14380 2016-03-24T06:25:58.311-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6840 Milliseconds Vbucket 828 2016-03-24T06:25:58.341-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6870 Milliseconds Vbucket 828 2016-03-24T06:25:58.371-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6900 Milliseconds Vbucket 828 2016-03-24T06:25:58.401-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6930 Milliseconds Vbucket 828 2016-03-24T06:25:58.431-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6960 Milliseconds Vbucket 828 2016-03-24T06:25:58.461-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 6990 Milliseconds Vbucket 828 2016-03-24T06:25:58.491-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7020 Milliseconds Vbucket 828 2016-03-24T06:25:58.521-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7050 Milliseconds Vbucket 828 2016-03-24T06:25:58.551-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7080 Milliseconds Vbucket 828 2016-03-24T06:25:58.581-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7110 Milliseconds Vbucket 828 2016-03-24T06:25:58.611-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7140 Milliseconds Vbucket 828 2016-03-24T06:25:58.641-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7170 Milliseconds Vbucket 828 2016-03-24T06:25:58.671-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7200 Milliseconds Vbucket 828 2016-03-24T06:25:58.701-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7230 Milliseconds Vbucket 828 2016-03-24T06:25:58.731-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7260 Milliseconds Vbucket 828 2016-03-24T06:25:58.761-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7290 Milliseconds Vbucket 828 2016-03-24T06:25:58.791-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7320 Milliseconds Vbucket 828 2016-03-24T06:25:58.821-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7350 Milliseconds Vbucket 828 2016-03-24T06:25:58.851-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7380 Milliseconds Vbucket 828 2016-03-24T06:25:58.881-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7410 Milliseconds Vbucket 828 2016-03-24T06:25:58.911-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7440 Milliseconds Vbucket 828 2016-03-24T06:25:58.941-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7470 Milliseconds Vbucket 828 2016-03-24T06:25:58.971-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7500 Milliseconds Vbucket 828 2016-03-24T06:25:59.001-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7530 Milliseconds Vbucket 828 2016-03-24T06:25:59.005-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9410000 QueuedCount 4380 2016-03-24T06:25:59.031-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7560 Milliseconds Vbucket 828 2016-03-24T06:25:59.061-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7590 Milliseconds Vbucket 828 2016-03-24T06:25:59.091-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7620 Milliseconds Vbucket 828 2016-03-24T06:25:59.121-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7650 Milliseconds Vbucket 828 2016-03-24T06:25:59.151-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7680 Milliseconds Vbucket 828 2016-03-24T06:25:59.181-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7710 Milliseconds Vbucket 828 2016-03-24T06:25:59.211-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7740 Milliseconds Vbucket 828 2016-03-24T06:25:59.241-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7770 Milliseconds Vbucket 828 2016-03-24T06:25:59.271-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7800 Milliseconds Vbucket 828 2016-03-24T06:25:59.301-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7830 Milliseconds Vbucket 828 2016-03-24T06:25:59.331-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7860 Milliseconds Vbucket 828 2016-03-24T06:25:59.361-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7890 Milliseconds Vbucket 828 2016-03-24T06:25:59.391-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7920 Milliseconds Vbucket 828 2016-03-24T06:25:59.421-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7950 Milliseconds Vbucket 828 2016-03-24T06:25:59.451-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 7980 Milliseconds Vbucket 828 2016-03-24T06:25:59.481-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8010 Milliseconds Vbucket 828 2016-03-24T06:25:59.511-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8040 Milliseconds Vbucket 828 2016-03-24T06:25:59.541-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8070 Milliseconds Vbucket 828 2016-03-24T06:25:59.571-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8100 Milliseconds Vbucket 828 2016-03-24T06:25:59.601-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8130 Milliseconds Vbucket 828 2016-03-24T06:25:59.631-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8160 Milliseconds Vbucket 828 2016-03-24T06:25:59.661-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8190 Milliseconds Vbucket 828 2016-03-24T06:25:59.691-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8220 Milliseconds Vbucket 828 2016-03-24T06:25:59.721-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8250 Milliseconds Vbucket 828 2016-03-24T06:25:59.751-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8280 Milliseconds Vbucket 828 2016-03-24T06:25:59.781-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8310 Milliseconds Vbucket 828 2016-03-24T06:25:59.811-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8340 Milliseconds Vbucket 828 2016-03-24T06:25:59.841-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8370 Milliseconds Vbucket 828 2016-03-24T06:25:59.871-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8400 Milliseconds Vbucket 828 2016-03-24T06:25:59.901-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8430 Milliseconds Vbucket 828 2016-03-24T06:25:59.931-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8460 Milliseconds Vbucket 828 2016-03-24T06:25:59.961-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8490 Milliseconds Vbucket 828 2016-03-24T06:25:59.991-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8520 Milliseconds Vbucket 828 2016-03-24T06:26:00.021-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8550 Milliseconds Vbucket 828 2016-03-24T06:26:00.051-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8580 Milliseconds Vbucket 828 2016-03-24T06:26:00.081-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8610 Milliseconds Vbucket 828 2016-03-24T06:26:00.091-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 24.676µs CommitTime 1.01040572s TotalFlushTime 8m48.100557091s TotalCommitTime 1m5.852467387s 2016-03-24T06:26:00.091-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9414380, 9414380, 106 committed:true 2016-03-24T06:26:00.091-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9414380, 9414380, 106 committed:true) SnapCreateDur 1.03601689s SnapOpenDur 48.169µs 2016-03-24T06:26:00.111-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8640 Milliseconds Vbucket 828 2016-03-24T06:26:00.141-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8670 Milliseconds Vbucket 828 2016-03-24T06:26:00.171-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8700 Milliseconds Vbucket 828 2016-03-24T06:26:00.198-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9420000 QueuedCount 6505 2016-03-24T06:26:00.201-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8730 Milliseconds Vbucket 828 2016-03-24T06:26:00.231-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8760 Milliseconds Vbucket 828 2016-03-24T06:26:00.261-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8790 Milliseconds Vbucket 828 2016-03-24T06:26:00.291-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8820 Milliseconds Vbucket 828 2016-03-24T06:26:00.321-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8850 Milliseconds Vbucket 828 2016-03-24T06:26:00.351-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8880 Milliseconds Vbucket 828 2016-03-24T06:26:00.381-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8910 Milliseconds Vbucket 828 2016-03-24T06:26:00.411-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8940 Milliseconds Vbucket 828 2016-03-24T06:26:00.441-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 8970 Milliseconds Vbucket 828 2016-03-24T06:26:00.471-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9000 Milliseconds Vbucket 828 2016-03-24T06:26:00.501-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9030 Milliseconds Vbucket 828 2016-03-24T06:26:00.531-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9060 Milliseconds Vbucket 828 2016-03-24T06:26:00.561-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9090 Milliseconds Vbucket 828 2016-03-24T06:26:00.591-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9120 Milliseconds Vbucket 828 2016-03-24T06:26:00.621-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9150 Milliseconds Vbucket 828 2016-03-24T06:26:00.651-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9180 Milliseconds Vbucket 828 2016-03-24T06:26:00.681-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9210 Milliseconds Vbucket 828 2016-03-24T06:26:00.711-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9240 Milliseconds Vbucket 828 2016-03-24T06:26:00.741-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9270 Milliseconds Vbucket 828 2016-03-24T06:26:00.771-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9300 Milliseconds Vbucket 828 2016-03-24T06:26:00.801-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9330 Milliseconds Vbucket 828 2016-03-24T06:26:00.831-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9360 Milliseconds Vbucket 828 2016-03-24T06:26:00.861-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9390 Milliseconds Vbucket 828 2016-03-24T06:26:00.882-07:00 [Info] ForestDBSlice::Commit SliceId 0 IndexInstId 1061207747814546192 FlushTime 4.968µs CommitTime 573.996446ms TotalFlushTime 8m48.266250468s TotalCommitTime 1m6.426463833s 2016-03-24T06:26:00.882-07:00 [Info] ForestDBSlice::OpenSnapshot SliceId 0 IndexInstId 1061207747814546192 Creating New Snapshot SnapshotInfo: seqnos: 9426505, 9426505, 107 committed:true 2016-03-24T06:26:00.882-07:00 [Info] StorageMgr::handleCreateSnapshot Added New Snapshot Index: 1061207747814546192 PartitionId: 0 SliceId: 0 Crc64: 8116629971307076159 (SnapshotInfo: seqnos: 9426505, 9426505, 107 committed:true) SnapCreateDur 586.362444ms SnapOpenDur 45.107µs 2016-03-24T06:26:00.891-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9420 Milliseconds Vbucket 828 2016-03-24T06:26:00.912-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:00.921-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9450 Milliseconds Vbucket 828 2016-03-24T06:26:00.937-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:00.95-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9430000 QueuedCount 7625 2016-03-24T06:26:00.951-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9480 Milliseconds Vbucket 828 2016-03-24T06:26:00.961-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:00.981-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9510 Milliseconds Vbucket 828 2016-03-24T06:26:00.987-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:01.008-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:01.011-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9540 Milliseconds Vbucket 828 2016-03-24T06:26:01.041-07:00 [Warn] Indexer::MutationQueue Waiting for Node Alloc for 9570 Milliseconds Vbucket 828 2016-03-24T06:26:01.05-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:01.135-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9440000 QueuedCount 50000 2016-03-24T06:26:01.137-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14590000 2016-03-24T06:26:01.204-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14600000 2016-03-24T06:26:01.267-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14610000 2016-03-24T06:26:01.325-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:01.331-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14620000 2016-03-24T06:26:02.396-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9450000 QueuedCount 50000 2016-03-24T06:26:02.475-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14630000 2016-03-24T06:26:02.535-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14640000 2016-03-24T06:26:02.544-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9460000 QueuedCount 50000 2016-03-24T06:26:02.597-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14650000 2016-03-24T06:26:02.658-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14660000 2016-03-24T06:26:02.74-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14670000 2016-03-24T06:26:02.823-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14680000 2016-03-24T06:26:02.906-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14690000 2016-03-24T06:26:02.991-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14700000 2016-03-24T06:26:03.077-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14710000 2016-03-24T06:26:03.169-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14720000 2016-03-24T06:26:03.258-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14730000 2016-03-24T06:26:03.351-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14740000 2016-03-24T06:26:03.406-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9470000 QueuedCount 50000 2016-03-24T06:26:03.424-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14750000 2016-03-24T06:26:03.486-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14760000 2016-03-24T06:26:03.487-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:03.508-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:03.536-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9480000 QueuedCount 50000 2016-03-24T06:26:03.56-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14770000 2016-03-24T06:26:03.623-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14780000 2016-03-24T06:26:03.624-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:03.709-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14790000 2016-03-24T06:26:03.797-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14800000 2016-03-24T06:26:03.887-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14810000 2016-03-24T06:26:03.985-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14820000 2016-03-24T06:26:04.088-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14830000 2016-03-24T06:26:04.203-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14840000 2016-03-24T06:26:04.314-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14850000 2016-03-24T06:26:04.341-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9490000 QueuedCount 50000 2016-03-24T06:26:04.381-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14860000 2016-03-24T06:26:04.394-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:04.435-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:04.462-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14870000 2016-03-24T06:26:04.466-07:00 [Info] logWriterStat:: 1061207747814546192 FlushedCount 9500000 QueuedCount 50000 2016-03-24T06:26:04.534-07:00 [Info] logReaderStat:: MAINT_STREAM MutationCount 14880000 2016-03-24T06:26:04.538-07:00 [Info] StorageMgr::handleCreateSnapshot Skip Snapshot For MAINT_STREAM bucket-1 SnapType NO_SNAP 2016-03-24T06:26:04.616-07:00 [Info] logReaderStat:: M