Details
-
Bug
-
Resolution: Fixed
-
Blocker
-
4.0.0
-
Security Level: Public
-
centOS 6.x
-
Triaged
-
No
Description
Build
4.0.0-1683
Found during manual testing of new UI with filter expression
1.Created replication between .186 and .188 with filter expression "aruna2"
2.Loaded ~100K keys on .186 with prefix aruna and aruna3, no incoming data on .188. Expected.
3.Continued loading with prefix "aruna2", saw incoming sets on .188. Continued for a bit, stopped. Started after fixing pipeline. Again stopped. This happened 2-3 times. See screenshot.
4.Shortly afterwards, .186 totally stopped replicating.
5.I continued loading @.186 till item count was 6.02M. I also see 5.69M keys in dcp queue on .186.
goxdcr log on .186
-------------------
StatisticsManager2015/03/27 13:48:26.389672 [INFO] total_doc=6023000, docs_processed=0, changes_left=6023000
StatisticsManager2015/03/27 13:48:26.390403 [INFO] Stats for pipeline f7f67975991126fd8a2fc2d71b9e11e0/def/default-400500189 {"CkptMgr": {"num_checkpoints": 9, "num_failedckpts": 0, "time_committing": {"count": 9, "max": 34, "mean": 11.777777777777779, "min": 3}}, "Errors": "[
,
{\"time\":\"2015-03-27T13:37:07.553358413-07:00\",\"errMsg\":\"map[xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_0:Xmem is stuck]\"}]", "Overview":
{"bandwidth_usage": 0, "changes_left": 6023000, "data_replicated": 0, "docs_checked": 326659, "docs_failed_cr_source": 0, "docs_filtered": 0, "docs_opt_repd": 0, "docs_processed": 0, "docs_received_from_dcp": 0, "docs_rep_queue": 0, "docs_written": 0, "num_checkpoints": 9, "num_failedckpts": 0, "rate_doc_checks": 1.633295e+06, "rate_doc_opt_repd": 0, "rate_received_from_dcp": 0, "rate_replicated": 0, "size_rep_queue": 0, "time_committing": 11, "wtavg_docs_latency": 0, "wtavg_meta_latency": 0}, "Progress": "Pipeline is running", "Status": "Replicating", "XDCRRouter":
{"docs_filtered": 0}, "dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_0":
{"docs_received_from_dcp": 0}, "dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_1":
{"docs_received_from_dcp": 0}, "xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_0":
{"data_replicated": 0, "docs_failed_cr_source": 0, "docs_opt_repd": 0, "docs_rep_queue": 0, "docs_written": 0, "size_rep_queue": 0}, "xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_1": {"data_replicated": 0, "docs_failed_cr_source": 0, "docs_opt_repd": 0, "docs_rep_queue": 0, "docs_written": 0, "size_rep_queue": 0}}
StatisticsManager2015/03/27 13:48:26.390507 [INFO] Xmem xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_0 state =2 connType=MemConn received 0 items, sent 0 items, 0 items waiting to confirm, 0 in queue
StatisticsManager2015/03/27 13:48:26.390616 [INFO] Xmem xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_1 state =2 connType=MemConn received 0 items, sent 0 items, 0 items waiting to confirm, 0 in queue
StatisticsManager2015/03/27 13:48:26.390681 [INFO] Rounter Router_dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_1 = map[xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_1:0]
StatisticsManager2015/03/27 13:48:26.390808 [INFO] Dcp dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_1 streamed 0 items. [] streams inactive
StatisticsManager2015/03/27 13:48:26.390871 [INFO] Rounter Router_dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_0 = map[xmem_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.188:11210_0:0]
StatisticsManager2015/03/27 13:48:26.390993 [INFO] Dcp dcp_f7f67975991126fd8a2fc2d71b9e11e0/def/default_10.3.4.186:11210_0 streamed 0 items. [] streams inactive
Attachments
Issue Links
- is duplicated by
-
MB-13994 GoXDCR: Replication is incomplete
- Closed