Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
6.5.0, 6.5.1
-
Untriaged
-
No
-
KV-Engine MH 2nd Beta, KV Sprint 2020-April
Description
Build 6.5.0-4218
Observed that replication stuck when data service goes into low resident ratio.
While running some HiDD tests on couchbase bucket we came across this issue.
In this test we have 2 data nodes, load 250M docs and RR goes to 0.43%. After load phase we wait for "ep_dcp_replica_items_remaining" to go to zero. "ep_dcp_replica_items_remaining" stays ~19K and never become zero.
Job- http://perf.jenkins.couchbase.com/job/magma-hidd/441
Logs-
https://cb-jira.s3.us-east-2.amazonaws.com/logs/replica_issue_couchbase/collectinfo-2019-09-10T055022-ns_1%40172.23.97.38.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/replica_issue_couchbase/collectinfo-2019-09-10T055022-ns_1%40172.23.97.39.zip
Attachments
Issue Links
Activity
Field | Original Value | New Value |
---|---|---|
Fix Version/s | Mad-Hatter [ 15037 ] |
Labels | Performance | Performance hidd |
Assignee | Daniel Owen [ owend ] | Jim Walker [ jwalker ] |
Assignee | Jim Walker [ jwalker ] | Mahesh Mandhare [ mahesh.mandhare ] |
Resolution | Fixed [ 1 ] | |
Status | Open [ 1 ] | Resolved [ 5 ] |
Assignee | Mahesh Mandhare [ mahesh.mandhare ] | Jim Walker [ jwalker ] |
Resolution | Fixed [ 1 ] | |
Status | Resolved [ 5 ] | Reopened [ 4 ] |
Status | Reopened [ 4 ] | In Progress [ 3 ] |
Sprint | KV-Engine MH 2nd Beta [ 872 ] |
Rank | Ranked higher |
Assignee | Jim Walker [ jwalker ] | Mahesh Mandhare [ mahesh.mandhare ] |
Resolution | Fixed [ 1 ] | |
Status | In Progress [ 3 ] | Resolved [ 5 ] |
Status | Resolved [ 5 ] | Closed [ 6 ] |
Resolution | Fixed [ 1 ] | |
Status | Closed [ 6 ] | Reopened [ 4 ] |
Assignee | Mahesh Mandhare [ mahesh.mandhare ] | Jim Walker [ jwalker ] |
Fix Version/s | Cheshire-Cat [ 15915 ] | |
Fix Version/s | Mad-Hatter [ 15037 ] |
Sprint | KV-Engine MH 2nd Beta [ 872 ] | KV-Engine MH 2nd Beta, KV-Engine MH 2nd Beta 2 [ 872, 910 ] |
Sprint | KV-Engine MH 2nd Beta, KV-Engine Mad-Hatter GA [ 872, 910 ] | KV-Engine MH 2nd Beta [ 872 ] |
Rank | Ranked higher |
Epic Link |
|
Assignee | Jim Walker [ jwalker ] | Ben Huddleston [ ben.huddleston ] |
Summary | Replication stuck if data service in low resident ratio | Replication can get stuck when checkpoint memory overhead is very high |
Sprint | KV-Engine MH 2nd Beta [ 872 ] | KV-Engine MH 2nd Beta, KV Spint 2020-March [ 872, 1002 ] |
Rank | Ranked lower |
Sprint | KV-Engine MH 2nd Beta, KV Spint 2020-March [ 872, 1002 ] | KV-Engine MH 2nd Beta, KV Sprint 2020-April [ 872, 1044 ] |
Rank | Ranked lower |
Link | This issue relates to CBSE-8284 [ CBSE-8284 ] |
Labels | Performance hidd | Performance candidate-for-6.6 hidd |
Fix Version/s | 6.6.0 [ 16787 ] |
Affects Version/s | 6.5.1 [ 16622 ] |
Priority | Major [ 3 ] | Critical [ 2 ] |
Link | This issue blocks MB-38724 [ MB-38724 ] |
Labels | Performance candidate-for-6.6 hidd | Performance approved-for-6.6.0 candidate-for-6.6 hidd |
Fix Version/s | Cheshire-Cat [ 15915 ] | |
Resolution | Fixed [ 1 ] | |
Status | Reopened [ 4 ] | Resolved [ 5 ] |
Resolution | Fixed [ 1 ] | |
Status | Resolved [ 5 ] | Reopened [ 4 ] |
Resolution | Fixed [ 1 ] | |
Status | Reopened [ 4 ] | Resolved [ 5 ] |
Assignee | Ben Huddleston [ ben.huddleston ] | Bo-Chun Wang [ bo-chun.wang ] |
Labels | Performance approved-for-6.6.0 candidate-for-6.6 hidd | Performance affects-cc-testing approved-for-6.6.0 candidate-for-6.6 hidd |
Status | Resolved [ 5 ] | Closed [ 6 ] |