[MB-45907] Eventing: Data miss match with SBM + multiple kv rebalance - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Critical
Resolution: Fixed
Affects Version/s: Cheshire-Cat
Fix Version/s: 7.0.0
Component/s: eventing
Labels:
- affects-cc-testing
- functional-test

Triage:
Untriaged
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.101.zip
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.102.zip
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.103.zip
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.104.zip
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.105.zip

Enterprise Edition 7.0.0 build 5102:

s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.101.zip
s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.102.zip
s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.103.zip
s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.104.zip
s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.105.zip

Latest logs
s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.101.zip
s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.102.zip
s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.103.zip
s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.104.zip
s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.105.zip

Show
s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.105.zip Enterprise Edition 7.0.0 build 5102: s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.105.zip Latest logs s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5102_latest/2021-05-05/collectinfo-2021-05-05t154607-ns_1@10.112.206.105.zip
Story Points:
1
Is this a Regression?:
Unknown

Description

Build: 7.0.0-5017

Test

./testrunner -i /tmp/testexec.18313.ini -p get-cbcollect-info=True,GROUP=bucket_op,skip_log_scan=False,bucket_storage=couchstore -t eventing.eventing_rebalance_collection.EventingRebalanceCollection.test_eventing_rebalance_with_multiple_kv_nodes,doc-per-day=20,dataset=default,nodes_init=5,services_init=kv-kv-kv-eventing-index:n1ql,groups=simple,reset_services=True,GROUP=bucket_op,java_sdk_client=True,get-cbcollect-info=True,skip_log_scan=False,bucket_storage=couchstore

Exception: missing data in destination bucket. Current : 94233 Expected : 120960  dcp_backlog : 0  TIMERS_IN_PAST : 0 lcb_exceptions : {'172.23.122.171': {}, '172.23.122.172': {}}

Seeing no lcb exceptions in the stats

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

172.23.122.170-20210424-2153-diag.zip
6.70 MB
25/Apr/21 10:39 PM
172.23.122.171-20210424-2153-diag.zip
13.87 MB
25/Apr/21 10:39 PM
172.23.122.172-20210424-2153-diag.zip
13.11 MB
25/Apr/21 10:39 PM
172.23.122.173-20210424-2153-diag.zip
12.29 MB
25/Apr/21 10:39 PM
172.23.122.174-20210424-2153-diag.zip
14.88 MB
25/Apr/21 10:39 PM
172.23.122.175-20210424-2153-diag.zip
12.66 MB
25/Apr/21 10:38 PM
172.23.122.176-20210424-2153-diag.zip
13.23 MB
25/Apr/21 10:39 PM
172.23.122.177-20210424-2153-diag.zip
11.77 MB
25/Apr/21 10:38 PM
mb-45907_testlogs.log
579 kB
05/May/21 6:20 PM
mb-54907_stats
67 kB
05/May/21 6:25 PM
Test_logs.txt
1.02 MB
25/Apr/21 10:39 PM
test_output.log
398 kB
05/May/21 12:44 AM

Issue Links

depends on

MB-44324 1 Timer callback failed with LCB_ERR_BUCKET_NOT_FOUND

Closed

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

Ascending order - Click to sort in descending order

Vikas Chaudhary created issue - 25/Apr/21 10:40 PM

Jeelan Poola made changes - 25/Apr/21 10:48 PM

Field	Original Value	New Value
Assignee	Jeelan Poola [ jeelan.poola ]	Ankit Prabhu [ ankit.prabhu ]

Jeelan Poola made changes - 25/Apr/21 10:55 PM

Assignee

Ankit Prabhu [ ankit.prabhu ]

Vinayaka Kamath [ JIRAUSER25010 ]

Vinayaka Kamath (Inactive) made changes - 26/Apr/21 12:38 AM

Link

This issue depends on ~~MB-44324~~ [ ~~MB-44324~~ ]

Vinayaka Kamath (Inactive) made changes - 26/Apr/21 4:03 AM

Due Date

30/Apr/21

Ritam Sharma made changes - 27/Apr/21 4:59 AM

Labels

functional-test

affects-cc-testing functional-test

Vinayaka Kamath (Inactive) made changes - 29/Apr/21 11:44 PM

Assignee

Vinayaka Kamath [ JIRAUSER25010 ]

Vikas Chaudhary [ vikas.chaudhary ]

Vikas Chaudhary made changes - 30/Apr/21 3:44 AM

Assignee

Vikas Chaudhary [ vikas.chaudhary ]

Vinayaka Kamath [ JIRAUSER25010 ]

Ankit Prabhu made changes - 03/May/21 7:43 AM

Due Date

30/Apr/21

05/May/21

Vinayaka Kamath (Inactive) made changes - 03/May/21 11:01 PM

Resolution		Fixed [ 1 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Mihir Kamdar (Inactive) made changes - 04/May/21 2:05 PM

Assignee

Vinayaka Kamath [ JIRAUSER25010 ]

Vikas Chaudhary [ vikas.chaudhary ]

Vikas Chaudhary made changes - 04/May/21 9:12 PM

Assignee

Vikas Chaudhary [ vikas.chaudhary ]

Sujay Gad [ JIRAUSER25279 ]

Vikas Chaudhary made changes - 04/May/21 9:12 PM

Assignee

Sujay Gad [ JIRAUSER25279 ]

Chanabasappa Ghali [ JIRAUSER25316 ]

Chanabasappa Ghali made changes - 04/May/21 10:50 PM

Link to Log File, atop/blg, CBCollectInfo, Core dump

Chanabasappa Ghali made changes - 04/May/21 10:50 PM

Resolution	Fixed [ 1 ]
Status	Resolved [ 5 ]	Reopened [ 4 ]

Vinayaka Kamath (Inactive) made changes - 04/May/21 10:52 PM

Assignee

Chanabasappa Ghali [ JIRAUSER25316 ]

Vinayaka Kamath [ JIRAUSER25010 ]

Chanabasappa Ghali made changes - 05/May/21 12:44 AM

Attachment

test_output.log [ 138992 ]

Vinayaka Kamath (Inactive) made changes - 05/May/21 12:58 AM

Assignee

Vinayaka Kamath [ JIRAUSER25010 ]

Chanabasappa Ghali [ JIRAUSER25316 ]

Chanabasappa Ghali made changes - 05/May/21 2:06 AM

Link to Log File, atop/blg, CBCollectInfo, Core dump	s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.105.zip	s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5092/2021-05-05/collectinfo-2021-05-05t053740-ns_1@10.112.206.105.zip Enterprise Edition 7.0.0 build 5102: s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.101.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.102.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.103.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.104.zip s3://cb-customers-secure/mb-45907--build-5102/2021-05-05/collectinfo-2021-05-05t085210-ns_1@10.112.206.105.zip
Assignee	Chanabasappa Ghali [ JIRAUSER25316 ]	Vinayaka Kamath [ JIRAUSER25010 ]

Ankit Prabhu made changes - 05/May/21 4:29 AM

Assignee

Vinayaka Kamath [ JIRAUSER25010 ]

Chanabasappa Ghali [ JIRAUSER25316 ]

Chanabasappa Ghali made changes - 05/May/21 8:50 AM

Link to Log File, atop/blg, CBCollectInfo, Core dump

Chanabasappa Ghali made changes - 05/May/21 8:51 AM

Assignee

Chanabasappa Ghali [ JIRAUSER25316 ]

Ankit Prabhu [ ankit.prabhu ]

Chanabasappa Ghali made changes - 05/May/21 6:20 PM

Attachment

mb-45907_testlogs.log [ 139179 ]

Chanabasappa Ghali made changes - 05/May/21 6:25 PM

Attachment

mb-54907_stats [ 139180 ]

Ankit Prabhu made changes - 05/May/21 9:39 PM

Assignee

Ankit Prabhu [ ankit.prabhu ]

Chanabasappa Ghali [ JIRAUSER25316 ]

Vinayaka Kamath (Inactive) made changes - 06/May/21 2:26 AM

Due Date

05/May/21

07/May/21

Chanabasappa Ghali made changes - 07/May/21 5:35 AM

Resolution		Fixed [ 1 ]
Status	Reopened [ 4 ]	Closed [ 6 ]

Lynn Straus made changes - 17/Jun/21 3:03 PM

Fix Version/s

7.0.0 [ 17233 ]

Lynn Straus made changes - 17/Jun/21 3:08 PM

Fix Version/s

Cheshire-Cat [ 15915 ]

People

Assignee:: Chanabasappa Ghali

Reporter:: Vikas Chaudhary

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Due:: 07/May/21

Created:: 25/Apr/21 10:40 PM

Updated:: 17/Jun/21 3:08 PM

Resolved:: 07/May/21 5:35 AM

Gerrit Reviews

There are no open Gerrit changes

Show There is 1 closed Gerrit change

Hide There is 1 closed Gerrit change

MB-45907: Update LCB stats when Bucket Connect Fails: Gerrit Review:

Couchbase Server

Eventing: Data miss match with SBM + multiple kv rebalance

Details

Description

Attachments

Attachments

Issue Links

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty