Loading...

XML

Word

Printable

Details

Type: Bug
Resolution: Fixed
Priority: Critical
Fix Version/s: 7.0.0
Affects Version/s: Cheshire-Cat
Component/s: secondary-index
Labels:
- eagle-eye
- system-test

Triage:
Untriaged
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.16.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.17.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.18.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.19.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.21.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.23.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.121.165.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.96.30.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.77.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.82.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.83.zip

Show
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.16.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.17.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.18.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.19.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.21.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.104.23.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.121.165.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.96.30.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.77.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.82.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1619897647/collectinfo-2021-05-01T193409-ns_1%40172.23.97.83.zip
Story Points:
1
Is this a Regression?:
Yes

Description

Build : 7.0.0-5075
Test : -test tests/2i/cheshirecat/test_idx_clusterops_cheshire_cat.yml -scope tests/2i/cheshirecat/scope_idx_cheshire_cat_dgm.yml
Scale : 2
Iteration : 1st

Seeing the following errors in the indexer logs on various indexer nodes :
172.23.97.77 : index
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:10:04.771-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.

172.23.97.82 : index
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:03:56.107-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:05:59.435-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:05:59.483-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.

172.23.97.83 : index
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:05:59.551-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:09:37.492-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.
/opt/couchbase/var/lib/couchbase/logs/indexer.log.1.gz:2021-05-01T12:10:04.798-07:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket4.

This is a regression as this issue was fixed in https://issues.couchbase.com/browse/MB-43060 and verified in 7.0.0-4970

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

People

Assignee:: Ajay Bhullar

Reporter:: Mihir Kamdar (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Due:: 12/May/21

Created:: 02/May/21 11:17 AM

Updated:: 17/Jun/21 3:10 PM

Resolved:: 10/May/21 10:24 PM

Gerrit Reviews

There are no open Gerrit changes

Show There is 1 closed Gerrit change

Hide There is 1 closed Gerrit change

MB-46051 - Add back the fix for MB-43060: Gerrit Review:

[System Test] : Invalid Internal State Detected. Index Count Underflow

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty