Need better metric for reporting replication progress

Description

cbes.backfillRemaining is of limited usefulness; once the backfill is complete there's no way to tell how far behind the connector is.

It would be nice to have another metric (per vbucket) that reported the difference between the "current seqno" Couchbase knows about and the seqno most recently indexed in ES.

Environment

None

Gerrit Reviews

None

Release Notes Description

None

Activity

Show:

David Nault October 13, 2020 at 8:20 PM

Plan is to periodically call "get all vb seqnos" on all DCP channels to update the client's view of the state of Couchbase. These seqnos will be propagated to the Elasticsearch connector via a new method on the DatabaseChangeListener interface. When the connector receives these messages, it can compare the seqnos against the values processed by the checkpoint DAO, and update a metric to report how many seqnos are yet to be processed in Couchbase.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Sprint

Fix versions

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created April 17, 2019 at 6:59 PM
Updated October 23, 2020 at 8:04 PM
Resolved October 23, 2020 at 8:04 PM
Instabug