Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
SDK 42: Txns/Connect/Docs/3.1
Description
cbes.backfillRemaining is of limited usefulness; once the backfill is complete there's no way to tell how far behind the connector is.
It would be nice to have another metric (per vbucket) that reported the difference between the "current seqno" Couchbase knows about and the seqno most recently indexed in ES.
Plan is to periodically call "get all vb seqnos" on all DCP channels to update the client's view of the state of Couchbase. These seqnos will be propagated to the Elasticsearch connector via a new method on the DatabaseChangeListener interface. When the connector receives these messages, it can compare the seqnos against the values processed by the checkpoint DAO, and update a metric to report how many seqnos are yet to be processed in Couchbase.