Uploaded image for project: 'Couchbase Elasticsearch Connector'
  1. Couchbase Elasticsearch Connector
  2. CBES-121

Need better metric for reporting replication progress

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.2.5
    • None
    • SDK 42: Txns/Connect/Docs/3.1

    Description

      cbes.backfillRemaining is of limited usefulness; once the backfill is complete there's no way to tell how far behind the connector is.

      It would be nice to have another metric (per vbucket) that reported the difference between the "current seqno" Couchbase knows about and the seqno most recently indexed in ES.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          david.nault David Nault added a comment -

          Plan is to periodically call "get all vb seqnos" on all DCP channels to update the client's view of the state of Couchbase. These seqnos will be propagated to the Elasticsearch connector via a new method on the DatabaseChangeListener interface. When the connector receives these messages, it can compare the seqnos against the values processed by the checkpoint DAO, and update a metric to report how many seqnos are yet to be processed in Couchbase.

          david.nault David Nault added a comment - Plan is to periodically call "get all vb seqnos" on all DCP channels to update the client's view of the state of Couchbase. These seqnos will be propagated to the Elasticsearch connector via a new method on the DatabaseChangeListener interface. When the connector receives these messages, it can compare the seqnos against the values processed by the checkpoint DAO, and update a metric to report how many seqnos are yet to be processed in Couchbase.

          People

            david.nault David Nault
            david.nault David Nault
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty