Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7522

Optimize very common index state transitions (rebalance)

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Critical
    • 2.0.1
    • 2.0.1
    • view-engine
    • Security Level: Public
    • None
    • Release Note
    • 2

    Description

      Optimize 2 types of state transitions:

      1) If a state transition consists only of moving partitions
      between the passive and active states (or vice-versa), that
      is, no new partitions are added nor existing partitions are
      marked for cleanup, don't restart the updater (at the expense
      of more complex logic to correct snapshots received from a
      currently running updater).

      2) If a state transition only adds new partitions to the
      passive state (as ns_server's rebalance frequently calls),
      don't restart the updater, and send the updater the new
      list of passive partitions, so that it has a chance to
      iterate over those partitions' content and index them in
      the same run.

      As long as the rebalancer in ns_server doesn't keep changing
      its logic regarding state transitions all the time, this
      provides a significant reduction of the indexing time. However
      for at least some scenarios, there's still significant portion
      of rebalance time not spent on indexing nor index compaction.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            FilipeManana Filipe Manana (Inactive)
            FilipeManana Filipe Manana (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty