Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10472

Handle multiple snapshots properly in view engine

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 3.0
    • 3.0
    • view-engine
    • Security Level: Public
    • None
    • Triaged
    • Unknown

    Description

      The view engine currently buffers mutations in order to do de-duplication in case there are several snapshots. It currently works, but for 3.0 this needs to fixed properly.

      The current idea is to make a distinction between the initial and the incremental index build. In the initial index build only the first (on-disk) snapshot is requested for all partitions that are part of the index. Once it's built the updater is restarted to add all additional items as incremental updates. Whenever a snapshot marker is hit, it will force a flush. Probably the view engine checkpointing code can be re-used to force such a flush.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MB-10803 Initial indexing is 2-3x slower with UPR

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-10908 beam.smp RSS grows to 50GB during delta recovery causing OOM killer invocation and rebalance failure

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-10803 Initial indexing is 2-3x slower with UPR

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is triggered by

          Bug - A problem which impairs or prevents the functions of the product. MB-9974 Rebalance breaks UPR Stream Request

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          relates to

          Task - A task that needs to be done. MB-10640 Upr protocol change to improve rollbacks during a failover case

          • Test Blocker - QE-related tests can't proceed
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              vmx Volker Mische
              vmx Volker Mische
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty