Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-22013

Port AccessScanner to pause/resume visitor

    XMLWordPrintable

Details

    • Release Note

    Description

      At the moment it builds a list (set) of all keys in a vbucket, then writes to disk. This is so we don't perform disk in the vbucket callback.

      Problem with this is that we need a massive chunk of memory to hold all the keys.

      Better approach would be to use the pause/resume visitor to say visit N keys, write to the disk, then continue. Also means we don't hold HashTable locks for long times (AccessScanner doesn't have to include every key, given it may well change in 1 days' time).

      Attachments

        1. Linear.png
          69 kB
          Oliver Downard
        2. logarithmic.png
          89 kB
          Oliver Downard

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              drigby Dave Rigby (Inactive)
              drigby Dave Rigby (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty