Uploaded image for project: 'Couchbase Python Client Library'
  1. Couchbase Python Client Library
  2. PYCBC-237

Add page_size option to RowProcessor to limit get_multi sizes

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Security Level: Public
    • Labels:
      None

      Description

      This option would be delivered to the RowProcessor implementation (if it's an instance of RowProcessor) to limit the number of documents fetched for a multi-get when dealing with many view results.

      Currently if we get several thousand results in a single fetch, it means the include_docs handling with also try to do a get_multi on that many documents.

      This will waste much memory and slow down the application.

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        mnunberg Mark Nunberg added a comment -

        Note this is possible to work around via user code by implementing a custom RowProcessor

        Show
        mnunberg Mark Nunberg added a comment - Note this is possible to work around via user code by implementing a custom RowProcessor
        Hide
        mnunberg Mark Nunberg added a comment -

        This is now handled by libcouchbase. We might want to expose a similar option for this in libcouchbase in the future.

        Show
        mnunberg Mark Nunberg added a comment - This is now handled by libcouchbase. We might want to expose a similar option for this in libcouchbase in the future.

          People

          • Assignee:
            mnunberg Mark Nunberg
            Reporter:
            mnunberg Mark Nunberg
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes