Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62960

Explore possible chunking optimisations

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Morpheus
    • None
    • fts
    • 0

    Description

      This ticket is set up to explore any optimisations possible when creating chunks when indexing or using them at query time.

      The default size of a chunk in zapx is 1024 items, since that's believed to be the optimal number of items needed to be "walked" without skipping(Ref: https://github.com/blevesearch/zapx/blob/master/chunk.go#L53-L61). .

      The first experiment is to vary the chunk size and see its impact on specific query types like conjunction, disjunction and geo at both query and indexing time(More details in comments).

       

      Will continue to update this as I explore more ideas to improve our chunking and related capabilities.

      Attachments

        Activity

          People

            aditi.ahuja Aditi Ahuja
            aditi.ahuja Aditi Ahuja
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              PagerDuty