Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-32305

[FTS] - perf: optimize scorch term-field-reader concurrency?

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • feature-backlog
    • 5.5.0
    • fts
    • None
    • Untriaged
    • Unknown

    Description

      Currently, a scorch TermFieldReader has essentially a single threaded implementation of the Next() API...

      https://github.com/blevesearch/bleve/blob/master/index/scorch/snapshot_index_tfr.go#L77

      This ticket is to consider optimizations and experiments with adding more concurrency there (i.e., leverage multiple cores)?

      Especially, if there's a page-fault in these codepaths due to mmap'ed block access, the entire thread for the goroutine becomes blocked.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            marty.schoch Marty Schoch (Inactive)
            steve Steve Yen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty