Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11056

crc32_8 is a major performance bottleneck during bulk writes

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • techdebt-backlog
    • 2.5.1
    • forestdb
    • Security Level: Public
    • None
    • MacBook Pro (2012), 2.3GHz Intel Core i7 (8 CPUs)
      Mac OS X 10.9.3

    Description

      The crc32_8 function is constraining performance of database writes, specifically, flushing the WAL. During a large fdb_commit that I've profiled, 32% of the time is spent in the crc32_8 function. (And the fdb_commit call was responsible for 70% of the time to write the database!)

      I experimentally changed crc32_8 to call the adler32 function from libz, and saw a 20% improvement in commit time. (From the docs: "An Adler-32 checksum is almost as reliable as a CRC32 but can be computed much faster.")

      Attachments

        For Gerrit Dashboard: MB-11056
        # Subject Branch Project Status CR V

        Activity

          People

            jung-sang Jung-Sang Ahn (Inactive)
            jens Jens Alfke
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty