Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44615

query throughput 50% lower for 1000 collections

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • Cheshire-Cat
    • 7.0.0
    • fts
    • Untriaged
    • Centos 64-bit
    • 1
    • Unknown

    Description

      In 1s1c test case we load 1M docs into a single collection and build single index on that collection. In 1s1000c we load the same set and number of docs but split evenly across 1000 collections, then build a single index on those 1000 collections. In both test cases, the queries target the single index with the same query.

      http://showfast.sc.couchbase.com/#/timeline/Linux/jts/1M/Throughput

      Average Throughput (q/sec), AndHighHigh, 10K KV w/sec, wiki 1M x 1KB, 3 node, FTS, s=1 c=1

      http://perf.jenkins.couchbase.com/job/atlas_collections/215/consoleFull

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-215/172.23.99.211.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-215/172.23.99.39.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-215/172.23.99.40.zip

      Throughput - 1240

      Average Throughput (q/sec), AndHighHigh, 10K KV w/sec, wiki 1M x 1KB, 3 node, FTS, s=1 c=1000

      http://perf.jenkins.couchbase.com/job/atlas_collections/217/consoleFull

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-217/172.23.99.211.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-217/172.23.99.39.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-atlas_collections-217/172.23.99.40.zip

      Throughput - 660

      Comparison graphs:

      http://cbmonitor.sc.couchbase.com/reports/html/?snapshot=fts_700-4502_run_test_a98f&label=1s1c&snapshot=fts_700-4502_run_test_1f26&label=1s1000c

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Build couchbase-server-7.0.0-4611 contains cbgt commit 3e9157f with commit message:
          MB-44615: [PartitionSeqs] Fetching vbucket collection high seqnos

          build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4611 contains cbgt commit 3e9157f with commit message: MB-44615 : [PartitionSeqs] Fetching vbucket collection high seqnos

          Build couchbase-server-7.0.0-4611 contains cbgt commit 01aad32 with commit message:
          MB-44615: No need to retreive start_seqnos for collections

          build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4611 contains cbgt commit 01aad32 with commit message: MB-44615 : No need to retreive start_seqnos for collections

          Korrigan Clark We've merged a change with which we should expect to see better throughput - http://review.couchbase.org/c/cbft/+/147796

          With the change we avoid having to parse the index mapping to obtain scope-collection details for every query. Would you give this test a re-run once a build is available?

          abhinav Abhinav Dangeti added a comment - Korrigan Clark  We've merged a change with which we should expect to see better throughput - http://review.couchbase.org/c/cbft/+/147796 With the change we avoid having to parse the index mapping to obtain scope-collection details for every query. Would you give this test a re-run once a build is available?

          Build couchbase-server-7.0.0-4633 contains cbft commit 7237132 with commit message:
          MB-44615- Throughput 50% lower for 1000 collections

          build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4633 contains cbft commit 7237132 with commit message: MB-44615 - Throughput 50% lower for 1000 collections
          korrigan.clark Korrigan Clark (Inactive) added a comment - - edited rerunning: http://perf.jenkins.couchbase.com/job/atlas_collections/400/ - 1236.0 http://perf.jenkins.couchbase.com/job/atlas_collections/401/   - 1224.0 looks better now.

          People

            korrigan.clark Korrigan Clark (Inactive)
            korrigan.clark Korrigan Clark (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty