Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48496

Fetch operator batch size never grows to pipeline cap

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 6.5.0, 6.0.0, 5.5.0, 5.5.1, 5.5.2, 5.5.3, 6.0.1, 6.0.2, 5.5.4, 6.0.3, 5.5.5, 5.5.6, 6.0.4, 6.5.1, 6.0.5, 6.6.0, 6.6.1, 6.6.2, 6.5.2, 7.0.0, 6.6.3, 7.1.0, 7.0.1, 6.6.4
    • 7.1.0, 7.0.2, 6.6.5
    • query
    • Untriaged
    • 1
    • Yes

    Description

      In mad hatter and later, if the amount of data to be fetched exceeds the current pipeline cap, this latter is not increased to match the value exchange capacity, which results in a lower throughput.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            marco.greco Marco Greco created issue -
            marco.greco Marco Greco made changes -
            Field Original Value New Value
            Link This issue causes CBSE-10676 [ CBSE-10676 ]

            Build couchbase-server-7.1.0-1304 contains query commit 66a4003 with commit message:
            MB-48496 grow fetch batch to pipeline cap

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.1.0-1304 contains query commit 66a4003 with commit message: MB-48496 grow fetch batch to pipeline cap
            lynn.straus Lynn Straus made changes -
            Is this a Regression? Unknown [ 10452 ] Yes [ 10450 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-46308 [ MB-46308 ]
            wayne Wayne Siu made changes -
            Labels approved-for-7.0.2
            wayne Wayne Siu made changes -
            Fix Version/s 7.0.2 [ 18012 ]
            kamini.jagtiani Kamini Jagtiani made changes -
            Affects Version/s 6.6.0 [ 16787 ]
            Affects Version/s 5.5.5 [ 16166 ]
            Affects Version/s 6.0.0 [ 15048 ]
            Affects Version/s 6.5.0 [ 15037 ]
            kamini.jagtiani Kamini Jagtiani made changes -
            Affects Version/s 5.5.0 [ 14610 ]
            Affects Version/s 5.5.5 [ 16166 ]

            Chris Malarky Added the affected versions starting 5.5.0

            kamini.jagtiani Kamini Jagtiani added a comment - Chris Malarky  Added the affected versions starting 5.5.0
            kamini.jagtiani Kamini Jagtiani made changes -
            Affects Version/s 7.0.0 [ 17233 ]

            Build couchbase-server-7.0.2-6683 contains query commit 7e15991 with commit message:
            MB-48496 grow fetch batch to pipeline cap

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.2-6683 contains query commit 7e15991 with commit message: MB-48496 grow fetch batch to pipeline cap
            malarky Chris Malarky made changes -
            Affects Version/s 5.5.6 [ 16211 ]
            Affects Version/s 5.5.5 [ 16166 ]
            Affects Version/s 6.0.3 [ 16164 ]
            Affects Version/s 5.5.4 [ 16003 ]
            Affects Version/s 6.0.2 [ 15919 ]
            Affects Version/s 6.0.1 [ 15522 ]
            Affects Version/s 5.5.3 [ 15520 ]
            Affects Version/s 5.5.2 [ 15412 ]
            Affects Version/s 5.5.1 [ 15159 ]
            Affects Version/s 6.5.2 [ 17223 ]
            Affects Version/s 6.6.2 [ 17103 ]
            Affects Version/s 6.6.1 [ 17002 ]
            Affects Version/s 6.0.5 [ 16729 ]
            Affects Version/s 6.5.1 [ 16622 ]
            Affects Version/s 6.0.4 [ 16502 ]
            wayne Wayne Siu made changes -
            Labels approved-for-7.0.2 6.6.4-candidate approved-for-7.0.2
            wayne Wayne Siu made changes -
            Link This issue blocks MB-47673 [ MB-47673 ]
            wayne Wayne Siu made changes -
            Labels 6.6.4-candidate approved-for-7.0.2 6.6.4-candidate approved-for-6.6.4 approved-for-7.0.2
            marco.greco Marco Greco made changes -
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            marco.greco Marco Greco made changes -
            Assignee Marco Greco [ marco.greco ] Pierre Regazzoni [ JIRAUSER25157 ]
            marco.greco Marco Greco added a comment -

            Repro:

            1) Install travel-sample
            2) INSERT INTO `travel-sample` (KEY UUID(), VALUE t) SELECT t FROM `travel-sample` t;
            3) INSERT INTO `travel-sample` (KEY UUID(), VALUE t) SELECT t FROM `travel-sample` t;
            4) At this time you have 126364 documents
            5) SELECT COUNT(1) FROM `travel-sample` t WHERE t.x IS MISSING;

            without the fix the select is much slower than with the fix (anything in between 30% and 100%)

            As an alternative without the fix, setting pipeline_cap to 512 improves the performance, with the fix pipeline_cap makes no difference.

            marco.greco Marco Greco added a comment - Repro: 1) Install travel-sample 2) INSERT INTO `travel-sample` (KEY UUID(), VALUE t) SELECT t FROM `travel-sample` t; 3) INSERT INTO `travel-sample` (KEY UUID(), VALUE t) SELECT t FROM `travel-sample` t; 4) At this time you have 126364 documents 5) SELECT COUNT(1) FROM `travel-sample` t WHERE t.x IS MISSING; without the fix the select is much slower than with the fix (anything in between 30% and 100%) As an alternative without the fix, setting pipeline_cap to 512 improves the performance, with the fix pipeline_cap makes no difference.

            Build couchbase-server-6.6.4-9918 contains query commit d83a62e with commit message:
            MB-48496 grow fetch batch to pipeline cap

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.4-9918 contains query commit d83a62e with commit message: MB-48496 grow fetch batch to pipeline cap

            Verfied on 7.1.0-1304, 7.0.2-6683 and 6.6.4-9918.

            Ran repro and see following perf difference with fix vs without fix respectively:

            • for 7.1.0 and 7.0.2: 14s vs 24s
            • for 6.6.4: 20s vs 31s
            pierre.regazzoni Pierre Regazzoni added a comment - Verfied on 7.1.0-1304, 7.0.2-6683 and 6.6.4-9918. Ran repro and see following perf difference with fix vs without fix respectively: for 7.1.0 and 7.0.2: 14s vs 24s for 6.6.4: 20s vs 31s
            pierre.regazzoni Pierre Regazzoni made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            wayne Wayne Siu made changes -
            Link This issue relates to MB-48658 [ MB-48658 ]
            kamini.jagtiani Kamini Jagtiani made changes -
            Link This issue is triggering MB-49902 [ MB-49902 ]
            wayne Wayne Siu made changes -
            Link This issue causes MB-49902 [ MB-49902 ]
            wayne Wayne Siu made changes -
            Link This issue is triggering MB-49902 [ MB-49902 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-48997 [ MB-48997 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-48997 [ MB-48997 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-50048 [ MB-50048 ]
            malarky Chris Malarky made changes -
            Affects Version/s 6.6.4 [ 18218 ]

            People

              pierre.regazzoni Pierre Regazzoni
              marco.greco Marco Greco
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty