Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46350

[BP 7.0.2 MB-47802]:UI shows 104k mutations remaining when creating indexes on empty bucket

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections and 0 documents , /stats API on one of thee indexer nodes returns this :

      "bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
      "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448, 
      "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0, 
      "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0, 
      "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,
      

      which is also causing the UI to display - 104k mutations pending

      This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

      logs : 
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip
       
       

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) created issue -
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Field Original Value New Value
            Description When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections, /stats API on one of thee indexer nodes returns this :
            {noformat}
            "bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,
            {noformat}
            which is also causing the UI to display - 104k mutations pending

            !Screen Shot 2021-05-18 at 11.17.42 AM.png|width=1764,height=228!

            !Screen Shot 2021-05-18 at 11.19.38 AM.png|width=505,height=119!

            This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

            logs : 
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip]
             
             
            When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections and 0 documents , /stats API on one of thee indexer nodes returns this :
            {noformat}"bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,
            {noformat}
            which is also causing the UI to display - 104k mutations pending

            !Screen Shot 2021-05-18 at 11.17.42 AM.png|width=1764,height=228!

            !Screen Shot 2021-05-18 at 11.19.38 AM.png|width=505,height=119!

            This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

            logs : 
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip]
              
              
            varun.velamuri Varun Velamuri made changes -
            Assignee Jeelan Poola [ jeelan.poola ] Varun Velamuri [ varun.velamuri ]
            varun.velamuri Varun Velamuri added a comment - - edited

            Prajwal‌ Kiran Kumar‌, This is an expected behaviour as creation of collections and scopes increment seqnos for every vbucket. The num_docs_pending stat is based on the high seqnos of the bucket. Closing this issue as Not-a-bug

            varun.velamuri Varun Velamuri added a comment - - edited Prajwal‌ Kiran Kumar‌ , This is an expected behaviour as creation of collections and scopes increment seqnos for every vbucket. The num_docs_pending stat is based on the high seqnos of the bucket. Closing this issue as Not-a-bug
            varun.velamuri Varun Velamuri made changes -
            Assignee Varun Velamuri [ varun.velamuri ] Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ]
            varun.velamuri Varun Velamuri made changes -
            Resolution Not a Bug [ 10200 ]
            Status Open [ 1 ] Resolved [ 5 ]

            Varun Velamuri - reopening and assigning it to you based on todays discussion. Moving it to CC.next. Please reassign it to the UI team.

            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) added a comment - Varun Velamuri  - reopening and assigning it to you based on todays discussion. Moving it to CC.next. Please reassign it to the UI team.
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Assignee Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ] Varun Velamuri [ varun.velamuri ]
            Resolution Not a Bug [ 10200 ]
            Status Resolved [ 5 ] Reopened [ 4 ]
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Fix Version/s CheshireCat.Next [ 16908 ]
            Fix Version/s Cheshire-Cat [ 15915 ]
            varun.velamuri Varun Velamuri made changes -
            Fix Version/s 7.0.1 [ 17104 ]
            Fix Version/s CheshireCat.Next [ 16908 ]
            jeelan.poola Jeelan Poola made changes -
            Link This issue blocks MB-46308 [ MB-46308 ]
            jeelan.poola Jeelan Poola made changes -
            Labels performance approved-for-7.0.1 performance
            varun.velamuri Varun Velamuri made changes -
            Comment [ [~jeelan.poola], [~mihir.kamdar], As discussed during GSI scrum, we are keeping this ticket to 7.0.1 as the change is minimum and user visible. Adding "approved-for-7.0.1" label to this. ]
            varun.velamuri Varun Velamuri made changes -
            Link This issue is cloned by MB-47802 [ MB-47802 ]
            varun.velamuri Varun Velamuri made changes -
            Summary :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP to 7.0.1] :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            jeelan.poola Jeelan Poola made changes -
            Summary [BP to 7.0.1] :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.1 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            varun.velamuri Varun Velamuri made changes -
            Resolution Fixed [ 1 ]
            Status Reopened [ 4 ] Resolved [ 5 ]

            Build couchbase-server-7.0.1-5995 contains indexing commit dc06406 with commit message:
            MB-46350 Do not populate numDocsPending for index in created state

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-5995 contains indexing commit dc06406 with commit message: MB-46350 Do not populate numDocsPending for index in created state
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.2 [ 18012 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.1 [ 17104 ]
            wayne Wayne Siu made changes -
            Labels approved-for-7.0.1 performance approved-for-7.0.2 performance
            wayne Wayne Siu made changes -
            Summary [BP 7.0.1 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.2 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            wayne Wayne Siu made changes -
            Link This issue is a backport of MB-47802 [ MB-47802 ]
            wayne Wayne Siu made changes -
            Link This issue is cloned by MB-47802 [ MB-47802 ]
            wayne Wayne Siu made changes -
            Assignee Varun Velamuri [ varun.velamuri ] Vikas Chaudhary [ vikas.chaudhary ]
            varun.velamuri Varun Velamuri made changes -
            Summary [BP 7.0.2 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.2 MB-47802]:UI shows 104k mutations remaining when creating indexes on empty bucket

            Vikas Chaudhary, For deferred indexes in created state, on UI, you should not see "mutations remaining" message.

            varun.velamuri Varun Velamuri added a comment - Vikas Chaudhary , For deferred indexes in created state, on UI, you should not see "mutations remaining" message.
            vikas.chaudhary Vikas Chaudhary made changes -
            vikas.chaudhary Vikas Chaudhary made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              vikas.chaudhary Vikas Chaudhary
              prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty