Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-46350

[BP 7.0.2 MB-47802]:UI shows 104k mutations remaining when creating indexes on empty bucket

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections and 0 documents , /stats API on one of thee indexer nodes returns this :

      "bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
      		 
      "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448, 
      "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0, 
      "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0, 
      "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,

      which is also causing the UI to display - 104k mutations pending

      This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

      logs : 
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip
       
       

      Attachments

        Issue Links

          is a backport of

          Bug - A problem which impairs or prevents the functions of the product. MB-47802 UI shows 104k mutations remaining when creating indexes on empty bucket

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Ascending order - Click to sort in descending order
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) created issue -
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Field Original Value New Value
            Description When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections, /stats API on one of thee indexer nodes returns this :
            {noformat}
            "bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,
            {noformat}
            which is also causing the UI to display - 104k mutations pending

            !Screen Shot 2021-05-18 at 11.17.42 AM.png|width=1764,height=228!

            !Screen Shot 2021-05-18 at 11.19.38 AM.png|width=505,height=119!

            This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

            logs : 
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip]
            [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip]
             
                          		When we CREATE indexes with defer build true, on a bucket with 1 scope and 100 collections and 0 documents , /stats API on one of thee indexer nodes returns this :
            {noformat}"bucket-1:scope-1:collection-14:index14-2:num_docs_indexed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_pending": 104448,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_processed": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_docs_queued": 0,
            "bucket-1:scope-1:collection-14:index14-2:num_flush_queued": 0,
            {noformat}
            which is also causing the UI to display - 104k mutations pending

            !Screen Shot 2021-05-18 at 11.17.42 AM.png|width=1764,height=228!

            !Screen Shot 2021-05-18 at 11.19.38 AM.png|width=505,height=119!

            This should ideally be 0 mutations pending (as we never loaded the bucket with any documents since the beginning of the test) 

            logs : 
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s705.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s708.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s709.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s710.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s712.perf.couchbase.com.zip]
             [https://cb-jira.s3.us-east-2.amazonaws.com/logs/CLI/perf-create-ddl/collectinfo-2021-05-18T054915-ns_1%40cen-s723.perf.couchbase.com.zip]
              
              
            varun.velamuri Varun Velamuri made changes -
            Assignee Jeelan Poola [ jeelan.poola ] Varun Velamuri [ varun.velamuri ]
            varun.velamuri Varun Velamuri added a comment - - edited

            Prajwal‌ Kiran Kumar‌, This is an expected behaviour as creation of collections and scopes increment seqnos for every vbucket. The num_docs_pending stat is based on the high seqnos of the bucket. Closing this issue as Not-a-bug

            varun.velamuri Varun Velamuri added a comment - - edited Prajwal‌ Kiran Kumar‌ , This is an expected behaviour as creation of collections and scopes increment seqnos for every vbucket. The num_docs_pending stat is based on the high seqnos of the bucket. Closing this issue as Not-a-bug
            varun.velamuri Varun Velamuri made changes -
            Assignee Varun Velamuri [ varun.velamuri ] Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ]
            varun.velamuri Varun Velamuri made changes -
            Resolution Not a Bug [ 10200 ]
            Status Open [ 1 ] Resolved [ 5 ]
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) added a comment -

            Varun Velamuri - reopening and assigning it to you based on todays discussion. Moving it to CC.next. Please reassign it to the UI team.

            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) added a comment - Varun Velamuri  - reopening and assigning it to you based on todays discussion. Moving it to CC.next. Please reassign it to the UI team.
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Assignee Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ] Varun Velamuri [ varun.velamuri ]
            Resolution Not a Bug [ 10200 ]
            Status Resolved [ 5 ] Reopened [ 4 ]
            prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive) made changes -
            Fix Version/s CheshireCat.Next [ 16908 ]
            Fix Version/s Cheshire-Cat [ 15915 ]
            varun.velamuri Varun Velamuri made changes -
            Fix Version/s 7.0.1 [ 17104 ]
            Fix Version/s CheshireCat.Next [ 16908 ]
            jeelan.poola Jeelan Poola made changes -
            Link This issue blocks MB-46308 [ MB-46308 ]
            jeelan.poola Jeelan Poola made changes -
            Labels performance approved-for-7.0.1 performance
            varun.velamuri Varun Velamuri made changes -
            Comment [ [~jeelan.poola], [~mihir.kamdar], As discussed during GSI scrum, we are keeping this ticket to 7.0.1 as the change is minimum and user visible. Adding "approved-for-7.0.1" label to this. ]
            varun.velamuri Varun Velamuri made changes -
            Link This issue is cloned by MB-47802 [ MB-47802 ]
            varun.velamuri Varun Velamuri made changes -
            Summary :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP to 7.0.1] :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            jeelan.poola Jeelan Poola made changes -
            Summary [BP to 7.0.1] :9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.1 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            varun.velamuri Varun Velamuri made changes -
            Resolution Fixed [ 1 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.1-5995 contains indexing commit dc06406 with commit message:
            MB-46350 Do not populate numDocsPending for index in created state

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.1-5995 contains indexing commit dc06406 with commit message: MB-46350 Do not populate numDocsPending for index in created state
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.2 [ 18012 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.1 [ 17104 ]
            wayne Wayne Siu made changes -
            Labels approved-for-7.0.1 performance approved-for-7.0.2 performance
            wayne Wayne Siu made changes -
            Summary [BP 7.0.1 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.2 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket
            wayne Wayne Siu made changes -
            Link This issue is a backport of MB-47802 [ MB-47802 ]
            wayne Wayne Siu made changes -
            Link This issue is cloned by MB-47802 [ MB-47802 ]
            wayne Wayne Siu made changes -
            Assignee Varun Velamuri [ varun.velamuri ] Vikas Chaudhary [ vikas.chaudhary ]
            varun.velamuri Varun Velamuri made changes -
            Summary [BP 7.0.2 MB-47802]:9102/stats api shows num_docs_pending : 104448 when creating indexes on empty bucket [BP 7.0.2 MB-47802]:UI shows 104k mutations remaining when creating indexes on empty bucket
            varun.velamuri Varun Velamuri added a comment -

            Vikas Chaudhary, For deferred indexes in created state, on UI, you should not see "mutations remaining" message.

            varun.velamuri Varun Velamuri added a comment - Vikas Chaudhary , For deferred indexes in created state, on UI, you should not see "mutations remaining" message.
            vikas.chaudhary Vikas Chaudhary made changes -
            Attachment Screenshot 2021-09-15 at 8.40.32 PM.png [ 159676 ]
            vikas.chaudhary Vikas Chaudhary made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              vikas.chaudhary Vikas Chaudhary
              prajwal.kirankumar Prajwal‌ Kiran Kumar‌ (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty