Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-34914

[high-bucket] More than 100% rebalance complete

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 6.5.0
    • 7.1.0
    • fts
    • Untriaged
    • Unknown

    Attachments

      Issue Links

        duplicates

        Bug - A problem which impairs or prevents the functions of the product. MB-50081 Rebalance progress seems to go above 100%

        • Major - Major loss of function.
        • Closed
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Ascending order - Click to sort in descending order
          mahesh.mandhare Mahesh Mandhare (Inactive) created issue -
          mahesh.mandhare Mahesh Mandhare (Inactive) made changes -
          Field Original Value New Value
          Description Build 6.5.0-3633

          Observed that rebalance complete is shown more than 100% when FTS swap rebalance is performed with 30 buckets(High bucket density test).

          Rebalance ultimately failed- https://issues.couchbase.com/browse/MB-32547?focusedCommentId=340259&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-340259

          On UI we have seen "rebalance 117% complete", attached snapshot.

          !Screen Shot 2019-07-04 at 10.24.48 PM.png|width=1512,height=795!

          Logs-

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.96.20.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.96.23.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.12.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.13.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.14.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.15.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.177.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.19.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.20.zip]           		Build 6.5.0-3633

          Observed that rebalance complete is shown more than 100% when FTS swap rebalance is performed with 30 buckets(High bucket density test).

          Rebalance ultimately failed- https://issues.couchbase.com/browse/MB-32547?focusedCommentId=340259&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-340259

          On UI we have seen "rebalance 117% complete", attached snapshot.

          Logs-

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.96.20.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.96.23.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.12.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.13.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.14.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.15.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.177.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.19.zip]

          [https://s3.amazonaws.com/bugdb/jira/fts_swap_failure/collectinfo-2019-07-05T030032-ns_1%40172.23.97.20.zip]
          mahesh.mandhare Mahesh Mandhare (Inactive) made changes -
          Attachment Screen Shot 2019-07-04 at 10.24.48 PM.png [ 70261 ]
          raju Raju Suravarjjala made changes -
          Fix Version/s Mad-Hatter [ 15037 ]
          Sreekanth Sivasankaran Sreekanth Sivasankaran made changes -
          Assignee Keshav Murthy [ keshav ] Sreekanth Sivasankaran [ sreekanth sivasankaran ]
          keshav Keshav Murthy made changes -
          Fix Version/s Cheshire-Cat [ 15915 ]
          Fix Version/s Mad-Hatter [ 15037 ]
          Sreekanth Sivasankaran Sreekanth Sivasankaran added a comment -

          This needs to get retested in CC and if happens again we need to think about switching to streaming ns-server endpoints for fetching bucket data. (the original problem was happening with a heavily loaded system is that - ns-server bucket endpoint becoming non-responsive.)

          Tagging Jyotsna Nayak/Girish Benakappa/Evgeny Makarenko to plan and run the high data density tests for FTS in CC.

          Sreekanth Sivasankaran Sreekanth Sivasankaran added a comment - This needs to get retested in CC and if happens again we need to think about switching to streaming ns-server endpoints for fetching bucket data. (the original problem was happening with a heavily loaded system is that - ns-server bucket endpoint becoming non-responsive.) Tagging  Jyotsna Nayak / Girish Benakappa / Evgeny Makarenko  to plan and run the high data density tests for FTS in CC.
          Sreekanth Sivasankaran Sreekanth Sivasankaran made changes -
          Assignee Sreekanth Sivasankaran [ sreekanth sivasankaran ] Girish Benakappa [ girish.benakappa ]
          girish.benakappa Girish Benakappa made changes -
          Assignee Girish Benakappa [ girish.benakappa ] Evgeny Makarenko [ evgeny.makarenko ]
          mihir.kamdar Mihir Kamdar (Inactive) added a comment -

          Ritam Sharma do we have plans to run the high data density tests in Cheshire Cat ?

          mihir.kamdar Mihir Kamdar (Inactive) added a comment - Ritam Sharma do we have plans to run the high data density tests in Cheshire Cat ?
          mihir.kamdar Mihir Kamdar (Inactive) made changes -
          Assignee Evgeny Makarenko [ evgeny.makarenko ] Jyotsna Nayak [ jyotsna.nayak ]
          wayne Wayne Siu made changes -
          Summary More than 100% rebalance complete [high-bucket] More than 100% rebalance complete
          keshav Keshav Murthy made changes -
          Fix Version/s CheshireCat.Next [ 16908 ]
          Fix Version/s Cheshire-Cat [ 15915 ]
          keshav Keshav Murthy made changes -
          Fix Version/s CheshireCat.Next [ 16908 ]
          Fix Version/s Neo [ 17615 ]
          keshav Keshav Murthy made changes -
          Assignee Jyotsna Nayak [ jyotsna.nayak ] Sreekanth Sivasankaran [ sreekanth sivasankaran ]
          abhinav Abhinav Dangeti added a comment -

          Closing as duplicate of MB-50081

          abhinav Abhinav Dangeti added a comment - Closing as duplicate of MB-50081
          abhinav Abhinav Dangeti made changes -
          Resolution Duplicate [ 3 ]
          Status Open [ 1 ] Resolved [ 5 ]
          abhinav Abhinav Dangeti made changes -
          Link This issue duplicates MB-50081 [ MB-50081 ]
          girish.benakappa Girish Benakappa added a comment -

          Closing as its dup

          girish.benakappa Girish Benakappa added a comment - Closing as its dup
          girish.benakappa Girish Benakappa made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

          People

            Sreekanth Sivasankaran Sreekanth Sivasankaran
            mahesh.mandhare Mahesh Mandhare (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty