Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62830

Upgrading from 7.2.5 to 7.2.6 causes temporary partition skew

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.6.4
    • 7.2.5, 7.6.2, 7.6.4
    • fts
    • 7.2.5 build 7599
      7.6.2 build 3721

    Description

      Steps:

      1. Create 3 nodes cluster with D+F: D+F: F configuration
      2. 3 indexes with 18:3:3 partitions
      3. Upgrade 1 node from 7.2 to 7.6 

      Seeing skew in partitions:

       

      Index actives distribution:
      		 
              Index: n2-copy
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.122.68:8094 : 3
      		 
                      172.23.120.23:8094 : 1
      		 
              Index: n2
      		 
                      172.23.107.56:8094 : 7
      		 
                      172.23.122.68:8094 : 7
      		 
                      172.23.120.23:8094 : 6
      		 
              Index: n2-copy-copy
      		 
                      172.23.120.23:8094 : 3
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.122.68:8094 : 1
      		 
      Index replicas distribution:
      		 
              Index: n2-copy
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 2
      		 
              Index: n2
      		 
                      172.23.122.68:8094 : 7
      		 
                      172.23.120.23:8094 : 7
      		 
                      172.23.107.56:8094 : 6
      		 
              Index: n2-copy-copy
      		 
                      172.23.122.68:8094 : 2
      		 
                      172.23.107.56:8094 : 1

       

       

      Upgrade another node –

      Replica skew was removed but active partitions skew remained

      Index actives distribution:
      		 
              Index: n2
      		 
                      172.23.120.23:8094 : 6
      		 
                      172.23.122.68:8094 : 7
      		 
                      172.23.107.56:8094 : 7
      		 
              Index: n2-copy
      		 
                      172.23.122.68:8094 : 1
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 2
      		 
              Index: n2-copy-copy
      		 
                      172.23.120.23:8094 : 1
      		 
                      172.23.107.56:8094 : 2
      		 
                      172.23.122.68:8094 : 1
      		 
      Index replicas distribution:
      		 
              Index: n2-copy-copy
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 1
      		 
                      172.23.122.68:8094 : 1
      		 
              Index: n2
      		 
                      172.23.107.56:8094 : 6
      		 
                      172.23.120.23:8094 : 6
      		 
                      172.23.122.68:8094 : 6
      		 
              Index: n2-copy
      		 
                      172.23.120.23:8094 : 1
      		 
                      172.23.122.68:8094 : 1
      		 
                      172.23.107.56:8094 : 1

      However upon upgrading the last node the skew was removed

       

      Index actives distribution:
      		 
              Index: n2-copy-copy
      		 
                      172.23.120.23:8094 : 1
      		 
                      172.23.122.68:8094 : 1
      		 
                      172.23.107.56:8094 : 1
      		 
              Index: n2-copy
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 1
      		 
                      172.23.122.68:8094 : 1
      		 
              Index: n2
      		 
                      172.23.120.23:8094 : 6
      		 
                      172.23.107.56:8094 : 6
      		 
                      172.23.122.68:8094 : 6
      		 
      Index replicas distribution:
      		 
              Index: n2-copy-copy
      		 
                      172.23.122.68:8094 : 1
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 1
      		 
              Index: n2-copy
      		 
                      172.23.122.68:8094 : 1
      		 
                      172.23.107.56:8094 : 1
      		 
                      172.23.120.23:8094 : 1
      		 
              Index: n2
      		 
                      172.23.107.56:8094 : 6
      		 
                      172.23.122.68:8094 : 6
      		 
                      172.23.120.23:8094 : 6

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sarthak.dua Sarthak Dua
            sarthak.dua Sarthak Dua
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty