Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-40515

Flex Index: Rebalance out/upgrade/rebalance in - n1fty: initClient failed when query run during rebalance in

    XMLWordPrintable

    Details

    • Story Points:
      1

      Description

      Build: 6.5.1-6296 --> 6.6.0 build 7883

      Steps for upgrade:

      1. Have 3 node cluster with 6.5.1-6296 with kv, n1ql,index and fts on all the nodes
      2. Rebalance out one of the node
      3. updgrade the rebalanced out node to 6.6.0-7883
      4. Rebalance in the upgraded node with same services
      5. Repeat the same for all the nodes

      In 4th step, run Flex query like below:

      SELECT META().id, address.applicationId FROM `default` USE INDEX (USING FTS, USING GSI) WHERE address.applicationId = 1 AND address.deviceTypeId=9 AND address.deviceStatus=0 ORDER BY address.applicationId

      we get error like below:

      [
        {
          "code": 5000,
          "msg": "n1fty: initClient failed - cause: client: cbauth err: Unable to find given hostport in cbauth database: `172.23.121.65:9130'",
          "query": "SELECT META().id FROM `default`  USE INDEX (USING FTS, USING GSI) WHERE address.ecpdId=\"1\" ORDER BY META().id"
        }
      ]
      
      

      Logs:

      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rebalance-upgrade/collectinfo-2020-07-17T000940-ns_1%40172.23.121.65.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rebalance-upgrade/collectinfo-2020-07-17T000940-ns_1%40172.23.121.66.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rebalance-upgrade/collectinfo-2020-07-17T000940-ns_1%40172.23.121.67.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rebalance-upgrade/collectinfo-2020-07-17T000940-ns_1%40172.23.121.68.zip

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            Hide
            abhinav Abhinav Dangeti added a comment -

            Till Westmann Wayne Siu Will need approval of this for 6.6.1, since we pushed it out of 6.6.0.

            Show
            abhinav Abhinav Dangeti added a comment - Till Westmann Wayne Siu  Will need approval of this for 6.6.1, since we pushed it out of 6.6.0.
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.0-2973 contains n1fty commit 8cad70e with commit message:
            MB-40515: Initialize indexer client only when successful

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-2973 contains n1fty commit 8cad70e with commit message: MB-40515 : Initialize indexer client only when successful
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.1-9031 contains n1fty commit 8cad70e with commit message:
            MB-40515: Initialize indexer client only when successful

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.1-9031 contains n1fty commit 8cad70e with commit message: MB-40515 : Initialize indexer client only when successful
            Hide
            wayne Wayne Siu added a comment -

            Build couchbase-server-6.5.1-6305 contains n1fty commit 3f37fa3 with commit message:
            MB-41603: [BP] Initialize indexer client only when successful

            Show
            wayne Wayne Siu added a comment - Build couchbase-server-6.5.1-6305 contains n1fty commit 3f37fa3 with commit message: MB-41603: [BP] Initialize indexer client only when successful
            Hide
            girish.benakappa Girish Benakappa added a comment -

            Verified in 6.5.1-6306, 6.6.1 build 9081, 7.0.0 build 3208 based on testcases: https://docs.google.com/spreadsheets/d/1xXThDbJXwC8ibUTqlzTsRcUrl8DOrmYKUKCs7Vast_Q/edit#gid=0

            Show
            girish.benakappa Girish Benakappa added a comment - Verified in 6.5.1-6306, 6.6.1 build 9081, 7.0.0 build 3208 based on testcases: https://docs.google.com/spreadsheets/d/1xXThDbJXwC8ibUTqlzTsRcUrl8DOrmYKUKCs7Vast_Q/edit#gid=0

              People

              Assignee:
              abhinav Abhinav Dangeti
              Reporter:
              girish.benakappa Girish Benakappa
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes

                    PagerDuty