Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49385

rebalance_failed,fts,nodes: sample res.StatusCode not 200, 503 Service Unavailable

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.1.0
    • 7.1.0
    • fts
    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.1.0-1624

      • 2 node cluster - Kv+search, search
      • Generate root CA and load node certs with encryption for each node.
      • Create 6 buckets and load 3000 docs in each bucket
      • Create 1 index for each bucket.
      • Validate if fts index is built successfully for each index.
      • Cleanup certs in inbox dir in each node
      • Delete all the indexes
      • Delete all the buckets
      • Rebalance out search node. Rebalance fails with below error:

        2021-11-04T17:19:17.100-07:00, ns_orchestrator:0:critical:message(ns_1@172.23.104.117) - Rebalance exited with reason {service_rebalance_failed,fts,
                                      {worker_died,
                                       {'EXIT',<0.16294.1>,
                                        {rebalance_failed,
                                         {service_error,
                                          <<"nodes: sample res.StatusCode not 200, res: &http.Response{Status:\"503 Service Unavailable\", StatusCode:503, Proto:\"HTTP/1.1\", ProtoMajor:1, ProtoMinor:1, Header:http.Header{\"Content-Length\":[]string{\"22\"}, \"Content-Type\":[]string{\"text/plain; charset=utf-8\"}, \"Date\":[]string{\"Fri, 05 Nov 2021 00:19:17 GMT\"}}, Body:(*http.bodyEOFSignal)(0xc000718cc0), ContentLength:22, TransferEncoding:[]string(nil), Close:false, Uncompressed:false, Trailer:http.Header(nil), Request:(*http.Request)(0xc002167b00), TLS:(*tls.ConnectionState)(0xc000548630)}, urlUUID: monitor.UrlUUID{Url:\"https://172.23.98.165:18094\", UUID:\"cd7a36226d03d0785f93a1b17a282ede\"}, kind: /api/stats?partitions=true, err: <nil>">>}}}}}.
        Rebalance Operation Id = 032158644dd8d870ae3e4ac3000ce4d6
        

      Logs:
      test_3.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            abhinav Abhi Dangeti
            girish.benakappa Girish Benakappa
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty