Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-18604

The indexer cannot be reached once the FDB indexes are built (initial build) for few minutes.

    XMLWordPrintable

Details

    Description

      The indexer is not reachable immediately after the indexes are completed (Or about to be completed i.e at 99% of index build) for few minutes. The page on the indexes in UI shows the following "Warning: Cannot communicate with indexer process.Information on indexes may be stale. Will retry."
      Also polling the indexBuildStatus api give the following error: curl -u Administrator:password 172.23.100.16:9102/getIndexStatus

      {"code":"error","error":"Fail to retrieve cluster-wide metadata from index service","failedNodes":["172.23.100.16:9102"]}

      Running the above command after some time (few minutes, typically 2 to 5 min) returns the correct result :
      curl -u Administrator:password 172.23.100.16:9102/getIndexStatus
      {"code":"success","status":[{"defnId":7873119372717895120,"name":"myindex1","bucket":"bucket-1","secExprs":["`alt_email`"],"status":"Ready","definition":"CREATE INDEX `myindex1` ON `bucket-1`(`alt_email`) WITH(

      {\"index_type\" : \"forestdb\"}

      ) WITH

      { \"defer_build\"=true }","hosts":["172.23.100.16:8091"],"completion":100},{"defnId":5525899616463294957,"name":"myindex2","bucket":"bucket-1","secExprs":["`city`"],"status":"Ready","definition":"CREATE INDEX `myindex2` ON `bucket-1`(`city`) WITH({\"index_type\" : \"forestdb\"}) WITH { "defer_build"=true }

      ","hosts":["172.23.100.16:8091"],"completion":100},{"defnId":16059061238490889572,"name":"myindex3","bucket":"bucket-1","secExprs":["`name`"],"status":"Ready","definition":"CREATE INDEX `myindex3` ON `bucket-1`(`name`) WITH(

      {\"index_type\" : \"forestdb\"}

      ) WITH

      { \"defer_build\"=true }","hosts":["172.23.100.16:8091"],"completion":100},{"defnId":194807889243482456,"name":"myindex4","bucket":"bucket-1","secExprs":["`coins`"],"status":"Ready","definition":"CREATE INDEX `myindex4` ON `bucket-1`(`coins`) WITH({\"index_type\" : \"forestdb\"}) WITH { "defer_build"=true }

      ","hosts":["172.23.100.16:8091"],"completion":100},{"defnId":210715086488636230,"name":"myindex5","bucket":"bucket-1","secExprs":["`achievements`"],"status":"Ready","definition":"CREATE INDEX `myindex5` ON `bucket-1`(`achievements`) WITH(

      {\"index_type\" : \"forestdb\"}

      ) WITH

      { \"defer_build\"=true }

      ","hosts":["172.23.100.16:8091"],"completion":100}]}

      This is affecting all the FDB performance tests, since we poll the indexer to check if the indexes are completed. Near the end of the completion, the indexer is not reachable and the tests fail.

      Repro steps:
      Load large number of documents (20M) and build index on the document. Wait for the index to complete.
      At the end of the build (99%) try to get the index build status or click on the index page in UI.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              bharath.gp Bharath G P
              bharath.gp Bharath G P
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty