Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-33706

[System Test] : Create partitioned index hung

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 5.5.4
    • 5.5.4
    • secondary-index
    • centos-1

    Description

      Build : 5.5.4-4333
      Test : -test tests/integration/test_allFeatures_vulcan.yml -scope tests/integration/scope_Xattrs_Vulcan.yml
      Scale : 3
      Iteration : 1st

      Seen this issue consistently in 2 runs of the same test. When the test is creating a partitioned index, index creation gets stuck.

      Seeing a lot of errors like the following on the indexer nodes.

      [root@localhost logs]# zgrep -i "internal error" indexer.log
      2019-04-08T00:37:27.818-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:37:31.819-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:37:50.591-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:37:57.821-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:38:06.876-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:38:39.833-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:39:09.805-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:39:36.719-07:00 [Warn] CommandListener: Failed to process create index token.  Skip /indexing/ddl/commandToken/create/8163095964088455102/0.  Internal Error = unexpected end of JSON input.
      2019-04-08T00:39:39.139-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:39:39.145-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result_ratings_claims_pindex, 8163095964088455102, 9775113570235268922).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:42:50.860-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:42:50.866-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result_ratings_claims_pindex, 8163095964088455102, 9775113570235268922).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:47:51.867-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:47:51.869-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result_ratings_claims_pindex, 8163095964088455102, 9775113570235268922).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      2019-04-08T00:52:51.394-07:00 [Warn] DDLServiceMgr: Failed to process create index (default, default_result, 16017746519222128717, 11481986112563137080).  Error = Fail to create index.  Internal Error: Cannot locate indexer nodes.
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            mihir.kamdar Mihir Kamdar (Inactive)
            mihir.kamdar Mihir Kamdar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty