Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-15728

[windows] Build index command failed with "Terminate Request due to server termination" in Windows Recovery add-index job

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Blocker
    • 4.0.0
    • 4.0.0
    • secondary-index
    • Security Level: Public
    • Windows
    • Untriaged
    • Yes

    Description

      Run: http://qa.sc.couchbase.com/job/w012R2-2i-vset03-03-recoverytests-add-index/19/consoleFull

      The build index command in test case test_rebalance_in fails with error as mentioned in below test output:

      [2015-07-16 22:01:19,379] - [base_2i:95] INFO - BUILD INDEX on default(employeec287556fe63b48d89632f36bdac4d3ccjoin_yr,employeec287556fe63b48d89632f36bdac4d3ccjob_title) USING GSI
      [2015-07-16 22:01:20,380] - [tuq_helper:72] INFO - RUN QUERY BUILD INDEX on default(employeec287556fe63b48d89632f36bdac4d3ccjoin_yr,employeec287556fe63b48d89632f36bdac4d3ccjob_title) USING GSI
      [2015-07-16 22:01:20,414] - [rest_client:2237] INFO - query params : statement=BUILD+INDEX+on+default%28employeec287556fe63b48d89632f36bdac4d3ccjoin_yr%2Cemployeec287556fe63b48d89632f36bdac4d3ccjob_title%29+USING+GSI
      [2015-07-16 22:01:50,881] - [task:2189] ERROR - Unexpected Exception Caught
      ERROR
      CBQError: CBQError: host 172.23.105.191: ERROR:{u'status': u'errors', u'errors': [

      {u'msg': u'BuildIndexes - cause: Terminate Request due to server termination', u'code': 5000}

      ], u'results': [], u'metrics':

      {u'elapsedTime': u'30.4609927s', u'executionTime': u'30.4609927s', u'resultSize': 0, u'resultCount': 0, u'errorCount': 1}

      , u'requestID': u'3c0c31ab-874a-4fa9-93fb-d1dd071295bd', u'signature': None}

      I could not find any panic in indexer logs. At 22:02:50, in 145 node, I only see - logs like:

      2015-07-16T22:01:49.792Z-07:00 [Debug] TK StreamEnd INIT_STREAM bucket0 727 180647589432835 117
      2015-07-16T22:01:49.792Z-07:00 [Warn] Timekeeper::handleStreamEnd
      Received StreamEnd for Inactive Bucket bucket0 Stream INIT_STREAM. Ignored.
      2015-07-16T22:01:49.792Z-07:00 [Debug] TK StreamEnd INIT_STREAM bucket0 761 249036166483391 98
      2015-07-16T22:01:49.792Z-07:00 [Warn] Timekeeper::handleStreamEnd
      Received StreamEnd for Inactive Bucket bucket0 Stream INIT_STREAM. Ignored.

      Cluster Config:

      [SERVER_1]
      ip:172.23.105.191
      services=n1ql,kv

      [SERVER_2]
      ip:172.23.105.240
      services=kv

      [SERVER_3]
      ip:172.23.107.144
      services=index

      [SERVER_4]
      ip:172.23.107.145
      services=index

      Logs:

      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/collectinfo-2015-07-17T085846-ns_1%40172.23.105.191.zip
      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/collectinfo-2015-07-17T085846-ns_1%40172.23.105.240.zip
      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/collectinfo-2015-07-17T085846-ns_1%40172.23.105.91.zip
      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/collectinfo-2015-07-17T085846-ns_1%40172.23.107.144.zip
      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/collectinfo-2015-07-17T085846-ns_1%40172.23.107.145.zip

      https://s3-ap-southeast-1.amazonaws.com/indexing-test/addIndex_Windows_19/testoutput

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            prathibha Prathibha Bisarahalli (Inactive)
            prathibha Prathibha Bisarahalli (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty