Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-52765

Analytics external storage runs failed while running query BF11

    XMLWordPrintable

Details

    • 1
    • CX Sprint 286

    Description

      Job: http://perf.jenkins.couchbase.com/job/Cloud-Analytics-Tester/87/

      Build: 7.1.0-2556

      Logs: 

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Analytics-Tester-87/ec2-3-237-83-74.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Analytics-Tester-87/ec2-44-197-119-181.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Analytics-Tester-87/ec2-44-198-159-199.compute-1.amazonaws.com.zip

      https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-Cloud-Analytics-Tester-87/ec2-44-199-218-45.compute-1.amazonaws.com.zip

       

      I can create external datasets.

      2022-06-24T12:54:34 [INFO] Creating external datasets

      2022-06-24T12:54:34 [INFO] statement: CREATE EXTERNAL DATASET `GleambookUsers-1` ON `analytics-bigfun20m-json` AT `external_link` Using 'GleambookUsers-1' WITH { 'format': 'json', 'include': '*.json' };

      2022-06-24T12:54:35 [INFO] statement: CREATE EXTERNAL DATASET `GleambookMessages-1` ON `analytics-bigfun20m-json` AT `external_link` Using 'GleambookMessages-1' WITH { 'format': 'json', 'include': '*.json' };

      2022-06-24T12:54:35 [INFO] statement: CREATE EXTERNAL DATASET `ChirpMessages-1` ON `analytics-bigfun20m-json` AT `external_link` Using 'ChirpMessages-1' WITH { 'format': 'json', 'include': '*.json' };

      However, when I ran the queries, I hit this error.

      WARNING

      "requestID": "d345fe58-bbfd-4fa1-9a92-98243c15ac9f",

      "errors": "code": 24086, "msg": "External source error. org.apache.http.ConnectionClosedException: Premature end of Content-Length delimited message body (expected: 384,044,886; received: 352,304,588)",

      "status": "fatal",

      "metrics":

      "elapsedTime": "16.899668786s",

      "executionTime": "16.896774092s",

      "resultCount": 0,

      "resultSize": 0,

      "processedObjects": 0,

      "errorCount": 1

      The queries failed after 20 attempts.

      2022-06-24T12:58:15 [WARNING] Retrying http://ec2-3-237-83-74.compute-1.amazonaws.com:8095/analytics/service
      2022-06-24T13:16:58 [ERROR] Request failed after 20 attempts
      2022-06-24T13:23:40 [ERROR] Request failed after 20 attempts
      2022-06-24T13:30:23 [ERROR] Request failed after 20 attempts

      The queries are the same queries we run in our weekly tests, BF03, 08, 10, 11, and 14
      https://github.com/couchbase/perfrunner/blob/master/perfrunner/workloads/bigfun/query_gen.py

      From the bigfun log, it looks like BF03, BF08 and BF10 worked, but the run failed while running BF11.
      http://perf.jenkins.couchbase.com/job/Cloud-Analytics-Tester/87/artifact/bigfun.log

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            bo-chun.wang Bo-Chun Wang
            bo-chun.wang Bo-Chun Wang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty