Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61818

Internal error while copying data from S3 into standalone collection

    XMLWordPrintable

Details

    Description

      Steps to reproduce -

      1. Create a 2 node cluster with compute storage separation.
      2. Create an external link to S3 bucket.
      3. Create 5 standalone collections.
      4. Now run copy from S3 (one for each supported file format) on all 5 standalone collections. Note - Only 3 Copy from S3 statements are executed at once in test.
      5. Internal error is seen.

      Test logs -

      2024-05-08 22:13:18,680 | test  | INFO    | cbas_worker_1 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3971] Copying into dD5VT using external link Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt from S3 bucket path columnar-functional-sanity-test-data/
      2024-05-08 22:13:18,680 | test  | INFO    | cbas_worker_2 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3971] Copying into MAjw4SmFLpirlAdhwjZ3 using external link Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt from S3 bucket path columnar-functional-sanity-test-data/
      2024-05-08 22:13:18,680 | test  | INFO    | cbas_worker_3 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3971] Copying into Jizy0 using external link Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt from S3 bucket path columnar-functional-sanity-test-data/
      2024-05-08 22:33:06,421 | test  | ERROR   | cbas_worker_3 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3983] {'msg': u'AnalyticsRequest, Reason: NO_MORE_RETRIES (CHANNEL_CLOSED_WHILE_IN_FLIGHT) {"cancelled":true,"completed":true,"coreId":"0xdacd7b3500000003","idempotent":false,"lastDispatchedFrom":"192.168.101.61:57940","lastDispatchedTo":"172.23.106.52:18095","reason":"NO_MORE_RETRIES (CHANNEL_CLOSED_WHILE_IN_FLIGHT)","requestId":4346,"requestType":"AnalyticsRequest","retried":0,"service":{"httpMethod":"POST","operationId":"28d54d3e-7205-4113-986e-3fdb10672f34","priority":0,"statement":"COPY INTO Default.Default.Jizy0 FROM `columnar-functional-sanity-test-data` AT Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt PATH \\"\\" WITH {\\"include\\": [\\"*.json\\"], \\"format\\": \\"json\\"};","type":"analytics","uri":"/analytics/service"},"timeoutMs":7200000,"timings":{"totalMicros":1187750043}}', 'code': ''}
      2024-05-08 22:33:06,427 | test  | INFO    | cbas_worker_3 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3971] Copying into AZqYPUUWwUvfGtjA3FV30e9Ua using external link Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt from S3 bucket path columnar-functional-sanity-test-data/
      2024-05-08 22:33:07,003 | test  | ERROR   | cbas_worker_1 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3983] {'msg': u'Internal error', 'code': 25000}
      2024-05-08 22:33:07,005 | test  | INFO    | cbas_worker_1 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3971] Copying into ezRuLxfYReo2COtkhJcWEcSoLOCiV using external link Default.Default.rGGvvR1qmEP7oIYxOHK9qcQyFmDt from S3 bucket path columnar-functional-sanity-test-data/
      2024-05-08 22:33:08,753 | test  | ERROR   | cbas_worker_3 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3983] {'msg': u'Internal error', 'code': 25000}
      2024-05-08 22:38:03,184 | test  | ERROR   | cbas_worker_2 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3983] {'msg': u'Internal error', 'code': 25000}
      2024-05-08 22:38:18,884 | test  | ERROR   | cbas_worker_1 | [cbas_utils_columnar:copy_from_external_resource_into_standalone_collection:3983] {'msg': u'Internal error', 'code': 25000}
      

      Note - Time stamp in test log will differ from time stamp in analytics log since the VMs are in US data center.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              umang.agrawal Umang
              umang.agrawal Umang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty