Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59737

Restore operation failed - error executing 'POST' request to '/api/v1/bucket/test_bucket/backup' socket closed in flight

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      The automated job has failed with a restore error for 2 different tests-

      Test 1

      2023-11-20 13:03:38,518] - [backup_restore_utils:177] ERROR - ['', "Restoring backup '2023-11-20T08_47_12.556355892-08_00'", "Automatically creating scopes/collections for bucket 'test_bucket'  0 items / 0B", '[=======                                                                ] 10.00%', '', "\x1b[3ARestoring backup '2023-11-20T08_47_12.556355892-08_00'", "Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B", '[==============                                                         ] 20.00%', '', "\x1b[3ARestoring backup '2023-11-20T08_47_12.556355892-08_00'", "Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B", '[=============X.........................................................] 20.00%', "Error restoring cluster: error executing 'POST' request to '/api/v1/bucket/test_bucket/backup' socket closed in flight, check the logs for more details", '', '| Transfer', '| --------', '| Status | Avg Transfer Rate | Started At                      | Finished At                     | Duration |', '| Failed | 0B/s              | Mon, 20 Nov 2023 13:03:37 -0800 | Mon, 20 Nov 2023 13:03:38 -0800 | 959ms    |']

      Test 2

      2023-11-20 13:03:38,511] - [remote_util:3393] INFO - command executed successfully with root
      		 
      [2023-11-20 13:03:38,513] - [remote_util:3179] INFO - 
      [2023-11-20 13:03:38,514] - [remote_util:3179] INFO - Restoring backup '2023-11-20T08_47_12.556355892-08_00'
      		 
      [2023-11-20 13:03:38,515] - [remote_util:3179] INFO - Automatically creating scopes/collections for bucket 'test_bucket'  0 items / 0B
      		 
      [2023-11-20 13:03:38,516] - [remote_util:3179] INFO - [=======                                                                ] 10.00%
      		 
      [2023-11-20 13:03:38,516] - [remote_util:3179] INFO - 
      [2023-11-20 13:03:38,516] - [remote_util:3179] INFO - Restoring backup '2023-11-20T08_47_12.556355892-08_00'
      		 
      [2023-11-20 13:03:38,516] - [remote_util:3179] INFO - Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B
      		 
      [2023-11-20 13:03:38,516] - [remote_util:3179] INFO - [==============                                                         ] 20.00%
      		 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - Restoring backup '2023-11-20T08_47_12.556355892-08_00'
      		 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B
      		 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - [=============X.........................................................] 20.00%
      		 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - Error restoring cluster: error executing 'POST' request to '/api/v1/bucket/test_bucket/backup' socket closed in flight, check the logs for more details
      		 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - 
      [2023-11-20 13:03:38,517] - [remote_util:3179] INFO - | Transfer
      		 
      [2023-11-20 13:03:38,518] - [remote_util:3179] INFO - | --------
      		 
      [2023-11-20 13:03:38,518] - [remote_util:3179] INFO - | Status | Avg Transfer Rate | Started At                      | Finished At                     | Duration |
      		 
      [2023-11-20 13:03:38,518] - [remote_util:3179] INFO - | Failed | 0B/s              | Mon, 20 Nov 2023 13:03:37 -0800 | Mon, 20 Nov 2023 13:03:38 -0800 | 959ms    |
      		 
      [2023-11-20 13:03:38,518] - [backup_restore_utils:177] ERROR - ['', "Restoring backup '2023-11-20T08_47_12.556355892-08_00'", "Automatically creating scopes/collections for bucket 'test_bucket'  0 items / 0B", '[=======                                                                ] 10.00%', '', "\x1b[3ARestoring backup '2023-11-20T08_47_12.556355892-08_00'", "Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B", '[==============                                                         ] 20.00%', '', "\x1b[3ARestoring backup '2023-11-20T08_47_12.556355892-08_00'", "Transferring GSI index definitions for bucket 'test_bucket'         0 items / 0B", '[=============X.........................................................] 20.00%', "Error restoring cluster: error executing 'POST' request to '/api/v1/bucket/test_bucket/backup' socket closed in flight, check the logs for more details", '', '| Transfer', '| --------', '| Status | Avg Transfer Rate | Started At                      | Finished At                     | Duration |', '| Failed | 0B/s              | Mon, 20 Nov 2023 13:03:37 -0800 |

      Unfortunately, the cbbackupmgr logs are not taken by the automated tests. I'm working on adding this, but hoping the cbcollect logs are enough.

      s3://cb-customers-secure/backuprestorefailurefilebasedrebal/2023-11-21/backuprestore.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            dhananjay.kshirsagar Dhananjay Kshirsagar
            pavan.pb Pavan PB
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty