Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-54092

s3 shard data cleanup not happening after successful RestoreShard

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • Elixir
    • None
    • storage-engine
    • Untriaged
    • 1
    • Unknown

    Description

      The issue was reported by Varun during integration testing. This is due to an invalid shard URL passed to cleanup.

      Relevant logs:

      2022-10-06T15:39:26.063-07:00 [Info] plasma:cleaning up shard in download path:s3://gsi-shard-rebalance/indexing/plasma_storage/Rebalance/15a87097a2622fcfa3621ba8283eb4b8/TransferToken/TransferTokena7:10:e0:73:e1:f1:8a:4f/3847382561027087624/3847382561027087624
      2022-10-06T15:39:26.064-07:00 [Info] plasma s3: downloading bucket :gsi-shard-rebalance key :indexing/plasma_storage/Rebalance/15a87097a2622fcfa3621ba8283eb4b8/TransferToken/TransferToken1b:ff:6f:1c:b4:c1:19:29/5695707462351474033/shards/shard5695707462351474033/data/recovery/log.00000000000000.data

      2022-10-06T15:39:26.082-07:00 [Info] plasma s3: downloading bucket :gsi-shard-rebalance key :indexing/plasma_storage/Rebalance/15a87097a2622fcfa3621ba8283eb4b8/TransferToken/TransferTokena7:10:e0:73:e1:f1:8a:4f/17232601689790706195/shards/shard17232601689790706195/data/recovery/log.00000000000000.data

      2022-10-06T15:39:26.173-07:00 [Info] : completed shard restore, download path s3://gsi-shard-rebalance/indexing/plasma_storage/Rebalance/15a87097a2622fcfa3621ba8283eb4b8/TransferToken/TransferTokena7:10:e0:73:e1:f1:8a:4f/3847382561027087624/shards/shard3847382561027087624, newshardId 3847382561027087624, newpath /Users/varunvelamuri/couchbase/elixir/ns_server/data/n_3/data/@2i/shards/shard3847382561027087624, shardsize 0, duration 1.781439166s

      Attachments

        For Gerrit Dashboard: MB-54092
        # Subject Branch Project Status CR V

        Activity

          People

            saptarshi.sen Saptarshi Sen
            saptarshi.sen Saptarshi Sen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty