Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-15345

CBBackup high memory usage regression in 3.0.1

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.0, 3.0.1
    • Fix Version/s: 3.1.0, 4.0.0
    • Component/s: tools
    • Security Level: Public
    • Labels:
      None
    • Triage:
      Untriaged
    • Is this a Regression?:
      Unknown

      Description

      Performance regression and high memory consumption with CBBackup tool in 3.0/3.0.1 CE and EE

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          anil Anil Kumar added a comment - - edited

          If you’re trying to backup large dataset and hit any performance regressions or high memory consumption with CBBackup tool in 3.0/3.0.1 CE. Follow the following workarounds to mitigate the issue -

          Steps:

          • Grab cbbackupwrapper patch from S3:

          > wget https://s3.amazonaws.com/support.couchbase.com/CBBackup-Patch/orig.patch

          • Apply the patch to file /opt/couchbase/lib/python/cbbackupwrapper:

          > patch -p1 < orig.patch

          • This patch enables --sequential flag, which basically controls limits
            the amount of backfills we do while performing backup.

          Sample command:

          > /opt/couchbase/bin/cbbackupwrapper http://<cluster-ip>:8091 <backup_dir> -u <username> -p <password> --path /opt/couchbase/bin/ -x —sequential -n <no_vbucket_per_batch>

          Note: Important thing to note here is the number you're passing to -n flag, which controls the number of vbuckets to backfill at a time. You should tune it according to memory headroom you have on your couchbase node(by default, batch size is 100).

          Show
          anil Anil Kumar added a comment - - edited If you’re trying to backup large dataset and hit any performance regressions or high memory consumption with CBBackup tool in 3.0/3.0.1 CE. Follow the following workarounds to mitigate the issue - Steps: Grab cbbackupwrapper patch from S3: > wget https://s3.amazonaws.com/support.couchbase.com/CBBackup-Patch/orig.patch Apply the patch to file /opt/couchbase/lib/python/cbbackupwrapper: > patch -p1 < orig.patch This patch enables --sequential flag, which basically controls limits the amount of backfills we do while performing backup. Sample command: > /opt/couchbase/bin/cbbackupwrapper http://<cluster-ip>:8091 <backup_dir> -u <username> -p <password> --path /opt/couchbase/bin/ -x —sequential -n <no_vbucket_per_batch> Note: Important thing to note here is the number you're passing to -n flag, which controls the number of vbuckets to backfill at a time. You should tune it according to memory headroom you have on your couchbase node(by default, batch size is 100).
          Hide
          cihan Cihan Biyikoglu (Inactive) added a comment -

          Hi team, is this also happening on 3.0.2 and 3.0.3?
          can we mark this for 3.1 if we plan on pushing the fix there in "fixversion"?
          thanks
          -cihan

          Show
          cihan Cihan Biyikoglu (Inactive) added a comment - Hi team, is this also happening on 3.0.2 and 3.0.3? can we mark this for 3.1 if we plan on pushing the fix there in "fixversion"? thanks -cihan
          Hide
          anil Anil Kumar added a comment -

          Duplicate issue - MB-14833

          Show
          anil Anil Kumar added a comment - Duplicate issue - MB-14833

            People

            • Assignee:
              bcui Bin Cui (Inactive)
              Reporter:
              anil Anil Kumar
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes