If you’re trying to backup large dataset and hit any performance regressions or high memory consumption with CBBackup tool in 3.0/3.0.1 CE. Follow the following workarounds to mitigate the issue -
- Grab cbbackupwrapper patch from S3:
> wget https://s3.amazonaws.com/support.couchbase.com/CBBackup-Patch/orig.patch
- Apply the patch to file /opt/couchbase/lib/python/cbbackupwrapper:
> patch -p1 < orig.patch
- This patch enables --sequential flag, which basically controls limits
the amount of backfills we do while performing backup.
> /opt/couchbase/bin/cbbackupwrapper http://<cluster-ip>:8091 <backup_dir> -u <username> -p <password> --path /opt/couchbase/bin/ -x —sequential -n <no_vbucket_per_batch>
Note: Important thing to note here is the number you're passing to -n flag, which controls the number of vbuckets to backfill at a time. You should tune it according to memory headroom you have on your couchbase node(by default, batch size is 100).