CBBackup high memory usage regression in 3.0.1
Description
Components
Labels
Environment
Link to Log File, atop/blg, CBCollectInfo, Core dump
Release Notes Description
Activity
Anil Kumar June 16, 2015 at 11:01 PM
Duplicate issue - https://couchbasecloud.atlassian.net/browse/MB-14833#icft=MB-14833
Cihan Biyikoglu June 16, 2015 at 10:55 PM
Hi team, is this also happening on 3.0.2 and 3.0.3?
can we mark this for 3.1 if we plan on pushing the fix there in "fixversion"?
thanks
-cihan
Anil Kumar June 16, 2015 at 10:24 PMEdited
If you’re trying to backup large dataset and hit any performance regressions or high memory consumption with CBBackup tool in 3.0/3.0.1 CE. Follow the following workarounds to mitigate the issue -
Steps:
Grab cbbackupwrapper patch from S3:
> wget https://s3.amazonaws.com/support.couchbase.com/CBBackup-Patch/orig.patch
Apply the patch to file /opt/couchbase/lib/python/cbbackupwrapper:
> patch -p1 < orig.patch
This patch enables --sequential flag, which basically controls limits
the amount of backfills we do while performing backup.
Sample command:
> /opt/couchbase/bin/cbbackupwrapper http://<cluster-ip>:8091 <backup_dir> -u <username> -p <password> --path /opt/couchbase/bin/ -x —sequential -n <no_vbucket_per_batch>
Note: Important thing to note here is the number you're passing to -n flag, which controls the number of vbuckets to backfill at a time. You should tune it according to memory headroom you have on your couchbase node(by default, batch size is 100).
Details
Details
Assignee
Reporter
Is this a Regression?
Triage
Priority
Instabug
PagerDuty
PagerDuty Incident
PagerDuty

Sentry
Linked Issues
Sentry
Zendesk Support
Linked Tickets
Zendesk Support

Performance regression and high memory consumption with CBBackup tool in 3.0/3.0.1 CE and EE