CBBackup high memory usage regression in 3.0.1

Description

Performance regression and high memory consumption with CBBackup tool in 3.0/3.0.1 CE and EE

Components

Affects versions

Fix versions

Labels

Environment

None

Link to Log File, atop/blg, CBCollectInfo, Core dump

None

Release Notes Description

None

Activity

Show:

Anil Kumar June 16, 2015 at 11:01 PM

Cihan Biyikoglu June 16, 2015 at 10:55 PM

Hi team, is this also happening on 3.0.2 and 3.0.3?
can we mark this for 3.1 if we plan on pushing the fix there in "fixversion"?
thanks
-cihan

Anil Kumar June 16, 2015 at 10:24 PM
Edited

If you’re trying to backup large dataset and hit any performance regressions or high memory consumption with CBBackup tool in 3.0/3.0.1 CE. Follow the following workarounds to mitigate the issue -

Steps:

  • Grab cbbackupwrapper patch from S3:

> wget https://s3.amazonaws.com/support.couchbase.com/CBBackup-Patch/orig.patch

  • Apply the patch to file /opt/couchbase/lib/python/cbbackupwrapper:

> patch -p1 < orig.patch

  • This patch enables --sequential flag, which basically controls limits
    the amount of backfills we do while performing backup.

Sample command:

> /opt/couchbase/bin/cbbackupwrapper http://<cluster-ip>:8091 <backup_dir> -u <username> -p <password> --path /opt/couchbase/bin/ -x —sequential -n <no_vbucket_per_batch>

Note: Important thing to note here is the number you're passing to -n flag, which controls the number of vbuckets to backfill at a time. You should tune it according to memory headroom you have on your couchbase node(by default, batch size is 100).

Duplicate
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Is this a Regression?

Unknown

Triage

Untriaged

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created June 16, 2015 at 10:02 PM
Updated June 29, 2015 at 6:55 PM
Resolved June 16, 2015 at 11:01 PM
Instabug