Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7907

Issues when scaling XDCR on single node

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • techdebt-backlog
    • 2.0.1, 3.0
    • couchbase-bucket
    • Security Level: Public
    • Build 2.0.1-170 (GA)
      CentOS 5.8
      RAM: 128GB
      CPU: 2 sockets (12 cores per sockets)
      Disk: SATA
      Network: 1 Gbit/sec, ping <1ms
    • Untriaged
    • Yes
    • PCI Team - Sprint 3

    Description

      Perry asked me recently about peak XDCR throughput for single node setup.

      It made me curious enough to run following test using our the most fast servers:
      1. Take single server with single default bucket
      2. Load 5M items, wait for persistence
      3. Enable XDC replication stream to another single server (so that 1-to-1 setup within the same LAN)
      4. Wait for initial replication and monitor overall cluster performance.

      As results I observer average throughput about 15K ops/sec. Not bad, absolutely.

      However, both cluster don't look saturated at all (I mean h/w resources). Obviously I will try tuning options or reduced number of vbuckets. But basically where do we expect bottleneck in such setups?

      Attachments

        1. wip-get-meta-prefetch-package.tar
          10.18 MB
          Aleksey Kondratenko
        2. xdcr_single_node.png
          484 kB
          Pavel Paulau
        3. xdcr_variable_topology.jpeg
          70 kB
          Pavel Paulau
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavelpaulau Pavel Paulau (Inactive)
            pavelpaulau Pavel Paulau (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty