Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7737

[Doc'd] Swap usage shoots up with view querying or indexing

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.1
    • Fix Version/s: 2.1.0
    • Security Level: Public
    • Labels:
      None
    • Environment:
      Seen on the latest few builds
      Observed on:
      2.0.1-153 Linux
      4 Core 30GB SSD machines

      Description

      • Setup a 7 node cluster,
      • RAM (for each physical machine): ~32GB
      • create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
      • run a load (with just creates), until the item count hits a mark
      • create 2 views over each of the buckets
      • Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
      • Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
      • Noticed the increased swap usage.
      • Start a new mixed load on both the buckets (creates, updates, deletes, expires).
      • Setup XDCR to another 5 node cluster.
      • Continue querying, noticed considerable increase in swap usage.

      This behavior is seen with a cluster with views as well (no XDCR involved).

      1. vperf-lnx.loop_2.0.1-153-rel-enterprise_2.0.1-153-rel-enterprise_VESTA_Feb-11-2013_15-40-09.pdf
        2.54 MB
        Farshid Ghods
      1. Screen Shot 2013-02-13 at 4.46.23 PM.png
        124 kB
      2. Screen Shot 2013-02-18 at 2.38.32 PM.png
        35 kB
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        abhinav Abhinav Dangeti created issue -
        jin Jin Lim made changes -
        Field Original Value New Value
        Assignee Jin Lim [ jin ] Abhinav Dangeti [ abhinav ]
        jin Jin Lim made changes -
        Planned End (re-schedule end date based on new assignee)
        farshid Farshid Ghods (Inactive) made changes -
        Fix Version/s 2.1 [ 10414 ]
        Fix Version/s 2.0.1 [ 10399 ]
        farshid Farshid Ghods (Inactive) made changes -
        Planned Start (set to new fixed version's start date)
        Planned End (set to new fixed version's start date)
        abhinav Abhinav Dangeti made changes -
        Fix Version/s 2.0.1 [ 10399 ]
        Fix Version/s 2.1 [ 10414 ]
        Environment Seen on the latest few builds Seen on the latest few builds
        Observed on:
        2.0.1-153 Linux
        4 Core 30GB SSD machines
        Description - Setup a 7 node cluster,
        - create 2 buckets: default and saslbucket.
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        abhinav Abhinav Dangeti made changes -
        Planned Start (set to new fixed version's start date)
        Planned End (set to new fixed version's start date)
        farshid Farshid Ghods (Inactive) made changes -
        Fix Version/s 2.1 [ 10414 ]
        Fix Version/s 2.0.1 [ 10399 ]
        farshid Farshid Ghods (Inactive) made changes -
        Planned Start (set to new fixed version's start date)
        Planned End (set to new fixed version's start date)
        farshid Farshid Ghods (Inactive) made changes -
        Summary Swap usage shoots up with view querying Swap usage shoots up with view querying or indexing
        abhinav Abhinav Dangeti made changes -
        Description - Setup a 7 node cluster,
        - create 2 buckets: default and saslbucket.
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        - Setup a 7 node cluster,
        - create 2 buckets: default (RAM: 12000MB per node) and saslbucket (RAM: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        abhinav Abhinav Dangeti made changes -
        Description - Setup a 7 node cluster,
        - create 2 buckets: default (RAM: 12000MB per node) and saslbucket (RAM: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        - Setup a 7 node cluster,
        - create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        abhinav Abhinav Dangeti made changes -
        Description - Setup a 7 node cluster,
        - create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        - Setup a 7 node cluster,
        - RAM (for each physical machine): ~32GB
        - create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        jin Jin Lim made changes -
        Priority Major [ 3 ] Critical [ 2 ]
        mikew Mike Wiederhold made changes -
        Sprint Status Current Sprint [ 10027 ]
        abhinav Abhinav Dangeti made changes -
        Attachment 10_6_2_68.zip [ 17570 ]
        wayne Wayne Siu made changes -
        Fix Version/s 2.1.0 [ 10418 ]
        Fix Version/s .major-release [ 10414 ]
        abhinav Abhinav Dangeti made changes -
        Description - Setup a 7 node cluster,
        - RAM (for each physical machine): ~32GB
        - create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.
        - Setup a 7 node cluster,
        - RAM (for each physical machine): ~32GB
        - create 2 buckets: default (bucket quota: 12000MB per node) and saslbucket (bucket quota: 7000MB per node)
        - run a load (with just creates), until the item count hits a mark
        - create 2 views over each of the buckets
        - Run load that pushes system into DGM, ~80% resident ratio for default, and ~60% resident ratio for saslbucket
        - Run queries continuously against the views as the load continues.
        (for e.g.:
        curl -X GET 'http://10.1.3.235:8092/default/_design/d1/_view/v1?startkey=0&stale=ok&limit=1000')
        - Noticed the increased swap usage.
        - Start a new mixed load on both the buckets (creates, updates, deletes, expires).
        - Setup XDCR to another 5 node cluster.
        - Continue querying, noticed considerable increase in swap usage.


        This behavior is seen with a cluster with views as well (no XDCR involved).
        maria Maria McDuff (Inactive) made changes -
        Summary Swap usage shoots up with view querying or indexing [DOC 2.1] Swap usage shoots up with view querying or indexing
        maria Maria McDuff (Inactive) made changes -
        Component/s documentation [ 10012 ]
        abhinav Abhinav Dangeti made changes -
        Assignee Abhinav Dangeti [ abhinav ] Karen Zeller [ kzeller ]
        kzeller kzeller made changes -
        Rank Ranked higher
        kzeller kzeller made changes -
        Summary [DOC 2.1] Swap usage shoots up with view querying or indexing [Doc'd] Swap usage shoots up with view querying or indexing
        kzeller kzeller made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        kzeller kzeller made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            kzeller kzeller
            Reporter:
            abhinav Abhinav Dangeti
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes