Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7499

memory used stats shows in stats all does not match together

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • 2.0.1
    • 2.0.1
    • couchbase-bucket
    • Security Level: Public
    • centos 5.7 64bit

    Description

      Environment:

      • 6 centos server 5.7 64bit.
      • Each server has 6 core cpu, 6GB RAM, 70GB disk for data, 100GB disk for view, 2GB swap, swappiness=10.

      Set up:

      • Create 2 clusters A and B. Each cluster has 3 nodes and one loginservice bucket 2 replica (size 1.2GB)
      • Install couchbase server 2.0.0-1976 in all nodes. Change +S 16:16 to +A 16 in all nodes.
      • Setup bi xdcr between cluster A and B.
      • Create a design doc with 3 views in cluster A
      • IPs of cluster A:
        10.1.4.0
        10.1.4.1
        10.1.4.2
      • IPs of cluster B:
        10.1.3.176
        10.1.3.254
        10.1.3.255

      Running:

      • Load 6 million items to bucket at each cluster with size 256 bytes and different key ( bucket will end up 12 million items due to bi xdcr between cluster A ad B)
      • Query view in cluster A.
      • When bucket reaches above 7 million items, resident ratio dropped to near zero and out of mem error appears due to small bucket size (1.2GB)
      • Look at the mem stats, I see the numbers of memory used do not add up correctly.

      [root@grape-004 ~]# /opt/couchbase/bin/cbstats 10.1.4.0:11210 all -b loginservice | grep 'mem|perc|meta|cache'
      ep_bg_meta_fetched: 2947736
      ep_diskqueue_memory: 0
      ep_mem_high_wat: 943718400
      ep_mem_low_wat: 754974720
      ep_mem_tracker_enabled: true
      ep_mutation_mem_threshold: 0
      ep_num_ops_del_meta: 0
      ep_num_ops_get_meta: 47563089
      ep_num_ops_set_meta: 3583281
      ep_total_cache_size: 893521299
      ep_warmup_min_memory_threshold: 100
      mem_used: 1137503824
      vb_active_ht_memory: 16971408
      vb_active_itm_memory: 298109955
      vb_active_meta_data_memory: 250576821
      vb_active_perc_mem_resident: 0
      vb_active_queue_memory: 0
      vb_pending_ht_memory: 0
      vb_pending_itm_memory: 0
      vb_pending_meta_data_memory: 0
      vb_pending_perc_mem_resident: 0
      vb_pending_queue_memory: 0
      vb_replica_ht_memory: 33843568
      vb_replica_itm_memory: 595411344
      vb_replica_meta_data_memory: 504379872
      vb_replica_perc_mem_resident: 0
      vb_replica_queue_memory: 0

      Link to manifest file of this build http://builds.hq.northscale.net/latestbuilds/couchbase-server-community_x86_64_2.0.0-1976-rel.rpm.manifest.xml
      Collect info will upload soon.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            jin Jin Lim (Inactive)
            thuan Thuan Nguyen
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty