Details
-
Bug
-
Resolution: Won't Fix
-
Major
-
2.0.1
-
Security Level: Public
-
centos 5.7 64bit
Description
Environment:
- 6 centos server 5.7 64bit.
- Each server has 6 core cpu, 6GB RAM, 70GB disk for data, 100GB disk for view, 2GB swap, swappiness=10.
Set up:
- Create 2 clusters A and B. Each cluster has 3 nodes and one loginservice bucket 2 replica (size 1.2GB)
- Install couchbase server 2.0.0-1976 in all nodes. Change +S 16:16 to +A 16 in all nodes.
- Setup bi xdcr between cluster A and B.
- Create a design doc with 3 views in cluster A
- IPs of cluster A:
10.1.4.0
10.1.4.1
10.1.4.2 - IPs of cluster B:
10.1.3.176
10.1.3.254
10.1.3.255
Running:
- Load 6 million items to bucket at each cluster with size 256 bytes and different key ( bucket will end up 12 million items due to bi xdcr between cluster A ad B)
- Query view in cluster A.
- When bucket reaches above 7 million items, resident ratio dropped to near zero and out of mem error appears due to small bucket size (1.2GB)
- Look at the mem stats, I see the numbers of memory used do not add up correctly.
[root@grape-004 ~]# /opt/couchbase/bin/cbstats 10.1.4.0:11210 all -b loginservice | grep 'mem|perc|meta|cache'
ep_bg_meta_fetched: 2947736
ep_diskqueue_memory: 0
ep_mem_high_wat: 943718400
ep_mem_low_wat: 754974720
ep_mem_tracker_enabled: true
ep_mutation_mem_threshold: 0
ep_num_ops_del_meta: 0
ep_num_ops_get_meta: 47563089
ep_num_ops_set_meta: 3583281
ep_total_cache_size: 893521299
ep_warmup_min_memory_threshold: 100
mem_used: 1137503824
vb_active_ht_memory: 16971408
vb_active_itm_memory: 298109955
vb_active_meta_data_memory: 250576821
vb_active_perc_mem_resident: 0
vb_active_queue_memory: 0
vb_pending_ht_memory: 0
vb_pending_itm_memory: 0
vb_pending_meta_data_memory: 0
vb_pending_perc_mem_resident: 0
vb_pending_queue_memory: 0
vb_replica_ht_memory: 33843568
vb_replica_itm_memory: 595411344
vb_replica_meta_data_memory: 504379872
vb_replica_perc_mem_resident: 0
vb_replica_queue_memory: 0
Link to manifest file of this build http://builds.hq.northscale.net/latestbuilds/couchbase-server-community_x86_64_2.0.0-1976-rel.rpm.manifest.xml
Collect info will upload soon.