===Checker results for '172.23.105.61'=== [info] Collection Time : 2017-05-30 18:35:36 [info] OS Name : Linux 3.19.0-25-generic [info] OS Version : Ubuntu 14.04.3 LTS [BAD] CB Version : 5.0.0-2958-enterprise - Unsupported build [info] CB Packages : ii couchbase-server 5.0.0-2958-1 amd64 Couchbase Server [info] CB Uptime : 16 hours, 54 minutes, 57 seconds [info] System Uptime : 85 days [ok] Installed CPUs : 12 [ok] Installed RAM : 30159 MB [ok] Used RAM : 52.5% (15847 / 30158 MB) [info] Data Quota : Data Quota (12063 MB) 40.00% of Total RAM (30159 MB) [info] FTS Quota : FTS Quota (512 MB) 1.70% of Total RAM (30159 MB) [ok] Total Server Quota : Total Quota (12575 MB) 41.70% of Total RAM (30159 MB) (17584.0 MB) remaining for the OS [ok] Erlang VM vsize : 3,962 MB [ok] Memcached vsize : 10,551 MB [warn] Memcached Fragmentation: ??? (Attribute not found). Cannot check. [ok] vm.swappiness : 0 (Recommended value) [warn] Swap Configured : 0 - Recommend swap is configured [warn] Interface 'eth0' (172.23.105.61) failures: RX:17 / TX:0 - Details: - RX packets:46,920,624,726 errors:0 dropped:17 overruns:0 frame:0 [warn] Interface 'eth1' (192.168.150.18) failures: RX:4286722 / TX:0 - Details: - RX packets:9,890,257 errors:0 dropped:4,286,722 overruns:0 frame:0 [ok] Transparent Huge Pages: never [BAD] Linux OOM Killer : evidence of Linux OOM Killer in syslogs or dmesg in couchbase.log [warn] Slow operations : 22799 - Last slow operation was at 2017-05-30T11:26:57.659487-07:00 [info] Data Directory : (non-default) /data - ext4 - (/dev/vda 197GB / 40% used) [info] Index Directory : (non-default) /data - ext4 - (/dev/vda 197GB / 40% used) [warn] CB Storage Check : Data and Index on the same disk/s [warn] View Indexing 'default': Design Doc 'scale' took 604.576 sec to update (average 1.787 sec) [warn] View Indexing 'ORDER_LINE': Design Doc 'all' took 270.946 sec to update (average 58.194 sec) [warn] MDS Services : fts, kv - Only run 1 service per node in production - FTS is not supported [warn] NS Stats Ticks : 4706 instances found, showing the last 3 : 2017-05-30T11:30:48.603-07:00 (Collector: index_stats_collector) Dropped 10 ticks : 2017-05-30T11:30:37.600-07:00 (Collector: index_stats_collector) Dropped 10 ticks : 2017-05-30T11:30:17.648-07:00 (Collector: index_stats_collector) Dropped 10 ticks [BAD] Rebalance data loss : Bucket `CUSTOMER` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:15.545-07 : Bucket `DISTRICT` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:16.637-07 : Bucket `ORDER_LINE` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:18.009-07 : Bucket `default` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:15.279-07 : Bucket `NEW_ORDER` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:17.193-07 : Bucket `ITEM` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:15.799-07 : Bucket `WAREHOUSE` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:16.896-07 : Bucket `HISTORY` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:17.531-07 : Bucket `ORDERS` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:17.750-07 : Bucket `STOCK` experienced 5 loss(es) on rebalance. Last: 10% of data at 2017-05-30T03:44:16.180-07 ===Analyser results=== * Connection Information Established TIME_WAIT Total TCP Connections in State Conns Hosts Conns Hosts Conns Hosts SendQ (Bytes) -------------------------------------------------------------------------------- Port 8091 (cluster mgmt) 19 2 0 0 20 3 0 Port 8092 (views) 54 3 0 0 55 4 0 Port 8094 (FTS) 2989 2 0 0 4647 3 1622 Port 9999 (Projector) 1 1 0 0 2 2 0 Port 11207 (KV SSL) 0 0 0 0 2 2 0 Port 11209 (ERL -> memcached) 137 7 0 0 139 9 24 Port 11210 (KV) 125 4 0 0 127 6 2855377 Port 11211 (moxi) 0 0 0 0 2 2 0 Port 18091 (cluster mgmt SSL) 0 0 0 0 1 1 0 Port 18092 (views SSL) 0 0 0 0 1 1 0 Port 18094 (FTS SSL) 0 0 0 0 1 1 0 ==Total== 3611 12 191 1 5489 14 2926376 Total recv queue (bytes): 161767264 * Open File Information Command FDs MMaps ------------------------ beam.smp 361 56 cbft 4159 15 memcached 374 38 moxi 43 21 goxdcr 21 3 projector 46 8 ==Total== 5013 145 * Per Node Bucket Stats (CB buckets only) Resident Ratio Bucket CurrItems KV (MB) Meta% Active Replica DWQ --------------------------------------------------------------------- CUSTOMER 30024 55 0.6 100 100 0 default 3306996 4905 0.2 3 0 1374 DISTRICT 10 0 0.0 100 100 0 HISTORY 5498 2 0.3 100 100 0 ITEM 20023 8 1.0 100 100 0 NEW_ORDER 3464 0 0.1 100 100 0 ORDER_LINE 454760 251 4.8 100 100 0 ORDERS 33328 14 0.3 100 100 0 STOCK 100235 134 2.1 100 100 0 WAREHOUSE 0 0 0.0 100 100 0 Total (10 buckets) 3954338 5369 - - - 1374 [BAD] Resident Items 'default': % Resident Ratio is too low ===Cluster '172.23.10{5.60,5.61,5.62,5.63,5.83,6.14,6.96,6.213}' Information=== [info] UUID : b267b5ee59c9b8a715254cc98f842e43 [info] Node Count : 8 [info] Orchestrator : 172.23.105.60 [info] Auto-failover : Disabled (was 120 seconds) [info] Auto-compaction : 30% (default) * Bucket Details Views/DDocs Bucket Type Quota (MB) Prio Evict Indx Reps Conf Cmpct Access Flush Prod Dev -------------------------------------------------------------------------------------------- CUSTOMER CB 603 Low Value On Seq 30% SASL On 0/0 0/0 default CB 6031 Low Full On Seq 30% SASL On 3/1 0/0 DISTRICT CB 241 Low Value On Seq 30% SASL On 0/0 0/0 HISTORY CB 241 Low Value On Seq 30% SASL On 0/0 0/0 ITEM CB 241 Low Value On Seq 30% SASL On 0/0 0/0 NEW_ORDER CB 603 Low Value On Seq 30% SASL On 0/0 0/0 ORDER_LINE CB 1206 Low Value On Seq 30% SASL On 1/1 0/0 ORDERS CB 1206 Low Value On Seq 30% SASL On 0/0 0/0 STOCK CB 603 Low Value On Seq 30% SASL On 0/0 0/0 WAREHOUSE CB 603 Low Value On Seq 30% SASL On 0/0 0/0 Total (10 buckets) - 11578 - - - - - - - 4/2 0/0 * vBucket Details ---Replicas--- Bucket Nodes Total Online 1 2 3 ---------------------------------------------------- CUSTOMER 5 1024 1024 1024 n/a n/a default 5 1024 1024 1024 n/a n/a DISTRICT 5 1024 1024 1024 n/a n/a HISTORY 5 1024 1024 1024 n/a n/a ITEM 5 1024 1024 1024 n/a n/a NEW_ORDER 5 1024 1024 1024 n/a n/a ORDER_LINE 5 1024 1024 1024 n/a n/a ORDERS 5 1024 1024 1024 n/a n/a STOCK 5 1024 1024 1024 n/a n/a WAREHOUSE 6 1024 1024 1024 n/a n/a [warn] Nodes for NEW_ORDER : 5 - less than size of cluster (6) [warn] Nodes for default : 5 - less than size of cluster (6) [warn] Nodes for HISTORY : 5 - less than size of cluster (6) [warn] Nodes for STOCK : 5 - less than size of cluster (6) [warn] Nodes for DISTRICT : 5 - less than size of cluster (6) [warn] Nodes for ORDER_LINE: 5 - less than size of cluster (6) [warn] Nodes for CUSTOMER : 5 - less than size of cluster (6) [warn] Nodes for ITEM : 5 - less than size of cluster (6) [warn] Nodes for ORDERS : 5 - less than size of cluster (6) * Multi-Dimensional Scaling Service Total Nodes --------------------------------------------------------- fts 1 172.23.105.61 index 1 172.23.105.60 kv 6 172.23.10{5.61,5.62,5.63,5.83,6.14,6.213} n1ql 1 172.23.106.96 * Rack Zone Awareness Information Server Group Nodes ------------------------------------------------------------------ Group 1 172.23.10{5.60,5.61,5.62,5.63,5.83,6.14,6.96,6.213}