Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-10958

collect_info size is huge(zip > 500MB), even the node has never been in cluster but its disk is full

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Critical
    • 3.0
    • 3.0
    • tools
    • Security Level: Public
    • None
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      build 3.0.0-594
      have 3 node in the cluster
      couple times i tried to add 172.23.105.16 with full disk. but as expected - unsuccessfully

      but what I figured out that this node has very large collect_info logs:

      rw-rr-. 1 root root 62M Apr 10 03:34 172.23.105.158-4102014-328-diag.zip
      rw-rr-. 1 root root 13M Apr 24 09:33 172.23.105.159-4242014-930-diag.zip
      rw-rr-. 1 root root 521M Apr 24 10:53 172.23.105.160-4242014-1039-diag.zip
      rw-rr-. 1 root root 500M Apr 24 09:46 172.23.105.160-4242014-933-diag.zip
      rw-rr-. 1 root root 13M Apr 24 09:48 172.23.105.206-4242014-946-diag.zip
      rw-rr-. 1 root root 13M Apr 24 09:51 172.23.105.207-4242014-948-diag.zip
      rw-rr-. 1 root root 30M Apr 10 03:49 172.23.105.22-4102014-345-diag.zip

      unzip 172.23.105.160-4242014-933-diag.zip -d tmp
      Archive: 172.23.105.160-4242014-933-diag.zip
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/couchbase.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.xdcr.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.couchdb.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/stats.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ini.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.error.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.ssl_proxy.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.views.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.info.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.xdcr_errors.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.mapreduce_errors.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/diag.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.xdcr_trace.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/syslog.tar.gz
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.debug.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ddocs.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.reports.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/memcached.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.babysitter.log
      inflating: tmp/cbcollect_info_ns_1@172.23.105.160_20140424-163301/ns_server.stats.log
      [root@cen-0422 testrunner]# cd tmp
      [root@cen-0422 tmp]# cd cbcollect_info_ns_1@172.23.105.160_20140424-163301/
      [root@cen-0422 cbcollect_info_ns_1@172.23.105.160_20140424-163301]# ls -la -h
      total 2.4G
      drwxr-xr-x. 2 root root 4.0K Apr 24 10:16 .
      drwxr-xr-x. 3 root root 4.0K Apr 24 10:15 ..
      rw------. 1 root root 1.9G Apr 24 09:35 couchbase.log
      rw------. 1 root root 264 Apr 24 09:35 ddocs.log
      rw------. 1 root root 174K Apr 24 09:35 diag.log
      rw------. 1 root root 16K Apr 24 09:35 ini.log
      rw------. 1 root root 305 Apr 24 09:35 memcached.log
      rw------. 1 root root 50M Apr 24 09:35 ns_server.babysitter.log
      rw------. 1 root root 97K Apr 24 09:35 ns_server.couchdb.log
      rw------. 1 root root 193M Apr 24 09:35 ns_server.debug.log
      rw------. 1 root root 17K Apr 24 09:35 ns_server.error.log
      rw------. 1 root root 5.0M Apr 24 09:35 ns_server.info.log
      rw------. 1 root root 223 Apr 24 09:35 ns_server.mapreduce_errors.log
      rw------. 1 root root 193M Apr 24 09:35 ns_server.reports.log
      rw------. 1 root root 27K Apr 24 09:35 ns_server.ssl_proxy.log
      rw------. 1 root root 55M Apr 24 09:35 ns_server.stats.log
      rw------. 1 root root 201 Apr 24 09:35 ns_server.views.log
      rw------. 1 root root 213 Apr 24 09:35 ns_server.xdcr_errors.log
      rw------. 1 root root 578K Apr 24 09:35 ns_server.xdcr.log
      rw------. 1 root root 211 Apr 24 09:35 ns_server.xdcr_trace.log
      rw------. 1 root root 6.5K Apr 24 09:35 stats.log
      rw------. 1 root root 121K Apr 24 09:33 syslog.tar.gz

      believe that it is unacceptable and logs continue to grow

      https://s3.amazonaws.com/bugdb/jira/MB-10954/db9206a6/172.23.105.160-4242014-933-diag.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Aliaksey Artamonau Aliaksey Artamonau (Inactive)
            andreibaranouski Andrei Baranouski
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty