Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-16948

Disk space issues while building GSI index

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 4.1.1
    • 4.1.0
    • forestdb
    • Security Level: Public
    • None
    • cat /etc/redhat-release
      Red Hat Enterprise Linux Server release 7.1 (Maipo)

      AWS instance: r3.8xlarge with 4TB EBS SSDs
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      Disk is filling up with forestdb files while building GSI Index. Build for 80GB of data reached 37% and the Disk Usage is more than 1TB.

      Single node Cluster which runs all services, with 200M items.

      #du -sch /opt/couchbase/var/lib/couchbase/data/dump/
      		 
      80G	/opt/couchbase/var/lib/couchbase/data/dump/
      		 
      80G	total


      # du -sch /opt/couchbase/var/lib/couchbase/data/@2i/*
      		 
      365G	/opt/couchbase/var/lib/couchbase/data/@2i/dump_pv_ndx_00_1663650541984925903_0.index
      		 
      229G	/opt/couchbase/var/lib/couchbase/data/@2i/dump_pv_ndx_01_387496869036711122_0.index
      		 
      228G	/opt/couchbase/var/lib/couchbase/data/@2i/dump_pv_ndx_02_211762729970114945_0.index
      		 
      226G	/opt/couchbase/var/lib/couchbase/data/@2i/dump_pv_ndx_03_17466434661570895732_0.index
      		 
      1.8M	/opt/couchbase/var/lib/couchbase/data/@2i/MetadataStore
      		 
      1.1T	total

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MB-17211 4.1.1 Minor Release

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-16835 Indexer: ForestDB fails to compact before disk fills up

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              james.mauss James Mauss (Inactive)
              bastian Bastian VS (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty