Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-28847

[FTS] Memory usage during index build overshoots RAM Quota

    XMLWordPrintable

Details

    • Triaged
    • Unknown
    • FTS Sprint Jul-28-2018, FTS Sprint Aug-11-2018 (Beta)

    Description

      • Build: 2252
      • Indexing YELP Review dataset, 
      • 1 KV node, 2 FTS nodes
      • FTS RAM Quota 1024 (1GB)

      During indexing, stats on the UI shown that RAM usage on a FTS node went up to around 4GB.

      – This is a placeholder bug as of now, I will provide dataset and capture stats, logs as soon as I get access to the FTS perf cluster for another round of experiment.

      Attachments

        1. 1GB_t1t2_rss.png
          1GB_t1t2_rss.png
          44 kB
        2. 1GB_t1t2.png
          1GB_t1t2.png
          29 kB
        3. 2G_t1t2_rss.png
          2G_t1t2_rss.png
          39 kB
        4. 2GB_t1t2.png
          2GB_t1t2.png
          31 kB
        5. 8GB_t1t2_rss.png
          8GB_t1t2_rss.png
          37 kB
        6. 8GB_t1t2.png
          8GB_t1t2.png
          33 kB
        7. 8GB_t1t2.png
          8GB_t1t2.png
          33 kB
        8. mem3.prof
          63 kB
        9. Screen Shot 2018-03-26 at 5.55.02 PM.png
          Screen Shot 2018-03-26 at 5.55.02 PM.png
          420 kB

        Issue Links

          blocks

          Task - A task that needs to be done. MB-30374 Honour FTS Service Memory Quota

          • Major - Major loss of function.
          • Reopened
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-29923 [FTS, scorch] high memory consumption by cbft when there are items in persistence queue

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-21649 [FTS] stats: FTS RAM used stat goes over allocation and doesn't match RSS

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-29967 [FTS, scorch] cbft actual memory consumption is higher than the quota

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-30616 [FTS] Indexing is blocked after update by app_herder

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              abhinav Abhi Dangeti
              tai.tran Tai Tran (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  PagerDuty