Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-45996

Analytics service crashes when ingesting maximum size docs (20MB) with minimally sized Analytics memory quota

    XMLWordPrintable

Details

    Description

      Node 1 - KV,N1QL and index
      Node 2 - cbas
      1) allocate 1200MB to CBAS node.
      2) upload multiple docs into a KV bucket. Total size of all the docs is 1200MB.
      3) create a dataset on the bucket in which data was loaded.
      4) Check doc count in the dataset using "select count(*) from ds". This query is run in a loop until all the docs are ingested into dataset.
      CBAS service crash is observed.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          michael.blow Michael Blow added a comment -

          Note, these are 20 MB documents- ingesting 20 MB documents consumes quite a bit of memory, which is not released until disconnect. Using smaller documents, increasing service quota, or disconnecting the link before running queries all would likely cause this scenario to pass.

          michael.blow Michael Blow added a comment - Note, these are 20 MB documents- ingesting 20 MB documents consumes quite a bit of memory, which is not released until disconnect. Using smaller documents, increasing service quota, or disconnecting the link before running queries all would likely cause this scenario to pass.
          michael.blow Michael Blow added a comment -

          Umang, can you try this scenario on 6.6.2 to see if this is a regression? Also, can you try a different scenario with with the same overall bucket data size, but not with massive (20MB) documents? e.g. 1200 1MB documents instead of 60 20MB documents...

          michael.blow Michael Blow added a comment - Umang , can you try this scenario on 6.6.2 to see if this is a regression? Also, can you try a different scenario with with the same overall bucket data size, but not with massive (20MB) documents? e.g. 1200 1MB documents instead of 60 20MB documents...
          umang.agrawal Umang added a comment - - edited

          Michael Blow
          I tried the test scenario with Enterprise Edition 6.6.2 build 9588 and observed the same behaviour of CBAS service crashing.

          Also I tried ingesting 1200 1MB documents in the above test scenario and it worked without any issues. Tried this with both build Enterprise Edition 6.6.2 build 9588 and Enterprise Edition 7.0.0 build 5118.

          umang.agrawal Umang added a comment - - edited Michael Blow I tried the test scenario with Enterprise Edition 6.6.2 build 9588 and observed the same behaviour of CBAS service crashing. Also I tried ingesting 1200 1MB documents in the above test scenario and it worked without any issues. Tried this with both build Enterprise Edition 6.6.2 build 9588 and Enterprise Edition 7.0.0 build 5118.

          As confirmed by Ritam Sharma this is not a regression.

          till Till Westmann added a comment - As confirmed by Ritam Sharma  this is not a regression.

          Removing affects-cc-testing label from issues that have been moved to 7.0.1 or CC.Next after discussion with Raju Suravarjjala.

          till Till Westmann added a comment - Removing affects-cc-testing label from issues that have been moved to 7.0.1 or CC.Next after discussion with Raju Suravarjjala .

          People

            michael.blow Michael Blow
            umang.agrawal Umang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty