Uploaded image for project: 'Couchbase C client library libcouchbase'
  1. Couchbase C client library libcouchbase
  2. CCBC-1108

cbc-pillowfight memory crash with collections more than 50

    XMLWordPrintable

Details

    Description

      pillowfight crashes with below error message when tried to run operations on more than 50 collections . Looks like a memory issue . Can you please take a look at it .

       

      cbc-pillowfight --password password --batch-size 1000 --num-items 20000000 --num-threads 50 --min-size 512 --max-size 512 --persist-to 0 --replicate-to 0 --collection 0x9 --collection 0x10  --collection 0x11  --collection 0x12  --collection 0x13  --collection 0x14  --collection 0x15  --collection 0x16  --collection 0x17  --collection 0x18  --collection 0x19  --collection 0x20  --collection 0x21  --collection 0x22  --collection 0x23  --collection 0x24  --collection 0x25  --collection 0x26  --collection 0x27  --collection 0x28  --collection 0x29  --collection 0x30  --collection 0x31  --collection 0x32  --collection 0x33  --collection 0x34  --collection 0x35  --collection 0x36  --collection 0x37  --collection 0x38  --collection 0x39  --collection 0x40  --collection 0x41  --collection 0x42  --collection 0x43  --collection 0x44  --collection 0x45  --collection 0x46  --collection 0x47  --collection 0x48  --collection 0x49  --collection 0x50  --collection 0x51  --collection 0x52  --collection 0x53  --collection 0x54  --collection 0x55  --collection 0x56  --collection 0x57  --collection 0x58  --collection 0x59  --collection 0x60  --collection 0x61  --collection 0x62  --collection 0x63  --collection 0x64  --collection 0x65  --collection 0x66  --collection 0x67  --collection 0x68  --collection 0x69  --collection 0x70  --collection 0x71  --collection 0x72  --collection 0x73  --collection 0x74  --collection 0x75  --collection 0x76  --collection 0x77  --collection 0x78  --collection 0x79  --collection 0x80  --collection 0x81  --collection 0x82  --collection 0x83  --collection 0x84  --collection 0x85  --collection 0x86  --collection 0x87  --collection 0x88  --collection 0x89  --collection 0x90  --collection 0x91  --collection 0x92  --collection 0x93  --collection 0x94  --collection 0x95  --collection 0x96  --collection 0x97  --collection 0x98  --collection 0x99 --json --spec "couchbase://172.23.109.175/bucket-1?enable_tracing=false&ipv6=allow" --populate-only

      cbc-pillowfight(1752,0x7fffa3d0b380) malloc: *** mach_vm_map(size=208957367283712) failed (error code=3)

      *** error: can't allocate region

      *** set a breakpoint in malloc_error_break to debug

      Segmentation fault: 11

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          bo-chun.wang Bo-Chun Wang added a comment -

          Hi Matt Ingenthron,

          The version is 2.9.3. Are there command options I can pass to cbc-pillowfight so we can collect more information?

          bo-chun.wang Bo-Chun Wang added a comment - Hi Matt Ingenthron , The version is 2.9.3. Are there command options I can pass to cbc-pillowfight so we can collect more information?
          bo-chun.wang Bo-Chun Wang added a comment -

          Matt Ingenthron

          I tried to collect the core file, but the file is very large. I'm not able to upload the core file. I can hold the client so someone can log in and take a look. Does it work?

          bo-chun.wang Bo-Chun Wang added a comment - Matt Ingenthron I tried to collect the core file, but the file is very large. I'm not able to upload the core file. I can hold the client so someone can log in and take a look. Does it work?

          That would be great Bo-Chun Wang. Getting a backtrace from the core would be good.

          If it truly is 2.9.3 (that doesn't sound right) then we'd probably want to repro this with 3.0 beta before going any further. 3.x will be what supports collections and a lot has changed.

          See approximate release dates here:
          https://issues.couchbase.com/projects/CCBC?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released-unreleased

          ingenthr Matt Ingenthron added a comment - That would be great Bo-Chun Wang . Getting a backtrace from the core would be good. If it truly is 2.9.3 (that doesn't sound right) then we'd probably want to repro this with 3.0 beta before going any further. 3.x will be what supports collections and a lot has changed. See approximate release dates here: https://issues.couchbase.com/projects/CCBC?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released-unreleased
          bo-chun.wang Bo-Chun Wang added a comment -

          Matt Ingenthron

          Thanks for the information. I changed the version to 3.0.0_alpha.5 which is the latest version supported in our lab. I re-ran the test, and the test didn't hit segmentation fault this time. The test finished successfully. 

          http://perf.jenkins.couchbase.com/job/ares_tmp/27/

          Note that, if we want to try it with 3.0 beta, we may have to fix CCBC-1101 first. 

          bo-chun.wang Bo-Chun Wang added a comment - Matt Ingenthron Thanks for the information. I changed the version to 3.0.0_alpha.5 which is the latest version supported in our lab. I re-ran the test, and the test didn't hit segmentation fault this time. The test finished successfully.  http://perf.jenkins.couchbase.com/job/ares_tmp/27/ Note that, if we want to try it with 3.0 beta, we may have to fix  CCBC-1101 first. 
          bo-chun.wang Bo-Chun Wang added a comment -

          According to the latest results, the test didn't hit memory crash with 100 collections. I closed the ticket. 

          bo-chun.wang Bo-Chun Wang added a comment - According to the latest results, the test didn't hit memory crash with 100 collections. I closed the ticket. 

          People

            bo-chun.wang Bo-Chun Wang
            sharath.sulochana Sharath Sulochana (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty