Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48825

AWS rebalance performance tests hard out of memory error

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 7.1.0
    • 7.1.0
    • couchbase-bucket
    • OS: Amazon Linux 2
      ARM instance: m6g.large
      x86 instance: m5.large

      Both machines using 2vCPU, 8GB memory, EBS 40GB disk.
    • Untriaged
    • 1
    • Unknown

    Attachments

      Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          sean.corrigan Sean Corrigan created issue -
          raju Raju Suravarjjala made changes -
          Field Original Value New Value
          Affects Version/s Neo [ 17615 ]
          raju Raju Suravarjjala made changes -
          Fix Version/s Neo [ 17615 ]
          meni.hillel Meni Hillel (Inactive) made changes -
          Assignee Meni Hillel [ JIRAUSER25407 ] Bryan McCoid [ JIRAUSER25453 ]
          bryan.mccoid Bryan McCoid made changes -
          Description Build number: 7.1.0-1361

          When running rebalance tests on AWS machines, both ARM and x86 instances, tests are hanging on a specific rebalance %. The logs show a hard out of memory error but the same test on a comparable instance (t3.large).

          Here are the jobs for each of these tests:

          Failed m6g.large (arm): [http://perf.jenkins.couchbase.com/job/Cloud-Tester/600/]
          Failed m5.large (x86): [http://perf.jenkins.couchbase.com/job/Cloud-Tester/605/
          ]
          Successful prior t3.large: [http://perf.jenkins.couchbase.com/job/Cloud-Tester/440/]

          Here are the corresponding logs, for the m6g.large:
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-3-219-56-9.compute-1.amazonaws.com.zip]
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-3-223-6-164.compute-1.amazonaws.com.zip]
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-44-195-22-82.compute-1.amazonaws.com.zip]



           

          For the m5.large:
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-107-23-15-217.compute-1.amazonaws.com.zip]
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-3-239-34-6.compute-1.amazonaws.com.zip]
          [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-44-198-61-230.compute-1.amazonaws.com.zip]

           

           
          Build number: 7.1.0-1361

          When running rebalance tests on AWS machines, both ARM and x86 instances, tests are hanging on a specific rebalance %. The logs show a hard out of memory error but the same test on a comparable instance (t3.large).

          Here are the jobs for each of these tests:

          Failed m6g.large (arm): [http://perf.jenkins.couchbase.com/job/Cloud-Tester/600/]
           Failed m5.large (x86): http://perf.jenkins.couchbase.com/job/Cloud-Tester/605/
           Successful prior t3.large: [http://perf.jenkins.couchbase.com/job/Cloud-Tester/440/]

          Here are the corresponding logs, for the m6g.large:
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-3-219-56-9.compute-1.amazonaws.com.zip]
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-3-223-6-164.compute-1.amazonaws.com.zip]
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-07T223241-ns_1%40ec2-44-195-22-82.compute-1.amazonaws.com.zip]

           

          For the m5.large:
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-107-23-15-217.compute-1.amazonaws.com.zip]
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-3-239-34-6.compute-1.amazonaws.com.zip]
           [https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2021-10-08T142839-ns_1%40ec2-44-198-61-230.compute-1.amazonaws.com.zip]

           

           
          drigby Dave Rigby made changes -
          Link This issue relates to MB-49037 [ MB-49037 ]
          bryan.mccoid Bryan McCoid made changes -
          Assignee Bryan McCoid [ JIRAUSER25453 ] Meni Hillel [ JIRAUSER25407 ]
          bryan.mccoid Bryan McCoid made changes -
          Component/s memcached [ 11621 ]
          Component/s ns_server [ 10019 ]
          bryan.mccoid Bryan McCoid made changes -
          Component/s couchbase-bucket [ 10173 ]
          Component/s memcached [ 11621 ]
          bryan.mccoid Bryan McCoid made changes -
          Assignee Meni Hillel [ JIRAUSER25407 ] Daniel Owen [ owend ]
          owend Daniel Owen made changes -
          Link This issue duplicates MB-49037 [ MB-49037 ]
          owend Daniel Owen made changes -
          Link This issue relates to MB-49037 [ MB-49037 ]
          owend Daniel Owen made changes -
          Resolution Duplicate [ 3 ]
          Status Open [ 1 ] Resolved [ 5 ]
          ritam.sharma Ritam Sharma made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

          People

            owend Daniel Owen
            sean.corrigan Sean Corrigan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty