Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58651

Tests were stuck during load/access phase in 7.6

    XMLWordPrintable

Details

    • Triaged
    • 0
    • Unknown

    Description

      Starting from 7.6, several magma tests were stuck during load phase or access phase. The same tests don't hit the issue in 7.2.1. I open this ticket to track the issue.

      Job: http://perf.jenkins.couchbase.com/job/rhea-5node2/3956/

      Build: 7.6.0-1483

      Logs:
      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2023-09-13T215547-ns_1%40172.23.97.26.zip
      https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2023-09-13T215547-ns_1%40172.23.97.27.zip
      The same test hit the issue on 7.6.0-1419 and 7.6.0-1451.

      7.6.0-1451 http://perf.jenkins.couchbase.com/job/rhea-5node2/3927/ 

      7.6.0-1419 http://perf.jenkins.couchbase.com/job/rhea-5node2/3892/ 

      The last good run of this test was running on 7.6.0-1363.

      http://perf.jenkins.couchbase.com/job/rhea-5node2/3838/

       

      The issue happened to other magma tests.

      7.6.0-1451: http://perf.jenkins.couchbase.com/job/rhea-5node2/3918/

      7.6.0-1483: http://perf.jenkins.couchbase.com/job/rhea-5node2/3948/ 

      I saw this error message in the log.
      http://perf.jenkins.couchbase.com/job/rhea-5node2/3918/artifact/worker.log 

      [2023-09-06 03:15:07,689: WARNING/Process-2:21] Function: read, error: <Key='f017e9-34c3ff1ce96ba52ddbb0e0de9e263cc2cc51', RC=0x8[The server is out of memory. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,312), Tracing Output={"f017e9-34c3ff1ce96ba52ddbb0e0de9e263cc2cc51": null}>

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              bo-chun.wang Bo-Chun Wang
              bo-chun.wang Bo-Chun Wang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty