Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55617

View tests are raising "gen_server" errors

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • None
    • 7.1.3
    • view-engine
    • None
    • Untriaged
    • 0
    • Unknown

    Description

      Please see https://couchbase.slack.com/archives/CF8KA58P6/p1675855258798229 for the full details. Here are the cliff notes:

      Recently (between 14th and 23rd January), the previously-reliable view integration tests we have for the JVM clients have started failing very frequently.

      We test against many cluster versions and only see it against 7.1. We test "7.1-stable" which is currently 7.1.4-3559.
      Interestingly, 7.1-stable was changed from "7.1.3" to "7.1.4-3559" on 16th January. And we know that the failures started happening sometime between 14th and 23rd of January...

      The error is:

      View Query Failed: {"error":"noproc","reason":"{gen_server,call,\n            [couch_system_event,\n             {system_event,<<\"{\\\"timestamp\\\":\\\"2023-02-08T01:38:50.479Z\\\",\\\"uuid\\\":\\\"b2c67f31-ff6b-ae21-82a7-68bdb9123911\\\",\\\"event_id\\\":10240,\\\"component\\\":\\\"views\\\",\\\"description\\\":\\\"Ddoc created\\\",\\\"severity\\\":\\\"info\\\",\\\"extra_attributes\\\":{\\\"bucket\\\":\\\"9dde19c6-8678-473a-bbd3-e1dff98ed618\\\",\\\"ddoc\\\":\\\"_design/myDesignDoc\\\",\\\"num_views\\\":0}}\">>}]}"}
      

      We've added logic that tries to wait for the views service to be ready, and tries to retry these failing operations for up to a minute. It has not consistently fixed the issue. In at least some cases we continue to see that error for the full minute of retries, before the test gives up.

      The problem can be reproduced with these steps:

      1. `git clone https://github.com/couchbase/couchbase-jvm-clients`
      2. Modify `src/integrationTest/resources/integration.local.properties` and change cluster.unmanaged.seed to node3-a63f8e0a.cbqeoc.com:80911. This is a 7.1.4-3559 cbdyncluster that I'll leave up for a few days, and can extend as long as needed. (Please let me when you're done). Probably any cluster of the same version will do, but this saves you a step.
      3. Run test ViewSpec. Either in an IDE like IntelliJ, or with CLI `./mvnw -pl scala-client -am -Dtest=ViewSpec -fn test`.

      I think the ./mvnw wrapper script will automatically download whatever's needed (e.g. Maven and Java). If not then https://sdkman.io/ is a great tool for downloading these dependencies. (But brew will also work fine)

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ankit.prabhu Ankit Prabhu
            graham.pople Graham Pople
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty