Uploaded image for project: 'Java Couchbase JVM Core'
  1. Java Couchbase JVM Core
  2. JVMCBC-1161

Cluster disconnect is intermittently timing out

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • 2.4.2
    • None
    • None
    • None
    • 1
    • SDK51

    Description

      We intermittently see errors on CI:

      java.lang.RuntimeException: java.util.concurrent.TimeoutException: Did not observe any item or terminal signal within 10000ms in 'ignoreThen' (and no fallback has been configured)
      	at com.couchbase.client.java.AsyncUtils.block(AsyncUtils.java:56)
      	at com.couchbase.client.java.Cluster.disconnect(Cluster.java:514)
      	at com.couchbase.client.java.KeyValueIntegrationTest.afterAll(KeyValueIntegrationTest.java:99) 

      stdout for this test was:

      01:36:47 INFO  [com.couchbase.transactions.cleanup:442] [com.couchbase.transactions.cleanup][LogEvent] Waiting for 1 regular background threads to exit
      01:36:47 INFO  [com.couchbase.transactions.cleanup.regular:442] [com.couchbase.transactions.cleanup.regular][LogEvent] Stopping background cleanup thread for transactions from this client
      01:36:47 INFO  [com.couchbase.transactions.cleanup.lost:442] [com.couchbase.transactions.cleanup.lost][LogEvent] Client 27833 stopping lost cleanup process, 0 threads running
      01:36:47 INFO  [com.couchbase.transactions.cleanup.lost:442] [com.couchbase.transactions.cleanup.lost][LogEvent] Client 27833 stopped lost cleanup process and removed client from client records
      01:36:47 INFO  [com.couchbase.transactions.cleanup:442] [com.couchbase.transactions.cleanup][LogEvent] Background threads have exitted
      01:36:47 INFO  [com.couchbase.core:442] [com.couchbase.core][BucketClosedEvent][541us] Closed bucket "14c2afdd-9ef2-4af1-b37e-7c4464d22bea" {"coreId":"0x4cca6d7c00000020"}
      01:36:47 WARN  [com.couchbase.config:457] [com.couchbase.config][ConfigPushFailedEvent] Individual config push failed because of: FAIL_TERMINATED {"coreId":"0x4cca6d7c00000020"}
      01:36:50 WARN  [com.couchbase.tracing:457] [com.couchbase.tracing][OverThresholdRequestsRecordedEvent][10s] Requests over Threshold found: {"kv":{"top_requests":[{"operation_name":"upsert","last_dispatch_duration_us":650818,"last_remote_socket":"172.23.111.130:11210","last_local_id":"4CCA6D7C00000020/00000000B20E1A31","last_local_socket":"172.18.0.3:59698","total_dispatch_duration_us":650818,"total_server_duration_us":649280,"encode_duration_us":288312,"operation_id":"0x1f41","timeout_ms":30000,"last_server_duration_us":649280,"total_duration_us":1012898}],"total_count":1}} 

      Attachments

        For Gerrit Dashboard: JVMCBC-1161
        # Subject Branch Project Status CR V

        Activity

          People

            graham.pople Graham Pople
            graham.pople Graham Pople
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There is 1 open Gerrit change

                PagerDuty