Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43230

[System Test] : Seeing exceptions in eventing logs - LCB_ERR_AUTHENTICATION_FAILURE - around the time when query service was OOM killed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Not a Bug
    • Critical
    • 7.0.0
    • Cheshire-Cat
    • query

    Description

      Build : 7.0.0-3977
      Test : -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml
      Scale : 3
      Iteration : 1st

      The query nodes 172.23.97.149 & 172.23.97.150 both experienced OOM kills at 2020-12-10T14:28:52 & 2020-12-10T14:28:13. See MB-43229.

      Around these times, we are seeing fatal errors logged in the Eventing logs on 172.23.120.58, 172.23.123.31 and 172.23.123.33

      2020-12-10 14:29:42,312 - systestmon - DEBUG - 2020-12-10T14:28:54.506-08:00 [Info] eventing-consumer [worker_timer_op_2:/tmp/127.0.0.1:8091_2_2456876380.sock:47438] Exception: {  "message": "SDK error : LCB_ERR_AUTHENTICATION_FAILURE (206) Query error : {\n\"requestID\": \"129fb9f1-cd4e-4bd9-9f60-bcb51177117a\",\n\"clientContextID\": \"34@timer_op.js(timerCallback)\",\n\"signature\": {\"*\":\"*\"},\n\"results\": [\n],\n\"errors\": [{\"code\":10000,\"msg\":\"Unable to authorize user. - cause: Authentication failure\"}],\n\"status\": \"fatal\",\n\"metrics\": {\"elapsedTime\": \"4.833624ms\",\"executionTime\": \"4.740797ms\",\"resultCount\": 0,\"resultSize\": 0,\"serviceLoad\": 9,\"errorCount\": 1}\n}\n",  "stack": "Error\n    at Function.timerCallback (timer_op.js:34:24)"} Location: timer_op.js:34 Code:     var select_query = N1QL('SELECT * FROM default USE KEYS[$context.docID];', {'$context':context}, { 'consistency': 'none' }); Stack: Error    at Function.timerCallback (timer_op.js:34:24) 
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mihir.kamdar Mihir Kamdar (Inactive)
              mihir.kamdar Mihir Kamdar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty