Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41671

Panic error message seen on concurrent N1ql Transactions

    XMLWordPrintable

Details

    Description

      On build 7.0.0-3167:

      test case:
      1. no of threads = 4
      2. no of collection = 3
      3. no of statement per collection = 8
      4. each txn has 5 savepoints (2 are over written)
      5. commit all txn

      thread that failed has the las query executed as follows:

      {u'1103ecbd-f510-478d-afc6-c2fcf4e6adb8': ['SAVEPOINT a1', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE job_title='Support' LIMIT 10 RETURNING *", ["UPDATE default:pxewcBcl.Mzarcx.beTLuRCaHAbSFX SET isdevloper=True WHERE 'Development' in skills LIMIT 100 RETURNING meta().id"], 'SAVEPOINT a2', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a0', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a2', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE 'Development' in skills LIMIT 10 RETURNING *"]}

      And the error is:
      txn failed with unexpected errors {u'signature': u'json', u'requestID': u'5e76137e-faa1-43bd-ba8d-ee3f387af9e4', u'metrics':

      {u'resultCount': 0, u'executionTime': u'520.298\xb5s', u'serviceLoad': 7, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'594.082\xb5s'}

      , u'results': [], u'errors': [

      {u'msg': u'*Panic: runtime error: index out of range [-1]*', u'code': 5001}

      ], u'status': u'aborted'}

      Queries executed on other threads are attached. Also attached link to cb_collect logs.

      https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip

      link to entire test log: (Almost 8 test case failed with same error) :
      http://qa.sc.couchbase.com/job/temp_atomicity_phase1/418/consoleText

      Also error seems to occuring after one of txn statement fails with "Duplicate key" error

      2020-09-24 23:28:23,246 | test  | INFO    | Thread-3598 | [N1qlBase:run_cbq_query:208] txn failed with error {u'signature': {u'*': u'*'}, u'requestID': u'5c0b7dbc-885b-46a4-ae9b-771fdb36970b', u'metrics': {u'resultCount': 0, u'executionTime': u'423.341881ms', u'serviceLoad': 4, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'423.417903ms'}, u'results': [], u'errors': [{u'msg': u'Duplicate Key: employee-1018', u'code': 17012}], u'status': u'errors'}
      2020-09-24 23:28:23,273 | test  | INFO    | Thread-3598 | [N1qlBase:run_cbq_query:199] txn failed
      2020-09-24 23:28:23,273 | test  | INFO    | Thread-3598 | [N1qlBase:full_execute_query:552] txn failed with unexpected errors {u'signature': u'json', u'requestID': u'b91174e3-1183-4b33-9564-b3016f97ec17', u'metrics': {u'resultCount': 0, u'executionTime': u'1.575423ms', u'serviceLoad': 7, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'1.643922ms'}, u'results': [], u'errors': [{u'msg': u'Panic: runtime error: index out of range [-1]', u'code': 5001}], u'status': u'aborted'}
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          anitha.kuberan Anitha Kuberan created issue -
          anitha.kuberan Anitha Kuberan made changes -
          Field Original Value New Value
          Description On build 7.0.0-3167:

          test case:
          1. no of threads = 4
          2. no of collection = 3
          3. no of statement per collection = 8
          4. each txn has 5 savepoints (2 are over written)
          5. commit all txn

          thread that failed has the las query executed as follows:
          {u'1103ecbd-f510-478d-afc6-c2fcf4e6adb8': ['SAVEPOINT a1', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE job_title='Support' LIMIT 10 RETURNING *", ["UPDATE default:pxewcBcl.Mzarcx.beTLuRCaHAbSFX SET isdevloper=True WHERE 'Development' in skills LIMIT 100 RETURNING meta().id"], 'SAVEPOINT a2', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a0', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a2', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE 'Development' in skills LIMIT 10 RETURNING *"]}

          And the error is:
          txn failed with unexpected errors {u'signature': u'json', u'requestID': u'5e76137e-faa1-43bd-ba8d-ee3f387af9e4', u'metrics': {u'resultCount': 0, u'executionTime': u'520.298\xb5s', u'serviceLoad': 7, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'594.082\xb5s'}, u'results': [], u'errors': [{u'msg': u'*Panic: runtime error: index out of range [-1]*', u'code': 5001}], u'status': u'aborted'}

          Queries executed on other threads are attached. Also attached link to cb_collect logs.

          https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip
          https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip

          On build 7.0.0-3167:

          test case:
          1. no of threads = 4
          2. no of collection = 3
          3. no of statement per collection = 8
          4. each txn has 5 savepoints (2 are over written)
          5. commit all txn

          thread that failed has the las query executed as follows:
          {u'1103ecbd-f510-478d-afc6-c2fcf4e6adb8': ['SAVEPOINT a1', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE job_title='Support' LIMIT 10 RETURNING *", ["UPDATE default:pxewcBcl.Mzarcx.beTLuRCaHAbSFX SET isdevloper=True WHERE 'Development' in skills LIMIT 100 RETURNING meta().id"], 'SAVEPOINT a2', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a0', 'SAVEPOINT a1', 'SAVEPOINT a0', 'SAVEPOINT a2', "INSERT INTO default:pxewcBcl.Mzarcx.wQXtZFGndXW (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:pxewcBcl.Mzarcx.wQXtZFGndXW t WHERE 'Development' in skills LIMIT 10 RETURNING *"]}

          And the error is:
          txn failed with unexpected errors {u'signature': u'json', u'requestID': u'5e76137e-faa1-43bd-ba8d-ee3f387af9e4', u'metrics': {u'resultCount': 0, u'executionTime': u'520.298\xb5s', u'serviceLoad': 7, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'594.082\xb5s'}, u'results': [], u'errors': [{u'msg': u'*Panic: runtime error: index out of range [-1]*', u'code': 5001}], u'status': u'aborted'}

          Queries executed on other threads are attached. Also attached link to cb_collect logs.

          https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip
          https://cb-jira.s3.us-east-2.amazonaws.com/logs/panic/collectinfo-2020-09-25T051231-ns_1@172.23.105.229.zip

          link to entire test log: (Almost 8 test case failed with same error) :
          http://qa.sc.couchbase.com/job/temp_atomicity_phase1/418/consoleText

          Also error seems to occuring after one of txn statement fails with "Duplicate key" error

          {code}
          2020-09-24 23:28:23,246 | test | INFO | Thread-3598 | [N1qlBase:run_cbq_query:208] txn failed with error {u'signature': {u'*': u'*'}, u'requestID': u'5c0b7dbc-885b-46a4-ae9b-771fdb36970b', u'metrics': {u'resultCount': 0, u'executionTime': u'423.341881ms', u'serviceLoad': 4, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'423.417903ms'}, u'results': [], u'errors': [{u'msg': u'Duplicate Key: employee-1018', u'code': 17012}], u'status': u'errors'}
          2020-09-24 23:28:23,273 | test | INFO | Thread-3598 | [N1qlBase:run_cbq_query:199] txn failed
          2020-09-24 23:28:23,273 | test | INFO | Thread-3598 | [N1qlBase:full_execute_query:552] txn failed with unexpected errors {u'signature': u'json', u'requestID': u'b91174e3-1183-4b33-9564-b3016f97ec17', u'metrics': {u'resultCount': 0, u'executionTime': u'1.575423ms', u'serviceLoad': 7, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'1.643922ms'}, u'results': [], u'errors': [{u'msg': u'Panic: runtime error: index out of range [-1]', u'code': 5001}], u'status': u'aborted'}
          {code}

          Sitaram.Vemulapalli Sitaram Vemulapalli made changes -
          Assignee Kamini Jagtiani [ kamini.jagtiani ] Anitha Kuberan [ anitha.kuberan ]
          Sitaram.Vemulapalli Sitaram Vemulapalli made changes -
          Assignee Anitha Kuberan [ anitha.kuberan ] Sitaram Vemulapalli [ sitaram.vemulapalli ]
          Sitaram.Vemulapalli Sitaram Vemulapalli made changes -
          Assignee Sitaram Vemulapalli [ sitaram.vemulapalli ] Anitha Kuberan [ anitha.kuberan ]
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          anitha.kuberan Anitha Kuberan made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          mihir.kamdar Mihir Kamdar (Inactive) made changes -
          Labels N1QL n1ql_txn N1QL functional-test n1ql_txn
          lynn.straus Lynn Straus made changes -
          Fix Version/s 7.0.0 [ 17233 ]
          lynn.straus Lynn Straus made changes -
          Fix Version/s Cheshire-Cat [ 15915 ]

          People

            anitha.kuberan Anitha Kuberan
            anitha.kuberan Anitha Kuberan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty