Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-27047

Eventing : Item mismatch between src and dest bucket when the workload was a mix of creates, updates and items set with expiration

    XMLWordPrintable

Details

    • Task
    • Resolution: Duplicate
    • Critical
    • 5.5.0
    • 5.5.0
    • eventing

    Description

      Build : 5.1.0-1470

      The simple system test creates 3 src buckets, 1 metadata bucket and 3 dest buckets. For each src bucket there is 1 handler app. 1 does bucket ops, 1 has cron timers for onUpdate and onDelete, and 1 has docTimer for onUpdate and cron timer for onDelete (function definitions attached)

      The KV ops is a mix of creates and updates, and some % docs are set to have a TTL of 10 mins.

      The test is run for 1 hr with constant KV ops on all src buckets. After few hours of this test ending, the number of docs in src and dest buckets do not match. Since the dest bucket has more items, it seems that the handler functions do not handle the expired documents correctly.

      Stats:

      curl http://172.23.108.234:8096/getExecutionStats?name=bucket_op_function -u Administrator:password
      {"doc_timer_create_failure":0,"non_doc_timer_create_failure":0,"on_delete_failure":14814,"on_delete_success":11493156,"on_update_failure":0,"on_update_success":18388834}
       
      curl http://172.23.108.234:8096/getFailureStats?name=bucket_op_function -u Administrator:password
      {"bucket_op_exception_count":14814,"checkpoint_failure_count":0,"n1ql_op_exception_count":0,"timeout_count":24}
       
       
      curl http://172.23.108.234:8096/getExecutionStats?name=cron_timer_op
      {"doc_timer_create_failure":0,"non_doc_timer_create_failure":85,"on_delete_failure":0,"on_delete_success":1686291,"on_update_failure":0,"on_update_success":2160997}
       
      curl http://172.23.108.234:8096/getFailureStats?name=cron_timer_op  -u Administrator:password
      {"bucket_op_exception_count":80206,"checkpoint_failure_count":0,"n1ql_op_exception_count":0,"timeout_count":3}
       
      curl http://172.23.108.234:8096/getExecutionStats?name=doc_timer_op_1  -u Administrator:password
      {"doc_timer_create_failure":56,"non_doc_timer_create_failure":16,"on_delete_failure":0,"on_delete_success":1146142,"on_update_failure":0,"on_update_success":1572829}
       
      curl http://172.23.108.234:8096/getFailureStats?name=doc_timer_op_1  -u Administrator:password
      {"bucket_op_exception_count":33159,"checkpoint_failure_count":0,"n1ql_op_exception_count":0,"timeout_count":704317}
      

      Cluster is live at 172.23.108.234:8091

      Attachments

        For Gerrit Dashboard: MB-27047
        # Subject Branch Project Status CR V

        Activity

          People

            mihir.kamdar Mihir Kamdar (Inactive)
            mihir.kamdar Mihir Kamdar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty