Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-27452

Data mismatch between source and destination buckets after rebalance (eventing, kv)

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • No

    Description

      Script to Repro the Issue:
      This is a test of kv rebalance in with non default eventing setting values.

      ./testrunner -i /tmp/testexec.26743.ini get-cbcollect-info=True -t eventing.eventing_rebalance.EventingRebalance.test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations,nodes_init=6,services_init=kv-kv-eventing-eventing-eventing-index:n1ql,dataset=default,groups=simple,reset_services=True,doc-per-day=10,sock_batch_size=8,worker_count=8,cpp_worker_thread_count=8
      

      Logs attached.

      Stats:

      [2018-01-06 22:48:33,689] - [eventing_base] [139729863083776] - INFO - Stats for Node 172.23.105.163 is [{"event_processing_stats":{"DCP_DELETION":6717,"DCP_MUTATION":6730,"DCP_SNAPSHOT":13446,"DCP_STREAMEND":171,"DCP_STREAMREQ":514},"events_remaining":{"dcp_backlog":13},"execution_stats":{"agg_queue_size":0,"doc_timer_create_failure":0,"non_doc_timer_create_failure":0,"on_delete_failure":0,"on_delete_success":6717,"on_update_failure":0,"on_update_success":6730},"failure_stats":{"bucket_op_exception_count":0,"checkpoint_failure_count":0,"n1ql_op_exception_count":0,"timeout_count":0},"function_name":"Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations","lcb_exception_stats":{},"planner_stats":[{"host_name":"172.23.105.163:8096","start_vb":0,"vb_count":342},{"host_name":"172.23.105.171:8096","start_vb":342,"vb_count":341},{"host_name":"172.23.105.173:8096","start_vb":683,"vb_count":341}],"vb_distribution_stats":{"172.23.105.163:8096":{"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_0":"[0-42]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_1":"[43-85]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_2":"[86-128]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_3":"[129-171]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_4":"[172-214]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_5":"[215-257]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_6":"[258-299]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_7":"[300-341]"},"172.23.105.171:8096":{"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_0":"[342-384]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_1":"[385-427]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_2":"[428-470]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_3":"[471-513]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_4":"[514-556]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_5":"[557-598]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_6":"[599-640]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_7":"[641-682]"},"172.23.105.173:8096":{"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_0":"[683-725]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_1":"[726-768]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_2":"[769-811]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_3":"[812-854]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_4":"[855-897]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_5":"[898-939]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_6":"[940-981]","worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_7":"[982-1023]"}},"worker_pids":{"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_0":16811,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_1":16814,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_2":16819,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_3":16820,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_4":16818,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_5":16839,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_6":16831,"worker_Function_172680225_test_kv_rebalance_in_when_existing_eventing_node_is_processing_mutations_7":16830}}] 
      
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              asingh Abhishek Singh (Inactive)
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty