Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49057

XDCR - P2P - handle potential burst of incoming requests

    XMLWordPrintable

Details

    • Task
    • Resolution: Duplicate
    • Critical
    • 7.1.0
    • 7.1.0
    • XDCR
    • None
    • 1

    Description

      In a large system under a heavy load, XDCR will experience a burst of incoming requests from peers. This is made worse by retries when operations take too long.

      It'll translate into situations where timeout occur on the p2p comm REST API:

      [{'ns_1@172.23.108.103',timeout}]
      [ns_server:error,2021-10-19T15:20:06.432-07:00,ns_1@172.23.108.103:<0.2088.614>:menelaus_util:reply_server_error:209]Server error during processing: ["web request failed",
                                       {path,"/xdcr/p2pCommunications"},
                                       {method,'POST'},
                                       {type,error},
      --
      --
                                           {line,150}]},
                                         {proc_lib,init_p_do_apply,3,
                                          [{file,"proc_lib.erl"},{line,226}]}]}]
      [ns_server:error,2021-10-19T15:20:06.729-07:00,ns_1@172.23.108.103:<0.1584.614>:menelaus_util:reply_server_error:209]Server error during processing: ["web request failed",
                                       {path,"/xdcr/p2pCommunications"},
                                       {method,'POST'},
                                       {type,error},
      --
      --
                                           {line,150}]},
                                         {proc_lib,init_p_do_apply,3,
                                          [{file,"proc_lib.erl"},{line,226}]}]}]
      [ns_server:error,2021-10-19T15:20:06.730-07:00,ns_1@172.23.108.103:<0.3319.614>:menelaus_util:reply_server_error:209]Server error during processing: ["web request failed",
                                       {path,"/xdcr/p2pCommunications"},
                                       {method,'POST'},
                                       {type,error},
      --
      --
                                           {line,150}]},
                                         {proc_lib,init_p_do_apply,3,
                                          [{file,"proc_lib.erl"},{line,226}]}]}]
      [ns_server:error,2021-10-19T15:20:06.773-07:00,ns_1@172.23.108.103:<0.2919.614>:menelaus_util:reply_server_error:209]Server error during processing: ["web request failed",
                                       {path,"/xdcr/p2pCommunications"},
                                       {method,'POST'},
                                       {type,error},
      --
      

      This ticket is a placeholder and more info will be updated here.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              neil.huang Neil Huang
              neil.huang Neil Huang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty