Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48212

[BP 6.6.4] - XDCR - File descriptor leak in XDCR

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 6.5.0, 6.5.1, 6.6.0, 6.6.1, 6.6.2, 6.5.2
    • 6.6.5
    • XDCR
    • Untriaged
    • 1
    • Unknown

    Description

      In a recent case from the field we've seen XDCR holding 70,000 sockets that do not have a process on the other side of the connection. When lsof is run, these sockets show up as follows:

       
      COMMAND     PID    USER   FD      TYPE    DEVICE SIZE/OFF      NODE NAME
      ...
      goxdcr.bi 24440 cbadmin    5u     sock       0,7      0t0 303953540 protocol: TCP
      goxdcr.bi 24440 cbadmin    6u     sock       0,7      0t0 211821560 protocol: TCP
      goxdcr.bi 24440 cbadmin   10u     sock       0,7      0t0 216966092 protocol: TCP
      ...
      

      In this case the user had set the file descriptor limit to 70k and so at this point XDCR is unable to create new connections. This issue was previously tracked in MB-44182 and believed to be fixed, but it seems that the core issue hasn't been completely fixed.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build couchbase-server-6.6.4-9910 contains goxdcr commit 82edbe2 with commit message:
            MB-48212 - XDCR file descriptor leak when system is busy

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.4-9910 contains goxdcr commit 82edbe2 with commit message: MB-48212 - XDCR file descriptor leak when system is busy

            Monitored open sockets for goxdcr during component test on 6.6.4-9928 and did not see the count exceed 40.

            pavithra.mahamani Pavithra Mahamani (Inactive) added a comment - Monitored open sockets for goxdcr during component test on 6.6.4-9928 and did not see the count exceed 40.

            People

              pavithra.mahamani Pavithra Mahamani (Inactive)
              neil.huang Neil Huang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty