Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62058

Vector Search: FTS crashed with exit status 130

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      Issue:

      FTS process crashed with exist status 130. Seems like this happened during jemalloc calls `arena 0 background thread creation faile`

      Cluster config:

      • 6 search nodes, 3 data nodes and 2 query nodes
      • Search service memory quota - 16851

      Test config

      • Having 2 collections with continuous expiry of the document for every 3600 seconds
      • Above 2 collections will also have continuous dataload every 3600 seconds
      • Other 3 collections have 10M documents each
      • We have 7 indices, but only two indexes are active with continuous data load on the collections along with queries running.
      •  

      Service 'fts' exited with status 130. Restarting. Messages:
      		 
      <jemalloc>: arena 0 background thread creation failed (11)
      		 
      OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 8: Resource temporarily unavailable
      		 
      OpenBLAS blas_thread_init: RLIMIT_NPROC 95782 current, 95782 max

      Logs:

      Attachments

        Issue Links

          Clones

          Bug - A problem which impairs or prevents the functions of the product. MB-62057 Vector Search: FTS crash looping with exit status 1 on system-test cluster

          • Test Blocker - QE-related tests can't proceed
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-62051 FTS OOM - Service 'fts' exited with status 137

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ashokkumar.alluri Ashok Alluri
              ashokkumar.alluri Ashok Alluri
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty