Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-63180

[System Test] Indexer crash - SIGSEGV: segmentation violation

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Critical
    • Cypher
    • Cypher
    • secondary-index
    • 7.7.0-1078
    • Untriaged
    • 0
    • Unknown

    Description

      The test is running with a much smaller document count (4 million per bucket * 3 buckets) than in the previous releases ( over 25 million per bucket * 3 buckets), but the RR seems to be really low. Not sure if that has anything to do with the crash.

      Seen on node 108 -

      2024-08-16T01:21:54.957-07:00 [Info] RebalanceServiceManager::rebalanceJanitor Running Periodic Cleanup
      2024-08-16T01:21:54.958-07:00 [Info] KVSender::sendAddInstancesRequest Success Projector 172.23.96.245:9999 Topic MAINT_4a2da80e9091a09052014247765d1d78 KeyspaceId bucket2
      2024-08-16T01:21:54.958-07:00 [Info] KVSender::sendAddInstancesRequest Projector 172.23.97.66:9999 Topic MAINT_4a2da80e9091a09052014247765d1d78 KeyspaceId bucket2 
      Instances [indexInstance:<instId:14815032935549726008 state:IndexLoading  definition:<defnID:11341653729896120718 bucket:bucket2 scope:scope_0 collection:coll_0 isPrimary:false name:idxvector2_idNWFMD using:0 exprType:N1QL secExpressions:<ud>([`price` `city` `name` `vectors`])</ud> partitionScheme:SINGLE whereExpression:<ud>()</ud> > singlePartn:endpoints:"172.23.97.108:9105" > ]
       
      libgomp: 
      libgomp: Thread creation failed: Resource temporarily unavailable
       
      libgomp: 
      libgomp: Thread creation failed: Resource temporarily unavailable
      Thread creation failed: Resource temporarily unavailable
       
      libgomp: Thread creation failed: Resource temporarily unavailable
      Thread creation failed: Resource temporarily unavailable
       
      libgomp: Thread creation failed: Resource temporarily unavailable
      SIGSEGV: segmentation violation
      PC=0x7f2d52c7ad57 m=565 sigcode=128 addr=0x0
      signal arrived during cgo execution
       
      goroutine 22447 gp=0xc047a79880 m=565 mp=0xc028f4e808 [syscall]:
      runtime.cgocall(0x1701440, 0xc01c4f17c0)
      	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.22.5/go/src/runtime/cgocall.go:157 +0x4b fp=0xc01c4f1798 sp=0xc01c4f1760 pc=0x40ceab
      github.com/couchbase/indexing/secondary/vector/faiss._Cfunc_faiss_Index_sa_encode(0x7f2c50cafd80, 0x1, 0xc0ce2f9400, 0xc00581d140)
      	_cgo_gotypes.go:321 +0x4b fp=0xc01c4f17c0 sp=0xc01c4f1798 pc=0x12109eb
      github.com/couchbase/indexing/secondary/vector/faiss.(*IndexImpl).EncodeAndAssignPQ.func3(0x7f2c50cafd80, 0x1, {0xc0ce2f9400, 0x3134a847b192cd79?, 0x64023776a4c6c35?}, {0xc00581d140, 0xc01c4f18b8?, 0x4163ec?})
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/vector/faiss/index_ivf.go:191 +0x88 fp=0xc01c4f1800 sp=0xc01c4f17c0 pc=0x12143e8
      github.com/couchbase/indexing/secondary/vector/faiss.(*IndexImpl).EncodeAndAssignPQ(0xc05b4db680, {0xc0ce2f9400, 0x80, 0x80}, {0xc00581d140, 0xa, 0xe}, {0xc04355e478, 0x1, 0x1}, ...)
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/vector/faiss/index_ivf.go:191 +0x117 fp=0xc01c4f1878 sp=0xc01c4f1800 pc=0x1214257
      github.com/couchbase/indexing/secondary/vector.(*codebookIVFPQ).EncodeAndAssignVectors(0xc0714160f0, {0xc0ce2f9400, 0x80, 0x80}, {0xc00581d140, 0xa, 0xe}, {0xc04355e478, 0x1, 0x1})
      

      cbcollect ->

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.106.171.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.97.109.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1723798147/collectinfo-2024-08-16T085700-ns_1%40172.23.97.67.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            deepkaran.salooja Deepkaran Salooja
            pavan.pb Pavan PB
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty