Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62721

Indexer crashed in insertVectorIndex during index creation. Also while running vector queries with sift1M, 128dim.

    XMLWordPrintable

Details

    • Bug
    • Resolution: User Error
    • Critical
    • Morpheus
    • Morpheus
    • secondary-index
    • 8.0.0-1706

    Description

      During Index Creation

      Service 'index' exited with status 2. Restarting. Messages:
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).insertVectorIndex(0xc005ba0008, {0xc00574cd80, 0xd, 0x10}, {0xc013565c28, 0x6, 0x8}, 0x2, 0x1, {0xc010873818, ...}, ...)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1729 +0x765
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).insert(0xc005ba0008, {0xc00574cd80?, 0xf29a17?, 0xc00574f300?}, {0xc013565c28?, 0x6?, 0xc00576f508?}, 0xc00fb15900?, 0x38?, {0xc010873818, ...}, ...)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1172 +0x116
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).handleCommandsWorker(0xc005ba0008, 0x2)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1041 +0x485
      created by github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).initWriters in goroutine 308
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:4754 +0x4fb
      

      Service 'index' exited with status 2. Restarting. Messages:
      }, 0x3, 0x0, {0xc00a1327e0, ...}, ...)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1729 +0x765
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).insert(0xc0004e2308, {0xc009cb82a0?, 0xc004810f98?, 0x151c9b8?}, {0xc009cb8118?, 0xc004810f10?, 0xc004810ebe?}, 0xc00d37024c?, 0x0?, {0xc00a1327e0, ...}, ...)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1172 +0x116
      github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).handleCommandsWorker(0xc0004e2308, 0x3)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:1041 +0x485
      created by github.com/couchbase/indexing/secondary/indexer.(*plasmaSlice).initWriters in goroutine 326
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/plasma_slice.go:4754 +0x4fb
      

      During Quering

      Service 'index' exited with status 2. Restarting. Messages:
      /home/couchbase/.cbdepscache/exploded/x86_64/go-1.22.5/go/src/runtime/select.go:327 +0x725 fp=0xc000250f58 sp=0xc000250e38 pc=0x458105
      github.com/couchbase/indexing/secondary/indexer.(*CancelCb).Run.func1()
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_coordinator.go:1590 +0x65 fp=0xc000250fe0 sp=0xc000250f58 pc=0x15ebb65
      runtime.goexit({})
      /home/couchbase/.cbdepscache/exploded/x86_64/go-1.22.5/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000250fe8 sp=0xc000250fe0 pc=0x47db21
      created by github.com/couchbase/indexing/secondary/indexer.(*CancelCb).Run in goroutine 177472
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/scan_coordinator.go:1589 +0x4f
       
      rax 0x0
      rbx 0x48d85
      rcx 0x7f93cbaa9d3c
      rdx 0x6
      rdi 0x48d85
      rsi 0x48d85
      rbp 0x7f93cc332280
      rsp 0x7ffc74220320
      r8 0x0
      r9 0x7ffc7421feb0
      r10 0x8
      r11 0x246
      r12 0x6
      r13 0x7ffc74220570
      r14 0x7f93cc35e220
      r15 0x4
      rip 0x7f93cbaa9d3c
      rflags 0x246
      cs 0x33
      fs 0x0
      gs 0x0
      

      Sample Doc(these are all float values. While copying from editor they are copied as int):

      {
        "id": 0,
        "emb": [
          0,
          16,
          35,
          5,
          32,
          31,
          14,
          10,
          11,
          78,
          55,
          10,
          45,
          83,
          11,
          6,
          14,
          57,
          102,
          75,
          20,
          8,
          3,
          5,
          67,
          17,
          19,
          26,
          5,
          0,
          1,
          22,
          60,
          26,
          7,
          1,
          18,
          22,
          84,
          53,
          85,
          119,
          119,
          4,
          24,
          18,
          7,
          7,
          1,
          81,
          106,
          102,
          72,
          30,
          6,
          0,
          9,
          1,
          9,
          119,
          72,
          1,
          4,
          33,
          119,
          29,
          6,
          1,
          0,
          1,
          14,
          52,
          119,
          30,
          3,
          0,
          0,
          55,
          92,
          111,
          2,
          5,
          4,
          9,
          22,
          89,
          96,
          14,
          1,
          0,
          1,
          82,
          59,
          16,
          20,
          5,
          25,
          14,
          11,
          4,
          0,
          0,
          1,
          26,
          47,
          23,
          4,
          0,
          0,
          4,
          38,
          83,
          30,
          14,
          9,
          4,
          9,
          17,
          23,
          41,
          0,
          0,
          2,
          8,
          19,
          25,
          23,
          1
        ]
      }
      

      Index defn:

      CREATE INDEX `vector_idx` ON `sift`(`emb` VECTOR)
      

      Query:

      SELECT RAW id
      FROM _default
      ORDER BY ANN(emb, [1.0, 3.0, 11.0, 110.0, 62.0, 22.0, 4.0, 0.0, 43.0, 21.0, 22.0, 18.0, 6.0, 28.0, 64.0, 9.0, 11.0, 1.0, 0.0, 0.0, 1.0, 40.0, 101.0, 21.0, 20.0, 2.0, 4.0, 2.0, 2.0, 9.0, 18.0, 35.0, 1.0, 1.0, 7.0, 25.0, 108.0, 116.0, 63.0, 2.0, 0.0, 0.0, 11.0, 74.0, 40.0, 101.0, 116.0, 3.0, 33.0, 1.0, 1.0, 11.0, 14.0, 18.0, 116.0, 116.0, 68.0, 12.0, 5.0, 4.0, 2.0, 2.0, 9.0, 102.0, 17.0, 3.0, 10.0, 18.0, 8.0, 15.0, 67.0, 63.0, 15.0, 0.0, 14.0, 116.0, 80.0, 0.0, 2.0, 22.0, 96.0, 37.0, 28.0, 88.0, 43.0, 1.0, 4.0, 18.0, 116.0, 51.0, 5.0, 11.0, 32.0, 14.0, 8.0, 23.0, 44.0, 17.0, 12.0, 9.0, 0.0, 0.0, 19.0, 37.0, 85.0, 18.0, 16.0, 104.0, 22.0, 6.0, 2.0, 26.0, 12.0, 58.0, 67.0, 82.0, 25.0, 12.0, 2.0, 2.0, 25.0, 18.0, 8.0, 2.0, 19.0, 42.0, 48.0, 11.0], "L2_SQUARED") ASC
      LIMIT 100;
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty