Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62766

Creating a vector index with incorrect dimension leaves a trace

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • None
    • Morpheus
    • secondary-index
    • None
    • Enterprise Edition 8.0.0 build 1709

    Description

      creating a index with incorrect value in the with clause leaves a trace of index in the workbench. The dimension should have 3

      CREATE INDEX `testmultiScalarOneVector_2` ON b1(rating,category,colorRGBVector Vector)
      PARTITION BY HASH (meta().id) WITH {"dimension":384, "description": "IVF,PQ8x8", "similarity":"L2", 'num_partition': 8}

      Also the error message has no clear indicator why the index creation failed. The error message has the same repetitive message all over the place as well.

      [
        {
          "code": 5000,
          "msg": "GSI CreateIndex() - cause: 4:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 5:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 6:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 7:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 8:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 1:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 2:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 3:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids \n\n",
          "reason": {
            "_level": "exception",
            "caller": "secondary_index:683",
            "cause": {
              "error": "4:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 5:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 6:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 7:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 8:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 1:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 2:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids 3:ErrTraining: Number of qualifying/valid vectors 0 are less than the number of vectors 256 required for training 256 centroids",
              "source": "CreateIndex()"
            },
            "code": 4350,
            "key": "indexing.error",
            "message": "GSI error"
          },
          "query": "CREATE INDEX `testmultiScalarOneVector_2` ON b1(rating,category,colorRGBVector Vector)\nPARTITION BY HASH (meta().id) WITH {\"dimension\":384, \"description\": \"IVF,PQ8x8\", \"similarity\":\"L2\", 'num_partition': 8}"
        }
      ] 

      This is the correct index definition and work well

      CREATE INDEX `testmultiScalarOneVector_2` ON b1(rating,category,colorRGBVector Vector)
      PARTITION BY HASH (meta().id) WITH {"dimension":3, "description": "IVF,PQ3x8", "similarity":"L2", 'num_partition': 8} 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            dhananjay.kshirsagar Dhananjay Kshirsagar
            hemant.rajput Hemant Rajput
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty