Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62807

Vector scan query is giving result even with incorrect dimension vector passed

    XMLWordPrintable

Details

    • Bug
    • Resolution: User Error
    • Major
    • Cypher
    • Cypher
    • query
    • Untriaged
    • 0
    • No

    Description

      I've created an index on dimension 3 on colourRGBVector field. When running the scan query I passed a vector of 384 dimension and I still got the result for the query.

       

       

      with qvec as ([-0.036820296, 0.07618901, -0.021834739, 0.04220322, 0.033987496, 0.0704323, 0.025807453, 0.10878884, -0.043683566, -0.07774865, 0.017205335, 0.04158909, 0.039815348, -0.0021969085, 0.0027028455, 0.030592808, 0.07504194, -0.003076337, -0.051966652, -0.07246586, -0.09823258, -0.04901024, -0.04255727, -0.038400967, -0.03373866, 0.025658714, 0.030753503, 0.0361316, -0.043296706, -0.027663713, -0.0067560845, -0.028243823, -0.0115379775, -0.01702936, 0.0044472534, -0.088370256, -0.014518465, -0.013595396, -0.036128365, -0.037513155, -0.06156864, -0.035275314, 0.011648602, 0.012744462, 0.071021594, 0.040060557, 0.016088465, 0.07086177, 0.01715197, -0.077548295, 0.014054293, 0.022932258, -0.021995312, 0.0012975361, -0.037059125, 0.04514445, -0.023010686, -0.0014881538, 0.0007652258, -0.052474774, 0.064887315, 0.022120908, -0.022651033, -0.033079635, -0.09455488, 0.051355746, 0.009913601, -0.114009246, -0.004214587, 0.013418273, 0.09501607, 0.017499031, 0.023619682, -0.06417556, 0.028813137, -0.0637579, 0.14812514, 0.077642106, -0.006441491, 0.032969218, 0.041564647, 0.013389866, -0.013249297, 0.01727403, 0.056603294, 0.017188163, -0.01776274, 0.015675118, -0.09252837, -0.014915472, -0.13979773, 0.056539834, -0.007982954, 0.043795902, -0.0693676, -0.006280503, -0.021245051, -0.020881101, 0.09918281, 0.035002302, 0.019559592, -0.00060439605, 0.11683902, 0.02291989, -0.06992134, -0.013727054, 0.013985894, 0.03032667, -0.022961732, -0.012699849, 0.02105489, -0.03687376, -0.009561348, -0.008201616, -0.0537653, -0.08757596, -0.051319975, 0.008195128, -0.016677652, 0.05686839, 0.03374004, -0.10579874, 0.021174839, 0.008227765, -0.027959006, -0.095962845, -0.0375068, -3.2213464e-33, -0.021233115, -0.01824475, -0.005768542, 0.093961574, 0.008093514, 0.052705232, -0.059017442, 0.08124648, -0.036572073, -0.03792554, 0.05620413, -0.11497135, -0.079446495, 0.011572549, 0.044601776, 0.002320734, -0.06557805, 0.0047379043, -0.07367442, -0.06490433, -0.123724505, 0.049442053, 0.043645725, -0.017604161, 0.058529943, 0.041982584, -0.003421749, 0.024217514, 0.0050515803, -0.006236546, 0.047634132, 0.0115695875, -0.023602324, 0.047253087, -0.057582356, 0.003933755, -0.061724555, -0.035830617, 0.021183847, 0.029148525, -0.015917093, 0.028692333, -0.033851378, 0.050731942, 0.02540079, 0.034221184, -0.011921909, -0.052332003, 0.07119082, -0.000266243, -0.043948203, -0.042967126, 0.0073981746, 0.038596023, -0.10304929, 0.0015927528, 0.016226772, 0.08858274, -0.023601575, -0.020880431, 0.0129885925, 0.094989106, 0.023947261, -0.040524445, 0.008786251, 0.0941992, 0.031267155, -0.039892565, 0.041485216, 0.012717094, 0.04550616, -0.01354394, 0.032109458, -0.08204305, 0.09838386, -0.013976441, 0.07060186, 0.009160129, 0.03573295, -0.05660407, -0.042920925, 0.0413583, -0.020093605, -0.008286198, 0.045080084, -0.012739944, -0.022248013, 0.024997767, 0.012573808, 0.04634914, 0.03318886, 0.0045299977, -0.1125356, -0.07409785, 0.044675462, 7.0410895e-34, 0.037628632, -0.015640065, -0.07102819, -0.03646955, 0.017303977, -0.049944133, -0.04062404, 0.07024185, -0.04109673, 0.04197842, 0.09084409, 0.0057614157, 0.11758176, 0.06773477, -0.050184965, 0.08525027, 0.047338128, 0.009116689, -0.037006713, -0.004567806, -0.036564227, -0.0012353694, 0.04636643, 0.030770866, -0.05534863, -0.0056543946, -0.04883859, 0.05638976, 0.023954924, -0.06602203, -0.04663451, -0.0487976, -0.0739677, 0.07643309, -0.06307288, -0.050367333, 0.0051040263, -0.05199625, -0.058746144, -0.0103539, 0.0039765975, -0.07134807, -0.01788225, 0.039283585, -0.0031834438, -0.041208625, 0.017576393, 0.015487212, 0.06368995, -0.012536173, 0.122053325, -0.0076698735, 0.027066462, 0.03289535, -0.08368525, 0.0037120269, 0.050318014, 0.05543046, 0.03937619, 0.078919746, 0.0124222385, 0.052048076, -0.041619148, -0.068711035, -0.019287363, -0.035230517, 0.007059409, -0.0369799, 0.010533271, 0.0061817644, 0.09391387, 0.035638545, -0.007366747, 0.015017483, -0.008655166, -0.027091393, 0.03183541, 0.046834394, 0.067605905, 0.002013485, -0.032189026, -0.06402388, 0.05323512, 0.07125808, 0.010005367, -0.057632606, -0.07910019, -0.007223362, 0.07096185, -0.03584206, 0.0911757, 0.14736593, -0.03962861, -0.004731548, -0.0395617, -1.607522e-08, 0.074483015, 0.07526199, -0.04186027, -0.03785444, 0.006187373, -0.08178824, 0.0610798, -0.09083121, -0.07604677, -0.022871984, -0.021561425, -0.046864375, 0.022488773, -0.008564857, -0.06727078, -0.002934923, -0.08168184, 0.078560546, 0.028595213, 0.03654049, -0.0021909128, 0.04442943, 0.009616439, 0.08301496, -0.04085892, 0.0080461325, -0.05176849, -0.067270234, 0.07550015, 0.00016813596, 0.013306632, 0.08050044, 0.023703683, -0.02648722, -0.036376294, -0.073955655, -0.0172293, 0.06834742, -0.011157806, -0.11666541, 0.063580886, -0.035268035, -0.083312884, 0.03021169, 0.019462232, 0.022774862, -0.06359228, -0.113269396, -0.005928917, 0.0012099325, 0.038526304, 0.018925037, -0.08957974, 0.08100417, -0.05649573, -0.102374114, -0.026690025, 0.04565719, -0.029000208, 0.043801248, -0.014243195, 0.029186198, -0.025379524, 0.10264518])  SELECT DISTINCT color, ANN(colorRGBVector, [12,23,1], "L2") from b1 ORDER BY ANN(colorRGBVector, qvec, "L2") limit 2;

       

       

      [
        {
          "color": "buff",
          "$1": 364.61212267284805
        },
        {
          "color": "toupe",
          "$1": 269.34364666722695
        }
      ] 

       

      Index created 

      CREATE INDEX `testcolorRGBVector` ON b1.s1.c1(colorRGBVector VECTOR)
      WITH {"dimension":3, "description": "IVF,PQ3x8", "similarity":"L2"} 

      https://cb-engineering.s3.amazonaws.com/vector-index/collectinfo-2024-07-19T091932-ns_1%40127.0.0.1.zip

       

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            kamini.jagtiani Kamini Jagtiani
            hemant.rajput Hemant Rajput
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty