Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61715

Vectors in xattrs seem to store and return both id and the base64 string

    XMLWordPrintable

Details

    • Bug
    • Resolution: User Error
    • Major
    • None
    • 7.6.2
    • fts
    • Untriaged
    • 0
    • Unknown

    Description

      A xattrs vector query returns data that it shouldn't

      {
          "knn": [{
              "k": 5,
              "field": "_$xattrs.emb_b64",
              "vector_base64": "B/w2vLucQTyU5Ta61BroO1HArDx ......."
          }],
          "fields": ["*"],
          "query": {
              "match_none": {}
          },
          "explain": true,
          "size": 10,
          "from": 0
      }

      Same set up as MB-61714 we see stuff returned that shouldn't have been stored.

      The gray boxes should be completely empty

      Below is the index:

      {
        "type": "fulltext-index",
        "name": "b64._default.a_b64_part8_xattr",
        "uuid": "7ac97e22b018a39a",
        "sourceType": "gocbcore",
        "sourceName": "b64",
        "sourceUUID": "a2c9889c69e63426fecbaa52aeb6d22a",
        "planParams": {
          "maxPartitionsPerPIndex": 32,
          "indexPartitions": 32
        },
        "params": {
          "doc_config": {
            "docid_prefix_delim": "",
            "docid_regexp": "",
            "mode": "scope.collection.type_field",
            "type_field": "type"
          },
          "mapping": {
            "analysis": {},
            "default_analyzer": "standard",
            "default_datetime_parser": "dateTimeOptional",
            "default_field": "_all",
            "default_mapping": {
              "dynamic": false,
              "enabled": false
            },
            "default_type": "_default",
            "docvalues_dynamic": true,
            "index_dynamic": true,
            "store_dynamic": true,
            "type_field": "_type",
            "types": {
              "_default._default": {
                "default_analyzer": "standard",
                "dynamic": true,
                "enabled": true,
                "properties": {
                  "_$xattrs": {
                    "dynamic": false,
                    "enabled": true,
                    "properties": {
                      "emb_b64": {
                        "dynamic": false,
                        "enabled": true,
                        "fields": [
                          {
                            "dims": 4096,
                            "index": true,
                            "name": "emb_b64",
                            "similarity": "dot_product",
                            "type": "vector_base64",
                            "vector_index_optimized_for": "latency"
                          }
                        ]
                      }
                    }
                  }
                }
              }
            }
          },
          "store": {
            "indexType": "scorch",
            "segmentVersion": 16
          }
        },
        "sourceParams": {
          "includeXAttrs": true
        }
      }

       

       

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            jon.strabala Jon Strabala
            jon.strabala Jon Strabala
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty