Details
-
Bug
-
Resolution: Not a Bug
-
Critical
-
7.6.0
-
Sandbox
Couchbase server Enterprise Edition 7.6.0 build 2043
-
Untriaged
-
-
0
-
Unknown
Description
1. Created a 7 node cluster on capella. 3 KV nodes and 4 FTS nodes. Each node is with 16vCPUs and 32 GB RAM. FTS quota allocated on each of the search nodes in 25GB.
2. Loaded about 100M documents into a bucket. Each document has a vector field called 'vector_data' with 128 dimension vectors.
3. Created index on that that data.
4. While the index building is still happening ran some queries
{ "query":{ "match_none":{ } }, "explain":true, "knn":[{ "field":"vector_data", "k":10, "vector":[16.0,34.0,46.0,3.0,1.0,6.0,27.0,44.0,0.0,9.0,77.0,32.0,37.0,83.0,41.0,3.0,19.0,14.0,15.0,17.0,18.0,34.0,22.0,22.0,12.0,23.0,52.0,12.0,0.0,0.0,0.0,1.0,8.0,22.0,15.0,16.0,16.0,35.0,92.0,94.0,1.0,3.0,9.0,13.0,22.0,120.0,120.0,12.0,120.0,15.0,5.0,0.0,0.0,39.0,74.0,120.0,115.0,24.0,14.0,7.0,2.0,7.0,4.0,34.0,1.0,18.0,36.0,120.0,41.0,10.0,2.0,0.0,1.0,8.0,93.0,120.0,35.0,21.0,7.0,0.0,120.0,104.0,57.0,7.0,0.0,1.0,2.0,20.0,120.0,51.0,2.0,13.0,18.0,12.0,3.0,20.0,7.0,6.0,9.0,18.0,18.0,24.0,19.0,4.0,5.0,12.0,114.0,71.0,13.0,2.0,0.0,2.0,60.0,30.0,81.0,54.0,0.0,0.0,0.0,13.0,44.0,10.0,1.0,3.0,7.0,15.0,20.0,38.0] }] } |
5. For smaller values of k(eg: 10 or even upto 100) the queries return results.
6. But for larger values of k (eg: k = 200 or more) I get the following error
context deadline exceeded
|
Not sure if this is related in any way but in fts_store_stats.log we are seeing these errors
Error: error opening zap file: unsupported version 16 != 15 |
Usage:
|
bleve zap v15 footer [path] [flags]
|
|
|
Flags:
|
-h, --help help for footer |
|
|
error opening zap file: unsupported version 16 != 15 |
==============================================================================
|
fts scorch zap (/var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013dfa.zap) |
cbft-bleve zap v15 footer /var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013dfa.zap |
==============================================================================
|
Error: error opening zap file: unsupported version 16 != 15 |
Usage:
|
bleve zap v15 footer [path] [flags]
|
|
|
Flags:
|
-h, --help help for footer |
|
|
error opening zap file: unsupported version 16 != 15 |
==============================================================================
|
fts scorch zap (/var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013e49.zap) |
cbft-bleve zap v15 footer /var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013e49.zap |
==============================================================================
|
Error: error opening zap file: unsupported version 16 != 15 |
Usage:
|
bleve zap v15 footer [path] [flags]
|
|
|
Flags:
|
-h, --help help for footer |
|
|
error opening zap file: unsupported version 16 != 15 |
==============================================================================
|
fts scorch zap (/var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013ea4.zap) |
cbft-bleve zap v15 footer /var/cb/data/@fts/l2norm_100mil_128dimension_2437e41f57752aac_54820232.pindex/store/000000013ea4.zap |
==============================================================================
|
Error: error opening zap file: unsupported version 16 != 15 |
Usage:
|
bleve zap v15 footer [path] [flags]
|
|
|
Flags:
|
-h, --help help for footer |
|
|
error opening zap file: unsupported version 16 != 15 |
