Details
-
Bug
-
Resolution: Unresolved
-
Major
-
7.6.0
-
None
-
Untriaged
-
0
-
Unknown
Description
While the system test is in progress, the memory usage is increasing and doesn't come down once the indexes are created. Attaching the images from promtimer. Please refer them.
Steps:
- Created an on-prem cluster with 12 nodes. Out of which 5 are fts nodes.
- Each node has atleast 12gb of memory.
- Created one scope and four collections under that scope
- coll_0: Normal Vector Data (5m documents)
- coll_1: Vector data with xattr (1m documents)
- coll_2: Vector data with base_64 (1m documents)
- coll_3: Vector data (1m documents)
- Creating four indexes with 12 partitions across 5 fts nodes.
- index_0: Indexing Normal Vector Data (5m documents)
- index_1: Indexing Vector data with xattr (1m documents)
- index_2: Indexing Vector data with base_64 (1m documents)
- index_3: Indexing Vector data (1m documents)
- Run knn queries on all the indexes created
- Mutated the documents and then again run the knn query on all the indexes
- Add an FTS node
- Perform mutations and then again run the knn queries on all the indexes
- Remove an FTS node
The above steps are performed in a loop.
Logs:
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.105.122.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.106.171.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.106.176.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.106.30.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.96.198.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.96.230.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.96.245.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.97.100.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.97.108.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.97.109.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.97.66.zip
- https://cb-engineering.s3.amazonaws.com/SysTest_Coll4/collectinfo-2024-05-20T065553-ns_1%40172.23.97.67.zip