Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.6.0
-
Untriaged
-
0
-
No
Description
Filing this issue to track higher memory usage issue on the node even after je_malloc is used. Let us keep this bug open even if there is an InProgress dev activity to address this issue.
- Total vectors 1Million in collection
- 1536 Dimension
- Total size of the FTS on the disk 2GB or so
- Started running k=100 and 10 parallel queries
- Even with je_malloc I seen memory usage going up 5 to 6GiB. Please check the screenshot attached.
- If we start 100 Parallel queries, OOM will happen.
Logs are as follows:
- https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.129.zip
- https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.130.zip
- https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.155.zip
- https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.156.zip
- https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.217.zip
CC Abhi Dangeti