Memory usage is higher than the data during Indexing (without large segment merges)

Filing this ticket to track memory growth during indexing even with je_malloc

• 1Million Vectors
• 1536 Dimension
• Total FTS data on disk is 2GiB or so
• Seen Memory peak of 5+GiB on single node.

Logs

• https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.129.zip
   

• https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.130.zip
   

• https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.155.zip
   

• https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.156.zip
   

• https://cb-engineering.s3.amazonaws.com/ashok-mem-exps/collectinfo-2024-03-26T130402-ns_1%40172.23.106.217.zip