Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62618

[Windows][Vector Search] : Sysproc CPU utilization is capped at around 200%, regardless of the number of vCPUs, indicating it only utilizes approximately 2 vCPUs irrespective of available resources.

    XMLWordPrintable

Details

    Description

      Steps taken for this issue

      1. Created a 2 node cluster - 1 kv, 1 fts node
      2. Created a magma bucket and loaded 10M docs onto it (4096 dims)
      3. Created a vector index - definition attached

      The above set of steps was carried out on 16 vCPU machines and 8 vCPU machines in windows. For comparison, the same was also executed on Linux systems.

      For 16 vCPU systems - c6a.4xlarge EC2 instances were used

      For 8 vCPU systems - t3.2xlarge EC2 instances were used.

      The same random data was used in all the clusters. It was loaded onto one of the clusters and was replicated onto all the others using XDCR.

      Observed the indexing stats at this point of time

      Listing down the observations

      1. In windows systems the sysproc CPU utilization is around 200% regardless of the number of vCPUs.
      2. In linux machines, the sysproc CPU utilization goes to almost 1600% in a 16 vCPU node cluster and 800% in a 8 vCPU node cluster
      3. In Linux clusters, overall CPU utilization always oscillates around 80-100% during indexing indicating good resource utilization
      4. In Windows clusters, the resource utilization is very low.

      Windows - 16 vCPU machines

      Windows - 8vCPU machines

      Linux - 16 vCPU machines

      Linux - 8 vCPU machines

      Attachments

        1. image (2).png
          59 kB
          Rahul Rampure
        2. image (3).png
          295 kB
          Rahul Rampure
        3. image-2024-07-08-19-41-16-163.png
          45 kB
          Rahul Rampure
        4. image-2024-07-08-19-42-19-044.png
          299 kB
          Rahul Rampure
        5. image-2024-07-08-19-59-31-740.png
          136 kB
          Rahul Rampure
        6. image-2024-08-09-08-10-30-769.png
          896 kB
          Raghav S K
        7. image-2024-08-09-08-12-34-206.png
          949 kB
          Raghav S K
        8. image-2024-08-09-08-19-00-947.png
          949 kB
          Raghav S K
        9. image-2024-08-09-08-19-17-323.png
          451 kB
          Raghav S K
        10. image-2024-08-09-08-19-45-583.png
          949 kB
          Raghav S K
        11. image-2024-08-09-08-23-48-269.png
          596 kB
          Raghav S K
        12. image-2024-08-09-16-01-40-946.png
          148 kB
          Rahul Rampure
        13. image-2024-08-09-16-04-56-532.png
          139 kB
          Rahul Rampure
        14. image-2024-08-09-16-17-22-372.png
          118 kB
          Rahul Rampure
        15. Screenshot 2024-07-07 at 11.32.41 AM.png
          168 kB
          Raghav S K
        16. Screenshot 2024-07-07 at 11.32.52 AM.png
          184 kB
          Raghav S K
        17. Screenshot 2024-07-07 at 12.05.53 AM.png
          531 kB
          Raghav S K
        18. Screenshot 2024-07-07 at 12.06.06 AM.png
          496 kB
          Raghav S K
        19. Screenshot 2024-07-07 at 7.07.36 PM.png
          270 kB
          Raghav S K
        20. Screenshot 2024-07-07 at 9.16.52 PM.png
          739 kB
          Raghav S K
        21. Screenshot 2024-07-07 at 9.16.59 PM.png
          239 kB
          Raghav S K
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            rahul.rampure Rahul Rampure
            raghav.sk Raghav S K
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty