Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-36144

Creating >100 indexes on my laptop freezes Couchbase Server

    XMLWordPrintable

Details

    Description

      Running the "create and build indexes" from mb-36143 resulted in my local Couchbase Server instance completely hanging, so far for many minutes without response.  The UI is spinning on all pages, the 'cbq' binary won't connect, but couchbase-cli seems to return at least some commands correctly.

       

      I can see also that 2 of my 4 CPU cores are at 100% but the other 2 are only at 50%.

       

      I could understand if many hundreds or thousands of indexes cause this issue but at only ~100 I'm hoping we can do something to make the system a bit more responsive...seemingly at this point I would have to revert to scratch or at the very least manually delete the indexes from disk (something the common user likely would not know how to do)

       

      Zip of the log directory attached, I doubt I'll be able to get a cbcollect to run successfully in this state.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          perry Perry Krug added a comment -

          Two other quick points:

          -These ~93 indexes were created on an empty bucket

          -Restarting Couchbase Server seems to have brought them back and warmed them up successfully without issue...some maybe it's just the initial bust of the create and build that needs to be throttled?

          perry Perry Krug added a comment - Two other quick points: -These ~93 indexes were created on an empty bucket -Restarting Couchbase Server seems to have brought them back and warmed them up successfully without issue...some maybe it's just the initial bust of the create and build that needs to be throttled?

          ns_server is not involved in index creation.

          Aliaksey Artamonau Aliaksey Artamonau (Inactive) added a comment - ns_server is not involved in index creation.

          Perry Krug, Multiple improvements have gone in to optimise the indexer CPU utilisation when creating large number of indexes. With the latest builds, I don't think this we would be an issue. Hence resolving this issue as Done

          varun.velamuri Varun Velamuri added a comment - Perry Krug , Multiple improvements have gone in to optimise the indexer CPU utilisation when creating large number of indexes. With the latest builds, I don't think this we would be an issue. Hence resolving this issue as Done
          perry Perry Krug added a comment -

          I just did a quick re-test of this and the node is MUCH more stable when creating and building indexes, though the CPU usage of beam.smp is still >100% for quite a long time during and after the building.

          perry Perry Krug added a comment - I just did a quick re-test of this and the node is MUCH more stable when creating and building indexes, though the CPU usage of beam.smp is still >100% for quite a long time during and after the building.

          Thanks Perry Krug for the quick testing. For the beam.smp CPU utilisation, I think it is being tracked through MB-42320. On indexer side, the idle time CPU utilisation can still be optimised when using standard global secondary storage mode and large number of indexes. MB-42347 is being used to track that issue.

          varun.velamuri Varun Velamuri added a comment - Thanks Perry Krug  for the quick testing. For the beam.smp CPU utilisation, I think it is being tracked through  MB-42320 . On indexer side, the idle time CPU utilisation can still be optimised when using standard global secondary storage mode and large number of indexes.  MB-42347 is being used to track that issue.

          Bulk closing all invalid, Done, duplicate bugs. Please feel free to reopen

          raju Raju Suravarjjala added a comment - Bulk closing all invalid, Done, duplicate bugs. Please feel free to reopen

          People

            varun.velamuri Varun Velamuri
            perry Perry Krug
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty