Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41938

DDLServiceMgr can take long time to build partitioned index with replica

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      DDLServiceMgr triggers the build of a partitioned index with replica created in non-defer mode. In order to do this, it needs MetadataProvider.

      When DDLServiceMgr tries to instantiate a new MetadataProvider, it waits for 500ms.
      https://github.com/couchbase/indexing/blob/457f86ae37854d1a7cf34ef7df6df6e723c28548/secondary/indexer/ddl_service_manager.go#L1657

      In case of large number of indexes, 500ms may not be enough, as there are other consumers such as getLocalIndexMetadata (used to respond to /getIndexStatus) which take lock while iterating over the repo.

      This can delay the index build.

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-41938
          # Subject Branch Project Status CR V

          Activity

            backport candidate

            deepkaran.salooja Deepkaran Salooja added a comment - backport candidate

            Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message:
            MB-41938 allow more time for MetadataProvider init

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message: MB-41938 allow more time for MetadataProvider init
            mihir.kamdar Mihir Kamdar added a comment -

            Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?

            mihir.kamdar Mihir Kamdar added a comment - Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?

            Mihir Kamdar, it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.

            deepkaran.salooja Deepkaran Salooja added a comment - Mihir Kamdar , it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.

            Verified in GSI volume test.

            mihir.kamdar Mihir Kamdar added a comment - Verified in GSI volume test.

            People

              mihir.kamdar Mihir Kamdar
              deepkaran.salooja Deepkaran Salooja
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty