Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41938

DDLServiceMgr can take long time to build partitioned index with replica

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      DDLServiceMgr triggers the build of a partitioned index with replica created in non-defer mode. In order to do this, it needs MetadataProvider.

      When DDLServiceMgr tries to instantiate a new MetadataProvider, it waits for 500ms.
      https://github.com/couchbase/indexing/blob/457f86ae37854d1a7cf34ef7df6df6e723c28548/secondary/indexer/ddl_service_manager.go#L1657

      In case of large number of indexes, 500ms may not be enough, as there are other consumers such as getLocalIndexMetadata (used to respond to /getIndexStatus) which take lock while iterating over the repo.

      This can delay the index build.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            backport candidate

            deepkaran.salooja Deepkaran Salooja added a comment - backport candidate

            Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message:
            MB-41938 allow more time for MetadataProvider init

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message: MB-41938 allow more time for MetadataProvider init

            Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?

            mihir.kamdar Mihir Kamdar (Inactive) added a comment - Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?

            Mihir Kamdar, it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.

            deepkaran.salooja Deepkaran Salooja added a comment - Mihir Kamdar , it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.

            Verified in GSI volume test.

            mihir.kamdar Mihir Kamdar (Inactive) added a comment - Verified in GSI volume test.

            People

              mihir.kamdar Mihir Kamdar (Inactive)
              deepkaran.salooja Deepkaran Salooja
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty