Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41938

DDLServiceMgr can take long time to build partitioned index with replica

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      DDLServiceMgr triggers the build of a partitioned index with replica created in non-defer mode. In order to do this, it needs MetadataProvider.

      When DDLServiceMgr tries to instantiate a new MetadataProvider, it waits for 500ms.
      https://github.com/couchbase/indexing/blob/457f86ae37854d1a7cf34ef7df6df6e723c28548/secondary/indexer/ddl_service_manager.go#L1657

      In case of large number of indexes, 500ms may not be enough, as there are other consumers such as getLocalIndexMetadata (used to respond to /getIndexStatus) which take lock while iterating over the repo.

      This can delay the index build.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            deepkaran.salooja Deepkaran Salooja created issue -
            deepkaran.salooja Deepkaran Salooja made changes -
            Field Original Value New Value
            Epic Link MB-31933 [ 93594 ]
            deepkaran.salooja Deepkaran Salooja made changes -
            Link This issue relates to CBSE-9004 [ CBSE-9004 ]
            jeelan.poola Jeelan Poola made changes -
            Assignee Jeelan Poola [ jeelan.poola ] Deepkaran Salooja [ deepkaran.salooja ]
            deepkaran.salooja Deepkaran Salooja made changes -
            Link This issue relates to MB-39661 [ MB-39661 ]
            deepkaran.salooja Deepkaran Salooja made changes -
            Labels customer

            backport candidate

            deepkaran.salooja Deepkaran Salooja added a comment - backport candidate
            deepkaran.salooja Deepkaran Salooja made changes -
            Labels customer backport-candidate customer
            deepkaran.salooja Deepkaran Salooja made changes -
            Link This issue relates to MB-39661 [ MB-39661 ]

            Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message:
            MB-41938 allow more time for MetadataProvider init

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4090 contains indexing commit 778904a with commit message: MB-41938 allow more time for MetadataProvider init
            deepkaran.salooja Deepkaran Salooja made changes -
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            jeelan.poola Jeelan Poola made changes -
            Link This issue is cloned by MB-44409 [ MB-44409 ]
            jeelan.poola Jeelan Poola made changes -
            Link This issue backports to MB-44409 [ MB-44409 ]
            jeelan.poola Jeelan Poola made changes -
            Link This issue is cloned by MB-44409 [ MB-44409 ]

            Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?

            mihir.kamdar Mihir Kamdar (Inactive) added a comment - Deepkaran Salooja for Cheshire Cat too, can this be closed based on Dev testing, or should we close based on Vol test where we are creating several indexes ?
            mihir.kamdar Mihir Kamdar (Inactive) made changes -
            Labels backport-candidate customer backport-candidate customer request-dev-verify

            Mihir Kamdar, it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.

            deepkaran.salooja Deepkaran Salooja added a comment - Mihir Kamdar , it would be good to validate in volume test. Build partitioned index with replica on a cluster with large number of indexes.
            deepkaran.salooja Deepkaran Salooja made changes -
            Assignee Deepkaran Salooja [ deepkaran.salooja ] Mihir Kamdar [ mihir.kamdar ]
            mihir.kamdar Mihir Kamdar (Inactive) made changes -
            Labels backport-candidate customer request-dev-verify backport-candidate customer

            Verified in GSI volume test.

            mihir.kamdar Mihir Kamdar (Inactive) added a comment - Verified in GSI volume test.
            mihir.kamdar Mihir Kamdar (Inactive) made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s 7.0.0 [ 17233 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s Cheshire-Cat [ 15915 ]

            People

              mihir.kamdar Mihir Kamdar (Inactive)
              deepkaran.salooja Deepkaran Salooja
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty