Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43886

Usage of global cluster info client object

    XMLWordPrintable

Details

    • Bug
    • Resolution: Resolved
    • Critical
    • 7.1.0
    • Cheshire-Cat
    • secondary-index
    • None
    • Untriaged
    • 1
    • Unknown

    Description

      Currently, indexer uses multiple cluster info client objects i.e. each component in indexer has a separate cluster info client object. When there is a pool/service change notification, all these clients would refresh their cache resulting in significant load at ns_server.

      Instead, indexer/projector process can maintain only on global cluster info client rather than initialising one per component. To do this, the updation of the cache data has to be made "Copy-On-Write".

      With out copy-on-write, it may not be possible to maintain a global cluster info cache as it would lead to significant RLock and WLock contention between different components.

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MB-47506 Reduce polling by services

          • Major - Major loss of function.
          • Resolved
          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. MB-49844 [BP of MB-43886 to 6.6.5] - Usage of global cluster info client object

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-47541 Indexer/Projector to use bucket streaming API

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-43885 Refresh bucket data (In cluster info cache) upon a change in buckets streaming endpoint

          • Major - Major loss of function.
          • Closed
          is parent task of

          Bug - A problem which impairs or prevents the functions of the product. MB-47541 Indexer/Projector to use bucket streaming API

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-50831 Avoid call to ns_server when querying info for deleted bucket

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-49446 Update in terse bucket streaming endpoint with only change in rev field

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-49448 Add serverGroup.Name in poolsStreaming endpoint update

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-49450 Add a hash value of "nodes" data in pools/default endpoint

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-49451 Addition of "nodeServicesURI" in pools/default endpoint with hash value on nodesExt data

          • Major - Major loss of function.
          • Closed
          For Gerrit Dashboard: MB-43886
          # Subject Branch Project Status CR V
          166192,9 MB-43886 : Add Unit test for nodesInfo and ClusterInfoClientLite unstable indexing Status: NEW 0 0
          158297,2 MB-43886 Introduce lighter version of cluster info client unstable indexing Status: ABANDONED 0 0
          158298,2 MB-43886 Update nodes data on a pool change notification unstable indexing Status: ABANDONED 0 0
          158299,6 MB-43886 Initialise global cluster info client lite version unstable indexing Status: ABANDONED 0 0
          158302,2 MB-43886 Use global cluster info client to retrieve nodeUUID unstable indexing Status: ABANDONED 0 0
          158305,4 MB-43886 Use global cluster info client to retrieve local KVAddrs unstable indexing Status: ABANDONED 0 0
          158306,2 MB-43886 Add support for poolServices in global cluster info client unstable indexing Status: ABANDONED 0 0
          158307,2 MB-43886 Build encrypt port mapping on a serviceChange notification unstable indexing Status: ABANDONED 0 0
          158308,2 MB-43886 Initialise client in global cluster info client lite unstable indexing Status: ABANDONED 0 0
          160159,3 MB-43886 Rename CollectionManifestChangeNotification to BucketInfoChangeNofitication unstable indexing Status: ABANDONED 0 0
          160161,1 MB-43886 Handle BucketInfoChange notification in cluster info lite unstable indexing Status: ABANDONED 0 0
          160165,1 MB-43886 Fetch collection manifest on BucketInfoChangeNotification unstable indexing Status: ABANDONED 0 0
          164228,1 MB-43886 Add infra for a global cluster info client unstable indexing Status: ABANDONED 0 0
          164229,3 MB-43886 Update infra to handle bucket change notification unstable indexing Status: ABANDONED 0 0
          165693,9 MB-43886 : Add basic clusterInfoClientLite unstable indexing Status: MERGED +2 +1
          165932,6 MB-43886 : Add Collection Info to ClusterInfoCacheLite unstable indexing Status: MERGED +2 +1
          166049,6 MB-43886 : Add bucketInfo to clusterInfoCacheLite unstable indexing Status: MERGED +2 +1
          166115,3 MB-43886: Fetch data on Hash Change in PoolChangeNotification unstable indexing Status: MERGED +2 +1
          167189,1 MB-43886 : Make hot swap from cinfo to cinfoLite synchronous unstable indexing Status: ABANDONED 0 0
          167455,2 MB-43886 : Add ClusterInfoProvider Interface unstable indexing Status: MERGED +2 +1
          167457,2 MB-43886 : Integrate ClusterInfoProvider into Projector and LifeCycleMgr unstable indexing Status: MERGED +2 +1
          167460,2 MB-43886 : Add ability to hot swap from cinfo to cinfo lite unstable indexing Status: MERGED +2 +1
          168079,3 MB-43886: Force fetch when ServiceChangeNotifier is restarted unstable indexing Status: MERGED +2 +1
          168099,8 MB-43886: Add ClusterInfoProvider in schedIndexCreator unstable indexing Status: MERGED +2 +1
          168100,4 MB-43886: Use bucketInfo in GetBucketUUID unstable indexing Status: MERGED +2 +1
          168119,13 MB-43886: Add ClusterInfoProvider in IndexManager and RequestHandler unstable indexing Status: MERGED +2 +1
          168125,2 MB-43886: Make Info log to Debug to indicate no hash values changed unstable indexing Status: MERGED +2 +1
          168127,4 MB-43886: Use static ports in ClusterInfoProvider when needed unstable indexing Status: MERGED +2 +1
          168192,10 MB-43886: Use hash value in NodeServiceURI to check if ports changed unstable indexing Status: MERGED +2 +1
          168196,6 MB-43886: Send PoolChangeNotitification on service notifier restart unstable indexing Status: MERGED +2 +1
          168304,8 MB-43886: Add ClusterInfoProvider in KVSender unstable indexing Status: MERGED +2 +1
          168413,9 MB-43886: Add ClusterInfoProvider in indexer and timekeeper unstable indexing Status: MERGED +2 +1
          168593,4 MB-43886: Fix cinfoProvider hot swap in Projector unstable indexing Status: MERGED +2 +1
          169062,4 MB-43886: Update cinfo config paths and fix hot swap unstable indexing Status: MERGED +2 +1
          169400,1 MB-43886: Fix cinfoProviderLocks for hot swap unstable indexing Status: MERGED +2 +1
          170533,2 MB-43886: Add stats endpoint for cinfolite in indexer and projector unstable indexing Status: MERGED +2 +1

          Activity

            People

              hemant.rajput Hemant Rajput
              varun.velamuri Varun Velamuri
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There is 1 open Gerrit change

                  PagerDuty