Description
Observations
1. Currently, during an index's rebalancing, all the partitions, irrespective of index, are redistributed by blance. However, only the partitions corresponding to the index being rebalanced are introduced in the end plans to be set in cfg.
2. Blance is agnostic of indexes(a cbgt concept). Hence, passing in many partitions across indexes can lead to skews at an index level, even though the overall partition distribution is even.
Aim
Hence, to achieve a uniform distribution at an index level(which is necessary for both provisioning and rebalance)
- it is necessary to pass context from prior iterations in the ongoing rebalance to blance in the form of existing partition distribution, but
- redistribute only the partitions belonging to the index being rebalanced/provisioned.
Requirement
Provisioning and rebalance result in even distribution of partitions.