Details
-
Bug
-
Resolution: Fixed
-
Major
-
5.0.0
-
centos 4.7.0-963
-
Untriaged
-
Unknown
Description
steps:
1. 3 nodes in cluster, 4 buckets. run data loader 6 hours on jenkins with sequoia framework
2. setup replication from SRC to cluster DEST for all buckets.
3. rebalance in at SRC cluster
rebalance in at DEST cluster
4. Fail Over node on SRC, add back (Delta Recovery) and rebalance
5) Fail Over node on SRC, add back(Full Recovery) and rebalance
Rebalance exited with reason {buckets_shutdown_wait_failed,
|
[{'ns_1@172.23.108.11',
|
{'EXIT',
|
{old_buckets_shutdown_wait_failed,
|
["AbRegNums"]}}}]}
|
ns_orchestrator 002 ns_1@172.23.108.8 7:02:36 AM Tue Aug 16, 2016
|
Failed to wait deletion of some buckets on some nodes: [{'ns_1@172.23.108.11',
|
{'EXIT',
|
{old_buckets_shutdown_wait_failed,
|
["AbRegNums"]}}}]
|
ns_rebalancer 000 ns_1@172.23.108.8 7:02:36 AM Tue Aug 16, 2016
|
Shutting down bucket "AbRegNums" on 'ns_1@172.23.108.11' for deletion ns_memcached 000 ns_1@172.23.108.11 7:02:33 AM Tue Aug 16, 2016
|
Shutting down bucket "MsgsCalls" on 'ns_1@172.23.108.11' for deletion ns_memcached 000 ns_1@172.23.108.11 7:02:31 AM Tue Aug 16, 2016
|
http://qa.sc.couchbase.com/job/viber-systest-launcher/24/console
....
|
type delta -u Administrator -p password
|
[2016-08-16T06:39:44-07:00, sequoiatools/couchbase-cli:410b42] rebalance -c 172.23.108.8 -u Administrator -p password
|
[2016-08-16T06:53:24-07:00, sequoiatools/couchbase-cli:2f4521] failover -c 172.23.108.8 --server-failover 172.23.108.11 -u Administrator -p password
|
[2016-08-16T07:01:30-07:00, sequoiatools/couchbase-cli:640e29] recovery -c 172.23.108.8 --server-recovery 172.23.108.11 --recovery-type full -u Administrator -p password
|
[2016-08-16T07:01:36-07:00, sequoiatools/couchbase-cli:d61f73] rebalance -c 172.23.108.8 -u Administrator -p password
|
→
|
|
|
Error occurred on container, try:
|
docker logs d61f73
|
docker start d61f73
|
|
|
�INFO: rebalancing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
|
MRebalance failed. See logs for detailed reason. You can try rebalance again.
|
Attachments
Issue Links
- relates to
-
-
- Closed
-