Blocker Description
________________________________________
From: Sharon Barr
Sent: Wednesday, August 15, 2012 1:55 PM
To: Steve Yen; Farshid Ghods
Cc: Peter Wansch
Subject: build 1588 clustering is broken on rightscale
I am afraid that this is just a symptom.
Clustering on my right scale templates stopped working on build 1588. It worked on 1579. Here are the logs:
What's the source of it?
Sharon
Build 1579 works well. Here are the logs of the clustering phase:
********************************************************************************
*RS> RightScript: 'DEV CBS 2.0.x - Clustering' ****
20:21:54: MB_CLI_PATH in use is: /opt/couchbase/bin/couchbase-cli
20:22:04: Running Clustering Script
20:22:04: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:22:04: Attempted to cluster-init: SUCCESS: init 127.0.0.1
20:22:06: Setting my own tags:
20:22:07: Request to add tag 'membase_cluster_tag:steve01=20120815202206-10.176.30.201' sent successfully.
20:22:07: Checking whether I am clustered already:
20:22:07: Searching for other members of cluster: steve01
20:22:07: Attempting to join node:10.177.2.38
20:22:09: Joined
20:22:09: Checking whether we want to rebalance...
20:22:09: Skipping rebalance since there are only 2 nodes in the cluster
20:22:09: Script exit status: 0
20:22:09: Script duration: 16.145578
********************************************************************************
On a medium VM.
Build 1588 failes to cluster nodes. Here are the logs:
********************************************************************************
*RS> RightScript: 'DEV CBS 2.0.x - Clustering' ****
20:36:50: MB_CLI_PATH in use is: /opt/couchbase/bin/couchbase-cli
20:37:00: Running Clustering Script
20:37:00: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:37:01: Traceback (most recent call last):
20:37:01: File "/opt/couchbase/lib/python/couchbase-cli", line 12, in ?
20:37:01: import buckets
20:37:01: File "/opt/couchbase/lib/python/buckets.py", line 7, in ?
20:37:01: from timeout import timed_out
20:37:01: ImportError
20:37:01: :
20:37:01: No module named timeout
20:37:01: Attempted to cluster-init:
20:37:11: Running Clustering Script
20:37:11: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:37:11: Traceback (most recent call last):
20:37:11: File "/opt/couchbase/lib/python/couchbase-cli", line 12, in ?
20:37:11: import buckets
20:37:11: File "/opt/couchbase/lib/python/buckets.py", line 7, in ?
20:37:11: from timeout import timed_out
20:37:11: ImportError
20:37:11: :
20:37:11: No module named timeout
20:37:11: Attempted to cluster-init:
20:37:21: Running Clustering Script
20:37:21: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:37:21: Traceback (most recent call last):
20:37:21: File "/opt/couchbase/lib/python/couchbase-cli", line 12, in ?
20:37:21: import buckets
20:37:21: File "/opt/couchbase/lib/python/buckets.py", line 7, in ?
20:37:21: from timeout import timed_out
20:37:21: ImportError
20:37:21: :
20:37:21: No module named timeout
20:37:21: Attempted to cluster-init:
20:37:31: Running Clustering Script
20:37:31: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:37:31: Traceback (most recent call last):
20:37:31: File "/opt/couchbase/lib/python/couchbase-cli", line 12, in ?
20:37:31: import buckets
20:37:31: File "/opt/couchbase/lib/python/buckets.py", line 7, in ?
20:37:31: from timeout import timed_out
20:37:31: ImportError
20:37:31: :
20:37:31: No module named timeout
20:37:31: Attempted to cluster-init:
20:37:41: Running Clustering Script
20:37:41: Attempting cluster-init: MEMBASE CLI=/opt/couchbase/bin/couchbase-cli
20:37:41: Traceback (most recent call last):
20:37:41: File "/opt/couchbase/lib/python/couchbase-cli", line 12, in ?
20:37:41: import buckets
20:37:41: File "/opt/couchbase/lib/python/buckets.py", line 7, in ?
20:37:41: from timeout import timed_out
20:37:41: ImportError
20:37:41: :
20:37:41: No module named timeout
20:37:41: Attempted to cluster-init:
20:37:41: Failed to set username/pass:
20:37:41: Script exit status: 255
20:37:41: Script duration: 51.576187
*ERROR> Chef converge failed
*ERROR> An external command returned an error during the execution of Chef:
RightScript < DEV CBS 2.0.x - Clustering > returned 255
*ERROR> Chef process failure
*ERROR> Chef process failed with return code 1
*RS> boot failed: SYS Timezone set v1, SYS Monitoring install v9, SYS Lvm
*RS> install - 11H1, SYS Add Swap Partition, RB rubygems 1.3.1 + quickinstall
*RS> v4, EBS stripe Rightscale tools install v2, Membase Server - EBS stripe
*RS> volume create v2, Membase Server - EBS stripe volume restore v2, Membase
*RS> Server - EBS create backup scripts v2, Membase Server - EBS continuous
*RS> backups v2, Membase Server - enable login, DEV CBS 2.0.x - Install, DEV CBS
*RS> 2.0.x - EBS Setup, DEV CBS 2.0.x - DNS Setup, Couchbase Server - Enterprise
*RS> Edition Support Setup, DEV CBS 2.0.x - Clustering, DEV CBS 2.0.x -
*RS> Configure, Membase Server - Delay Decommission
*ERROR> Failed to run boot sequence: Failed to run boot bundle