Started by user anonymous Building remotely on slave001 Checkout:centos-64-view-tests / /home/couchbase/workspace/centos-64-view-tests - hudson.remoting.Channel@4f10216c:slave001 Using strategy: Default Last Built Revision: Revision 078c73e7bc703b274433c654519b2653d7a161d2 (origin/master) Checkout:centos-64-view-tests / /home/couchbase/workspace/centos-64-view-tests - hudson.remoting.LocalChannel@78189538 Wiping out workspace first. Cloning the remote Git repository Cloning repository origin Fetching upstream changes from git://10.1.1.210/testrunner.git Commencing build of Revision 078c73e7bc703b274433c654519b2653d7a161d2 (origin/master) Checking out Revision 078c73e7bc703b274433c654519b2653d7a161d2 (origin/master) No emails were triggered. [centos-64-view-tests] $ /bin/sh -xe /tmp/hudson2877941564771421780.sh + echo version=2.0.0r-553 version=2.0.0r-553 + /opt/python2.7/bin/python scripts/install.py -i resources/jenkins/centos-64-6-nodes.ini -p version=2.0.0r-553,product=cb,parallel=True 2012-01-24 16:59:09,032 - root - INFO - connecting to 10.1.2.30 with username : root password : couchbase ssh_key: 2012-01-24 16:59:09,033 - root - INFO - connecting to 10.1.2.31 with username : root password : couchbase ssh_key: 2012-01-24 16:59:09,034 - root - INFO - connecting to 10.1.2.32 with username : root password : couchbase ssh_key: 2012-01-24 16:59:09,034 - root - INFO - connecting to 10.1.2.33 with username : root password : couchbase ssh_key: thread uninstaller-thread-10.1.2.30 finished 2012-01-24 16:59:09,036 - root - INFO - connecting to 10.1.2.34 with username : root password : couchbase ssh_key: 2012-01-24 16:59:09,036 - root - INFO - connecting to 10.1.2.35 with username : root password : couchbase ssh_key: 2012-01-24 16:59:09,055 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,055 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,055 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,057 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,059 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,079 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:09,236 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,237 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,238 - root - INFO - Connected 2012-01-24 16:59:09,240 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,243 - root - INFO - Connected 2012-01-24 16:59:09,248 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,259 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,260 - root - INFO - Connected 2012-01-24 16:59:09,263 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,264 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,267 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,268 - root - INFO - Connected 2012-01-24 16:59:09,271 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,273 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:09,273 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,276 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,280 - root - INFO - Connected 2012-01-24 16:59:09,282 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,287 - root - INFO - Connected 2012-01-24 16:59:09,290 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,291 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:09,301 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,308 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,324 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:09,480 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,492 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,501 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,511 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,511 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,517 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:09,528 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,535 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,547 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,547 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,557 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,559 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:09,569 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,577 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,590 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,592 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,597 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,600 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:09,637 - root - INFO - command executed successfully 2012-01-24 16:59:09,638 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,645 - root - INFO - command executed successfully 2012-01-24 16:59:09,646 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,656 - root - INFO - command executed successfully 2012-01-24 16:59:09,658 - root - INFO - command executed successfully 2012-01-24 16:59:09,658 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,658 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,667 - root - INFO - command executed successfully 2012-01-24 16:59:09,667 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,669 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,670 - root - INFO - command executed successfully 2012-01-24 16:59:09,671 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:09,677 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,688 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,700 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,702 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,712 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:09,747 - root - INFO - command executed successfully 2012-01-24 16:59:09,748 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,751 - root - INFO - command executed successfully 2012-01-24 16:59:09,753 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,757 - root - INFO - command executed successfully 2012-01-24 16:59:09,757 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,760 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,766 - root - INFO - command executed successfully 2012-01-24 16:59:09,766 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,769 - root - INFO - command executed successfully 2012-01-24 16:59:09,770 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,772 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,775 - root - INFO - command executed successfully 2012-01-24 16:59:09,776 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:09,793 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,798 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,811 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,818 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:09,835 - root - INFO - command executed successfully 2012-01-24 16:59:09,836 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,840 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,846 - root - INFO - command executed successfully 2012-01-24 16:59:09,846 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,856 - root - INFO - command executed successfully 2012-01-24 16:59:09,857 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,865 - root - INFO - command executed successfully 2012-01-24 16:59:09,867 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,875 - root - INFO - command executed successfully 2012-01-24 16:59:09,876 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,888 - root - INFO - command executed successfully 2012-01-24 16:59:09,888 - root - INFO - running command.raw hostname 2012-01-24 16:59:09,889 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,900 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,908 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,916 - root - INFO - command executed successfully 2012-01-24 16:59:09,918 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,928 - root - INFO - CentOS 2012-01-24 16:59:09,928 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:09,929 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:09,956 - root - INFO - command executed successfully 2012-01-24 16:59:09,957 - root - INFO - CentOS 2012-01-24 16:59:09,958 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:09,960 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:09,966 - root - INFO - command executed successfully 2012-01-24 16:59:09,971 - root - INFO - CentOS 2012-01-24 16:59:09,972 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:09,979 - root - INFO - command executed successfully 2012-01-24 16:59:09,983 - root - INFO - CentOS 2012-01-24 16:59:09,984 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:09,984 - root - INFO - command executed successfully 2012-01-24 16:59:09,988 - root - INFO - CentOS 2012-01-24 16:59:09,989 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:09,997 - root - INFO - command executed successfully 2012-01-24 16:59:09,998 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:10,000 - root - INFO - CentOS 2012-01-24 16:59:10,001 - root - INFO - running rpm -e to remove membase-server 2012-01-24 16:59:10,008 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,011 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:10,024 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:10,025 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:10,035 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,042 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 16:59:10,075 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,076 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,109 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,111 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 16:59:10,174 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,214 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,217 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,227 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,252 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,255 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,263 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,269 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 16:59:10,276 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,307 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,309 - root - INFO - command executed successfully 2012-01-24 16:59:10,309 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,311 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,315 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,317 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:10,319 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,323 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,321 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,325 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,328 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,360 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 16:59:10,390 - root - INFO - command executed successfully 2012-01-24 16:59:10,390 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,398 - root - INFO - command executed successfully 2012-01-24 16:59:10,399 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,402 - root - INFO - command executed successfully 2012-01-24 16:59:10,402 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,405 - root - INFO - command executed successfully 2012-01-24 16:59:10,406 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,410 - root - INFO - command executed successfully 2012-01-24 16:59:10,412 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,413 - root - INFO - command executed successfully 2012-01-24 16:59:10,414 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:10,430 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,439 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,443 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,447 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,453 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,457 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 16:59:10,498 - root - INFO - command executed successfully 2012-01-24 16:59:10,498 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,501 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,509 - root - INFO - command executed successfully 2012-01-24 16:59:10,509 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,513 - root - INFO - command executed successfully 2012-01-24 16:59:10,513 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,522 - root - INFO - command executed successfully 2012-01-24 16:59:10,522 - root - INFO - command executed successfully 2012-01-24 16:59:10,522 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,524 - root - INFO - command executed successfully 2012-01-24 16:59:10,525 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,526 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:10,548 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,553 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,563 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,564 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,570 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 16:59:10,575 - root - INFO - command executed successfully 2012-01-24 16:59:10,575 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,578 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,617 - root - INFO - command executed successfully 2012-01-24 16:59:10,618 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,620 - root - INFO - command executed successfully 2012-01-24 16:59:10,622 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,628 - root - INFO - command executed successfully 2012-01-24 16:59:10,629 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,635 - root - INFO - command executed successfully 2012-01-24 16:59:10,637 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,638 - root - INFO - command executed successfully 2012-01-24 16:59:10,641 - root - INFO - running command.raw hostname 2012-01-24 16:59:10,655 - root - INFO - command executed successfully 2012-01-24 16:59:10,657 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,659 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,663 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,670 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,682 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,683 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 16:59:10,697 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,726 - root - INFO - command executed successfully 2012-01-24 16:59:10,729 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,734 - root - INFO - command executed successfully 2012-01-24 16:59:10,734 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,734 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,738 - root - INFO - command executed successfully 2012-01-24 16:59:10,740 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,741 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,746 - root - INFO - command executed successfully 2012-01-24 16:59:10,748 - root - INFO - command executed successfully 2012-01-24 16:59:10,748 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,752 - root - INFO - running command.raw rpm -e membase-server 2012-01-24 16:59:10,765 - root - INFO - command executed successfully 2012-01-24 16:59:10,765 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,766 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,769 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,769 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,781 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,788 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,793 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 16:59:10,818 - root - INFO - command executed successfully 2012-01-24 16:59:10,818 - root - ERROR - beam: no process killed 2012-01-24 16:59:10,818 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:10,821 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:10,838 - root - INFO - command executed successfully 2012-01-24 16:59:10,839 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,840 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,842 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,847 - root - INFO - command executed successfully 2012-01-24 16:59:10,848 - root - ERROR - beam: no process killed 2012-01-24 16:59:10,848 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:10,851 - root - INFO - command executed successfully 2012-01-24 16:59:10,853 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:10,853 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,855 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,858 - root - INFO - command executed successfully 2012-01-24 16:59:10,859 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,860 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,862 - root - INFO - command executed successfully 2012-01-24 16:59:10,863 - root - ERROR - error: package membase-server is not installed 2012-01-24 16:59:10,863 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:10,908 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,913 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,916 - root - INFO - command executed successfully 2012-01-24 16:59:10,917 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:10,972 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:10,973 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 16:59:10,975 - root - INFO - command executed successfully 2012-01-24 16:59:10,979 - root - INFO - command executed successfully 2012-01-24 16:59:10,981 - root - ERROR - beam: no process killed 2012-01-24 16:59:10,981 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:10,983 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:11,036 - root - INFO - command executed successfully 2012-01-24 16:59:11,036 - root - ERROR - beam: no process killed 2012-01-24 16:59:11,039 - root - INFO - command executed successfully 2012-01-24 16:59:11,043 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:11,044 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:11,045 - root - ERROR - beam: no process killed 2012-01-24 16:59:11,058 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:11,047 - root - INFO - command executed successfully 2012-01-24 16:59:11,057 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:11,060 - root - ERROR - beam: no process killed 2012-01-24 16:59:11,069 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:11,064 - root - INFO - command executed successfully 2012-01-24 16:59:11,070 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,087 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:11,089 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:11,090 - root - INFO - command executed successfully 2012-01-24 16:59:11,090 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:11,093 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:11,110 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,112 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 16:59:11,116 - root - INFO - command executed successfully 2012-01-24 16:59:11,117 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,169 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,171 - root - INFO - command executed successfully 2012-01-24 16:59:11,172 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:11,175 - root - INFO - command executed successfully 2012-01-24 16:59:11,176 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:11,188 - root - INFO - command executed successfully 2012-01-24 16:59:11,195 - root - INFO - command executed successfully 2012-01-24 16:59:11,196 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,199 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,200 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,226 - root - INFO - command executed successfully 2012-01-24 16:59:11,227 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:11,229 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:11,230 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:11,241 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,244 - root - INFO - command executed successfully 2012-01-24 16:59:11,244 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,245 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,246 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,256 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 16:59:11,298 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,296 - root - INFO - command executed successfully 2012-01-24 16:59:11,302 - root - INFO - command executed successfully 2012-01-24 16:59:11,308 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,308 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,313 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,309 - root - INFO - command executed successfully 2012-01-24 16:59:11,319 - root - INFO - command executed successfully 2012-01-24 16:59:11,319 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,324 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,323 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,337 - root - INFO - command executed successfully 2012-01-24 16:59:11,338 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:11,343 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,350 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,352 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,353 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,360 - root - INFO - command executed successfully 2012-01-24 16:59:11,360 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,360 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,396 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 16:59:11,411 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,423 - root - INFO - command executed successfully 2012-01-24 16:59:11,423 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,424 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,430 - root - INFO - command executed successfully 2012-01-24 16:59:11,431 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,432 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,433 - root - INFO - command executed successfully 2012-01-24 16:59:11,434 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,436 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,437 - root - INFO - command executed successfully 2012-01-24 16:59:11,438 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,429 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,443 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,445 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,456 - root - INFO - command executed successfully 2012-01-24 16:59:11,457 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,460 - root - INFO - command executed successfully 2012-01-24 16:59:11,462 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:11,462 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:11,477 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,497 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,502 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 16:59:11,507 - root - INFO - command executed successfully 2012-01-24 16:59:11,509 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,518 - root - INFO - command executed successfully 2012-01-24 16:59:11,519 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,520 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,527 - root - INFO - command executed successfully 2012-01-24 16:59:11,528 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,532 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,547 - root - INFO - command executed successfully 2012-01-24 16:59:11,548 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,549 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,553 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,560 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,569 - root - INFO - command executed successfully 2012-01-24 16:59:11,571 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,570 - root - INFO - command executed successfully 2012-01-24 16:59:11,574 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:11,574 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:11,589 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,611 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,612 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 16:59:11,615 - root - INFO - command executed successfully 2012-01-24 16:59:11,615 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,619 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,629 - root - INFO - command executed successfully 2012-01-24 16:59:11,629 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,632 - root - INFO - command executed successfully 2012-01-24 16:59:11,633 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,636 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,640 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,656 - root - INFO - command executed successfully 2012-01-24 16:59:11,656 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,677 - root - INFO - command executed successfully 2012-01-24 16:59:11,678 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,680 - root - INFO - command executed successfully 2012-01-24 16:59:11,680 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:11,697 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,698 - root - INFO - command executed successfully 2012-01-24 16:59:11,698 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:11,701 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:11,715 - root - INFO - command executed successfully 2012-01-24 16:59:11,720 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,720 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,727 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 16:59:11,730 - root - INFO - command executed successfully 2012-01-24 16:59:11,731 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,738 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,762 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,766 - root - INFO - command executed successfully 2012-01-24 16:59:11,766 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,776 - root - INFO - command executed successfully 2012-01-24 16:59:11,776 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:11,787 - root - INFO - command executed successfully 2012-01-24 16:59:11,787 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:11,788 - root - INFO - command executed successfully 2012-01-24 16:59:11,789 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:11,806 - root - INFO - command executed successfully 2012-01-24 16:59:11,806 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:11,808 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,816 - root - INFO - command executed successfully 2012-01-24 16:59:11,817 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:11,818 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,828 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:11,828 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 16:59:11,846 - root - INFO - command executed successfully 2012-01-24 16:59:11,847 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:11,847 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,856 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,876 - root - INFO - command executed successfully 2012-01-24 16:59:11,887 - root - INFO - command executed successfully 2012-01-24 16:59:11,887 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:11,888 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,891 - root - INFO - command executed successfully 2012-01-24 16:59:11,891 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:11,917 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:11,919 - root - INFO - command executed successfully 2012-01-24 16:59:11,919 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:11,926 - root - INFO - command executed successfully 2012-01-24 16:59:11,926 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:11,927 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:11,935 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 16:59:11,957 - root - INFO - command executed successfully 2012-01-24 16:59:11,958 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:11,960 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:11,966 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:11,972 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:11,996 - root - INFO - command executed successfully 2012-01-24 16:59:11,998 - root - INFO - command executed successfully 2012-01-24 16:59:11,998 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:12,001 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:12,011 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 16:59:12,038 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:12,055 - root - INFO - command executed successfully 2012-01-24 16:59:12,086 - root - INFO - command executed successfully 2012-01-24 16:59:12,087 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:12,088 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:12,090 - root - INFO - command executed successfully 2012-01-24 16:59:12,090 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:12,093 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:12,096 - root - INFO - command executed successfully 2012-01-24 16:59:12,097 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:12,102 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:12,111 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:12,120 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:12,142 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 16:59:12,186 - root - INFO - command executed successfully 2012-01-24 16:59:12,194 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,198 - root - INFO - command executed successfully 2012-01-24 16:59:12,203 - root - INFO - command executed successfully 2012-01-24 16:59:12,233 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:12,239 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:12,243 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,245 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 16:59:12,280 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:12,282 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,291 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:12,350 - paramiko.transport.sftp - INFO - [chan 25] Opened sftp connection (server version 3) 2012-01-24 16:59:12,360 - root - INFO - command executed successfully 2012-01-24 16:59:12,361 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,410 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,557 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,562 - root - INFO - command executed successfully 2012-01-24 16:59:12,563 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,583 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,611 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,613 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:12,628 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,638 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,639 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,641 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,644 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 16:59:12,653 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,690 - root - INFO - command executed successfully 2012-01-24 16:59:12,690 - root - INFO - running command.raw hostname 2012-01-24 16:59:12,697 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,713 - root - INFO - command executed successfully 2012-01-24 16:59:12,714 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,714 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,725 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,726 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:12,748 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:12,755 - root - INFO - command executed successfully 2012-01-24 16:59:12,758 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,756 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,769 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 16:59:12,807 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,808 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,820 - root - INFO - command executed successfully 2012-01-24 16:59:12,820 - root - INFO - command executed successfully 2012-01-24 16:59:12,822 - root - INFO - command executed successfully 2012-01-24 16:59:12,827 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,827 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,830 - root - INFO - CentOS 2012-01-24 16:59:12,836 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:12,837 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:12,841 - root - INFO - command executed successfully 2012-01-24 16:59:12,847 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:12,852 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,854 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,857 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 16:59:12,861 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:12,875 - root - INFO - command executed successfully 2012-01-24 16:59:12,877 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,905 - root - INFO - command executed successfully 2012-01-24 16:59:12,912 - root - INFO - command executed successfully 2012-01-24 16:59:12,913 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,913 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,933 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:12,937 - root - INFO - command executed successfully 2012-01-24 16:59:12,939 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,941 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:12,945 - root - INFO - command executed successfully 2012-01-24 16:59:12,948 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:12,978 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:12,988 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:12,993 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 16:59:13,045 - root - INFO - command executed successfully 2012-01-24 16:59:13,047 - root - INFO - running command.raw hostname 2012-01-24 16:59:13,052 - root - INFO - command executed successfully 2012-01-24 16:59:13,063 - root - INFO - command executed successfully 2012-01-24 16:59:13,069 - root - INFO - command executed successfully 2012-01-24 16:59:13,070 - root - INFO - running command.raw hostname 2012-01-24 16:59:13,071 - root - INFO - running command.raw hostname 2012-01-24 16:59:13,075 - root - INFO - running command.raw hostname 2012-01-24 16:59:13,076 - root - INFO - command executed successfully 2012-01-24 16:59:13,080 - root - INFO - running command.raw hostname 2012-01-24 16:59:13,105 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:13,108 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:13,125 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:13,139 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:13,142 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 16:59:13,149 - root - INFO - command executed successfully 2012-01-24 16:59:13,154 - root - INFO - CentOS 2012-01-24 16:59:13,155 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:13,155 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:13,191 - root - INFO - command executed successfully 2012-01-24 16:59:13,198 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:13,209 - root - INFO - command executed successfully 2012-01-24 16:59:13,232 - root - INFO - command executed successfully 2012-01-24 16:59:13,252 - root - INFO - CentOS 2012-01-24 16:59:13,256 - root - INFO - CentOS 2012-01-24 16:59:13,257 - root - INFO - CentOS 2012-01-24 16:59:13,256 - root - INFO - command executed successfully 2012-01-24 16:59:13,258 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:13,285 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:13,271 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:13,287 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:13,284 - root - INFO - CentOS 2012-01-24 16:59:13,258 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:13,299 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:13,298 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:13,298 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:13,319 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:13,320 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:13,328 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:13,351 - paramiko.transport - INFO - Secsh channel 31 opened. 2012-01-24 16:59:19,456 - root - INFO - command executed successfully 2012-01-24 16:59:19,456 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:19,457 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:19,457 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:19,458 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:19,498 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:19,941 - root - INFO - command executed successfully 2012-01-24 16:59:19,941 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:19,941 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:19,942 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:19,942 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:19,944 - root - INFO - command executed successfully 2012-01-24 16:59:19,945 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:19,982 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:19,984 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:20,050 - root - INFO - command executed successfully 2012-01-24 16:59:20,052 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:20,053 - root - INFO - command executed successfully 2012-01-24 16:59:20,056 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:20,093 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:20,097 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:20,158 - root - INFO - command executed successfully 2012-01-24 16:59:20,159 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:20,162 - root - INFO - command executed successfully 2012-01-24 16:59:20,162 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:20,199 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:20,203 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:20,269 - root - INFO - command executed successfully 2012-01-24 16:59:20,269 - root - INFO - command executed successfully 2012-01-24 16:59:20,270 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:20,272 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:20,273 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:20,310 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:20,314 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:20,376 - root - INFO - command executed successfully 2012-01-24 16:59:20,376 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:20,377 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:20,381 - root - INFO - command executed successfully 2012-01-24 16:59:20,382 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:20,382 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:20,383 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:20,424 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:20,455 - root - INFO - command executed successfully 2012-01-24 16:59:20,457 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:20,485 - root - INFO - command executed successfully 2012-01-24 16:59:20,486 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:20,487 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:20,497 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:20,528 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:20,556 - root - INFO - command executed successfully 2012-01-24 16:59:20,557 - root - ERROR - memsup: no process killed 2012-01-24 16:59:20,557 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:20,560 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:20,595 - root - INFO - command executed successfully 2012-01-24 16:59:20,596 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:20,636 - root - INFO - command executed successfully 2012-01-24 16:59:20,637 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:20,638 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:20,639 - root - INFO - command executed successfully 2012-01-24 16:59:20,640 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:20,641 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:20,642 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:20,643 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:20,643 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:20,645 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:20,681 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:20,696 - root - INFO - command executed successfully 2012-01-24 16:59:20,697 - root - ERROR - memsup: no process killed 2012-01-24 16:59:20,698 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:20,725 - root - INFO - command executed successfully 2012-01-24 16:59:20,726 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:20,738 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:20,746 - root - INFO - command executed successfully 2012-01-24 16:59:20,746 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:20,768 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:20,787 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:20,805 - root - INFO - command executed successfully 2012-01-24 16:59:20,806 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:20,807 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:20,825 - root - INFO - command executed successfully 2012-01-24 16:59:20,827 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:20,850 - root - INFO - command executed successfully 2012-01-24 16:59:20,850 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:20,851 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:20,868 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:20,890 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:20,894 - root - INFO - command executed successfully 2012-01-24 16:59:20,894 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:20,895 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:20,895 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:20,895 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:20,915 - root - INFO - command executed successfully 2012-01-24 16:59:20,915 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:20,918 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:20,925 - root - INFO - command executed successfully 2012-01-24 16:59:20,926 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:20,929 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:20,934 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:20,959 - root - INFO - command executed successfully 2012-01-24 16:59:20,960 - root - ERROR - moxi: no process killed 2012-01-24 16:59:20,960 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:20,996 - root - INFO - command executed successfully 2012-01-24 16:59:20,996 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:20,998 - root - INFO - command executed successfully 2012-01-24 16:59:20,998 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:21,000 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:21,002 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:21,005 - root - INFO - command executed successfully 2012-01-24 16:59:21,006 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:21,038 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:21,047 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:21,066 - root - INFO - command executed successfully 2012-01-24 16:59:21,066 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:21,066 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:21,076 - root - INFO - command executed successfully 2012-01-24 16:59:21,076 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:21,079 - root - INFO - command executed successfully 2012-01-24 16:59:21,080 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:21,080 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:21,080 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:21,080 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:21,081 - root - INFO - command executed successfully 2012-01-24 16:59:21,081 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/ip saved as /opt/couchbase/var/lib/couchbase/ip.rpmsave 2012-01-24 16:59:21,081 - root - ERROR - warning: /opt/couchbase/var/lib/couchbase/config/config.dat saved as /opt/couchbase/var/lib/couchbase/config/config.dat.rpmsave 2012-01-24 16:59:21,081 - root - INFO - Stopping couchbase-server 2012-01-24 16:59:21,082 - root - INFO - running command.raw killall -9 beam.smp 2012-01-24 16:59:21,108 - root - INFO - command executed successfully 2012-01-24 16:59:21,109 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:21,110 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:21,111 - root - INFO - command executed successfully 2012-01-24 16:59:21,112 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:21,117 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:21,121 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:21,122 - paramiko.transport - INFO - Secsh channel 32 opened. 2012-01-24 16:59:21,151 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:21,155 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:21,190 - root - INFO - command executed successfully 2012-01-24 16:59:21,190 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:21,190 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:21,191 - root - INFO - command executed successfully 2012-01-24 16:59:21,191 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:21,193 - root - INFO - command executed successfully 2012-01-24 16:59:21,194 - root - INFO - running command.raw killall -9 memcached 2012-01-24 16:59:21,196 - root - INFO - command executed successfully 2012-01-24 16:59:21,197 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:21,215 - root - INFO - command executed successfully 2012-01-24 16:59:21,218 - root - ERROR - moxi: no process killed 2012-01-24 16:59:21,218 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:21,219 - root - INFO - command executed successfully 2012-01-24 16:59:21,230 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:21,232 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:21,233 - paramiko.transport - INFO - Secsh channel 33 opened. 2012-01-24 16:59:21,241 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:21,257 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:21,259 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:21,299 - root - INFO - command executed successfully 2012-01-24 16:59:21,299 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:21,301 - root - INFO - command executed successfully 2012-01-24 16:59:21,304 - root - ERROR - memcached: no process killed 2012-01-24 16:59:21,305 - root - INFO - command executed successfully 2012-01-24 16:59:21,308 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:21,309 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:21,310 - root - INFO - command executed successfully 2012-01-24 16:59:21,315 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:21,311 - root - INFO - running command.raw killall -9 moxi 2012-01-24 16:59:21,332 - root - INFO - command executed successfully 2012-01-24 16:59:21,332 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:21,333 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:21,343 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:21,346 - paramiko.transport - INFO - Secsh channel 34 opened. 2012-01-24 16:59:21,348 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:21,352 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:21,376 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:21,388 - root - INFO - command executed successfully 2012-01-24 16:59:21,389 - root - ERROR - moxi: no process killed 2012-01-24 16:59:21,389 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:21,398 - root - INFO - command executed successfully 2012-01-24 16:59:21,398 - root - ERROR - moxi: no process killed 2012-01-24 16:59:21,398 - root - INFO - running command.raw killall -9 vbucketmigrator 2012-01-24 16:59:21,418 - root - INFO - command executed successfully 2012-01-24 16:59:21,420 - root - INFO - command executed successfully 2012-01-24 16:59:21,420 - root - ERROR - memsup: no process killed 2012-01-24 16:59:21,420 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:21,431 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:21,436 - root - INFO - command executed successfully 2012-01-24 16:59:21,437 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:21,438 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:21,439 - paramiko.transport - INFO - Secsh channel 35 opened. 2012-01-24 16:59:21,442 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:21,457 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:21,462 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:21,477 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:21,485 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:21,496 - root - INFO - command executed successfully 2012-01-24 16:59:21,496 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:21,497 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:21,505 - root - INFO - command executed successfully 2012-01-24 16:59:21,506 - root - ERROR - vbucketmigrator: no process killed 2012-01-24 16:59:21,509 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:21,509 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:21,527 - root - INFO - command executed successfully 2012-01-24 16:59:21,527 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:21,527 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:21,529 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:21,537 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:21,545 - root - INFO - command executed successfully 2012-01-24 16:59:21,545 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:21,548 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:21,549 - paramiko.transport - INFO - Secsh channel 36 opened. 2012-01-24 16:59:21,567 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:21,597 - root - INFO - command executed successfully 2012-01-24 16:59:21,597 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:21,605 - root - INFO - command executed successfully 2012-01-24 16:59:21,605 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:21,607 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:21,618 - root - INFO - command executed successfully 2012-01-24 16:59:21,619 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:21,621 - root - INFO - running command.raw killall -9 epmd 2012-01-24 16:59:21,628 - root - INFO - command executed successfully 2012-01-24 16:59:21,630 - root - ERROR - memsup: no process killed 2012-01-24 16:59:21,630 - root - INFO - command executed successfully 2012-01-24 16:59:21,632 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:21,633 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:21,637 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:21,640 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:21,648 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:21,661 - paramiko.transport - INFO - Secsh channel 37 opened. 2012-01-24 16:59:21,672 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:21,674 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:21,676 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:21,695 - root - INFO - command executed successfully 2012-01-24 16:59:21,696 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:21,716 - root - INFO - command executed successfully 2012-01-24 16:59:21,717 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:21,719 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:21,728 - root - INFO - command executed successfully 2012-01-24 16:59:21,729 - root - INFO - running command.raw killall -9 memsup 2012-01-24 16:59:21,737 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:21,739 - root - INFO - command executed successfully 2012-01-24 16:59:21,739 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:21,740 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:21,741 - root - INFO - command executed successfully 2012-01-24 16:59:21,743 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:21,757 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:21,771 - paramiko.transport - INFO - Secsh channel 38 opened. 2012-01-24 16:59:21,780 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:21,782 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:21,788 - root - INFO - command executed successfully 2012-01-24 16:59:21,789 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:21,798 - root - INFO - command executed successfully 2012-01-24 16:59:21,799 - root - INFO - running command.raw hostname 2012-01-24 16:59:21,818 - root - INFO - command executed successfully 2012-01-24 16:59:21,819 - root - ERROR - memsup: no process killed 2012-01-24 16:59:21,819 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:21,830 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:21,838 - root - INFO - command executed successfully 2012-01-24 16:59:21,839 - root - ERROR - memsup: no process killed 2012-01-24 16:59:21,840 - root - INFO - running command.raw killall -9 cpu_sup 2012-01-24 16:59:21,842 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:21,846 - root - INFO - command executed successfully 2012-01-24 16:59:21,846 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:21,849 - root - INFO - command executed successfully 2012-01-24 16:59:21,849 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:21,861 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:21,880 - paramiko.transport - INFO - Secsh channel 39 opened. 2012-01-24 16:59:21,889 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:21,890 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:21,895 - root - INFO - command executed successfully 2012-01-24 16:59:21,896 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:21,905 - root - INFO - command executed successfully 2012-01-24 16:59:21,907 - root - INFO - CentOS 2012-01-24 16:59:21,908 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:21,911 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:21,928 - root - INFO - command executed successfully 2012-01-24 16:59:21,930 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:21,930 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:21,938 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:21,948 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:21,949 - root - INFO - command executed successfully 2012-01-24 16:59:21,952 - root - ERROR - cpu_sup: no process killed 2012-01-24 16:59:21,953 - root - INFO - running command.raw rm -rf /var/opt/membase 2012-01-24 16:59:21,956 - root - INFO - command executed successfully 2012-01-24 16:59:21,957 - root - INFO - command executed successfully 2012-01-24 16:59:21,957 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:21,957 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:21,969 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:21,995 - root - INFO - command executed successfully 2012-01-24 16:59:21,997 - root - INFO - running command.raw hostname 2012-01-24 16:59:21,999 - paramiko.transport - INFO - Secsh channel 40 opened. 2012-01-24 16:59:22,001 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:22,002 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:22,015 - root - INFO - command executed successfully 2012-01-24 16:59:22,016 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:22,016 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:22,019 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:22,039 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:22,039 - root - INFO - command executed successfully 2012-01-24 16:59:22,042 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:22,065 - root - INFO - command executed successfully 2012-01-24 16:59:22,066 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,066 - root - INFO - command executed successfully 2012-01-24 16:59:22,067 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:22,072 - root - INFO - command executed successfully 2012-01-24 16:59:22,074 - root - INFO - running command.raw rm -rf /opt/membase 2012-01-24 16:59:22,077 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:22,081 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:22,095 - root - INFO - command executed successfully 2012-01-24 16:59:22,096 - root - ERROR - beam: no process killed 2012-01-24 16:59:22,097 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:22,108 - root - INFO - command executed successfully 2012-01-24 16:59:22,109 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:22,112 - root - INFO - CentOS 2012-01-24 16:59:22,112 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:22,113 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:22,116 - paramiko.transport - INFO - Secsh channel 41 opened. 2012-01-24 16:59:22,139 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:22,148 - root - INFO - command executed successfully 2012-01-24 16:59:22,149 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:22,152 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:22,155 - root - INFO - command executed successfully 2012-01-24 16:59:22,158 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:22,176 - root - INFO - command executed successfully 2012-01-24 16:59:22,177 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:22,179 - root - INFO - command executed successfully 2012-01-24 16:59:22,180 - root - INFO - running command.raw rm -rf /etc/opt/membase 2012-01-24 16:59:22,189 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:22,205 - root - INFO - command executed successfully 2012-01-24 16:59:22,206 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:22,208 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,217 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:22,219 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:22,222 - root - INFO - command executed successfully 2012-01-24 16:59:22,222 - paramiko.transport - INFO - Secsh channel 42 opened. 2012-01-24 16:59:22,223 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:22,225 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:22,248 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:22,260 - root - INFO - command executed successfully 2012-01-24 16:59:22,260 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:22,265 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:22,286 - root - INFO - command executed successfully 2012-01-24 16:59:22,286 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,287 - root - INFO - command executed successfully 2012-01-24 16:59:22,289 - root - INFO - running command.raw rm -rf /var/membase/data/* 2012-01-24 16:59:22,301 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:22,321 - root - INFO - command executed successfully 2012-01-24 16:59:22,327 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:22,331 - root - INFO - command executed successfully 2012-01-24 16:59:22,332 - root - ERROR - beam: no process killed 2012-01-24 16:59:22,332 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:22,333 - paramiko.transport - INFO - Secsh channel 43 opened. 2012-01-24 16:59:22,336 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:22,347 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:22,366 - root - INFO - command executed successfully 2012-01-24 16:59:22,367 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:22,388 - root - INFO - command executed successfully 2012-01-24 16:59:22,391 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:22,395 - root - INFO - command executed successfully 2012-01-24 16:59:22,395 - root - INFO - running command.raw rm -rf /opt/membase/var/lib/membase/* 2012-01-24 16:59:22,397 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:22,406 - paramiko.transport - INFO - Secsh channel 44 opened. 2012-01-24 16:59:22,417 - root - INFO - command executed successfully 2012-01-24 16:59:22,418 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:22,419 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,430 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:22,433 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:22,460 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:22,465 - root - INFO - command executed successfully 2012-01-24 16:59:22,467 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,475 - root - INFO - command executed successfully 2012-01-24 16:59:22,476 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:22,478 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:22,496 - root - INFO - command executed successfully 2012-01-24 16:59:22,496 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:22,498 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:22,510 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:22,517 - paramiko.transport - INFO - Secsh channel 45 opened. 2012-01-24 16:59:22,526 - root - INFO - command executed successfully 2012-01-24 16:59:22,577 - root - INFO - command executed successfully 2012-01-24 16:59:22,578 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:22,580 - root - INFO - command executed successfully 2012-01-24 16:59:22,586 - root - INFO - command executed successfully 2012-01-24 16:59:22,587 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:22,601 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:22,617 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:22,626 - paramiko.transport - INFO - Secsh channel 46 opened. 2012-01-24 16:59:22,636 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:22,665 - root - INFO - command executed successfully 2012-01-24 16:59:22,666 - root - INFO - running command.raw hostname 2012-01-24 16:59:22,669 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:22,675 - paramiko.transport.sftp - INFO - [chan 46] Opened sftp connection (server version 3) 2012-01-24 16:59:22,678 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:22,708 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:22,739 - root - INFO - command executed successfully 2012-01-24 16:59:22,740 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:22,777 - root - INFO - command executed successfully 2012-01-24 16:59:22,783 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:22,786 - root - INFO - CentOS 2012-01-24 16:59:22,786 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:22,787 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:22,805 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:22,806 - paramiko.transport - INFO - Secsh channel 47 opened. 2012-01-24 16:59:22,822 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:22,846 - root - INFO - command executed successfully 2012-01-24 16:59:22,847 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:22,850 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:22,850 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:22,855 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:22,860 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:22,895 - paramiko.transport - INFO - Secsh channel 48 opened. 2012-01-24 16:59:22,896 - root - INFO - command executed successfully 2012-01-24 16:59:22,897 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:22,898 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:22,925 - root - INFO - command executed successfully 2012-01-24 16:59:22,926 - root - INFO - running command.raw hostname 2012-01-24 16:59:22,929 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:22,935 - root - INFO - command executed successfully 2012-01-24 16:59:22,935 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:22,938 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:22,939 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:22,966 - root - INFO - command executed successfully 2012-01-24 16:59:22,967 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:22,969 - paramiko.transport - INFO - Secsh channel 49 opened. 2012-01-24 16:59:23,006 - root - INFO - command executed successfully 2012-01-24 16:59:23,008 - root - INFO - command executed successfully 2012-01-24 16:59:23,009 - root - INFO - CentOS 2012-01-24 16:59:23,010 - root - ERROR - beam: no process killed 2012-01-24 16:59:23,011 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:23,012 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:23,013 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:23,017 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:23,019 - root - INFO - command executed successfully 2012-01-24 16:59:23,019 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:23,045 - root - INFO - command executed successfully 2012-01-24 16:59:23,046 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:23,048 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:23,060 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:23,086 - root - INFO - command executed successfully 2012-01-24 16:59:23,087 - paramiko.transport - INFO - Secsh channel 50 opened. 2012-01-24 16:59:23,088 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:23,090 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:23,095 - root - INFO - command executed successfully 2012-01-24 16:59:23,095 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:23,095 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:23,125 - root - INFO - command executed successfully 2012-01-24 16:59:23,125 - root - INFO - running command.raw hostname 2012-01-24 16:59:23,129 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:23,137 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:23,158 - root - INFO - command executed successfully 2012-01-24 16:59:23,158 - root - INFO - running command.raw hostname 2012-01-24 16:59:23,161 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:23,168 - paramiko.transport - INFO - Secsh channel 51 opened. 2012-01-24 16:59:23,196 - root - INFO - command executed successfully 2012-01-24 16:59:23,197 - root - INFO - command executed successfully 2012-01-24 16:59:23,196 - root - ERROR - beam: no process killed 2012-01-24 16:59:23,198 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:23,238 - root - INFO - command executed successfully 2012-01-24 16:59:23,240 - root - INFO - command executed successfully 2012-01-24 16:59:23,241 - root - INFO - CentOS 2012-01-24 16:59:23,244 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:23,244 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:23,242 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:23,246 - root - INFO - CentOS 2012-01-24 16:59:23,248 - root - INFO - running rpm -e to remove couchbase-server 2012-01-24 16:59:23,249 - root - INFO - running command.raw rpm -e couchbase-server 2012-01-24 16:59:23,282 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:23,286 - paramiko.transport - INFO - Secsh channel 52 opened. 2012-01-24 16:59:23,296 - root - INFO - command executed successfully 2012-01-24 16:59:23,296 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:23,297 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:23,338 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:23,349 - root - INFO - command executed successfully 2012-01-24 16:59:23,350 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:23,350 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:23,352 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:23,356 - root - INFO - command executed successfully 2012-01-24 16:59:23,357 - root - ERROR - error: package couchbase-server is not installed 2012-01-24 16:59:23,357 - root - INFO - running command.raw killall -9 beam 2012-01-24 16:59:23,396 - root - INFO - command executed successfully 2012-01-24 16:59:23,399 - paramiko.transport - INFO - Secsh channel 53 opened. 2012-01-24 16:59:23,427 - root - INFO - command executed successfully 2012-01-24 16:59:23,427 - root - ERROR - beam: no process killed 2012-01-24 16:59:23,428 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:23,465 - root - INFO - command executed successfully 2012-01-24 16:59:23,466 - root - ERROR - beam: no process killed 2012-01-24 16:59:23,467 - root - INFO - running command.raw killall -9 couchdb 2012-01-24 16:59:23,468 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:23,509 - paramiko.transport - INFO - Secsh channel 54 opened. 2012-01-24 16:59:23,535 - root - INFO - command executed successfully 2012-01-24 16:59:23,535 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:23,537 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:23,578 - root - INFO - command executed successfully 2012-01-24 16:59:23,579 - root - ERROR - couchdb: no process killed 2012-01-24 16:59:23,579 - root - INFO - running command.raw rm -rf /opt/couchbase 2012-01-24 16:59:23,580 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:23,619 - paramiko.transport - INFO - Secsh channel 55 opened. 2012-01-24 16:59:23,645 - root - INFO - command executed successfully thread uninstaller-thread-10.1.2.31 finished thread uninstaller-thread-10.1.2.32 finished thread uninstaller-thread-10.1.2.33 finished thread uninstaller-thread-10.1.2.34 finished thread uninstaller-thread-10.1.2.35 finished 2012-01-24 16:59:23,696 - root - INFO - command executed successfully 2012-01-24 16:59:23,797 - root - INFO - connecting to 10.1.2.30 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,797 - root - INFO - connecting to 10.1.2.31 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,798 - root - INFO - connecting to 10.1.2.32 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,800 - root - INFO - connecting to 10.1.2.33 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,805 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:23,808 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:23,808 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:23,808 - root - INFO - connecting to 10.1.2.34 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,814 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) thread installer-thread-10.1.2.30 finished 2012-01-24 16:59:23,859 - root - INFO - connecting to 10.1.2.35 with username : root password : couchbase ssh_key: 2012-01-24 16:59:23,861 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:23,892 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:23,965 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:23,991 - root - INFO - Connected 2012-01-24 16:59:23,994 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,002 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:24,004 - root - INFO - Connected 2012-01-24 16:59:24,007 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,010 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:24,012 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:24,012 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:24,015 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,027 - root - INFO - Connected 2012-01-24 16:59:24,029 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,031 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,040 - root - INFO - Connected 2012-01-24 16:59:24,041 - root - INFO - Connected 2012-01-24 16:59:24,042 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,046 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,050 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:24,055 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,067 - root - INFO - Connected 2012-01-24 16:59:24,070 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:24,071 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,077 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,108 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 16:59:24,209 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,219 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,241 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,251 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,256 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,268 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,271 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,273 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,276 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 16:59:24,296 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,297 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,301 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,302 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,316 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,319 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 16:59:24,336 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,349 - root - INFO - command executed successfully 2012-01-24 16:59:24,350 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,358 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,361 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 16:59:24,368 - root - INFO - command executed successfully 2012-01-24 16:59:24,369 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,378 - root - INFO - command executed successfully 2012-01-24 16:59:24,379 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,390 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,396 - root - INFO - command executed successfully 2012-01-24 16:59:24,396 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,409 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,420 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,425 - root - INFO - command executed successfully 2012-01-24 16:59:24,426 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,430 - root - INFO - command executed successfully 2012-01-24 16:59:24,431 - root - INFO - running command.raw sudo df -Th 2012-01-24 16:59:24,437 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,455 - root - INFO - command executed successfully 2012-01-24 16:59:24,456 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,469 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,474 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 16:59:24,475 - root - INFO - command executed successfully 2012-01-24 16:59:24,477 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,485 - root - INFO - command executed successfully 2012-01-24 16:59:24,486 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,498 - root - INFO - command executed successfully 2012-01-24 16:59:24,498 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,500 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,517 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,529 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,536 - root - INFO - command executed successfully 2012-01-24 16:59:24,536 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,539 - root - INFO - command executed successfully 2012-01-24 16:59:24,539 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 16:59:24,544 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,545 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,547 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 16:59:24,567 - root - INFO - command executed successfully 2012-01-24 16:59:24,568 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,586 - root - INFO - command executed successfully 2012-01-24 16:59:24,586 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,588 - root - INFO - command executed successfully 2012-01-24 16:59:24,588 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,592 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,606 - root - INFO - command executed successfully 2012-01-24 16:59:24,607 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,611 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,616 - root - INFO - command executed successfully 2012-01-24 16:59:24,618 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,627 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,629 - root - INFO - command executed successfully 2012-01-24 16:59:24,629 - root - INFO - running command.raw hostname 2012-01-24 16:59:24,645 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,658 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,670 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 16:59:24,678 - root - INFO - command executed successfully 2012-01-24 16:59:24,681 - root - INFO - command executed successfully 2012-01-24 16:59:24,698 - root - INFO - command executed successfully 2012-01-24 16:59:24,708 - root - INFO - command executed successfully 2012-01-24 16:59:24,729 - root - INFO - command executed successfully 2012-01-24 16:59:24,738 - root - INFO - command executed successfully 2012-01-24 16:59:59,797 - root - INFO - connecting to 10.1.2.31 with username : root password : couchbase ssh_key: 2012-01-24 16:59:59,844 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 16:59:59,955 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 16:59:59,957 - root - INFO - Connected 2012-01-24 16:59:59,960 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 16:59:59,985 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:00,187 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:00,235 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:00,274 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:00,341 - root - INFO - command executed successfully 2012-01-24 17:00:00,342 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:00,383 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:00,444 - root - INFO - command executed successfully 2012-01-24 17:00:00,444 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:00,454 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:00,539 - root - INFO - command executed successfully 2012-01-24 17:00:00,539 - root - INFO - running command.raw hostname 2012-01-24 17:00:00,552 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:00,627 - root - INFO - command executed successfully 2012-01-24 17:00:00,671 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:00,718 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:00,923 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:00,966 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:00,975 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:01,060 - root - INFO - command executed successfully 2012-01-24 17:00:01,062 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:01,104 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:01,190 - root - INFO - command executed successfully 2012-01-24 17:00:01,192 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:01,231 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:01,310 - root - INFO - command executed successfully 2012-01-24 17:00:01,310 - root - INFO - running command.raw hostname 2012-01-24 17:00:01,319 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:01,402 - root - INFO - command executed successfully 2012-01-24 17:00:01,405 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:01,446 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:01,533 - root - INFO - command executed successfully 2012-01-24 17:00:01,534 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:01,536 - root - ERROR - rm: cannot remove `cb_7948': Is a directory 2012-01-24 17:00:01,538 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:01,539 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:01,540 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:01,541 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:01,543 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:01,547 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:01,589 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:01,910 - root - INFO - command executed successfully 2012-01-24 17:00:01,910 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:01,911 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:01,953 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:02,024 - root - INFO - command executed successfully 2012-01-24 17:00:02,051 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:02,112 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:02,138 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:02,197 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:02,240 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:02,676 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:02,727 - root - INFO - connecting to 10.1.2.32 with username : root password : couchbase ssh_key: 2012-01-24 17:00:02,753 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:02,794 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:02,797 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:02,885 - root - INFO - command executed successfully 2012-01-24 17:00:02,887 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:02,927 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:03,007 - root - INFO - command executed successfully 2012-01-24 17:00:03,008 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:03,011 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:03,020 - root - INFO - Connected 2012-01-24 17:00:03,024 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 17:00:03,051 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:03,052 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:03,101 - root - INFO - command executed successfully 2012-01-24 17:00:03,109 - root - INFO - running command.raw hostname 2012-01-24 17:00:03,145 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:03,218 - root - INFO - command executed successfully 2012-01-24 17:00:03,236 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:03,238 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:03,281 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:03,332 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:03,342 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:03,388 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:03,429 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:03,476 - root - INFO - connecting to 10.1.2.30 with username : root password : couchbase ssh_key: 2012-01-24 17:00:03,495 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:03,498 - root - INFO - command executed successfully 2012-01-24 17:00:03,499 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:03,546 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:03,536 - root - INFO - connecting to 10.1.2.33 with username : root password : couchbase ssh_key: 2012-01-24 17:00:03,557 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:03,577 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:03,598 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:03,607 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:03,640 - root - INFO - connecting to 10.1.2.34 with username : root password : couchbase ssh_key: 2012-01-24 17:00:03,648 - root - INFO - command executed successfully 2012-01-24 17:00:03,659 - root - INFO - connecting to 10.1.2.35 with username : root password : couchbase ssh_key: 2012-01-24 17:00:03,662 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:03,667 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:03,672 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:03,674 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:03,675 - root - INFO - Connected 2012-01-24 17:00:03,679 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 17:00:03,701 - root - INFO - command executed successfully 2012-01-24 17:00:03,701 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:03,704 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:03,711 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:03,718 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:03,748 - root - INFO - Connected 2012-01-24 17:00:03,751 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:03,758 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 17:00:03,763 - root - INFO - command executed successfully 2012-01-24 17:00:03,765 - root - INFO - running command.raw hostname 2012-01-24 17:00:03,793 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:03,804 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:03,807 - root - INFO - command executed successfully 2012-01-24 17:00:03,808 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:03,808 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:03,809 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:03,811 - root - INFO - Connected 2012-01-24 17:00:03,817 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 17:00:03,836 - root - INFO - Connected 2012-01-24 17:00:03,839 - paramiko.transport - INFO - Secsh channel 1 opened. 2012-01-24 17:00:03,841 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:03,855 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:03,859 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:03,867 - paramiko.transport.sftp - INFO - [chan 1] Opened sftp connection (server version 3) 2012-01-24 17:00:03,874 - root - INFO - command executed successfully 2012-01-24 17:00:03,914 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:03,920 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:03,921 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:03,930 - root - INFO - command executed successfully 2012-01-24 17:00:03,930 - root - INFO - running command.raw hostname 2012-01-24 17:00:03,957 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:03,958 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:03,964 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:03,974 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:03,981 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:03,990 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:03,996 - paramiko.transport - INFO - Secsh channel 2 opened. 2012-01-24 17:00:04,024 - root - INFO - command executed successfully 2012-01-24 17:00:04,025 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:04,029 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,032 - root - INFO - command executed successfully 2012-01-24 17:00:04,032 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,036 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,046 - root - INFO - command executed successfully 2012-01-24 17:00:04,047 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,065 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:04,069 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:04,072 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:04,076 - paramiko.transport - INFO - Secsh channel 3 opened. 2012-01-24 17:00:04,087 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:04,110 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:04,137 - root - INFO - command executed successfully 2012-01-24 17:00:04,138 - root - INFO - command executed successfully 2012-01-24 17:00:04,138 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,141 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,143 - root - INFO - command executed successfully 2012-01-24 17:00:04,143 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,146 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,156 - root - INFO - command executed successfully 2012-01-24 17:00:04,157 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,177 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:04,181 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:04,186 - paramiko.transport - INFO - Secsh channel 4 opened. 2012-01-24 17:00:04,188 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:04,198 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:04,246 - root - INFO - command executed successfully 2012-01-24 17:00:04,247 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,248 - root - INFO - command executed successfully 2012-01-24 17:00:04,249 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,253 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:04,254 - root - INFO - command executed successfully 2012-01-24 17:00:04,254 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,259 - root - INFO - command executed successfully 2012-01-24 17:00:04,260 - paramiko.transport - INFO - Secsh channel 5 opened. 2012-01-24 17:00:04,260 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,268 - root - INFO - command executed successfully 2012-01-24 17:00:04,269 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,271 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:04,288 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:04,302 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:04,338 - root - INFO - command executed successfully 2012-01-24 17:00:04,339 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,342 - root - INFO - command executed successfully 2012-01-24 17:00:04,342 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,347 - root - INFO - command executed successfully 2012-01-24 17:00:04,349 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:04,353 - paramiko.transport - INFO - Secsh channel 6 opened. 2012-01-24 17:00:04,355 - root - INFO - command executed successfully 2012-01-24 17:00:04,365 - root - INFO - command executed successfully 2012-01-24 17:00:04,366 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,392 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:04,398 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:04,408 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:04,428 - root - INFO - command executed successfully 2012-01-24 17:00:04,429 - root - INFO - command executed successfully 2012-01-24 17:00:04,438 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:04,443 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:04,471 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:04,473 - paramiko.transport - INFO - Secsh channel 7 opened. 2012-01-24 17:00:04,481 - root - INFO - command executed successfully 2012-01-24 17:00:04,482 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,519 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:04,521 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:04,536 - paramiko.transport.sftp - INFO - [chan 7] Opened sftp connection (server version 3) 2012-01-24 17:00:04,587 - root - INFO - command executed successfully 2012-01-24 17:00:04,596 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:04,604 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:04,607 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:04,630 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:04,641 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:04,650 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,651 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,657 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:04,665 - paramiko.transport - INFO - Secsh channel 8 opened. 2012-01-24 17:00:04,677 - root - INFO - command executed successfully 2012-01-24 17:00:04,678 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:04,678 - root - ERROR - rm: cannot remove `cb_8058': Is a directory 2012-01-24 17:00:04,678 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:04,678 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:04,678 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:04,678 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:04,678 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:04,679 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:04,685 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,688 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:04,692 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:04,705 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:04,708 - paramiko.transport - INFO - Secsh channel 9 opened. 2012-01-24 17:00:04,716 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:04,736 - root - INFO - command executed successfully 2012-01-24 17:00:04,736 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,755 - root - INFO - command executed successfully 2012-01-24 17:00:04,757 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,766 - root - INFO - command executed successfully 2012-01-24 17:00:04,766 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,769 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:04,777 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:04,785 - root - INFO - command executed successfully 2012-01-24 17:00:04,787 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:04,797 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:04,828 - paramiko.transport - INFO - Secsh channel 10 opened. 2012-01-24 17:00:04,836 - root - INFO - command executed successfully 2012-01-24 17:00:04,836 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,845 - root - INFO - command executed successfully 2012-01-24 17:00:04,845 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,848 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:04,868 - root - INFO - command executed successfully 2012-01-24 17:00:04,869 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,877 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:04,895 - root - INFO - command executed successfully 2012-01-24 17:00:04,897 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:04,911 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:04,925 - root - INFO - command executed successfully 2012-01-24 17:00:04,926 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,928 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:04,936 - root - INFO - command executed successfully 2012-01-24 17:00:04,937 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,940 - paramiko.transport - INFO - Secsh channel 11 opened. 2012-01-24 17:00:04,980 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:04,982 - root - INFO - command executed successfully 2012-01-24 17:00:04,982 - root - INFO - running command.raw hostname 2012-01-24 17:00:04,996 - root - INFO - command executed successfully 2012-01-24 17:00:04,997 - root - INFO - running command.raw hostname 2012-01-24 17:00:05,006 - root - INFO - command executed successfully 2012-01-24 17:00:05,009 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:05,022 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:05,039 - paramiko.transport - INFO - Secsh channel 12 opened. 2012-01-24 17:00:05,046 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:05,048 - root - INFO - command executed successfully 2012-01-24 17:00:05,051 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:05,060 - root - INFO - command executed successfully 2012-01-24 17:00:05,060 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:05,060 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:05,085 - root - INFO - command executed successfully 2012-01-24 17:00:05,087 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:05,091 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:05,100 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:05,105 - root - INFO - command executed successfully 2012-01-24 17:00:05,108 - root - INFO - running command.raw cd /tmp ; D=$(mktemp -d cb_XXXX) ; mv couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm $D ; mv core.* $D ; rm -f * ; mv $D/* . ; rmdir $D 2012-01-24 17:00:05,120 - root - INFO - command executed successfully 2012-01-24 17:00:05,120 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:05,121 - root - ERROR - rm: cannot remove `cb_7110': Is a directory 2012-01-24 17:00:05,122 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:05,122 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:05,124 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:05,124 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:05,124 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:05,124 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:05,129 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:05,148 - paramiko.transport - INFO - Secsh channel 13 opened. 2012-01-24 17:00:05,157 - root - INFO - command executed successfully 2012-01-24 17:00:05,158 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:05,159 - root - ERROR - rm: cannot remove `cb_6862': Is a directory 2012-01-24 17:00:05,160 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:05,160 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:05,161 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:05,162 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:05,162 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:05,163 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:05,163 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:05,165 - root - INFO - command executed successfully 2012-01-24 17:00:05,167 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:05,196 - root - INFO - command executed successfully 2012-01-24 17:00:05,196 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:05,198 - root - ERROR - rm: cannot remove `cb_7960': Is a directory 2012-01-24 17:00:05,198 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:05,199 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:05,199 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:05,200 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:05,200 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:05,200 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:05,201 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:05,206 - root - INFO - command executed successfully 2012-01-24 17:00:05,206 - root - ERROR - mv: cannot stat `core.*': No such file or directory 2012-01-24 17:00:05,206 - root - ERROR - rm: cannot remove `cb_6934': Is a directory 2012-01-24 17:00:05,207 - root - ERROR - rm: cannot remove `gconfd-couchbase': Is a directory 2012-01-24 17:00:05,207 - root - ERROR - rm: cannot remove `gconfd-root': Is a directory 2012-01-24 17:00:05,208 - root - ERROR - rm: cannot remove `rubygems-1.8.10': Is a directory 2012-01-24 17:00:05,208 - root - ERROR - rm: cannot remove `vmware-root': Is a directory 2012-01-24 17:00:05,208 - root - INFO - get md5 sum for local and remote 2012-01-24 17:00:05,210 - root - INFO - running command.raw cd /tmp ; rm -f *.md5 *.md5l ; wget -q http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 ; md5sum couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm > couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l 2012-01-24 17:00:05,228 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:05,235 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:05,239 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:05,251 - paramiko.transport - INFO - Secsh channel 14 opened. 2012-01-24 17:00:05,278 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:05,324 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:05,441 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:05,478 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:05,498 - root - INFO - command executed successfully 2012-01-24 17:00:05,499 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:05,500 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:05,521 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:05,540 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:05,542 - root - INFO - command executed successfully 2012-01-24 17:00:05,543 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:05,543 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:05,584 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:05,585 - root - INFO - command executed successfully 2012-01-24 17:00:05,586 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:05,586 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:05,590 - root - INFO - command executed successfully 2012-01-24 17:00:05,591 - root - INFO - command executed successfully 2012-01-24 17:00:05,592 - root - INFO - comparing md5 sum and downloading if needed 2012-01-24 17:00:05,594 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:05,594 - root - INFO - running command.raw cd /tmp;diff couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5 couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm.md5l || wget -q -O couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm http://builds.hq.northscale.net/latestbuilds/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm;rm -f *.md5 *.md5l 2012-01-24 17:00:05,605 - root - INFO - command executed successfully 2012-01-24 17:00:05,627 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:05,633 - paramiko.transport - INFO - Secsh channel 15 opened. 2012-01-24 17:00:05,634 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:05,648 - root - INFO - command executed successfully 2012-01-24 17:00:05,650 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:05,690 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:05,694 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:05,696 - root - INFO - command executed successfully 2012-01-24 17:00:05,699 - root - INFO - command executed successfully 2012-01-24 17:00:05,703 - root - INFO - command executed successfully 2012-01-24 17:00:05,705 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:05,710 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:05,714 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:05,735 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:05,735 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:05,740 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:05,742 - paramiko.transport - INFO - Secsh channel 16 opened. 2012-01-24 17:00:05,745 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:05,752 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:05,756 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:05,780 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:05,785 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:05,799 - paramiko.transport.sftp - INFO - [chan 16] Opened sftp connection (server version 3) 2012-01-24 17:00:05,807 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:05,810 - root - INFO - command executed successfully 2012-01-24 17:00:05,810 - root - INFO - running command.raw hostname 2012-01-24 17:00:05,825 - paramiko.transport.sftp - INFO - [chan 16] sftp session closed. 2012-01-24 17:00:05,827 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:05,850 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:05,868 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:05,871 - paramiko.transport - INFO - Secsh channel 17 opened. 2012-01-24 17:00:05,902 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:05,907 - root - INFO - command executed successfully 2012-01-24 17:00:05,909 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:05,913 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:05,915 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:05,920 - paramiko.transport.sftp - INFO - [chan 17] Opened sftp connection (server version 3) 2012-01-24 17:00:05,935 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:05,949 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:05,957 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:05,974 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:05,980 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:05,997 - root - INFO - command executed successfully 2012-01-24 17:00:05,997 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,023 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:06,039 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:06,050 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:06,058 - paramiko.transport - INFO - Secsh channel 18 opened. 2012-01-24 17:00:06,076 - root - INFO - command executed successfully 2012-01-24 17:00:06,076 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,086 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,096 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,101 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:06,106 - root - INFO - command executed successfully 2012-01-24 17:00:06,107 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,117 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:06,129 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:06,136 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,137 - paramiko.transport - INFO - Secsh channel 19 opened. 2012-01-24 17:00:06,147 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:06,178 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:06,188 - root - INFO - command executed successfully 2012-01-24 17:00:06,189 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,199 - root - INFO - command executed successfully 2012-01-24 17:00:06,199 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,201 - root - INFO - command executed successfully 2012-01-24 17:00:06,202 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,216 - root - INFO - command executed successfully 2012-01-24 17:00:06,216 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,231 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:06,239 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:06,243 - paramiko.transport - INFO - Secsh channel 20 opened. 2012-01-24 17:00:06,248 - root - INFO - command executed successfully 2012-01-24 17:00:06,248 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,251 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:06,261 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:06,299 - root - INFO - command executed successfully 2012-01-24 17:00:06,299 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,309 - root - INFO - command executed successfully 2012-01-24 17:00:06,309 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,312 - root - INFO - command executed successfully 2012-01-24 17:00:06,312 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,325 - root - INFO - command executed successfully 2012-01-24 17:00:06,329 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:06,329 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:06,330 - root - INFO - command executed successfully 2012-01-24 17:00:06,333 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,339 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:06,351 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:06,355 - paramiko.transport - INFO - Secsh channel 21 opened. 2012-01-24 17:00:06,369 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:06,373 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:06,409 - root - INFO - command executed successfully 2012-01-24 17:00:06,410 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:06,410 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:06,416 - root - INFO - command executed successfully 2012-01-24 17:00:06,416 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,418 - root - INFO - command executed successfully 2012-01-24 17:00:06,419 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,421 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:06,423 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:06,439 - root - INFO - command executed successfully 2012-01-24 17:00:06,440 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,452 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:06,459 - paramiko.transport - INFO - Secsh channel 22 opened. 2012-01-24 17:00:06,483 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:06,498 - root - INFO - command executed successfully 2012-01-24 17:00:06,500 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:06,501 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:06,519 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:06,531 - root - INFO - command executed successfully 2012-01-24 17:00:06,538 - root - INFO - deliverable_type : rpm 2012-01-24 17:00:06,541 - root - INFO - /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm or /tmp/couchbase-server-enterprise 2012-01-24 17:00:06,545 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:06,547 - root - INFO - command executed successfully 2012-01-24 17:00:06,550 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:06,559 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:06,572 - paramiko.transport - INFO - Secsh channel 23 opened. 2012-01-24 17:00:06,587 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:06,590 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:06,596 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,629 - paramiko.transport.sftp - INFO - [chan 23] Opened sftp connection (server version 3) 2012-01-24 17:00:06,637 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:06,648 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:06,696 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,706 - root - INFO - command executed successfully 2012-01-24 17:00:06,707 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,714 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:06,739 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:06,746 - paramiko.transport - INFO - Secsh channel 24 opened. 2012-01-24 17:00:06,750 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:06,756 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,789 - root - INFO - running command.raw sudo cat /proc/cpuinfo 2012-01-24 17:00:06,796 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:06,808 - root - INFO - command executed successfully 2012-01-24 17:00:06,808 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,818 - root - INFO - command executed successfully 2012-01-24 17:00:06,818 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,830 - paramiko.transport - INFO - Secsh channel 25 opened. 2012-01-24 17:00:06,850 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:06,859 - root - INFO - command executed successfully 2012-01-24 17:00:06,859 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,861 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:06,888 - root - INFO - command executed successfully 2012-01-24 17:00:06,889 - root - INFO - running command.raw sudo df -Th 2012-01-24 17:00:06,899 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:06,915 - root - INFO - command executed successfully 2012-01-24 17:00:06,916 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,925 - root - INFO - command executed successfully 2012-01-24 17:00:06,926 - root - INFO - running command.raw hostname 2012-01-24 17:00:06,929 - paramiko.transport - INFO - Secsh channel 26 opened. 2012-01-24 17:00:06,958 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:06,968 - root - INFO - command executed successfully 2012-01-24 17:00:06,968 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:06,971 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:06,971 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:06,997 - root - INFO - command executed successfully 2012-01-24 17:00:06,997 - root - INFO - running command.raw sudo cat /proc/meminfo 2012-01-24 17:00:07,032 - root - INFO - command executed successfully 2012-01-24 17:00:07,033 - root - INFO - running command.raw hostname 2012-01-24 17:00:07,038 - root - INFO - command executed successfully 2012-01-24 17:00:07,040 - paramiko.transport - INFO - Secsh channel 27 opened. 2012-01-24 17:00:07,041 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:07,048 - root - INFO - command executed successfully 2012-01-24 17:00:07,048 - root - INFO - running command.raw hostname 2012-01-24 17:00:07,050 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:07,074 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:07,082 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:07,109 - root - INFO - command executed successfully 2012-01-24 17:00:07,109 - root - INFO - running command.raw hostname 2012-01-24 17:00:07,125 - root - INFO - command executed successfully 2012-01-24 17:00:07,126 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:07,136 - root - INFO - command executed successfully 2012-01-24 17:00:07,138 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:07,151 - paramiko.transport - INFO - Secsh channel 28 opened. 2012-01-24 17:00:07,168 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:07,175 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:07,220 - root - INFO - command executed successfully 2012-01-24 17:00:07,221 - root - INFO - running command.raw rpm -i /tmp/couchbase-server-enterprise_x86_64_2.0.0r-553-ga97d249.rpm 2012-01-24 17:00:07,262 - paramiko.transport - INFO - Secsh channel 29 opened. 2012-01-24 17:00:11,552 - root - INFO - command executed successfully 2012-01-24 17:00:11,553 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:11,554 - root - INFO - 2012-01-24 17:00:11,554 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:11,554 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:11,555 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:11,555 - root - INFO - 2012-01-24 17:00:11,555 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:11,556 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:11,556 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:11,556 - root - INFO - 2012-01-24 17:00:11,556 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:11,557 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:11,557 - root - INFO - 2012-01-24 17:00:11,557 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:11,592 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:11,656 - root - INFO - command executed successfully 2012-01-24 17:00:11,657 - root - ERROR - 2012-01-24 17:00:11,658 - root - ERROR - =============================================== 2012-01-24 17:00:11,659 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:11,660 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:11,660 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:11,661 - root - ERROR - =============================================== 2012-01-24 17:00:11,661 - root - ERROR - 2012-01-24 17:00:11,661 - root - INFO - wait 5 seconds for membase server to start 2012-01-24 17:00:25,099 - root - INFO - command executed successfully 2012-01-24 17:00:25,100 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:25,100 - root - INFO - 2012-01-24 17:00:25,102 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:25,102 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:25,103 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:25,103 - root - INFO - 2012-01-24 17:00:25,103 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:25,104 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:25,104 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:25,104 - root - INFO - 2012-01-24 17:00:25,104 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:25,105 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:25,105 - root - INFO - 2012-01-24 17:00:25,105 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:25,143 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:25,214 - root - INFO - command executed successfully 2012-01-24 17:00:25,215 - root - ERROR - 2012-01-24 17:00:25,216 - root - ERROR - =============================================== 2012-01-24 17:00:25,217 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:25,218 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:25,218 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:25,218 - root - ERROR - =============================================== 2012-01-24 17:00:25,218 - root - ERROR - 2012-01-24 17:00:25,219 - root - INFO - wait 5 seconds for membase server to start 2012-01-24 17:00:25,367 - root - INFO - command executed successfully 2012-01-24 17:00:25,368 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:25,368 - root - INFO - 2012-01-24 17:00:25,368 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:25,369 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:25,369 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:25,369 - root - INFO - 2012-01-24 17:00:25,370 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:25,370 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:25,370 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:25,370 - root - INFO - 2012-01-24 17:00:25,371 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:25,371 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:25,371 - root - INFO - 2012-01-24 17:00:25,372 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:25,407 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:25,478 - root - INFO - command executed successfully 2012-01-24 17:00:25,479 - root - ERROR - 2012-01-24 17:00:25,480 - root - ERROR - =============================================== 2012-01-24 17:00:25,481 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:25,481 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:25,481 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:25,482 - root - ERROR - =============================================== 2012-01-24 17:00:25,482 - root - ERROR - 2012-01-24 17:00:25,482 - root - INFO - wait 5 seconds for membase server to start 2012-01-24 17:00:25,709 - root - INFO - command executed successfully 2012-01-24 17:00:25,711 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:25,712 - root - INFO - 2012-01-24 17:00:25,713 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:25,713 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:25,714 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:25,714 - root - INFO - 2012-01-24 17:00:25,715 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:25,715 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:25,715 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:25,716 - root - INFO - 2012-01-24 17:00:25,716 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:25,716 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:25,717 - root - INFO - 2012-01-24 17:00:25,717 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:25,732 - root - INFO - command executed successfully 2012-01-24 17:00:25,733 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:25,733 - root - INFO - 2012-01-24 17:00:25,733 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:25,733 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:25,734 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:25,734 - root - INFO - 2012-01-24 17:00:25,734 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:25,735 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:25,735 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:25,735 - root - INFO - 2012-01-24 17:00:25,736 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:25,737 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:25,737 - root - INFO - 2012-01-24 17:00:25,737 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:25,754 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:25,778 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:25,845 - root - INFO - command executed successfully 2012-01-24 17:00:25,846 - root - ERROR - 2012-01-24 17:00:25,847 - root - ERROR - =============================================== 2012-01-24 17:00:25,847 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:25,847 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:25,848 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:25,849 - root - ERROR - =============================================== 2012-01-24 17:00:25,850 - root - ERROR - 2012-01-24 17:00:25,850 - root - INFO - wait 5 seconds for membase server to start 2012-01-24 17:00:25,868 - root - INFO - command executed successfully 2012-01-24 17:00:25,869 - root - ERROR - 2012-01-24 17:00:25,869 - root - ERROR - =============================================== 2012-01-24 17:00:25,871 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:25,872 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:25,872 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:25,872 - root - ERROR - =============================================== 2012-01-24 17:00:25,873 - root - ERROR - 2012-01-24 17:00:25,873 - root - INFO - wait 5 seconds for membase server to start 2012-01-24 17:00:26,068 - root - INFO - command executed successfully 2012-01-24 17:00:26,069 - root - INFO - Starting couchbase-server[ OK ] 2012-01-24 17:00:26,070 - root - INFO - 2012-01-24 17:00:26,070 - root - INFO - You have successfully installed Couchbase Server. 2012-01-24 17:00:26,070 - root - INFO - Please browse to http://localhost.localdomain:8091/ to configure your server. 2012-01-24 17:00:26,071 - root - INFO - Please refer to http://couchbase.com for additional resources. 2012-01-24 17:00:26,071 - root - INFO - 2012-01-24 17:00:26,072 - root - INFO - Please note that you have to update your firewall configuration to 2012-01-24 17:00:26,072 - root - INFO - allow connections to the following ports: 11211, 11210, 4369, 2012-01-24 17:00:26,072 - root - INFO - 8091, 8092 and from 21100-to-21299. 2012-01-24 17:00:26,073 - root - INFO - 2012-01-24 17:00:26,073 - root - INFO - By using this software you agree to the End User License Agreement. 2012-01-24 17:00:26,073 - root - INFO - See /opt/couchbase/LICENSE.txt. 2012-01-24 17:00:26,074 - root - INFO - 2012-01-24 17:00:26,074 - root - INFO - running command.raw /opt/couchbase/bin/mbenable_core_dumps.sh /tmp 2012-01-24 17:00:26,109 - paramiko.transport - INFO - Secsh channel 30 opened. 2012-01-24 17:00:26,184 - root - INFO - command executed successfully 2012-01-24 17:00:26,186 - root - ERROR - 2012-01-24 17:00:26,188 - root - ERROR - =============================================== 2012-01-24 17:00:26,189 - root - ERROR - DEPRECATION NOTE: /opt/couchbase/bin/mbenable_core_dumps.sh has been 2012-01-24 17:00:26,189 - root - ERROR - renamed to /opt/couchbase/bin/cbenable_core_dumps.sh, but still running 2012-01-24 17:00:26,189 - root - ERROR - /opt/couchbase/bin/cbenable_core_dumps.sh on your behalf. 2012-01-24 17:00:26,190 - root - ERROR - =============================================== 2012-01-24 17:00:26,190 - root - ERROR - 2012-01-24 17:00:26,191 - root - INFO - wait 5 seconds for membase server to start thread installer-thread-10.1.2.31 finished thread installer-thread-10.1.2.32 finished thread installer-thread-10.1.2.33 finished thread installer-thread-10.1.2.34 finished thread installer-thread-10.1.2.35 finished 2012-01-24 17:00:31,199 - root - INFO - connecting to 10.1.2.30 with username : root password : couchbase ssh_key: 2012-01-24 17:00:31,199 - root - INFO - connecting to 10.1.2.31 with username : root password : couchbase ssh_key: 2012-01-24 17:00:31,200 - root - INFO - connecting to 10.1.2.32 with username : root password : couchbase ssh_key: 2012-01-24 17:00:31,201 - root - INFO - connecting to 10.1.2.33 with username : root password : couchbase ssh_key: thread installer-thread-10.1.2.30 finished 2012-01-24 17:00:31,208 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:31,209 - root - INFO - connecting to 10.1.2.35 with username : root password : couchbase ssh_key: 2012-01-24 17:00:31,209 - root - INFO - connecting to 10.1.2.34 with username : root password : couchbase ssh_key: 2012-01-24 17:00:31,211 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:31,215 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:31,231 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:31,343 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:31,349 - root - INFO - Connected 2012-01-24 17:00:31,350 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:31,855 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:31,856 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_4.3) 2012-01-24 17:00:32,016 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:32,023 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:32,025 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:32,028 - root - INFO - Connected 2012-01-24 17:00:32,028 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,038 - root - INFO - Connected 2012-01-24 17:00:32,038 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,045 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password 2012-01-24 17:00:32,048 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password 2012-01-24 17:00:32,051 - root - INFO - Connected 2012-01-24 17:00:32,053 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,056 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:32,056 - paramiko.transport - INFO - Authentication (password) successful! 2012-01-24 17:00:32,065 - root - INFO - Connected 2012-01-24 17:00:32,066 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,069 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password 2012-01-24 17:00:32,080 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password 2012-01-24 17:00:32,082 - root - INFO - Connected 2012-01-24 17:00:32,083 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,100 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password 2012-01-24 17:00:32,105 - root - INFO - pools/default params : memoryQuota=3082&username=Administrator&password=password thread installer-thread-10.1.2.31 finished thread installer-thread-10.1.2.32 finished thread installer-thread-10.1.2.33 finished thread installer-thread-10.1.2.34 finished thread installer-thread-10.1.2.35 finished [centos-64-view-tests] $ /bin/sh -xe /tmp/hudson9075086876376114209.sh + ./testrunner -i resources/jenkins/centos-64-6-nodes.ini -c conf/py-viewmerge.conf test_delete_10k_docs (viewtests.ViewTests) ... /home/couchbase/workspace/centos-64-view-tests/tmp-17-00-32 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_delete_10k_docs 2012-01-24 17:00:32,992 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:00:32,996 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:00:33,079 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:00:33,086 - root - INFO - existing buckets : [] 2012-01-24 17:00:33,090 - root - INFO - http://10.1.2.30:8091//pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&name=default&replicaNumber=1&saslPassword=&ramQuotaMB=1369 2012-01-24 17:00:33,095 - root - INFO - 0.00424408912659 seconds to create bucket default 2012-01-24 17:00:33,095 - root - INFO - waiting for memcached bucket : default in 10.1.2.30 to accept set ops 2012-01-24 17:00:44,266 - root - INFO - creating direct client 10.1.2.30:11210 default 2012-01-24 17:00:44,536 - root - INFO - existing buckets : [u'default'] 2012-01-24 17:00:44,537 - root - INFO - found bucket default 2012-01-24 17:00:44,537 - root - INFO - adding node 10.1.2.31:8091 to cluster 2012-01-24 17:00:44,538 - root - INFO - adding remote node : 10.1.2.31 to this cluster @ : 10.1.2.30 2012-01-24 17:00:45,636 - root - INFO - adding node 10.1.2.32:8091 to cluster 2012-01-24 17:00:45,636 - root - INFO - adding remote node : 10.1.2.32 to this cluster @ : 10.1.2.30 2012-01-24 17:00:46,317 - root - INFO - adding node 10.1.2.33:8091 to cluster 2012-01-24 17:00:46,318 - root - INFO - adding remote node : 10.1.2.33 to this cluster @ : 10.1.2.30 2012-01-24 17:00:46,938 - root - INFO - adding node 10.1.2.34:8091 to cluster 2012-01-24 17:00:46,938 - root - INFO - adding remote node : 10.1.2.34 to this cluster @ : 10.1.2.30 2012-01-24 17:00:47,940 - root - INFO - adding node 10.1.2.35:8091 to cluster 2012-01-24 17:00:47,941 - root - INFO - adding remote node : 10.1.2.35 to this cluster @ : 10.1.2.30 2012-01-24 17:00:48,943 - root - INFO - beginning rebalance in 2012-01-24 17:00:48,954 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:00:48,969 - root - INFO - rebalance operation started 2012-01-24 17:00:48,976 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:00:50,983 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:00:52,990 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:00:54,997 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:00:57,005 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:00:59,012 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:01:01,018 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:01:03,024 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:01:05,031 - root - INFO - rebalance percentage : 23.8095238095 % 2012-01-24 17:01:07,039 - root - INFO - rebalance percentage : 73.8095238095 % 2012-01-24 17:01:09,046 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:01:11,051 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:01:13,058 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:01:17,068 - root - INFO - rebalance progress took 28.0982739925 seconds 2012-01-24 17:01:17,069 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:01:27,079 - root - INFO - rebalance finished 2012-01-24 17:01:27,080 - root - INFO - description : create a view 2012-01-24 17:01:27,101 - root - ERROR - http://10.1.2.30:8091/couchBase/default/_design/dev_test_view-a06f0d8 error 404 reason: not_found {"error":"not_found","reason":"missing"} 2012-01-24 17:01:27,101 - root - INFO - dict {'_id': '_design/dev_test_view-a06f0d8', 'language': 'javascript', 'views': {'dev_test_view-a06f0d8': {'map': 'function (doc) {if(doc.name.indexOf("a06f0d8-") != -1) { emit(doc.name, doc);}}'}}} 2012-01-24 17:01:27,129 - root - INFO - /diag/eval : status : True content : [{[{ok,<0.9482.0>}, {ok,<18517.4111.0>}, {ok,<18518.4066.0>}, {ok,<18519.4052.0>}, {ok,<18520.4025.0>}, {ok,<18521.4005.0>}], []}] 2012-01-24 17:01:27,257 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:02:39,919 - root - INFO - inserted 100000 json documents 2012-01-24 17:02:40,050 - root - INFO - view returned in 0.126579046249 seconds 2012-01-24 17:02:40,051 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:02:40,053 - root - INFO - doc_names has 0 elements 2012-01-24 17:02:40,299 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:02:40,458 - root - INFO - ep_queue_size : 3426 2012-01-24 17:02:42,534 - root - INFO - ep_queue_size : 2723 2012-01-24 17:02:44,661 - root - INFO - ep_queue_size : 150 2012-01-24 17:02:46,777 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:46,778 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:02:46,914 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:46,915 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:02:47,114 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:47,115 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:02:47,252 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:47,253 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:02:47,381 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:47,382 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:02:47,496 - root - INFO - ep_queue_size : 0 2012-01-24 17:02:47,531 - root - INFO - view returned 0 items, expected to return 100000 items 2012-01-24 17:02:47,532 - root - INFO - trying again in 5 seconds 2012-01-24 17:03:06,947 - root - INFO - view returned in 14.4131810665 seconds 2012-01-24 17:03:06,947 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:03:07,212 - root - INFO - doc_names has 99437 elements 2012-01-24 17:03:07,242 - root - INFO - view returned 99437 items, expected to return 100000 items 2012-01-24 17:03:07,243 - root - INFO - trying again in 5 seconds 2012-01-24 17:03:26,421 - root - INFO - view returned in 14.1723370552 seconds 2012-01-24 17:03:26,421 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:03:26,784 - root - INFO - doc_names has 100000 elements 2012-01-24 17:03:27,080 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:03:33,903 - root - INFO - deleted 10000 json documents 2012-01-24 17:03:48,594 - root - INFO - view returned in 14.6905398369 seconds 2012-01-24 17:03:48,595 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:03:48,792 - root - INFO - doc_names has 100000 elements 2012-01-24 17:03:48,835 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:03:48,884 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:48,884 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:03:48,930 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:48,930 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:03:48,994 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:48,995 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:03:49,061 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:49,062 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:03:49,109 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:49,109 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:03:49,176 - root - INFO - ep_queue_size : 0 2012-01-24 17:03:49,192 - root - INFO - view returned 100000 items, expected to return 90000 items 2012-01-24 17:03:49,192 - root - INFO - trying again in 5 seconds 2012-01-24 17:04:06,218 - root - INFO - view returned in 12.020015955 seconds 2012-01-24 17:04:06,219 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:04:06,498 - root - INFO - doc_names has 90693 elements 2012-01-24 17:04:06,515 - root - INFO - view returned 90693 items, expected to return 90000 items 2012-01-24 17:04:06,515 - root - INFO - trying again in 5 seconds 2012-01-24 17:04:23,189 - root - INFO - view returned in 11.6687159538 seconds 2012-01-24 17:04:23,190 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:04:23,536 - root - INFO - doc_names has 90000 elements 2012-01-24 17:04:36,438 - root - INFO - view returned in 12.7080469131 seconds 2012-01-24 17:04:36,439 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:04:36,668 - root - INFO - doc_names has 90000 elements 2012-01-24 17:04:36,714 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:04:36,784 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:36,785 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:04:36,852 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:36,852 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:04:36,920 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:36,921 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:04:36,989 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:36,990 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:04:37,059 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:37,060 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:04:37,128 - root - INFO - ep_queue_size : 0 2012-01-24 17:04:37,328 - root - INFO - deleted view dev_test_view-a06f0d8 from bucket default 2012-01-24 17:04:37,329 - root - INFO - deleting existing buckets on [ip:10.1.2.30 ssh_username:root, ip:10.1.2.31 ssh_username:root, ip:10.1.2.32 ssh_username:root, ip:10.1.2.33 ssh_username:root, ip:10.1.2.34 ssh_username:root, ip:10.1.2.35 ssh_username:root] 2012-01-24 17:04:38,049 - root - INFO - deleted bucket : default from 10.1.2.30 2012-01-24 17:04:38,052 - root - INFO - waiting for bucket deletion to complete.... 2012-01-24 17:04:38,060 - root - INFO - existing buckets : [] 2012-01-24 17:04:38,104 - root - INFO - rebalancing all nodes in order to remove nodes 2012-01-24 17:04:38,105 - root - INFO - rebalance params : password=password&ejectedNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:04:38,112 - root - INFO - rebalance operation started 2012-01-24 17:04:40,124 - root - INFO - rebalance progress took 2.00981116295 seconds 2012-01-24 17:04:40,125 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:04:50,134 - root - INFO - removed all the nodes from cluster associated with ip:10.1.2.30 ssh_username:root ? True 2012-01-24 17:04:50,135 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:04:50,140 - root - INFO - waiting for ns_server @ 10.1.2.31:8091 2012-01-24 17:04:50,145 - root - INFO - waiting for ns_server @ 10.1.2.32:8091 2012-01-24 17:04:50,149 - root - INFO - waiting for ns_server @ 10.1.2.33:8091 2012-01-24 17:04:50,154 - root - INFO - waiting for ns_server @ 10.1.2.34:8091 2012-01-24 17:04:50,158 - root - INFO - waiting for ns_server @ 10.1.2.35:8091 ok ---------------------------------------------------------------------- Ran 1 test in 257.182s OK test_readd_10k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 1 , fail 0 logs and results are available under tmp-17-00-32 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_readd_10k_docs 2012-01-24 17:04:50,177 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:04:50,181 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:04:50,257 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:04:50,266 - root - INFO - existing buckets : [] 2012-01-24 17:04:50,272 - root - INFO - http://10.1.2.30:8091//pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&name=default&replicaNumber=1&saslPassword=&ramQuotaMB=1369 2012-01-24 17:04:50,280 - root - INFO - 0.00768113136292 seconds to create bucket default 2012-01-24 17:04:50,280 - root - INFO - waiting for memcached bucket : default in 10.1.2.30 to accept set ops 2012-01-24 17:05:01,521 - root - INFO - creating direct client 10.1.2.30:11210 default 2012-01-24 17:05:01,787 - root - INFO - existing buckets : [u'default'] 2012-01-24 17:05:01,788 - root - INFO - found bucket default 2012-01-24 17:05:01,788 - root - INFO - adding node 10.1.2.31:8091 to cluster 2012-01-24 17:05:01,789 - root - INFO - adding remote node : 10.1.2.31 to this cluster @ : 10.1.2.30 2012-01-24 17:05:02,824 - root - INFO - adding node 10.1.2.32:8091 to cluster 2012-01-24 17:05:02,825 - root - INFO - adding remote node : 10.1.2.32 to this cluster @ : 10.1.2.30 2012-01-24 17:05:03,761 - root - INFO - adding node 10.1.2.33:8091 to cluster 2012-01-24 17:05:03,762 - root - INFO - adding remote node : 10.1.2.33 to this cluster @ : 10.1.2.30 2012-01-24 17:05:04,778 - root - INFO - adding node 10.1.2.34:8091 to cluster 2012-01-24 17:05:04,779 - root - INFO - adding remote node : 10.1.2.34 to this cluster @ : 10.1.2.30 2012-01-24 17:05:05,807 - root - INFO - adding node 10.1.2.35:8091 to cluster 2012-01-24 17:05:05,808 - root - INFO - adding remote node : 10.1.2.35 to this cluster @ : 10.1.2.30 2012-01-24 17:05:06,761 - root - INFO - beginning rebalance in 2012-01-24 17:05:06,770 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:05:06,776 - root - INFO - rebalance operation started 2012-01-24 17:05:06,780 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:08,787 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:10,794 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:12,800 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:14,808 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:16,814 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:18,823 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:20,833 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:05:22,840 - root - INFO - rebalance percentage : 21.4285714286 % 2012-01-24 17:05:24,847 - root - INFO - rebalance percentage : 69.0476190476 % 2012-01-24 17:05:26,854 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:05:28,861 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:05:30,868 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:05:34,891 - root - INFO - rebalance progress took 28.1144349575 seconds 2012-01-24 17:05:34,892 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:05:44,892 - root - INFO - rebalance finished 2012-01-24 17:05:44,893 - root - INFO - description : create a view 2012-01-24 17:05:44,899 - root - ERROR - http://10.1.2.30:8091/couchBase/default/_design/dev_test_view-4b63e24 error 404 reason: not_found {"error":"not_found","reason":"missing"} 2012-01-24 17:05:44,899 - root - INFO - dict {'_id': '_design/dev_test_view-4b63e24', 'language': 'javascript', 'views': {'dev_test_view-4b63e24': {'map': 'function (doc) {if(doc.name.indexOf("4b63e24-") != -1) { emit(doc.name, doc);}}'}}} 2012-01-24 17:05:44,917 - root - INFO - /diag/eval : status : True content : [{[{ok,<0.22539.0>}, {ok,<18517.11945.0>}, {ok,<18518.11936.0>}, {ok,<18519.11864.0>}, {ok,<18520.11813.0>}, {ok,<18521.11766.0>}], []}] 2012-01-24 17:05:45,049 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:07:01,481 - root - INFO - inserted 100000 json documents 2012-01-24 17:07:02,710 - root - INFO - view returned in 1.22822785378 seconds 2012-01-24 17:07:02,711 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:07:02,712 - root - INFO - doc_names has 0 elements 2012-01-24 17:07:02,888 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:07:03,027 - root - INFO - ep_queue_size : 1103 2012-01-24 17:07:05,106 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,106 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:07:05,186 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,187 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:07:05,278 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,279 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:07:05,353 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,354 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:07:05,451 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,452 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:07:05,536 - root - INFO - ep_queue_size : 0 2012-01-24 17:07:05,570 - root - INFO - view returned 0 items, expected to return 100000 items 2012-01-24 17:07:05,571 - root - INFO - trying again in 5 seconds 2012-01-24 17:07:24,194 - root - INFO - view returned in 13.6199018955 seconds 2012-01-24 17:07:24,195 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:07:24,397 - root - INFO - doc_names has 96363 elements 2012-01-24 17:07:24,420 - root - INFO - view returned 96363 items, expected to return 100000 items 2012-01-24 17:07:24,420 - root - INFO - trying again in 5 seconds 2012-01-24 17:07:43,515 - root - INFO - view returned in 14.0940258503 seconds 2012-01-24 17:07:43,516 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:07:43,916 - root - INFO - doc_names has 99788 elements 2012-01-24 17:07:43,950 - root - INFO - view returned 99788 items, expected to return 100000 items 2012-01-24 17:07:43,950 - root - INFO - trying again in 5 seconds 2012-01-24 17:08:02,551 - root - INFO - view returned in 13.5965452194 seconds 2012-01-24 17:08:02,551 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:08:02,853 - root - INFO - doc_names has 100000 elements 2012-01-24 17:08:03,157 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:08:10,585 - root - INFO - deleted 10000 json documents 2012-01-24 17:08:25,625 - root - INFO - view returned in 15.0387299061 seconds 2012-01-24 17:08:25,625 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:08:25,812 - root - INFO - doc_names has 100000 elements 2012-01-24 17:08:25,855 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:08:25,923 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:25,923 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:08:25,992 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:25,993 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:08:26,041 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:26,041 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:08:26,089 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:26,090 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:08:26,137 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:26,138 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:08:26,204 - root - INFO - ep_queue_size : 0 2012-01-24 17:08:26,220 - root - INFO - view returned 100000 items, expected to return 90000 items 2012-01-24 17:08:26,220 - root - INFO - trying again in 5 seconds 2012-01-24 17:08:44,026 - root - INFO - view returned in 12.8038439751 seconds 2012-01-24 17:08:44,027 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:08:44,409 - root - INFO - doc_names has 92089 elements 2012-01-24 17:08:44,432 - root - INFO - view returned 92089 items, expected to return 90000 items 2012-01-24 17:08:44,433 - root - INFO - trying again in 5 seconds 2012-01-24 17:09:02,357 - root - INFO - view returned in 12.9223849773 seconds 2012-01-24 17:09:02,358 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:09:02,650 - root - INFO - doc_names has 90000 elements 2012-01-24 17:09:14,947 - root - INFO - view returned in 12.1298189163 seconds 2012-01-24 17:09:14,947 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:09:15,114 - root - INFO - doc_names has 90000 elements 2012-01-24 17:09:15,159 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:09:15,223 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,224 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:09:15,288 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,288 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:09:15,357 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,358 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:09:15,425 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,426 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:09:15,492 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,493 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:09:15,558 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:15,885 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:09:23,974 - root - INFO - updated 10000 json documents 2012-01-24 17:09:38,950 - root - INFO - view returned in 14.974834919 seconds 2012-01-24 17:09:38,950 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:09:39,117 - root - INFO - doc_names has 90000 elements 2012-01-24 17:09:39,161 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:09:39,207 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,207 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:09:39,273 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,274 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:09:39,343 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,344 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:09:39,415 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,416 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:09:39,482 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,483 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:09:39,547 - root - INFO - ep_queue_size : 0 2012-01-24 17:09:39,577 - root - INFO - view returned 90000 items, expected to return 100000 items 2012-01-24 17:09:39,578 - root - INFO - trying again in 5 seconds 2012-01-24 17:09:57,857 - root - INFO - view returned in 13.2759771347 seconds 2012-01-24 17:09:57,857 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:09:58,139 - root - INFO - doc_names has 96775 elements 2012-01-24 17:09:58,163 - root - INFO - view returned 96775 items, expected to return 100000 items 2012-01-24 17:09:58,163 - root - INFO - trying again in 5 seconds 2012-01-24 17:10:17,037 - root - INFO - view returned in 13.8714809418 seconds 2012-01-24 17:10:17,038 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:10:17,357 - root - INFO - doc_names has 100000 elements 2012-01-24 17:10:31,080 - root - INFO - view returned in 13.4937319756 seconds 2012-01-24 17:10:31,080 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:10:31,256 - root - INFO - doc_names has 100000 elements 2012-01-24 17:10:31,300 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:10:31,351 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,352 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:10:31,418 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,419 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:10:31,464 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,464 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:10:31,533 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,533 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:10:31,595 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,596 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:10:31,642 - root - INFO - ep_queue_size : 0 2012-01-24 17:10:31,849 - root - INFO - deleted view dev_test_view-4b63e24 from bucket default 2012-01-24 17:10:31,851 - root - INFO - deleting existing buckets on [ip:10.1.2.30 ssh_username:root, ip:10.1.2.31 ssh_username:root, ip:10.1.2.32 ssh_username:root, ip:10.1.2.33 ssh_username:root, ip:10.1.2.34 ssh_username:root, ip:10.1.2.35 ssh_username:root] 2012-01-24 17:10:32,946 - root - INFO - deleted bucket : default from 10.1.2.30 2012-01-24 17:10:32,947 - root - INFO - waiting for bucket deletion to complete.... 2012-01-24 17:10:32,955 - root - INFO - existing buckets : [] 2012-01-24 17:10:32,998 - root - INFO - rebalancing all nodes in order to remove nodes 2012-01-24 17:10:32,998 - root - INFO - rebalance params : password=password&ejectedNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:10:33,003 - root - INFO - rebalance operation started 2012-01-24 17:10:35,016 - root - INFO - rebalance progress took 2.01193499565 seconds 2012-01-24 17:10:35,016 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:10:45,024 - root - INFO - removed all the nodes from cluster associated with ip:10.1.2.30 ssh_username:root ? True 2012-01-24 17:10:45,025 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:10:45,031 - root - INFO - waiting for ns_server @ 10.1.2.31:8091 2012-01-24 17:10:45,035 - root - INFO - waiting for ns_server @ 10.1.2.32:8091 2012-01-24 17:10:45,039 - root - INFO - waiting for ns_server @ 10.1.2.33:8091 2012-01-24 17:10:45,043 - root - INFO - waiting for ns_server @ 10.1.2.34:8091 2012-01-24 17:10:45,048 - root - INFO - waiting for ns_server @ 10.1.2.35:8091 ok ---------------------------------------------------------------------- Ran 1 test in 354.882s OK test_update_10k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 2 , fail 0 logs and results are available under tmp-17-00-32 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_update_10k_docs 2012-01-24 17:10:45,069 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:10:45,074 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:10:45,157 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:10:45,167 - root - INFO - existing buckets : [] 2012-01-24 17:10:45,173 - root - INFO - http://10.1.2.30:8091//pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&name=default&replicaNumber=1&saslPassword=&ramQuotaMB=1369 2012-01-24 17:10:45,179 - root - INFO - 0.0063898563385 seconds to create bucket default 2012-01-24 17:10:45,180 - root - INFO - waiting for memcached bucket : default in 10.1.2.30 to accept set ops 2012-01-24 17:10:56,437 - root - INFO - creating direct client 10.1.2.30:11210 default 2012-01-24 17:10:56,779 - root - INFO - existing buckets : [u'default'] 2012-01-24 17:10:56,780 - root - INFO - found bucket default 2012-01-24 17:10:56,781 - root - INFO - adding node 10.1.2.31:8091 to cluster 2012-01-24 17:10:56,781 - root - INFO - adding remote node : 10.1.2.31 to this cluster @ : 10.1.2.30 2012-01-24 17:10:57,760 - root - INFO - adding node 10.1.2.32:8091 to cluster 2012-01-24 17:10:57,760 - root - INFO - adding remote node : 10.1.2.32 to this cluster @ : 10.1.2.30 2012-01-24 17:10:58,789 - root - INFO - adding node 10.1.2.33:8091 to cluster 2012-01-24 17:10:58,789 - root - INFO - adding remote node : 10.1.2.33 to this cluster @ : 10.1.2.30 2012-01-24 17:10:59,802 - root - INFO - adding node 10.1.2.34:8091 to cluster 2012-01-24 17:10:59,803 - root - INFO - adding remote node : 10.1.2.34 to this cluster @ : 10.1.2.30 2012-01-24 17:11:00,798 - root - INFO - adding node 10.1.2.35:8091 to cluster 2012-01-24 17:11:00,798 - root - INFO - adding remote node : 10.1.2.35 to this cluster @ : 10.1.2.30 2012-01-24 17:11:01,758 - root - INFO - beginning rebalance in 2012-01-24 17:11:01,769 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:11:01,776 - root - INFO - rebalance operation started 2012-01-24 17:11:01,781 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:03,788 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:05,795 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:07,802 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:09,807 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:11,814 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:13,820 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:15,827 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:11:17,833 - root - INFO - rebalance percentage : 21.4285714286 % 2012-01-24 17:11:19,840 - root - INFO - rebalance percentage : 69.0476190476 % 2012-01-24 17:11:21,846 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:11:23,859 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:11:25,866 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:11:29,885 - root - INFO - rebalance progress took 28.1091270447 seconds 2012-01-24 17:11:29,886 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:11:39,895 - root - INFO - rebalance finished 2012-01-24 17:11:39,895 - root - INFO - description : create a view 2012-01-24 17:11:39,902 - root - ERROR - http://10.1.2.30:8091/couchBase/default/_design/dev_test_view-2207c88 error 404 reason: not_found {"error":"not_found","reason":"missing"} 2012-01-24 17:11:39,902 - root - INFO - dict {'_id': '_design/dev_test_view-2207c88', 'language': 'javascript', 'views': {'dev_test_view-2207c88': {'map': 'function (doc) {if(doc.name.indexOf("2207c88-") != -1) { emit(doc.name, doc);}}'}}} 2012-01-24 17:11:39,922 - root - INFO - /diag/eval : status : True content : [{[{ok,<0.4119.1>}, {ok,<18517.20821.0>}, {ok,<18518.20766.0>}, {ok,<18519.20607.0>}, {ok,<18520.20681.0>}, {ok,<18521.20539.0>}], []}] 2012-01-24 17:11:40,076 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:12:55,838 - root - INFO - inserted 100000 json documents 2012-01-24 17:12:57,392 - root - INFO - view returned in 1.55282092094 seconds 2012-01-24 17:12:57,393 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:12:57,393 - root - INFO - doc_names has 0 elements 2012-01-24 17:12:58,419 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:12:58,540 - root - INFO - ep_queue_size : 3139 2012-01-24 17:13:00,610 - root - INFO - ep_queue_size : 20 2012-01-24 17:13:02,727 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:02,728 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:13:02,835 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:02,836 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:13:02,930 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:02,931 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:13:03,049 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:03,049 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:13:03,154 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:03,155 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:13:03,249 - root - INFO - ep_queue_size : 0 2012-01-24 17:13:03,281 - root - INFO - view returned 0 items, expected to return 100000 items 2012-01-24 17:13:03,282 - root - INFO - trying again in 5 seconds 2012-01-24 17:13:22,289 - root - INFO - view returned in 14.0014309883 seconds 2012-01-24 17:13:22,290 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:13:22,561 - root - INFO - doc_names has 99414 elements 2012-01-24 17:13:22,593 - root - INFO - view returned 99414 items, expected to return 100000 items 2012-01-24 17:13:22,593 - root - INFO - trying again in 5 seconds 2012-01-24 17:13:42,161 - root - INFO - view returned in 14.5633440018 seconds 2012-01-24 17:13:42,162 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:13:42,460 - root - INFO - doc_names has 100000 elements 2012-01-24 17:13:42,630 - root - INFO - loaded 100000 docs 2012-01-24 17:13:42,755 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:13:50,961 - root - INFO - updated 10000 json documents 2012-01-24 17:14:06,983 - root - INFO - view returned in 16.0213749409 seconds 2012-01-24 17:14:06,983 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:14:07,237 - root - INFO - doc_names has 100000 elements 2012-01-24 17:14:07,278 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:14:07,349 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,349 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:14:07,418 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,419 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:14:07,484 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,485 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:14:07,552 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,553 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:14:07,620 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,620 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:14:07,686 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:07,717 - root - INFO - view returned 100000 items, expected to return 100000 items 2012-01-24 17:14:07,718 - root - INFO - trying again in 5 seconds 2012-01-24 17:14:26,457 - root - INFO - view returned in 13.7340118885 seconds 2012-01-24 17:14:26,458 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:14:26,763 - root - INFO - doc_names has 100000 elements 2012-01-24 17:14:26,802 - root - INFO - view returned 100000 items, expected to return 100000 items 2012-01-24 17:14:26,803 - root - INFO - trying again in 5 seconds 2012-01-24 17:14:45,139 - root - INFO - view returned in 13.3336210251 seconds 2012-01-24 17:14:45,140 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:14:45,512 - root - INFO - doc_names has 100000 elements 2012-01-24 17:14:45,734 - root - INFO - updated 10000 docs out of 100000 docs 2012-01-24 17:14:59,178 - root - INFO - view returned in 13.4429979324 seconds 2012-01-24 17:14:59,179 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:14:59,367 - root - INFO - doc_names has 100000 elements 2012-01-24 17:14:59,409 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:14:59,475 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:59,475 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:14:59,521 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:59,521 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:14:59,586 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:59,587 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:14:59,651 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:59,651 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:14:59,697 - root - INFO - ep_queue_size : 0 2012-01-24 17:14:59,697 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:14:59,758 - root - INFO - ep_queue_size : 0 2012-01-24 17:15:00,008 - root - INFO - deleted view dev_test_view-2207c88 from bucket default 2012-01-24 17:15:00,009 - root - INFO - deleting existing buckets on [ip:10.1.2.30 ssh_username:root, ip:10.1.2.31 ssh_username:root, ip:10.1.2.32 ssh_username:root, ip:10.1.2.33 ssh_username:root, ip:10.1.2.34 ssh_username:root, ip:10.1.2.35 ssh_username:root] 2012-01-24 17:15:01,071 - root - INFO - deleted bucket : default from 10.1.2.30 2012-01-24 17:15:01,071 - root - INFO - waiting for bucket deletion to complete.... 2012-01-24 17:15:01,078 - root - INFO - existing buckets : [] 2012-01-24 17:15:01,119 - root - INFO - rebalancing all nodes in order to remove nodes 2012-01-24 17:15:01,120 - root - INFO - rebalance params : password=password&ejectedNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:15:01,125 - root - INFO - rebalance operation started 2012-01-24 17:15:05,141 - root - INFO - rebalance progress took 4.01518416405 seconds 2012-01-24 17:15:05,141 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:15:15,152 - root - INFO - removed all the nodes from cluster associated with ip:10.1.2.30 ssh_username:root ? True 2012-01-24 17:15:15,153 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:15:15,158 - root - INFO - waiting for ns_server @ 10.1.2.31:8091 2012-01-24 17:15:15,163 - root - INFO - waiting for ns_server @ 10.1.2.32:8091 2012-01-24 17:15:15,167 - root - INFO - waiting for ns_server @ 10.1.2.33:8091 2012-01-24 17:15:15,172 - root - INFO - waiting for ns_server @ 10.1.2.34:8091 2012-01-24 17:15:15,176 - root - INFO - waiting for ns_server @ 10.1.2.35:8091 ok ---------------------------------------------------------------------- Ran 1 test in 270.119s OK test_delete_10k_docs_rebalance_in (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 3 , fail 0 logs and results are available under tmp-17-00-32 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_delete_10k_docs_rebalance_in 2012-01-24 17:15:15,195 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:15:15,199 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:15:15,278 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:15:15,288 - root - INFO - existing buckets : [] 2012-01-24 17:15:15,294 - root - INFO - http://10.1.2.30:8091//pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&name=default&replicaNumber=1&saslPassword=&ramQuotaMB=1369 2012-01-24 17:15:15,300 - root - INFO - 0.00654006004333 seconds to create bucket default 2012-01-24 17:15:15,301 - root - INFO - waiting for memcached bucket : default in 10.1.2.30 to accept set ops 2012-01-24 17:15:26,540 - root - INFO - creating direct client 10.1.2.30:11210 default 2012-01-24 17:15:26,808 - root - INFO - existing buckets : [u'default'] 2012-01-24 17:15:26,808 - root - INFO - found bucket default 2012-01-24 17:15:26,814 - root - INFO - removing node 10.1.2.31:8091 from cluster 2012-01-24 17:15:26,814 - root - INFO - removing node 10.1.2.32:8091 from cluster 2012-01-24 17:15:26,815 - root - INFO - removing node 10.1.2.33:8091 from cluster 2012-01-24 17:15:26,815 - root - INFO - removing node 10.1.2.34:8091 from cluster 2012-01-24 17:15:26,815 - root - INFO - removing node 10.1.2.35:8091 from cluster 2012-01-24 17:15:26,816 - root - INFO - beginning rebalance out 2012-01-24 17:15:26,816 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.30 2012-01-24 17:15:26,824 - root - INFO - rebalance operation started 2012-01-24 17:15:26,837 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:15:30,845 - root - INFO - rebalance progress took 4.02066802979 seconds 2012-01-24 17:15:30,845 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:15:40,856 - root - INFO - rebalance finished 2012-01-24 17:15:40,857 - root - INFO - description : create a view 2012-01-24 17:15:40,863 - root - ERROR - http://10.1.2.30:8091/couchBase/default/_design/dev_test_view-8adc944 error 404 reason: not_found {"error":"not_found","reason":"missing"} 2012-01-24 17:15:40,864 - root - INFO - dict {'_id': '_design/dev_test_view-8adc944', 'language': 'javascript', 'views': {'dev_test_view-8adc944': {'map': 'function (doc) {if(doc.name.indexOf("8adc944-") != -1) { emit(doc.name, doc);}}'}}} 2012-01-24 17:15:40,875 - root - INFO - /diag/eval : status : True content : [{[{ok,<0.14929.1>}],[]}] 2012-01-24 17:15:41,031 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:16:38,374 - root - INFO - inserted 100000 json documents 2012-01-24 17:16:38,388 - root - INFO - view returned in 0.0140919685364 seconds 2012-01-24 17:16:38,389 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:16:38,390 - root - INFO - doc_names has 0 elements 2012-01-24 17:16:38,457 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:16:38,502 - root - INFO - ep_queue_size : 502 2012-01-24 17:16:40,557 - root - INFO - ep_queue_size : 0 2012-01-24 17:16:40,578 - root - INFO - view returned 0 items, expected to return 100000 items 2012-01-24 17:16:40,579 - root - INFO - trying again in 5 seconds 2012-01-24 17:16:47,713 - root - INFO - view returned in 2.13287496567 seconds 2012-01-24 17:16:47,714 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:16:47,777 - root - INFO - doc_names has 21712 elements 2012-01-24 17:16:47,801 - root - INFO - view returned 21712 items, expected to return 100000 items 2012-01-24 17:16:47,801 - root - INFO - trying again in 5 seconds 2012-01-24 17:16:56,351 - root - INFO - view returned in 3.54381299019 seconds 2012-01-24 17:16:56,351 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:16:56,483 - root - INFO - doc_names has 36091 elements 2012-01-24 17:16:56,508 - root - INFO - view returned 36091 items, expected to return 100000 items 2012-01-24 17:16:56,509 - root - INFO - trying again in 5 seconds 2012-01-24 17:17:06,616 - root - INFO - view returned in 5.10118293762 seconds 2012-01-24 17:17:06,618 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:17:06,813 - root - INFO - doc_names has 52011 elements 2012-01-24 17:17:06,839 - root - INFO - view returned 52011 items, expected to return 100000 items 2012-01-24 17:17:06,840 - root - INFO - trying again in 5 seconds 2012-01-24 17:17:18,457 - root - INFO - view returned in 6.61400198936 seconds 2012-01-24 17:17:18,458 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:17:18,709 - root - INFO - doc_names has 69984 elements 2012-01-24 17:17:18,739 - root - INFO - view returned 69984 items, expected to return 100000 items 2012-01-24 17:17:18,740 - root - INFO - trying again in 5 seconds 2012-01-24 17:17:32,668 - root - INFO - view returned in 8.92659807205 seconds 2012-01-24 17:17:32,669 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:17:32,981 - root - INFO - doc_names has 88468 elements 2012-01-24 17:17:33,013 - root - INFO - view returned 88468 items, expected to return 100000 items 2012-01-24 17:17:33,014 - root - INFO - trying again in 5 seconds 2012-01-24 17:17:46,050 - root - INFO - view returned in 8.03096699715 seconds 2012-01-24 17:17:46,051 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:17:46,334 - root - INFO - doc_names has 99867 elements 2012-01-24 17:17:46,359 - root - INFO - view returned 99867 items, expected to return 100000 items 2012-01-24 17:17:46,360 - root - INFO - trying again in 5 seconds 2012-01-24 17:17:59,266 - root - INFO - view returned in 7.90133213997 seconds 2012-01-24 17:17:59,266 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:17:59,559 - root - INFO - doc_names has 100000 elements 2012-01-24 17:17:59,741 - root - INFO - adding node 10.1.2.31:8091 to cluster 2012-01-24 17:17:59,743 - root - INFO - adding remote node : 10.1.2.31 to this cluster @ : 10.1.2.30 2012-01-24 17:18:00,772 - root - INFO - adding node 10.1.2.32:8091 to cluster 2012-01-24 17:18:00,772 - root - INFO - adding remote node : 10.1.2.32 to this cluster @ : 10.1.2.30 2012-01-24 17:18:01,765 - root - INFO - adding node 10.1.2.33:8091 to cluster 2012-01-24 17:18:01,765 - root - INFO - adding remote node : 10.1.2.33 to this cluster @ : 10.1.2.30 2012-01-24 17:18:02,695 - root - INFO - adding node 10.1.2.34:8091 to cluster 2012-01-24 17:18:02,696 - root - INFO - adding remote node : 10.1.2.34 to this cluster @ : 10.1.2.30 2012-01-24 17:18:03,766 - root - INFO - adding node 10.1.2.35:8091 to cluster 2012-01-24 17:18:03,767 - root - INFO - adding remote node : 10.1.2.35 to this cluster @ : 10.1.2.30 2012-01-24 17:18:04,752 - root - INFO - beginning rebalance in 2012-01-24 17:18:04,769 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:18:04,778 - root - INFO - rebalance operation started 2012-01-24 17:18:05,235 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:18:13,610 - root - INFO - deleted 10000 json documents 2012-01-24 17:18:25,303 - root - INFO - view returned in 11.6926920414 seconds 2012-01-24 17:18:25,304 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:18:25,577 - root - INFO - doc_names has 88275 elements 2012-01-24 17:18:25,649 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:18:25,686 - root - INFO - ep_queue_size : 1317 2012-01-24 17:18:27,723 - root - INFO - ep_queue_size : 3484 2012-01-24 17:18:29,768 - root - INFO - ep_queue_size : 333 2012-01-24 17:18:31,812 - root - INFO - ep_queue_size : 1722 2012-01-24 17:18:33,854 - root - INFO - ep_queue_size : 3128 2012-01-24 17:18:36,089 - root - INFO - ep_queue_size : 1401 2012-01-24 17:18:38,142 - root - INFO - ep_queue_size : 32103 2012-01-24 17:18:40,191 - root - INFO - ep_queue_size : 1915 2012-01-24 17:18:42,248 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,249 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:18:42,312 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,313 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:18:42,361 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,361 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:18:42,410 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,411 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:18:42,458 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,458 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:18:42,508 - root - INFO - ep_queue_size : 0 2012-01-24 17:18:42,528 - root - INFO - view returned 88275 items, expected to return 90000 items 2012-01-24 17:18:42,529 - root - INFO - trying again in 5 seconds 2012-01-24 17:18:51,043 - root - INFO - view returned in 3.50849413872 seconds 2012-01-24 17:18:51,044 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:18:51,277 - root - INFO - doc_names has 30158 elements 2012-01-24 17:18:51,292 - root - INFO - view returned 30158 items, expected to return 90000 items 2012-01-24 17:18:51,293 - root - INFO - trying again in 5 seconds 2012-01-24 17:19:08,182 - root - INFO - view returned in 11.884116888 seconds 2012-01-24 17:19:08,183 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:19:08,397 - root - INFO - doc_names has 90000 elements 2012-01-24 17:19:10,577 - root - INFO - rebalance progress took 2.007376194 seconds 2012-01-24 17:19:10,577 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:19:20,584 - root - INFO - rebalance finished 2012-01-24 17:19:32,156 - root - INFO - view returned in 11.5702109337 seconds 2012-01-24 17:19:32,156 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:19:32,365 - root - INFO - doc_names has 90000 elements 2012-01-24 17:19:32,425 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:19:32,508 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:32,508 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:19:32,580 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:32,581 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:19:32,648 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:32,648 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:19:32,718 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:32,718 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:19:32,801 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:32,802 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:19:32,872 - root - INFO - ep_queue_size : 0 2012-01-24 17:19:33,093 - root - INFO - deleted view dev_test_view-8adc944 from bucket default 2012-01-24 17:19:33,094 - root - INFO - deleting existing buckets on [ip:10.1.2.30 ssh_username:root, ip:10.1.2.31 ssh_username:root, ip:10.1.2.32 ssh_username:root, ip:10.1.2.33 ssh_username:root, ip:10.1.2.34 ssh_username:root, ip:10.1.2.35 ssh_username:root] 2012-01-24 17:19:34,568 - root - INFO - deleted bucket : default from 10.1.2.30 2012-01-24 17:19:34,569 - root - INFO - waiting for bucket deletion to complete.... 2012-01-24 17:19:34,574 - root - INFO - existing buckets : [] 2012-01-24 17:19:34,616 - root - INFO - rebalancing all nodes in order to remove nodes 2012-01-24 17:19:34,617 - root - INFO - rebalance params : password=password&ejectedNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:19:34,622 - root - INFO - rebalance operation started 2012-01-24 17:19:36,631 - root - INFO - rebalance progress took 2.00823807716 seconds 2012-01-24 17:19:36,632 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:19:46,640 - root - INFO - removed all the nodes from cluster associated with ip:10.1.2.30 ssh_username:root ? True 2012-01-24 17:19:46,641 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:19:46,646 - root - INFO - waiting for ns_server @ 10.1.2.31:8091 2012-01-24 17:19:46,651 - root - INFO - waiting for ns_server @ 10.1.2.32:8091 2012-01-24 17:19:46,655 - root - INFO - waiting for ns_server @ 10.1.2.33:8091 2012-01-24 17:19:46,659 - root - INFO - waiting for ns_server @ 10.1.2.34:8091 2012-01-24 17:19:46,663 - root - INFO - waiting for ns_server @ 10.1.2.35:8091 ok ---------------------------------------------------------------------- Ran 1 test in 271.480s OK test_delete_10k_docs_rebalance_out (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 4 , fail 0 logs and results are available under tmp-17-00-32 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_delete_10k_docs_rebalance_out 2012-01-24 17:19:46,683 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:19:46,687 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:19:46,766 - root - INFO - waiting for ns_server @ 10.1.2.30:8091 2012-01-24 17:19:46,775 - root - INFO - existing buckets : [] 2012-01-24 17:19:46,781 - root - INFO - http://10.1.2.30:8091//pools/default/buckets with param: proxyPort=11211&bucketType=membase&authType=sasl&name=default&replicaNumber=1&saslPassword=&ramQuotaMB=1369 2012-01-24 17:19:46,788 - root - INFO - 0.00653195381165 seconds to create bucket default 2012-01-24 17:19:46,788 - root - INFO - waiting for memcached bucket : default in 10.1.2.30 to accept set ops 2012-01-24 17:19:58,003 - root - INFO - creating direct client 10.1.2.30:11210 default 2012-01-24 17:19:58,287 - root - INFO - existing buckets : [u'default'] 2012-01-24 17:19:58,288 - root - INFO - found bucket default 2012-01-24 17:19:58,289 - root - INFO - adding node 10.1.2.31:8091 to cluster 2012-01-24 17:19:58,289 - root - INFO - adding remote node : 10.1.2.31 to this cluster @ : 10.1.2.30 2012-01-24 17:19:59,372 - root - INFO - adding node 10.1.2.32:8091 to cluster 2012-01-24 17:19:59,373 - root - INFO - adding remote node : 10.1.2.32 to this cluster @ : 10.1.2.30 2012-01-24 17:20:00,323 - root - INFO - adding node 10.1.2.33:8091 to cluster 2012-01-24 17:20:00,323 - root - INFO - adding remote node : 10.1.2.33 to this cluster @ : 10.1.2.30 2012-01-24 17:20:01,322 - root - INFO - adding node 10.1.2.34:8091 to cluster 2012-01-24 17:20:01,323 - root - INFO - adding remote node : 10.1.2.34 to this cluster @ : 10.1.2.30 2012-01-24 17:20:02,404 - root - INFO - adding node 10.1.2.35:8091 to cluster 2012-01-24 17:20:02,405 - root - INFO - adding remote node : 10.1.2.35 to this cluster @ : 10.1.2.30 2012-01-24 17:20:03,413 - root - INFO - beginning rebalance in 2012-01-24 17:20:03,429 - root - INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:20:03,438 - root - INFO - rebalance operation started 2012-01-24 17:20:03,448 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:05,454 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:07,461 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:09,467 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:11,471 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:13,476 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:15,481 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:17,487 - root - INFO - rebalance percentage : 0.0 % 2012-01-24 17:20:19,492 - root - INFO - rebalance percentage : 40.4761904762 % 2012-01-24 17:20:21,499 - root - INFO - rebalance percentage : 88.0952380952 % 2012-01-24 17:20:23,505 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:20:25,512 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:20:27,519 - root - INFO - rebalance percentage : 97.619047619 % 2012-01-24 17:20:31,532 - root - INFO - rebalance progress took 28.0928089619 seconds 2012-01-24 17:20:31,533 - root - INFO - sleep for 10 seconds after rebalance... 2012-01-24 17:20:41,540 - root - INFO - rebalance finished 2012-01-24 17:20:41,541 - root - INFO - description : create a view 2012-01-24 17:20:41,547 - root - ERROR - http://10.1.2.30:8091/couchBase/default/_design/dev_test_view-4fc0702 error 404 reason: not_found {"error":"not_found","reason":"missing"} 2012-01-24 17:20:41,548 - root - INFO - dict {'_id': '_design/dev_test_view-4fc0702', 'language': 'javascript', 'views': {'dev_test_view-4fc0702': {'map': 'function (doc) {if(doc.name.indexOf("4fc0702-") != -1) { emit(doc.name, doc);}}'}}} 2012-01-24 17:20:41,574 - root - INFO - /diag/eval : status : True content : [{[{ok,<0.4616.2>}, {ok,<18517.548.1>}, {ok,<18518.194.1>}, {ok,<18519.21.1>}, {ok,<18520.32722.0>}, {ok,<18521.32697.0>}], []}] 2012-01-24 17:20:41,737 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:21:55,309 - root - INFO - inserted 100000 json documents 2012-01-24 17:21:55,351 - root - INFO - view returned in 0.0413711071014 seconds 2012-01-24 17:21:55,352 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:21:55,352 - root - INFO - doc_names has 0 elements 2012-01-24 17:21:55,458 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.32 2012-01-24 17:21:55,805 - root - INFO - ep_queue_size : 4659 2012-01-24 17:21:57,900 - root - INFO - ep_queue_size : 594 2012-01-24 17:22:00,062 - root - INFO - ep_queue_size : 645 2012-01-24 17:22:02,183 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,184 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.33 2012-01-24 17:22:02,285 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,286 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.35 2012-01-24 17:22:02,395 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,395 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:22:02,516 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,517 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.31 2012-01-24 17:22:02,635 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,636 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.30 2012-01-24 17:22:02,719 - root - INFO - ep_queue_size : 0 2012-01-24 17:22:02,741 - root - INFO - view returned 0 items, expected to return 100000 items 2012-01-24 17:22:02,741 - root - INFO - trying again in 5 seconds 2012-01-24 17:22:21,290 - root - INFO - view returned in 13.5441808701 seconds 2012-01-24 17:22:21,291 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:22:21,476 - root - INFO - doc_names has 99618 elements 2012-01-24 17:22:21,498 - root - INFO - view returned 99618 items, expected to return 100000 items 2012-01-24 17:22:21,499 - root - INFO - trying again in 5 seconds 2012-01-24 17:22:40,053 - root - INFO - view returned in 13.5517377853 seconds 2012-01-24 17:22:40,054 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:22:40,367 - root - INFO - doc_names has 100000 elements 2012-01-24 17:22:40,560 - root - INFO - removing node 10.1.2.31:8091 from cluster 2012-01-24 17:22:40,561 - root - INFO - removing node 10.1.2.32:8091 from cluster 2012-01-24 17:22:40,561 - root - INFO - removing node 10.1.2.33:8091 from cluster 2012-01-24 17:22:40,561 - root - INFO - removing node 10.1.2.34:8091 from cluster 2012-01-24 17:22:40,562 - root - INFO - removing node 10.1.2.35:8091 from cluster 2012-01-24 17:22:40,562 - root - INFO - beginning rebalance out 2012-01-24 17:22:40,563 - root - INFO - rebalance params : password=password&ejectedNodes=ns_1%4010.1.2.31%2Cns_1%4010.1.2.32%2Cns_1%4010.1.2.33%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.35&user=Administrator&knownNodes=ns_1%4010.1.2.32%2Cns_1%4010.1.2.34%2Cns_1%4010.1.2.30%2Cns_1%4010.1.2.31%2Cns_1%4010.1.2.35%2Cns_1%4010.1.2.33 2012-01-24 17:22:40,567 - root - INFO - rebalance operation started 2012-01-24 17:22:41,132 - root - INFO - creating proxy client 10.1.2.30:11211 default 2012-01-24 17:22:54,445 - root - INFO - deleted 10000 json documents 2012-01-24 17:22:59,786 - root - INFO - view returned in 5.34084892273 seconds 2012-01-24 17:22:59,787 - root - INFO - was able to get view results after trying 1 times 2012-01-24 17:22:59,855 - root - INFO - doc_names has 25925 elements 2012-01-24 17:22:59,943 - root - INFO - waiting for bucket default stat : ep_queue_size to match 0 on 10.1.2.34 2012-01-24 17:23:00,032 - root - INFO - ep_queue_size : 73217 2012-01-24 17:23:04,045 - root - ERROR - socker error while connecting to 10.1.2.34:8091 error [Errno 111] Connection refused: 2012-01-24 17:23:05,048 - root - ERROR - socker error while connecting to 10.1.2.34:8091 error [Errno 111] Connection refused: ERROR 2012-01-24 17:23:06,098 - root - INFO - deleted view dev_test_view-4fc0702 from bucket default 2012-01-24 17:23:06,098 - root - INFO - deleting existing buckets on [ip:10.1.2.30 ssh_username:root, ip:10.1.2.31 ssh_username:root, ip:10.1.2.32 ssh_username:root, ip:10.1.2.33 ssh_username:root, ip:10.1.2.34 ssh_username:root, ip:10.1.2.35 ssh_username:root] 2012-01-24 17:23:06,821 - root - INFO - deleted bucket : default from 10.1.2.30 2012-01-24 17:23:06,821 - root - INFO - waiting for bucket deletion to complete.... 2012-01-24 17:23:06,828 - root - INFO - existing buckets : [] ERROR ====================================================================== ERROR: test_delete_10k_docs_rebalance_out (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 214, in test_delete_10k_docs_rebalance_out doc_names = self._delete_docs(num_of_docs, num_of_deleted_docs, prefix) File "pytests/viewtests.py", line 961, in _delete_docs self._verify_docs_doc_name(doc_names, prefix) File "pytests/viewtests.py", line 973, in _verify_docs_doc_name RebalanceHelper.wait_for_stats_on_all(master, bucket, 'ep_queue_size', 0) File "lib/membase/helper/rebalance_helper.py", line 160, in wait_for_stats_on_all timeout_in_seconds=timeout_in_seconds) File "lib/membase/helper/rebalance_helper.py", line 27, in wait_for_stats stats = rest.get_bucket_stats(bucket) File "lib/membase/api/rest_client.py", line 789, in get_bucket_stats status, content = self._http_request(api) File "lib/membase/api/rest_client.py", line 384, in _http_request json_parsed = json.loads(content) File "/opt/python2.7/lib/python2.7/json/__init__.py", line 326, in loads return _default_decoder.decode(s) File "/opt/python2.7/lib/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/opt/python2.7/lib/python2.7/json/decoder.py", line 384, in raw_decode raise ValueError("No JSON object could be decoded") ValueError: No JSON object could be decoded ====================================================================== ERROR: test_delete_10k_docs_rebalance_out (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 627, in tearDown BucketOperationHelper.delete_all_buckets_or_assert(self.servers, self) File "lib/membase/helper/bucket_helper.py", line 133, in delete_all_buckets_or_assert rest.delete_bucket(bucket.name) File "lib/membase/api/rest_client.py", line 824, in delete_bucket status, content = self._http_request(api, 'DELETE') File "lib/membase/api/rest_client.py", line 384, in _http_request json_parsed = json.loads(content) File "/opt/python2.7/lib/python2.7/json/__init__.py", line 326, in loads return _default_decoder.decode(s) File "/opt/python2.7/lib/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/opt/python2.7/lib/python2.7/json/decoder.py", line 384, in raw_decode raise ValueError("No JSON object could be decoded") ValueError: No JSON object could be decoded ---------------------------------------------------------------------- Ran 1 test in 200.237s FAILED (errors=2) summary so far suite viewtests.ViewTests , pass 4 , fail 1 failures so far... viewtests.ViewTests.test_delete_10k_docs_rebalance_out logs and results are available under tmp-17-00-32 + ./testrunner -i resources/jenkins/centos-64-6-nodes.ini -c conf/py-view.conf test_create_multiple_development_view (viewtests.ViewTests) ... /home/couchbase/workspace/centos-64-view-tests/tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_create_multiple_development_view 2012-01-24 17:23:07,236 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:07,241 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,143 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_create_multiple_development_view (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 35.923s FAILED (errors=1) test_view_on_100_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 1 failures so far... viewtests.ViewTests.test_create_multiple_development_view logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_view_on_100_docs 2012-01-24 17:23:43,162 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,167 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,202 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_view_on_100_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.047s FAILED (errors=1) test_view_on_10k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 2 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_view_on_10k_docs 2012-01-24 17:23:43,219 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,223 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,257 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_view_on_10k_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.045s FAILED (errors=1) test_view_on_100k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 3 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_view_on_100k_docs 2012-01-24 17:23:43,273 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,277 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,312 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_view_on_100k_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.045s FAILED (errors=1) test_count_reduce_100_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 4 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_count_reduce_100_docs 2012-01-24 17:23:43,329 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,334 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,368 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_count_reduce_100_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.045s FAILED (errors=1) test_count_reduce_10k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 5 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_count_reduce_10k_docs 2012-01-24 17:23:43,386 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,390 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,424 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_count_reduce_10k_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.046s FAILED (errors=1) test_count_reduce_100k_docs (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 6 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_count_reduce_100k_docs 2012-01-24 17:23:43,442 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,446 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,479 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_count_reduce_100k_docs (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.044s FAILED (errors=1) test_get_view_during_1_min_load_10k_working_set (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 7 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set 2012-01-24 17:23:43,497 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,501 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,536 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_get_view_during_1_min_load_10k_working_set (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.046s FAILED (errors=1) test_get_view_during_1_min_load_100k_working_set (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 8 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set 2012-01-24 17:23:43,554 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,558 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,590 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_get_view_during_1_min_load_100k_working_set (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.044s FAILED (errors=1) test_get_view_during_5_min_load_10k_working_set (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 9 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set 2012-01-24 17:23:43,608 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,612 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,645 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_get_view_during_5_min_load_10k_working_set (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.044s FAILED (errors=1) test_get_view_during_5_min_load_100k_working_set (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 10 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set 2012-01-24 17:23:43,662 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,667 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,701 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_get_view_during_5_min_load_100k_working_set (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.046s FAILED (errors=1) test_view_on_5k_docs_multiple_nodes (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 11 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes 2012-01-24 17:23:43,719 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,724 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,757 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_view_on_5k_docs_multiple_nodes (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.045s FAILED (errors=1) test_update_view_on_5k_docs_multiple_nodes (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 12 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_update_view_on_5k_docs_multiple_nodes 2012-01-24 17:23:43,776 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,780 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,813 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_update_view_on_5k_docs_multiple_nodes (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.045s FAILED (errors=1) test_view_on_10k_docs_multiple_nodes (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 13 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_update_view_on_5k_docs_multiple_nodes logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_view_on_10k_docs_multiple_nodes 2012-01-24 17:23:43,834 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,838 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,870 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_view_on_10k_docs_multiple_nodes (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.043s FAILED (errors=1) test_load_10k_during_rebalance (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 14 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_update_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_view_on_10k_docs_multiple_nodes logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_load_10k_during_rebalance 2012-01-24 17:23:43,888 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,893 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,925 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_load_10k_during_rebalance (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.044s FAILED (errors=1) test_invalid_view (viewtests.ViewTests) ... summary so far suite viewtests.ViewTests , pass 0 , fail 15 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_update_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_view_on_10k_docs_multiple_nodes viewtests.ViewTests.test_load_10k_during_rebalance logs and results are available under tmp-17-23-07 ./testrunner resources/jenkins/centos-64-6-nodes.ini -t viewtests.ViewTests.test_invalid_view 2012-01-24 17:23:43,944 - root - INFO - settings/web params : username=Administrator&password=password&port=8091 2012-01-24 17:23:43,948 - root - INFO - pools/default params : memoryQuota=2054&username=Administrator&password=password 2012-01-24 17:23:43,983 - root - ERROR - http://10.1.2.31:8091/nodes/self error 404 reason: unknown "Node is unknown to this cluster." ERROR ====================================================================== ERROR: test_invalid_view (viewtests.ViewTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/viewtests.py", line 32, in setUp ClusterOperationHelper.cleanup_cluster([server]) File "lib/membase/helper/cluster_helper.py", line 179, in cleanup_cluster master_id = rest.get_nodes_self().id AttributeError: 'NoneType' object has no attribute 'id' ---------------------------------------------------------------------- Ran 1 test in 0.046s FAILED (errors=1) summary so far suite viewtests.ViewTests , pass 0 , fail 16 failures so far... viewtests.ViewTests.test_create_multiple_development_view viewtests.ViewTests.test_view_on_100_docs viewtests.ViewTests.test_view_on_10k_docs viewtests.ViewTests.test_view_on_100k_docs viewtests.ViewTests.test_count_reduce_100_docs viewtests.ViewTests.test_count_reduce_10k_docs viewtests.ViewTests.test_count_reduce_100k_docs viewtests.ViewTests.test_get_view_during_1_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_1_min_load_100k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_10k_working_set viewtests.ViewTests.test_get_view_during_5_min_load_100k_working_set viewtests.ViewTests.test_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_update_view_on_5k_docs_multiple_nodes viewtests.ViewTests.test_view_on_10k_docs_multiple_nodes viewtests.ViewTests.test_load_10k_during_rebalance viewtests.ViewTests.test_invalid_view logs and results are available under tmp-17-23-07 Archiving artifacts Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE Email was triggered for: Unstable Sending email for trigger: Unstable Sending email to: staff_qa@couchbase.com Notifying upstream projects of job completion Finished: UNSTABLE