mixed cluster/online upgrade 1.8.1-2.0.2 Rebalance exited with reason {badarg,[{erlang,'++' [{'EXIT',{noproc,{gen_server,call, [{'janitor_agent-default','ns_1@10.3.3.93'},{get_mass_tap_docs_estimate,

1.8.1 & 2.0.2-779
http://qa.hq.northscale.net/job/centos-64-2.0-new-rebalance-mixed-cluster-P0/71/consoleFull

mixed suite/cluster:
1.8.1-937-rel
10.3.3.92
10.3.3.94
10.3.3.93

2.0.2-779-rel
10.3.3.99
10.3.3.91
10.3.3.82
10.3.3.97

all tests failed with the same reason

013-04-27 02:08:01 | WARNING | MainProcess | Cluster_Thread | [task.start_rebalance] cluster is mixed. sleep for 10 seconds before rebalance
2013-04-27 02:08:04 | INFO | MainProcess | MainThread | [rest_client.get_nodes] Node 10.3.3.82 not part of cluster inactiveAdded
2013-04-27 02:08:04 | INFO | MainProcess | MainThread | [rest_client.get_nodes] Node 10.3.3.93 not part of cluster inactiveAdded
2013-04-27 02:08:04 | INFO | MainProcess | MainThread | [rest_client.get_nodes] Node 10.3.3.99 not part of cluster inactiveAdded
2013-04-27 02:08:04 | INFO | MainProcess | MainThread | [data_helper.direct_client] creating direct client 10.3.3.92:11210 default
2013-04-27 02:08:11 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%4010.3.3.92%2Cns_1%4010.3.3.82%2Cns_1%4010.3.3.99%2Cns_1%4010.3.3.93
2013-04-27 02:08:11 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance operation started
2013-04-27 02:08:11 | INFO | MainProcess | Cluster_Thread | [rest_client._rebalance_progress] rebalance percentage : 0 %
2013-04-27 02:08:21 | ERROR | MainProcess | Cluster_Thread | [rest_client._rebalance_progress]

{u'status': u'none', u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try rebalance again.'}

- rebalance failed
2013-04-27 02:08:21 | INFO | MainProcess | Cluster_Thread | [rest_client._rebalance_progress] Latest logs from UI:
2013-04-27 02:08:21 | ERROR | MainProcess | Cluster_Thread | [rest_client._rebalance_progress] {u'node': u'ns_1@10.3.3.82', u'code': 2, u'text': u"Rebalance exited with reason {badarg,\n [{erlang,'++',\n [{'EXIT',\n {noproc,\n {gen_server,call,\n [

{'janitor_agent-default',\n 'ns_1@10.3.3.93'}

,\n

{get_mass_tap_docs_estimate,\n [86,87,88,89,90,91,92,93,94,95,96,97,98,\n 99,100,101,102,103,104,105,106,107,108,\n 109,110,111,112,113,114,115,116,117,\n 118,119,120,121,122,123,124,125,126,\n 127,128,129,130,131,132,133,134,135,\n 136,137,138,139,140,141,142,143,144,\n 145,146,147,148,149,150,151,152,153,\n 154,155,156,157,158,159,160,161,162,\n 163,164,165,166,167,168,169,170,342,\n 343,344,345,346,347,348,349,350,351,\n 352,353,354,355,356,357,358,359,360,\n 361,362,363,364,365,366,367,368,369,\n 370,371,372,373,374,375,376,377,378,\n 379,380,381,382,383,384,385,386,387,\n 388,389,390,391,392,393,394,395,396,\n 397,398,399,400,401,402,403,404,405,\n 406,407,408,409,410,411,412,413,414,\n 415,416,417,418,419,420,421,422,423,\n 424,425,426,512,513,514,515,516,517,\n 518,519,520,521,522,523,524,525,526,\n 527,528,529,530,531,532,533,534,535,\n 536,537,538,539,540,541,542,543,544,\n 545,546,547,548,549,550,551,552,553,\n 554,555,556,557,558,559,560,561,562,\n 563,564,565,566,567,568,569,570,571,\n 572,573,574,575,576,577,578,579,580,\n 581,582,583,584,585,586,587,588,589,\n 590,591,592,593,594,595,596,597,598,\n 599,600,601,602,603,604,605,606,607,\n 608,609,610,611,612,613,614,615,616,\n 617,618,619,620,621,622,623,624,625,\n 626,627,628,629,630,631,632,633,634,\n 635,636,637,638,639,640,641,642,643,\n 644,645,646,647,648,649,650,651,652,\n 653,654,655,656,657,658,659,660,661,\n 662,663,664,665,666,667,668,669,670,\n 671,672,673,674,675,676,677,678,679,\n 680,681,682,683,684,685,686,687,688,\n 689,690,691,692,693,694,695,696,697,\n 698,699,700,701,702,703,704,705,706,\n 707,708,709,710,711,712,713,714,715,\n 716,717,718,719,720,721,722,723,724,\n 725,726,727,728,729,730,731,732,733,\n 734,735,736,737,738,739,740,741,742,\n 743,744,745,746,747,748,749,750,751,\n 752,753,754,755,756,757,758,759,760,\n 761,762,763,764,765,766,767,938,939,\n 940,941,942,943,944,945,946,947,948,\n 949,950,951,952,953,954,955,956,957,\n 958,959,960,961,962,963,964,965,966,\n 967,968,969,970,971,972,973,974,975,\n 976,977,978,979,980,981,982,983,984,\n 985,986,987,988,989,990,991,992,993,\n 994,995,996,997,998,999,1000,1001,1002,\n 1003,1004,1005,1006,1007,1008,1009,\n 1010,1011,1012,1013,1014,1015,1016,\n 1017,1018,1019,1020,1021,1022,1023]}

,\n infinity]}}},\n ............