occasional evperf test query thread crash on startup

After uploading the design document(s) to the server, evperf tests spawn threads to query the views in those design documents. However, the server (ns_server) configures and replicates the design documents asynchronously, which means that after the client gets an OK response for the design document creation, there's a short period of time where it's not yet possible to query views from the design document. In this short period, queries return "view_undefined" error. The solution here is to retry until that error is not returned anymore, instead of crashing. See below.

2012-10-15 13:29:03,820 - root - INFO - ep_flusher_todo : 0
[perf.drain] disk write queue has been drained: Oct-15-2012_13:29:08
[perf.repl] waiting for replication: Oct-15-2012_13:29:08
[perf.drain] disk write queue has been drained: Oct-15-2012_13:29:08
[perf.repl] waiting for replication: Oct-15-2012_13:29:08
2012-10-15 13:29:08,349 - root - INFO - waiting for bucket default stat : vb_replica_queue_size to match 0 on 127.0.0.1
2012-10-15 13:29:08,358 - root - INFO - waiting for bucket default stat : vb_replica_queue_size to match 0 on 127.0.0.1
2012-10-15 13:29:08,430 - root - INFO - waiting for bucket default stat : ep_tap_replica_queue_itemondisk to match 0 on 127.0.0.1
2012-10-15 13:29:08,434 - root - INFO - waiting for bucket default stat : ep_tap_replica_queue_itemondisk to match 0 on 127.0.0.1
2012-10-15 13:29:08,506 - root - INFO - waiting for bucket default stat : ep_tap_rebalance_queue_backfillremaining to match 0 on 127.0.0.1
2012-10-15 13:29:08,509 - root - INFO - waiting for bucket default stat : ep_tap_rebalance_queue_backfillremaining to match 0 on 127.0.0.1
2012-10-15 13:29:08,578 - root - INFO - waiting for bucket default stat : ep_tap_replica_qlen to match 0 on 127.0.0.1
2012-10-15 13:29:08,579 - root - INFO - waiting for bucket default stat : ep_tap_replica_qlen to match 0 on 127.0.0.1
[perf.repl] replication is done: Oct-15-2012_13:29:08
[perf.repl] replication is done: Oct-15-2012_13:29:08
[perf.drain] disk write queue has been drained: Oct-15-2012_13:29:08
[perf.repl] waiting for replication: Oct-15-2012_13:29:08
2012-10-15 13:29:08,788 - root - INFO - waiting for bucket default stat : vb_replica_queue_size to match 0 on 127.0.0.1
[perf.drain] disk write queue has been drained: Oct-15-2012_13:29:08
[perf.repl] waiting for replication: Oct-15-2012_13:29:08
2012-10-15 13:29:08,834 - root - INFO - waiting for bucket default stat : vb_replica_queue_size to match 0 on 127.0.0.1
2012-10-15 13:29:08,856 - root - INFO - waiting for bucket default stat : ep_tap_replica_queue_itemondisk to match 0 on 127.0.0.1
2012-10-15 13:29:08,906 - root - INFO - waiting for bucket default stat : ep_tap_replica_queue_itemondisk to match 0 on 127.0.0.1
2012-10-15 13:29:08,926 - root - INFO - waiting for bucket default stat : ep_tap_rebalance_queue_backfillremaining to match 0 on 127.0.0.1
2012-10-15 13:29:08,973 - root - INFO - waiting for bucket default stat : ep_tap_rebalance_queue_backfillremaining to match 0 on 127.0.0.1
2012-10-15 13:29:08,992 - root - INFO - waiting for bucket default stat : ep_tap_replica_qlen to match 0 on 127.0.0.1
2012-10-15 13:29:09,039 - root - INFO - waiting for bucket default stat : ep_tap_replica_qlen to match 0 on 127.0.0.1
[perf.repl] replication is done: Oct-15-2012_13:29:09
[perf.repl] replication is done: Oct-15-2012_13:29:09
2012-10-15 13:29:09,830 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/A/_view/city2?limit=10
2012-10-15 13:29:09,895 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/A/_view/city1?limit=10
2012-10-15 13:29:09,898 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/C/_view/category?limit=10
2012-10-15 13:29:09,911 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/C/_view/experts2?limit=10
2012-10-15 13:29:09,927 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/C/_view/realm3?limit=10
2012-10-15 13:29:09,934 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/C/_view/realm2?limit=10
2012-10-15 13:29:09,938 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/B/_view/experts1?limit=10
2012-10-15 13:29:09,955 - root - ERROR - http://127.0.0.1:9500/default/_design/B/_view/experts1?limit=10 error 500 reason: unknown_error

{"error":"unknown_error","reason":"view_undefined"}

Process Process-2:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "pytests/performance/iperf.py", line 217, in test_vperf4
super(MultiClientTests, self).test_vperf4()
File "/home/fdmanana/couchbase/1/testrunner/pytests/performance/eperf.py", line 1303, in test_vperf4
self.index_phase(ddocs)
File "/home/fdmanana/couchbase/1/testrunner/pytests/performance/eperf.py", line 496, in _inner
result = function(self, *args, **kargs)
File "/home/fdmanana/couchbase/1/testrunner/pytests/performance/eperf.py", line 56, in wrapper
return func(self, *args, **kwargs)
File "/home/fdmanana/couchbase/1/testrunner/pytests/performance/eperf.py", line 748, in index_phase

{"limit": 10}

)
File "lib/membase/api/rest_client.py", line 284, in query_view
raise QueryViewException(view_name, content)
QueryViewException: Error occured querying view experts1:

{"error":"unknown_error","reason":"view_undefined"}

2012-10-15 13:29:10,792 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/A/_view/city2?limit=10
2012-10-15 13:29:10,803 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/A/_view/city1?limit=10
2012-10-15 13:29:10,811 - root - INFO - index query url: http://127.0.0.1:9500/default/_design/C/_view/category?limit=10