unable to run benchmark unit tests

Will, assigning this to you because you added benchmark to the manifest recently. Please reassign if someone else should look at it.

Here is the result summary of a recent spock unit test run: http://cv.jenkins.couchbase.com/view/scheduled-unit-tests/job/unit-simple-test/625/testReport/projectroot.benchmark/

All 24 benchmark tests are "skipped" but they actually fail because it can't find some executables (basic_test, filter_test etc). (Above URL is just an example run; but this is true for all the spock unit test runs)

Is it not supposed to be run at all?