Unable to link to vbucketmigrator specifying --with-libvbucket-prefix

I have tried to build vbucketmigrator specifying --with-libvbucket-prefix to where I have the shared library files for libvbucket located but configure seems unable to use this and uses the installed libvbucket library instead (/usr/local/lib) or fails to find it if libvbucket is not installed in a system location.

I'm trying to have an installation setup for users to not have to require them to need root access to install anything.