Balakumaran Gopal I'm unable to reproduce this on my local setup with non-root installation.

However, do observe that rpath for $ORIGIN/../lib:/opt/couchbase/lib which doesn't match up because we will first try searching for dependencies /home/nonroot/opt/couchbase/lib/couchdb/erlang/lib/ whereas the dependencies actually are at /home/nonroot/opt/couchbase/lib.

The rpath is set correctly for mapreduce_nif though: $ORIGIN/../../../../../:/opt/couchbase/lib

—

Can you please try the same non-root install with the following toy build: http://latestbuilds.service.couchbase.com/builds/latestbuilds/couchbase-server/toybuilds/14466/ (which has the correct rpath set) and check for the same on a non-root install ?

Thanks,

For more context :

On this server, we have:

• couchbase server 6.6.3 installed at root paths (standard installation at /opt/couchbase). this service is not running though.
• couchbase server 7.1.x installed at non-root path (/home/nonroot) and non-sudo which is what's being run and tested here.

From the logs there are problems while trying to use the compression library nifs and are not able to locate some dependencies:

 =========================WARNING REPORT=========================

 The on_load function for module snappy returned:

 {error,{load_failed,"Failed to load NIF library: '/home/nonroot/opt/couchbase/lib/couchdb/erlang/lib/snappy-1.0.4/priv/snappy_nif.so: undefined symbol: _ZN6snappy4Sink22AppendAndTakeOwnershipEPcmPFvPvPKcmES2_'"}}

Looking at how the nifs are built and rpaths, I can see one difference here -

We build and use the following 3 nifs for couchdb:

1. snappy_nif.so
2. couch_view_parser_nif.so
3. mapreduce_nif.so

These shared objects are located at <installation path>/opt/couchbase/lib/couchdb/erlang/lib and we are supposed to locate the dependencies of these shared objects at
/home/nonroot/opt/couchbase/lib which relative to nifs path is $ORIGIN/../../../../../ or /opt/couchbase/bin (only valid for a root install).

However, checking for snappy_nif.so rpath, we see $ORIGIN/../lib which resolves to an incorrect path: /home/nonroot/opt/couchbase/lib/couchdb/erlang/lib/snappy-1.0.4/lib

This is in contrast to rpath for mapreduce_nif.so which is indeed correct: $ORIGIN/../../../../... This change in rpath for mapreduce nif was made around 4 yrs ago in 5.5.0 timeframe: https://review.couchbase.org/c/couchdb/+/94316/

However, for some reason wasn't made for other nifs. Example :

1. https://github.com/couchbase/couchdb/blob/8a75fd2faa89f95158de1776354ceccf3e762753/src/snappy/CMakeLists.txt
2. https://github.com/couchbase/couchdb/blob/8a75fd2faa89f95158de1776354ceccf3e762753/src/couchdb/priv/CMakeLists.txt#L30-L34

—

I tried copying over the change made in mapreduce cmake to the above two: https://review.couchbase.org/c/couchdb/+/171299 which resolves the dependency issues as QE confirmed above.

Chris Hillery I believe you made the rpath change mentioned above via https://review.couchbase.org/c/couchdb/+/94316/ . Would be helpful if you can review the analysis above and confirm whether the rpath needs a change for the other two shared objects? In particular, whether https://review.couchbase.org/c/couchdb/+/171299 should be sufficient enough to resolve the dependency issues whether it's for a root or non-root install?

Abhishek Jindal Yes, I believe your diagnosis is correct. I am a little confused how the current CMakeLists for mapreduce is ending up with the RPATH being set to $ORIGIN/../../../../..:/opt/couchbase/lib - I don't know where the /opt/couchbase/lib part is coming from. But that's a relatively minor issue.

I think your proposed change looks correct, and I've put a +2 on it. Thanks for tracking it down.

Build couchbase-server-7.1.0-2407 contains couchdb commit fff78b5 with commit message:
MB-51118 : nifs dependency lookup

Validated this on 7.1.0-2407. See consoleText_MB-51118 for logs.