Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49975

[Upgrade] /pools/default request returns unexpected server error

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • Yes

    Description

      Steps to Repro
      1. Create a 2 node cluster (.90, .237) with all services on 6.6.3
      2. Stop server on .90
      3. Upgrade to 6.6.4 on .90

      rpm -Uvh couchbase-server-enterprise-6.6.4-9946-centos7.x86_64.rpm

      4. Try connecting to /pools/default on .90 node . 
      Results in "unexpected server error, request logged"

      Observations

      [ns_server:error,2021-12-08T02:28:36.861-08:00,ns_1@172.23.107.90:<0.11886.3>:menelaus_web:loop:171]Server error during processing: ["web request failed",
                                       {path,"/pools/default"},
                                       {method,'GET'},
                                       {type,exit},
                                       {what,
                                        {{{{badmatch,
                                            {error,couldnt_connect_to_memcached}},
                                           [{ns_audit_cfg,notify_memcached,1,
                                             [{file,"src/ns_audit_cfg.erl"},
                                              {line,171}]},
                                            {ns_audit_cfg,handle_info,2,
                                             [{file,"src/ns_audit_cfg.erl"},
                                              {line,145}]},
                                            {gen_server,try_dispatch,4,
                                             [{file,"gen_server.erl"},{line,616}]},
                                            {gen_server,handle_msg,6,
                                             [{file,"gen_server.erl"},{line,686}]},
                                            {proc_lib,init_p_do_apply,3,
                                             [{file,"proc_lib.erl"},{line,247}]}]},
                                          {gen_server,call,[ns_audit_cfg,get_uid]}},
                                         {gen_server,call,
                                          [<0.11868.3>,
                                           #Fun<menelaus_web_cache.2.43854398>,
                                           infinity]}}},
                                       {trace,
                                        [{gen_server,call,3,
                                          [{file,"gen_server.erl"},{line,214}]},
                                         {menelaus_web_pools,pool_info,6,
                                          [{file,"src/menelaus_web_pools.erl"},
                                           {line,115}]},
                                         {menelaus_web_pools,handle_pool_info,2,
                                          [{file,"src/menelaus_web_pools.erl"},
                                           {line,105}]},
                                         {request_throttler,do_request,3,
                                          [{file,"src/request_throttler.erl"},
                                           {line,59}]},
                                         {menelaus_web,loop,2,
                                          [{file,"src/menelaus_web.erl"},
                                           {line,149}]},
                                         {mochiweb_http,headers,5,
                                          [{file,
                                            "/home/couchbase/jenkins/workspace/couchbase-server-unix/couchdb/src/mochiweb/mochiweb_http.erl"},
                                           {line,94}]},
                                         {proc_lib,init_p_do_apply,3,
                                          [{file,"proc_lib.erl"},{line,247}]}]}]

      looks like ns-server is unable to connect to memcached. Probably this is also why other services like index and query seem to be exiting (as they are unable to make /pools/default requests)

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Build couchbase-server-7.0.4-7203 contains ns_server commit d6149d7 with commit message:
          MB-48047, MB-49975: Update memcached_config on upgrade to 6.6.5

          build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.4-7203 contains ns_server commit d6149d7 with commit message: MB-48047, MB-49975 : Update memcached_config on upgrade to 6.6.5

          Build couchbase-server-6.6.5-10062 contains ns_server commit d6149d7 with commit message:
          MB-48047, MB-49975: Update memcached_config on upgrade to 6.6.5

          build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.5-10062 contains ns_server commit d6149d7 with commit message: MB-48047, MB-49975 : Update memcached_config on upgrade to 6.6.5

          Verified on 6.6.5-10070. Closing.

          sumedh.basarkod Sumedh Basarkod (Inactive) added a comment - Verified on 6.6.5-10070. Closing.
          wayne Wayne Siu added a comment -

          Sumedh Basarkod 

          Can you also verify the fix in 7.0.4?  Thanks.

          wayne Wayne Siu added a comment - Sumedh Basarkod   Can you also verify the fix in 7.0.4?  Thanks.

          Verified this for 7.0.4 on build 7238. 

          sumedh.basarkod Sumedh Basarkod (Inactive) added a comment - Verified this for 7.0.4 on build 7238. 

          People

            sumedh.basarkod Sumedh Basarkod (Inactive)
            sumedh.basarkod Sumedh Basarkod (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty