Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44428

Replication cannot connect to metakv on 8091

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • No

    Description

      System testing cluster - Looking at timestamp in test.log:

      [2021-02-18T00:55:38-08:00, sequoiatools/couchbase-cli:7.0:7c8361] failover -c 172.23.108.103:8091 --server-failover 172.23.104.67:8091 -u Administrator -p password --force --hard
      [2021-02-18T00:56:00-08:00, sequoiatools/couchbase-cli:7.0:33844d] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      [2021-02-18T03:42:35-08:00, sequoiatools/cmd:8f7723] 60
      [2021-02-18T03:43:52-08:00, sequoiatools/cmd:54b6f5] 300
      

      Replication mgr cannot connect to metakv on 8091 -
      Node in cluster - 172.23.99.25

      =========================ERROR REPORT=========================
      ** Generic server <0.19692.34> terminating
      ** Last message in was {<0.19699.34>,{exit_status,0}}
      ** When Server state == {state,<0.19699.34>,
                                  {goxdcr,"/opt/couchbase/bin/goxdcr",
                                      ["-sourceKVAdminPort=8091",
                                       "-xdcrRestPort=9998","-isEnterprise=true",
                                       "-ipv6=false"],
                                      [via_goport,exit_status,stderr_to_stdout,
                                       {env,
                                           [{"GOTRACEBACK","single"},
                                            {"CBAUTH_REVRPC_URL",
                                             "http://%40:d732fcfeb9c3a8be133a261d5d2599b0@127.0.0.1:8091/goxdcr"}]}]},
                                  {ringbuffer,2393,1024,
                                      {[{<<"2021-02-18T02:25:19.186-08:00 INFO GOXDCR.GlobalSettingChangeListener: metakv.RunObserveChildren (GlobalSettingChangeListener) failed after max retry 4\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ConnPoolMgr: close pool 1dc912edc48c474dfd0363d28c0da429/bucket8/bucket8/Couch_Xmem_172.23.105.168:11210/bucket8\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ConnPoolMgr: close pool 1dc912edc48c474dfd0363d28c0da429/bucket4/bucket4/Couch_Xmem_172.23.105.168:11210/bucket4\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ConnPoolMgr: close pool 1dc912edc48c474dfd0363d28c0da429/default/remote/Couch_Xmem_172.23.105.168:11210/remote\n">>,
                                         615}],
                                       [{<<"2021-02-18T02:25:19.185-08:00 INFO GOXDCR.ReplicationSpecChangeListener: metakv.RunObserveChildren failed, err=Get \"http://127.0.0.1:8091/_metakv/replicationSpec/?feed=continuous\": dial tcp 127.0.0.1:8091: connect: connection refused\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ReplicationSpecChangeListener: metakv.RunObserveChildren (ReplicationSpecChangeListener) failed after max retry 4\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.RemoteClusterChangeListener: metakv.RunObserveChildren failed, err=Get \"http://127.0.0.1:8091/_metakv/remoteCluster/?feed=continuous\": dial tcp 127.0.0.1:8091: connect: connection refused\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.RemoteClusterChangeListener: metakv.RunObserveChildren (RemoteClusterChangeListener) failed after max retry 4\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ReplMgr: Replication manager is exiting...\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ReplMgr: Replication manager is already in the processof stopping, no-op on this stop request\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.InternalSettingChangeListener: metakv.RunObserveChildren failed, err=Get \"http://127.0.0.1:8091/_metakv/V2InternalSettings/?feed=continuous\": dial tcp 127.0.0.1:8091: connect: connection refused\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.InternalSettingChangeListener: metakv.RunObserveChildren (InternalSettingsChangeListener) failed after max retry 4\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.ConnPoolMgr: close pool 1dc912edc48c474dfd0363d28c0da429/bucket9/bucket9/Couch_Xmem_172.23.105.168:11210/bucket9\n2021-02-18T02:25:19.186-08:00 INFO GOXDCR.GlobalSettingChangeListener: metakv.RunObserveChildren failed, err=Get \"http://127.0.0.1:8091/_metakv/GlobalConfiguration/?feed=continuous\": dial tcp 127.0.0.1:8091: connect: connection refused\n">>,
                                         1778}]}},
                                  goxdcr,undefined,[],0}
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritam.sharma Ritam Sharma
            ritam.sharma Ritam Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty