Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-33598

cbtransfer failed to extract data out of bucket to csv file

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 6.5.0
    • 6.5.0
    • tools
    • Untriaged
    • Centos 64-bit
    • Yes

    Description

      Problem
      cbtransfer failed to extract data out of bucket to csv file

      Steps To Reproduce

      1. Install Couchbase Server 6.5.0-2804 on a centos 7.6 server.
      2. Initialise node with kv, index and n1ql services.
      3. Create travel sample in setting page.
      4. Run command cbtransfer to transfer data in bucket out to file, failed to transfer.

      Expectation
      Cbtransfer to extract the data out of the bucket into a CSV file.

      Notes
      cbtransfer runs ok in build 6.5.0-2715

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          Here is print out from the run

          [root@localhost ~]# /opt/couchbase/bin/cbtransfer http://12.11.10.131:8091 csv:/tmp/ddfceb87-54aa-11e9-9b7e-acde48001122.csv  -b travel-sample  -u Administrator -p password --single-node -v
          2019-04-01 11:42:15,060: mt cbtransfer...
          2019-04-01 11:42:15,061: mt  source : http://12.11.10.131:8091
          2019-04-01 11:42:15,061: mt  sink   : csv:/tmp/ddfceb87-54aa-11e9-9b7e-acde48001122.csv
          2019-04-01 11:42:15,061: mt  opts   : {'bucket_source': 'travel-sample', 'bucket_destination': None, 'id': None, 'key': None, 'vbucket_list': None, 'dry_run': False, 'username': '<xxx>', 'password': '<xxx>', 'username_dest': None, 'password_dest': None, 'ssl': False, 'no_ssl_verify': True, 'cacert': None, 'threads': 4, 'verbose': 1, 'silent': False, 'extra': {'batch_max_size': 1000.0, 'batch_max_bytes': 400000.0, 'cbb_max_mb': 100000.0, 'max_retry': 10.0, 'report': 5.0, 'report_full': 2000.0, 'recv_min_bytes': 4096.0, 'try_xwm': 1.0, 'nmv_retry': 1.0, 'rehash': 0.0, 'data_only': 0.0, 'design_doc_only': 0.0, 'conflict_resolve': 1.0, 'seqno': 0.0, 'mcd_compatible': 1.0, 'uncompress': 0.0, 'backoff_cap': 10.0, 'flow_control': 1.0, 'dcp_consumer_queue_length': 1000.0, 'allow_recovery_vb_remap': 0.0}, 'collection': None, 'force_txn': False, 'single_node': True, 'source_vbucket_state': 'active', 'destination_vbucket_state': 'active', 'destination_operation': None}
          2019-04-01 11:42:15,071: mt Starting new HTTP connection (1): 12.11.10.131
          2019-04-01 11:42:15,082: mt bucket: travel-sample
          .
          bucket: travel-sample, msgs transferred...
          msg
          2019-04-01 11:42:15,097: mt Starting new HTTP connection (1): 12.11.10.131
          2019-04-01 11:42:15,100: mt Starting new HTTP connection (1): 127.0.0.1
          2019-04-01 11:42:15,140: mt Starting new HTTP connection (1): 12.11.10.131
          2019-04-01 11:42:15,142: mt Starting new HTTP connection (1): 12.11.10.131
          done
          [root@localhost ~]#
          

          thuan Thuan Nguyen added a comment - Here is print out from the run [root@localhost ~]# /opt/couchbase/bin/cbtransfer http://12.11.10.131:8091 csv:/tmp/ddfceb87-54aa-11e9-9b7e-acde48001122.csv -b travel-sample -u Administrator -p password --single-node -v 2019-04-01 11:42:15,060: mt cbtransfer... 2019-04-01 11:42:15,061: mt source : http://12.11.10.131:8091 2019-04-01 11:42:15,061: mt sink : csv:/tmp/ddfceb87-54aa-11e9-9b7e-acde48001122.csv 2019-04-01 11:42:15,061: mt opts : {'bucket_source': 'travel-sample', 'bucket_destination': None, 'id': None, 'key': None, 'vbucket_list': None, 'dry_run': False, 'username': '<xxx>', 'password': '<xxx>', 'username_dest': None, 'password_dest': None, 'ssl': False, 'no_ssl_verify': True, 'cacert': None, 'threads': 4, 'verbose': 1, 'silent': False, 'extra': {'batch_max_size': 1000.0, 'batch_max_bytes': 400000.0, 'cbb_max_mb': 100000.0, 'max_retry': 10.0, 'report': 5.0, 'report_full': 2000.0, 'recv_min_bytes': 4096.0, 'try_xwm': 1.0, 'nmv_retry': 1.0, 'rehash': 0.0, 'data_only': 0.0, 'design_doc_only': 0.0, 'conflict_resolve': 1.0, 'seqno': 0.0, 'mcd_compatible': 1.0, 'uncompress': 0.0, 'backoff_cap': 10.0, 'flow_control': 1.0, 'dcp_consumer_queue_length': 1000.0, 'allow_recovery_vb_remap': 0.0}, 'collection': None, 'force_txn': False, 'single_node': True, 'source_vbucket_state': 'active', 'destination_vbucket_state': 'active', 'destination_operation': None} 2019-04-01 11:42:15,071: mt Starting new HTTP connection (1): 12.11.10.131 2019-04-01 11:42:15,082: mt bucket: travel-sample . bucket: travel-sample, msgs transferred... msg 2019-04-01 11:42:15,097: mt Starting new HTTP connection (1): 12.11.10.131 2019-04-01 11:42:15,100: mt Starting new HTTP connection (1): 127.0.0.1 2019-04-01 11:42:15,140: mt Starting new HTTP connection (1): 12.11.10.131 2019-04-01 11:42:15,142: mt Starting new HTTP connection (1): 12.11.10.131 done [root@localhost ~]#

          Doing some testing it looks like it is something to do with the --single-node option as if the same command is run with out the --singe-node it will work fine. I'll investigate further to find the root cause.

          carlos.gonzalez Carlos Gonzalez Betancort (Inactive) added a comment - Doing some testing it looks like it is something to do with the --single-node option as if the same command is run with out the --singe-node it will work fine. I'll investigate further to find the root cause.

          Build couchbase-server-6.5.0-2823 contains couchbase-cli commit f36abba with commit message:
          MB-33598 Fix error resolving host with --single-node

          build-team Couchbase Build Team added a comment - Build couchbase-server-6.5.0-2823 contains couchbase-cli commit f36abba with commit message: MB-33598 Fix error resolving host with --single-node
          thuan Thuan Nguyen added a comment -

          Verified on build 6.5.0-3182. This issue was fixed.

          thuan Thuan Nguyen added a comment - Verified on build 6.5.0-3182. This issue was fixed.

          People

            thuan Thuan Nguyen
            thuan Thuan Nguyen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty