Uploaded image for project: 'Couchbase Documentation'
  1. Couchbase Documentation
  2. DOC-12291

cbimport: --dataset option needs more info

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • Major
    • None
    • 7.6.0, 7.6.1, 7.6.2
    • tools
    • None
    • 0

    Description

      In 7.6.x, cbimport csv and cbimport json commands support accepting a URL (like a cloud object store presigned URL) for the data set location in the --data-set option.

      The --dataset option documented here need a bit more information about using the URL:

      https://docs.couchbase.com/server/current/tools/cbimport-csv.html

      https://docs.couchbase.com/server/current/tools/cbimport-json.html

      Currently, this is what it says:

      -d,--dataset <uri>
      The URI of the dataset to be loaded. cbimport supports loading data from a local file or from a URL. When importing data from a local file the path must be prefixed with file://. 

       
      It should also explain that if a URL is used (for example, a cloud object store presigned URL), the file will be downloaded to the current machine, to the directory specified by the --http-cache-directory <path> . Note that the downloaded file is not removed after cbimport completes.

      The current documentation has this for --http-cache-directory <path> :

      --http-cache-directory <path>
      The directory used to store files when the --dataset flag uses the 'http(s)://' scheme; this avoids re-downloading the files when running multiple imports.
      

      Related: see MB-55859 and this slack thread

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            owend Daniel Owen
            hyun-ju.vega Hyun-Ju Vega
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty