Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-22547

cbimport for JSON lines doesn't meet the performance requirements

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 5.0.0
    • 5.0.0
    • tools
    • Client: 2 x E5-2680 v3 (48 vCPU), 128GB RAM, Samsung SM863, 10 GbE
      Server: 4 Data nodes
    • Untriaged
    • Centos 64-bit
    • No

    Description

      Goal: 100MB/sec
      Actual: 86-87MB/sec

      See also http://showfast.sc.couchbase.com/#/timeline/Linux/tools/import .

      The command:

      ./opt/couchbase/bin/cbimport json -c http://172.23.100.29:8091 -u Administrator -p password --dataset file:///workspace/backup/lines.json -b bucket-1 -g "#MONO_INCR#" -l LOG -t 16 --format lines

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-21433 Import/export list/json/csv very slow - 5-50 MB/sec

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mikew Mike Wiederhold [X] (Inactive)
              pavelpaulau Pavel Paulau (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty