Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7157

Provide way users can populate data from RDBM sourfce to couchbase via csv conversion tool ( e.g cbtransfer)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.1.0, feature-backlog
    • Component/s: tools
    • Security Level: Public
    • Labels:

      Description

      "Devloper Usability feedback: Interpreting and Converting RDBMS tables / data in to couchbase JSON format. Easy conversion steps for migrating csv , tab separated and other data formats in to JSON "

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        kzeller kzeller added a comment - - edited

        Please also make sure to provide the following when you assign this to document:

        -Example on Linux of this command
        -Example on Windows of this command
        -Example csv file
        -Example output when this successfully runs
        -Any errors that can occur and appear in output (e.g. poorly formatted csv, etc.)
        -Any limitations (e.g. file size < xyz GB, etc)
        -When to run this, when NOT to run this (e.g. only for development use, not for production systems that are live, etc.)

        Show
        kzeller kzeller added a comment - - edited Please also make sure to provide the following when you assign this to document: -Example on Linux of this command -Example on Windows of this command -Example csv file -Example output when this successfully runs -Any errors that can occur and appear in output (e.g. poorly formatted csv, etc.) -Any limitations (e.g. file size < xyz GB, etc) -When to run this, when NOT to run this (e.g. only for development use, not for production systems that are live, etc.)
        Hide
        maria Maria McDuff (Inactive) added a comment -

        bin – pls provide info to karen for documentation.

        Show
        maria Maria McDuff (Inactive) added a comment - bin – pls provide info to karen for documentation.
        Hide
        bcui Bin Cui (Inactive) added a comment -

        i don't think we provide tool to populate data from any RDBMS source to couchbase via CSV conversion tool.
        What we provide is to export couchbase data to external csv file and import any csv file to couchbase.

        1. Export couchbase data to csv file:
        c:\t3\bin>cbtransfer http://localhost:8091 csv:c:\t3\gamesim.csv -b gamesim-sample -u Administrator -p 123456
        ................................................................................
        ....... ################### 100.0% (586/586 msgs)
        bucket: gamesim-sample, msgs transferred...
        : total | last | per sec
        batch : 439 | 439 | 425.8
        byte : 94693 | 94693 | 91845.8
        msg : 586 | 586 | 568.4

        2013-05-29 09:53:12,299: mt warning: cannot save bucket design on a CSV destination
        done

        2. Import csv file to couchbase

        c:\t3\bin>cbtransfer c:\t3\gamesim.csv http://localhost:8091 -B gamesim-sample -u Administrator -p 123456
        .
        bucket: gamesim.csv, msgs transferred...
        : total | last | per sec
        batch : 1 | 1 | 1.0
        byte : 2930 | 2930 | 2995.9
        msg : 586 | 586 | 599.2
        done

        Sample csv file:
        id,flags,expiration,cas,value
        Demolisher_0658d2be-5902-4c8b-a37b-dc2e04bb5c01,0,0,571167110220712,"

        {""jsonType"":""item"",""name"":""Demolisher_0658d2be-5902-4c8b-a37b-dc2e04bb5c01"",""uuid"":""0658d2be-5902-4c8b-a37b-dc2e04bb5c01"",""ownerId"":""Keith0""}

        "
        Plague_spreader_34e00239-9520-4a35-b84f-c3f1ce6d7acf,0,0,571169348696552,"

        {""jsonType"":""item"",""name"":""Plague_spreader_34e00239-9520-4a35-b84f-c3f1ce6d7acf"",""uuid"":""34e00239-9520-4a35-b84f-c3f1ce6d7acf"",""ownerId"":""Claire2""}

        "
        Katana_b7aaa26e-ace8-49aa-b521-99c86058614b,0,0,571167874874041,"

        {""jsonType"":""item"",""name"":""Katana_b7aaa26e-ace8-49aa-b521-99c86058614b"",""uuid"":""b7aaa26e-ace8-49aa-b521-99c86058614b"",""ownerId"":""Tony0""}

        "
        Bauchan0,0,0,571166123924968,"{
        ""experienceWhenKilled"": 28,
        ""hitpoints"": 3755,
        ""itemProbability"": 0.31149362634773436,
        ""jsonType"": ""monster"",
        ""name"": ""Bauchan0"",
        ""uuid"": ""0ca96555-7543-4497-b707-341c320b1ad6""
        }
        "
        Fuath7,0,0,571167441176183,"{
        ""experienceWhenKilled"": 99,
        ""hitpoints"": 132,
        ""itemProbability"": 0.54305685781782442,
        ""jsonType"": ""monster"",
        ""name"": ""Fuath7"",
        ""uuid"": ""e6082897-2d4a-4baa-a9ac-965000f57ec8""
        }
        "

        Show
        bcui Bin Cui (Inactive) added a comment - i don't think we provide tool to populate data from any RDBMS source to couchbase via CSV conversion tool. What we provide is to export couchbase data to external csv file and import any csv file to couchbase. 1. Export couchbase data to csv file: c:\t3\bin>cbtransfer http://localhost:8091 csv:c:\t3\gamesim.csv -b gamesim-sample -u Administrator -p 123456 ................................................................................ ....... ################### 100.0% (586/586 msgs) bucket: gamesim-sample, msgs transferred... : total | last | per sec batch : 439 | 439 | 425.8 byte : 94693 | 94693 | 91845.8 msg : 586 | 586 | 568.4 2013-05-29 09:53:12,299: mt warning: cannot save bucket design on a CSV destination done 2. Import csv file to couchbase c:\t3\bin>cbtransfer c:\t3\gamesim.csv http://localhost:8091 -B gamesim-sample -u Administrator -p 123456 . bucket: gamesim.csv, msgs transferred... : total | last | per sec batch : 1 | 1 | 1.0 byte : 2930 | 2930 | 2995.9 msg : 586 | 586 | 599.2 done Sample csv file: id,flags,expiration,cas,value Demolisher_0658d2be-5902-4c8b-a37b-dc2e04bb5c01,0,0,571167110220712," {""jsonType"":""item"",""name"":""Demolisher_0658d2be-5902-4c8b-a37b-dc2e04bb5c01"",""uuid"":""0658d2be-5902-4c8b-a37b-dc2e04bb5c01"",""ownerId"":""Keith0""} " Plague_spreader_34e00239-9520-4a35-b84f-c3f1ce6d7acf,0,0,571169348696552," {""jsonType"":""item"",""name"":""Plague_spreader_34e00239-9520-4a35-b84f-c3f1ce6d7acf"",""uuid"":""34e00239-9520-4a35-b84f-c3f1ce6d7acf"",""ownerId"":""Claire2""} " Katana_b7aaa26e-ace8-49aa-b521-99c86058614b,0,0,571167874874041," {""jsonType"":""item"",""name"":""Katana_b7aaa26e-ace8-49aa-b521-99c86058614b"",""uuid"":""b7aaa26e-ace8-49aa-b521-99c86058614b"",""ownerId"":""Tony0""} " Bauchan0,0,0,571166123924968,"{ ""experienceWhenKilled"": 28, ""hitpoints"": 3755, ""itemProbability"": 0.31149362634773436, ""jsonType"": ""monster"", ""name"": ""Bauchan0"", ""uuid"": ""0ca96555-7543-4497-b707-341c320b1ad6"" } " Fuath7,0,0,571167441176183,"{ ""experienceWhenKilled"": 99, ""hitpoints"": 132, ""itemProbability"": 0.54305685781782442, ""jsonType"": ""monster"", ""name"": ""Fuath7"", ""uuid"": ""e6082897-2d4a-4baa-a9ac-965000f57ec8"" } "
        Hide
        kzeller kzeller added a comment -

        Drafted, reviewed and revised.

        Consolidating into MB-7102

        Show
        kzeller kzeller added a comment - Drafted, reviewed and revised. Consolidating into MB-7102
        Hide
        kzeller kzeller added a comment -

        Drafted, reviewed and revised.

        Consolidating into MB-7102

        Show
        kzeller kzeller added a comment - Drafted, reviewed and revised. Consolidating into MB-7102

          People

          • Assignee:
            kzeller kzeller
            Reporter:
            don Don Pinto
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes