Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44580

cbtransfer uncompress=1 does not work when transfering from couchbase to CSV

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Install Couchbase server 6.6.2-9540 on a centos server 7.6
      Create default bucket and load 1000 docs to default bucket.
      Run cbbackupmgr to backup data
      Delete default bucket.
      Recreate default bucket.
      Restore data back to default bucket.
      Use cbtransfer with uncompress=1 flag to transfer out data without compress, uncompress flag failed to run

       /opt/couchbase/bin/cbtransfer http://172.23.121.226:8091 csv:/tmp/9043bcba-772d-11eb-bfa4-acde48001122.csv  -b default -u Administrator -p password --single-node -x uncompress=1 
       
      output:  ['  [####################] 100.0% (100/estimated 100 msgs)\x1b[A', '', 'bucket: default, msgs transferred...', '       :                total |       last |    per sec', ' byte  :                 4548 |       4548 |     6375.0', 'done']
      2021-02-24 21:51:56,350 - root - INFO - done execute cbtransfer
       
      complete maps:  {'default': {'ent-backup81': "ent-backup81,0,0,1614232170701914112,b'\\x80\\x044ent-backup-81a\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfa\\x01\\x00\\x00T\\xfe@\\x01\\xfe@\\x01\\xc6@\\x01',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',70,2\r\n", 'ent-backup91': "ent-backup91,0,0,1614232170614620160,b'\\x80\\x044ent-backup-91a\\xfe\\x01\\x00\\xfe\\x01\\x00\\xde\\x01\\x00\\x00K\\xfe\\xb9\\x00\\xfe\\xb9\\x00\\xde\\xb9\\x00\\xfe\\xb8\\x00\\xfe\\xb8\\x00\\x02\\xb8\\x00',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',349,2\r\n", 'ent-backup90': "ent-backup90,0,0,1614232170620649472,b'\\x80\\x044ent-backup-90a\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\x8a\\x01\\x00\\x00F\\xfe\\xe4\\x00\\xfe\\xe4\\x00\\xfe\\xe4\\x00\\x8a\\xe4\\x00\\xaa\\xe3\\x00',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',602,2\r\n", 'ent-backup93': "ent-backup93,0,0,1614232170620715008,b'\\x80\\x044ent-backup-93a.\\x01\\x00\\x00B.\\r\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00\\xfe\\x0c\\x00b\\x0c\\x00',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',851,2\r\n", 'ent-backup92': "ent-backup92,0,0,1614232170620846080,b'\\x80\\x044ent-backup-92a\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xb2\\x01\\x00\\x00J\\xfen\\x01\\xfen\\x01!n',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',84,2\r\n", 'ent-backup95': "ent-backup95,0,0,1614232170620911616,b'\\x80\\x044ent-backup-95a\\xfe\\x01\\x00\\xfe\\x01\\x00\\xfe\\x01\\x00\\xce\\x01\\x00\\x00R\\xfe\\xf5\\x00\\xfe\\xf5\\x00\\xfe\\xf5\\x00\\xce\\xf5\\x00\\x15
      

      I will find stable version

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build couchbase-server-6.6.2-9544 contains couchbase-cli commit a43dcf6 with commit message:
            MB-44580 Allow uncompressing when exporting

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9544 contains couchbase-cli commit a43dcf6 with commit message: MB-44580 Allow uncompressing when exporting

            Verified on build 6.6.2-9544. This issue is fixed

             
             full version:  6.6.2-9544
             
            command + uncompress:  /opt/couchbase/bin/cbtransfer http://172.23.121.226:8091 csv:/tmp/dd576699-779e-11eb-9f0c-acde48001122.csv  -b default -u Administrator -p password --single-node -x uncompress=1 
             
            output:  ['  [####################] 100.0% (100/estimated 100 msgs)\x1b[A', '', 'bucket: default, msgs transferred...', '       :                total |       last |    per sec', ' byte  :                51200 |      51200 |    71391.0', 'done']
            2021-02-25 11:22:58,954 - root - INFO - done execute cbtransfer
             
            complete maps:  {'default': {'ent-backup81': "ent-backup81,0,0,1614280831432982528,b'ent-baCkup-81aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',70,0\r\n", 'ent-backup91': "ent-backup91,0,0,1614280831337365504,b'ent-backup-91aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaGaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',349,0\r\n", 'ent-backup90': "ent-backup90,0,0,1614280831337431040,b'ent-backup-90aaaaaaaaaaaaaa
            

            thuan Thuan Nguyen added a comment - Verified on build 6.6.2-9544. This issue is fixed   full version: 6.6.2-9544   command + uncompress: /opt/couchbase/bin/cbtransfer http://172.23.121.226:8091 csv:/tmp/dd576699-779e-11eb-9f0c-acde48001122.csv -b default -u Administrator -p password --single-node -x uncompress=1   output: [' [####################] 100.0% (100/estimated 100 msgs)\x1b[A', '', 'bucket: default, msgs transferred...', ' : total | last | per sec', ' byte : 51200 | 51200 | 71391.0', 'done'] 2021-02-25 11:22:58,954 - root - INFO - done execute cbtransfer   complete maps: {'default': {'ent-backup81': "ent-backup81,0,0,1614280831432982528,b'ent-baCkup-81aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',70,0\r\n", 'ent-backup91': "ent-backup91,0,0,1614280831337365504,b'ent-backup-91aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaGaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa',b'\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x02',349,0\r\n", 'ent-backup90': "ent-backup90,0,0,1614280831337431040,b'ent-backup-90aaaaaaaaaaaaaa

            Build couchbase-server-7.0.0-4554 contains couchbase-cli commit a43dcf6 with commit message:
            MB-44580 Allow uncompressing when exporting

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-4554 contains couchbase-cli commit a43dcf6 with commit message: MB-44580 Allow uncompressing when exporting
            owend Daniel Owen added a comment - - edited

            Hi Carlos Gonzalez Betancort Could you add a release note for this MB?

            James Lee highlighted to me an earlier comment where it states uncompressing on exports has never worked and was not supported. So will remove the release-note.

            owend Daniel Owen added a comment - - edited Hi Carlos Gonzalez Betancort Could you add a release note for this MB? James Lee highlighted to me an earlier comment where it states uncompressing on exports has never worked and was not supported. So will remove the release-note.

            Description for release notes:
            Summary: Fixes an issue to ensure the flag -x uncompress=1 operates as expected when using cbtransfer to transfer data out of a cluster.

            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) added a comment - - edited Description for release notes: Summary: Fixes an issue to ensure the flag -x uncompress=1 operates as expected when using cbtransfer to transfer data out of a cluster.

            People

              thuan Thuan Nguyen
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty