Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-24734

cbbackupmgr : no error when archive location is out of disk space

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Done
    • 4.6.3, 5.0.0, 5.1.0, 5.0.1, 5.1.1, 6.0.0, 5.5.0, 5.5.1, 5.1.2, 5.5.2, 5.1.3, 5.5.3, 6.0.1, 6.0.2, 5.5.4, 6.0.3, 5.5.5, 5.5.6, 5.5.5-MP2
    • 6.5.0
    • tools

    Description

      Build : 5.0.0-3064

      The disk where the archive dir was located went out of space while a backup was being taken. The backup logs show the relevant error :

      2017-06-08T21:15:03.965+05:30 (DCP) (vb 437) Creating dcp stream with start seqno 0, end seqno 149654, vbuuid 0, snap start seqno 0, and snap end seqno 0
      2017-06-08T21:15:03.965+05:30 (DCP) (vb 802) Creating dcp stream with start seqno 0, end seqno 149832, vbuuid 0, snap start seqno 0, and snap end seqno 0
      [FDB ERR] Error in FLUSH on a database file '/tmp/backup/backup/2017-06-08T21_10_23.739528753+05_30/other-1-98ba038193f683dae6168f87ad2a1277/data/shard_0.fdb', errno = 28: 'No space left on device'
      2017-06-08T21:39:02.683+05:30 ERRO: unknown forestdb error: -65 – couchbase.dcpClient.Mutation() at dcp.go:314
      [FDB ERR] Error in FLUSH on a database file '/tmp/backup/backup/2017-06-08T21_10_23.739528753+05_30/other-1-98ba038193f683dae6168f87ad2a1277/data/shard_0.fdb', errno = 28: 'No space left on device'
      2017-06-08T21:39:04.064+05:30 ERRO: unknown forestdb error: -65 – couchbase.dcpClient.Mutation() at dcp.go:314
      [FDB ERR] Error in FLUSH on a database file '/tmp/backup/backup/2017-06-08T21_10_23.739528753+05_30/other-1-98ba038193f683dae6168f87ad2a1277/data/shard_0.fdb', errno = 28: 'No space left on device'
      2017-06-08T21:39:04.667+05:30 ERRO: unknown forestdb error: -65 – couchbase.dcpClient.Mutation() at dcp.go:314
      [FDB ERR] Error in FLUSH on a database file '/tmp/backup/backup/2017-06-08T21_10_23.739528753+05_30/other-1-98ba038193f683dae6168f87ad2a1277/data/shard_0.fdb', errno = 28: 'No space left on device'
      2017-06-08T21:39:05.156+05:30 ERRO: unknown forestdb error: -65 – couchbase.dcpCli

      But the CLI is hung for quite some time. There is no error on the CLI.

      root@espresso:/opt/couchbase/bin# ./cbbackupmgr backup -c 172.16.12.9 -u Administrator -p password -a /tmp/backup -r backup

      Backing up to 2017-06-08T21_10_23.739528753+05_30
      Copying at 0B (about 5h 17m 14s remaining) 19397899 items / 29.67GB
      ephemeral [==========================================================================================================================================================================] 100.00%
      other-1 [================= ] 10.44%

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-24734
          # Subject Branch Project Status CR V

          Activity

            mihir.kamdar Mihir Kamdar (Inactive) created issue -
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Field Original Value New Value
            Fix Version/s feature-backlog [ 10342 ]
            Fix Version/s 4.6.3 [ 14508 ]
            Fix Version/s Spock [ 12927 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Issue Type Bug [ 1 ] Improvement [ 4 ]
            ritam.sharma Ritam Sharma made changes -
            Labels merge-test
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Link This issue is duplicated by MB-25024 [ MB-25024 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s vulcan [ 14610 ]
            Fix Version/s feature-backlog [ 10342 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Link This issue relates to CBSE-4086 [ CBSE-4086 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s Spock.Next [ 13624 ]
            Fix Version/s vulcan [ 14610 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Link This issue is duplicated by MB-26777 [ MB-26777 ]
            lynn.straus Lynn Straus made changes -
            Fix Version/s vulcan [ 14610 ]
            mikew Mike Wiederhold [X] (Inactive) made changes -
            Fix Version/s Mad-Hatter [ 15037 ]
            Fix Version/s Spock.Next [ 13624 ]
            Fix Version/s vulcan [ 14610 ]
            pvarley Patrick Varley made changes -
            Component/s tools [ 10223 ]
            Component/s backup [ 12517 ]
            pvarley Patrick Varley made changes -
            Assignee Mike Wiederhold [ mikew ] Carlos Gonzalez Betancort [ carlos.gonzalez ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Resolution Fixed [ 1 ]
            Status In Progress [ 3 ] Resolved [ 5 ]
            carlos.gonzalez Carlos Gonzalez Betancort (Inactive) made changes -
            Actual End 2018-11-01 10:11 (issue has been resolved)
            ritam.sharma Ritam Sharma made changes -
            Labels merge-test merge-test needs-qe
            ritam.sharma Ritam Sharma made changes -
            Assignee Carlos Gonzalez Betancort [ carlos.gonzalez ] Thuan Nguyen [ thuan ]
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            owend Daniel Owen made changes -
            Assignee Thuan Nguyen [ thuan ] Carlos Gonzalez Betancort [ carlos.gonzalez ]
            Resolution Fixed [ 1 ]
            Status Closed [ 6 ] Reopened [ 4 ]
            owend Daniel Owen made changes -
            Labels merge-test needs-qe 6.0.5-candidate merge-test needs-qe
            owend Daniel Owen made changes -
            Affects Version/s 5.5.5-MP2 [ 16512 ]
            Affects Version/s 5.5.6 [ 16211 ]
            Affects Version/s 5.5.5 [ 16166 ]
            Affects Version/s 6.0.3 [ 16164 ]
            Affects Version/s 5.5.4 [ 16003 ]
            Affects Version/s 6.0.2 [ 15919 ]
            Affects Version/s 6.0.1 [ 15522 ]
            Affects Version/s 5.5.3 [ 15520 ]
            Affects Version/s 5.1.3 [ 15434 ]
            Affects Version/s 5.5.2 [ 15412 ]
            Affects Version/s 5.1.2 [ 15204 ]
            Affects Version/s 5.5.1 [ 15159 ]
            Affects Version/s 5.5.0 [ 14610 ]
            Affects Version/s 6.0.0 [ 15048 ]
            Affects Version/s 5.1.1 [ 15070 ]
            Affects Version/s 5.0.1 [ 15052 ]
            Affects Version/s 5.1.0 [ 14611 ]
            owend Daniel Owen made changes -
            Link This issue is duplicated by MB-37750 [ MB-37750 ]
            pvarley Patrick Varley made changes -
            Fix Version/s 6.0.5 [ 16729 ]
            pvarley Patrick Varley made changes -
            Resolution Duplicate [ 3 ]
            Status Reopened [ 4 ] Closed [ 6 ]
            pvarley Patrick Varley made changes -
            Resolution Duplicate [ 3 ]
            Status Closed [ 6 ] Reopened [ 4 ]
            pvarley Patrick Varley made changes -
            Comment [ Bulk updating - removing fixedVersion ]
            owend Daniel Owen made changes -
            Fix Version/s 6.0.5 [ 16729 ]
            owend Daniel Owen made changes -
            Labels 6.0.5-candidate merge-test needs-qe merge-test needs-qe
            owend Daniel Owen made changes -
            Resolution Done [ 6 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            owend Daniel Owen made changes -
            Labels merge-test needs-qe 6.0.5-candidate merge-test needs-qe
            owend Daniel Owen made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              carlos.gonzalez Carlos Gonzalez Betancort (Inactive)
              mihir.kamdar Mihir Kamdar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty