Loading...

XML

Word

Printable

Details

Type: Bug
Resolution: Fixed
Priority: Critical
Fix Version/s: 5.5.0
Affects Version/s: 5.5.0
Component/s: secondary-index, tools
Labels:
None
Environment:
Centos 7.4

Triage:
Untriaged
Operating System:
Centos 64-bit
Is this a Regression?:
Yes

Description

Install Couchbase server on 4 centos servers.
Create a 2 nodes cluster (224 and 225)
Create default bucket.
Load 1K to default bucket.
From node 227 (still version 4.5.0), do backup data

2018-02-27 10:19:59,441 - root - INFO - running command.raw on 172.23.121.227:   /opt/couchbase/bin//cbbackupmgr backup --archive /tmp/entbackup --repo backup --host http://172.23.121.224:8091 --username Administrator  --password password  --no-progress-bar

2018-02-27 10:20:02,577 - root - INFO - command executed successfully

2018-02-27 10:20:02,577 - root - INFO - Backup successfully completed

2018-02-27 10:20:02,578 - root - INFO - running command.raw on 172.23.121.227: ls -tr /tmp/entbackup/backup | tail -1

2018-02-27 10:20:02,680 - root - INFO - command executed successfully

2018-02-27 10:20:02,681 - root - INFO - Finished taking backup  with args: backup --archive /tmp/entbackup --repo backup --host http://172.23.121.224:8091 --username Administrator  --password password  --no-progress-bar

2018-02-27 10:20:02,684 - root - INFO - connecting to 172.23.121.227 with username:root password:couchbase ssh_key:

2018-02-27 10:20:02,946 - root - INFO - Connected to 172.23.121.227

2018-02-27 10:20:03,497 - root - INFO - It could be other operating system.  Go to check at other location

2018-02-27 10:20:04,140 - root - INFO - running command.raw on 172.23.121.227: /opt/couchbase/bin//cbbackupmgr list --archive /tmp/entbackup

2018-02-27 10:20:04,350 - root - INFO - command executed successfully

2018-02-27 10:20:04,351 - root - INFO -  Size      Items          Name

2018-02-27 10:20:04,351 - root - INFO -  52.61MB   -              /

2018-02-27 10:20:04,352 - root - INFO -  52.61MB   -              + backup

2018-02-27 10:20:04,352 - root - INFO -  52.61MB   -                  + 2018-02-27T10_19_59.511789282-08_00

2018-02-27 10:20:04,352 - root - INFO -  52.61MB   -                      + default

2018-02-27 10:20:04,353 - root - INFO -  292B      0                          bucket-config.json

2018-02-27 10:20:04,353 - root - INFO -  52.61MB   1000                       + data

2018-02-27 10:20:04,353 - root - INFO -  52.61MB   1000                           shard_0.fdb

2018-02-27 10:20:04,353 - root - INFO -  2B        0                          full-text.json

2018-02-27 10:20:04,354 - root - INFO -  2.69KB    2                          gsi.json

2018-02-27 10:20:04,354 - root - INFO -  2B        0                          views.json

2018-02-27 10:20:04,481 - root - INFO - connecting to 172.23.121.227 with username:root password:couchbase ssh_key:

2018-02-27 10:20:04,722 - root - INFO - Connected to 172.23.121.227

2018-02-27 10:20:05,231 - root - INFO - It could be other operating system.  Go to check at other location

2018-02-27 10:20:06,118 - root - INFO - running command.raw on 172.23.121.227: ls -lR /tmp/entbackup/backup

2018-02-27 10:20:06,223 - root - INFO - command executed successfully

2018-02-27 10:20:06,224 - root - INFO - /tmp/entbackup/backup:

2018-02-27 10:20:06,225 - root - INFO - total 4

2018-02-27 10:20:06,225 - root - INFO - drwxrwx---. 3 root root  69 Feb 27 10:19 2018-02-27T10_19_59.511789282-08_00

2018-02-27 10:20:06,226 - root - INFO - -rw-rw----. 1 root root 397 Feb 27 10:19 backup-meta.json

2018-02-27 10:20:06,226 - root - INFO -

2018-02-27 10:20:06,226 - root - INFO - /tmp/entbackup/backup/2018-02-27T10_19_59.511789282-08_00:

2018-02-27 10:20:06,227 - root - INFO - total 8

2018-02-27 10:20:06,227 - root - INFO - drwxrwx---. 3 root root 4096 Feb 27 10:19 default-73ac811675a85f303fe1b22c37b7bbd3

2018-02-27 10:20:06,228 - root - INFO - -rw-rw----. 1 root root 1711 Feb 27 10:20 plan.json

2018-02-27 10:20:06,228 - root - INFO -

2018-02-27 10:20:06,228 - root - INFO - /tmp/entbackup/backup/2018-02-27T10_19_59.511789282-08_00/default-73ac811675a85f303fe1b22c37b7bbd3:

2018-02-27 10:20:06,228 - root - INFO - total 448

2018-02-27 10:20:06,228 - root - INFO - -rw-rw----. 1 root root    292 Feb 27 10:19 bucket-config.json

2018-02-27 10:20:06,229 - root - INFO - drwxrwx---. 2 root root     24 Feb 27 10:19 data

2018-02-27 10:20:06,229 - root - INFO - -rw-rw----. 1 root root      2 Feb 27 10:19 full-text.json

2018-02-27 10:20:06,229 - root - INFO - -rw-rw----. 1 root root   2753 Feb 27 10:19 gsi.json

2018-02-27 10:20:06,229 - root - INFO - -rw-rw----. 1 root root 441842 Feb 27 10:19 range.json

2018-02-27 10:20:06,230 - root - INFO - -rw-rw----. 1 root root      2 Feb 27 10:19 views.json

2018-02-27 10:20:06,230 - root - INFO -

2018-02-27 10:20:06,230 - root - INFO - /tmp/entbackup/backup/2018-02-27T10_19_59.511789282-08_00/default-73ac811675a85f303fe1b22c37b7bbd3/data:

2018-02-27 10:20:06,230 - root - INFO - total 53960

2018-02-27 10:20:06,230 - root - INFO - -rw-rw----. 1 root root 55250944 Feb 27 10:20 shard_0.fdb

Clean install Couchbase Server 5.5.0-1979 on 2 nodes (226 and 227)
Upgrade watson cluster to vulcan using swap rebalance.
Flush default bucket.
On node 227 (now vulcan), run restore data to default bucket on upgrade cluster using cbbackupmgr from vulcan node. Failed to restore with error EOF.

2018-02-27T10:33:39.302-08:00 [INFO][FDB] Forestdb opened database file /tmp/entbackup/backup/2018-02-27T10_19_59.511789282-08_00/default-73ac811675a85f303fe1b22c37b7bbd3/data/shard_0.fdb

2018-02-27T10:33:39.306-08:00 [INFO][FDB] Forestdb closed database file /tmp/entbackup/backup/2018-02-27T10_19_59.511789282-08_00/default-73ac811675a85f303fe1b22c37b7bbd3/data/shard_0.fdb

2018-02-27T10:33:39.306-08:00 Restoring data from backup 2018-02-27T10_19_59.511789282-08_00

2018-02-27T10:33:39.306-08:00 (Plan) Executing transfer plan

2018-02-27T10:33:39.306-08:00 (Plan) Checking for data movement restrictions between default and default

2018-02-27T10:33:39.317-08:00 (Rest) GET http://172.23.121.226:8091/pools/default/buckets 200

2018-02-27T10:33:39.326-08:00 (Rest) GET http://172.23.121.226:8091/pools/default 200

2018-02-27T10:33:39.326-08:00 Transfering to Couchbase Server 5.5.0

2018-02-27T10:33:39.326-08:00 (Plan) Transfering views definitions for default to default

2018-02-27T10:33:39.327-08:00 (Rest) GET http://172.23.121.226:8091/pools/default/nodeServices 200

2018-02-27T10:33:39.327-08:00 (Plan) Transfering GSI index definitions for default to default

2018-02-27T10:33:39.329-08:00 (Rest) GET http://172.23.121.226:8091/pools/default/nodeServices 200

2018-02-27T10:33:39.336-08:00 ERRO: EOF -- plan.(*gsi).execute() at gsi.go:64

2018-02-27T10:33:39.336-08:00 (Plan) Transfer plan failed due to error EOF

2018-02-27T10:33:39.336-08:00 (Cmd) Error restoring cluster: EOF

This test was passed on build 5.5.0-1911

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

backup.log.zip
12 kB
27/Feb/18 10:54 AM
backup-files.zip
10.33 MB
05/Mar/18 9:52 AM

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

People

Assignee:: Thuan Nguyen

Reporter:: Thuan Nguyen

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 27/Feb/18 10:54 AM

Updated:: 09/Apr/18 3:30 PM

Resolved:: 07/Mar/18 10:25 PM

Gerrit Reviews

There are no open Gerrit changes

Show There is 1 closed Gerrit change

Hide There is 1 closed Gerrit change

MB-28399: check for number of partitions during restore: Gerrit Review:

cbbackupmgr in vulcan failed to restore data from watson cluster

Details

Description

Attachments

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty