Details
-
Bug
-
Resolution: Fixed
-
Major
-
4.5.1
-
4.5.1-2860
Description
Steps to reproduce:
- Create a new backup repo named `testRepo`
- Flush `travel-sample` bucket
- Insert ~5,000,000 items into `travel-sample` using pillow-fight
- Take a backup in `testRepo` and compact it
- Flush `travel-sample` bucket
- Restore the saved backup into `travel-sample`
- Insert a few thousand additional items into `travel-sample` using pillow-fight
- Take another backup into `testRepo`
- Repeat steps 7 and 8 two more times
- Compact all backups
- Perform a cbbackupmgr merge
In my testing, I saw cbbackupmgr stop with the error pasted below. Mike W. has looked at backup.log file and he thinks that ForestDB is crashing underneath.
/opt/couchbase/bin/cbbackupmgr merge --archive /couchbase/testBackups/ --repo testRepo --start 2017-03-09T21_01_58.87715463Z --end 2017-03-10T08_05_44.262830586Z
Segmentation fault (core dumped)
A mini dump and backup.log files are attached.
The crashing thread from the minidump file:
Thread 1 (Thread 16217):
|
#0 avl_search (tree=0x19744d0, node=0x7fff7c57c790, func=0x7fa3a43a7d70 <_hash_cmp_wrap(avl_node*, avl_node*, void*)>)
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/avltree.cc:320
|
#1 0x00007fa3a437b07c in bcache_write (file=Unhandled dwarf expression opcode 0xf3
|
) at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/blockcache.cc:1082
|
#2 0x00007fa3a439060c in filemgr_read (file=0x7fa319f0e000, bid=24849, buf=0x7fa3173b5000, log_callback=0x7fa316c5f0f0, read_on_cache_miss=Unhandled dwarf expression opcode 0xf3
|
)
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/filemgr.cc:2053
|
#3 0x00007fa3a438a9b9 in _docio_read_through_buffer (handle=0x7fa316c9e580, offset=101782321, doc=0x7fff7c57c960, read_on_cache_miss=Unhandled dwarf expression opcode 0xf3
|
)
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/docio.cc:704
|
#4 _docio_read_length (handle=0x7fa316c9e580, offset=101782321, doc=0x7fff7c57c960, read_on_cache_miss=Unhandled dwarf expression opcode 0xf3
|
)
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/docio.cc:792
|
---Type <return> to continue, or q <return> to quit---
|
#5 docio_read_doc_key_meta (handle=0x7fa316c9e580, offset=101782321, doc=0x7fff7c57c960, read_on_cache_miss=Unhandled dwarf expression opcode 0xf3
|
)
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/docio.cc:1112
|
#6 0x00007fa3a4395dc6 in _fdb_readseq_wrap (handle=Unhandled dwarf expression opcode 0xf3
|
) at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/forestdb.cc:121
|
#7 0x00007fa3a43a9394 in _hbtrie_next (it=0x7fa319f48140, item=<value optimized out>, key_buf=0x7fff7c57cc70, keylen=0x7fff7c57ccb0, value_buf=0x7fff7c57ccc0, flag=0 '\000')
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:995
|
#8 0x00007fa3a43a8d8e in _hbtrie_next (it=0x7fa319f48140, item=0x7fa319f481e0, key_buf=0x7fff7c57cc70, keylen=0x7fff7c57ccb0, value_buf=0x7fff7c57ccc0, flag=0 '\000')
|
at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:778
|
#9 0x00007fa3a43aa4e1 in hbtrie_next (it=0x7fa319f48140, key_buf=Unhandled dwarf expression opcode 0xf3
|
) at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/hbtrie.cc:1022
|
#10 0x00007fa3a43ad339 in _fdb_iterator_seq_next (iterator=0x7fa319f48000) at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/iterator.cc:1690
|
#11 0x00007fa3a43ae0ac in fdb_iterator_next (iterator=0x7fa319f48000) at /home/couchbase/jenkins/workspace/watson-unix/forestdb/src/iterator.cc:1897
|
#12 0x00000000007775d7 in _cgo_512a988f7ab7_Cfunc_fdb_iterator_next (v=0xc820025678)
|
at /home/couchbase/jenkins/workspace/watson-unix/godeps/src/github.com/couchbase/goforestdb/iterator.go:111
|
#13 0x00000000004765f0 in runtime.asmcgocall () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.5.2/go/src/runtime/asm_amd64.s:692
|
#14 0x000000c820025618 in ?? ()
|
#15 0x000000000041d2aa in runtime.cgocall (fn=0xd550a0, arg=0x7fff7c57cf50, ~r2=13979744) at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.5.2/go/src/runtime/cgocall.go:107
|
#16 0x0000000000449b60 in runtime.startTheWorldWithSema () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.5.2/go/src/runtime/proc1.go:603
|
#17 0x00007fff7c57d068 in ?? ()
|
#18 0x000000000000000a in ?? ()
|
#19 0x00007fff7c57d068 in ?? ()
|
#20 0x0000000000000000 in ?? ()
|