Details
-
Bug
-
Resolution: Fixed
-
Test Blocker
-
6.5.0
-
Enterprise Edition 6.5.0 build 3522
-
Untriaged
-
Centos 64-bit
-
-
No
-
KV-Engine Mad-Hatter Beta
Description
1. Create a 2 node cluster - Both KV nodes
Rebalance Overview
+--------------+----------+--------------+
|
| Nodes | Services | Status |
|
+--------------+----------+--------------+
|
| 172.23.97.52 | [u'kv'] | Cluster node |
|
| 172.23.97.53 | None | <--- IN --- |
|
+--------------+----------+--------------+
|
2. Create a default bucket with replica=1
3. Create 50000 docs with durability=Majority
Bucket statistics
+---------+---------+----------+-----+-------+------------+----------+-----------+
|
| Bucket | Type | Replicas | TTL | Items | RAM Quota | RAM Used | Disk Used |
|
+---------+---------+----------+-----+-------+------------+----------+-----------+
|
| default | membase | 1 | 0 | 50000 | 4498391040 | 65149776 | 183448983 |
|
+---------+---------+----------+-----+-------+------------+----------+-----------+
|
4. Rebalance In 2 new nodes and in parallel start another load of new 50k docs with durability=majority.
Rebalance Overview
+--------------+----------+--------------+
|
| Nodes | Services | Status |
|
+--------------+----------+--------------+
|
| 172.23.97.53 | [u'kv'] | Cluster node |
|
| 172.23.97.52 | [u'kv'] | Cluster node |
|
| 172.23.97.56 | None | <--- IN --- |
|
| 172.23.97.57 | None | <--- IN --- |
|
+--------------+----------+--------------+
|
5. Rebalance fails
2019-06-18T08:01:25.473672-07:00 CRITICAL Breakpad caught a crash (Couchbase version 6.5.0-3522). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/50ab9610-90b0-6ccb-016a9d1c-6024db05.dmp before terminating.
|
2019-06-18T08:01:25.473691-07:00 CRITICAL Stack backtrace of crashed thread:
|
2019-06-18T08:01:25.473825-07:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x12f8d0]
|
2019-06-18T08:01:25.473841-07:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ce) [0x400000+0x14513e]
|
2019-06-18T08:01:25.473849-07:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0x94) [0x400000+0x145454]
|
2019-06-18T08:01:25.473856-07:00 CRITICAL /lib64/libpthread.so.0() [0x7f326fb92000+0xf5d0]
|
2019-06-18T08:01:25.473883-07:00 CRITICAL /lib64/libc.so.6(gsignal+0x37) [0x7f326f7c5000+0x36207]
|
2019-06-18T08:01:25.473904-07:00 CRITICAL /lib64/libc.so.6(abort+0x148) [0x7f326f7c5000+0x378f8]
|
2019-06-18T08:01:25.473933-07:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6(ZN9gnu_cxx27_verbose_terminate_handlerEv+0x125) [0x7f32702c7000+0x91195]
|
2019-06-18T08:01:25.473960-07:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x140ced]
|
2019-06-18T08:01:25.473974-07:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f32702c7000+0x8ef86]
|
2019-06-18T08:01:25.473995-07:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f32702c7000+0x8efd1]
|
2019-06-18T08:01:25.474007-07:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f32702c7000+0x8f213]
|
2019-06-18T08:01:25.474017-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x63294]
|
2019-06-18T08:01:25.474026-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x187ce5]
|
2019-06-18T08:01:25.474033-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x16c283]
|
2019-06-18T08:01:25.474046-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x1cfa63]
|
2019-06-18T08:01:25.474052-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x1dfa7c]
|
2019-06-18T08:01:25.474058-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x1e03c5]
|
2019-06-18T08:01:25.474065-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0xe4a9b]
|
2019-06-18T08:01:25.474072-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0xe566b]
|
2019-06-18T08:01:25.474078-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x1321a5]
|
2019-06-18T08:01:25.474084-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x13266d]
|
2019-06-18T08:01:25.474091-07:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f326af7c000+0x12ba50]
|
2019-06-18T08:01:25.474096-07:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f3272162000+0x8f27]
|
2019-06-18T08:01:25.474101-07:00 CRITICAL /lib64/libpthread.so.0() [0x7f326fb92000+0x7dd5]
|
2019-06-18T08:01:25.474126-07:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7f326f7c5000+0xfdead]
|
Attachments
Issue Links
- duplicates
-
-
- Closed
-