Indexer stuck( core dumped)

Client-side error-report for user undefined on node 'ns_1@172.23.100.70':

User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36

Got unhandled javascript error:

message: The transition has been superseded by a different transition (see detail).;

menelaus_web 102	ns_1@172.23.100.70	2:56:26 AM Mon Mar 21, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:31:04 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:31:04 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:29:12 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:29:12 PM Sun Mar 20, 2016

Approaching full disk warning. Usage of disk "/" on node "172.23.100.45" is around 92%.	menelaus_web_alerts_srv 000	ns_1@172.23.100.45	3:28:08 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:27:51 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:27:51 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:26:29 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:26:29 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:25:00 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:25:00 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:23:52 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:23:52 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:22:39 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:22:39 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:21:28 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:21:28 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:20:14 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:20:14 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:19:00 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:19:00 PM Sun Mar 20, 2016

Service 'indexer' exited with status 1. Restarting. Messages: gs     0x0

-----

[goport] 2016/03/20 15:17:46 /opt/couchbase/bin/indexer terminated: signal: quit (core dumped)	ns_log 000	ns_1@172.23.100.45	3:17:46 PM Sun Mar 20, 2016

[root@hadesindex-s522 couchbase]# ls -la

total 43824656

drwxr-xr-x 7 couchbase couchbase        4096 Mar 21 02:41 .

drwxr-xr-x 3 couchbase couchbase        4096 Mar 20 14:44 ..

drwxr-xr-x 2 couchbase couchbase        4096 Mar 20 14:46 config

-rw------- 1 couchbase couchbase 84447600640 Mar 20 15:13 core.59260

-rw------- 1 couchbase couchbase 70441930752 Mar 20 15:18 core.59732

-rw------- 1 couchbase couchbase 70318071808 Mar 20 15:20 core.59781

-rw------- 1 couchbase couchbase 70355439616 Mar 20 15:21 core.59835

-rw------- 1 couchbase couchbase 70403072000 Mar 20 15:22 core.59883

-rw------- 1 couchbase couchbase 70300209152 Mar 20 15:23 core.59935

-rw------- 1 couchbase couchbase 70347210752 Mar 20 15:24 core.59983

-rw------- 1 couchbase couchbase 70445228032 Mar 20 15:26 core.60033

-rw------- 1 couchbase couchbase 70360039424 Mar 20 15:27 core.60085

-rw------- 1 couchbase couchbase 70279987200 Mar 20 15:29 core.60134

-rw------- 1 couchbase couchbase 70391975936 Mar 20 15:30 core.60195

-rw------- 1 couchbase couchbase 70301425664 Mar 20 15:32 core.60267

-rw------- 1 couchbase couchbase 70378729472 Mar 21 00:09 core.77615

-rw-rw---- 1 couchbase couchbase          17 Mar 20 14:46 couchbase-server.cookie

[root@hadesindex-s522 couchbase]# gdb core.59260

GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)

Copyright (C) 2010 Free Software Foundation, Inc.

License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>

This is free software: you are free to change and redistribute it.

There is NO WARRANTY, to the extent permitted by law.  Type "show copying"

and "show warranty" for details.

This GDB was configured as "x86_64-redhat-linux-gnu".

For bug reporting instructions, please see:

<http://www.gnu.org/software/gdb/bugs/>...

Reading symbols from /opt/couchbase/bin/indexer...Reading symbols from /usr/lib/debug/opt/couchbase/bin/indexer.debug...done.

done.

[New Thread 59451]

[New Thread 59453]

[New Thread 59656]

[New Thread 59587]

[New Thread 59452]

[New Thread 59456]

[New Thread 59458]

[New Thread 59641]

[New Thread 59640]

[New Thread 59264]

[New Thread 59270]

[New Thread 59272]

[New Thread 59276]

[New Thread 59280]

[New Thread 59279]

[New Thread 59268]

[New Thread 59275]

[New Thread 59265]

[New Thread 59271]

[New Thread 59269]

[New Thread 59285]

[New Thread 59273]

[New Thread 59274]

[New Thread 59278]

[New Thread 59373]

[New Thread 59450]

[New Thread 59277]

[New Thread 59454]

[New Thread 59321]

[New Thread 59322]

[New Thread 59267]

[New Thread 59260]

[New Thread 59266]

[New Thread 59282]

[New Thread 59302]

[New Thread 59281]

[New Thread 59449]

warning: Can't read pathname for load map: Input/output error.

Reading symbols from /opt/couchbase/lib/libforestdb.so...Reading symbols from /usr/lib/debug/opt/couchbase/lib/libforestdb.so.debug...done.

done.

Loaded symbols for /opt/couchbase/lib/libforestdb.so

Reading symbols from /opt/couchbase/lib/libbreakpad_wrapper.so...Reading symbols from /usr/lib/debug/opt/couchbase/lib/libbreakpad_wrapper.so.debug...done.

done.

Loaded symbols for /opt/couchbase/lib/libbreakpad_wrapper.so

Reading symbols from /opt/couchbase/lib/libjemalloc.so.2...Reading symbols from /usr/lib/debug/opt/couchbase/lib/libjemalloc.so.2.debug...done.

done.

Loaded symbols for /opt/couchbase/lib/libjemalloc.so.2

Reading symbols from /opt/couchbase/lib/libsnappy.so.1.2.0...Reading symbols from /usr/lib/debug/opt/couchbase/lib/libsnappy.so.1.2.0.debug...done.

done.

Loaded symbols for /opt/couchbase/lib/libsnappy.so.1.2.0

Reading symbols from /opt/couchbase/lib/libplatform.so.0.1.0...Reading symbols from /usr/lib/debug/opt/couchbase/lib/libplatform.so.0.1.0.debug...done.

done.

Loaded symbols for /opt/couchbase/lib/libplatform.so.0.1.0

warning: Can't read pathname for load map: Input/output error.

warning: Can't read pathname for load map: Input/output error.

Core was generated by `/opt/couchbase/bin/indexer -vbuckets=1024 -cluster=127.0.0.1:8091 -adminPort=91'.

Program terminated with signal 3, Quit.

#0  runtime.raise () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sys_linux_amd64.s:110

110	/home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sys_linux_amd64.s: No such file or directory.

	in /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sys_linux_amd64.s

warning: Missing auto-load scripts referenced in section .debug_gdb_scripts

of file /usr/lib/debug/opt/couchbase/bin/indexer.debug

Use `info auto-load python [REGEXP]' to list them.

Missing separate debuginfos, use: debuginfo-install couchbase-server-4.5.0-1842.x86_64

(gdb) bt

#0  runtime.raise () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sys_linux_amd64.s:110

#1  0x00000000004440f6 in runtime.raisebadsignal (sig=3) at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/signal1_unix.go:223

#2  0x00000000004467db in runtime.badsignalgo (sig=3) at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sigqueue.go:192

#3  0x00000000004619be in runtime.call32 () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:472

#4  0x000000000040678c in runtime.cgocallbackg1 () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/cgocall.go:267

#5  0x0000000000406607 in runtime.cgocallbackg () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/cgocall.go:180

#6  0x0000000000463110 in runtime.cgocallback_gofunc () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:716

#7  0x00000000004640b1 in runtime.goexit () at /home/couchbase/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:1998

#8  0x0000000000000000 in ?? ()

(gdb)