Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-3845

moxi: cproxy_protocol_a2b.c:1086: cproxy_forward_a2b_simple_downstream: Assertion `uc->cmd_curr != (protocol_binary_command) -1' failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 1.7.0
    • 1.7 beta
    • moxi
    • Security Level: Public
    • None
    • Ubuntu 1004 64 bit

    Description

      Install membase server basestar-262-gc94bbfb on one ubuntu 1004 64bit.
      Create a small membase bucket (250MB).
      Fill this bucket up to 99% from memcachetest and mc-loader.
      See memcached and mc-loader failed to add keys
      Check log page and see error
      Port server moxi on node 'ns_1@127.0.0.1' exited with status 134. Restarting. Messages: }
      })
      moxi: cproxy_protocol_a2b.c:1086: cproxy_forward_a2b_simple_downstream: Assertion `uc->cmd_curr != (protocol_binary_command) -1' failed.

      Here is core dump log.
      Basic crash dump analysis of /tmp/core.moxi.1224.

      Please send the file to support@membase.com

      --------------------------------------------------------------------------------
      File information:
      -rwxr-xr-x 1 membase membase 5565443 2011-05-15 09:15 /opt/membase/bin/moxi
      rw------ 1 membase membase 61399040 2011-05-15 16:45 /tmp/core.moxi.1224
      1f9512b37270c153eaf7a8a778ce8934 /opt/membase/bin/moxi
      29e946be3b3beb983c93124bd7013b5d /tmp/core.moxi.1224
      --------------------------------------------------------------------------------
      Core file callstacks:
      GNU gdb (GDB) 7.1-ubuntu
      Copyright (C) 2010 Free Software Foundation, Inc.
      License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
      This is free software: you are free to change and redistribute it.
      There is NO WARRANTY, to the extent permitted by law. Type "show copying"
      and "show warranty" for details.
      This GDB was configured as "x86_64-linux-gnu".
      For bug reporting instructions, please see:
      <http://www.gnu.org/software/gdb/bugs/>...
      Reading symbols from /opt/membase/bin/moxi...done.
      [New Thread 1228]
      [New Thread 1229]
      [New Thread 1230]
      [New Thread 1231]
      [New Thread 1224]
      [New Thread 1225]
      [New Thread 1226]
      [New Thread 1227]

      warning: Can't read pathname for load map: Input/output error.
      Reading symbols from /lib/libz.so.1...(no debugging symbols found)...done.
      Loaded symbols for /lib/libz.so.1
      Reading symbols from /usr/lib/libsasl2.so.2...(no debugging symbols found)...done.
      Loaded symbols for /usr/lib/libsasl2.so.2
      Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
      Loaded symbols for /lib/libdl.so.2
      Reading symbols from /lib/libresolv.so.2...(no debugging symbols found)...done.
      Loaded symbols for /lib/libresolv.so.2
      Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done.
      Loaded symbols for /lib/librt.so.1
      Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
      Loaded symbols for /lib/libm.so.6
      Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
      Loaded symbols for /lib/libpthread.so.0
      Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
      Loaded symbols for /lib/libc.so.6
      Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
      Loaded symbols for /lib64/ld-linux-x86-64.so.2
      Core was generated by `/opt/membase/bin/moxi -Z port_listen=11211,default_bucket_name=default,do
      wnstre'.
      Program terminated with signal 6, Aborted.
      #0 0x00007fe7cf6aea75 in raise () from /lib/libc.so.6

      Thread 8 (Thread 1227):
      #0 0x00007fe7cf761c93 in epoll_wait () from /lib/libc.so.6
      #1 0x000000000044c9c8 in epoll_dispatch (base=0x2656be0, tv=<value optimized out>)
      at epoll.c:404
      #2 0x0000000000446995 in event_base_loop (base=0x2656be0, flags=<value optimized out>)
      at event.c:1558
      #3 0x00000000004160f5 in worker_libevent (arg=<value optimized out>) at thread.c:272
      #4 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #5 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 7 (Thread 1226):
      #0 0x00007fe7cf761c93 in epoll_wait () from /lib/libc.so.6
      #1 0x000000000044c9c8 in epoll_dispatch (base=0x26525f0, tv=<value optimized out>)
      at epoll.c:404
      #2 0x0000000000446995 in event_base_loop (base=0x26525f0, flags=<value optimized out>)
      at event.c:1558
      #3 0x00000000004160f5 in worker_libevent (arg=<value optimized out>) at thread.c:272
      #4 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #5 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 6 (Thread 1225):
      #0 0x00007fe7cf761c93 in epoll_wait () from /lib/libc.so.6
      #1 0x000000000044c9c8 in epoll_dispatch (base=0x264e000, tv=<value optimized out>)
      at epoll.c:404
      #2 0x0000000000446995 in event_base_loop (base=0x264e000, flags=<value optimized out>)
      at event.c:1558
      #3 0x00000000004160f5 in worker_libevent (arg=<value optimized out>) at thread.c:272
      #4 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #5 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 5 (Thread 1224):
      #0 0x00007fe7cf761c93 in epoll_wait () from /lib/libc.so.6
      #1 0x000000000044c9c8 in epoll_dispatch (base=0x263b1c0, tv=<value optimized out>)
      at epoll.c:404
      #2 0x0000000000446995 in event_base_loop (base=0x263b1c0, flags=<value optimized out>)
      at event.c:1558
      #3 0x0000000000409179 in main (argc=12, argv=0x7fffe314e468) at memcached.c:5056

      Thread 4 (Thread 1231):
      #0 0x00007fe7cf75347d in read () from /lib/libc.so.6
      #1 0x00007fe7cf6ee348 in _IO_file_underflow () from /lib/libc.so.6
      #2 0x00007fe7cf6efeee in _IO_default_uflow () from /lib/libc.so.6
      #3 0x00007fe7cf6e6c7b in getc () from /lib/libc.so.6
      #4 0x0000000000432b26 in check_stdin_thread (arg=<value optimized out>) at stdin_check.c:18
      #5 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #6 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #7 0x0000000000000000 in ?? ()

      Thread 3 (Thread 1230):
      #0 0x00007fe7cf754f53 in poll () from /lib/libc.so.6
      #1 0x0000000000455466 in Curl_socket_ready ()
      #2 0x000000000046c7ed in Curl_do_perform ()
      #3 0x000000000044ec4e in run_rest_conflate (arg=0x2667440) at rest.c:281
      #4 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #5 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 2 (Thread 1229):
      #0 0x00007fe7cfa0885c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
      #1 0x000000000041524e in assoc_maintenance_thread (arg=<value optimized out>) at assoc.c:220
      #2 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #3 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #4 0x0000000000000000 in ?? ()

      Thread 1 (Thread 1228):
      #0 0x00007fe7cf6aea75 in raise () from /lib/libc.so.6
      #1 0x00007fe7cf6b25c0 in abort () from /lib/libc.so.6
      #2 0x00007fe7cf6a7941 in __assert_fail () from /lib/libc.so.6
      #3 0x000000000042a08b in cproxy_forward_a2b_simple_downstream (d=0x26a37a0,
      command=0x26fa9a0 "stats", uc=0x27059a0) at cproxy_protocol_a2b.c:1086
      #4 0x000000000042a3ca in cproxy_forward_a2b_downstream (d=0x26a37a0)
      at cproxy_protocol_a2b.c:1063
      #5 0x000000000041ce3c in cproxy_forward_or_error (d=0x4c8) at cproxy.c:1907
      #6 0x000000000041e4bc in cproxy_on_connect_downstream_conn (c=0x26aef70) at cproxy.c:3054
      #7 0x000000000040f679 in drive_machine (c=0x26aef70) at memcached.c:3490
      #8 0x0000000000446a89 in event_process_active_single_queue (base=0x265b2d0,
      flags=<value optimized out>) at event.c:1308
      #9 event_process_active (base=0x265b2d0, flags=<value optimized out>) at event.c:1375
      #10 event_base_loop (base=0x265b2d0, flags=<value optimized out>) at event.c:1572
      #11 0x00000000004160f5 in worker_libevent (arg=<value optimized out>) at thread.c:272
      #12 0x00007fe7cfa039ca in start_thread () from /lib/libpthread.so.0
      #13 0x00007fe7cf76169d in clone () from /lib/libc.so.6
      #14 0x0000000000000000 in ?? ()
      --------------------------------------------------------------------------------
      Module information:
      /lib/libz.so.1:
      lrwxrwxrwx 1 root root 15 2011-04-13 11:07 /lib/libz.so.1 -> libz.so.1.2.3.3
      6abd7af4f2752f371b0ecb7cc601c3ac /lib/libz.so.1
      /usr/lib/libsasl2.so.2:
      lrwxrwxrwx 1 root root 18 2011-04-13 11:08 /usr/lib/libsasl2.so.2 -> libsasl2.so.2.0.23
      114ce87cac159911bddc4f289365de8c /usr/lib/libsasl2.so.2
      /lib/libdl.so.2:
      lrwxrwxrwx 1 root root 15 2011-04-13 11:07 /lib/libdl.so.2 -> libdl-2.11.1.so
      4fc2038540e79999571aa4a338ac8692 /lib/libdl.so.2
      /lib/libresolv.so.2:
      lrwxrwxrwx 1 root root 19 2011-04-13 11:07 /lib/libresolv.so.2 -> libresolv-2.11.1.so
      42978497a43d78e860753fc0f284def4 /lib/libresolv.so.2
      /lib/librt.so.1:
      lrwxrwxrwx 1 root root 15 2011-04-13 11:07 /lib/librt.so.1 -> librt-2.11.1.so
      1cfe1e6a4c1630a2e050303652c3341d /lib/librt.so.1
      /lib/libm.so.6:
      lrwxrwxrwx 1 root root 14 2011-04-13 11:07 /lib/libm.so.6 -> libm-2.11.1.so
      54f6f084ce7ce998d5ae8efaf5daea70 /lib/libm.so.6
      /lib/libpthread.so.0:
      lrwxrwxrwx 1 root root 20 2011-04-13 11:07 /lib/libpthread.so.0 -> libpthread-2.11.1.so
      deb7c9592f790b5ec2910b627df2d480 /lib/libpthread.so.0
      /lib/libc.so.6:
      lrwxrwxrwx 1 root root 14 2011-04-13 11:07 /lib/libc.so.6 -> libc-2.11.1.so
      df0cc88c32da17856164f20b4b82c54a /lib/libc.so.6
      /lib64/ld-linux-x86-64.so.2:
      lrwxrwxrwx 1 root root 12 2011-04-13 11:07 /lib64/ld-linux-x86-64.so.2 -> ld-2.11.1.so
      b319f05500878fd836406046864771fa /lib64/ld-linux-x86-64.so.2

      Attachments

        For Gerrit Dashboard: MB-3845
        # Subject Branch Project Status CR V

        Activity

          People

            steve Steve Yen
            thuan Thuan Nguyen
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty