Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-37913

Invalid state file found

    XMLWordPrintable

Details

    • Untriaged
    • Unknown

    Description

      memcached.log.000205.txt:2020-02-12T23:22:50.266438-08:00 CRITICAL kvstore-13/rev-000000001/localIndex Invalid sstable:/opt/couchbase/var/lib/couchbase/data/default/magma.1/kvstore-13/rev-000000001/localIndex/sstable.39.data Status:IOError: /opt/couchbase/var/lib/couchbase/data/default/magma.1/kvstore-13/rev-000000001/localIndex/sstable.39.data: Unable to open file err=No such file or directory
      memcached.log.000205.txt:2020-02-12T23:22:50.266465-08:00 CRITICAL kvstore-13/rev-000000001/localIndex Invalid state file found: state.153
      memcached.log.000205.txt:2020-02-12T23:22:50.384975-08:00 CRITICAL *** Fatal error encountered during exception handling ***
      memcached.log.000205.txt:2020-02-12T23:22:50.385028-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): MagmaKVStore vbstate vbid:13 not found. Status:NotFound: MagmaKVStore::readLocalDoc(vbid:vb:13 key:_vbstate not found.
      memcached.log.000205.txt:2020-02-12T23:22:50.472218-08:00 CRITICAL Breakpad caught a crash (Couchbase version 1006.5.1-1057). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/11b4523b-8052-e0c1-7756a71b-673e1cc4.dmp before terminating.
      memcached.log.000205.txt:2020-02-12T23:22:50.472266-08:00 CRITICAL Stack backtrace of crashed thread:
      memcached.log.000205.txt:2020-02-12T23:22:50.472433-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x1324cd]
      memcached.log.000205.txt:2020-02-12T23:22:50.472454-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ce) [0x400000+0x14a50e]
      memcached.log.000205.txt:2020-02-12T23:22:50.472464-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0x94) [0x400000+0x14a824]
      memcached.log.000205.txt:2020-02-12T23:22:50.472474-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f2a2a1c1000+0xf5d0]
      memcached.log.000205.txt:2020-02-12T23:22:50.472530-08:00 CRITICAL     /lib64/libc.so.6(gsignal+0x37) [0x7f2a29df4000+0x36207]
      memcached.log.000205.txt:2020-02-12T23:22:50.472551-08:00 CRITICAL     /lib64/libc.so.6(abort+0x148) [0x7f2a29df4000+0x378f8]
      memcached.log.000205.txt:2020-02-12T23:22:50.472579-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7f2a2a8f6000+0x91195]
      memcached.log.000205.txt:2020-02-12T23:22:50.472596-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x145e02]
      memcached.log.000205.txt:2020-02-12T23:22:50.472613-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f2a2a8f6000+0x8ef86]
      memcached.log.000205.txt:2020-02-12T23:22:50.472635-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f2a2a8f6000+0x8efd1]
      memcached.log.000205.txt:2020-02-12T23:22:50.472651-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f2a2a8f6000+0x8f213]
      memcached.log.000205.txt:2020-02-12T23:22:50.472661-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x1fb7fc]
      memcached.log.000205.txt:2020-02-12T23:22:50.472676-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x1466a7]
      memcached.log.000205.txt:2020-02-12T23:22:50.472683-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x160b54]
      memcached.log.000205.txt:2020-02-12T23:22:50.472690-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x1a3f93]
      memcached.log.000205.txt:2020-02-12T23:22:50.472696-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x1518ae]
      memcached.log.000205.txt:2020-02-12T23:22:50.472703-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0xd9596]
      memcached.log.000205.txt:2020-02-12T23:22:50.472710-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0xef189]
      memcached.log.000205.txt:2020-02-12T23:22:50.472715-08:00 CRITICAL     /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f2a2528a000+0x10254f]
      memcached.log.000205.txt:2020-02-12T23:22:50.472808-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x24118]
      memcached.log.000205.txt:2020-02-12T23:22:50.472818-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x245d9]
      memcached.log.000205.txt:2020-02-12T23:22:50.472824-08:00 CRITICAL     /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0(_ZN9Couchbase6Thread12thread_entryEv+0xf) [0x7f2a2c79f000+0x147bf]
      memcached.log.000205.txt:2020-02-12T23:22:50.472828-08:00 CRITICAL     /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f2a2c79f000+0x8f17]
      memcached.log.000205.txt:2020-02-12T23:22:50.472835-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7f2a2a1c1000+0x7dd5]
      memcached.log.000205.txt:2020-02-12T23:22:50.472865-08:00 CRITICAL     /lib64/libc.so.6(clone+0x6d) [0x7f2a29df4000+0xfdead]
      memcached.log.000206.txt:2020-02-12T23:22:52.970474-08:00 CRITICAL kvstore-13/rev-000000001/localIndex Invalid sstable:/opt/couchbase/var/lib/couchbase/data/default/magma.1/kvstore-13/rev-000000001/localIndex/sstable.39.data Status:IOError: /opt/couchbase/var/lib/couchbase/data/default/magma.1/kvstore-13/rev-000000001/localIndex/sstable.39.data: Unable to open file err=No such file or directory
      

      Logs:
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rollback_1006.5.1057/collectinfo-2020-02-13T073733-ns_1%40172.23.105.220.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/rollback_1006.5.1057/collectinfo-2020-02-13T073733-ns_1%40172.23.105.223.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apaar.gupta Apaar Gupta
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty