Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-39744

VBucket::abort (vb:156) - active failed as HashTable value is not CommittedState::Pending

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • None
    • Cheshire-Cat
    • couchbase-bucket
    • Enterprise Edition 7.0.0 build 2241
      Centos7 on Vagrant box
    • Triaged
    • Centos 64-bit
    • 1
    • Unknown

    Description

      Build: 7.0.0-2241

      Scenario:

      • Two node cluster, Couchbase bucket (replicas=1)
      •  Performing durability abort scenario tests using sigstop on memcached process on each node

      Service 'memcached' exited with status 134. Restarting. Messages:
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0xdb910]
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0xd5bae]
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0xd61a3]
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0x1a3810]
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0xdd5ad]
      2020-06-04T03:51:04.496609-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0x146623]
      2020-06-04T03:51:04.496614-07:00 CRITICAL /opt/couchbase/bin/../lib/libep.so() [0x7f914bb3f000+0x13cf8f]
      2020-06-04T03:51:04.496620-07:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f914a67d000+0x10777]
      2020-06-04T03:51:04.496625-07:00 CRITICAL /lib64/libpthread.so.0() [0x7f9147cc3000+0x7df3]
      2020-06-04T03:51:04.496654-07:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7f9147902000+0xf61ad]
       
      Compactor for database `eJG-dFwcwK86fvITBOA_ytghCVkrl` (pid [{type,database},
      {important,true},
      {name,
      <<"eJG-dFwcwK86fvITBOA_ytghCVkrl">>},
      {fa,
      {#Fun<compaction_daemon.4.9063353>,
      [<<"eJG-dFwcwK86fvITBOA_ytghCVkrl">>,
      {config,
      {30, undefined},
      {30, undefined},
      undefined,
      false,false,
      {daemon_config, 30,131072, 20971520}}, false,
      {[{type, bucket}]}]}}]) terminated unexpectedly: {{{badmatch,
      {error, timeout}},
      [{mc_client_binary, stats_recv, 4,
      [{file, "src/mc_client_binary.erl"}, {line, 168}]},
      {mc_client_binary, stats, 4,
      [{file, "src/mc_client_binary.erl"}, {line, 419}]},
      {ns_memcached, do_handle_call, 3,
      [{file, "src/ns_memcached.erl"}, {line, 463}]},
      {ns_memcached, worker_loop, 3,
      [{file, "src/ns_memcached.erl"}, {line, 236}]},
      {proc_lib, init_p_do_apply, 3,
      [{file, "proc_lib.erl"}, {line, 247}]}]},
      {gen_server, call,
      [{'ns_memcached-eJG-dFwcwK86fvITBOA_ytghCVkrl', 'ns_1@10.112.191.103'},
      {raw_stats, <<"diskinfo">>,
      #Fun<compaction_daemon.18.9063353>,
      {<<"0">>, <<"0">>}}, 180000]}} hide

      Observation:

      Followed by the crash, the docs in the server are not accessible. 

      Cb_collect_logs:
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/mc_crash/collectinfo-2020-06-04T105726-ns_1%4010.112.191.103.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/mc_crash/collectinfo-2020-06-04T105726-ns_1%4010.112.191.104.zip
      Testcase:

      epengine.collection_crud_negative.CollectionDurabilityTests:
        test_durability_abort,num_items=100,replicas=1,nodes_init=2,override_spec_params=replicas;num_items,GROUP=P0
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ashwin.govindarajulu Ashwin Govindarajulu
              ashwin.govindarajulu Ashwin Govindarajulu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty