Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-35243

Jepsen crash during initial teardown

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • master
    • master
    • Jepsen
    • None
    • Untriaged
    • Unknown

    Description

      Some Jepsen test runs are crashing immediately after startup when attempting to clear any leftover iptables rules.

      2019-07-22 23:52:46,127{GMT}	WARN	[main] jepsen.core: Test crashed!
      java.lang.Exception: teardown failed: clojure.lang.ExceptionInfo: Command exited with non-zero status -1 on node 172.28.128.189:
      sudo -S -u root bash -c "cd /; iptables -F -w"
       
      STDIN:
      null
       
      STDOUT:
       
       
      STDERR:
       {:type :jepsen.control/nonzero-exit, :cmd "sudo -S -u root bash -c \"cd /; iptables -F -w\"", :exit -1, :out "", :err "", :host "172.28.128.189", :action {:cmd "sudo -S -u root bash -c \"cd /; iptables -F -w\"", :in "root\n"}}
      	at couchbase.util$teardown.invokeStatic(util.clj:437) ~[na:na]
      	at couchbase.util$teardown.invoke(util.clj:402) ~[na:na]
      	at couchbase.core$couchbase$reify__4628.teardown_BANG_(core.clj:23) ~[na:na]
      	at jepsen.db$fn__2939$G__2935__2943.invoke(db.clj:8) ~[jepsen-0.1.14.jar:na]
      	at jepsen.db$fn__2939$G__2934__2948.invoke(db.clj:8) ~[jepsen-0.1.14.jar:na]
      	at clojure.core$partial$fn__5839.invoke(core.clj:2625) ~[clojure-1.10.1.jar:na]
      	at jepsen.control$on_nodes$fn__2918.invoke(control.clj:391) ~[jepsen-0.1.14.jar:na]
      	at clojure.lang.AFn.applyToHelper(AFn.java:154) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.10.1.jar:na]
      	at clojure.core$apply.invokeStatic(core.clj:665) ~[clojure-1.10.1.jar:na]
      	at clojure.core$with_bindings_STAR_.invokeStatic(core.clj:1973) ~[clojure-1.10.1.jar:na]
      	at clojure.core$with_bindings_STAR_.doInvoke(core.clj:1973) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.RestFn.applyTo(RestFn.java:142) ~[clojure-1.10.1.jar:na]
      	at clojure.core$apply.invokeStatic(core.clj:669) ~[clojure-1.10.1.jar:na]
      	at clojure.core$bound_fn_STAR_$fn__5749.doInvoke(core.clj:2003) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.RestFn.invoke(RestFn.java:408) ~[clojure-1.10.1.jar:na]
      	at dom_top.core$real_pmap_helper$build_thread__214$fn__215.invoke(core.clj:146) ~[jepsen-0.1.14.jar:na]
      	at clojure.lang.AFn.applyToHelper(AFn.java:152) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.10.1.jar:na]
      	at clojure.core$apply.invokeStatic(core.clj:665) ~[clojure-1.10.1.jar:na]
      	at clojure.core$with_bindings_STAR_.invokeStatic(core.clj:1973) ~[clojure-1.10.1.jar:na]
      	at clojure.core$with_bindings_STAR_.doInvoke(core.clj:1973) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.RestFn.invoke(RestFn.java:425) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.AFn.applyToHelper(AFn.java:156) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.RestFn.applyTo(RestFn.java:132) ~[clojure-1.10.1.jar:na]
      	at clojure.core$apply.invokeStatic(core.clj:669) ~[clojure-1.10.1.jar:na]
      	at clojure.core$bound_fn_STAR_$fn__5749.doInvoke(core.clj:2003) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.10.1.jar:na]
      	at clojure.lang.AFn.run(AFn.java:22) ~[clojure-1.10.1.jar:na]
      	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_212]
      

      http://172.23.120.13:8080/files/Couchbase-jenkins-kv-engine-jepsen-nightly-189/20190722T234847.000-0700
      http://172.23.120.13:8080/files/Couchbase-jenkins-kv-engine-jepsen-nightly-187/20190720T235739.000-0700

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sven.signer Sven Signer (Inactive)
            sven.signer Sven Signer (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty