Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-33735

CV Intermittent test failure: HdrHistogramTest.meanTest

    XMLWordPrintable

Details

    Description

      Saw the following error when running ep-engine_ep_unit_tests - HdrHistogramTest.meanTest

      06:58:10 [ RUN      ] HdrHistogramTest.meanTest
      06:58:10 /home/couchbase/jenkins/workspace/kv_engine-linux-master-CE/kv_engine/engines/ep/tests/module_tests/hdrhistogram_test.cc:256: Failure
      06:58:10 Value of: static_cast<unsigned int>(round(histogram.getMean()) / normaliseBy)
      06:58:10   Actual: 1185941
      06:58:10 Expected: static_cast<unsigned int>(round(avg) / normaliseBy)
      06:58:10 Which is: 1186232
      06:58:10 
      

      See CV run

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Intermittent failure of HdrHistogramTest.meanTest about 1/500 runs due to the random nature of the data I input affecting it in different ways. Seems two be two problems with the failures:

            1. There's no accounting for rounding error that could be +/- 1 between the expected and value from the histogram 
            2. Theres a bug with large values where we don't normalise them correctly when we only want to compare the 3 most significant figures of each value.
            richard.demellow Richard deMellow added a comment - Intermittent failure of HdrHistogramTest.meanTest about 1/500 runs due to the random nature of the data I input affecting it in different ways. Seems two be two problems with the failures: There's no accounting for rounding error that could be +/- 1 between the expected and value from the histogram  Theres a bug with large values where we don't normalise them correctly when we only want to compare the 3 most significant figures of each value.

            Build couchbase-server-6.5.0-2984 contains kv_engine commit ca40cdb with commit message:
            MB-33735 Make HdrHistogram mean test more reliable

            build-team Couchbase Build Team added a comment - Build couchbase-server-6.5.0-2984 contains kv_engine commit ca40cdb with commit message: MB-33735 Make HdrHistogram mean test more reliable

            marking resolved as commit changing this test so that we check the error percentage instead of trying to work out the sig fig of error. Is now in the master branch.

            richard.demellow Richard deMellow added a comment - marking resolved as commit changing this test so that we check the error percentage instead of trying to work out the sig fig of error. Is now in the master branch.

            People

              richard.demellow Richard deMellow
              owend Daniel Owen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty