benchmark: [BUG] 1.5.1: test suite is failing

+ cd benchmark-1.5.1
+ /usr/bin/make -O -j48 V=1 VERBOSE=1 -C x86_64-redhat-linux-gnu test
make: Entering directory '/home/tkloczko/rpmbuild/BUILD/benchmark-1.5.1/x86_64-redhat-linux-gnu'
Running tests...
/usr/bin/ctest --force-new-ctest-process
Test project /home/tkloczko/rpmbuild/BUILD/benchmark-1.5.1/x86_64-redhat-linux-gnu
      Start  1: benchmark
 1/61 Test  #1: benchmark ..................................   Passed    3.50 sec
      Start  2: filter_simple
 2/61 Test  #2: filter_simple ..............................   Passed    0.03 sec
      Start  3: filter_simple_list_only
 3/61 Test  #3: filter_simple_list_only ....................   Passed    0.01 sec
      Start  4: filter_simple_negative
 4/61 Test  #4: filter_simple_negative .....................   Passed    0.01 sec
      Start  5: filter_simple_negative_list_only
 5/61 Test  #5: filter_simple_negative_list_only ...........   Passed    0.01 sec
      Start  6: filter_suffix
 6/61 Test  #6: filter_suffix ..............................   Passed    0.02 sec
      Start  7: filter_suffix_list_only
 7/61 Test  #7: filter_suffix_list_only ....................   Passed    0.01 sec
      Start  8: filter_suffix_negative
 8/61 Test  #8: filter_suffix_negative .....................   Passed    0.01 sec
      Start  9: filter_suffix_negative_list_only
 9/61 Test  #9: filter_suffix_negative_list_only ...........   Passed    0.01 sec
      Start 10: filter_regex_all
10/61 Test #10: filter_regex_all ...........................   Passed    0.01 sec
      Start 11: filter_regex_all_list_only
11/61 Test #11: filter_regex_all_list_only .................   Passed    0.00 sec
      Start 12: filter_regex_all_negative
12/61 Test #12: filter_regex_all_negative ..................   Passed    0.00 sec
      Start 13: filter_regex_all_negative_list_only
13/61 Test #13: filter_regex_all_negative_list_only ........   Passed    0.00 sec
      Start 14: filter_regex_blank
14/61 Test #14: filter_regex_blank .........................   Passed    0.01 sec
      Start 15: filter_regex_blank_list_only
15/61 Test #15: filter_regex_blank_list_only ...............   Passed    0.00 sec
      Start 16: filter_regex_blank_negative
16/61 Test #16: filter_regex_blank_negative ................   Passed    0.00 sec
      Start 17: filter_regex_blank_negative_list_only
17/61 Test #17: filter_regex_blank_negative_list_only ......   Passed    0.00 sec
      Start 18: filter_regex_none
18/61 Test #18: filter_regex_none ..........................   Passed    0.00 sec
      Start 19: filter_regex_none_list_only
19/61 Test #19: filter_regex_none_list_only ................   Passed    0.00 sec
      Start 20: filter_regex_none_negative
20/61 Test #20: filter_regex_none_negative .................   Passed    0.01 sec
      Start 21: filter_regex_none_negative_list_only
21/61 Test #21: filter_regex_none_negative_list_only .......   Passed    0.00 sec
      Start 22: filter_regex_wildcard
22/61 Test #22: filter_regex_wildcard ......................   Passed    0.01 sec
      Start 23: filter_regex_wildcard_list_only
23/61 Test #23: filter_regex_wildcard_list_only ............   Passed    0.00 sec
      Start 24: filter_regex_wildcard_negative
24/61 Test #24: filter_regex_wildcard_negative .............   Passed    0.01 sec
      Start 25: filter_regex_wildcard_negative_list_only
25/61 Test #25: filter_regex_wildcard_negative_list_only ...   Passed    0.00 sec
      Start 26: filter_regex_begin
26/61 Test #26: filter_regex_begin .........................   Passed    0.01 sec
      Start 27: filter_regex_begin_list_only
27/61 Test #27: filter_regex_begin_list_only ...............   Passed    0.00 sec
      Start 28: filter_regex_begin_negative
28/61 Test #28: filter_regex_begin_negative ................   Passed    0.01 sec
      Start 29: filter_regex_begin_negative_list_only
29/61 Test #29: filter_regex_begin_negative_list_only ......   Passed    0.00 sec
      Start 30: filter_regex_begin2
30/61 Test #30: filter_regex_begin2 ........................   Passed    0.01 sec
      Start 31: filter_regex_begin2_list_only
31/61 Test #31: filter_regex_begin2_list_only ..............   Passed    0.00 sec
      Start 32: filter_regex_begin2_negative
32/61 Test #32: filter_regex_begin2_negative ...............   Passed    0.01 sec
      Start 33: filter_regex_begin2_negative_list_only
33/61 Test #33: filter_regex_begin2_negative_list_only .....   Passed    0.00 sec
      Start 34: filter_regex_end
34/61 Test #34: filter_regex_end ...........................   Passed    0.01 sec
      Start 35: filter_regex_end_list_only
35/61 Test #35: filter_regex_end_list_only .................   Passed    0.00 sec
      Start 36: filter_regex_end_negative
36/61 Test #36: filter_regex_end_negative ..................   Passed    0.01 sec
      Start 37: filter_regex_end_negative_list_only
37/61 Test #37: filter_regex_end_negative_list_only ........   Passed    0.00 sec
      Start 38: options_benchmarks
38/61 Test #38: options_benchmarks .........................   Passed    1.31 sec
      Start 39: basic_benchmark
39/61 Test #39: basic_benchmark ............................   Passed    1.18 sec
      Start 40: diagnostics_test
40/61 Test #40: diagnostics_test ...........................   Passed    0.07 sec
      Start 41: skip_with_error_test
41/61 Test #41: skip_with_error_test .......................   Passed    0.24 sec
      Start 42: donotoptimize_test
42/61 Test #42: donotoptimize_test .........................   Passed    0.01 sec
      Start 43: fixture_test
43/61 Test #43: fixture_test ...............................   Passed    0.09 sec
      Start 44: register_benchmark_test
44/61 Test #44: register_benchmark_test ....................   Passed    0.02 sec
      Start 45: map_test
45/61 Test #45: map_test ...................................   Passed    0.28 sec
      Start 46: multiple_ranges_test
46/61 Test #46: multiple_ranges_test .......................   Passed    0.35 sec
      Start 47: link_main_test
47/61 Test #47: link_main_test .............................   Passed    0.03 sec
      Start 48: reporter_output_test
48/61 Test #48: reporter_output_test .......................   Passed    0.26 sec
      Start 49: templated_fixture_test
49/61 Test #49: templated_fixture_test .....................   Passed    0.02 sec
      Start 50: user_counters_test
50/61 Test #50: user_counters_test .........................   Passed    0.23 sec
      Start 51: internal_threading_test
51/61 Test #51: internal_threading_test ....................   Passed    1.82 sec
      Start 52: report_aggregates_only_test
52/61 Test #52: report_aggregates_only_test ................   Passed    0.03 sec
      Start 53: display_aggregates_only_test
53/61 Test #53: display_aggregates_only_test ...............   Passed    0.02 sec
      Start 54: user_counters_tabular_test
54/61 Test #54: user_counters_tabular_test .................   Passed    0.31 sec
      Start 55: user_counters_thousands_test
55/61 Test #55: user_counters_thousands_test ...............   Passed    0.03 sec
      Start 56: memory_manager_test
56/61 Test #56: memory_manager_test ........................   Passed    0.03 sec
      Start 57: cxx03
57/61 Test #57: cxx03 ......................................   Passed    0.15 sec
      Start 58: complexity_benchmark
58/61 Test #58: complexity_benchmark .......................   Passed    1.30 sec
      Start 59: run_donotoptimize_assembly_test_CHECK
59/61 Test #59: run_donotoptimize_assembly_test_CHECK ......***Failed    0.01 sec
      Start 60: run_state_assembly_test_CHECK
60/61 Test #60: run_state_assembly_test_CHECK ..............***Failed    0.01 sec
      Start 61: run_clobber_memory_assembly_test_CHECK
61/61 Test #61: run_clobber_memory_assembly_test_CHECK .....***Failed    0.01 sec

95% tests passed, 3 tests failed out of 61

Total Test time (real) =  11.61 sec

The following tests FAILED:
         59 - run_donotoptimize_assembly_test_CHECK (Failed)
         60 - run_state_assembly_test_CHECK (Failed)
         61 - run_clobber_memory_assembly_test_CHECK (Failed)
Errors while running CTest
make: *** [Makefile:153: test] Error 8
make: Leaving directory '/home/tkloczko/rpmbuild/BUILD/benchmark-1.5.1/x86_64-redhat-linux-gnu'

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 30 (7 by maintainers)

Most upvoted comments

Please feel free to open a new issue, thanks!