View Issue Details [ Jump to Notes ] [ Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0015524CMake(No Category)public2015-04-20 18:392015-11-02 09:13
ReporterStephen Kelly 
Assigned ToBrad King 
PrioritynormalSeverityminorReproducibilityhave not tried
StatusclosedResolutionfixed 
PlatformOSOS Version
Product Version 
Target VersionFixed in Version 
Summary0015524: CTestTestSerialOrder test fails if CTEST_PARALLEL_LEVEL > 1
Descriptionstephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ rm -rf *
stephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ cmake ..
-- The C compiler identification is GNU 4.9.1
-- The CXX compiler identification is GNU 4.9.1
-- Check for working C compiler: /usr/lib/ccache/cc
-- Check for working C compiler: /usr/lib/ccache/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/lib/ccache/c++
-- Check for working CXX compiler: /usr/lib/ccache/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done
-- Generating done
-- Build files have been written to: /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
stephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ ctest .
Test project /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
      Start 8: test7a
      Start 9: test7b
      Start 7: test6
      Start 1: initialization
      Start 11: test9
      Start 10: test8
 1/15 Test 0000007: test6 ............................ Passed 0.01 sec
 2/15 Test 0000010: test8 ............................ Passed 0.01 sec
 3/15 Test #1: initialization ................... Passed 0.01 sec
 4/15 Test #11: test9 ............................ Passed 0.01 sec
 5/15 Test #9: test7b ........................... Passed 0.02 sec
 6/15 Test 0000008: test7a ........................... Passed 0.02 sec
      Start 6: test5
      Start 2: test1
      Start 3: test2
      Start 4: test3
      Start 12: test10
      Start 13: test11
 7/15 Test 0000003: test2 ............................ Passed 0.01 sec
 8/15 Test 0000004: test3 ............................ Passed 0.01 sec
 9/15 Test 0000012: test10 ........................... Passed 0.01 sec
10/15 Test 0000002: test1 ............................ Passed 0.02 sec
11/15 Test 0000013: test11 ........................... Passed 0.01 sec
12/15 Test 0000006: test5 ............................ Passed 0.02 sec
      Start 5: test4
      Start 14: test12
      Start 15: verification
13/15 Test 0000005: test4 ............................ Passed 0.01 sec
14/15 Test 0000014: test12 ........................... Passed 0.01 sec
15/15 Test 0000015: verification .....................***Failed 0.01 sec
CMake Error at /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/test.cmake:25 (message):
  Actual test order
  [initialization;test9;test8;test5;test2;test1;test3;test10;test11;test4;test12]
  differs from expected test order
  [initialization;test9;test8;test1;test2;test3;test6;test7a;test7b;test5;test4;test10;test11;test12]




93% tests passed, 1 tests failed out of 15

Total Test time (real) = 0.06 sec

The following tests FAILED:
         15 - verification (Failed)
Errors while running CTest
Additional InformationGiven that the test is about serial order of test execution, I'm not sure how to fix this, but adding

 unset(ENV{CTEST_PARALLEL_LEVEL})
 unset(ENV{CTEST_OUTPUT_ON_FAILURE})

works for me.
TagsNo tags attached.
Attached Files

 Relationships

  Notes
(0038574)
Brad King (manager)
2015-04-21 11:49

 Fixed:

 Tests: Protect CTestTestSerialOrder from environment
 http://cmake.org/gitweb?p=cmake.git;a=commitdiff;h=2f4b13b3 [^]

I was not able to get unset() to help. Where were you putting it?
(0038575)
Stephen Kelly (developer)
2015-04-21 13:45

 I put it here:

diff --git a/Tests/CTestTestSerialOrder/CMakeLists.txt b/Tests/CTestTestSerialOrder/CMakeLists.txt
index 69c11fc..f1d0ac3c 100644
--- a/Tests/CTestTestSerialOrder/CMakeLists.txt
+++ b/Tests/CTestTestSerialOrder/CMakeLists.txt
@@ -4,6 +4,9 @@ project(CTestTestSerialOrder)
 
 set(TEST_OUTPUT_FILE "${CMAKE_CURRENT_BINARY_DIR}/test_output.txt")
 
+unset(ENV{CTEST_PARALLEL_LEVEL})
+unset(ENV{CTEST_OUTPUT_ON_FAILURE})
+
 enable_testing()
 
 function(add_serial_order_test TEST_NAME)


However, that fixes the issue when using ctest -R CTestTestSerialO, but not when running

 cd Tests/CTestTestSerialOrder/build
 cmake ..
 ctest
(0039786)
Robert Maynard (manager)
2015-11-02 09:13

 Closing resolved issues that have not been updated in more than 4 months.

 Issue History
Date Modified Username Field Change
2015-04-20 18:39 Stephen Kelly New Issue
2015-04-21 11:49 Brad King Note Added: 0038574
2015-04-21 11:49 Brad King Assigned To => Brad King
2015-04-21 11:49 Brad King Status new => resolved
2015-04-21 11:49 Brad King Resolution open => fixed
2015-04-21 13:45 Stephen Kelly Note Added: 0038575
2015-11-02 09:13 Robert Maynard Note Added: 0039786
2015-11-02 09:13 Robert Maynard Status resolved => closed

Copyright © 2000 - 2018 MantisBT Team