MantisBT - CMake
View Issue Details
IDProjectCategoryView StatusDate SubmittedLast Update
0015524CMake(No Category)public2015-04-20 18:392015-11-02 09:13
ReporterStephen Kelly 
Assigned ToBrad King 
PrioritynormalSeverityminorReproducibilityhave not tried
StatusclosedResolutionfixed 
PlatformOSOS Version
Product Version 
Target VersionFixed in Version 
Summary0015524: CTestTestSerialOrder test fails if CTEST_PARALLEL_LEVEL > 1
Descriptionstephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ rm -rf *
stephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ cmake ..
-- The C compiler identification is GNU 4.9.1
-- The CXX compiler identification is GNU 4.9.1
-- Check for working C compiler: /usr/lib/ccache/cc
-- Check for working C compiler: /usr/lib/ccache/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/lib/ccache/c++
-- Check for working CXX compiler: /usr/lib/ccache/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done
-- Generating done
-- Build files have been written to: /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
stephen@hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$ ctest .
Test project /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
      Start 8: test7a
      Start 9: test7b
      Start 7: test6
      Start 1: initialization
      Start 11: test9
      Start 10: test8
 1/15 Test 0000007: test6 ............................ Passed 0.01 sec
 2/15 Test 0000010: test8 ............................ Passed 0.01 sec
 3/15 Test #1: initialization ................... Passed 0.01 sec
 4/15 Test #11: test9 ............................ Passed 0.01 sec
 5/15 Test #9: test7b ........................... Passed 0.02 sec
 6/15 Test 0000008: test7a ........................... Passed 0.02 sec
      Start 6: test5
      Start 2: test1
      Start 3: test2
      Start 4: test3
      Start 12: test10
      Start 13: test11
 7/15 Test 0000003: test2 ............................ Passed 0.01 sec
 8/15 Test 0000004: test3 ............................ Passed 0.01 sec
 9/15 Test 0000012: test10 ........................... Passed 0.01 sec
10/15 Test 0000002: test1 ............................ Passed 0.02 sec
11/15 Test 0000013: test11 ........................... Passed 0.01 sec
12/15 Test 0000006: test5 ............................ Passed 0.02 sec
      Start 5: test4
      Start 14: test12
      Start 15: verification
13/15 Test 0000005: test4 ............................ Passed 0.01 sec
14/15 Test 0000014: test12 ........................... Passed 0.01 sec
15/15 Test 0000015: verification .....................***Failed 0.01 sec
CMake Error at /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/test.cmake:25 (message):
  Actual test order
  [initialization;test9;test8;test5;test2;test1;test3;test10;test11;test4;test12]
  differs from expected test order
  [initialization;test9;test8;test1;test2;test3;test6;test7a;test7b;test5;test4;test10;test11;test12]




93% tests passed, 1 tests failed out of 15

Total Test time (real) = 0.06 sec

The following tests FAILED:
         15 - verification (Failed)
Errors while running CTest
Steps To Reproduce
Additional InformationGiven that the test is about serial order of test execution, I'm not sure how to fix this, but adding

 unset(ENV{CTEST_PARALLEL_LEVEL})
 unset(ENV{CTEST_OUTPUT_ON_FAILURE})

works for me.
TagsNo tags attached.
Relationships
Attached Files
Issue History
Date ModifiedUsernameFieldChange
2015-04-20 18:39Stephen KellyNew Issue
2015-04-21 11:49Brad KingNote Added: 0038574
2015-04-21 11:49Brad KingAssigned To => Brad King
2015-04-21 11:49Brad KingStatusnew => resolved
2015-04-21 11:49Brad KingResolutionopen => fixed
2015-04-21 13:45Stephen KellyNote Added: 0038575
2015-11-02 09:13Robert MaynardNote Added: 0039786
2015-11-02 09:13Robert MaynardStatusresolved => closed

Notes
(0038574)
Brad King   
2015-04-21 11:49   
Fixed:

 Tests: Protect CTestTestSerialOrder from environment
 http://cmake.org/gitweb?p=cmake.git;a=commitdiff;h=2f4b13b3 [^]

I was not able to get unset() to help. Where were you putting it?
(0038575)
Stephen Kelly   
2015-04-21 13:45   
I put it here:

diff --git a/Tests/CTestTestSerialOrder/CMakeLists.txt b/Tests/CTestTestSerialOrder/CMakeLists.txt
index 69c11fc..f1d0ac3c 100644
--- a/Tests/CTestTestSerialOrder/CMakeLists.txt
+++ b/Tests/CTestTestSerialOrder/CMakeLists.txt
@@ -4,6 +4,9 @@ project(CTestTestSerialOrder)
 
 set(TEST_OUTPUT_FILE "${CMAKE_CURRENT_BINARY_DIR}/test_output.txt")
 
+unset(ENV{CTEST_PARALLEL_LEVEL})
+unset(ENV{CTEST_OUTPUT_ON_FAILURE})
+
 enable_testing()
 
 function(add_serial_order_test TEST_NAME)


However, that fixes the issue when using ctest -R CTestTestSerialO, but not when running

 cd Tests/CTestTestSerialOrder/build
 cmake ..
 ctest
(0039786)
Robert Maynard   
2015-11-02 09:13   
Closing resolved issues that have not been updated in more than 4 months.