MantisBT - CMake
http://www.mail-archive.com/cmake@cmake.org/msg32863.html [^]
The high points:
* Tyler: I use set_tests_properties (... COST -500) to force my code coverage
checks to run after all the unit tests have run. This has stopped
working.
* Zach: In this release we decided that the costs should only be taken into account in a parallel case (ctest -j N). Many users have implicit dependencies
based on the order of their add_test calls, so we didn't want to break
backward compatibility for those not using parallel ctest. The non-parallel way to specify a test to run last is simply to make it the last add_test call.
* Zach: The middle ground here would be to respect costs
in the non-parallel case when they are expressed explicitly, but not to
cost-order them automatically based on their previous run times.
* Tyler: Perhaps if CTest reserved a range for its own COST data (-10 <=
CTest-calculated COST <= 10?) then users could use costs < -10 or > 10
to insure ordering of certain tests?
cmake_minimum_required(VERSION 2.8)
project(p)
enable_testing()
add_test (i_should_run_second echo i should run second)
set_tests_properties (i_should_run_second PROPERTIES COST -1)
add_test (i_should_run_first echo i should run first)
[tyle...@tpb006:~/cmake-test-properties-test]$ mkdir b && cd b && cmake ..
-- The C compiler identification is GNU
-- The CXX compiler identification is GNU
-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Configuring done
-- Generating done
-- Build files have been written to:
/tpb006/tylermr/cmake-test-properties-test/b
[tyle...@tpb006:~/cmake-test-properties-test/b]$ ctest --version
ctest version 2.8.3
[tyle...@tpb006:~/cmake-test-properties-test/b]$ ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
Start 1: i_should_run_second
1/2 Test #1: i_should_run_second .............. Passed 0.01 sec
Start 2: i_should_run_first
2/2 Test 0000002: i_should_run_first ............... Passed 0.01 sec
100% tests passed, 0 tests failed out of 2
Total Test time (real) = 0.04 sec
[tyle...@tpb006:~/cmake-test-properties-test/b]$
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest --version
ctest version 2.8.1
[tyle...@tpb006:~/cmake-test-properties-test/b]$
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
Start 2: i_should_run_first
1/2 Test 0000002: i_should_run_first ............... Passed 0.01 sec
Start 1: i_should_run_second
2/2 Test #1: i_should_run_second .............. Passed 0.01 sec
100% tests passed, 0 tests failed out of 2
Total Test time (real) = 0.02 sec
| related to | 0011877 | closed | David Cole | ctest runs tests in different order than previous versions of ctest |
COST-changes-patch.txt (1,941) 2010-12-09 12:03https://public.kitware.com/Bug/file/3556/COST-changes-patch.txt