[cmake-developers] [CMake 0011561]: test property COST not working in cmake 2.8.3
Mantis Bug Tracker
mantis at public.kitware.com
Thu Dec 2 11:51:03 EST 2010
The following issue has been SUBMITTED.
======================================================================
http://www.cmake.org/Bug/view.php?id=11561
======================================================================
Reported By: tyler
Assigned To:
======================================================================
Project: CMake
Issue ID: 11561
Category: CTest
Reproducibility: always
Severity: minor
Priority: normal
Status: new
======================================================================
Date Submitted: 2010-12-02 11:51 EST
Last Modified: 2010-12-02 11:51 EST
======================================================================
Summary: test property COST not working in cmake 2.8.3
Description:
Full details in this thread:
http://www.mail-archive.com/cmake@cmake.org/msg32863.html
The high points:
* Tyler: I use set_tests_properties (... COST -500) to force my code coverage
checks to run after all the unit tests have run. This has stopped
working.
* Zach: In this release we decided that the costs should only be taken into
account in a parallel case (ctest -j N). Many users have implicit dependencies
based on the order of their add_test calls, so we didn't want to break
backward compatibility for those not using parallel ctest. The non-parallel way
to specify a test to run last is simply to make it the last add_test call.
* Zach: The middle ground here would be to respect costs
in the non-parallel case when they are expressed explicitly, but not to
cost-order them automatically based on their previous run times.
* Tyler: Perhaps if CTest reserved a range for its own COST data (-10 <=
CTest-calculated COST <= 10?) then users could use costs < -10 or > 10
to insure ordering of certain tests?
Steps to Reproduce:
[tyle... at tpb006:~/cmake-test-properties-test]$ cat CMakeLists.txt
cmake_minimum_required(VERSION 2.8)
project(p)
enable_testing()
add_test (i_should_run_second echo i should run second)
set_tests_properties (i_should_run_second PROPERTIES COST -1)
add_test (i_should_run_first echo i should run first)
[tyle... at tpb006:~/cmake-test-properties-test]$ mkdir b && cd b && cmake ..
-- The C compiler identification is GNU
-- The CXX compiler identification is GNU
-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Configuring done
-- Generating done
-- Build files have been written to:
/tpb006/tylermr/cmake-test-properties-test/b
[tyle... at tpb006:~/cmake-test-properties-test/b]$ ctest --version
ctest version 2.8.3
[tyle... at tpb006:~/cmake-test-properties-test/b]$ ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
Start 1: i_should_run_second
1/2 Test http://www.cmake.org/Bug/view.php?id=1: i_should_run_second
.............. Passed 0.01 sec
Start 2: i_should_run_first
2/2 Test http://www.cmake.org/Bug/view.php?id=2: i_should_run_first
............... Passed 0.01 sec
100% tests passed, 0 tests failed out of 2
Total Test time (real) = 0.04 sec
[tyle... at tpb006:~/cmake-test-properties-test/b]$
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest --version
ctest version 2.8.1
[tyle... at tpb006:~/cmake-test-properties-test/b]$
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
Start 2: i_should_run_first
1/2 Test http://www.cmake.org/Bug/view.php?id=2: i_should_run_first
............... Passed 0.01 sec
Start 1: i_should_run_second
2/2 Test http://www.cmake.org/Bug/view.php?id=1: i_should_run_second
.............. Passed 0.01 sec
100% tests passed, 0 tests failed out of 2
Total Test time (real) = 0.02 sec
======================================================================
Issue History
Date Modified Username Field Change
======================================================================
2010-12-02 11:51 tyler New Issue
======================================================================
More information about the cmake-developers
mailing list