[cmake-developers] [CMake 0011561]: test property COST not working in cmake 2.8.3

Mantis Bug Tracker mantis at public.kitware.com
Thu Dec 2 11:51:03 EST 2010


The following issue has been SUBMITTED. 
====================================================================== 
http://www.cmake.org/Bug/view.php?id=11561 
====================================================================== 
Reported By:                tyler
Assigned To:                
====================================================================== 
Project:                    CMake
Issue ID:                   11561
Category:                   CTest
Reproducibility:            always
Severity:                   minor
Priority:                   normal
Status:                     new
====================================================================== 
Date Submitted:             2010-12-02 11:51 EST
Last Modified:              2010-12-02 11:51 EST
====================================================================== 
Summary:                    test property COST not working in cmake 2.8.3
Description: 
Full details in this thread:
http://www.mail-archive.com/cmake@cmake.org/msg32863.html

The high points:

* Tyler: I use set_tests_properties (... COST -500) to force my code coverage
checks to run after all the unit tests have run. This has stopped
working.

* Zach:  In this release we decided that the costs should only be taken into
account in a parallel case (ctest -j N).  Many users have implicit dependencies
based on the order of their add_test calls, so we didn't want to break
backward compatibility for those not using parallel ctest. The non-parallel way
to specify a test to run last is simply to make it the last add_test call.

* Zach: The middle ground here would be to respect costs
in the non-parallel case when they are expressed explicitly, but not to
cost-order them automatically based on their previous run times.

* Tyler: Perhaps if CTest reserved a range for its own COST data (-10 <=
CTest-calculated COST <= 10?) then users could use costs < -10 or > 10
to insure ordering of certain tests?


Steps to Reproduce: 
[tyle... at tpb006:~/cmake-test-properties-test]$ cat CMakeLists.txt
cmake_minimum_required(VERSION 2.8)
project(p)
enable_testing()

add_test (i_should_run_second echo i should run second)
set_tests_properties (i_should_run_second PROPERTIES COST -1)
add_test (i_should_run_first echo i should run first)

[tyle... at tpb006:~/cmake-test-properties-test]$ mkdir b && cd b && cmake ..
-- The C compiler identification is GNU
-- The CXX compiler identification is GNU
-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Configuring done
-- Generating done
-- Build files have been written to: 
/tpb006/tylermr/cmake-test-properties-test/b

[tyle... at tpb006:~/cmake-test-properties-test/b]$ ctest --version
ctest version 2.8.3
[tyle... at tpb006:~/cmake-test-properties-test/b]$ ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
    Start 1: i_should_run_second
1/2 Test http://www.cmake.org/Bug/view.php?id=1: i_should_run_second
..............   Passed    0.01 sec
    Start 2: i_should_run_first
2/2 Test http://www.cmake.org/Bug/view.php?id=2: i_should_run_first
...............   Passed    0.01 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) =   0.04 sec

[tyle... at tpb006:~/cmake-test-properties-test/b]$ 
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest --version
ctest version 2.8.1
[tyle... at tpb006:~/cmake-test-properties-test/b]$ 
/usr/local/cmake-2.8.1-Linux-i386/bin/ctest
Test project /tpb006/tylermr/cmake-test-properties-test/b
    Start 2: i_should_run_first
1/2 Test http://www.cmake.org/Bug/view.php?id=2: i_should_run_first
...............   Passed    0.01 sec
    Start 1: i_should_run_second
2/2 Test http://www.cmake.org/Bug/view.php?id=1: i_should_run_second
..............   Passed    0.01 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) =   0.02 sec
====================================================================== 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2010-12-02 11:51 tyler          New Issue                                    
======================================================================




More information about the cmake-developers mailing list