MantisBT - CMake

View Issue Details

Project

Category

View Status

Date Submitted

Last Update

0015431

CMake

CTest

public

2015-03-05 10:08

2016-06-10 14:21

Reporter

hansmi

Assigned To

Priority

normal

Severity

major

Reproducibility

always

Status

closed

Resolution

duplicate

Platform

OS Version

Product Version

Target Version

Fixed in Version

Summary

0015431: Skipped tests (SKIP_RETURN_CODE) cause non-zero exit code

Description

Issue 0008466 implemented a property named SKIP_RETURN_CODE for tests. It works as intended, but CTest's exit status is non-zero when one or more tests were skipped. CMake's support for CTest automatically generates a target which relies on the exit code of CTest to indicate success.

There should probably be a flag (and/or environment variable) to indicate that skipped tests are acceptable.

Steps To Reproduce

Add a skipped test:

add_test(NAME mytest COMMAND bash -c "exit 77")
set_property(TEST mytest PROPERTY SKIP_RETURN_CODE 77)

Then run “cmake --build . --target test”. At least with GNU make this causes a failure.

1/1 Test #1: mytest ...............***Skipped 0.00 sec
…
The following tests FAILED:
1 - mytest (Not Run)
Errors while running CTest
Makefile:117: recipe for target 'test' failed
make: *** [test] Error 8

Additional Information