[CMake] Merging CTest results

[David Cole]

Everytime you run ctest -D ExperimentalTest, ctest writes a Test.xml file
that describes what occurred during the run... If you do it twice, (or even
more times), only the last one is available after the run. (i.e. -- it's
overwritten each time, only the last one wins)

You could merge them by hand if you really wanted to, but it would take some
editing.

You could also do multiple submits, so that you send each Test.xml as it's
generated up to CDash. With Test.xml files, CDash should accumulate the
results. It's not well defined what it will do in such cases: this may
result in repeated test results showing up for a given CDash build.


HTH,
David


On Thu, May 12, 2011 at 12:47 PM, Neil Chittenden <
neilchittenden at quintessa.org> wrote:

> Hi
>
> Background:
> I've run a set of tests using:
>
>  ctest -D ExperimentalTest
>
> (i.e. delaying the CDash submit)
> These tests take a long time to complete. Now I notice one of the tests
> failed because I forgot to update it after a change to my program.
>
> I can re-run that particular test using something like:
>
>  ctest -D ExperimentalTest -R my-test-to-rerun
>
> As this test now results in a pass (after being corrected), is it possible
> to easily merge CTest results before submitting to CDash? (I guess doing the
> submit using 'make ExperimentalSubmit')
>
> Or will I have to rerun all the tests? (which takes a long time!)
>
> I do realise that as the file being submitted is XML-based, it probably
> isn't too difficult to manually merge them but if CMake/CTest already has
> the functionality I may as well use that!
>
> Cheers
> ---
> Neil
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the CMake FAQ at:
> http://www.cmake.org/Wiki/CMake_FAQ
>
> Follow this link to subscribe/unsubscribe:
> http://www.cmake.org/mailman/listinfo/cmake
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.cmake.org/pipermail/cmake/attachments/20110516/c46a0369/attachment.htm>