[CMake] Merging CTest results

Neil Chittenden neilchittenden at quintessa.org
Tue May 17 05:36:50 EDT 2011


OK, thanks for the info. I think for simplicity I won't worry about 
merging and just resubmit the particular test - even if it means that 
test shows up twice on the dashboard.

---
Neil

On 16/05/11 22:50, David Cole wrote:
> Everytime you run ctest -D ExperimentalTest, ctest writes a Test.xml
> file that describes what occurred during the run... If you do it twice,
> (or even more times), only the last one is available after the run.
> (i.e. -- it's overwritten each time, only the last one wins)
>
> You could merge them by hand if you really wanted to, but it would take
> some editing.
>
> You could also do multiple submits, so that you send each Test.xml as
> it's generated up to CDash. With Test.xml files, CDash should accumulate
> the results. It's not well defined what it will do in such cases: this
> may result in repeated test results showing up for a given CDash build.
>
>
> HTH,
> David
>
>
> On Thu, May 12, 2011 at 12:47 PM, Neil Chittenden
> <neilchittenden at quintessa.org <mailto:neilchittenden at quintessa.org>> wrote:
>
>     Hi
>
>     Background:
>     I've run a set of tests using:
>
>       ctest -D ExperimentalTest
>
>     (i.e. delaying the CDash submit)
>     These tests take a long time to complete. Now I notice one of the
>     tests failed because I forgot to update it after a change to my program.
>
>     I can re-run that particular test using something like:
>
>       ctest -D ExperimentalTest -R my-test-to-rerun
>
>     As this test now results in a pass (after being corrected), is it
>     possible to easily merge CTest results before submitting to CDash?
>     (I guess doing the submit using 'make ExperimentalSubmit')
>
>     Or will I have to rerun all the tests? (which takes a long time!)
>
>     I do realise that as the file being submitted is XML-based, it
>     probably isn't too difficult to manually merge them but if
>     CMake/CTest already has the functionality I may as well use that!
>
>     Cheers
>     ---
>     Neil
>     _______________________________________________
>     Powered by www.kitware.com <http://www.kitware.com>
>
>     Visit other Kitware open-source projects at
>     http://www.kitware.com/opensource/opensource.html
>
>     Please keep messages on-topic and check the CMake FAQ at:
>     http://www.cmake.org/Wiki/CMake_FAQ
>
>     Follow this link to subscribe/unsubscribe:
>     http://www.cmake.org/mailman/listinfo/cmake
>
>


More information about the CMake mailing list