[Cdash] Weekly tests easily overseen

[Martin Apel]

Hi Julien,

I finally got around to try out the approach we discussed.
I adjusted the XML files as suggested and used the following CTest
script to submit
the files:

SET (CTEST_SOURCE_DIRECTORY "/scratch/simbuild/s_9XXX_64/develop")
SET (CTEST_PROJECT_NAME "Test")
SITE_NAME(CTEST_SITE)
SET(CTEST_BUILD_NAME linux64-opt-Weekly)
SET (CTEST_BINARY_DIRECTORY
"/scratch/s_9XXX_64/dyn/Weekly-opt64-120527-0830")
SET (CTEST_TEST_TIMEOUT 3600)
SET (CTEST_BUILD_COMMAND "make -i -j8")
SET (CTEST_COVERAGE_COMMAND "gcov")
SET (CTEST_CONFIGURE_COMMAND "cmake -DCMAKE_BUILD_TYPE=Release
${CTEST_SOURCE_DIRECTORY}")
ctest_start(Nightly)
ctest_submit(FILES
${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Configure.xml
                  
${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Build.xml
                   ${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Test.xml)

Uploading the results seems to work. However I do not see anything on
the Dashboard for these uploads.
The monitor page shows the submissions for these three files, but I had
the impression, that they weren't processed at all,
because the server load did not rise for even a second.

Do you have any idea, how I can find out, what went wrong?

Martin



On 21/03/12 16:27, Julien Jomier wrote:
> Hi Martin,
>
> There is currently no way to make the test results visible for longer
> than 24h since this timeframe is hardcoded in CDash. It would require
> some efforts to make this configurable.
>
> It looks like the best option is to resubmit the test results every
> night and as you mentioned you would need to tweak the XML files. You
> will need to change the "BuildStamp" as well as the "StartDateTime" and
> "StartBuildTime" (and the corresponding EndDateTime and EndBuildTime).
>
> Hope that helps,
> Julien
>
> On 21/03/2012 15:26, Martin Apel wrote:
>> Hi all,
>>
>> we are using weekly tests for long-running tests, which can only be
>> carried out on weekends, not during our nightly builds.
>> We start these tests on Saturday, but unfortunately test failures are
>> regularly overseen, because CDash does not show the results
>> on Monday anymore. The results are available for Sunday, but people tend
>> to forget, they have to switch back to Sunday to see them.
>> Is there any way to make test results visible for longer than one day?
>>
>> I also thought about resubmitting test results every night using a
>> cronjob, but this would probably require some tweaking of the XML files,
>> because they contain the build date. Would this be a possibility?
>>
>> Best Regards,
>>
>> Martin
>> _______________________________________________
>> Cdash mailing list
>> Cdash at public.kitware.com
>> http://public.kitware.com/cgi-bin/mailman/listinfo/cdash
>>


-- 

Martin Apel                                    
Software Architect                              
Phone:   + 49 8105 77266-53
E-Mail:  martin.apel at simpack.de

SIMPACK AG
Friedrichshafener Strasse 1, 82205 Gilching, Germany
info at simpack.de, www.simpack.com
Phone: + 49 8105 77266-0
Fax:   + 49 8105 77266-11


Executive Board: Dr. Alexander Eichberger, Dr. Lutz Mauer
Chair of Supervisory Board: Silvia Förster (CPA)
Commercial Register München HRB 181 229