[Cdash] Weekly tests easily overseen

[Julien Jomier]

Hi Martin,

Could you check the backup directory and see if you have any XML related 
to this submission? Do you have access to the database? You can look in 
the table build and see if the latest one is the one you just submitted.

Julien

On 29/05/2012 09:49, Martin Apel wrote:
> Hi Julien,
>
> I finally got around to try out the approach we discussed.
> I adjusted the XML files as suggested and used the following CTest
> script to submit
> the files:
>
> SET (CTEST_SOURCE_DIRECTORY "/scratch/simbuild/s_9XXX_64/develop")
> SET (CTEST_PROJECT_NAME "Test")
> SITE_NAME(CTEST_SITE)
> SET(CTEST_BUILD_NAME linux64-opt-Weekly)
> SET (CTEST_BINARY_DIRECTORY
> "/scratch/s_9XXX_64/dyn/Weekly-opt64-120527-0830")
> SET (CTEST_TEST_TIMEOUT 3600)
> SET (CTEST_BUILD_COMMAND "make -i -j8")
> SET (CTEST_COVERAGE_COMMAND "gcov")
> SET (CTEST_CONFIGURE_COMMAND "cmake -DCMAKE_BUILD_TYPE=Release
> ${CTEST_SOURCE_DIRECTORY}")
> ctest_start(Nightly)
> ctest_submit(FILES
> ${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Configure.xml
>
> ${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Build.xml
>                     ${CTEST_BINARY_DIRECTORY}/Testing/20120526-2200/Test.xml)
>
> Uploading the results seems to work. However I do not see anything on
> the Dashboard for these uploads.
> The monitor page shows the submissions for these three files, but I had
> the impression, that they weren't processed at all,
> because the server load did not rise for even a second.
>
> Do you have any idea, how I can find out, what went wrong?
>
> Martin
>
>
>
> On 21/03/12 16:27, Julien Jomier wrote:
>> Hi Martin,
>>
>> There is currently no way to make the test results visible for longer
>> than 24h since this timeframe is hardcoded in CDash. It would require
>> some efforts to make this configurable.
>>
>> It looks like the best option is to resubmit the test results every
>> night and as you mentioned you would need to tweak the XML files. You
>> will need to change the "BuildStamp" as well as the "StartDateTime" and
>> "StartBuildTime" (and the corresponding EndDateTime and EndBuildTime).
>>
>> Hope that helps,
>> Julien
>>
>> On 21/03/2012 15:26, Martin Apel wrote:
>>> Hi all,
>>>
>>> we are using weekly tests for long-running tests, which can only be
>>> carried out on weekends, not during our nightly builds.
>>> We start these tests on Saturday, but unfortunately test failures are
>>> regularly overseen, because CDash does not show the results
>>> on Monday anymore. The results are available for Sunday, but people tend
>>> to forget, they have to switch back to Sunday to see them.
>>> Is there any way to make test results visible for longer than one day?
>>>
>>> I also thought about resubmitting test results every night using a
>>> cronjob, but this would probably require some tweaking of the XML files,
>>> because they contain the build date. Would this be a possibility?
>>>
>>> Best Regards,
>>>
>>> Martin
>>> _______________________________________________
>>> Cdash mailing list
>>> Cdash at public.kitware.com
>>> http://public.kitware.com/cgi-bin/mailman/listinfo/cdash
>>>
>
>