View Issue Details Jump to Notes ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0008926CDashpublic2009-04-23 11:592009-05-18 11:10
ReporterFrançois Bertel 
Assigned ToJulien Jomier 
PrioritynormalSeverityminorReproducibilityalways
StatusclosedResolutionfixed 
PlatformOSOS Version
Product Version1.4 
Target VersionFixed in Version1.4 
Summary0008926: test timeout not reported
Description* cdash 1.4.1 on VTKEdge
* ctest CVS head

arkadia has a timeout set to 35 seconds on vtkedge with
set(CTEST_TEST_TIMEOUT 35)
ref:
https://www.kitware.com/CDash/viewNotes.php?buildid=35411 [^]

The two following tests are failing because they time out (PaintbrushTest6 and PaintbrushTest8):

https://www.kitware.com/CDash/viewTest.php?onlyfailed&buildid=35411 [^]

you can see the execution time is about 35 seconds.

The problem is cdash does not tell they are failing because they time out, the only information is:

* "status" failed
* "details" Completed

going to the report itself:
https://www.kitware.com/CDash/testDetails.php?test=1347461&build=35411 [^]

the only information is:

Completion Status Completed
Exit Value 0

ctest reports the timeout correctly, the fault is on cdash side, see how Testing/20090423-0400/Test.xml itself informs about the timeout (see line <NamedMeasurement type="text/string" name="Exit Code"><Value>Timeout</Value></NamedMeasurement>):


  <Test Status="failed">
                <Name>PaintbrushTest6</Name>
                <Path>./Widgets/Testing/Cxx</Path>
                <FullName>./Widgets/Testing/Cxx/PaintbrushTest6</FullName>
                <FullCommandLine>/home/kitware/dashboards/vtkedge-build-all-debug/bin/VTKEdgeWidgetsCxxTests PaintbrushTest6 /home/kitware/dashboards/VTKEdge/Data/Data/HeadMR.mha /home/kitware/dashboards/VTKEdge/Data/Data/Ventricles.mha /home/kitware/dashboards/VTKEdge/Data/Data/PaintbrushTest6InputEventLog.txt 0</FullCommandLine>
                <Results>
                        <NamedMeasurement type="text/string" name="Exit Code"><Value>Timeout</Value></NamedMeasurement>
                        <NamedMeasurement type="text/string" name="Exit Value"><Value>0</Value></NamedMeasurement>
                        <NamedMeasurement type="numeric/double" name="Execution Time"><Value>35.0895</Value></NamedMeasurement>
                        <NamedMeasurement type="text/string" name="Completion Status"><Value>Completed</Value></NamedMeasurement>
                        <NamedMeasurement type="text/string" name="Command Line"><Value>/home/kitware/dashboards/vtkedge-build-all-debug/bin/VTKEdgeWidgetsCxxTests PaintbrushTest6 /home/kitware/dashboards/VTKEdge/Data/Data/HeadMR.mha /home/kitware/dashboards/VTKEdge/Data/Data/Ventricles.mha /home/kitware/dashboards/VTKEdge/Data/Data/PaintbrushTest6InputEventLog.txt 0</Value></NamedMeasurement>
                        <Measurement>
                                <Value>Interaction replaying.....
</Value>
                        </Measurement>
                </Results>
        </Test>


The log on arkadia also tells that there was a time out:

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:154 Current_Time: Apr 23 03:06 EDT

/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:661 27/
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:662 30
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:669 Testing
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:671
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:684 PaintbrushTest6 ..............
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:687 Testing PaintbrushTest6 ...
/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:735
Test command: /home/kitware/dashboards/vtkedge-build-all-debug/bin/VTKEdgeWidgetsCxxTests PaintbrushTest6 /home/kitware/dashboards/VTKEdge/Data/Data/HeadMR.mha /home/kitware/dashboards/VTKEdge/Data/Data/Ventricles.mha /home/kitware/dashboards/VTKEdge/Data/Data/PaintbrushTest6InputEventLog.txt 0

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:154 Current_Time: Apr 23 03:06 EDT

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:1105 Test timeout computed to be: 35

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:1178 Command is: /home/kitware/dashboards/vtkedge-build-all-debug/bin/VTKEdgeWidgetsCxxTests

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:1195 Interaction replaying.....

/home/kitware/dashboards/CMake/Source/cmCTest.cxx:1208 -- Process completed

/home/kitware/dashboards/CMake/Source/CTest/cmCTestTestHandler.cxx:844 ***Timeout
TagsNo tags attached.
Attached Files

 Relationships

  Notes
(0016190)
Julien Jomier (manager)
2009-04-25 11:47

Thanks for the report!

 Issue History
Date Modified Username Field Change
2009-04-23 11:59 François Bertel New Issue
2009-04-25 11:46 Julien Jomier Status new => assigned
2009-04-25 11:46 Julien Jomier Assigned To => Julien Jomier
2009-04-25 11:47 Julien Jomier Note Added: 0016190
2009-04-25 11:47 Julien Jomier Status assigned => resolved
2009-04-25 11:47 Julien Jomier Fixed in Version => 1.4
2009-04-25 11:47 Julien Jomier Resolution open => fixed
2009-05-18 11:10 Julien Jomier Status resolved => closed


Copyright © 2000 - 2018 MantisBT Team