[CMake] ctest timer question

[David Cole]

Nope. This is the right list..... (Or you may want to try the Dart mailing
list if this does not answer your question...)

If you look at the source in "CMake/Source/CTest/cmCTestTestHandler.cxx" you
will find where the "Execution Time" NamedMeasurement xml element is emitted
into the Test.xml file that gets submitted to the dart server. This time is
measured by CTest when it runs your test, and includes launching the
executable and waiting for it to finish...

If you want to include measurements of your own design in the dashboard
results for your test, you can emit "DartMeasurement" xml fragments in your
test's output, and ctest will include those as NamedMeasurement xml elements
in the Test.xml file.

Something like this, for example, in your test output:
<DartMeasurement name="MyMoreAccurateTiming" type="numeric/double">0.03434
</DartMeasurement>

The code that transforms those xml fragments can also be found in
cmCTestTestHandler. I do not know if all measurements of this type show up
as entities that get graphed on the dashboard web pages, but I do know that
they show up when viewing an individual test's result page.

Good luck,
David Cole


On 10/17/07, James Bigler <bigler at cs.utah.edu> wrote:
>
> Is there a CTest mailing list or Dart mailing list I should ask this
> question on?
>
> Thanks,
> James
>
> James Bigler wrote:
> > I'm not sure if this is the right place to ask this question, so please
> > inform me if there is a better list to post this question to.
> >
> > I'm starting to use ctest to submit some tests to a dart server.  One of
> > the nightly tests I run is a benchmark test.  The execution time in the
> > dart display doesn't match the actual run time reported by my test to
> > stdout.  The dart times vary wildly whereas the times reported by my
> > executable are identical.
> >
> > I know that Dart provides a way to graph a reported value over time (it
> > does this with the current test run time), and I was wondering if there
> > was a way I could grab the stdout from my test, get the value I need and
> > submit that to the dash board.
> >
> > Currently, my test looks like this:
> >
> > ADD_TEST(DefaultSceneNoDisplayBench ${CMAKE_BINARY_DIR}/bin/manta
> > "-nodisplaybench")
> >
> > My current drop method is "xmlrpc".
> >
> > Thanks,
> > James
> _______________________________________________
> CMake mailing list
> CMake at cmake.org
> http://www.cmake.org/mailman/listinfo/cmake
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://public.kitware.com/pipermail/cmake/attachments/20071017/c3dc5b22/attachment.html