[vtk-developers] Dashboard hasn't shown "diff" images since CMake 2.8

[Dave Partyka]

I think I have fixed this on the VTK side. In vtkTesting we were always
defining the Testing/Temporary directory relatively. I added code to expand
it to a full path. I see difference images on the 2.8 driven Continuous
dashboard now. We'll have to see what happens tonight.

Bill Hoffman and I tried digging into the CMake code for test handling,
suspecting that the working directory was being changed after the test was
run but before the dashboard xml was processed, but were not successful.
More investigation with a debugger will be needed to figure out what's
broken on the CMake end.

On Mon, Oct 18, 2010 at 11:00 AM, David Gobbi <david.gobbi at gmail.com> wrote:

> I've reported the bug.
>
> On Mon, Oct 18, 2010 at 8:33 AM, David Cole <david.cole at kitware.com>
> wrote:
> > I bet if you get rid of the other error log spew that the problem "goes
> > away"...
> > But still, something in ctest must have changed to trigger this.
> > I don't have time to investigate quickly and immediately, but please log
> a
> > bug and somebody will get to it, hopefully in time for the *next* cmake
> > release. (Not the impending 2.8.3 release, but the next one...)
> >
> > Thanks,
> > David C.
> >
> > On Mon, Oct 18, 2010 at 10:05 AM, David Gobbi <david.gobbi at gmail.com>
> wrote:
> >>
> >> Also interesting, I looked at cherry.hooperlab on the dashboard, and
> >> found one test that is finding the diff images:
> >> http://www.cdash.org/CDash/testDetails.php?test=69308655&build=752172
> >>
> >> But the spiderplot test, strangely enough, isn't:
> >> http://www.cdash.org/CDash/testDetails.php?test=69308021&build=752172
> >>
> >> So ctest-2.8 might just be finicky about some of VTK's cmake scripts.
> >>
> >>  David
> >>
> >> On Mon, Oct 18, 2010 at 7:58 AM, Dave Partyka <dave.partyka at kitware.com
> >
> >> wrote:
> >> > Very interesting,
> >> > I just reproduced this on my machine using two experimental
> dashboards,
> >> > just
> >> > switching between 2.6.4 and 2.8.2 as the driving ctest.
> >> >
> >> >
> http://www.cdash.org/CDash/index.php?project=VTK&date=2010-10-16#Experimental
> >> > 2.8.2
> >> > http://www.cdash.org/CDash/viewTest.php?onlyfailed&buildid=750970
> >> > 2.6.4
> >> > http://www.cdash.org/CDash/viewTest.php?onlyfailed&buildid=750967
> >> > I will pester the CMake guys.
> >> >
> >> > On Sat, Oct 16, 2010 at 4:07 PM, David Gobbi <david.gobbi at gmail.com>
> >> > wrote:
> >> >>
> >> >> When a dashboard fails due to an image difference, errors like the
> >> >> following are given instead of the actual diff image being shown:
> >> >>
> >> >> File ../../../Testing/Temporary/TestSpiderPlotActor.png not found
> >> >> File ../../../Testing/Temporary/TestSpiderPlotActor.diff.png not
> found
> >> >>
> >> >> For example, see yesterday's dashboard:
> >> >>
> http://www.cdash.org/CDash/testDetails.php?test=69080454&build=750165
> >> >>
> >> >> When I run ctest-2.8 on my home machine, I see these same errors.
> >> >> But with ctest-2.6, the image difference is correctly reported.
> >> >>
> >> >> So ctest-2.8 is not finding or submitting the .png files that the
> tests
> >> >> produce.
> >> >> Is this an error with ctest or an error within VTK?
> >> >>
> >> >>  David
> >> >> _______________________________________________
> >> >> Powered by www.kitware.com
> >> >>
> >> >> Visit other Kitware open-source projects at
> >> >> http://www.kitware.com/opensource/opensource.html
> >> >>
> >> >> Follow this link to subscribe/unsubscribe:
> >> >> http://www.vtk.org/mailman/listinfo/vtk-developers
> >> >>
> >> >
> >> >
> >> _______________________________________________
> >> Powered by www.kitware.com
> >>
> >> Visit other Kitware open-source projects at
> >> http://www.kitware.com/opensource/opensource.html
> >>
> >> Follow this link to subscribe/unsubscribe:
> >> http://www.vtk.org/mailman/listinfo/vtk-developers
> >>
> >
> >
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Follow this link to subscribe/unsubscribe:
> http://www.vtk.org/mailman/listinfo/vtk-developers
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://public.kitware.com/pipermail/vtk-developers/attachments/20101019/bfc8bcb3/attachment.html>