<font color='black' size='2' face='arial'>Don't forget<font size="2">, there are also these pages already available:<br>
<br>
<font size="2">This one</font><font size="2"><font size="2"> [ </font>http://open.cdash.org/testOverview.php?project=VTK ]<font size="2"> shows a summary of the names of the tests that are failing in a given group. After you <font size="2">get to the <font size="2">page, you have to choose "Nightly Expected" to see those test failures. This is the closest thing there is to "a summary page that shows what's wrong with a given group", but there are no<font size="2"> <font size="2">details on that page, and you're still <font size="2">2 cli<font size="2">cks away from seeing details.</font></font></font></font><br>
<br>
<font size="2">This one [ http://open.cdash.org/queryTests.php?project=VTK&date=&limit=10 ] allows you to choose filter parameters, but (unfortunately) there is no easy way<font size="2"> on that page </font>to <font size="2">limit <font size="2">the output to a given <font size="2">bui<font size="2">ld group.</font></font></font></font></font> And again, you'<font size="2">re at least <font size="2">1 click away from seeing any details.</font></font><br>
<br>
<font size="2">It would be better to modify CDash to prov<font size="2">ide the <font size="2">desi<font size="2">red <font size="2">page than it would to introduce scraping scripts. If the scraping scripts run "too much" or automatically, rather than strictly on demand by <font size="2">developers when they need it,</font></font></font></font></font></font> it will just put a mostly unnecessary burden on the CDash server. This page should only be produced *on demand*, not on an automatic<font size="2"> schedule.</font><br>
<br>
<br>
<font size="2">D<br>
</font></font></font></font></font></font><font color="black" face="arial" size="2"><br>
<div> <br>
</div>
<div> <br>
</div>
<div style="font-family:arial,helvetica;font-size:10pt;color:black">-----Original Message-----<br>
From: David E DeMarle <dave.demarle@kitware.com><br>
To: Bill Lorensen <bill.lorensen@gmail.com><br>
Cc: VTK Developers <vtk-developers@vtk.org>; cdash <cdash@public.kitware.com>; Bill Hoffman <bill.hoffman@kitware.com><br>
Sent: Tue, Feb 12, 2013 9:06 pm<br>
Subject: Re: [vtk-developers] [Cdash] CDash query for all failing tests<br>
<br>
<div id="AOLMsgPart_0_1ca94d75-7f50-40a9-9b97-59604b603e78" style="margin: 0px;font-family: Tahoma, Verdana, Arial, Sans-Serif;font-size: 12px;color: #000;background-color: #fff;">
<pre style="font-size: 9pt;"><tt>The second script does essentially the same thing that Dave Cole did years ago
Ie:
<a href="http://www.cmake.org/Wiki/CMake_Useful_Variables/Get_Variables_From_CMake_Dashboards" target="_blank">http://www.cmake.org/Wiki/CMake_Useful_Variables/Get_Variables_From_CMake_Dashboards</a>
I assume that was in the dart days as it didn't work for me right off
the bat, so I decided to roll my own.
David E DeMarle
Kitware, Inc.
R&D Engineer
21 Corporate Drive
Clifton Park, NY 12065-8662
Phone: 518-881-4909
On Tue, Feb 12, 2013 at 9:02 PM, David E DeMarle
<<a href="mailto:dave.demarle@kitware.com">dave.demarle@kitware.com</a>> wrote:
> If you run vtk_fail_summary.py it will summarize all the test failures
> on the nightly expected group, from there you have to dig deeper than
> the cdash web api will let you go.
>
> To go down that route, take a look at vtk_submitter_summary.py. It
> scrapes the raw html pages to get the results of a particular
> test on every machine. The script and the accompanying test (once I finish and
> commit them) will give us the details of each submitter's configuration, so
> that we can inspect the testing space and know what configurations we
> are testing and what we aren't.
>
> David E DeMarle
> Kitware, Inc.
> R&D Engineer
> 21 Corporate Drive
> Clifton Park, NY 12065-8662
> Phone: 518-881-4909
>
>
> On Tue, Feb 12, 2013 at 4:04 PM, Bill Lorensen <<a href="mailto:bill.lorensen@gmail.com">bill.lorensen@gmail.com</a>>
wrote:
>> Bill,
>>
>> Thanks. I knew how to do that. I was hoping I could see all the
>> failing test details. I'll have to do it by hand. Or maybe I can
>> figure out a way to scrape the cdash pages.
>>
>> Currently VTK has 18 Nightly Expected builds with test failures
>> (actually that is every build in that group). I'd like to generate a
>> page (or spreadsheet) that shows every failing test (today there are
>> 123 total tests failing).
>>
>> Bill
>>
>> On Tue, Feb 12, 2013 at 3:23 PM, Bill Hoffman <<a href="mailto:bill.hoffman@kitware.com">bill.hoffman@kitware.com</a>>
wrote:
>>> On 2/12/2013 1:53 PM, Bill Lorensen wrote:
>>>>
>>>> Folks,
>>>>
>>>> Is there a cdash query that can provide, on a single page, links to
>>>> all failing tests for a given group, say "Nightly Expected"?
>>>>
>>>> Bill
>>>> _______________________________________________
>>>> Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a>
>>>>
>>>> Visit other Kitware open-source projects at
>>>> <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a>
>>>>
>>>> Follow this link to subscribe/unsubscribe:
>>>> <a href="http://www.vtk.org/mailman/listinfo/vtk-developers" target="_blank">http://www.vtk.org/mailman/listinfo/vtk-developers</a>
>>>>
>>>>
>>>
>>> You can do something like this:
>>>
>>> <a href="http://open.cdash.org/index.php?project=CMake&date=2013-02-12&filtercount=2&showfilters=1&filtercombine=and&field1=groupname/string&compare1=63&value1=Nightly%20Expected&field2=testsfailed/number&compare2=43&value2=0" target="_blank">http://open.cdash.org/index.php?project=CMake&date=2013-02-12&filtercount=2&showfilters=1&filtercombine=and&field1=groupname/string&compare1=63&value1=Nightly%20Expected&field2=testsfailed/number&compare2=43&value2=0</a>
>>>
>>> If you create a filter you can match the group name. Unfortunately, you can
>>> not show errors and test failures. You can only match all or any of the
>>> filters. I think CDash needs to be able to have the any or all be applied
>>> to each of the filters so you can create a filter that will show you any red
>>> in a group. But you can show all failing tests for a group. :)
>>>
>>> -Bill
>>>
>>>
>>> --
>>> Bill Hoffman
>>> Kitware, Inc.
>>> 28 Corporate Drive
>>> Clifton Park, NY 12065
>>> <a href="mailto:bill.hoffman@kitware.com">bill.hoffman@kitware.com</a>
>>> <a href="http://www.kitware.com" target="_blank">http://www.kitware.com</a>
>>> 518 881-4905 (Direct)
>>> 518 371-3971 x105
>>> Fax (518) 371-4573
>>
>>
>>
>> --
>> Unpaid intern in BillsBasement at noware dot com
>> _______________________________________________
>> Cdash mailing list
>> <a href="mailto:Cdash@public.kitware.com">Cdash@public.kitware.com</a>
>> <a href="http://public.kitware.com/cgi-bin/mailman/listinfo/cdash" target="_blank">http://public.kitware.com/cgi-bin/mailman/listinfo/cdash</a>
_______________________________________________
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a>
Follow this link to subscribe/unsubscribe:
<a href="http://www.vtk.org/mailman/listinfo/vtk-developers" target="_blank">http://www.vtk.org/mailman/listinfo/vtk-developers</a>
</tt></pre>
</div>
<!-- end of AOLMsgPart_0_1ca94d75-7f50-40a9-9b97-59604b603e78 -->
</div>
</font></font>