[Dart] Present multiple DART reports from same site in one row?

[Blezek, Daniel J (GE, Research)]

Hi Matt,

  The short answer is yes, you can do this without any changes to the
Dart source.

Longer answer:

  Dart uses the site/buildname to identify the client during a
sumbission.  It also takes the BuildStamp into account.  So each time
you submit from the same Client with a different BuildStamp, you get a
new row on the Dashboard.  To do what you describe, simply fix the
BuildStamp to midnight for the entire day.  Throughout the day, just
submit tests with the same BuildStamp.  Dart, however, is set up to
overwrite repeated Tests, so you'd need to modify the test name to make
them all unique, perhaps adding the time of day.  Then you should get
one row per client on the Dashboard, with accumulating
Passed/Failed/NotRun status on the dashboard.  As a nice benefit, the
Tests would be ordered from morning to evening in the detail pages.

Have a whack at it, and let me know if you bump into any problems!
-dan 

-----Original Message-----
From: dart-bounces+blezek=crd.ge.com at public.kitware.com
[mailto:dart-bounces+blezek=crd.ge.com at public.kitware.com] On Behalf Of
Matt England
Sent: Wednesday, September 20, 2006 9:07 PM
To: Dart email list
Cc: mengland at mengland.net
Subject: [Dart] Present multiple DART reports from same site in one row?

Summary:

Is there a way to make multiple reports from same site coalesce into one
row in the DART web display?

Details:

We (the Cleversafe dispersed-storage project) are now bringing to life a
large-scale, distributed, automated-testing framework that currently
uses DART as it's primary reporting mechanism.  This framework (even
with only the 4 or so client test machines we have right now) can
generate thousands of test reports per day, potentially hundreds of
thousands.  (And to be clear, these are far from just build-from-src
reports; these are actual reports on the behavior of our software as
generated directly by the DART knowledge embedded into our various
software applications.)

Specifically, one site/machine can generate many reports in one day, but
it's not submitting all these reports at one time--we wish to have the
reports come in as the test results are run, and we specifically do not
want to have these reports "cached" into one big report at the end of
the day.

However, we don't want thousands (or tens/hundreds of thousands) of rows
listed in our DART view as the number of reports grow.  If the DART web
view can coalesce all the reports from one site into one row (and make
the time stamp presented be one of the last report received), this would
greatly reduce the list length of the DART report presentation web page.

Is there a way to configure DART to do this?  If not, would this be a
feasible patch we can make?  (We've patched DART before, and are not
afraid to do it again.)  If so, can we get some recommendations on
where/how to do this?

Here's an example of our just a few reports that we generated today with
an early prototype of our distributed test framework with just a few (5
or
less) client machines reporting:

http://csbase1.com:8081/dscore-reports/Dashboard/Dashboard?trackid=359

It's REALLY long, and there's mostly only 4 clients listed there.   It
sure 
would be nice to combine all these reports together into one row and
simply increase the NotRun/Failed/Passed counters per site, accordingly.

We're going to be lighting up at least 15 clients like this by the end
of the week...and probably 500 to 1000 clients in the next 6 months.  We
need to solve this problem quickly.

Thanks for any help,
-Matt
Dispersed Storage:  http://cleversafe.org

_______________________________________________
Dart mailing list
Dart at public.kitware.com
http://public.kitware.com/mailman/listinfo/dart