[Dart] Email on Test Failure

[Ian Scott]

Jim,

Just in case this makes you fell more comfortable, I implemented the 
email on test failure in Dart classic.

My experience was exactly as you suggest. Its great for our small 
internal dashboard (3 nightly builds + continuous, but similar code base 
size to VXL). When you get a test failure due to an earlier compiler 
errors, then you get emailed anyway. So long as the compiler error and 
test failure are send in the same email - it doesn't increase the email 
load on the developers. Additionally Dart Classic does email on compiler 
warning, which we also use on our internal dashboard.

We don't use email on warning or test with the big public VXL dashboard 
for the reasons you mentioned.

Not that we are in any hurry to move from Dart Classic to new Dart, but 
the lack of this functionality is one thing that would prevent us upgrading.

Ian.


Miller, James V (GE, Research) wrote:
 > Alex,
 >
 > I have thought about an email on test failure feature (and nearly 
implemented it when the I implemented the email on build failure).
 >
 > The question is how to know who to contact when a test fails.  If you
 > are starting from a green dashboard, then you can link test failures
 > to commits fairly reliably.  However, many of our dashboards are rarely
 > completely green.  We usually have one or two lingering failures (out 
of 1000 tests).
 >
 > One option is that I could implement test failure like I implemented 
build failure and we simply would not use that feature on some of our
 > larger dashboards.
 >
 > Jim
 >
 >
 > -----Original Message-----
 > From: dart-bounces+millerjv=crd.ge.com at public.kitware.com
 > [mailto:dart-bounces+millerjv=crd.ge.com at public.kitware.com]On Behalf Of
 > Alex Brooks
 > Sent: Monday, June 19, 2006 4:54 AM
 > To: dart at public.kitware.com
 > Subject: [Dart] Email on Test Failure
 >
 >
 > Hi,
 >
 > I really like the (relatively recent) feature of emailing people when 
build errors are introduced.  We run a continuous build, so I know 
within a few minutes if I break something.
 >
 > As a consequence, I don't actually look at the dashboard all that 
often.  Since it doesn't send an email when a test failure is 
introduced, I can miss this occurrence and not pick it up for days or 
even weeks.
 >
 > Is email-on-test-failure planned as a feature?
 >
 >
 > Thanks,
 >
 > Alex
 > _______________________________________________
 > Dart mailing list
 > Dart at public.kitware.com
 > http://public.kitware.com/mailman/listinfo/dart
 > _______________________________________________
 > Dart mailing list
 > Dart at public.kitware.com
 > http://public.kitware.com/mailman/listinfo/dart