MantisBT - CDash
View Issue Details
0010290CDashpublic2010-02-14 11:472010-10-28 04:59
Alex Neundorf 
Julien Jomier 
normalmajoralways
closedfixed 
1.7 
1.6.4 
0010290: CDash sends failed-test emails, even when this is disabled
In my subscription settings for kdelibs on my.cdash.org, I have disabled the "Warning" and "Test" categories in the "Email categories" tab.
Nevertheless cdash sends me emails about the failing tests:

Subject: FAILED (t=75): kdelibs - SunOS-sunstudio-12.1-cmake-2.6.2 - Nightly
From: CDash <admin@www.cdash.org>
To: neundorf@kde.org
Date: Today 02:07:12
   
A submission to CDash for the project kdelibs has failing tests.
...

Since we have many failing tests in the nightly builds (mostly due to setup problems, like X server, dbus, etc.), this means that I get a lot of emails everyday, where the actual build breakages get lost among all the failing-test emails.

I am admin of the kdelibs project, is there anything else I would have to enable/disable in order to not get the failing-test emails ?

Alex
No tags attached.
jpg cdash-email-settings.jpg (95,114) 2010-03-05 14:12
https://public.kitware.com/Bug/file/2930/cdash-email-settings.jpg
jpg

jpg cdash-failure-emails.jpg (224,848) 2010-03-07 11:42
https://public.kitware.com/Bug/file/2935/cdash-failure-emails.jpg
jpg
Issue History
2010-02-14 11:47Alex NeundorfNew Issue
2010-02-21 12:27Julien JomierStatusnew => assigned
2010-02-21 12:27Julien JomierAssigned To => Julien Jomier
2010-02-21 12:29Julien JomierNote Added: 0019566
2010-02-21 13:01Alex NeundorfNote Added: 0019570
2010-02-22 13:16Alex NeundorfNote Added: 0019574
2010-03-03 12:59Alex NeundorfNote Added: 0019696
2010-03-03 13:45Julien JomierNote Added: 0019697
2010-03-04 15:35Alex NeundorfNote Added: 0019715
2010-03-05 12:51Alex NeundorfNote Added: 0019730
2010-03-05 13:49Julien JomierNote Added: 0019731
2010-03-05 13:53Alex NeundorfNote Added: 0019732
2010-03-05 13:57Julien JomierNote Added: 0019733
2010-03-05 13:57Julien JomierNote Added: 0019734
2010-03-05 14:02Alex NeundorfNote Added: 0019735
2010-03-05 14:05Julien JomierNote Added: 0019736
2010-03-05 14:12Alex NeundorfNote Added: 0019737
2010-03-05 14:12Alex NeundorfFile Added: cdash-email-settings.jpg
2010-03-05 14:24Julien JomierNote Added: 0019738
2010-03-05 14:30Julien JomierNote Added: 0019739
2010-03-06 13:06Alex NeundorfNote Added: 0019741
2010-03-06 14:23Julien JomierNote Added: 0019742
2010-03-07 11:42Alex NeundorfNote Added: 0019750
2010-03-07 11:42Alex NeundorfFile Added: cdash-failure-emails.jpg
2010-03-15 11:40Julien JomierNote Added: 0019885
2010-04-16 13:41Julien JomierStatusassigned => resolved
2010-04-16 13:41Julien JomierFixed in Version => 1.6.4
2010-04-16 13:41Julien JomierResolutionopen => fixed
2010-10-28 04:59Julien JomierStatusresolved => closed

Notes
(0019566)
Julien Jomier   
2010-02-21 12:29   
Can you confirm that the build had also some other errors despite "Tests" and "Warnings"?
(0019570)
Alex Neundorf   
2010-02-21 13:01   
I'll check tomorrow, I deleted the dashboard emails from today already.

Hope you hade a nice vacation :-)

Alex
(0019574)
Alex Neundorf   
2010-02-22 13:16   
Yes, this seems to be the case.

Why is it actually in a separate email ?

Also, the "FAILED(b=28, w=1)" emails also include the warnings, even while I disabled warnings.
It would be nice if they would contain only the errors then :-)

Alex
(0019696)
Alex Neundorf   
2010-03-03 12:59   
Hi Julien,

if you find some time, could you please have a look at this one ?
It is really a show stopper for us in KDE, since as it is cdash generates just too many emails, so if I show people this they will quickly start to ignore the emails. (we have many failing tests on the different platforms and it will take some time before they are fixed).

Alex
(0019697)
Julien Jomier   
2010-03-03 13:45   
Upgrading my.cdash.org right now. I'll let you know when it's done so you can test it out.
(0019715)
Alex Neundorf   
2010-03-04 15:35   
Thanks :-)
Will check what I get this night.

Alex
(0019730)
Alex Neundorf   
2010-03-05 12:51   
Unfortunately it doesn't look too good :-/

I got today the following 7 emails:
* FAILED (c=1): kdepimlibs - Linux-c++ - Nightly (vkpc7)
* FAILED (b=3, w=18): kdepimlibs - Linux-c++ - Nightly (vkpc7)
* FAILED (t=120): kdepimlibs - Linux-c++ - Nightly (vkpc7)

Looking at http://my.cdash.org/index.php?project=kdepimlibs&date=2010-03-05 [^]
there should have been also an email for "hammer" and for "dashboardbuild".

* FAILED (b=42, w=447): kdepim - Linux-c++ - Nightly (vkpc7)
* FAILED (t=27): kdepim - Linux-c++ - Nightly (vkpc7)
* FAILED (t=48): kdepim - Linux-gcc-4.3.2-cmake-2.6.2 - Nightly (hammer)
* FAILED (b=4, w=67): kdepim - Linux-gcc-4.3.2-cmake-2.6.2 - Nightly (hammer)

Looking at http://my.cdash.org/index.php?project=kdepim&date=2010-03-05 [^] , there should have been also an email for the failing build from "dashboardbuild".

So, there are still the emails with just failing tests, and there are missing emails.

For all projects, my subscription settings are
(x) Email me when checkins are breaking nightly dashboard
and for Update, Configure and Error, the other items ("Warning" and "Test") are not checked.

Looking at my.cdash.org, I should have received additional mails:

2 for kdeadmin: http://my.cdash.org/index.php?project=kdeadmin&date=2010-03-05 [^]

1 for kdebase: http://my.cdash.org/index.php?project=kdebase&date=2010-03-05 [^]

2 for kdelibs: http://my.cdash.org/index.php?project=kdelibs&date=2010-03-05 [^]

3 for kdenetwork: http://my.cdash.org/index.php?project=kdenetwork&date=2010-03-05 [^]

1 for kdeutils: http://my.cdash.org/index.php?project=kdeutils&date=2010-03-05 [^]

Alex
(0019731)
Julien Jomier   
2010-03-05 13:49   
I'm looking into it. Note that CDash doesn't send email if the failure is not new, so it's normal that you didn't get any emails for the builds reported.
(0019732)
Alex Neundorf   
2010-03-05 13:53   
Ah, I didn't know that.
Could that be also made configurable ?

Alex
(0019733)
Julien Jomier   
2010-03-05 13:57   
Yes, you can check "Email redundant failures" in the project settings.
(0019734)
Julien Jomier   
2010-03-05 13:57   
I found the problem for the categories, I'm going to upgrade my.cdash.org soon.
(0019735)
Alex Neundorf   
2010-03-05 14:02   
Hmm, I checked all tabs I think, but didn't find "Email redundant failures".
Where is it ?

While you're at it, would it also be possible to make it so that I get only one email per host instead of separate ones for the configure, build and test steps ?

Thanks a lot :-)
Alex
(0019736)
Julien Jomier   
2010-03-05 14:05   
This is a project configuration, under the Email tab for the project -> "Email redundant failures:". There is no way to get only one email per host, this is done by design because there is no way to know when to send the email because we don't know when the submission is done for a client.
(0019737)
Alex Neundorf   
2010-03-05 14:12   
I must be blind, I really can not see it (see the attached screenshot).

Alex
(0019738)
Julien Jomier   
2010-03-05 14:24   
Haha, something is going on, let me see where this option went on my.cdash.org :)
(0019739)
Julien Jomier   
2010-03-05 14:30   
Ok, should be better now. The email should be working as expected, otherwise let me know.
(0019741)
Alex Neundorf   
2010-03-06 13:06   
Unfortunately it still doesn't seem to do the right thing.
I switched the "Send redundant email" on in all my projects, and got a lot of emails today.
Also including email about failed tests (which I have disabled everyhwere):
* FAILED (t=27): kdepim - Linux-c++ - Nightly
* FAILED (t=135): kdelibs - SunOS-sunstudio-12.1-cmake-2.6.2 - Nightly
* FAILED (t=5): kdeadmin - FreeBSD-cmake-2.8.0 - Nightly
... and many more.

Alex
(0019742)
Julien Jomier   
2010-03-06 14:23   
That doesn't make any sense. Could you forward me one of the test message in private? I'll try to see what's going on.
(0019750)
Alex Neundorf   
2010-03-07 11:42   
Problem is still there. I'm attaching a screenshot showing all cdash emails I got today for yesterday.

Alex
(0019885)
Julien Jomier   
2010-03-15 11:40   
I have put some debugging statements, I'll see what I find. The local tests seem to work, I don't know why it's not working on the server. I'll keep you posted.