View Issue Details [ Jump to Notes ] [ Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0010290CDashpublic2010-02-14 11:472010-10-28 04:59
ReporterAlex Neundorf 
Assigned ToJulien Jomier 
PrioritynormalSeveritymajorReproducibilityalways
StatusclosedResolutionfixed 
PlatformOSOS Version
Product Version1.7 
Target VersionFixed in Version1.6.4 
Summary0010290: CDash sends failed-test emails, even when this is disabled
DescriptionIn my subscription settings for kdelibs on my.cdash.org, I have disabled the "Warning" and "Test" categories in the "Email categories" tab.
Nevertheless cdash sends me emails about the failing tests:

Subject: FAILED (t=75): kdelibs - SunOS-sunstudio-12.1-cmake-2.6.2 - Nightly
From: CDash <admin@www.cdash.org>
To: neundorf@kde.org
Date: Today 02:07:12
   
A submission to CDash for the project kdelibs has failing tests.
...

Since we have many failing tests in the nightly builds (mostly due to setup problems, like X server, dbus, etc.), this means that I get a lot of emails everyday, where the actual build breakages get lost among all the failing-test emails.

I am admin of the kdelibs project, is there anything else I would have to enable/disable in order to not get the failing-test emails ?

Alex
TagsNo tags attached.
Attached Filesjpg file icon cdash-email-settings.jpg [^] (95,114 bytes) 2010-03-05 14:12


jpg file icon cdash-failure-emails.jpg [^] (224,848 bytes) 2010-03-07 11:42

 Relationships

  Notes
(0019566)
Julien Jomier (manager)
2010-02-21 12:29

 Can you confirm that the build had also some other errors despite "Tests" and "Warnings"?
(0019570)
Alex Neundorf (reporter)
2010-02-21 13:01

 I'll check tomorrow, I deleted the dashboard emails from today already.

Hope you hade a nice vacation :-)

Alex
(0019574)
Alex Neundorf (reporter)
2010-02-22 13:16

 Yes, this seems to be the case.

Why is it actually in a separate email ?

Also, the "FAILED(b=28, w=1)" emails also include the warnings, even while I disabled warnings.
It would be nice if they would contain only the errors then :-)

Alex
(0019696)
Alex Neundorf (reporter)
2010-03-03 12:59

 Hi Julien,

if you find some time, could you please have a look at this one ?
It is really a show stopper for us in KDE, since as it is cdash generates just too many emails, so if I show people this they will quickly start to ignore the emails. (we have many failing tests on the different platforms and it will take some time before they are fixed).

Alex
(0019697)
Julien Jomier (manager)
2010-03-03 13:45

 Upgrading my.cdash.org right now. I'll let you know when it's done so you can test it out.
(0019715)
Alex Neundorf (reporter)
2010-03-04 15:35

 Thanks :-)
Will check what I get this night.

Alex
(0019730)
Alex Neundorf (reporter)
2010-03-05 12:51

 Unfortunately it doesn't look too good :-/

I got today the following 7 emails:
* FAILED (c=1): kdepimlibs - Linux-c++ - Nightly (vkpc7)
* FAILED (b=3, w=18): kdepimlibs - Linux-c++ - Nightly (vkpc7)
* FAILED (t=120): kdepimlibs - Linux-c++ - Nightly (vkpc7)

Looking at http://my.cdash.org/index.php?project=kdepimlibs&date=2010-03-05 [^]
there should have been also an email for "hammer" and for "dashboardbuild".

* FAILED (b=42, w=447): kdepim - Linux-c++ - Nightly (vkpc7)
* FAILED (t=27): kdepim - Linux-c++ - Nightly (vkpc7)
* FAILED (t=48): kdepim - Linux-gcc-4.3.2-cmake-2.6.2 - Nightly (hammer)
* FAILED (b=4, w=67): kdepim - Linux-gcc-4.3.2-cmake-2.6.2 - Nightly (hammer)

Looking at http://my.cdash.org/index.php?project=kdepim&date=2010-03-05 [^] , there should have been also an email for the failing build from "dashboardbuild".

So, there are still the emails with just failing tests, and there are missing emails.

For all projects, my subscription settings are
(x) Email me when checkins are breaking nightly dashboard
and for Update, Configure and Error, the other items ("Warning" and "Test") are not checked.

Looking at my.cdash.org, I should have received additional mails:

2 for kdeadmin: http://my.cdash.org/index.php?project=kdeadmin&date=2010-03-05 [^]

1 for kdebase: http://my.cdash.org/index.php?project=kdebase&date=2010-03-05 [^]

2 for kdelibs: http://my.cdash.org/index.php?project=kdelibs&date=2010-03-05 [^]

3 for kdenetwork: http://my.cdash.org/index.php?project=kdenetwork&date=2010-03-05 [^]

1 for kdeutils: http://my.cdash.org/index.php?project=kdeutils&date=2010-03-05 [^]

Alex
(0019731)
Julien Jomier (manager)
2010-03-05 13:49

 I'm looking into it. Note that CDash doesn't send email if the failure is not new, so it's normal that you didn't get any emails for the builds reported.
(0019732)
Alex Neundorf (reporter)
2010-03-05 13:53

 Ah, I didn't know that.
Could that be also made configurable ?

Alex
(0019733)
Julien Jomier (manager)
2010-03-05 13:57

 Yes, you can check "Email redundant failures" in the project settings.
(0019734)
Julien Jomier (manager)
2010-03-05 13:57

 I found the problem for the categories, I'm going to upgrade my.cdash.org soon.
(0019735)
Alex Neundorf (reporter)
2010-03-05 14:02

 Hmm, I checked all tabs I think, but didn't find "Email redundant failures".
Where is it ?

While you're at it, would it also be possible to make it so that I get only one email per host instead of separate ones for the configure, build and test steps ?

Thanks a lot :-)
Alex
(0019736)
Julien Jomier (manager)
2010-03-05 14:05

 This is a project configuration, under the Email tab for the project -> "Email redundant failures:". There is no way to get only one email per host, this is done by design because there is no way to know when to send the email because we don't know when the submission is done for a client.
(0019737)
Alex Neundorf (reporter)
2010-03-05 14:12

 I must be blind, I really can not see it (see the attached screenshot).

Alex
(0019738)
Julien Jomier (manager)
2010-03-05 14:24

 Haha, something is going on, let me see where this option went on my.cdash.org :)
(0019739)
Julien Jomier (manager)
2010-03-05 14:30

 Ok, should be better now. The email should be working as expected, otherwise let me know.
(0019741)
Alex Neundorf (reporter)
2010-03-06 13:06

 Unfortunately it still doesn't seem to do the right thing.
I switched the "Send redundant email" on in all my projects, and got a lot of emails today.
Also including email about failed tests (which I have disabled everyhwere):
* FAILED (t=27): kdepim - Linux-c++ - Nightly
* FAILED (t=135): kdelibs - SunOS-sunstudio-12.1-cmake-2.6.2 - Nightly
* FAILED (t=5): kdeadmin - FreeBSD-cmake-2.8.0 - Nightly
... and many more.

Alex
(0019742)
Julien Jomier (manager)
2010-03-06 14:23

 That doesn't make any sense. Could you forward me one of the test message in private? I'll try to see what's going on.
(0019750)
Alex Neundorf (reporter)
2010-03-07 11:42

 Problem is still there. I'm attaching a screenshot showing all cdash emails I got today for yesterday.

Alex
(0019885)
Julien Jomier (manager)
2010-03-15 11:40

 I have put some debugging statements, I'll see what I find. The local tests seem to work, I don't know why it's not working on the server. I'll keep you posted.

 Issue History
Date Modified Username Field Change
2010-02-14 11:47 Alex Neundorf New Issue
2010-02-21 12:27 Julien Jomier Status new => assigned
2010-02-21 12:27 Julien Jomier Assigned To => Julien Jomier
2010-02-21 12:29 Julien Jomier Note Added: 0019566
2010-02-21 13:01 Alex Neundorf Note Added: 0019570
2010-02-22 13:16 Alex Neundorf Note Added: 0019574
2010-03-03 12:59 Alex Neundorf Note Added: 0019696
2010-03-03 13:45 Julien Jomier Note Added: 0019697
2010-03-04 15:35 Alex Neundorf Note Added: 0019715
2010-03-05 12:51 Alex Neundorf Note Added: 0019730
2010-03-05 13:49 Julien Jomier Note Added: 0019731
2010-03-05 13:53 Alex Neundorf Note Added: 0019732
2010-03-05 13:57 Julien Jomier Note Added: 0019733
2010-03-05 13:57 Julien Jomier Note Added: 0019734
2010-03-05 14:02 Alex Neundorf Note Added: 0019735
2010-03-05 14:05 Julien Jomier Note Added: 0019736
2010-03-05 14:12 Alex Neundorf Note Added: 0019737
2010-03-05 14:12 Alex Neundorf File Added: cdash-email-settings.jpg
2010-03-05 14:24 Julien Jomier Note Added: 0019738
2010-03-05 14:30 Julien Jomier Note Added: 0019739
2010-03-06 13:06 Alex Neundorf Note Added: 0019741
2010-03-06 14:23 Julien Jomier Note Added: 0019742
2010-03-07 11:42 Alex Neundorf Note Added: 0019750
2010-03-07 11:42 Alex Neundorf File Added: cdash-failure-emails.jpg
2010-03-15 11:40 Julien Jomier Note Added: 0019885
2010-04-16 13:41 Julien Jomier Status assigned => resolved
2010-04-16 13:41 Julien Jomier Fixed in Version => 1.6.4
2010-04-16 13:41 Julien Jomier Resolution open => fixed
2010-10-28 04:59 Julien Jomier Status resolved => closed

Copyright © 2000 - 2018 MantisBT Team