No subject
Sun Apr 3 09:54:08 EDT 2011
Kitware Robot has submitted this change and it was merged.
Change subject: COMP: Intermittent test failure
......................................................................
COMP: Intermittent test failure
itkInitializationBiasedParticleSwarmOptimizerTest is failing
intermittenly. This patch enables more verbose (but not too verbose)
output to help track down the problem.
It seems the test was failing a tolerance check on the results of the
optimization. This was due to hitting the max number of iterations
stop condition rather than the parameter tolerance stop
condition. This patch increases the max number of iterations, forcing
a parameter tolerance stop condition.
It is not clear whether this is a deterministic algorithm. Should we
expect consistent answers for each run?
This patch does not address the deterministic issue.
Change-Id: Ie2110c51639f491cb7b8a6287b0eaeb1370c50bd
---
M Modules/Numerics/Optimizers/test/itkInitializationBiasedParticleSwarmOpti=
mizerTest.cxx
1 file changed, 45 insertions(+), 90 deletions(-)
Approvals:
Hans J. Johnson: Verified; Looks good to me, approved
Bill Lorensen: Verified; Looks good to me, but someone else must approve
--
To view, visit http://review.source.kitware.com/2793
To unsubscribe, visit http://review.source.kitware.com/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ie2110c51639f491cb7b8a6287b0eaeb1370c50bd
Gerrit-PatchSet: 2
Gerrit-Project: ITK
Gerrit-Branch: master
Gerrit-Owner: Bill Lorensen <bill.lorensen at gmail.com<mailto:bill.lorensen at g=
mail.com>>
Gerrit-Reviewer: Bill Lorensen <bill.lorensen at gmail.com<mailto:bill.lorense=
n at gmail.com>>
Gerrit-Reviewer: Hans J. Johnson <hans-johnson at uiowa.edu<mailto:hans-johnso=
n at uiowa.edu>>
Gerrit-Reviewer: Matt McCormick <matt.mccormick at kitware.com<mailto:matt.mcc=
ormick at kitware.com>>
Gerrit-Reviewer: Ziv Yaniv <zyaniv at childrensnational.org<mailto:zyaniv at chil=
drensnational.org>>
________________________________
Notice: This UI Health Care e-mail (including attachments) is covered by th=
e Electronic Communications Privacy Act, 18 U.S.C. 2510-2521, is confidenti=
al and may be legally privileged. If you are not the intended recipient, y=
ou are hereby notified that any retention, dissemination, distribution, or =
copying of this communication is strictly prohibited. Please reply to the =
sender that you have received the message in error, then delete it. Thank =
you.
________________________________
--_000_CA989C1E29C92hansjohnsonuiowaedu_
Content-Type: text/html; charset="us-ascii"
Content-ID: <13C4F48F55C97643BC1A7EDB46562CBC at mailhost6.uiowa.edu>
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
</head>
<body style=3D"word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font=
-family:Calibri,sans-serif">
<div>Bill,</div>
<div><br>
</div>
<div>There were fewer failures, but there a still two similar failures:</di=
v>
<div><br>
</div>
<div><span class=3D"Apple-style-span" style=3D"background-color:rgb(255,255=
,255); font-family:Arial,Helvetica,sans-serif">
<pre>Reason for stopping optimization:
InitializationBiasedParticleSwarmOptimizer: successfuly converged after 95=
iterations
Known parameters =3D [2, -2] Estimated parameters =3D [2.1757, -2.09753=
]
[Test 2 FAILURE]</pre>
<pre><br></pre>
<pre>Hans</pre>
<pre><br></pre>
</span></div>
<div><br>
</div>
<span id=3D"OLK_SRC_BODY_SECTION">
<div style=3D"font-family:Calibri; font-size:11pt; text-align:left; color:b=
lack; border-bottom:medium none; border-left:medium none; padding-bottom:0i=
n; padding-left:0in; padding-right:0in; border-top:#b5c4df 1pt solid; borde=
r-right:medium none; padding-top:3pt">
<span style=3D"font-weight:bold">From: </span>Bill Lorensen <<a href=3D"=
mailto:bill.lorensen at gmail.com">bill.lorensen at gmail.com</a>><br>
<span style=3D"font-weight:bold">Date: </span>Thu, 15 Sep 2011 23:15:30 -04=
00<br>
<span style=3D"font-weight:bold">To: </span>"Yaniv, Ziv" <<a h=
ref=3D"mailto:ZYaniv at childrensnational.org">ZYaniv at childrensnational.org</a=
>><br>
<span style=3D"font-weight:bold">Cc: </span>Matt McCormick <<a href=3D"m=
ailto:matt.mccormick at kitware.com">matt.mccormick at kitware.com</a>>, Hans =
Johnson <<a href=3D"mailto:hans-johnson at uiowa.edu">hans-johnson at uiowa.ed=
u</a>>, ITK <<a href=3D"mailto:insight-developers at itk.org">insight-de=
velopers at itk.org</a>><br>
<span style=3D"font-weight:bold">Subject: </span>Re: Change in ITK[master]:=
COMP: Intermittent test failure<br>
</div>
<div><br>
</div>
Ziv,<br>
<br>
The problem with the test was that sometimes it was terminating on iteratio=
ns. When this happened, the tolerance was not always satisfied.<br>
<br>
I upped the number of max iterations and I think the test should pass conos=
istently.<br>
<br>
We'll see.<br>
<br>
Usually for non-deterministic algorithms the test seeds the random number g=
enerator with a fixed number.<br>
<br>
<div class=3D"gmail_quote">On Thu, Sep 15, 2011 at 8:43 PM, Yaniv, Ziv <spa=
n dir=3D"ltr">
<<a href=3D"mailto:ZYaniv at childrensnational.org">ZYaniv at childrensnationa=
l.org</a>></span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0pt 0pt 0pt 0.8ex; border=
-left:1px solid rgb(204,204,204); padding-left:1ex">
<u></u>
<div>
<p><font size=3D"2">Hi Bill,<br>
<br>
I was traveling and did not have internet connection for a day. Back online=
. The PSO family of algorithms is stochastic and does not ensure convergenc=
e to the local minimum. My initial implementation of the tests dealt with t=
his by running them multiple times
and if a certain percentage was successful then the test was declared succ=
essful. Perhaps this is not the best way to test such algorithms but I do n=
ot have a better idea. The nice feature of PSO is that it efficiently explo=
res a rugged parameter space. A
common practice is to run the PSO and then initialize a standard optimizer=
with the previous result, ensuring converges to the local minimum.<br>
<br>
What approach does ITK use to tests non-deterministic algorithms?<br>
<br>
&nb=
sp; regards<br>
&nb=
sp; Ziv<br>
<br>
--<br>
Ziv Yaniv, PhD.,<br>
Principal Investigator,<br>
The Sheikh Zayed Institute for Pediatric Surgical Innovation<br>
Children's National Medical Center<br>
6th Floor Main Hospital, Room M7740<br>
111 Michigan Ave., N.W<br>
Washington, D.C 20010<br>
Phone: <a href=3D"tel:202-476-1288" value=3D"+12024761288" target=3D"_b=
lank">202-476-1288</a><br>
email: <a href=3D"mailto:zyaniv at childrensnational.org" target=3D"_blank">zy=
aniv at childrensnational.org</a></font></p>
<div>
<div></div>
<div class=3D"h5"><font size=3D"2"><br>
<br>
<br>
<br>
<br>
-----Original Message-----<br>
From: Code Review [<a href=3D"mailto:review at kitware.com" target=3D"_blank">=
mailto:review at kitware.com</a>]<br>
Sent: Thu 9/15/2011 6:25 PM<br>
To: Bill Lorensen<br>
Cc: Matt McCormick; Hans J. Johnson; Yaniv, Ziv<br>
Subject: Change in ITK[master]: COMP: Intermittent test failure<br>
<br>
More information about the Insight-developers
mailing list