<div>Hi,</div>
<div> </div>
<div>Most of the optimizers which I have came across help in finding the local minima around the given initial approximation. But in that case I mostly end up in a wrong place. Is there any algorithm which helps to scan the global space somehow and help in determining the global minima.
</div>
<div> </div>
<div>Other problem that I am facing with the conjugate gradient method is that the scales do not work for conjugate gradient optimizer. The scales are only taken into account in the very first initialization step and are never considered again in any of the latter iterations. I want to fix some of the parameters by setting the scale to some extreme value (I used to set 100 or something for regular step gradient descent optimizer and it used to serve the purpose very conveniently).
</div>
<div> </div>
<div>any help will be highly appreciated,</div>
<div>with regards,</div>
<div>Ashish.<br><br> </div>
<div><span class="gmail_quote">On 5/18/05, <b class="gmail_sendername">Luis Ibanez</b> <<a href="mailto:luis.ibanez@kitware.com">luis.ibanez@kitware.com</a>> wrote:</span>
<blockquote class="gmail_quote" style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid"><br>Hi Ashish,<br><br>The Conjugate Gradient method is only convenient when the cost<br>function has smooth second derivatives. If your cost function
<br>is noisy, is is unlikely that this optimizer will behave nicely.<br><br>Note that is is common to find that Image Metrics are rather<br>noisy functions.<br><br><br><br> Regards,<br><br><br> Luis<br><br><br><br>
--------------------<br><br>Ashish Poddar wrote:<br><br>> Hi,<br>><br>> I also am right now struggling with the initialization options for the<br>> Conjugate Gradient for which I could not find any examples. While
<br>> searching I came across an example for Levenberg Marquardt Optimizer<br>> which seems to be having similar interface as that of conjugate<br>> gradient optimizer. However the similar initialization did not worked
<br>> for Conjugate gradient. If someone can point out any reference for<br>> Conjugate Gradient, it would be great.<br>><br>> Earlier I was using regular step gradient descent optimizer with these<br>> parameters:
<br>> Transform - Centered Affine<br>> Scale for first 9 parameters - 1.0<br>> Scale for next 6 parameters - 0.0001<br>> Number of Iterations - 400<br>> Minimum Step Length - 0.0001<br>> Maximum Step Length -
0.005<br>><br>> Any help will be highly appreciated,<br>> with regards,<br>> Ashish.<br>><br>><br>><br>> On 5/17/05, Ashish Poddar <<a href="mailto:ahpoddar@gmail.com">ahpoddar@gmail.com</a>> wrote:
<br>><br>>>Hi Luis,<br>>><br>>>Thank you for the quick action. probably similar change is required<br>>>for Levenberg Marquardt Optimizer too.<br>>><br>>>with regards,<br>>>Ashish.
<br>>><br>>>On 5/16/05, Luis Ibanez <<a href="mailto:luis.ibanez@kitware.com">luis.ibanez@kitware.com</a>> wrote:<br>>><br>>>>Hi Ashish,<br>>>><br>>>>Thanks for pointing this out.
<br>>>><br>>>>You are right, the GetValue() method should be const.<br>>>><br>>>>A fix has now been committed to the CVS repository.<br>>>><br>>>>Please let us know if you encounter any other problem.
<br>>>><br>>>> Thanks<br>>>><br>>>> Luis<br>>>><br>>>>----------------------<br>>>>Ashish Poddar wrote:<br>>>><br>>>>>hi,<br>>>>>
<br>>>>>I am not sure whether it qualifies as a bug or not, but surely affects<br>>>>>the re-usability and pluggability model of ITK Library.<br>>>>><br>>>>>the GetValue() function in ConjugateGradientOptimizer class currently is
<br>>>>><br>>>>>MeasureType GetValue();<br>>>>><br>>>>>but in case of RegularStepGradientDescentOptimizer class its defined by macro as<br>>>>><br>>>>>MeasureType GetValue() const;
<br>>>>><br>>>>>which is an interface mis-match... This I encountered when i replaced<br>>>>>regular step gradient descent optimizer by conjugate gradient<br>>>>>optimizer. In the observer I was using a const reference of the
<br>>>>>optimizer and displaying the value (just the example which is<br>>>>>available for the same nothing new =D)...<br>>>>><br>>>>>with regards,<br>>>>>Ashish.
<br>>>>><br>>>><br>>>><br>>>--<br>>>Ashish Poddar<br>>>Have an acceptable reason for accepting anything.<br>>>Y:ashish_poddar | <a href="mailto:MSN:ashish_poddar@yahoo.com">
MSN:ashish_poddar@yahoo.com</a><br>>><br>><br>><br>><br><br><br><br></blockquote></div><br><br><br>-- <br>Ashish Poddar<br>Have an acceptable reason for accepting anything.<br>Y:ashish_poddar | <a href="mailto:MSN:ashish_poddar@yahoo.com">
MSN:ashish_poddar@yahoo.com</a>