[Insight-developers] Test framework

[Luis Ibanez]

Blezek, Daniel J. wrote:
> Hi Bill,
>  
>   I would like to point out that what we have now is _exactly_ like using the class in an application.  In reality VTK and ITK tests have always been more of examples than true regression tests.  The post by Steve way down at the end started this discussion by pointing out that ITK's example-tests are much more verbose than they need to be, precisely because they are example-oriented.
> 
...
> -dan
> 

-----------------



I would disagree with this statement.

ITK has a very clear distinction between Examples and Tests.

The ~350 files in the Insight/Examples directory are minimal
use case Examples of ITK classes. The are indeed the content
of the ITK Software Guide. Opening any of the Example files
in ITK will reveal that they contain more comment text than
actual code.


While the ~930 file in the Insight/Testing directory are test
(and not really suitable as examples on how to use ITK classes).


Of course, there is a continuous range in between, and of course,
the test in Insight/Testing could do a better job of enforcing
regression.


However, it is clear for example that we don't use the files in
the Example directory for the purpose of increasing code coverage,
but for the purpose of providing guidance to users on how to
take advantage of ITK functionalities.


---

Coming back to the original point, I agree with Bill, that what
we probably should do is to take a closer look at other testing
systems and to bring into CTest the features that are interesting
for ITK and VTK.



     Luis