[vtk-developers] vtkpython testing - need more directions!

[Prabhu Ramachandran]

hi,

I have made a little progress with the vtkpython "black box testing"
code.  I added a Set/Get tester and a boolean test.  I also wrote a
shell script that shows all the segfaulting classes with what method
fails (on my platform).  

I found quite a few "mini-bugs" (or micro-bugs?) with these simple
tests.  Most notably was the fact that if I do the following:

appropriate_vtk_obj.ReleaseDataFlagOff()
I find that 
appropriate_vtk_obj.GetReleaseDataFlag() != 0

This happens a lot.  For instance here is the first (alphabetically)
failure:

----------------------------------------
Testing vtkArrayCalculator
Testing if class is parseable... 
ok
Testing Get/Set methods... 
ok
Testing boolean (On/Off) methods... 
Exception: Tester.py:89: 
TestError: Failed test for vtkArrayCalculator.ReleaseDataFlagOff
Result not equal to 0  (in test_boolean)
----------------------------------------

I also find that for several Boolean methods there is no GetMethod -
for instance there is no GetCopyAll although there is a CopyAllOn:

----------------------------------------
Testing vtkCellData
Testing if class is parseable... 
ok
Testing Get/Set methods... 
ok
Testing boolean (On/Off) methods... 
Exception: <string>:0: AttributeError: GetCopyAll (in ?)
----------------------------------------


A total of 425 classes passed the tests.  Which means that 120 classes
failed in one test or an other.  The test script also gives you a list
of failed classes.  That apart there were about 5 that segfault.

I have received no feedback on how you want it formatted etc.  Let me
know what i should do with the code I have now?  Do I mail it to
someone or put it in the cvs tree somewhere?  Bill?

All the tests run well within 30 seconds on a PIII 450.

Later when I get some time I will try to test the clamped variables.
BTW, the current code should also enable one to check for obsolete,
obsolete messages. :)


cheers,
prabhu

-- 

Those who hate and fight must stop themselves -- otherwise it is not
stopped.
		-- Spock, "Day of the Dove", stardate unknown