[Insight-developers] Need to add images for new tests to Data -- how to do that in a Gerrit topic?

[Bill Lorensen]

Luis,

I am surprised at the approach taken to address this important issue.

My suggested approach:
ITK needs a better way to manage test data and test baselines. Define
the problem, establish baseline measurements, analyze the root causes,
propose improvements, establish a process to control the solution. All
with community input.

The current approach is:
ITK needs a better way to manage test data and test baselines. Here is
a solution, please review it.

The later approach shows that a group has spent time and money for a
solution without community input regarding the problem, requirements
and alternative solutions.

Bill

On Fri, Nov 5, 2010 at 2:38 PM, Luis Ibanez <luis.ibanez at kitware.com> wrote:
> Bill,
>
> On Thu, Nov 4, 2010 at 4:04 PM, Bill Lorensen <bill.lorensen at gmail.com>
> wrote:
>>
>> I hope you have some discussion about this in Iowa. I assume it is a
>> proposal and not a mandate.
>
>
> This is an open source project,
>
> We don't do mandates,
> except to keep patented code away     :-)
>
>
>>
>> I hope that Baselines will remain (go back) in the ITK repository (not
>> a submodule). They currently take 17 megs.
>>
>
>
> What really matters is whether the images are in our local
> working tree when they are needed to run the tests, and
> whether they are the right version (of the images) for the
> current version of the source code.
>
>
>>
>> Test data is another issue. If there is a solution it must allow
>> testing without an internet connection.
>>
>
>
> Both the Git submodule and MIDAS options allow running
> testing without a network connection, of course, as long as
>
> a)  We download the data in an initial step, and
> b)  We get the right version of the data.
>
> In practice, in both cases, the work cycle becomes:
>
> 0) Download the data initially
> 1) Run the tests in many instances
> 2) From time to time download
>      new versions of images  that have changed.
>
>
>     Luis
>
>
>