[Insight-developers] Need to add images for new tests to Data -- how to do that in a Gerrit topic?

[Bill Lorensen]

Stephen,

As a member of the VTK community and the VTK ARB, I have the same
concerns I mentioned. I do not believe this has been discussed by the
VTK community. I cannot find any discussion regarding this on the VTK
wiki.

Bill

On Fri, Nov 5, 2010 at 8:14 PM, Stephen Aylward
<stephen.aylward at kitware.com> wrote:
> Hi Bill,
>
> I think Luis did a great job at pointing out in a previous email that
> this is merely a suggestion for ITK, and there have been numerous
> discussions regarding data hosting and management in repositories
> intended for source code - particularly when used with gerrit.   There
> is a problem.  Heck, Luis didn't start this email thread - someone
> else did when they were trying to determine what to do with their
> data.
>
> My understanding (and it could be wrong on some details, but is
> correct in the general message) is that the system that will be
> presented by others (not Luis) was developed by the CMake team at the
> request of the VTK team, and it is being put into place by those teams
> for those projects.   As an existing open source solution, we should
> consider it.    Never did Luis dictate its use.   You know Luis - he
> isn't like that.
>
> But, you bring up a good point.  The presentation should follow the
> outline you've given - state the problem, discuss how this solution
> addresses them and falls short (I applaud that they already have
> hands-on experience with it), listen to suggestions for alternatives,
> and then pick a way forward as a community.
>
> Stephen
>
>
>
> On Fri, Nov 5, 2010 at 7:45 PM, Bill Lorensen <bill.lorensen at gmail.com> wrote:
>> Luis,
>>
>> I am surprised at the approach taken to address this important issue.
>>
>> My suggested approach:
>> ITK needs a better way to manage test data and test baselines. Define
>> the problem, establish baseline measurements, analyze the root causes,
>> propose improvements, establish a process to control the solution. All
>> with community input.
>>
>> The current approach is:
>> ITK needs a better way to manage test data and test baselines. Here is
>> a solution, please review it.
>>
>> The later approach shows that a group has spent time and money for a
>> solution without community input regarding the problem, requirements
>> and alternative solutions.
>>
>> Bill
>>
>> On Fri, Nov 5, 2010 at 2:38 PM, Luis Ibanez <luis.ibanez at kitware.com> wrote:
>>> Bill,
>>>
>>> On Thu, Nov 4, 2010 at 4:04 PM, Bill Lorensen <bill.lorensen at gmail.com>
>>> wrote:
>>>>
>>>> I hope you have some discussion about this in Iowa. I assume it is a
>>>> proposal and not a mandate.
>>>
>>>
>>> This is an open source project,
>>>
>>> We don't do mandates,
>>> except to keep patented code away     :-)
>>>
>>>
>>>>
>>>> I hope that Baselines will remain (go back) in the ITK repository (not
>>>> a submodule). They currently take 17 megs.
>>>>
>>>
>>>
>>> What really matters is whether the images are in our local
>>> working tree when they are needed to run the tests, and
>>> whether they are the right version (of the images) for the
>>> current version of the source code.
>>>
>>>
>>>>
>>>> Test data is another issue. If there is a solution it must allow
>>>> testing without an internet connection.
>>>>
>>>
>>>
>>> Both the Git submodule and MIDAS options allow running
>>> testing without a network connection, of course, as long as
>>>
>>> a)  We download the data in an initial step, and
>>> b)  We get the right version of the data.
>>>
>>> In practice, in both cases, the work cycle becomes:
>>>
>>> 0) Download the data initially
>>> 1) Run the tests in many instances
>>> 2) From time to time download
>>>      new versions of images  that have changed.
>>>
>>>
>>>     Luis
>>>
>>>
>>>
>> _______________________________________________
>> Powered by www.kitware.com
>>
>> Visit other Kitware open-source projects at
>> http://www.kitware.com/opensource/opensource.html
>>
>> Kitware offers ITK Training Courses, for more information visit:
>> http://kitware.com/products/protraining.html
>>
>> Please keep messages on-topic and check the ITK FAQ at:
>> http://www.itk.org/Wiki/ITK_FAQ
>>
>> Follow this link to subscribe/unsubscribe:
>> http://www.itk.org/mailman/listinfo/insight-developers
>>
>
>
>
> --
>
> ==============================
> Stephen R. Aylward, Ph.D.
> Director of Medical Imaging Research
> Kitware, Inc. - North Carolina Office
> http://www.kitware.com
> stephen.aylward (Skype)
> (919) 969-6990 x300
>