[Insight-developers] Data submodule was reverted again ( staging check needed? )

Tue Jan 25 14:40:41 EST 2011

Hi Mark,

Thanks!

Great idea - it should be easy to download an entire directory of
data.  One file at a time can be a pain.   MIDAS supports it, but we
don't have a cmake interface for it.   Again, good idea.

About the download error.  There do seem to be strange communication
problems on that machine last night. I'm sure Zach can help with it -
but me being nosy...if you have access to that machine, you might want
to try re-running them now - all downloads/tests passed yesterday and
then all failed last night - hate to blame a network fluke, but....
If any problems persist or spread to other machines, please let me
know.

Thanks,
Stephen

On Tue, Jan 25, 2011 at 2:14 PM, Scully, Mark S <mark-scully at uiowa.edu> wrote:
> That's actually a separate issue.  I've since requested a function to
> download a directory to be used as input to a test, and Zach is working on
> adding it.
>
> The issue mentioned earlier is something else I've emailed Zach about,
> which is that some tests that fetch data from midas are failing on one of
> the Win32 builds of slicer.  Here is an example:
> http://www.cdash.org/CDash/testDetails.php?test=80925570&build=833710
>
> Mark
>
> On 1/25/11 12:07 PM, "Stephen Aylward" <stephen.aylward at kitware.com> wrote:
>
>>Hi,
>>
>>Zach and Mark have been emailing.   I think "issue" is the right term
>>for this.   Mark wants to upload some data, and the first email
>>exchange gave him admin permissions to do the uploads.   The second
>>email exchange told him that the digital archive standard upon which
>>MIDAS is based defines that communities can contain communities and
>>collections, but collections can only contain items, not communities.
>>He couldn't find a "create community" button within a collection,
>>because that operation isn't allowed.   Zach emailed him the solution
>>yesterday.   We haven't heard back.
>>
>>BUT, that does raise a good point.   I think the upload process for
>>MIDAS and the Insight Journal (they are the same) should be easier.
>>
>>Thanks,
>>Stephen
>>
>>On Tue, Jan 25, 2011 at 12:40 PM, Williams, Norman K
>><norman-k-williams at uiowa.edu> wrote:
>>> Mark Scully (mark-scully at uiowa.edu) is working on it. I don't know the
>>> details.
>>>
>>> On 1/25/11 11:36 AM, "Stephen Aylward" <stephen.aylward at kitware.com>
>>>wrote:
>>>
>>>>Hi,
>>>>
>>>>What problems are you having with MIDAS?
>>>>
>>>>Stephen
>>>>
>>>>On Tue, Jan 25, 2011 at 12:29 PM, Williams, Norman K
>>>><norman-k-williams at uiowa.edu> wrote:
>>>>> Depending on Midas isn't all skittles and beer, either.  When you're
>>>>> having a Midas issue -- which we're currently having with some of our
>>>>> programs that are included in Slicer -- you're dead in the water until
>>>>>you
>>>>> get Midas to behave.
>>>>>
>>>>> Having your own testing data in a big whomping git repo has it's
>>>>> disadvantages, but it is the least brittle option.
>>>>>
>>>>> On 1/25/11 11:05 AM, "Bill Lorensen" <bill.lorensen at gmail.com> wrote:
>>>>>
>>>>>>I still feel that Baseline and small testing data should be a part of
>>>>>>the ITK checkout (and not a submodule). Larger data would be well
>>>>>>hosted at midas with the hashing presented earlier.
>>>>>>
>>>>>>The current setup is not developer friendly for testing.
>>>>>>
>>>>>>Bill
>>>>>>
>>>>>>On Tue, Jan 25, 2011 at 11:40 AM, Stephen Aylward
>>>>>><stephen.aylward at kitware.com> wrote:
>>>>>>> CMake/URLs for data hosting?
>>>>>>>
>>>>>>> s
>>>>>>>
>>>>>>> On Tue, Jan 25, 2011 at 11:08 AM, Bradley Lowekamp
>>>>>>> <blowekamp at mail.nih.gov> wrote:
>>>>>>>> Hello,
>>>>>>>> I updated the data submodule over the weekend. And moved the
>>>>>>>>submodule
>>>>>>>> pointer along in the ITK project. Unfortunately, this change was
>>>>>>>>over
>>>>>>>> written again. This appears to be a common problem, and this is at
>>>>>>>>least the
>>>>>>>> second time this has happened to me.
>>>>>>>> I believe we need some commit checks and staging area checks to
>>>>>>>>prevent this
>>>>>>>> from happening. I would think that it would not be too difficult to
>>>>>>>>check
>>>>>>>> that the Data submodule pointer only get moved forwards not
>>>>>>>>backwards,
>>>>>>>> during a commit and in the staging area. This would still allow a
>>>>>>>>direct
>>>>>>>> commit into the ITK repository to have more control if needed. I
>>>>>>>>believe
>>>>>>>> this would prevent this kind of accident from happening again. Or
>>>>>>>>is
>>>>>>>>the
>>>>>>>> better solution?
>>>>>>>> I will be restoring the Data submodule pointer now.
>>>>>>>> Thanks,
>>>>>>>> Brad
>>>>>>>>
>>>>>>>> ========================================================
>>>>>>>>
>>>>>>>> Bradley Lowekamp
>>>>>>>>
>>>>>>>> Lockheed Martin Contractor for
>>>>>>>>
>>>>>>>> Office of High Performance Computing and Communications
>>>>>>>>
>>>>>>>> National Library of Medicine
>>>>>>>>
>>>>>>>> blowekamp at mail.nih.gov
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Powered by www.kitware.com
>>>>>>>>
>>>>>>>> Visit other Kitware open-source projects at
>>>>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>>>>
>>>>>>>> Kitware offers ITK Training Courses, for more information visit:
>>>>>>>> http://kitware.com/products/protraining.html
>>>>>>>>
>>>>>>>> Please keep messages on-topic and check the ITK FAQ at:
>>>>>>>> http://www.itk.org/Wiki/ITK_FAQ
>>>>>>>>
>>>>>>>> Follow this link to subscribe/unsubscribe:
>>>>>>>> http://www.itk.org/mailman/listinfo/insight-developers
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> ==============================
>>>>>>> Stephen R. Aylward, Ph.D.
>>>>>>> Director of Medical Imaging Research
>>>>>>> Kitware, Inc. - North Carolina Office
>>>>>>> http://www.kitware.com
>>>>>>> stephen.aylward (Skype)
>>>>>>> (919) 969-6990 x300
>>>>>>> _______________________________________________
>>>>>>> Powered by www.kitware.com
>>>>>>>
>>>>>>> Visit other Kitware open-source projects at
>>>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>>>
>>>>>>> Kitware offers ITK Training Courses, for more information visit:
>>>>>>> http://kitware.com/products/protraining.html
>>>>>>>
>>>>>>> Please keep messages on-topic and check the ITK FAQ at:
>>>>>>> http://www.itk.org/Wiki/ITK_FAQ
>>>>>>>
>>>>>>> Follow this link to subscribe/unsubscribe:
>>>>>>> http://www.itk.org/mailman/listinfo/insight-developers
>>>>>>>
>>>>>>_______________________________________________
>>>>>>Powered by www.kitware.com
>>>>>>
>>>>>>Visit other Kitware open-source projects at
>>>>>>http://www.kitware.com/opensource/opensource.html
>>>>>>
>>>>>>Kitware offers ITK Training Courses, for more information visit:
>>>>>>http://kitware.com/products/protraining.html
>>>>>>
>>>>>>Please keep messages on-topic and check the ITK FAQ at:
>>>>>>http://www.itk.org/Wiki/ITK_FAQ
>>>>>>
>>>>>>Follow this link to subscribe/unsubscribe:
>>>>>>http://www.itk.org/mailman/listinfo/insight-developers
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>>--
>>>>
>>>>==============================
>>>>Stephen R. Aylward, Ph.D.
>>>>Director of Medical Imaging Research
>>>>Kitware, Inc. - North Carolina Office
>>>>http://www.kitware.com
>>>>stephen.aylward (Skype)
>>>>(919) 969-6990 x300
>>>
>>>
>>
>>
>>
>>--
>>
>>==============================
>>Stephen R. Aylward, Ph.D.
>>Director of Medical Imaging Research
>>Kitware, Inc. - North Carolina Office
>>http://www.kitware.com
>>stephen.aylward (Skype)
>>(919) 969-6990 x300
>>_______________________________________________
>>Powered by www.kitware.com
>>
>>Visit other Kitware open-source projects at
>>http://www.kitware.com/opensource/opensource.html
>>
>>Kitware offers ITK Training Courses, for more information visit:
>>http://kitware.com/products/protraining.html
>>
>>Please keep messages on-topic and check the ITK FAQ at:
>>http://www.itk.org/Wiki/ITK_FAQ
>>
>>Follow this link to subscribe/unsubscribe:
>>http://www.itk.org/mailman/listinfo/insight-developers
>
>

-- 

==============================
Stephen R. Aylward, Ph.D.
Director of Medical Imaging Research
Kitware, Inc. - North Carolina Office
http://www.kitware.com
stephen.aylward (Skype)
(919) 969-6990 x300