[vtk-developers] Wiki scrapping regression after web page update

[Matt McCormick]

Hi Bill,

itk.org/ was recently changed to use HTTPS -- does making that change
to your configuration help?

Thanks,
Matt

On Thu, May 5, 2016 at 11:00 AM, Bill Lorensen <bill.lorensen at gmail.com> wrote:
> Looks like itk has been changed. Now I can no longer scrape the wiki. HELP!
>
>
> On Tue, May 5, 2015 at 11:07 AM, David E DeMarle
> <dave.demarle at kitware.com> wrote:
>> So Bill trying to close the loop on this.
>>
>> We should now use.
>> site = mwclient.Site('www.(project).org', '/Wiki/')
>> page = site.Pages['PROJECT/Examples]
>>
>> That will work now and if/when www.itk.org gets it's own facelift.
>>
>> hth
>>
>>
>> David E DeMarle
>> Kitware, Inc.
>> R&D Engineer
>> 21 Corporate Drive
>> Clifton Park, NY 12065-8662
>> Phone: 518-881-4909
>>
>> On Thu, Apr 16, 2015 at 6:31 PM, Jean-Christophe Fillion-Robin
>> <jchris.fillionr at kitware.com> wrote:
>>>
>>> Hi Bill,
>>>
>>> I wrote too fast. Ignore my previous email.
>>>
>>> Jc
>>>
>>> On Thu, Apr 16, 2015 at 6:30 PM, Jean-Christophe Fillion-Robin
>>> <jchris.fillionr at kitware.com> wrote:
>>>>
>>>> Hi Bill,
>>>>
>>>> Seems the wiki is available here: http://www.vtk.org/Wiki/VTK
>>>>
>>>> Instead of
>>>>
>>>>   site = mwclient.Site('vtk.org', '/Wiki/')
>>>>
>>>> try this
>>>>
>>>>   site = mwclient.Site('vtk.org', '/Wiki/VTK/')
>>>>
>>>> Hth
>>>> Jc
>>>>
>>>> On Mon, Apr 13, 2015 at 11:45 AM, David E DeMarle
>>>> <dave.demarle at kitware.com> wrote:
>>>>>
>>>>> I'll take a look.
>>>>> thanks
>>>>>
>>>>> David E DeMarle
>>>>> Kitware, Inc.
>>>>> R&D Engineer
>>>>> 21 Corporate Drive
>>>>> Clifton Park, NY 12065-8662
>>>>> Phone: 518-881-4909
>>>>>
>>>>> On Tue, Mar 31, 2015 at 3:30 PM, Bill Lorensen <bill.lorensen at gmail.com>
>>>>> wrote:
>>>>>>
>>>>>> Folks,
>>>>>>
>>>>>> I scrape the vtk.org wiki site each evening to maintain the  vtk wiki
>>>>>> examples. I have a python program that uses mwclient
>>>>>> (https://github.com/mwclient/mwclient) that uses the MediaWiki API.
>>>>>>
>>>>>> Ever since the vtk.org page was updated, my nightly scripts have been
>>>>>> failing.
>>>>>> The error are occur on this line:
>>>>>>
>>>>>> site = mwclient.Site('vtk.org', '/Wiki/')
>>>>>>
>>>>>> If I change vtk.org to itk.org, my scripts work.
>>>>>>
>>>>>> I suspect some sort of web magic going on. I can workaround the
>>>>>> problem but specifying itk.org, but I'd like to understand what
>>>>>> happened just in case the itk.org site changes in the future.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Bill
>>>>>> _______________________________________________
>>>>>> Powered by www.kitware.com
>>>>>>
>>>>>> Visit other Kitware open-source projects at
>>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>>
>>>>>> Search the list archives at:
>>>>>> http://markmail.org/search/?q=vtk-developers
>>>>>>
>>>>>> Follow this link to subscribe/unsubscribe:
>>>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Powered by www.kitware.com
>>>>>
>>>>> Visit other Kitware open-source projects at
>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>
>>>>> Search the list archives at:
>>>>> http://markmail.org/search/?q=vtk-developers
>>>>>
>>>>> Follow this link to subscribe/unsubscribe:
>>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> +1 919 869 8849
>>>
>>>
>>>
>>>
>>> --
>>> +1 919 869 8849
>>
>>
>
>
>
> --
> Unpaid intern in BillsBasement at noware dot com