[vtk-developers] Wiki scrapping regression after web page update

[Bill Lorensen]

Matt,
The change to https is what is causing the problem. I can modify my call from
site = mwclient.Site(('itk.org', '/Wiki/')
to
site = mwclient.Site(('https','itk.org'), '/Wiki/')

Thanks,

Bill

On Thu, May 5, 2016 at 11:11 AM, Matt McCormick
<matt.mccormick at kitware.com> wrote:
> Hi Bill,
>
> itk.org/ was recently changed to use HTTPS -- does making that change
> to your configuration help?
>
> Thanks,
> Matt
>
> On Thu, May 5, 2016 at 11:00 AM, Bill Lorensen <bill.lorensen at gmail.com> wrote:
>> Looks like itk has been changed. Now I can no longer scrape the wiki. HELP!
>>
>>
>> On Tue, May 5, 2015 at 11:07 AM, David E DeMarle
>> <dave.demarle at kitware.com> wrote:
>>> So Bill trying to close the loop on this.
>>>
>>> We should now use.
>>> site = mwclient.Site('www.(project).org', '/Wiki/')
>>> page = site.Pages['PROJECT/Examples]
>>>
>>> That will work now and if/when www.itk.org gets it's own facelift.
>>>
>>> hth
>>>
>>>
>>> David E DeMarle
>>> Kitware, Inc.
>>> R&D Engineer
>>> 21 Corporate Drive
>>> Clifton Park, NY 12065-8662
>>> Phone: 518-881-4909
>>>
>>> On Thu, Apr 16, 2015 at 6:31 PM, Jean-Christophe Fillion-Robin
>>> <jchris.fillionr at kitware.com> wrote:
>>>>
>>>> Hi Bill,
>>>>
>>>> I wrote too fast. Ignore my previous email.
>>>>
>>>> Jc
>>>>
>>>> On Thu, Apr 16, 2015 at 6:30 PM, Jean-Christophe Fillion-Robin
>>>> <jchris.fillionr at kitware.com> wrote:
>>>>>
>>>>> Hi Bill,
>>>>>
>>>>> Seems the wiki is available here: http://www.vtk.org/Wiki/VTK
>>>>>
>>>>> Instead of
>>>>>
>>>>>   site = mwclient.Site('vtk.org', '/Wiki/')
>>>>>
>>>>> try this
>>>>>
>>>>>   site = mwclient.Site('vtk.org', '/Wiki/VTK/')
>>>>>
>>>>> Hth
>>>>> Jc
>>>>>
>>>>> On Mon, Apr 13, 2015 at 11:45 AM, David E DeMarle
>>>>> <dave.demarle at kitware.com> wrote:
>>>>>>
>>>>>> I'll take a look.
>>>>>> thanks
>>>>>>
>>>>>> David E DeMarle
>>>>>> Kitware, Inc.
>>>>>> R&D Engineer
>>>>>> 21 Corporate Drive
>>>>>> Clifton Park, NY 12065-8662
>>>>>> Phone: 518-881-4909
>>>>>>
>>>>>> On Tue, Mar 31, 2015 at 3:30 PM, Bill Lorensen <bill.lorensen at gmail.com>
>>>>>> wrote:
>>>>>>>
>>>>>>> Folks,
>>>>>>>
>>>>>>> I scrape the vtk.org wiki site each evening to maintain the  vtk wiki
>>>>>>> examples. I have a python program that uses mwclient
>>>>>>> (https://github.com/mwclient/mwclient) that uses the MediaWiki API.
>>>>>>>
>>>>>>> Ever since the vtk.org page was updated, my nightly scripts have been
>>>>>>> failing.
>>>>>>> The error are occur on this line:
>>>>>>>
>>>>>>> site = mwclient.Site('vtk.org', '/Wiki/')
>>>>>>>
>>>>>>> If I change vtk.org to itk.org, my scripts work.
>>>>>>>
>>>>>>> I suspect some sort of web magic going on. I can workaround the
>>>>>>> problem but specifying itk.org, but I'd like to understand what
>>>>>>> happened just in case the itk.org site changes in the future.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Bill
>>>>>>> _______________________________________________
>>>>>>> Powered by www.kitware.com
>>>>>>>
>>>>>>> Visit other Kitware open-source projects at
>>>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>>>
>>>>>>> Search the list archives at:
>>>>>>> http://markmail.org/search/?q=vtk-developers
>>>>>>>
>>>>>>> Follow this link to subscribe/unsubscribe:
>>>>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Powered by www.kitware.com
>>>>>>
>>>>>> Visit other Kitware open-source projects at
>>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>>
>>>>>> Search the list archives at:
>>>>>> http://markmail.org/search/?q=vtk-developers
>>>>>>
>>>>>> Follow this link to subscribe/unsubscribe:
>>>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> +1 919 869 8849
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> +1 919 869 8849
>>>
>>>
>>
>>
>>
>> --
>> Unpaid intern in BillsBasement at noware dot com



-- 
Unpaid intern in BillsBasement at noware dot com