[vtk-developers] Wiki scrapping regression after web page update

Bill Lorensen bill.lorensen at gmail.com
Thu May 5 11:00:31 EDT 2016


Looks like itk has been changed. Now I can no longer scrape the wiki. HELP!


On Tue, May 5, 2015 at 11:07 AM, David E DeMarle
<dave.demarle at kitware.com> wrote:
> So Bill trying to close the loop on this.
>
> We should now use.
> site = mwclient.Site('www.(project).org', '/Wiki/')
> page = site.Pages['PROJECT/Examples]
>
> That will work now and if/when www.itk.org gets it's own facelift.
>
> hth
>
>
> David E DeMarle
> Kitware, Inc.
> R&D Engineer
> 21 Corporate Drive
> Clifton Park, NY 12065-8662
> Phone: 518-881-4909
>
> On Thu, Apr 16, 2015 at 6:31 PM, Jean-Christophe Fillion-Robin
> <jchris.fillionr at kitware.com> wrote:
>>
>> Hi Bill,
>>
>> I wrote too fast. Ignore my previous email.
>>
>> Jc
>>
>> On Thu, Apr 16, 2015 at 6:30 PM, Jean-Christophe Fillion-Robin
>> <jchris.fillionr at kitware.com> wrote:
>>>
>>> Hi Bill,
>>>
>>> Seems the wiki is available here: http://www.vtk.org/Wiki/VTK
>>>
>>> Instead of
>>>
>>>   site = mwclient.Site('vtk.org', '/Wiki/')
>>>
>>> try this
>>>
>>>   site = mwclient.Site('vtk.org', '/Wiki/VTK/')
>>>
>>> Hth
>>> Jc
>>>
>>> On Mon, Apr 13, 2015 at 11:45 AM, David E DeMarle
>>> <dave.demarle at kitware.com> wrote:
>>>>
>>>> I'll take a look.
>>>> thanks
>>>>
>>>> David E DeMarle
>>>> Kitware, Inc.
>>>> R&D Engineer
>>>> 21 Corporate Drive
>>>> Clifton Park, NY 12065-8662
>>>> Phone: 518-881-4909
>>>>
>>>> On Tue, Mar 31, 2015 at 3:30 PM, Bill Lorensen <bill.lorensen at gmail.com>
>>>> wrote:
>>>>>
>>>>> Folks,
>>>>>
>>>>> I scrape the vtk.org wiki site each evening to maintain the  vtk wiki
>>>>> examples. I have a python program that uses mwclient
>>>>> (https://github.com/mwclient/mwclient) that uses the MediaWiki API.
>>>>>
>>>>> Ever since the vtk.org page was updated, my nightly scripts have been
>>>>> failing.
>>>>> The error are occur on this line:
>>>>>
>>>>> site = mwclient.Site('vtk.org', '/Wiki/')
>>>>>
>>>>> If I change vtk.org to itk.org, my scripts work.
>>>>>
>>>>> I suspect some sort of web magic going on. I can workaround the
>>>>> problem but specifying itk.org, but I'd like to understand what
>>>>> happened just in case the itk.org site changes in the future.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Bill
>>>>> _______________________________________________
>>>>> Powered by www.kitware.com
>>>>>
>>>>> Visit other Kitware open-source projects at
>>>>> http://www.kitware.com/opensource/opensource.html
>>>>>
>>>>> Search the list archives at:
>>>>> http://markmail.org/search/?q=vtk-developers
>>>>>
>>>>> Follow this link to subscribe/unsubscribe:
>>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Powered by www.kitware.com
>>>>
>>>> Visit other Kitware open-source projects at
>>>> http://www.kitware.com/opensource/opensource.html
>>>>
>>>> Search the list archives at:
>>>> http://markmail.org/search/?q=vtk-developers
>>>>
>>>> Follow this link to subscribe/unsubscribe:
>>>> http://public.kitware.com/mailman/listinfo/vtk-developers
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> +1 919 869 8849
>>
>>
>>
>>
>> --
>> +1 919 869 8849
>
>



-- 
Unpaid intern in BillsBasement at noware dot com


More information about the vtk-developers mailing list