[Insight-developers] Checking ITK for stale URLs

[Bill Lorensen]

Brad,

Very nice.

The "Extreme Bill"  says it would be a great test.
The "Cynical Bill" says it will just generate more errors we can ignore.

I mostly feel extreme...

It would be nice to give it just a directory name and have it walk the
whole tree. Also, only report warnings/errors. I guess the warnings
would be the "Moved" results and the errors would be the "Not Found"
results.

It should also print out the file that contains the bad url.

I just ran it on all of ITK and it does generate a lot of false
errors. For example:
http://www.kitware.com/) not found. Buit it seems to include the ")"
http://www.boost.org/LICENSE_1_0.txt)  Not Found
so the re probably needs some work.

I ran this command from the top of the ITK tree:
find . -exec ~/Downloads/VerifyURLs.py  /dev/null {} \; | grep Not


Bill

On Tue, Feb 22, 2011 at 3:41 PM, Bradley Lowekamp
<blowekamp at mail.nih.gov> wrote:
> Bill,
> Good question. The scripts takes a list of files. So I have been executing
> it by something like "VerifyURLs.py Code/Review/*" or another directory.  So
> it will scan all files in the directory. The real goal is to verify that all
> referenced URLs in doxygen or other documentation still work, so likely just
> *.h *.txx *.cxx is needed. The program just scans any text files you pass as
> a argument looking for a regular expressions which describes URLs.
> Brad
> On Feb 22, 2011, at 3:26 PM, Bill Lorensen wrote:
>
> Brad,
>
> What are you scanning?
>
> Bill
>
> On Tue, Feb 22, 2011 at 3:20 PM, Bradley Lowekamp
> <blowekamp at mail.nih.gov> wrote:
>
> Hello,
>
> With ITK being 10 years old, there are a lot of referenced URLs which are
> not longer good. To find the ones that are no longer OK I wrote a little
> python script to scan for URLs and then check to server.
>
> I am not sure with how to deal with some of the URL redirection, but the
> basis of the script should be good to find URLs that are not OK. It needs
> work to deal with some of the redirection cases.
>
> As this script actively goes out and polls a bunch of servers I am not sure
> it makes since to have this as a regular test.
>
> Brad
>
>
>
>
> _______________________________________________
>
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
>
> http://www.kitware.com/opensource/opensource.html
>
> Kitware offers ITK Training Courses, for more information visit:
>
> http://kitware.com/products/protraining.html
>
> Please keep messages on-topic and check the ITK FAQ at:
>
> http://www.itk.org/Wiki/ITK_FAQ
>
> Follow this link to subscribe/unsubscribe:
>
> http://www.itk.org/mailman/listinfo/insight-developers
>
>
>
> ========================================================
>
> Bradley Lowekamp
>
> Lockheed Martin Contractor for
>
> Office of High Performance Computing and Communications
>
> National Library of Medicine
>
> blowekamp at mail.nih.gov
>
>