[ITK-dev] [ITK] Benchmarks for ITK

[Matt McCormick]

Hi Tim,

Thanks for reaching out to the list.

Improvements in ITK's support for parallel processing and
architectures would be greatly welcome.

We currently have some support for OpenCL-based computing. However, if
appropriate, addition of SYCL or better C++ programming capabilities
would be welcome.  Also, a port of the VTK SMPTools (see 'git grep
SMPTools' within the VTK tree) would be a good way to allow better
parallel computing in ITK. If you want to do a comparison for your
thesis, there are a few backends there that could be compared to the
ones you propose. Since ITK and VTK have a common ancestry in the
multi-threading code, a similar update could be possible in the
codebase.

For benchmarks, I am hoping to try Air Speed Velocity [1] to track
performance. We started a repository to add performance benchmarks [2]
with real-world use cases, but it has yet to be populated. A good
start for performance benchmarks may be some of the slower tests that
currently exist in the test suite [3].

Thanks,
Matt

[1] https://spacetelescope.github.io/asv/index.html

[2] https://github.com/InsightSoftwareConsortium/ITKPerformanceTests

[3] http://kitware.com/blog/posts/view/556

On Wed, Mar 25, 2015 at 7:59 AM, Tim Beattie <s1471978 at sms.ed.ac.uk> wrote:
> Hi folks.
>
> Are there any readily-available benchmarks for the ITK project?  I’m interested in porting some of the parallelised parts of ITK to SYCL in order to see how SYCL performs when compared to other parallel programming frameworks.  I’ve had a brief look at the ITK code and some of the mailing list archives, but I haven’t found anything called a benchmark or which mentions performance.  I know there are extensive unit tests and plenty of examples, but what I’m really looking for is a “this is how we all benchmark it” program.
>
> Just in case anyone’s interested, this is for a masters dissertation in High Performance Computing at the University of Edinburgh.  I’ll be running several medical imaging and robotic vision benchmarks on Xeon Phi hardware and possibly on AMD GPUs as well.
>
> Thanks in advance,
>
> Tim
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Kitware offers ITK Training Courses, for more information visit:
> http://kitware.com/products/protraining.php
>
> Please keep messages on-topic and check the ITK FAQ at:
> http://www.itk.org/Wiki/ITK_FAQ
>
> Follow this link to subscribe/unsubscribe:
> http://public.kitware.com/mailman/listinfo/insight-developers
> _______________________________________________
> Community mailing list
> Community at itk.org
> http://public.kitware.com/mailman/listinfo/community