[vtkusers] Connecting Kinect with VTK

[Nikhil Shetty]

Thanks for sharing this. Do you know if the application had an
initialization step to recognize the person (like lifting the hand  to form
a 'V' etc).

I had worked on a similar application and investigated using both the
OpenNI based and MSKinect library. The OpenNI app (FAAST) typically
required the user to hold a pose whereas the the MSKinect library didnt.

-Nikhil


On Wed, Mar 13, 2013 at 11:55 AM, Kischell, Eric R.
<Kischell.Eric at mayo.edu>wrote:

> **
> Dear VTK Lurkers,
> While the Kinect thread is still active...
> Here is an interesting medical Kinect application.
>
> Kinect suitable for surgical manipulation of MR imagesBy *Erik L. Ridley,
> AuntMinnie staff writer* <http://contacteditor.auntminnie.com/>
> January 14, 2013
>
> Microsoft's Kinect motion-sensing gaming device is reliable for surgeons
> to use to manipulate MR images on operating room (OR) workstations,
> according to research from the Purdue University Department of Industrial
> Engineering.
>
> A team led by doctoral student Mithun George Jacob concluded that gesture
> interaction and surgeon behavior analysis can facilitate accurate
> navigation and manipulation of MR images, opening the door for the
> replacement of traditional keyboard and mouse-based interfaces.
>
> "The main finding is that it is possible to accurately recognize the
> user's (or a surgeon's in an OR) intention to perform a gesture by
> observing environmental cues (context) with high accuracy," the authors
> wrote.
>
> Imaging devices are accessible in the OR today, but they use traditional
> interfaces that can compromise sterility. While nurses or assistants can
> use the keyboard for the surgeon, that approach can be cumbersome,
> inefficient, and frustrating, according to the researchers (*Journal of
> the American Medical Informatics Association* <http://jamia.bmj.com/>,
> December 18, 2012).
>
> "This is a problem when the user (surgeon) is already performing a
> cognitively demanding task," they wrote.
>
> In a three-step project, the researchers first developed an MR image
> browser application and conducted an ethnographic study with 10 surgeons
> from Purdue's College of Veterinary Medicine to gather a set of gestures
> that would be natural for clinicians and surgeons. Ten gestures were
> ultimately selected for use by the browser.
>
> Next, the team developed gesture recognition software that used the *
> OpenNI* <http://www.openni.org/> software library to track skeletal
> joints using Kinect. System evaluation was then performed via three
> experiments.
>
> In the first experiment, the researchers collected a dataset of 4,750
> observations from two users. Gesture recognition was evaluated in a second
> experiment using a dataset of 1,000 gestures performed by 10 users.
>
> The final experiment involved users performing a specific browsing and
> manipulation task using hand gestures with the image browser.
>
> In the first experiment, the researchers found that their system was
> accurate in recognizing the gestures, with a mean recognition accuracy of
> 97.9% and a false-positive rate of 1.36%.
>
> The second experiment showed a gesture recognition accuracy of 97.2%,
> while the third experiment concluded that the system could correctly
> determine user intent 98.7% of the time. Mean gesture recognition accuracy
> was 92.6% with context and 93.6% without context.
>
> It's imperative to collect training data from more users, the authors
> noted, as people perform gestures differently and exhibit intent to use the
> system in different ways.
>
>  ------------------------------
> *From:* vtkusers-bounces at vtk.org [mailto:vtkusers-bounces at vtk.org] *On
> Behalf Of *Pat Marion
> *Sent:* Tuesday, March 12, 2013 7:47 PM
> *To:* Sidou_3D
> *Cc:* vtkusers at vtk.org
> *Subject:* Re: [vtkusers] Connecting Kinect with VTK
>
>  Hi,
>
> The PCL Plugin for ParaView is a collection of VTK filters that use the
> Point Cloud Library.  Included in the plugin is the vtkOpenNISource.  This
> wraps around the pcl::OpenNIGrabber to provide point cloud streams from an
> OpenNI device like a Kinect camera.  Using the vtkOpenNISource, you can
> feed Kinect point clouds directly into your VTK filter pipeline.  The
> source code, and a video demonstration is here:
>
> http://www.paraview.org/Wiki/ParaView/PCL_Plugin
>
> Pat
>
>
> On Sat, Mar 9, 2013 at 3:04 AM, Sidou_3D <draoua.ahmed at gmail.com> wrote:
>
>> thank you very much for your help.
>>
>> Ahmed
>>
>>
>>
>> --
>> View this message in context:
>> http://vtk.1045678.n5.nabble.com/Connecting-Kinect-with-VTK-tp5719138p5719198.html
>>  Sent from the VTK - Users mailing list archive at Nabble.com.
>> _______________________________________________
>> Powered by www.kitware.com
>>
>> Visit other Kitware open-source projects at
>> http://www.kitware.com/opensource/opensource.html
>>
>> Please keep messages on-topic and check the VTK FAQ at:
>> http://www.vtk.org/Wiki/VTK_FAQ
>>
>> Follow this link to subscribe/unsubscribe:
>> http://www.vtk.org/mailman/listinfo/vtkusers
>>
>
>
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the VTK FAQ at:
> http://www.vtk.org/Wiki/VTK_FAQ
>
> Follow this link to subscribe/unsubscribe:
> http://www.vtk.org/mailman/listinfo/vtkusers
>
>


-- 
Regards
Nikhil
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.vtk.org/pipermail/vtkusers/attachments/20130313/ffa05280/attachment.htm>