[vtkusers] Connecting Kinect with VTK

Wed Mar 13 12:44:58 EDT 2013

Nikhil,
I'm not sure.
The article was originally posted on Aunt Minnie.
Perhaps you could try contacting the original authors?
Note, I'm currently coming up to speed on the Kinect via a few tech articles and a local .NET user group meeting.
Regards,
e.-

________________________________
From: Nikhil Shetty [mailto:nikhil.shetty at kitware.com]
Sent: Wednesday, March 13, 2013 11:25 AM
To: Kischell, Eric R.
Cc: vtkusers at vtk.org
Subject: Re: [vtkusers] Connecting Kinect with VTK

Thanks for sharing this. Do you know if the application had an initialization step to recognize the person (like lifting the hand  to form a 'V' etc).

I had worked on a similar application and investigated using both the OpenNI based and MSKinect library. The OpenNI app (FAAST) typically required the user to hold a pose whereas the the MSKinect library didnt.

-Nikhil

On Wed, Mar 13, 2013 at 11:55 AM, Kischell, Eric R. <Kischell.Eric at mayo.edu<mailto:Kischell.Eric at mayo.edu>> wrote:
Dear VTK Lurkers,
While the Kinect thread is still active...
Here is an interesting medical Kinect application.

Kinect suitable for surgical manipulation of MR imagesBy Erik L. Ridley, AuntMinnie staff writer<http://contacteditor.auntminnie.com/>
January 14, 2013

Microsoft's Kinect motion-sensing gaming device is reliable for surgeons to use to manipulate MR images on operating room (OR) workstations, according to research from the Purdue University Department of Industrial Engineering.

A team led by doctoral student Mithun George Jacob concluded that gesture interaction and surgeon behavior analysis can facilitate accurate navigation and manipulation of MR images, opening the door for the replacement of traditional keyboard and mouse-based interfaces.

"The main finding is that it is possible to accurately recognize the user's (or a surgeon's in an OR) intention to perform a gesture by observing environmental cues (context) with high accuracy," the authors wrote.

Imaging devices are accessible in the OR today, but they use traditional interfaces that can compromise sterility. While nurses or assistants can use the keyboard for the surgeon, that approach can be cumbersome, inefficient, and frustrating, according to the researchers (Journal of the American Medical Informatics Association<http://jamia.bmj.com/>, December 18, 2012).

"This is a problem when the user (surgeon) is already performing a cognitively demanding task," they wrote.

In a three-step project, the researchers first developed an MR image browser application and conducted an ethnographic study with 10 surgeons from Purdue's College of Veterinary Medicine to gather a set of gestures that would be natural for clinicians and surgeons. Ten gestures were ultimately selected for use by the browser.

Next, the team developed gesture recognition software that used the OpenNI<http://www.openni.org/> software library to track skeletal joints using Kinect. System evaluation was then performed via three experiments.

In the first experiment, the researchers collected a dataset of 4,750 observations from two users. Gesture recognition was evaluated in a second experiment using a dataset of 1,000 gestures performed by 10 users.

The final experiment involved users performing a specific browsing and manipulation task using hand gestures with the image browser.

In the first experiment, the researchers found that their system was accurate in recognizing the gestures, with a mean recognition accuracy of 97.9% and a false-positive rate of 1.36%.

The second experiment showed a gesture recognition accuracy of 97.2%, while the third experiment concluded that the system could correctly determine user intent 98.7% of the time. Mean gesture recognition accuracy was 92.6% with context and 93.6% without context.

It's imperative to collect training data from more users, the authors noted, as people perform gestures differently and exhibit intent to use the system in different ways.

________________________________
From: vtkusers-bounces at vtk.org<mailto:vtkusers-bounces at vtk.org> [mailto:vtkusers-bounces at vtk.org<mailto:vtkusers-bounces at vtk.org>] On Behalf Of Pat Marion
Sent: Tuesday, March 12, 2013 7:47 PM
To: Sidou_3D
Cc: vtkusers at vtk.org<mailto:vtkusers at vtk.org>
Subject: Re: [vtkusers] Connecting Kinect with VTK

Hi,

The PCL Plugin for ParaView is a collection of VTK filters that use the Point Cloud Library.  Included in the plugin is the vtkOpenNISource.  This wraps around the pcl::OpenNIGrabber to provide point cloud streams from an OpenNI device like a Kinect camera.  Using the vtkOpenNISource, you can feed Kinect point clouds directly into your VTK filter pipeline.  The source code, and a video demonstration is here:

http://www.paraview.org/Wiki/ParaView/PCL_Plugin

Pat

On Sat, Mar 9, 2013 at 3:04 AM, Sidou_3D <draoua.ahmed at gmail.com<mailto:draoua.ahmed at gmail.com>> wrote:
thank you very much for your help.

Ahmed

--
View this message in context: http://vtk.1045678.n5.nabble.com/Connecting-Kinect-with-VTK-tp5719138p5719198.html
Sent from the VTK - Users mailing list archive at Nabble.com.
_______________________________________________
Powered by www.kitware.com<http://www.kitware.com>

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the VTK FAQ at: http://www.vtk.org/Wiki/VTK_FAQ

Follow this link to subscribe/unsubscribe:
http://www.vtk.org/mailman/listinfo/vtkusers

_______________________________________________
Powered by www.kitware.com<http://www.kitware.com>

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the VTK FAQ at: http://www.vtk.org/Wiki/VTK_FAQ

Follow this link to subscribe/unsubscribe:
http://www.vtk.org/mailman/listinfo/vtkusers

--
Regards
Nikhil
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.vtk.org/pipermail/vtkusers/attachments/20130313/08c96e8d/attachment.htm>