1.1Microsoft Kinect for Human-Computer Interaction Prepared By: Patel Mihir B. 131060753015

2. Microsoft Kinect for HCI_________ 2Presentation Objective: Introduction How it Works Hardware and software Applications Conclusion 3. Introduction___________________ 3Kinect (codenamed in development as Project Natal) motion sensing input devices by Microsoft for Xbox 360 and Xbox One video game consoles and Windows PCs. it enables users to control and interact with their console/computer as Human is game controller, through a natural user interface using gestures and spoken commands. The first-generation Kinect was first introduced in November 2010. Kinect builds on software technology developed by Microsoft Game Studios and on range camera technology by Israeli developer Prime sense. 4. 4 Kinect sensor is a horizontal bar connected to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display. RGB camera depth sensor multi-array microphone running proprietary software which provide Full-body 3D motion capture Facial recognition Full Skeleton Tracking Gesture Recognition Voice Recognition Capabilities 5. 5 6. 6RGB camera -That stores three-channel data in a 1280 x 960 resolution at 12 frames per second, or a 640 x 480 resolution at 30 frames per second. This makes capturing a color image or video possible. infrared (IR) emitter and an IR depth sensor -The emitter emits infrared light beams and the depth sensor reads the IR beams reflected back to the sensor. The reflected beams are converted into depth information measuring the distance between an object and the sensor. This makes capturing a depth image possible.Multi-array microphone -That contains four microphones for capturing sound. Because there are four microphones, it is possible to record audio from a specific direction, as well as find the location of the sound source and the direction of the audio wave. 7. How It Works_________________ 7 8. Hardware & Software___________ 8 Microsoft released Kinect software development kit for Windows 7 in June, 2011. This SDK was meant to allow developers to write Kinect apps in C++/CLI, C#, or Visual Basic .NET by using Microsoft Visual Studio 2010.Similer software LibFreenect for Linux machines Google's released Robotic Operating System (ROS) OpenNI is used on all OS. 9. Application___________________ 9 Gaming Console and Gaming purpose Ex. Xbox 360 and Xbox one. Robotic applications Ex. MIT and UC Berkley researchers teamed up to create a quadrocopter capable of autonomous flight. Interactive science experiments Ex. team from the University of Konstanz in Germany paired the Kinect to help the blind navigate on their own. Exercise and physical therapy Language/speech learning Ex. Natural human-computer interaction with Kinect and Leap Motion Home Healthcare / Tele-Medicine 10. Challenges____________________ 10 Lots of variation in bodies, orientation, poses Lots of data to recognize of different poses,body,weight. 11. Conclusion___________________ 11 Kinect for Windows sensor and the Kinect for Windows software development kit (SDK) to develop and deploy innovative solutions for retail, healthcare, education and every area where Human computer interaction(HCI) is required. 12. References___________________ 12 www.kinectforwimdows.com I. Tashev, "Recent Advances in Human-Machine Interfaces for Gaming and Entertainment," Int'l J. Information Technology and Security, vol. 3, no. 3, 2011, pp. 6976. V. Tam and Ling-Shan Integrating the Kinect Camera, Gesture Recognition and Mobile Devices for Interactive Discussion IEEE International Conference R A. El-Iaithy, J. Huang, M. YehStudy on the Use of Microsoft Kinect for Robotics Applications IEEE International Conference. Z. Zhang, Microsoft Kinect sensor and its effect, IEEE Multimedia Mag. www.kinecthacks.com www.openkinect.com