odessa .net user group - kinect v2
DESCRIPTION
Slides for my talk "Introduction to Kinect v2" at Odessa .NET User Group on 30.10.2014TRANSCRIPT
Kinect v2
Дмитрий Миндра@dmytromindra
Что такое Кинект v2?
64Kbyte0.043MHz
Что же такое Kinect v2?
Kinect VS Kinect v2Feature K4W K4W v2
Color Camera 640x480 @30 fps 1920 x1080 @30 fps
Depth Camera 320 x 240 512 x 424
Infra-Red (Spreads Dots) Yes No
Infra-Red (TOF) No Yes
Infra-Red Spectrum ~827 - 850nm ~827-850nm
Max Depth Distance ~4.5M ~4.5M
Min Depth Distance 40cm in near mode 50cm – 1cm (near mode)*
Microphone Array 4 mics 4 channels 16bit 16kHz 4 mics 4Channels 32bit 16kHz IEEE Float
Kinect VS Kinect v2Feature K4W K4W v2
Horizontal Field Of View 57 degrees 70 degrees
Vertical Field of View 43 degrees 60 degrees
Tilt Motor Yes No
Body Joints 20 26
Skeletons Tracked 2 6
USB version 2 3.0
Supported OS Win 7, Win 8 Desktop Win 8
Price $299 $199
Types of Applications Desktop, x86, x64, JavaScript, Web Desktop, x86, x64, Win 8 Store, JavaScript, Web
Кинект – это новый способ взаимодействия!
Высокоуровневая архитектура
Kinect Drivers
Kinect Runtime
.NetAPI
.NetApps
Native API
Native Apps
WinRT API
Windows Store Apps
C#, VB, JS, C++/CX
Несколько приложений могут работать с одним сенсором одновременно !
Physical Kinect Sensor
The data sources
Audio, Speech,
Interactions
DepthInfrared
Body Body Masks
Color
512 x 424 array of pixels
30 fps
2 bytes per pixel– 16-bit IR intensity value
Ambient light removedFrom the same physical sensor as depth
InfraredFrameSource
• 512 x 424 array of depth pixels• 30 fps• Range: 0.5 - 4.5 meters• Each depth pixel is a 16-bit
distance in millimeters from the sensor’s focal plane
DepthFrameSource
1920 x 1080 array of color pixelsDifferent image sensor than depth30 fps
– Will maintain brightness and quality by dropping to 15 fps in low-light
ColorFrameSource
512 x 424 array of body indexes– -1: No body at this pixel– 0 to 5: Index of the corresponding body, as
tracked by the body source
30 fpsResolution is same as depth
BodyIndexFrameSource
• Frame data is a collection of Body objects each with 25 joints– Each joint has position in 3D space and an
orientation
• Up to six simultaneous bodies• 30fps• Hand State on 2 bodies• Lean
BodyFrameSource
• Data is audio samples captured over a specific interval of time
• Audio data is associated with an “audio beam”– A steerable “cone” of focus for audio– May be automatically or manually aimed
AudioFrameSource
Есть официальный плагин для Unity!
Время для Демонстрации!
• Activities, Appearance, Expression– EyeLeftClosed, EyeRightClosed, LookingAway, MouthMoved,
MouthOpen, WearingGlasses, Happy expression, Neutral expression
• Speech• HD Face• Unity• Fusion
Что еще есть в Кинекте ?
Купить кинект!Зайти на Dev Center – http://aka.ms/k4wdev
Больше информации на официальном сайте http://kinectforwindows.com
Скачать плагин для Юнити:http://www.microsoft.com/en-us/kinectforwindows/develop/downloads-docs.aspx
Фото разобранного Кинекта вы можете найти на https://www.ifixit.com/Teardown/Xbox+One+Kinect+Teardown/19725
Видео лекции:http://channel9.msdn.com/Events/Build/2014/2-532http://channel9.msdn.com/Events/Build/2014/2-514
С чего начать ?
Спасибо !