gam02 kinect1, kinect2
DESCRIPTION
TRANSCRIPT
Template designed by
Kinect 1, Kinect 2, Leap Motion, Intel
Perceptual Computing: quale scegliere?
Matteo Valoriani
[email protected] - @MatteoValoriani
Template designed by
brought to you by
WHO I AM…
PhD Student at Politecnico of Milano
CEO of Fifth Element
Consultant
FOLLOW ME ON
TWITTER OR THE
KITTEN GETS IT:
@MatteoValoriani
Template designed by
Why NUI
Sensors
• Kinect 1
• Leap Motion
• Intel Camera
• Kinect 2
Which to choose?
Agenda
Why NUI?
#CDays14 – Milano 25, 26 e 27 Febbraio 2014
NUI devices
Template designed by
Kinect
Template designed by
3D DEPTH SENSOR
RGB CAMERA
MULTI-ARRAY MIC MOTORIZED TILT
Hardware
Depth resolution:
320x240
RGB resolution:
640x480
FrameRate:
60 FPS
Latency
90 ms
Kinect - Specs
Template designed by
43° vertical by 57° horizontal field of view
Kinect - Field of View
Template designed by
Skeleton Data
Maximum two players
tracked at once
Six player proposals per
Kinect
dem
o
#CDays14 – Milano 25, 26 e 27 Febbraio 2014
Leap Motion
https://www.youtube.com/watch?v=_d6KuiuteIA
https://airspace.leapmotion.com/
Template designed by
Hardware
Template designed by
Leap Motion -Field of View
150° - Long Side
120° - Short Side
Max 60 cm abovethe controller
Max 60 cm wide on each side
Template designed by
Leap Motion for Developers
Template designed by
Hands Recognition
Template designed by
Comfortable use of Leap
Place the Leap Motion Controller on your desk where it's comfortable to use.
Relax your shoulders. If standing or sitting high in a chair, hold your elbows near your side, and keep
your forearms parallel to the floor and at a right angle from your body. If sitting at usual desk height,
you can rest your elbows or forearms on your desk, but not on a sharp edge. Hold your hands just
above the device, your wrist and hands in roughly a straight line
Template designed by
dem
o
Template designed by
Intel Perceptual Computing
https://www.youtube.com/watch?v=WePIY7svVtg
Template designed by
Camera Specs
Hardware:
Depth resolution:320x240
RGB resolution:1280x720
FrameRate:30 FPS
• Size:10.15 x 5.1 x 5 cm
Template designed by
dem
o
Template designed by
Kinect 2 - Specs
3D DEPTH SENSOR
RGB CAMERA
MULTI-ARRAY MIC
Hardware:
Depth resolution:512×424
RGB resolution:1920×1080 (16:9)
FrameRate:60 FPS
Latency:60 ms
Template designed by
Kinect 2 vs Kinect 1
Version 1 Version 2
Depth range 0.4m → 4.0m 0.4m → 4.5m
Color stream 640×480 1920×1080
Depth stream 320×240 512×424
Infrared stream None 512×424
Audio stream 4-mic array 16 kHz 4-mic array 48 kHz
USB 2.0 3.0
Hand Traking External tools Yes
Face Traking Yes Yes+Expressions
FOV 57° H 43° V 70° H 60° V
Tilt Motorized Manual
dem
o
Which to choose?
Template designed by
Some selection criterias…
1° 2° 3° 4°
2 or + users Kinect 2 Kinect 1 Intel Leap
Full body interaction Kinect 2 Kinect 1 - -
Hand Recognition Intel Leap Kinect 2 Kinect 1*
Accuracy Leap Intel Kinect 2 Kinect 1
Voice command Intel (Kinect 2) Kinect 1
Minimum Hardware Intel Leap Kinect 1 Kinect 2
Price Leap Kinect 1 Intel* (Kinect 2)
Compatibility Leap Intel Kinect 1 Kinect 2
Template designed by
Microsoft Kinect Issues:
The device is large
A dedicated power cord is required
The amount of data generated by the sensor also tends to saturate
a USB controller
Kinect cannot easily distinguish individual fingers on a hand
Most of the features listed above require the Microsoft SDK, which
is only supported for desktop applications on Windows 7 and 8.
Which to choose? ALL
Microsoft Kinect
Advantages:• Skeletal tracking
• Face tracking
• Multiple sensors:
• Raw data
• Voice control
Best for:
Kiosks, installations, and digital signage projects where the user will be
standing fairly far away from the display.
Template designed by
Leap Motion Issues:Sensing range is fairly limited.
Only fingers are tracked.
There is no skeleton or face tracking.
No access to the raw sensor data.
Which to choose? ALL
Leap Motion Advantages:• Finger tracking is fast and
accurate.
• Smaller and less expensive
• Framework support: .NET, Processing, Cinder, etc.
• Compatible: Mac OS and Windows.
Best for:
Controlled kiosk environments with a pointing-based UI.
Generally best for general audience desktop apps which can be distributed in the Airspace
store.
Template designed by
Intel Issues:
Getting some of the deeper features (like age and gender
detection) to work is a bit tricky.
Device and software are in beta.
Due to the close range of the tracking system, hand
gestures must be designed such that a user’s hand doesn’t
occlude their own view of the display.
Which to choose? ALL
Intel Advantages:• Smaller and less expensive
• Close-range tracking
• Hand posture/gesture recognition
• Facial analysis
• Speech (built-in support for speech synthesis powered by Nuance).
• Raw data
• Framework support: Processing, Unity and OpenFrameworks
Best for:
Desktop/laptop applications where the user will be seated in front of the PC.
Close range applications where features, apart from hand tracking and recognition, are
necessary without too much precision or accuracy.
… TIRED?
Template designed by
So Long
and
Thanks for
all the Fish
Template designed by
brought to you by