SDP 12

Project “PRASER”Senior Design Project Final Project Review

Team Mosaic

Advisor: Professor Lixin GaoMembers: Allen Chew, Charles Essien, Brian Giang, Simon Ma

Evaluators: Professor Gong, Professor Vouvakis

2SDP 12 2

Agenda Introduction

• Refined project definition• Comparison

Project Specification• System block diagram• Subsystem components• Application• Accomplished• Demonstration

3SDP 12 3

Reintroduction - Motivation Online presentations are boring

• Difficult to view both presentationand presenter at the same time

• Low quality slides (streaming video)• Loss of focus on presenter

Viewing remote presentations• Bad visual quality• Loss of expression

4SDP 12 4

Comparison For most presentations,

• Difficult to capture both the presenter and Power Point at the same time

• Requires a cameraman

However our prototype application• Capable of capture both the

presenter and Power Point• Addition functions/gestures

5SDP 12 5

Reintroduction - Goals

We want to:Improve presentation experience

• More interactive• More entertaining

Rethink approach to capturing presentations• Bring focus back to the presenter• Facilitate “emotion” for remote presentation

6SDP 12 6

Design Specification – Project Definition

Praser is …

“A redesigned platform capable of delivering an enhanced presentation experience, both for in

person and remote viewers.”

More interactive utility for presenters Better experience for viewers with avatars

7SDP 12 7

Design Specifications –Block Diagram

System Block Diagram

8SDP 12 8

Design Specifications – Kinect Subsystem

OpenNI & NITE• Generate “users”• Return interpreted motions and gestures

OpenGL• Real-time image manipulation

OpenNI NITE OpenGL

9SDP 12 9

Kinect Subsystem - Capabilities

Gesture Recognition• Hand gestures for control• User poses

Tracking• Mapping user position to screen• Location based “selections”

Compositing• Background removal• Image manipulation

10

SDP 12 10

Kinect Subsystem – Avatar Application

Capture presenter in on screen avatar

Walk around and point modes• X, Y coordinates mapped with Kinect

Depth information• Presenter avatar points mapped to

actual points

11

SDP 12 11

Kinect Subsystem – Avatar Application cont’dBenefits:More expression and emotionBetter interaction with slideshow slidesMore efficient remote viewing of presentation

12

SDP 12 12

Accomplished

Hand TrackingHand GesturesVideo RecordingLayer Control – Presenter, Power Point Slides, AnnotationsSelecting specific Power Point SlidesDisplaying two slides at once – Splitting

13

SDP 12

Kinect Demonstration

13

14

SDP 12 14

The Future

Writing Recognition when annotating. Capturing the presenter in 3-D using two Kinects. Using the Kinect for other purposes (e.g. medical

diagnostics and therapy)

15

SDP 12 15

Problems Addressed

Purchased safety goggles to prevent retinal damage

Blanking not currently implemented For safety reasons decided would be best not to

use the laser system in this project. Memory Leak in software Video Recording Threading Tracking and Scaling

16

SDP 12 16

Team Responsibility

Allen Chew (CSE) – Team Manager, Coordinated laser projection system, Software Development, Researched on how to build correctional amplifier, Researched and ordered parts for project in a timely manner

Charles Essien (CSE) – Software coordinator, Research graphics libraries, Isolated user pixels and overlay onto slides, Created Flow and Calibration, Split Screen

Brian Giang (EE) – Laser Projection Coordinator, Coordinated team

meetings and set deadlines, Assembled laser projection system and figured signal lines from DAC

Simon Ma (CSE) – Compiled OpenLase Binaries, Ported code over to Ubuntu, Coordinated hand tracking and gestures, Created Annotations

17

SDP 12 17

The End

Thank you very much for your time. I hope you enjoyed the presentation.

Questions?