Seminar onAN INTRODUCTION

TO BLUE EYES TECHNOLOGY

BYBY

CHANDRAKANT VASHISTHACHANDRAKANT VASHISTHA

ROLL NO. 0922631018ROLL NO. 0922631018

WHAT IS BLUE EYES WHAT IS BLUE EYES TECHNOLOGY?TECHNOLOGY?• Aims at creating computational machines Aims at creating computational machines

that have perceptual and sensory ability.that have perceptual and sensory ability.

• The basic idea behind this technology is to The basic idea behind this technology is to give the computer the human power.give the computer the human power.

• Due to this the machine can understand what Due to this the machine can understand what a user wants, where he is looking at and even a user wants, where he is looking at and even realize his physical or emotional states.realize his physical or emotional states.

• Use camera and microphone to identify user Use camera and microphone to identify user actions and emotions.actions and emotions.

Motivation for blue eyesMotivation for blue eyes

• Human error - a frequent reason of Human error - a frequent reason of catastrophes and ecological disasterscatastrophes and ecological disasters– weariness weariness – OversightOversight– Mental illnessMental illness• Monitoring of consciousMonitoring of conscious

brain involvement (automation in brain involvement (automation in

long driving)long driving)

The term BLUE EYESThe term BLUE EYES

• BLUE in the term stands for Bluetooth,BLUE in the term stands for Bluetooth,

which enables reliable wireless which enables reliable wireless communicationcommunication

• EYES , because the eye movement EYES , because the eye movement enables us to obtain a lot of enables us to obtain a lot of interesting and important informationinteresting and important information..

How can we make How can we make computers computers

“see”and“feel” ?“see”and“feel” ?Blue eyes uses sensing Blue eyes uses sensing

technology to identify a user’s technology to identify a user’s actions and to extract key actions and to extract key

information.information.

Information is then analyzed Information is then analyzed to determine the user’s to determine the user’s physical, emotional, or physical, emotional, or

informational stateinformational state..

What is blue eyes not?What is blue eyes not?

•Neither predicts nor interferes Neither predicts nor interferes with operator’s thoughtswith operator’s thoughts

•Cannot force directly the Cannot force directly the operator to workoperator to work

TECHNOLGIES USEDTECHNOLGIES USED

• Emotion MouseEmotion Mouse

• Manual And Gaze Input Cascaded Manual And Gaze Input Cascaded (MAGIC)(MAGIC)

• Artificial Intelligent Speech Artificial Intelligent Speech RecognitionRecognition

• Simple User Interest Tracker Simple User Interest Tracker (SUITOR)(SUITOR)

Touch recognitionTouch recognition

• Hardware: - mouseHardware: - mouse– Heart rateHeart rate– Temperature : thermocoupleTemperature : thermocouple– Galvanic skin response (gsr): digital Galvanic skin response (gsr): digital

multimetermultimeter– General somatic activity (gsa): General somatic activity (gsa):

movement of computer mousemovement of computer mouse• Emotions: Emotions:

Anger, fear, sadness, disgust, joy, Anger, fear, sadness, disgust, joy, surprisesurprise

Eye trackingEye tracking

• Hardware: - cmos camera, jazz Hardware: - cmos camera, jazz multisensormultisensor

– Eye movementEye movement– Eye position (gaze)Eye position (gaze)– Level of blood oxygenation accelerationLevel of blood oxygenation acceleration– Ambient light intensityAmbient light intensity

Speech recognition Speech recognition

• Scanned input words are matched Scanned input words are matched against internally stored known against internally stored known wordswords

• Slight variations: statistical Slight variations: statistical techniques for matching processtechniques for matching process

System overviewSystem overview Central System UnitData Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Bluetooth

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.

DataLogger

applicationsapplications

• Generic control roomsGeneric control rooms– Power stationPower station– Flight control centersFlight control centers– Operating theatres Operating theatres

• Common applicationCommon application– A simpler system version for driversA simpler system version for drivers

Case study: professional Case study: professional driversdrivers

• Human factor in accidents : 92%Human factor in accidents : 92%

• Vehicle defects :Vehicle defects :

} 8%} 8%

• Road defects :Road defects :

Analogy between hci and Analogy between hci and dvidviHARDWARES

AND ESSENTIALS

Human

Computer

Interface

Driver Vehicle

Interface

Continuous attention

towards …… is required

Monitor screen Road, signal

conscious brain

involvement monitoring

Yes required Yes required

Oversight and weariness yes yes

For touch recognition Mouse, keyboard Steering, brake,

accelerator

Eye tracking towards Screen Signal, other vehicles

BLUE EYES ENABLED DEVICESBLUE EYES ENABLED DEVICES

PODPOD

Technology used in Technology used in carscars

PONGPONG

A RobotA Robot

Blue Eyes - benefitsBlue Eyes - benefits

•Prevention from dangerous Prevention from dangerous incidentsincidents

•Minimization ofMinimization of– ecological consequencesecological consequences– financial lossfinancial loss– a threat to a human lifea threat to a human life

FUTURE FUTURE DEVELOPMENTSDEVELOPMENTS

Security purposes.Security purposes.

ordinary household devices .ordinary household devices .

Eg : Working of television , Eg : Working of television ,

refrigerators & ovens when refrigerators & ovens when

we look at them.we look at them.

CONCLUSIONCONCLUSION

• Provide more delicate and user friendly Provide more delicate and user friendly facilities in computing devicesfacilities in computing devices

• Gap between the electronic and physical Gap between the electronic and physical world is reducedworld is reduced

• The computers can be run using implicit The computers can be run using implicit commands instead of the explicit commands instead of the explicit commandscommands

• Future applications of blue eye technology Future applications of blue eye technology is limitlessis limitless

Thank youThank you

Any Questions???Any Questions???