mind reading computers report

21
1 MIND READING COMPUTERS BY AMAN RAJ (1221510004) Submitted to the Department of COMPUTER SCIENCE In partial fulfillment of the requirements For the degree of Bachelor of Technology In COMPUTER SCIENCE SHREE GANPATI INSTITUTE OF TECHNOLOGY U.P. Technical University 2015

Upload: aman-raj

Post on 22-Jan-2018

608 views

Category:

Technology


11 download

TRANSCRIPT

1

MIND READING COMPUTERS

BY

AMAN RAJ (1221510004)

Submitted to the Department of COMPUTER SCIENCE

In partial fulfillment of the requirements

For the degree of

Bachelor of Technology

In

COMPUTER SCIENCE

SHREE GANPATI INSTITUTE OF

TECHNOLOGY U.P. Technical University

2015

2

DECLARATION

I hereby declare that this submission is my own work and that, to the best of my knowledge and belief, it contains no material previously published or written by another person nor material which to a

substantial extent has been accepted for the award of any other degree or diploma of the university or other institute of higher learning, except where due acknowledgment has been made in the text.

SIGNATURE

AMAN RAJ (1221510004)

3

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

CERTIFICATE

This is certified that the project report entitled Mind Reading computers is a bonafide work carried

out by AMAN RAJ (1221510004) in the partial fulfillment for the award of Degree of Bachelor of

Technology in department of Computer Science And Engineering of Uttar Pradesh Technica l

University during the year 2014-2015, is a record of the candidate own work carried out by him

under my/our supervision. The matter embodied in this thesis is original and has not been

submitted for the award of any other degree.

Date: Supervisor

Prof. Pradeep Tripathi

4

ACKNOWLEDGEMENT

It gives us a great sense of pleasure to present the report of the B. Tech Project undertaken during B. Tech. Pre-Final Year. We owe special debt of gratitude to Professor Prof. AVINASH SHAMA, Project Coordinator, Department of Computer Science & Engineering, SGIT, GHAZIABAD for his constant

support and guidance throughout the course of our work. His sincerity, thoroughness and perseverance have been a constant source of inspiration for us. It is only his cognizant efforts that our endeavors have

seen light of the day. We also take the opportunity to acknowledge the contribution of Prof. VIPIN. DEVAL, Head, Department of Computer Science & Engineering, SGIT, GHAZIABAD for his full support and assistance

during the development of the project. We also do not like to miss the opportunity to acknowledge the contribution of all faculty members of

the department for their kind assistance and cooperation during the development of our project. Last but not the least, we acknowledge our friends for their contribution in the completion of the project.

Date:

AMAN RAJ (1121510004)

5

ABSTRACT

People express their mental states, including emotions, thoughts and desires, all the time through facial expressions, vocal nuances and gestures. Mind reading machine is co-ordination of human psychology

and computer techniques. Some equipment are used to gather data & then analyzed. To use those data for further prediction of mind is known as theory of mind reading. Existing human-computer interfaces

are mind-blind, they are unaware to the user’s mental states and intentions.

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer Laboratory at the University of Cambridge has developed mind-reading machines - computers that

implement a computational model of mind-reading to infer mental states of people from their facial signals. The goal is to enhance human-computer interaction through empathic responses, to improve the productivity of the user and to enable applications to initiate interactions with and on behalf of the user,

without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions in real time and infers that person's underlying mental state, such as whether he or she is agreeing or

disagreeing, interested or bored, thinking or confused.

6

TABLE OF CONTENTS Page.no.

TITLE PAGE……………………………………………………………………………… i

DECLARATION................................................................................................................ ii

CERTIFICATE.................................................................................................................. iii

ACKNOWLEDGEMENTS............................................................................................... iv

ABSTRACT....................................................................................................................... v

LIST OF FIGURES........................................................................................................... viii

CHAPTER 1 PREAMBLE………………………………………………………………… 7

1.1 Introduction 8

1.1.1 What is Mind Reading? 9

1.2 Scope of Mind Reading 10

1.2.1 Future of Mind Reading Computers 11

CHAPTER 2 TECHNOLOGY AND REQUIREMENT .................................. 12

2.1 TECHNOLOGY USED 13

2.1. FUTURISTIC HEAD BAND 13

2.1.2. NUROSCIENCE 14

CHAPTER 3 WORKING OF MIND READING COMPUTERS……………..................… 23

3.1 Process of the Reading mind using mind reading computers 24

3.2 REQUIREMENT ANALYSIS 25

3.2.1 SYSTEM ANALYSIS OVERVIEW 25

3.2.2 FEASIBILITY STUDY 26

CHAPTER 4 – Mind Reading Computers around the world……………........................... 36

4.1 APPLICATION & USES 37

4.2 ADVANTAGES & DISADVANATGES 37

CONCLUSION……………………………………………………………………………….... 62

REFFRENCES……………………………………………………………………………….... 63

7

CHAPTER-1

PREAMBLE

8

1. INTRODUCTION

People express their mental states, including emotions, thoughts and desires, all the time through facial

expressions, vocal nuances and gestures. Mind reading machine is co-ordination of human psychology and computer techniques. Some equipment are used to gather data & then analyzed. To use those data for further prediction of mind is known as theory of mind reading. Existing human-computer interfaces

are mind-blind, they are unaware to the user’s mental states and intentions.

1.1 WHAT IS MIND READING?

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer Laboratory at the University of Cambridge has developed mind-reading machines - computers that

implement a computational model of mind-reading to infer mental states of people from their facial signals. The goal is to enhance human-computer interaction through empathic responses, to improve the

productivity of the user and to enable applications to initiate interactions with and on behalf of the user, without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions

in real time and infers that person's underlying mental state, such as whether he or she is agreeing or disagreeing, interested or bored, thinking or confused.

Prior knowledge of how particular mental states are expressed in the face is combined with analysis of facial expressions and head gestures occurring in real time. The model represents these at different

granularities, starting with face and head movements and building those in time and in space to form a clearer model of what mental state is being represented. Software from Nevenvision identifies 24 feature

points on the face and tracks them in real time. Movement, shape and color are then analyzed to identif y gestures like a smile or eyebrows being raised. Combinations of these occurring over time indicate mental states. For example, a combination of a head nod, with a smile and eyebrows raised might mean interest.

The relationship between observable head and facial displays and the corresponding hidden mental states over time is modeled using Dynamic Bayesian Networks.

1.2 Scope of Mind Reading

According to IBM, we might soon be lighting our house with human generated power or using computers that can literally read our minds…. Those are just two of IBMs 5 in 5 predictions for how technology will change the world within the next 5 years. Below, we take a whistle-stop tour

through their list and the implications for financial technology.

9

1.2.1 Future of mind reading computers

IBM uses the example of walking up to an ATM that lets you withdraw cash by simply saying your name. That might seem a way off, but getting to grips with contactless payments and letting digita l

signatures take the place of compliance nightmares are just around the corner.

MIND READING WILL BECOME A REALITY

IBM is apparently already researching just how to hook up your brain to your mobile device. It may sound like something from Doctor Who but mind reading computers that respond not only to voices but

the thoughts in your head could become a reality.

PASSWORDS WILL BECOME A THING OF THE PAST

Biometric identification is set to put an end to the pain of remembering countless different passwords and log-ons. Instead, you will be able to log on securely by simply speaking or looking at an eye

sensor.

IBM uses the example of walking up to an ATM that lets you withdraw cash by simply saying your name. That might seem a way off, but getting to grips with contactless payments and letting digita l

signatures take the place of compliance nightmares are just around the corner.

THE DIGITAL DIVIDE WILL END

The information gap is one of the biggest divides that separates the haves from the have-nots of modern society. Within 5 years, IBM predicts the gap will have ceased to exist.

Whilst the developing world benefits from access to better medical, technological and social information

and uses it in life changing ways, financial providers will have to get better and better at sharing valuable information with the world.

JUNK MAIL WILL BECOME PRIORITY MAIL

Unsolicited e-mails will become a thing of the past with our computers knowing what we want even before we do. The idea of a smartphone picking your investment portfolio might be a little fanciful but

a move towards timely, highly relevant, highly personal messages is hugely attractive.

For financial institutions, the biggest issue will be ensuring that they are at the front rather than the back

of the queue of people implementing such technology. For years, banks have struggled to use and manage customer data effectively. As technology improves at breakneck speed, customer patience is about to wear out

10

CHAPTER-2

TECHNOLOGY AND REQUIREMENTS

11

2.1 TECHNOLOGY USED

The mind reading actually involves measuring the volume and oxygen level of the blood around the

subject's brain, using technology called functional near-infrared spectroscopy (fNIRS). The user wears a sort of futuristic headband that sends light in that spectrum into the tissues of the head

where it is absorbed by active, blood-filled tissues. The headband then measures how much light was not absorbed, letting the computer gauge the metabolic demands that the brain is making.

2.1.1 FUTURISTIC HEAD BAND

The mind reading actually involves measuring the volume and oxygen level of the blood around the

subject’s brain using technology called functional near-infrared spectroscopy (fNIRS).

The user wears a futuristic head band that sends light in that spectrum into the tissues of the head where

it is absorbed by active, blood filled tissues.

FIG: FUTURISTIC HEAD BAND

The headband then measures how much light was not absorbed, letting the computer gauge the metabolic

demands that the brain is making. The results are often compared to an MRI, but can be gathered with

lightweight, non-invasive equipment.

12

2.1.2 NUROSCIENCE

Neuroscience is the scientific study of the nervous system. Traditionally, neuroscience has been seen as

a branch of biology. However, it is currently an interdisciplinary science that collaborates with other

fields such as chemistry, cognitive science, computer

science, engineering, linguistics, mathematics, medicine (including neurology), genetics, and allied

disciplines including philosophy, physics, and psychology. It also exerts influence on other fields, such

as neuroeducation,[2]neuroethics, and neurolaw. The term neurobiology is usually used interchangeab ly

with the term neuroscience, although the former refers specifically to the biology of the nervous system,

whereas the latter refers to the entire science of the nervous system.

The scope of neuroscience has broadened to include different approaches used to study

the molecular, cellular,developmental, structural, functional, evolutionary, computationa l,

and medical aspects of the nervous system. The techniques used by neuroscientists have also expanded

enormously, from molecular and cellular studies of individual nerve cells toimaging of sensory and motor

tasks in the brain. Recent theoretical advances in neuroscience have also been aided by the study of neural

networks.

13

CHAPTER-3

WORKING OF MIND READING

COMPUTERS

14

3.1 PROCESS OF THE READING MIND USING MIND READING COMPUTERS The results are often compared to an MRI (Magnetic Resonance Imaging), but can be gathered with lightweight. Wearing the fNIRS (functional near-infrared spectroscopy) sensor, experimental subjects

were asked to count the number of squares on a rotating onscreen cube and to perform other tasks. Preliminary results show that using buttoned sensors. Biological signals arise when reading or speaking to oneself with or without actual lip or facial movement.

DISPLAYING IMAGE FROM BRAIN

MONITORING A CAR DRIVER . . .

15

Mind reading in Web Search

For the first test of sensors, scientists trained the program to recognize six

words-including “go", "left” and “right” numbers, etc.

Then researchers put the letters of the alphabet into a matrix with each column and row labeled with a single digit number.

These were used to silently spell “NASA” into a web search engine using program.

“This proved we could browse the web without touching a Keyboard”.

3.2 REQUIREMENT ANALYSIS 3.2.1 SYSTEM ANALYSIS OVERVIEW Problem recognition means detailed study of the current system being used by the user. A detailed study of system being currently used must be carried out of sessions with the Individual.

A complete understanding of Mind Reading computers is essential to the success the performance. The problem evaluation and solution synthesis is the next major area of effort for analysis. It enables the

system, engine to redefine the software allocation and build model of process followed Identification of need Preliminary investigation.

3.2.2 FEASIBILITY STUDY

All the projects are feasible given the unlimited resources and infinite time. Unfortunately, the

development of a computer-based system or product is more likely to be plagued by the scarcity of resources and difficult delivery dates. It is both necessary and prudent to evaluate the feasibility of a project at the earliest possible time. Months or years of effort, thousands or millions of rupees, and

untold professional embarrassment can be averted if an ill-conceived system is recognized early in the definition phase.

Feasibility and risk analysis are related to each other. If project risk is great, the feasibility of producing quality software is reduced.

However, we confine our attention to:

Technical Feasibility.

Economical Feasibility.

Operational feasibility.

16

CHAPTER-4

MIND READING COMPUTERS

AROUND THE WORLD

17

4.1 APPLICATIONS & USES OF MIND READING COMPUTERS

1) Mind-reading computers could 'save your life‘

2) Emergency

3) Control robots by brain power

4) Mind-Reading Technology Speeds Ahead

5) The mind-reading computer that could communicate with coma patients

Mind-reading computers could 'save your life‘

Devices allowing people to write letters or play pinball using just the power of their brains have become

a major draw at the world's biggest high-tech fair. Scientists are researching ways to monitor motorists' brain waves to improve reaction times in a crash.

Emergency

In an emergency stop situation, the brain activity kicks in on average around 200 milliseconds before even an alert driver can hit the brake.

There is no question of braking automatically for a driver - "we would never take away that kind of control" Using this brain-wave monitoring technology, a car can also tell whether the driver is drowsy or not,

potentially warning him or her to take a break.

Control robots by brain power

Another device allows users to control robots by brain power. The small box has lights flashing at different frequencies at the four points of the compass.

The user concentrates on the corresponding light, depending on whether he wants the robot to move up, down, left or right and

the brainwaves generated by viewing that frequency are monitored and the robot is controlled.

18

Mind-Reading Technology Speeds Ahead

By scanning blogs of brain activity, scientists may be able to decode people's thoughts, dreams and

intentions By Kerri Smith and Nature magazine .Makes Web browsing easy Giving Commands will be easy for the users who use the internet , it will also provide the simplicity to the users, those who are not so much educated they can also use the website as they are good enough to speak rather than to write so

those type of people can also use these computers.

The mind-reading computer that could communicate with coma patients Canadian researchers have developing a mind-reading computer that could help communicate with people in a coma. The University of Western Ontario researchers used neuroimaging to read human thoughts via brain

activity when they are conveying specific ‘yes’ or ‘no’ answers. The team say their research could lead to dramatic new ways of attempting to communicate with patients

in a vegetative state.

Fig: Communication of the mind reading computer with people

19

4.2 ADVANTAGES & DISADVANTAGES OF MIND READING

COMPUTERS

ADVANTAGERS & USES

Can read minds

Help paralytic patients

Help Handicapped people

Help Comma patients

Help people who cant speak

Can be used for military purposes & sting operations

Can be combined with consoles & used for mind gaming, robotics & stuff.

Eliminate the capability to lie.

DISADVANTAGERS & PROBLEMS

It is not always correct while predicting the views

Can extract, through an individual, an important, secure &

confidential information of individual, state or even a country

If developed or used by sinners, can be highly dangerous

Eavesdropping

No way to neutralize this technology.

20

CONCLUSION

Tufts university researchers have begun a 3 year research project which, if successful, will allow computers to respond to the brain activity of the computer’s users.

Users wear a futuristic looking headbands to shine light on their foreheads and then performs a series of increasingly difficult tasks while the device reads what parts of the brain are absorbing the light. That info is then transferred to the computer and from there the computer can adjust its interface and functions

to each individual.

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer Laboratory at the University of Cambridge has developed mind-reading machines - computers that

implement a computational model of mind-reading to infer mental states of people from their facial signals. The goal is to enhance human-computer interaction through empathic responses, to improve the productivity of the user and to enable applications to initiate interactions with and on behalf of the user,

without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions in real time and infers that person's underlying mental state, such as whether he or she is agreeing or

disagreeing, interested or bored, thinking or confused.

Prior knowledge of how particular mental states are expressed in the face is combined with analysis of facial expressions and head gestures occurring in real time. The model represents these at different granularities, starting with face and head movements and building those in time and in space to form a

clearer model of what mental state is being represented. Software from Nevenvision identifies 24 feature points on the face and tracks them in real time. Movement, shape and color are then analyzed to identify

gestures like a smile or eyebrows being raised. Combinations of these occurring over time indicate mental states. For example, a combination of a head nod, with a smile and eyebrows raised might mean interest. The relationship between observable head and facial displays and the corresponding hidden mental states

over time is modeled using Dynamic Bayesian Networks.

21

REFERENCES

www.eurescom.de/message/default_Dec2004.asp

blog.marcelotoledo.org/2007/10

www.newscientist.com/article/dn4795-nasa-develops-mindreading-system

http://blogs.vnunet.com/app/trackback/95409

Face station tracking, 2002.

S. Baron-Cohen. How to build a baby that can read minds: Cognitive

mechanisms in mindreading. Current Psychology of Cognition, 13(5):513–552,

1994.

S. Baron-Cohen and T. H. E. Tead. Mind reading: The interactive guide to

emotion, 2003.