supervisor – dr. deepak singh tomar prof. jaytrilok chaudhary team members- harshita jhavar iii yr...

20
UKSH THEY HAVE THE POTENTIAL BUT NO OPPORTUNITY Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III Y ANUSHEEL SINGH III Y AMAN GUPTA II YR GAURAV ISRANI II YR ( ALL FROM BTECH CSE)

Upload: harvey-garrison

Post on 24-Dec-2015

225 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

UKSHTHEY HAVE THE POTENTIAL BUT NO OPPORTUNITY

Supervisor – Dr. Deepak Singh TomarProf. Jaytrilok Chaudhary

Team Members-HARSHITA JHAVAR III YRANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI II YR( ALL FROM BTECH CSE)

Page 2: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Over 364 million in the world are deaf,Assuming 1,00,000 people in a country.

- WORLD HEALTH ORGANISATION

Page 3: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

1 out of every 19 is hearing impaired!!

Page 4: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

GALLUDET UNIVERSITY- ONLY ONE UNIVERSITY WHICH

PROVIDES ALL THE PROGRAMS AND SERVICES FOR THE DEAF

364 MILLION- 1 UNIVERSITY THEY HAVE THE POTENTIAL BUT NO OPPORTUNITY

Page 5: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

To enable the deaf to study at any school or university with

normal people

VISION

Page 6: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Let a computer be their ears with speech

recognition and sign language animation.

UKSH

Page 7: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

THE IDEA!!

TEACHER

microphone

SPEECH IS CONVERTED TO SIGN LANGUAGE

SIGN LANGUAGE

Page 8: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

UKSH HAS TWO MAIN COMPONENTS:

• Speech Recognizer - MS API

• Sign Language Animator

Converts Spoken Words To Text

Converted Text To Sign Language Animation

Page 9: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

OUR RESEARCH WORKWILL BE TO IMPLEMENTTHAT KIND OF MACHINE

LEARNING INORDER TO GENERATESIGN LANGUAGE ANIMATION

Page 10: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Sentence Spoken

Converted Into Text

Part of Speech Tagger

Page 11: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

HE SAW THE MOVIE.

PRONOUN VERBDETERMINANT NOUN

USING MAXIMUM ENTROPY MARKOV MODELS ALGORITHM

Page 12: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Sentence Spoken

Converted Into Text

Part of Speech Tagger

Sign Language translator

Page 13: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Sign Language Translator

It determines the type of the sentenceAnd after this it applies that type

of grammar into the Sentence.

He saw the movie- Declarative sentence

Page 14: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Determinants are droppedSaw- Finish seeRearrangement……..

Movie he finish see

Page 15: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Sentence Spoken

Converted Into Text

Part of Speech Tagger

Sign Language translator

Sign Language Animation Generator

Page 16: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Movie he finish see

Sign language animation generator

It uses the dictionary stored in it’s databaseTo generate the sign language animation

Page 17: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

WHAT ABOUT THE PROPER NOUNS/ SPECIAL

TERMINOLOGIES????

CAN ADD NEW WORDS

TO THE DICTIONARYJust like how new words are added to

Spoken English!!!

Page 18: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Conclusion

Uksh enables the hearing impaired to Study anywhere in this world according

To their interest

160 280 364 420 620 1995 2010 2015 2020 2025

Page 19: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

Better futurePeople Society Technology

EducationAbridging the gap in the society

Page 20: Supervisor – Dr. Deepak Singh Tomar Prof. Jaytrilok Chaudhary Team Members- HARSHITA JHAVAR III YR ANUSHEEL SINGH III YR AMAN GUPTA II YR GAURAV ISRANI

“We have to start somewhere, you willBe able to speak to the computer as if you are speaking to another Human being”-Steve BallmerCEO Microsoft Corporation

Thank You !!!!