final presentation (1) (1)
DESCRIPTION
my PROJECTTRANSCRIPT
GESTURE RECOGNITION SYSTEM (GRS)
Group Partners:
Zain Bohri
Gargee Hiray
Gitesh Jethwa
Ashok Choudhary
Overview
• Introduction• Problem Statement• System Functional Requirement • Project Design• Testing • Costing • Applications and Limitations • Advantage and disadvantage • Future Enhancement
Introduction
• Gestures are a major form of human communication. Hence gestures are found to be an appealing way to interact with computers, as they are already a natural part of how we communicate.
Conceptual Diagram
Problem Statement
• The user needs to go under a long process to open any Application, Folder & Files which user uses frequently.
E.g. Opening WORD
• The any Application, Folder & Files which user require frequently which under goes this lengthy steps takes time
Principle Of Project
• The principle of our project is to provide a new
• Graphical User Interface (GUI)
• Make the system work efficiently
System Functional Requirements
• Software Requirements:
1. Java Development Kit
2. Java Media Framework
3. Operating System- Windows 9x onwards• Hardware Requirements:
1. Web Camera
2. RAM- 512 MB(minimum)
User
Normal User Physically Challenged User
Perform Action
Gesture RecognitionSystem
Check for Errors
Conversion to Binary Image
Noise Removal
Resizing Picture
Conversion to Grayscale Image
Identify Gesture
Zooming in Binary PictureCrop Image
«extend»
Update Background Picture«include»
Web Cam
Capture Image
Transmit Image to System
«extend»
Locate Hand in Picture
System Level Diagram
Important Modules Diagram
Grayscale
name: String
Convert_grayscale()
Normal UserPhysically Challenged
User
«powertype»UserType
1..*
Module Name
Gesture Identification
no_of_fingures : integer
Calculate_total_fingers()Identify_gesture()
Image capture
image_name : String
update_background()
Background
name : Stringtype : String
1..*
1
Binary
name : String
Convert_binary()
1uses
Image
width : integerheight : integersize : integer
User
name : String
perform_action()
«interface» Web Cam
Capture_image()Capture_background()
«powertype»imagetype
Error Checking
Check_errors()validate_picture()validate_no_of_hands()
Filter
perform_noise_reduction()check_noisy_pixels()set_intensities()
captures
recognizes
Gesture RecognitionSystem
1..* Updates
Image Designing• Our project is based totally on IMAGE PROCESSING.
• Java Media Framework is used for image and video processing by java.
Fig:- Image processing using JAVA MEDIA FRAMEWORK
• Algorithm used: EDGE CUTTING ALGORITHM • ZOOMING IN THE BINARY PICTURE.
• i.e. Converting Image 320*240 pixel size
• RECOGNIZING WHETHER THE HAND IS RIGHT OR LEFT.
• DETECTING WHETHER THE THUMB IS UP OR NOT.
Image Designing (contd..)
Image Designing (contd..) • EDGE COUNTING ANAYASIS .
• STORING THE IMAGE AT BACKEND.
• PERFORMING THE EVENT RELATED TO THE NUMBER OF EDGES OF IMAGE.
Input/output Design
USER
JMFInterface
PC
WebCamInterface
USB PORT
User Interface
The unit testing is performed for following modules:
• image capturing module.
• image processing module.
• gesture recognize module.
• event handling module.
Testing
1.Unit Testing
Re-engineering of following two modules was required.
• Binary conversion of image.
• Noise removal from image.
Different White Box Testing Methods Are Used Such As:
• Functional Testing for event handling module.
Testing (contd..)
• Compatibility Testing
Measures Expected Results Observed Results
Check number of fingers.
Execution of appropriate action.
Execution of appropriate action.
Measures Expected Results Observed Results
Windows XP
Should Runs Properly
Runs Properly
Windows 7 32-bit
Should Run Properly Runs Properly
Windows 7 64-bit Should run Properly Error of JMF
Re-engineering• JMF patches for Windows 7 (64-bit) is required
COSTINGNumber of Person = 4 Number of Computer = 2Total Number of Hours of per person = 100 hr *4 = 400Total Number of Hours of per Computer = 100 hr *2 = 200
Cost of per Hours of person = 10RsCost of per Hours of Computer = 10Rs
Total Cost of Person Hours = Cost per Hours * Total Hours of Person
= 10 * 400 Total = 4000
Cost of Computer Hours = 10 * 200 = 2000Rs Cost of Camera = 1*1000= 1000Rs
Total Cost of Software = Total Cost Of Human Hour + Total Use of Computer Hours + Cost Of Camera + Extra cost
= 4,000+ 2,000 + 1000 +200 = 7,200Rs/-
Total Cost Of Module = Rs7,200/- .
• Opening all basic applications merely on
gesture.• E.g. Paint, Word, PowerPoint
• Performing basic operations such as Refresh, Back, Enter
• Performing Cut, Copy & Paste operations on folders and files.
Application
Limitations
• Such systems are difficult to develop because of the complexity and the cost of implementation.
• Image Background should be kept black or of any constant color while running the application for proper functioning
• The gesture must be a hand gesture• There should be a reference point to recognize
the gesture
Advantage
• Provides a natural way of interfacing with the computers hence it is more users friendly.
• There is less wear and tear of the computer .• Carpal-tunnel syndrome is increasing because
of the repetitive use keyboard and mouse. Since this system does not use either of these as input device, it improves to be healthier way of interacting with the computers
Disadvantages
• The cost of implementation• Such systems are difficult to develop as each
gesture is assigned a specific control command, this system is not platform independent since certain control commands vary as the operating system varies.
• Eg windows7 open library where as xp opens my computer
Future Enhancement
• This system could further be used effectively and independently for different purposes such as follows :
• Control of consumer electronics • Interaction with visualization systems • Control of mechanical systems • Computer games • Security System• Television • In ATM’s
CONCLUSION
• Gesture Recognition System is a research and development project which performs the basic operations of the computer by detecting the human generated hand gestures and wit
• Finally we conclude that , This project has given us tremendous exposure to the industry working standards, which will definitely be useful in the future as working could be done without using any external equipments.
Web References
• http://www.javaworld.com• http://www.java.sun.com• http://sourceforge.net/projects/javaipl/• http://www.products.sun.com• http://www.javaguru.com• http://www.sunmicrosystems.com
Book References
• Taming Java Threads:
• The Complete Reference : Java
• Java Black Book :
• Matthew T. Nelson “ Java Foundation Classes “ ,
McGraw-Hill Publication.
Any Questions??.
Thank You !