PROJECT ONAMAZING DIGITAL GLOVES THAT GIVE

VOICE TO THE VOICELESS

CONTENTSINTRODUCTIONBLOCK DIAGRAMFLEX SENSORADCMICROCONTROLLERSPEECH PROCESSORADVANTAGES AND APPLICATIONCONCLUSIONREFERENCE

INTRODUCTIONGlove-based systems represent one of the most important

efforts aimed at acquiring hand movement data.Generally dumb people use sign language for

communication but they find difficulty in communicating with others who do not understand sign language.

It is based on the need of developing an electronic device that can translate sign language into speech in order to make the communication take place between the mute communities with the general public possible, a Wireless data gloves is used which is normal cloth driving gloves fitted with flex sensors along the length of each finger and the thumb.

Mute people can use the gloves to perform hand gesture and it will be converted into speech so that normal people can understand their expression.

BLOCK DIAGRAM

USER GESTURE

FLEX SENSOR

ADCMICRO-

CONTROLLER

SPEECH PROCESSOR

FLEX SENSOR

In this project data glove is implemented to capture the hand gestures of a user. The data glove is fitted with flex sensors along the length of each finger and the thumb.

The Flex Sensor patented technology is based on resistive carbon thick elements.

When the substrate is bent, the sensor produces a resistance output correlated to the bend radius-the smaller the radius, the higher the resistance value.

Flex sensors are normally attached to the glove using needle and thread. They require a 5-volt input and output between 0 and 5 V, the resistivity varying with the sensor’s degree of bend and the voltage output changing accordingly.

The sensors connect to the device via three pin connectors (ground, live, and output).

The device can activate the sensors from sleep mode, enabling them to power down when not in use and greatly decreasing power consumption.

The flex sensor pictured below changes resistance when bent. It will only change, the resistance increases to 30- 40 kilo ohms at 90 degrees. The sensor measures ¼ inch wide, 4-1/2 inches long and 0.19 inches.

Fig : Basic Flex sensor Circuit

Fig . Sign Language

ADC(ANALOG TO DIGITAL CONVERTER)

The flex sensors output a stream of data that varies with degree of bend.

The analog outputs from the sensors are then fed to the ADC(analog to digital converter).

It processes the signals and perform analog to digital signal conversion.

The resulting digital signal is encoded and transmitted through microcontroller.

Features• Compatible with MCS-51® Products• 8K Bytes of In-System Programmable (ISP) Flash Memory– Endurance: 1000 Write/Erase Cycles• 4.0V to 5.5V Operating Range• Fully Static Operation: 0 Hz to 33 MHz• Three-level Program Memory Lock• 256 x 8-bit Internal RAM• 32 Programmable I/O Lines• Three 16-bit Timer/Counters• Eight Interrupt Sources• Full Duplex UART Serial Channel• Low-power Idle and Power-down Modes• Interrupt Recovery from Power-down Mode• Watchdog Timer• Dual Data Pointer• Power-off Flag

DescriptionThe AT89S52 is a low-power, high-performance

CMOS 8-bit microcontroller with 8K bytes of in-system programmable Flash memory.

The device is manufactured using Atmel’s high density non-volatile memory technology and is compatible with the industry-standard 80C51 instruction set and pin out.

The Atmel AT89S52 is a powerful microcontroller which provides a highly-flexible and cost-effective solution to many embedded control applications.

Pin Configurations

LCD DISPLAYLCD screen consists of two lines with 16

characters each. Each character consists of 5x7 dot matrix.

Contrast on display depends on the power supply voltage and whether messages are displayed in one or two lines.

For that reason, variable voltage 0-Vdd is applied on pin marked as Vee.

Trimmer potentiometer is usually used for that purpose. Some versions of displays have built in backlight (blue or green diodes).

When used during operating, a resistor for current limitation should be used (like with any LE diode).

FIG:LCD DISPLAY

FEATURES

•Operating voltage: 2.4V~12V•Low power and high noise immunity CMOS technology•Low standby current•Capable of decoding 12 bits of information•Binary address setting•Received codes are checked 3 times•Address/Data number combination•HT12D: 8 address bits and 4 data bits•Built-in oscillator needs only 5% resistor•Valid transmission indicator•Easy interface with an RF or an infrared transmission medium•Minimal external components•Pair with Holtek’s 212 series of encoders

SPEECH PROCESSORFEATURES

Operating Voltage Range: 3V ~ 6.5V. Single Chip, High Quality Audio/Voice Recording

& Playback Solution. No External ICs Required. Minimum External Components. User Friendly, Easy to Use Operation. Programming & Development Systems Not

Required. Powerful 16-Bits Digital Audio Processor. Non-volatile Flash Memory Technology. No Battery Backup Required.

External Reset pin. Powerful Power Management Unit Very Low Standby Current: 1uA Low Power-Down Current: 15uA Supports Power-Down Mode for Power Saving. Built-in Audio-Recording Microphone Amplifier. No External OPAMP or BJT Required. Easy to PCB layout. Configurable analog interface. Differential-ended MIC pre-amp for Low Noise. High Quality Line Receiver. High Quality Analog to Digital and PWM module. Resolution up to 16-bits. Simple And Direct User Interface.

OPERATIONTo start using the board, we need to provide +3v to

+6v DC to the board and connect a speaker to board. Ideally +5v will be just fine as we use with our controllers.

If no external audio is connected to line in stereo pin, onboard MIC will automatically be used for recording.

Power on the board now.Put the SW(REC mode switch) to record mode. The

record mode is indicated by a RED LED. If LED is off means the board is in play mode. Move it to either side to switch between PLAY and RECORD mode.

Press the switch to record and the RED LED will be glowing due to that.

Press the switch to record and the RED LED will be glowing due to that.

Now let us check what we recorded. Put REC mode switch to PLAY mode , RED LED will go off indicating play mode .Press SW to play back the recorded message.

FIG:PIN CONFIGURATION

Advantages Low cost Compact systems Flexible to users It takes less power to operate system Applications Physically challenged persons Conveying information related Operations

CONCLUSIONSign language is a useful tool to ease the communication

between the deaf or mute community and the normal people.

Yet there is a communication barrier between these communities with normal people.

This project aims to lower the communication gap between the deaf or mute community and the normal world.

This project was meant to be a prototype to check the feasibility of recognizing sign language using sensor gloves.

With this project the deaf or mute people can use the gloves to perform sign language and it will be converted in to speech so that normal people can easily understand.

REFERENCES• Sushmita Mitra and Tinku Acharya, ”Gesture Recognition: A Survey”,

IEEE Transactions On Systems,Man, and Cybernetics—PART C: Applications and Reviews, VOL. 37, NO. 3, MAY 2007, pp. 311-324.

• Md. Al-Amin Bhuiyan, “On Gesture Recognition for Human-Robot Symbiosis”, The 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN06), Hatfield,UK, September 6-8, 2006, pp.541-545.

• V. I. Pavlovic, R. Sharma, and T. S. Huang, “Visual interpretation of hand gestures for human computer interaction,” IEEE Trans. Pattern Anal.Mach. Intell., vol. 19, no. 7, pp. 677–695, Jul. 1997.

• R. Venkatesh Babu, K. R. Ramakrishnan, Compressed Domain Human Motion Recognition Using Motion History Information, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), April, vol. 3, 2003, pp. 41-44

• J. Weaver, T. Starner, and A. Pentland, “Real-time American Sign Language recognition using desk and wearable computer based video,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 1371–1378, Dec.1998.

THANK

YOU