gesture controlled wheel chair along with home …

"GESTURE CONTROLLED WHEEL CHAIR ALONG WITH

HOME AUTOMATION” 1: Manidipa Roy ABES Engineering College (AKTU)

2: Rahul Pal 3: Deepak Vishwakarma

Electronics and Communication Engineering Electronics and Communication Engineering

ABES Engineering College (AKTU) ABES Engineering College (AKTU)

4: Praveen Kumar Pal 5: Radheshyam Mourya

Electronics and Communication Engineering Electronics and Communication Engineering

ABES Engineering College (AKTU) ABES Engineering College (AKTU)

ABSTRACT

The plan is to develop a wheelchair for the physically challenged. The wheel is controlled by the chair

Hand movements/hand gestures are recognized by the accelerometer sensor. An ultrasonic sensor

is used to detect obstructions in front of the chair. Sensor signals are acted upon, And the wheelchair

is controlled by an atmega 328 microcontroller. Maintenance engineering Use of engineering

sciences and technology to improve people's quality of life Disability A device designed for blind

people to help them run home Appliances individually. Microelectrochemical systems (MEMS)

accelerometers are used to understand this feeling.

The movement of a hand moves in three straight directions (x, y, z) and moves

Wireless protocol using radio frequency (RF). The frequency of transmission of RF signal is 2.25 GHz.

The codec templates are already stored in the microcontroller in the receiver section. Received

The hand gestures shown by gestures and visually are recognized and compared

The templates are stored in the recipient. If the templates match the stored templates, then at

home accordingly the devices are controlled.

INTRODUCTION The wheelchair is the best accessory for the disabled and the elderly. Driving and control

The traditional wheelchair is a difficult job. Our goal is to manufacture low-cost, powerful wheelchairs

Help people with disabilities travel without people. Introducing cost prototype

ISSN No: 0932-4747

Page No:298

Zeichen Journal

Volume 7, Issue 6, 2021

An effective wheelchair based on electronic gestures. Easy to operate because this wheelchair can be

operated, this is true even for users without palms.

A wireless home automation system is powered to meet the needs of the elderly and disabled using

voice commands, touch screen responses and Zigbee technology to control lights and more home

appliances. The authors discussed the control of household appliances through the voice to the text

SMS and mobile phone are used as a remote control for the benefit of people with vision problems and

the elderly. We have designed a control system for household appliances based on radio frequency

technology via voice and mobile phone for visually impaired and disabled people. In-home automation

based on mobile technology

The system is established based on the cell phone Short Message Service / General Packet Radio

Service and microcontroller.

LITERATURE REVIEW

An accelerometer-based home automation system is designed for partially sighted and partially

sighted people paralyzed people. The system includes an accelerometer, microcontroller, RF

transmitter and receiver e-communication that takes place via RF signals. The accelerometer detects

hand gestures and signals transmitted to the receiving section via an RF transmitter. The RF receiver

receives the transmitted signal compare with already stored gestures, only when similar hand

gestures are identified, then the appliances are checked.

The purpose of this project is to prepare a gesture-controlled wheelchair for the disabled

In today's life, it is difficult for people to move from one place to another. A wheelchair is a device

Designed for people with limited mobility, transferring patients from one place to another. Generally

speaking

The wheelchair is manually driven with the help of another person or by self-

propelled. To Reduce complexity for those who are unable to move the chair on

their own.

The wheelchair is automatic. Depends on human instructions, such as audio,

gestures or the head gestures are automated.

ISSN No: 0932-4747

Page No:299

Zeichen Journal


SENSORS & COMPONENTS USED

HARDWARE COMPONENTS: SOFTWARE COMPONENT:

-Accelerometer sensor -Arduino IDE

-Motor Driver Module

-Arduino uno

-RF Transmitter

-RF Receiver

-Liquid Crystal Display

-Relay

-DC motor

Accelerometer

The accelerometer are micro-electromechanical systems used to measure the static and dynamic force of acceleration. In the proposed work three accelerometer sensors are used for interaction with home appliance using recognized hand gestures.

ULTRASONIC SENSOR

This is the HC-SR04 ultrasonic distance sensor. This economical sensor can provide non-contact from

2cm to 400cm.

Measuring function, ranging accuracy can reach 3mm. Each HC-SR04

Only four pins You need to worry about HC-SR04: VCC (power), Trig (trigger), Echo (receive) and GND

(ground). You will find this sensor is quite easy to install and use for your next ranging project.

Microcontroller The microcontroller is the controlling unit of the device that controls all tasks. PIC16F877A

Reduced Instruction Set Computer (RISC) employs architecture, an 8-bit microcontroller system.

The microcontroller receives a hand signal from the accelerometer sensor and delivers the signal

In transmitter unit and display unit.

RF Transmitter

The RF transmitter shown operates at a frequency of 434 MHz An RF transmitter receives serial data from controller and transmits it wirelessly through RF antenna. The transmission occurs at the rate of 1Kbps-10Kbps.

RF Receiver

The wireless RF receiver receives the data with an operating frequency of 434MHz, same as that of the transmitter. The RF receiver work well with microcontroller to create a simple wireless data link. The received frequencies are sent to the microcontroller.

Liquid Crystal Display

ISSN No: 0932-4747

Page No:300

Zeichen Journal


A crystal liquid display is a panel that displays a visual display, depending on the properties of the liquid crystals. Depending on the hand find, the LCD indicates the state of the home appliances to be controlled.

Relay

A relay is an electromechanical device that works with an electric current in the figure. The current that flows through a circuit that can turn on and off, the current in the other circuit. The relay can be used with this unit on and off, and household appliances.

Motor Driver Module

This L298N motor driver module is a high-power motor driver module for running DC (Direct Current) and stepper motors. This module consists of L298 motor driver IC (Integrated Circuit) and 78M05 5V regulator. The L298N module can control 4 DC motors, or 2 DC motors, both directionally and at high speeds.

5V: L298N IC inside switching logic circuit power supply.

12V: 12V input from DC power source.

METHODOLOGY The gestures recorded by the disabled are recorded by sensors. Gesture can

Put the person's arm on the wheelchair using only the fingers or the whole hand. This

A person in a wheelchair should only wave his fingers or hands, so no extra effort is required

necessary. The person can draw gestures without wearing gloves. Webcam sends

Real-time video frames are sent to a video processor, which contains algorithms that can

understand air gestures.

If the gesture corresponds to the wheelchair movement, this information will be sent to the motor

control board, and then

Control the steering wheel, and if the gestures correspond to the control of household appliances,

the household

The device is controlled via the Bluetooth interface. Control of specific home appliances

Relay help. There will be a coil inside the relay. When voltage is applied through the coil,

An electromagnetic field is generated and the coil starts to act as a magnet, pulling the armature

towards

Drive home applications by itself. Here, uses the following software to design video processing

algorithms:

Specify it below and it will identify the gesture. Finally, the pattern that the camera can recognize

helps

Move the wheelchair, control household appliances and open/close doors.

ISSN No: 0932-4747

Page No:301

Zeichen Journal


Block Diagram of Gesture Controlled Wheel Chair

Block Diagram of Home Automation

ISSN No: 0932-4747

Page No:302

Zeichen Journal


WORKING In this project we control the Wheelchair and home automation through gesture control motion. Wheel chair is consisting of DC motor, motor driver module, receiver, Battery, and wheel. Home automation is consisting of Transformer, Rectifier, Receiver, Arduino, Relay and Switches and Bulb holder. Home Automation and Wheelchair is controlled by our hand movement in these three components are connected Arduino, Transmitter, Accelerometer and Battery. So, by Hand movement we controlled the Wheelchair and Home Automation. Hand movement is Left, Right, Up Down. When we move our hand, the Wheelchair is moved forward, backward, left, right and the Wheelchair is also consisting of Switch when we want to stop the movement the Wheelchair we switched of the switch. Home Automation is controlled by hand movement when we move our Hand in Left, Right, Up, down then the Bulb and Switched will on and apposite movement of hand will off all the Bulb and Switches.

Fig. Home Automation

ISSN No: 0932-4747

Page No:303

Zeichen Journal


Fig. Wheelchair

ISSN No: 0932-4747

Page No:304

Zeichen Journal


Fig. Hand Gestur Controller

Arduino Code For Wheelchair

#define FD 16

#define BD 17

#define LD 18

#define RD 19

#define m11 3

#define m12 4

#define m21 5

#define m22 6 void forward()

{

digitalWrite(m11, HIGH);

digitalWrite(m12, LOW);



}

ISSN No: 0932-4747

Page No:305

Zeichen Journal


void backward()

{





}

ISSN No: 0932-4747

Page No:306

Zeichen Journal


void left()

{





}

void right()

{





}

void Stop()

{





}

void setup()

{

pinMode(FD, INPUT);

pinMode(BD, INPUT);

pinMode(LD, INPUT);

pinMode(RD, INPUT);

ISSN No: 0932-4747

Page No:307

Zeichen Journal


pinMode(m11, OUTPUT);




}

void loop()

{

int temp1=digitalRead(FD);

int temp2=digitalRead(BD);

int temp3=digitalRead(LD);

int temp4=digitalRead(RD);

if(temp1==1 && temp2==0 && temp3==0 && temp4==0)

backward();

else if(temp1==0 && temp2==1 && temp3==0 && temp4==0)

forward();


left();


right();

else Stop();

}

Arduino Code for Home Automation int

led1 = 2, //Connect LED 1 To Pin #2




rc1=8,

rc2=9,

rc3=10,

rc4=11;

int rcv1=0,rcv2=0,rcv3=0,rcv4=0;

ISSN No: 0932-4747

Page No:308

Zeichen Journal


int aa=0,bb=0,cc=0,dd=0,ee=0,ff=0,gg=0,hh=0;

void setup()

{

Serial.begin(9600);

delay(2000);

// lcd.clear();

// lcd.setCursor(0, 0);

pinMode(led1, OUTPUT);




pinMode(rc1, INPUT);



ISSN No: 0932-4747

Page No:309

Zeichen Journal



digitalWrite(led1, HIGH);




aa=~aa;bb=~bb;cc=~cc;dd=~dd;ee=~ee;ff=~ff;gg=~gg;hh=~hh;

}

//-----------------------------------------------------------------------//

void loop()

{

rcv1=digitalRead(rc1);




//digitalWrite(led1, aa);

//digitalWrite(led2, bb);

//digitalWrite(led3, cc);

//digitalWrite(led4, dd);

if((rcv1==HIGH)&&(rcv3==HIGH)){aa=~aa;digitalWrite(led1, aa); delay(3000);}

else if((rcv2==HIGH)&&(rcv4==HIGH)){bb=~bb; digitalWrite(led2, bb);delay(3000);}

else if((rcv1==HIGH)&&(rcv4==HIGH)){cc=~cc;digitalWrite(led3, cc);delay(3000);}

else if((rcv2==HIGH)&&(rcv3==HIGH)){dd=~dd; digitalWrite(led4, dd);delay(3000);}

}

RESULTS AND DISCUSSIONS

The system was successfully implemented to move the wheel chair Left, Right, Forward, Backward or Stay in the same position The wheel chair detect the obstacle at the front and stop the movement. Automated wheel chair can be used to help handicapped people, especially those who are not able to move the system was successfully implemented to move the wheel chair Left, Right, Forward, Backward or Stay in the same position. The accelerometer recognizes four types of hand gestures such as UP, DOWN, HORIZONTAL and VERTICAL. A three-dimensional accelerometer accelerates hand touch and signals are sent to the microcontroller on the receiver side. Reference actions are already stored in the microcontroller receiver as templates. The input found was matched to referral actions, based on the corresponding touch recognition devices controlled. Action UP is designed to FOLLOW fan, OPEN action to turn off the fan, HORIZONTAL OPEN action, OPEN action to turn off the light. Different body

ISSN No: 0932-4747

Page No:310

Zeichen Journal


arms can be used to control a variety of household items.

CONCLUSION

The stored gesture, " in the receiver section is compared with that of the hand gesture shown to be impaired viewers. The stored template matches with the received inputs then the LCD displays the comments regarding the home appliances controlled. The two devices controlled are fan and light for compactness of the device design. In the future, many home appliances can be controlled by installing those devices with new types of body touches, which are also installed in every home at a lower cost. The device helps the aged persons too.

The automatic wheelchair can be used to help people with disabilities, especially those who are unable to move the system.

REFERENCES

[1] Rakhi A. Kalantri, D.K. Chitre, “Automatic Wheelchair using Gesture Recognition” in International Journal of Engineering and Advanced Technology (IJEAT) 2013, pp.146-150.

[2] Manisha Devi, B.Anil Kumar, “Accelerometer Based Direction Controlled Wheelchair Using Gesture Technology” in International Journal of Scientific Engineering and Technology,2014, pp: 1065- 1070

[3] V Sundara Siva Kumar,G.Ramesh, P Nagesh “Hand Gesture Based Wheelchair Movement Control for Disabled Person Using MEMS” International Journal of Scientific Engineering and Technology 2015.

[4] Prof. Vishal V. Pande, Nikita S.Ubale, Darshana P. Masurkar, Nikita R. Ingole, Pragati P “Hand Gesture Based Wheelchair Movement Control for Disabled Person Using MEMS” in International Journal of Engineering Research and Applications, April 2014, pp:152-158.

[5] Arduino website, http://arduino.cc/en/Main/arduinoBoardMega

[6] Ramya V and Palaniappan B Article: Embedded Home Automation for Visually Impaired, International Journal of Computer Applications 41(18):32-39, March 2012. Published by Foundation of Computer Science, New York, USA. BibTeX.

[7] Van Der Werff M J, Xu W L, Gui X, Activation of Home Automation System via Mobile Technology, In RCO.Ed (Ed.) ENZCon’04: Proceedings of the Eleventh Electronics New Zealand Conference. pp. 235-240.

ISSN No: 0932-4747

Page No:311

Zeichen Journal


gesture controlled wheel chair along with home …

Documents