A Study On Gesture Control Ardiuno Robot
A Study On Gesture Control Ardiuno Robot
ABSTRACT: Gesture Controlled Car is a robot which can be controlled by simple human gestures. The user just needs to
wear a gesture device in which a sensor is included. The sensor will record the movement of hand in a specific direction
which will result in the motion of the robot in the respective directions. The robot and the Gesture instrument are connected
wirelessly through radio waves. User can interact with the robot in a more friendly way due to the wireless communication.
We can control the car using accelerometer sensors connected to a hand glove. The sensors are intended to replace the
remote control that is generally used to run the car. It will allow user to control the forward, backward, leftward and
rightward movements, while using the same accelerometer sensor to control the throttle of the car. Movement of car is
controlled by the differential mechanism. The mechanism involves the rotation of both forth & rear wheels of left or right
side to move in the anticlockwise direction and the other pair to rotate in the clockwise direction which makes the car to
rotate about its own axis without any kind of forward or backward motion. The main advantage of this mechanism is the
car with this mechanism can take sharp turn without any difficulty. The design and implementation of a gesture control
robotic arm using flex sensor is proposed. The robotic arm is designed in such a way that it consists of four movable fingers,
each with three linkages, an opposing thumb, a rotating wrist and an elbow. The robotic arm is made to imitate the human
hand movements using a hand glove.
Keywords: Robotic Arm, Flex Sensor, Wireless Module, Accelerometer
1. INTRODUCTION
Nowadays, robotics are becoming one of the most advanced in the field of technology. A Robot is an electro-mechanical system
that is operated by a computer program. Robots can be autonomous or semi-autonomous. An autonomous robot is not controlled
by human and acts on its own decision by sensing its environment.Majority of the industrial robots are autonomous as they are
required to operate at high speed and with great accuracy. But some applications require semi-autonomous or human controlled
robots.Some of the most commonly used control systems are voice recognition, tactile or touch controlled and motion controlled.
A Gesture Controlled robot is a kind of robot which can be controlled by your hand gestures not by old buttons.You just need to
wear a small transmitting device in your hand which included an acceleration meter.This will transmit an appropriate command to
the robot so that it can do whatever we want. The transmitting device included a ADC for analog to digital conversion and an
encoder IC(HT12E) which is use to encode the four bit data and then it will transmit by an RF Transmitter module. At the receiving
end an RF Receiver module receive's the encoded data and decode it by and decoder IC(HT12D). This data is then processed by a
microcontroller and finally our motor driver to control the motor's. Now its time to break the task in different module's to make
the task easy and simple any project become easy or error free if it is done in different modules. As our project is already divided
into two different part transmitter and receiver. The applications of robotics mainly involve in automobiles, medical, construction,
defense and also used as a fire fighting robot to help the people from the fire accident. But, controlling the robot with a remote or a
switch is quite complicated. So, a new project is developed that is, an accelerometer based gesture control robot. The main goal of
this project is to control the movement of the robot with hand gesture using accelerometer.The robot is usually an electro-mechanical
machine that can perform tasks automatically. Some robots require some degree of guidance, which may be done using a remote
control or with a computer interface. Robots can be autonomous, semi-autonomous or remotely controlled. Robots have evolved so
much and are capable of mimicking humans that they seem to have a mind of their own.
1.1Problem statement
The traditional wired buttons controlled robot becomes very bulgy and it also limits the distance the robot goes. The Wireless Hand
controlled Robot will function by a wearable hand glove from which the movements of the hand can be used as the input for the
movement of the robot. The basic idea of our project is to develop a system (Robot) which can recognize the Human Interaction
with it to accomplish the certain tasks assigned to it. In our project we will design a wearable Hand Glove which will contain the
sensors mounted on it to capture the movement of the hand and convert the raw mechanical data into electrical form. This data will
be further processed and converted into an understandable format for the lilypad mounted on the Glove. This lilypad will act as a
transmitter of the data for wireless communication purpose. Once the transmitted data is received by the receiver module which
will be connected to the Microcontroller, it will be processed and further sent to the Microcontroller. Microcontroller will deduce
the commands and accordingly it will actuate the motor drivers to control the Motors for various tasks on the robot.
1.2. Objectives
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 385
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
The aim of the project is to develop a human machine interface used for control robot arm. Our objective is to make this device
simple as well as cheap so it can be produced and used for number of purposes. The objective of this project is to build a car that
can be controlled by gesture wirelessly. In this project user is also able to control motions of the car by wearing controller glove
and performing predefined gestures. This can be also used in many potential applications such as wireless controller car racing etc.
1.3. Scope
Wireless controlled robots are very useful in many applications like remote surveillance, military etc.
Entertainment applications – Most videogames today are played either on game consoles, arcade units or PCs, and all
require a combination of input devices. Gesture recognition can be used to truly immerse a players in the game world like
never before.
Automation systems – In homes, offices, transport vehicles and more, gesture recognition can be incorporated to greatly
increase usability and reduce the resources necessary to create primary or secondary input systems like remote controls,
car entertainment systems with buttons or similar.
An easier life for the disabled – One of the biggest challenges faced today is providing separate and equally non
cumbersome services to the differently abled and handicapped. While there are special provisions around the world, there’s
still huge room for improvement to bring all lives on equal footing. Gesture recognition technology can eliminate a lot of
manual labor and make life much easier for those who aren’t as fortunate as most of us are.
These are just a handful of the places and situations in which gesture recognition technology can be implemented, and as
is evident, can totally change the way we interact with the world around us, not only at home, but in commercial venues
as well. In fact, a South African company had come up with an innovative machine placed at the Tambo International
Airport that detected travellers who yawned or looked sleepy and dispensed free cups of coffee. Although it used only
basic facial and gesture recognition technology, it is nonetheless an interesting look into what can be done with this
technology. Currently, there aren’t too many gesture recognition applications available for public use, but interestingly,
despite its potential for real world applications, gesture recognition technology is actually dominated by the videogame
industry. Electronics giants Microsoft and Sony, makers of the Xbox and PlayStation line of consoles respectively, have
incorporated gesture recognition to an extent into their entertainment systems, via extra hardware. Called ‘Kinect’ in the
case of Microsoft and the ‘PlayStation Eye/Camera’ in the case of Sony, these amazing devices bring us one step closer to
the future. While Microsoft in 2014 has gone ahead and included the Kinect 2.0 camera with the Xbox One, their latest
gaming console and made gesture and voice control an integral part of it, Sony has left the PlayStation Camera as an
accessory for the PlayStation 4, instead focusing on traditional input methods.
So far you came to know about Hand Gesture Controlled Robot that completely moves according to moments of your hand
(sign of input to the device).
1.4. Methodology
Methodology for communication signal
Transmitter Module
An RF transmitter module is a small PCB ie, printed circuit board sub-assembly capable of transmitting a radio wave and
modulating that wave to carry data. Transmitter modules are usually implemented alongside a micro controller which will provide
data to the module which is transmitted. RF transmitters are usually subject to regulatory requirements which dictate the maximum
allowable transmitter power output, harmonics and band edge requirement.
Receiver modules
An RF Receiver module RF433-RX is 433 MHz radio receiver receives the modulated RF signal, and then it demodulates . There
are two types of RF receiver module. Super-regenerative modules are usually of low cost and low power designs using a series of
amplifiers use to extract modulated data from a carrier wave. Super-regenerative modules are generally imprecise as their frequency
of operation varies in a fair amount with temperature and power supply voltage. Super heterodyne receivers having a performance
advantage over super-regenerative; they offer increased an accuracy and stability over a large voltage and temperature range. This
stability comes from a fixed crystal design which in turn leads to a comparatively more expensive product. Radio receiver which
receives the transmitted coded from the remote place these codes are converted to digital format and output is available to the pin
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 386
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
no 2 of the ic2 master microcontroller; this is the pin of inbuilt art of the microcontroller. We Based on the input codes master will
give command to slave microcontroller and robot will behave as follows.
It can even turn left or right while moving forward or in reverse direction.
In case of bump, moves reverse turn left or right and wail for the next instruction.
On the spot left or right turn to pass through the narrow space
We have also added head light, back light and turning lights to left a right .
Methodology for Motion Control
L293D is a dual H-bridge motor driver integrated circuit (IC). Motor drivers act as current amplifiers as they take a low-current
control signal and provide a higher-current signal. This higher current signal is used to drive the motors. L293D contains two inbuilt
H-bridge driver circuits. In common mode of operation, two DC motors can be driven simultaneously, both in forward and reverse
direction. The motor operations of two motors can be controlled by input logic. When an enable input is high, the associated driver
gets enabled. As a result, the outputs become active and work in phase with their inputs. Similarly, when the enable input is low,
that driver is disabled, and their outputs are off and in the high-impedance state. This project controls a remote robot through RF.
The ordinary 433 MHz RF modules are used in this project. AT89C51 microcontroller is used in this project.
This robot can perform their operations without direct human guidance. They are used basically for industrial applications and can
be made laser guided. Navigation is achieved by one of the several means, including following a path defined by buried inductive
wires, surface mounted magnetic or optical strips; or alternatively by the way of laser guidance. This is an improved version of my
previous robot which we designed years ago. Intelligent spy robot project has been designed for the spying purpose .it is radio
controlled and can be operated at a radial distance of 100m radius. Most probably our army youth need to venture into the enemy
area just to track their activities.
Which is often a very risky job and may cost precious life? Such dangerous job could be done using small spy robot all the developed
and advance nations are in the process of making it, a robot that can fight against enemy. Our robot us just a step towards similar
activity.
This robot is radio operated which is, self powered, and has all the controls like a normal car. A laser gun has been installed on it
so that it can fire on enemy remotely whenever required; this is not possible until a wireless camera is installed. Wireless camera
will send real time video and audio signals which could be seen on a remote monitor and 224 action can be taken accordingly. Being
in size small of it, will not be tracked by enemy on his radar. Robot silently enter into enemy canopy or tent and send us all the
information through its’ tiny camera eyes. It can also be used for suicide attack, if required. Heart of our robot is microcontroller
8051 family, we are using at89C51 In two microcontrollers where first microcontroller which acts as master controller, decodes all
the commands received from the transmitter and give commands to slave microcontroller. Slave microcontroller is responsible for
executing all the commands received from the master and also generating pulse width modulation pulses for the speed control driver
circuit which drives 4 nos. of motors. Two no bumper switch is added bmp 1 and bmp2 so that in case of accident our battery dose
not drains out.
Both the motors will stop instantly and after few second robots will move in opposite direction take turn to left or right direction
and stops and stop. Navigation and Dead Reckoning, Tilt Compensation in inertial sensors, 3D-Gaming. transmitter receives serial
data and transmits it wirelessly through RF through its antenna connected at pin4. The transmission occurs at the rate of 1Kbps-
10Kbps. The transmitted data is received by an RF receiver operating at the same frequency as that of the transmitted.
Transmission through RF (Radio frequency) is better than IR (infrared) because of many reasons. Firstly, signals through RF can
travel through larger distances making it suitable for long range applications. Also, while IR mostly operates in line Of sight mode,
RF signals can travel even when there is an obstruction between transmitter & receiver. Next, RF transmission is more strong and
reliable than IR transmission. RF communication uses a specific frequency unlike IR signals which are affected by other IR emitting
sources. This RF module comprises of an RF Transmitter and an RF Receiver. The transmitter/receiver (TX/RX) pair operates at a
frequency of 433MHz an RF transmitter receives serial data and transmits it wirelessly through RF through its antenna connected
at pin4. The transmission occurs at the rate of 1Kbps-10Kbps. The transmitted data is received by an RF receiver operating at the
same frequency as that of the tran
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 387
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 388
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
of this device is Analog in nature and proportional to the acceleration. This device measures the static acceleration of gravity
when we tilt it. And gives an result in form of motion or vibration.
According to the datasheet of adxl335 polysilicon surface-micromachined structure placed on top of silicon wafer. Polysilicon
springs suspend the structure over the surface of the wafer and provide a resistance against acceleration forces. Deflection of the
structure is measured using a differential capacitor which incorporate independent fixed plates and plates attached to the moving
mass. The fixed plates are driven by 180° out-of-phase square waves. Acceleration deflects the moving mass and unbalances the
differential capacitor resulting in a sensor output whose amplitude is proportional to acceleration. Phase-sensitive demodulation
techniques are then used to determine the magnitude and direction of acceleration.
Fig.3.0 accelerometer
Pin Description of accelerometer
1. Vcc 5 volt supply should connect at this pin.
2. X-OUT This pin gives an Analog output in x direction
3. Y-OUT This pin give an Analog Output in y direction
4. Z-OUT This pin gives an Analog Output in z direction
5. GND Ground
6. ST This pin used for set sensitivity of sensor
1. Transmitter part
2. Receiver part
In transmitter part an accelerometer and a RF transmitter unit is used. As we have already discussed that accelerometer gives an
analog output so here we need to convert this analog data in to digital. For this purpose we have used 4 channel comparator
circuit in place of any ADC. By setting reference voltage we gets a digital signal and then apply this signal to HT12E encoder to
encode data or converting it into serial form and then send this data by using RF transmitter into the environment. At the receiver
end we have used RF receiver to receive data and then applied to HT12D decoder. This decoder IC converts received serial data
to parallel and then read by using arduino. According to received data we drive robot by using two DC motor in forward, reverse,
left, right and stop direction.
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 389
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
Fig.4.0 Transmitter
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 390
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
movements in the X and Y directions only and outputs constant analog voltage levels. These voltages are fed to the microcontroller
which processes the input and encodes the data into digital form which is suitable to be transmitted through the xbee serial
transmitter. Circuit for this hand gesture controlled robot is quite simple. As shown in above schematic diagrams, a RF pair is used
for communication and connected with arduino. Motor driver is connected to arduino to run the robot. Motor driver’s input pin 2,
7, 10 and 15 is connected to arduino digital pin number 6, 5, 4 and 3 respectively. Here we have used two DC motors to drive robot
in which one motor is connected at output pin of motor driver 3 and 6 and another motor is connected at 11 and 14. A 9 volt Battery
is also used to power the motor driver for driving motors.
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 391
ISSN: 2455-2631 © May 2018 IJSDR | Volume 3, Issue 5
References:
[1] Nitin and Naresh, “Gesture Controlled Robot PPT”, URLAvailable [http://seminarprojects.com/s/hand-gesturecontrolled-robot-
ppt
[2] Naveet Kumar, Neeraj Purohit, “Gesture ControlledTank Toy User Guide” URL Available
[http://www.slideshare.net/neeraj18290/wireless-gesturecontrolled-tank-toy-transmitter]Accessed 13 October 2013.
[3] Jochen Triesch and Christoph Von Der Malsburg “Robotic Gesture Recognition (1997)”URL Available
[http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.37.5427] Accessed 15 October 2013.
[4] “Real-Time Robotic Hand Control Using Hand Gestures” by Jagdish Lal Raheja, Radhey Shyam, G. Arun Rajsekhar and P.
Bhanu Prasad.
[5] Bhosale Prasad S., Bunage Yogesh B. and Shinde Swapnil V. “Hand Gesture Controlled Robot” URL Available
[6] [http://www.engineersgarage.com/contribution/accelero meter-based-hand-gesture-controlled-robot] Accessed 3 November,
2013.
[7] [http://www.robotplatform.com/howto/L293/motor_driver_1.html] Accessed 5 November, 2013.
[8] [http://en.wikipedia.org/wiki/Gesture_interface]Accessed 5 November, 2013.
[9] [http://www.wisegeek.com/what-is-a-gear-motor.htm] Accessed 6 November, 2013.
[10] [http://www.scribd.com/doc/98400320/InTech-RealTime-Robotic-Hand-Control-Using-Hand-Gestures]Accessed 6
November, 2013.
IJSDR1805055 International Journal of Scientific Development and Research (IJSDR) www.ijsdr.org 392