Arduino Based Hand Gasture Control 



Overview 

As the technology tends to make human life easier and safer. So our main aim is to reduce the effort of interaction with computers through input devices using simple gestures.
You might have seen Hand Gesture Controlled Robots, where the motion of a robot is controlled by the gestures of the hand. Another interesting project based on a similar principle is an Arduino based Hand Gesture Control of your computer or laptop.
Instead of using a keyboard, mouse or joystick, we can use our hand gestures to control certain functions of a computer like play/pause a video, move left/right in a photo slide show, scroll up/down.
​In this project, we have implemented a simple Arduino based hand gesture control where you can control few functions of your web browser like switching between tabs, scrolling up and down in web pages, shift between tasks (applications), play or pause a video and increase or decrease the volume with the help of hand gestures.

Concept Behind This Project 

The principle behind the project is very simple . All we have to do is use two ultrasonic sensors with Arduino  UNO , place your hand in front of the Ultrasonic sensor which calculates the distance between the hand and the sensor , using an ultrasonic wave. Using this information, relevant actions in the computer can be performed. To perform actions on our computer we use Python pyautogui library. The commands from Arduino are sent to the computer through serial port (USB). This data will be then read by python which is running on the computer and based on the read data an action will be performed.




Front View 

To control the PC with Hand Gestures, just connect the two Ultrasonic sensors with Arduino. We know US sensor work with 5V and hence they are powered by the on board Voltage regulator of Arduino. The Arduino can be connected to the PC/Laptop for powering the module and also for Serial communication. Once the connections are done place them on your monitor as shown below. I have used a double side tape to stick it on my monitor but you can use your own creativity. After securing it in a place we can proceed with the Programming.

The Interfacing With Arduino , Sensors And Python:

The hand gestures in front of the Ultrasonic sensors can be calibrated so that they can perform different tasks on your computer. Before taking a look at the gestures, let us first see the tasks that we can accomplish.
  • Switch to Next Tab in a Web Browser
  • Scroll Down in a Web Page
  • Scroll Up in a Web Page
  • Switch between two Tasks (Chrome and Media Player)
  • Play/Pause Video in Media Player
  • Forward/Reverse Video
  • Increase / Decrease Volume
Here's the Github link of project: