Gesture Controlled Robotic Arm Overview
Gesture Recognition
Object detection
Object detection
Circuit Diagram

Project Information

  • Category: Electrical
  • Type: Capstone Project (Group)
  • Project Date: May, 2024
  • Tool & Tech: Arduino Uno, ESP32, REST API, Python, OpenCV, Postman, VS Code

Gesture Controlled Robotic Arm

This project involves the development of a robotic arm controlled by hand gestures. The system integrates gesture detection and object recognition to automate precise object handling tasks. The key aspects include:

  • Gesture Detection: Utilizes a gesture detection program to recognize finger counts and various hand gestures.
  • Object Detection: Employs an object detection program to identify objects and their coordinates.
  • System Communication: Utilizes REST API for data transfer between detection programs and the ESP32.
  • Robotic Control: The ESP32 communicates with the Arduino Uno to control the SCARA robot, which performs object handling tasks based on received commands.

The project showcases a complete solution for automated object manipulation using advanced gesture recognition technology and robotics.