Skip to content

MIETDevelopers/2020a1r070_COM-811_MajorProject

Repository files navigation

GestureAssist: Empowering Accessibility Through Hand Gestures

  [] [platform]

GestureAssist is a project that aims to empower individuals with limited mobility by providing an intuitive and accessible way to interact with computers using hand gestures. It addresses the challenge that traditional input methods like keyboards and mouse can pose for people with physical limitations. GestureAssist holds the potential to revolutionize the way individuals with limited mobility interact with technology. By offering an intuitive and accessible solution, it empowers users to achieve greater independence and inclusivity in the digital world. We are excited to continue developing GestureAssist and making it a valuable tool for everyone.

Note: Use Python version: 3.8.5

Features

click on dropdown to know more

Gesture Recognition:

Neutral Gesture Neutral Gesture. Used to halt/stop execution of current gesture.
Move Cursor Cursor is assigned to the midpoint of index and middle fingertips. This gesture moves the cursor to the desired location. Speed of the cursor movement is proportional to the speed of hand.
Left Click Gesture for single left click
Right Click Gesture for single right click
Double Click Gesture for double click
Scrolling Dynamic Gestures for horizontal and vertical scroll. The speed of scroll is proportional to the distance moved by pinch gesture from start point. Vertical and Horizontal scrolls are controlled by vertical and horizontal pinch movements respectively.
Drag and Drop Gesture for drag and drop functionality. Can be used to move/tranfer files from one directory to other.
Multiple Item Selection Gesture to select multiple items
Volume Control Dynamic Gestures for Volume control. The rate of increase/decrease of volume is proportional to the distance moved by pinch gesture from start point.
Brightness Control Dynamic Gestures for Brightness control. The rate of increase/decrease of brightness is proportional to the distance moved by pinch gesture from start point.

Voice Assistant ( proton ):

Launch / Stop Gesture Recognition launch stop gesture recognition
  • proton Launch Gesture Recognition
    Turns on webcam for hand gesture recognition.
  • proton Stop Gesture Recognition
    Turns off webcam and stops gesture recognition. (Termination of Gesture controller can also be done via pressing Enter key in webcam window)
Google Search proton search github
  • proton search {text_you_wish_to_search}
    Opens a new tab on Chrome Browser if it is running, else opens a new window. Searches the given text on Google.
Find a Location on Google Maps proton find location
  1. proton Find a Location
    Will ask the user for the location to be searched.
  2. {Location_you_wish_to_find}
    Will find the required location on Google Maps in a new Chrome tab.
File Navigation proton list filesproton openproton go back
  • proton list files / proton list
    Will list the files and respective file_numbers in your Current Directory (by default C:)
  • proton open {file_number}
    Opens the file / directory corresponding to specified file_number.
  • proton go back / proton back
    Changes the Current Directory to Parent Directory and lists the files.
Current Date and Time proton date / time
  • proton what is today's date / proton date
    proton what is the time / proton time
    Returns the current date and time.
Copy and Paste proton copy proton paste
  • proton Copy
    Copies the selected text to clipboard.
  • proton Paste
    Pastes the copied text.
Sleep / Wake up proton proton sleep / wake up
  • Sleep
    proton bye
    Pauses voice command execution till the assistant is woken up.
  • Wake up
    proton wake up
    Resumes voice command execution.
Exit proton exit
  • proton Exit
    Terminates the voice assisstant thread. GUI window needs to be closed manually.

Getting Started

Pre-requisites

Python: (3.6 - 3.8.5)
Anaconda Distribution: To download click here.

Procedure

git clone https://github.com/MIETDevelopers/2020a1r116_COM-811_Major_Project.git

For detailed information about cloning visit here.

Step 1:

conda create --name gest python=3.8.5

Step 2:

conda activate gest

Step 3:

pip install -r requirements.txt

Step 4:

conda install PyAudio
conda install pywin32

Step 5:

cd to the GitHub Repo till src folder

Command may look like: cd C:\Users\.....\Gesture-Assist\src

Step 6:

For running Voice Assistant:

python proton.py

( You can enable Gesture Recognition by using the command "proton Launch Gesture Recognition" )

Or to run only Gesture Recognition without the voice assisstant:

Uncomment last 2 lines of Code in the file Gesture_Controller.py

python Gesture_Controller.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published