CORONAVIRUS (COVID-19) RESOURCE CENTER Read More
Category: Input

Touchless PC Control aka JARBAS

AbleData does not produce, distribute or sell any of the products listed on this website, but we provide you with information on how to contact manufacturers or distributors of these products. If you are interested in purchasing a product, you can find companies who sell it below.

Touchless PC Control aka JARBAS is designed for use by individuals with limited fine motor strength and dexterity associated with arthritis, nerve injury, or upper motor neuron lesions. This device allows the user to access the keyboard without physically touching the keys on the keyboard.

Technical Specifications: 

Step 1: Things you need.

This instructable does not require any electronic soldering. Materials needed include the following: a leap motion, a Windows-running computer. Once you have the materials gathered, it is time to begin the connection process.

PS: If you already have the Leap Motion drivers and Visual Studio installed, just go to step 3.

Step 2: Setting up everything.

Once you have gathered all of the materials, it is time to begin the configuration. First, download the drivers from Leap Motion. Go to this page, create an account and download the sdk. You will have and .zip file, extract it to a folder of your preference (the author suggest one that you will not forget/delete later, most of the libs are in this sdk) and double click in the installer to make your Leap Motion work. After installing, type "Leap Motion Visualizer" in the Windows Search and run it. If everything is ok, you should be seeing two cameras and your hovering hands. Next, download and install the Visual Studio 2015 (you can try and run it on Mono) Special Note:  The author has not tested and run Visual Studio). First, go to the download page, enter in your Microsoft account, download and install the Visual Studio. Now let's go to the best part: opening the project!

Step 3: Opening and running the project.

So, now that we have everything set up, let's open and run the project! Go the JARBAS project page on GitHub, and download and unpack it or clone it. After completing this step, go to the JARBAS folder and run the JARBAS.sln, the Visual Studio should open the solution. Now what you only have to do is click on, "Start" to run the project! If everything is running properly, a Window should appear. At the time of posting this instructable, the program works this way. It uses the position of your right hand index finger to control the cursor, and bending of the right hand thumb to simulate clicks. As for now, it has some events:

1. Left click (by contracting your thumb finger)

2. Right click (by contracting your thumb finger with your palm upwards)

3. Opening the virtual keyboard (by showing your left hand to the Leap Motion)

4. Closing the virtual keyboard (by not showing your left hand to the Leap Motion)

I intend to add more events to the program (the new features will be on the GitHub page, so check it often).

Step 4: Extending and improving the project

The project is fully detailed here and the source code is on GitHub. The author intends to improve the project, add more features, events (dragging, using the virtual keyboard properly), create a proper UI, and port it to Linux and OS X, while improving the accuracy.

Author:  leonardots

Available

Price Check
Price: 
0.00
as of: 
12/28/2015
Additional Pricing Notes: 
Cost of supplies and materials.
Seller(s): 
Touchless PC Control a.k.a JARBAS