Practical Project 2: Giving sight to the blind appetizer

By -
Practical Project #2 Giving sight to the blind

In this project, I’m going to take a project that I’ve already done and already works and transition it to a different platform in a more generic way and take you fine readers along for the ride.  A while ago, I worked with Google on their Giving Through Glass project and one of the projects I worked on was to give sight to the blind.  I worked with Classroom Champions and an amazing Paralympic athlete named Lex.  Lex is a blind long jumper who lives and trains in San Diego.  I’ve worked with him for the last year or so on creating an application for Google Glass that would allow him to hear the world around him via an app that translates the images from the camera into sin wave sounds.
As cool as that project is, there’s plenty of people out there that are similarly blind, like Lex.  And it is now impossible to get the same hardware as Google is no longer selling consumer Glass devices.  So I thought it time to bring this project to other android devices and see if we can’t make it more generic along with a project to help the world give sight to the blind.  Also, a lot has changed in the short time since I last worked on this project, and it’s a great opportune time to work on migrating it from depending upon OpenCV to working with FastCV from Qualcomm as well as the Qualcomm math libraries.
The source code for this project lives in my github directory: https://github.com/gpx1000/gpxblog-blindSight.  The original codebase for the Glass project is at: https://github.com/gpx1000/LexApp.

This blog post is intentionally short as this is a work in progress, and thus meant to only wet the appetite of the reader.  Next time, I’ll outline the hardware required, and then explain how to put it together.  At a minimum, one would need: 1 camera, pair of headphones, project board (probably a 410c), and a battery.  I’ll also note that a major problem with Google’s Glass is that it runs out of batteries fast when using this app.  So I’m going to do some testing with various types of hardware to figure out how to give an end user a full day using this application.
Also, because the Glass version runs out of batteries so fast, it includes indoor positioning code that works off of bluetooth BLE beacons and traversing via RSSI (Received Signal Strength Indicator to approximate position indoors with GPS outdoors).  To keep the same functionality the hardware will need to have a GPS receiver and bluetooth dongle.  Next time we’ll dive into which ones I settled on, the cost and how to build it all.


Comments

Post a Comment

Popular posts from this blog

Drone VR Software Architecture

By -
Image
Finally we're at the point in our opus VR drone project that we need to look at the software. If you're following along, I have the Hardware drone built, using Snapdragon flight . To review, we have knowledge of how to create a project in Android Studio that can target Snapdragon Flight for deployment. We know how to utilize the Daydream controller to build an arm model . We also know how to setup a VR project in Android Studio . Finally, we know how to communicate with the Snapdragon flight controller. So, if we put it all together, we only need to figure out how to program the controller aspect of the Flight. Thankfully there's rich support available for Flight that allows us to have full C-API control over both the ESC and the controller board. It is provided through the navigator api library . Now let's talk about the overall design. I envision four main modules: VR Controller App interfaces with the user gets positional updates and issues commands de
Read more

Build Snapdragon Flight Drone

By -
Image
In order to have a VR Drone, we must start building a real physical Drone. Snapdragon Flight offers a great light weight powerful platform we can do a lot with. While most home built Drones are built with very custom specs; I felt it necessary to make this very approachable by ensuring the Drone is built exactly as the specs outline. Our's looks slightly different, but hey Drone time! Let's start with the parts the Drone needs: Allen Wrench Hex Key Set Dynamite 5 pc Metric Nut Driver Assortment Generic M2.5 Nylon Hex M-F Spacer/Screw/Nut Assorted Kit Loctite Heavy Duty Threadlocker 2x clock wise motors 2x counter clock wise motors ac converter for battery charger battery charger Battery ESC (to control the 4 props) Frame Kit gps antenna 4 x DF3-3P-2DSA connector Wifi antenna Grey props: x2 Red props: x2 Before jumping straight into working with the hardware, a small house keeping task must be preformed. There's a small problem, If you have big
Read more

Soldering new connectors for the drone

By -
Image
If you're with me so far, in our Snapdragon Flight VR build, you might have noticed that the connectors that come with the motors do not match the connectors that come with the Snapdragon ESC. This means we need to replace the connectors so electrons can flow and power the motors. Remembering that the whole point of this is to get electrons to flow will make the concept easier. Copper is a conductive material, that's what wires are made up of. Solder is a metal material that is highly conductive with a low melting point and solidifies fast. So the idea is we want to use the molten solder to join the wires to the new connector. I personally favor damaging a cheap motor to damaging an expensive ESC, so I opt for doing the work on the motor connections themselves and highly recommend this path. While the minimum you'll need is 4 connectors, I am really good at making mistakes, so I wound up getting 10. The first step, is to cur the old connector off. Grab a pair of w
Read more