TRACLabs is developing the Wearable Augmented Perception for Environmental Recognition (WRAPPER) under a National Science Foundation grant.  WRAPPER is a computer vision system that provides information about the world to individuals who have impaired vision.  This information can be provided via auditory cues (for those with severely impaired vision) or via small, embedded LCD screens (for those with partial vision).   WRAPPER is designed to provide information to the visually impaired in five key areas: 1) Detection of obstacles, free corridors and drop-offs in the immediate vicinity of the user; 2) Detection, identification and location of people in the immediate vicinity of the user; 3) Detection, identification and location of specific, pre-defined objects within reaching distance of the user; 4) Estimation of user location and distance traveled within a large-scale environment; and 5) General vision aids such as reading text, enhancing images and magnifying objects.  All information is extracted from a pair of cameras mounted in unobtrusive eyewear connected to a portable, embedded computer system.  Stereo vision algorithms produce depth maps that are fed to different algorithms that identify specific features in the world.  After feature identification, audio or visual cues are produced and sent to the user.  The picture below on the left shows the current prototype system, which is large and bulky, but is used to test algorithms.  The picture below on the right shows the target system.  TRACLabs will be teaming with headset manufacturer Vuzix Corporation to develop the system.

A prototype assistant for the visually impaired.

The target system.