TRACLabs was fortunate to have three excellent summer interns this year. These interns improved the capabilities of our mobile manipulation system and also built a high-fidelity Gazebo simulation of the mobile manipulator. Pictured below, left to right, are Ben Conrad from the University of Wisconsin-Madison, Nicolae Stiurca from the University of Texas-Austin, and Jonathan Realmuto from the University of Nevada-Las Vegas. Ben will return to the University of Wisconsin for graduate school. Nicolai will start graduate studies at the University of Pennsylvania in the fall while Jonathan will start graduate studies at the University of Washington in the fall.
Posted by David Kortenkamp at August 17th, 2011 @ 9:01 pm · Uncategorized
TRACLabs interns received a behind-the-scenes tour of NASA Johnson Space Center’s robotics facilities today. Including an upclose-and-personal encounter with the R2 humanoid robot. A duplicate of this R2 robot is currently on-board the International Space Station (ISS). TRACLabs scientists work side-by-side with NASA robotics engineers on a wide variety of robots for space applications.
The US Army has announced that TRACLabs and Texas A&M University will be awarded a Phase I Small Business Technology Transfer (STTR) award worth $150,000. The award is to develop an autonomous robot that can assist in the medical treatment and evacuation of injured soldiers from the battlefield. TRACLabs will apply its computer vision, intelligent control and human-robot interaction expertise gained from NASA’s Robonaut project. Texas A&M Raytheon Profession of Computer Science and Engineering, Dr. Robin Murphy will apply her experience in search and rescue robotics. The resulting dual-manipulator, mobile robot will be able to apply simple treatments to injured soldiers and also evacuate injured soldiers from the battlefield.
The Navy has announced that TRACLabs and the Southwest Research Institute (SwRI) will be receiving a Phase I Small Business Technology Transfer Research (STTR) award worth $150,000. The award is to to design and demonstrate a combined EO/LIDAR perception system, LEOPARD (for Lidar and Electro-Optic Perception with Advanced Recalibration Design), that facilitates improved autonomy for UGVs. Research and development of the LEOPARD system will focus on integration of the multi-camera/LIDAR hardware and on the software needed for automatic calibration, sensor fusion, and terrain analysis.
Posted by David Kortenkamp at April 20th, 2011 @ 4:10 pm · News
NASA has recently announced that TRACLabs will be awarded a Phase II STTR entitled “Integration of Notification with 3D Visualization of Rover Operations.” This work will be performed in cooperation with Carnegie Mellon University – Silicon Valley and Stinger Ghaffarian Technologies (SGT). The contract is to develop software for notifying users of 3D visualizations about important notices without distracting users unnecessarily or adding to the visual clutter. This software will monitor events from the system or user, identify which events should be brought to the user’s attention, and alert users in the 3D pane. The appearance of alerts is altered to shift a user’s attention to new notices based on an assessment of the importance and urgency of the notice specific to the user. Thus the same notice may be presented to different users in different ways. Because notices are anchored to a screen overlay, they are visible regardless of what location the user is viewing in the 3D space.
National Robotics Week was April 9 – 17, 2011. TRACLabs scientists took several of our robots to Space Center Houston for demonstrations to the general public. Demonstrations included using stereo vision to follow passers-by with a pan-tilt head and pre-programmed scooping behaviors from our seven degree-of-freedom manipulator. Both children and adults enjoyed talking to our scientists and seeing real robots up close.
Posted by Patrick Beeson at April 1st, 2011 @ 6:56 pm · Robotics
A previous post discussed human following and showed videos of robust human tracking indoors. This work has now been integrated with 2D “best-based” gestures from Brown University in order to allow different tracking modes of humans. TRACLabs and Brown University are collaborating under an Army contract to create a passive sensing system that facilitates unmanned leader-following in potentially novel, cluttered, and dynamic environments. We call this self-contained system LIBERATION (Leader Informed Beacon Estimation for ReAl-Time, Intelligent, Onboard Navigation).
3D person tracking:
2D Beat-based gesture recognition (with human location from 3D tracking):
Fully integrated system:
TRACLabs is working in conjunction with Vanderbilt University on a NASA-funded project to diagnose faults in complex systems. Space systems such as habitats, vehicles and rovers have multiple, interconnected subsystems each of which has its own set of telemetry and commands. Faults in any subsystem may manifest in a number of different ways, and for lack of sufficient sensors be difficult to isolate. Even if faults are isolated, the remote location of the spacecraft or rover may make it hard to repair. Recovery from faults often involves a lengthy process of sending commands, verifying their success, and then re-evaluating system performance. Given the insufficiency of sensors, isolating faults may require issuing commands to reconfigure the system or subsystem to obtain more information or to rule out certain hypotheses. is focused on developing an active diagnosis system that can iteratively evaluate diagnosis hypotheses to arrive at a definitive diagnosis and then recommend recovery actions. The research uses a model-based diagnosis system combined with an adjustably autonomous procedure execution system in a novel architecture that fits into NASA’s concept of operations for space missions. The architecture includes a model-based diagnosis component that compares system sensors with values generated from a model. It also includes a procedure executive that operates on a clearly specified linear set of commands and telemetry checks to move the system from one configuration to another. Between these two components is a functional reasoner that maps diagnosis hypotheses to procedures that can generate more information. Another component is a cost/benefit analyzer that ranks procedures based on their suitability for the current situation. Together, these components can reason about different diagnoses and take action on the system to overcome uncertainty and recover from faults. The figure below shows the complete system. Additional components such as a predictor (for determining future system state), a decision-maker (for altering system activities) and a replanner (for determining new system goals) are also being integrated.
It would be quite useful for a robot operator to simply tell the robot “Follow me” and have it track the operator in a variety of situations and environments. TRACLabs and Brown University are collaborating under an Army contract to create a passive sensing system that facilitates unmanned leader-following in potentially novel, cluttered, and dynamic environments. We call this self-contained system LIBERATION (Leader Informed Beacon Estimation for ReAl-Time, Intelligent, Onboard Navigation). LIBERATION uses stereo vision (a technique using two cameras and triangulation to determine distance to objects) to build a depth map of the environment. We then use a simple 3D model composed of 8 overlapping spheres—one at each corner of a virtual box—to quickly and easily detect and track arbitrary shaped people in the lab. The video below shows some preliminary results.










