Small Business Innovation Research/Small Business Tech Transfer
Anytime Summarization for Remote Robot Operations
Project Description
NASA plans to use intelligent planetary rovers to improve the productivity and safety of human explorers. A key challenge in using robots for human exploration is orienting remote personnel about robot operations, as latency and communication constraints make eyes-on monitoring impractical. Summary measures are needed to identify what progress the robot has made and, when progress is impeded, to indicate what went wrong. Trending measures also are needed that determine how well robotic assets are being utilized and identify opportunities to improve robot productivity. TRACLabs and Brigham Young University propose to develop software for anytime summarization to orient personnel quickly about the performance of planetary robots operating remotely, when data are limited, interrupted, or delayed. Thus an anytime summary must support personnel in understanding the operational situation without relying on vigilance monitoring. We successfully completed all Phase I objectives. We designed an approach for developing an anytime summarization web application. We identified candidate use cases to support Intelligent Robotics Group (IRG) tests. We designed and prototyped algorithms to summarize robot performance. We designed a web application with a graphical narrative interface (GNI) for exploring anytime summaries for different uses and perspectives. This web application integrates these interface clients with a performance data server and with the IRG Exploration Ground Data System (xGDS). In Phase II we will implement this Phase I design as a web application for anytime summarization. This software will compute and present information about robot performance including key performance indicators, significant events affecting performance, and expected performance under different operational conditions. It will build a new performance database for use by web clients, such as the GNI. This web application will be evaluated for use with NASA robots as part of the IRG xGDS.
More »
Anticipated Benefits
Anytime summarization supports crew-centered operations by assisting astronauts in understanding robot performance without eyes-on supervision. These summaries also help remote controllers come up to speed quickly when they cannot observe operations directly due to communication constraints. The proposed project will develop and evaluate quantifiable metrics for robot performance that can be applied at different levels of robot autonomy (NASA Roadmap TA4). The anytime summaries can be used while operations are ongoing, or used retrospectively. Applications during operations include summarizing performance for the engineering and field tests of NASA robots, such the upcoming In-Situ Resource Utilization (ISRU) Regolith and Environment Science and Oxygen and Lunar Volatile Extraction (RESOLVE) engineering tests, or field tests with the K10 and KRex robot. Applications for use after an operation include summarizing performance for debriefing Space Station astronauts participating in the HET Surface Telerobotics (ST) test. For HET ST the anytime summary changes as new input are received from non-real-time sources, such as performance questionnaires, or user analysis. The proposed metrics for image quality and coverage should help science teams retrospectively find the best images collected during scientific data collection, such as that done for the Pavilion Lake Research Project.
The Department of Defense has multiple prime contractors building small, unmanned ground vehicles. In this class are the iRobot Packbot, the Qiniteq TALON, and the Northrop Grumman Remotec ANDROS. These vehicles work closely with dismounted soldiers to perform tasks such as Explosive Ordnance Disposal (EOD), Urban Search and Rescue (USAR), and urban reconnaissance. DOD has increasingly relied on remotely operating these robots during such hazardous missions. The software for anytime summarization supports remote situation awareness of such operations. In the private sector, there is renewed interest in remote operations and robot inspection and maintenance for oil and natural gas drilling, extraction, and processing. Whether monitoring and controlling an off-shore oil rig from an on-shore location using both local and remote experts or controlling robots that monitor and maintain off-shore rigs during an evacuation, or controlling Remotely Operated Vehicles (ROV) underwater, or controlling robots that perform disaster response tasks in large refinery, the need for robotics and automation in the oil and gas industry is growing. Such operations are hazardous, making remote operations desirable. Monitoring for key performance indicators and performance events is needed to ensure safety and to make operations more cost effective. The proposed anytime summarization aids situation awareness for remote operations and robot inspection and maintenance for the oil and gas industry. More »
The Department of Defense has multiple prime contractors building small, unmanned ground vehicles. In this class are the iRobot Packbot, the Qiniteq TALON, and the Northrop Grumman Remotec ANDROS. These vehicles work closely with dismounted soldiers to perform tasks such as Explosive Ordnance Disposal (EOD), Urban Search and Rescue (USAR), and urban reconnaissance. DOD has increasingly relied on remotely operating these robots during such hazardous missions. The software for anytime summarization supports remote situation awareness of such operations. In the private sector, there is renewed interest in remote operations and robot inspection and maintenance for oil and natural gas drilling, extraction, and processing. Whether monitoring and controlling an off-shore oil rig from an on-shore location using both local and remote experts or controlling robots that monitor and maintain off-shore rigs during an evacuation, or controlling Remotely Operated Vehicles (ROV) underwater, or controlling robots that perform disaster response tasks in large refinery, the need for robotics and automation in the oil and gas industry is growing. Such operations are hazardous, making remote operations desirable. Monitoring for key performance indicators and performance events is needed to ensure safety and to make operations more cost effective. The proposed anytime summarization aids situation awareness for remote operations and robot inspection and maintenance for the oil and gas industry. More »
Project Library
Primary U.S. Work Locations and Key Partners
| Organizations Performing Work | Role | Type | Location |
|---|---|---|---|
| TRACLabs, Inc. | Lead Organization | Industry | Webster, Texas |
Ames Research Center
(ARC)
|
Supporting Organization | NASA Center | Moffett Field, California |
| Brigham Young University | Supporting Organization | Academia | Provo, Utah |
Primary U.S. Work Locations
-
California
-
Texas
-
Utah
Suggest an Edit
Recommend changes and additions to this project record.