Skip Navigation
Human Research Program

Evidence-based Metrics Toolkit for Measuring Safety and Efficiency in Human-Automation Systems--NNX15AR28G

Completed Technology Project

Project Introduction

NOTE: Continuation of "Evidence-based Metrics Toolkit for Measuring Safety and Efficiency in Human-Automation Systems," grant #NNX13AO51G with Principal Investigator (PI) Eduardo Salas, Ph.D., due to PI move in mid-2015 to Rice University from University of Central Florida. Specific aims of this proposal are threefold: (1) develop a framework for human-systems integration requirements, (2) identify and develop a metrics criteria in which safety and efficiency can be characterized in human-automation teams, and (3) design, develop, and validate a theoretically-driven, empirically-based metrics toolkit that characterizes the safety and efficiency of human automation interactions. This proposal meets NASA goals and objectives by mitigating the risk of inadequate design of human and automation/robotic integration through the development of safety and efficiency metrics for human-automation systems. The proposal is divided into three primary phases. Phase 1 will consist of synthesizing and translating findings from the extant literature relevant to human automation/robotic integration. The result of this effort will be the development of objective metrics generalizable to individual and team levels that characterize the safety and efficiency of a human automation interaction. The final outcome of Phase 1 will be the development of a human automation interaction metrics (HAIM) toolkit. Phase 2 will involve in-depth preparation for scientifically sound experiments. Phase 2 ensures adequate time and methodology for meaningful outcomes for Phase 3. The central outcome of Phase 2 will be the final development of the experimental testbed and experimental protocol. Phase 3 will involve preparation for, and execution of, experiments. This will include the design and execution of a set of multi-level empirical studies aimed at validating the metrics toolkit. The validation studies will focus on testing different aspects of human automation interaction (e.g., levels of automation, task complexity, and the number and configuration of system operators). The outcome of the proposed effort will provide NASA a set of evidence-based, empirically-validated guidelines and a measurement toolkit for mitigating the risk of inadequate design of human and automation/robotic integration as it pertains to the development of safety and efficiency metrics for human automation systems. More »

Anticipated Benefits

Project Closeout – Executive Summary

Primary U.S. Work Locations and Key Partners

Share this Project

Organizational Responsibility

Project Management

Project Duration

Technology Maturity (TRL)

Technology Areas

Target Destinations

Light bulb

Suggest an Edit

Recommend changes and additions to this project record.
^