Non-intrusive Hazardous Pilot Cognitive State Assessment via Semi-Supervised Deep Learning: CSA-Deep, Phase I

We anticipate that by the end of our Phase II effort we will have matured our CSA-Deep assessment system sufficiently and we will be able to demonstrate the proposed approach to evaluate hazardous cognitive states and crew coordination in a flight simulation environment. We will work closely with NASA to ensure that technology developed in this effort can be integrated with the NASA's systems, reducing risk associated with technology transition. The proposed innovation has applicability to crew coordination research work in the Variable Autonomy Interface System (VAIS) element within NASA's Safe Flight Deck Systems and Operations (SFDSO) sub-project within the Aviation Safety Program (AvSP) Vehicle Systems Safety Technologies (VSST) Robust AutomationCrewSys (ACS) program as well as potential for enhancing safety through crew coordination in other manned aircraft and spacecraft work. We envisage the following target markets and probable customers for the Phase 2 product: Air Operation Centers (Air Force, Navy and FAA): There is significant demand for evaluating the pilot cognitive state and coordination among crew members for air traffic management in military and civilian arenas. Furthermore, the gradual rollout of FAA's Next Generation Air Traffic System (NGATS) and its new systems, applications and operational procedures will require the development of advanced coordination assessment systems. This system could be used to perform aviation missions more effectively, as well as increasing the flight NextGen capacity. Emergency Response Systems (Homeland Security): The CSA-Deep could be used in the assessment of the operator functional state and the quality of team coordination of emergency first responders, emergency medicine personnel in procedures and exercises for disaster preparedness and mass casualty event. More »