{"project":{"acronym":"","projectId":89298,"title":"Increasing Efficiency of Routine Robot Space Operations through Adjustable Autonomy and Learning from Human Instructions","primaryTaxonomyNodes":[{"taxonomyNodeId":10629,"taxonomyRootId":8816,"parentNodeId":10628,"level":3,"code":"TX04.4.1","title":"Multi-Modal and Proximate Interaction","definition":"Multi-modal interaction allows for humans to interact with robots using multiple modes of communication, e.g. voice, gesture recognition. Proximate interaction allows for humans to interact with a robot side-by-side. Technologies to assist in these can enable humans to safely and efficiently control a larger number of robotic and autonomous assets, reducing overall demands on astronauts’ time for future exploration missions.","exampleTechnologies":"Virtual environment (VE), multi-modal dialogue, robot-to-suit interfaces, intent recognition and reaction, feedback displays for proximate interaction","hasChildren":false,"hasInteriorContent":true}],"startTrl":2,"currentTrl":3,"endTrl":3,"benefits":"
The objective of this work is to improve operational efficiency of robotic systems by lowering deployment time, increasing robustness of routine operations, and increasing support for human astronauts by enabling a robot to leverage the input it obtains from human operators to incrementally increase operational autonomy.
","description":"This research aims to address the execution of repetitive, routine and potentially hazardous tasks by robots operating in crewed low Earth orbit, lunar and Mars-based deployments. Current practices in deploying robotic space systems are limited to manual teleoperation of robots by crew in co-located settings, and the use of carefully hand-crafted structured control sequences from ground control. Both approaches are costly in terms of crew time and effort, and are not scalable for long-term, co-robot deployments. The objective of this work is to improve operational efficiency of robotic systems by lowering deployment time, increasing robustness of routine operations, and increasing support for human astronauts by enabling a robot to leverage the input it obtains from human operators to incrementally increase operational autonomy. Our approach focuses on techniques for identifying what information is needed to improve task performance, decision mechanisms for selecting between crew and ground control interactions, development of interface methodologies for task recovery interactions, and algorithmic methods for improving autonomy based on the acquired instructions.
","startYear":2016,"startMonth":10,"endYear":2020,"endMonth":10,"statusDescription":"Completed","principalInvestigators":[{"contactId":439554,"canUserEdit":false,"firstName":"Sonia","lastName":"Chernova","fullName":"Sonia H Chernova","fullNameInverted":"Chernova, Sonia H","middleInitial":"H","primaryEmail":"chernova@cc.gatech.edu","publicEmail":false,"nacontact":false}],"programDirectors":[{"contactId":84634,"canUserEdit":false,"firstName":"Claudia","lastName":"Meyer","fullName":"Claudia M Meyer","fullNameInverted":"Meyer, Claudia M","middleInitial":"M","primaryEmail":"claudia.m.meyer@nasa.gov","publicEmail":true,"nacontact":false}],"programExecutives":[{"contactId":84634,"canUserEdit":false,"firstName":"Claudia","lastName":"Meyer","fullName":"Claudia M Meyer","fullNameInverted":"Meyer, Claudia M","middleInitial":"M","primaryEmail":"claudia.m.meyer@nasa.gov","publicEmail":true,"nacontact":false}],"programManagers":[{"contactId":183514,"canUserEdit":false,"firstName":"Hung","lastName":"Nguyen","fullName":"Hung D Nguyen","fullNameInverted":"Nguyen, Hung D","middleInitial":"D","primaryEmail":"hung.d.nguyen@nasa.gov","publicEmail":true,"nacontact":false}],"projectManagers":[{"contactId":37,"canUserEdit":false,"firstName":"Terrence","lastName":"Fong","fullName":"Terrence W Fong","fullNameInverted":"Fong, Terrence W","middleInitial":"W","primaryEmail":"terry.fong@nasa.gov","publicEmail":true,"nacontact":false}],"website":"https://www.nasa.gov/strg#.VQb6T0jJzyE","libraryItems":[],"transitions":[{"transitionId":75955,"projectId":89298,"transitionDate":"2020-10-01","path":"Closed Out","details":"Our work on this project has led to contributions along two research thrusts: Robot Manipulation Alongside and in Collaboration with People. Autonomous robot manipulators have the potential to significantly impact a wide range of domains, from households to remote planetary exploration. Across these domains, robots will frequently work among humans, necessitating support for a spectrum of manipulation behaviors ranging from teleoperation to full autonomy. Our work shows that improved autonomy, adjustability of behavior, and adaptiveness to people lead to greater robot efficiency and effectiveness in manipulation tasks when operating alongside and in collaboration with people. Specifically, this research has made the following contributions:
•Human-in-the-loop grasp pose specification for teleoperation: development of novel, latency-robust teleoperation interfaces that offload some of the human’s responsibilities to the robot, and demonstration of the interfaces’ effects on manipulation task performance.
•Pairwise ranking for autonomous grasp calculation: development of an autonomous grasp calculation approach based on pairwise ranking that can adapt to novel objects and be re-trained with few data samples.
•Active perception for autonomous observation: formalization of autonomous human observation as a constraint-based multi-objective optimization problem that, solved in real-time and with the incorporation of robot grasping and human motion prediction, enables unobtrusive recording of humans in isolated environments.
•Adaptive and collaborative task planning: development of a task planning approach using interconnected hierarchical task models that enables real-time collaborative assembly between a human worker and a robot assistant.
Facilitating Reliable Autonomy with Human-Robot Interaction Autonomous robots are increasingly deployed to complex environments in which we cannot predict all possible failure cases a priori. Robustness to failures can be provided by humans enacting the roles of:
• developers who can iteratively incorporate robustness into the robot system,
• collocated bystanders who can be approached for aid, and
• remote teleoperators who can be contacted for guidance.
However, assisting the robot in any of these roles can place demands on the time or effort of the human. This thesis will develop modules for use during failure interventions leading to increased reliability of autonomous robots while reducing the demand on humans. In pursuit of that goal, this thesis makes the following contributions:
•A development paradigm for autonomous robots that separates task specification from error recovery. The paradigm reduces burden on developers while making the robot robust to failures.
•Development of a model for gauging the interruptibility of collocated humans.
•A human-subjects study shows that using the model can reduce the time expended by the robot during failure recovery
•A human-subjects experiment on the effects of suggestions provided to remote operators during failure interventions. We show that humans need both diagnosis suggestions and action recommendations as decision support during the intervention.
\tThe Space Technology Research Grants Program will accelerate the development of "push" technologies to support the future space science and exploration needs of NASA, other government agencies and the commercial space sector. Innovative efforts with high risk and high payoff will be encouraged. The program is composed of two competitively awarded components.
","programId":69,"responsibleMd":{"acronym":"STMD","canUserEdit":false,"city":"","external":false,"linkCount":0,"organizationId":4875,"organizationName":"Space Technology Mission Directorate","organizationType":"NASA_Mission_Directorate","naorganization":false,"organizationTypePretty":"NASA Mission Directorate"},"responsibleMdId":4875,"stockImageFileId":36658,"title":"Space Technology Research Grants"},"leadOrganization":{"acronym":"GA Tech","canUserEdit":false,"city":"Atlanta","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"external":true,"linkCount":0,"organizationId":5029,"organizationName":"Georgia Institute of Technology-Main Campus","organizationType":"Academia","stateTerritory":{"abbreviation":"GA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Georgia","stateTerritoryId":2},"stateTerritoryId":2,"murepUnitId":139755,"naorganization":false,"organizationTypePretty":"Academia"},"supportingOrganizations":[{"acronym":"ARC","canUserEdit":false,"city":"Moffett Field","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"external":false,"linkCount":0,"organizationId":4941,"organizationName":"Ames Research Center","organizationType":"NASA_Center","stateTerritory":{"abbreviation":"CA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"California","stateTerritoryId":59},"stateTerritoryId":59,"naorganization":false,"organizationTypePretty":"NASA Center"}],"statesWithWork":[{"abbreviation":"GA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Georgia","stateTerritoryId":2}],"lastUpdated":"2024-2-6","releaseStatusString":"Released","viewCount":481,"endDateString":"Oct 2020","startDateString":"Oct 2016"}}