{"projectId":91575,"project":{"projectId":91575,"title":"Scalable Unsupervised Learning for Unmanned Exploration","startDate":"2013-08-01","startYear":2013,"startMonth":8,"endDate":"2016-07-31","endYear":2016,"endMonth":7,"programId":69,"program":{"ableToSelect":false,"acronym":"STRG","isActive":true,"description":"<p> \tThe Space Technology Research Grants Program will accelerate the development of &quot;push&quot; technologies to support the future space science and exploration needs of NASA, other government agencies and the commercial space sector. Innovative efforts with high risk and high payoff will be encouraged. The program is composed of two competitively awarded components.</p> ","parentProgram":{"ableToSelect":false,"isActive":true,"description":"Catalyst is a portfolio of early stage programs that specialize in different innovation constituencies and mechanisms to push the state of the art in aerospace technology development","programId":92327,"responsibleMd":{"canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":""},"title":"Catalyst","manageGaps":false,"acronymOrTitle":"Catalyst"},"parentProgramId":92327,"programId":69,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36658,"title":"Space Technology Research Grants","manageGaps":false,"acronymOrTitle":"STRG"},"description":"Though we dream of the day when humans will first walk on Mars, these dreams remain in the distance. For now, we explore vicariously by sending robotic agents  like the Curiosity rover  in our stead. Though our current robotic systems are extremely capable, they lack perceptual common sense. This characteristic will be increasingly needed as we create robotic extensions of humanity to reach across the stars, for several reasons. First, robots can go places that humans cannot. If we manage to get a human on Mars by 2035, as predicted by the current NASA timeline, this will still represent a 60 year lag from the time of the first robotic lander.  Second, while it is possible to replace common sense in robots with human teleoperated control to some extent, this becomes infeasible as the distance to the base planet and the associated radio signal delay increase. Finally, as we pack more and more sensors onboard, the fraction of data that can be sent back to earth decreases. Data triage (finding the few frames containing a curious object on a planet's surface out of terabytes of data) becomes more important. In the last few years, research into a class of scalable unsupervised algorithms, also called deep learning algorithms, has blossomed, in part due to state of the art performance in a number of areas. A common thread among many recent deep learning algorithms is that they tend to represent the world in ways similar to how our brains represent the world. For example, thanks to decades of work by neuroscientists, we now know that in the V1 area of the visual cortex, the first region that visual information passes through after the retina, neurons tune themselves to respond to oriented edges and do so in a way that groups them together based on similarity. With this behavior as a goal, researchers set out to devise simple algorithms that reproduce this effect. It turns out that there are several. One, known as Topographic Independent Component Analysis, has each neuron start with random connections and then look for patterns that are statistically out of the ordinary. When it finds one, it locks onto this pattern, discouraging other neurons from duplicating its findings but simultaneously trying to group itself with other neurons that have learned patterns which are similar, but not identical. My proposed research plan is to develop existing and new unsupervised learning algorithms of this type and apply them to a robotic system. Specifically, I will demonstrate a prototype system capable of (1) learning about itself and its environment and of (2) actively carrying out experiments to learn more about itself and its environment. Research will be kept focused by developing a system aimed at eventual deployment on an unmanned space mission. Key components of the project will include synthetic data experiments, experiments on data recorded from a real robot, and finally experiments with learning in the loop as the robot explores its environment and learns actively. The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration. Tantalizing though this is, it is equally exciting that unsupervised learning is already finding application with surprisingly impressive performance right now, indicating great promise for near-term application to unmanned space exploration.","benefits":"The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration.","releaseStatus":"Released","status":"Completed","viewCount":611,"destinationType":["Foundational_Knowledge"],"trlBegin":2,"trlCurrent":3,"trlEnd":3,"lastUpdated":"12/18/25","favorited":false,"detailedFunding":false,"projectContacts":[{"contactId":463231,"canUserEdit":false,"firstName":"Thomas","lastName":"Fuchs","fullName":"Thomas Fuchs","fullNameInverted":"Fuchs, Thomas","receiveEmail":"Subscribed_User","projectContactRole":"Project_Manager","projectContactId":560752,"projectId":91575,"programContactRolePretty":"","projectContactRolePretty":"Project Manager"},{"contactId":181452,"canUserEdit":false,"firstName":"Hod","lastName":"Lipson","fullName":"Hod Lipson","fullNameInverted":"Lipson, Hod","receiveEmail":"Subscribed_User","projectContactRole":"Principal_Investigator","projectContactId":560751,"projectId":91575,"programContactRolePretty":"","projectContactRolePretty":"Principal Investigator"},{"contactId":207858,"canUserEdit":false,"firstName":"Jason","lastName":"Yosinski","fullName":"Jason Yosinski","fullNameInverted":"Yosinski, Jason","receiveEmail":"Subscribed_User","projectContactRole":"Co_Investigator","projectContactId":560750,"projectId":91575,"programContactRolePretty":"","projectContactRolePretty":"Co-Investigator"}],"programContacts":[],"leadOrganization":{"organizationId":3009,"organizationName":"Cornell University","organizationType":"Academia","city":"Mableton","stateTerritoryId":2,"stateTerritory":{"abbreviation":"GA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Georgia","stateTerritoryId":2,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"30126","murepUnitId":190415,"academicDegreeType":"Private_4_year","projectId":91575,"projectOrganizationId":586662,"organizationRole":"Lead_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Lead Organization","organizationTypePretty":"Academia"},"otherOrganizations":[{"organizationId":3009,"organizationName":"Cornell University","organizationType":"Academia","city":"Mableton","stateTerritoryId":2,"stateTerritory":{"abbreviation":"GA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Georgia","stateTerritoryId":2,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"30126","murepUnitId":190415,"academicDegreeType":"Private_4_year","projectId":91575,"projectOrganizationId":586662,"organizationRole":"Lead_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Lead Organization","organizationTypePretty":"Academia"},{"organizationId":4946,"organizationName":"Jet Propulsion Laboratory","acronym":"JPL","organizationType":"FFRDC_2fUARC","city":"Pasadena","stateTerritoryId":59,"stateTerritory":{"abbreviation":"CA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"California","stateTerritoryId":59,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"91109","projectId":91575,"projectOrganizationId":586661,"organizationRole":"Supporting_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Supporting Organization","organizationTypePretty":"FFRDC/UARC"}],"primaryTx":{"taxonomyNodeId":11279,"taxonomyRootId":8817,"parentNodeId":11272,"code":"TX10.2.7","title":"Learning and Adaptation","description":"Learning and adapting technologies adapt to changing environments and conditions without explicit reprogramming. These technologies do so by using knowledge collected from the past or from other systems’ experiences.","exampleTechnologies":"Learning planning/scheduling models, learning fault models, learning anomalies, learning for system degradation, learning models for state estimation and control","level":3,"hasChildren":false,"selected":false,"isPrimary":true,"hasInteriorContent":true},"primaryTxTree":[[{"taxonomyNodeId":11264,"taxonomyRootId":8817,"code":"TX10","title":"Autonomous Systems","level":1,"hasChildren":true,"selected":false,"hasInteriorContent":true},{"taxonomyNodeId":11272,"taxonomyRootId":8817,"parentNodeId":11264,"code":"TX10.2","title":"Reasoning and Acting Technologies","description":"Reasoning and acting technologies analyze and evaluate situations (past, present, or future) for decision-making and for directing actions to achieve a goal or a mission.","level":2,"hasChildren":true,"selected":false,"hasInteriorContent":true},{"taxonomyNodeId":11279,"taxonomyRootId":8817,"parentNodeId":11272,"code":"TX10.2.7","title":"Learning and Adaptation","description":"Learning and adapting technologies adapt to changing environments and conditions without explicit reprogramming. These technologies do so by using knowledge collected from the past or from other systems’ experiences.","exampleTechnologies":"Learning planning/scheduling models, learning fault models, learning anomalies, learning for system degradation, learning models for state estimation and control","level":3,"hasChildren":false,"selected":true,"hasInteriorContent":true}]],"technologyOutcomes":[{"technologyOutcomeId":96684,"projectId":91575,"project":{"projectId":91575,"title":"Scalable Unsupervised Learning for Unmanned Exploration","startDate":"2013-08-01","startYear":2013,"startMonth":8,"endDate":"2016-07-31","endYear":2016,"endMonth":7,"programId":69,"program":{"ableToSelect":false,"acronym":"STRG","isActive":true,"description":"<p> \tThe Space Technology Research Grants Program will accelerate the development of &quot;push&quot; technologies to support the future space science and exploration needs of NASA, other government agencies and the commercial space sector. Innovative efforts with high risk and high payoff will be encouraged. The program is composed of two competitively awarded components.</p> ","parentProgram":{"ableToSelect":false,"isActive":true,"description":"Catalyst is a portfolio of early stage programs that specialize in different innovation constituencies and mechanisms to push the state of the art in aerospace technology development","programId":92327,"responsibleMd":{"canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":""},"title":"Catalyst","manageGaps":false,"acronymOrTitle":"Catalyst"},"parentProgramId":92327,"programId":69,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36658,"title":"Space Technology Research Grants","manageGaps":false,"acronymOrTitle":"STRG"},"description":"Though we dream of the day when humans will first walk on Mars, these dreams remain in the distance. For now, we explore vicariously by sending robotic agents  like the Curiosity rover  in our stead. Though our current robotic systems are extremely capable, they lack perceptual common sense. This characteristic will be increasingly needed as we create robotic extensions of humanity to reach across the stars, for several reasons. First, robots can go places that humans cannot. If we manage to get a human on Mars by 2035, as predicted by the current NASA timeline, this will still represent a 60 year lag from the time of the first robotic lander.  Second, while it is possible to replace common sense in robots with human teleoperated control to some extent, this becomes infeasible as the distance to the base planet and the associated radio signal delay increase. Finally, as we pack more and more sensors onboard, the fraction of data that can be sent back to earth decreases. Data triage (finding the few frames containing a curious object on a planet's surface out of terabytes of data) becomes more important. In the last few years, research into a class of scalable unsupervised algorithms, also called deep learning algorithms, has blossomed, in part due to state of the art performance in a number of areas. A common thread among many recent deep learning algorithms is that they tend to represent the world in ways similar to how our brains represent the world. For example, thanks to decades of work by neuroscientists, we now know that in the V1 area of the visual cortex, the first region that visual information passes through after the retina, neurons tune themselves to respond to oriented edges and do so in a way that groups them together based on similarity. With this behavior as a goal, researchers set out to devise simple algorithms that reproduce this effect. It turns out that there are several. One, known as Topographic Independent Component Analysis, has each neuron start with random connections and then look for patterns that are statistically out of the ordinary. When it finds one, it locks onto this pattern, discouraging other neurons from duplicating its findings but simultaneously trying to group itself with other neurons that have learned patterns which are similar, but not identical. My proposed research plan is to develop existing and new unsupervised learning algorithms of this type and apply them to a robotic system. Specifically, I will demonstrate a prototype system capable of (1) learning about itself and its environment and of (2) actively carrying out experiments to learn more about itself and its environment. Research will be kept focused by developing a system aimed at eventual deployment on an unmanned space mission. Key components of the project will include synthetic data experiments, experiments on data recorded from a real robot, and finally experiments with learning in the loop as the robot explores its environment and learns actively. The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration. Tantalizing though this is, it is equally exciting that unsupervised learning is already finding application with surprisingly impressive performance right now, indicating great promise for near-term application to unmanned space exploration.","benefits":"The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration.","releaseStatus":"Released","status":"Completed","destinationType":["Foundational_Knowledge"],"trlBegin":2,"trlCurrent":3,"trlEnd":3,"favorited":false,"detailedFunding":false,"programContacts":[],"endDateString":"Jul 2016","startDateString":"Aug 2013"},"relatedProjectId":12184,"relatedProject":{"projectId":12184,"title":"Heat Pipe Limits in Reduced Gravity Environments","startDate":"2011-09-07","startYear":2011,"startMonth":9,"endDate":"2015-05-07","endYear":2015,"endMonth":5,"programId":72,"program":{"ableToSelect":false,"acronym":"FO","isActive":true,"description":"<p>The President&rsquo;s 2010 National Space Policy:</p><p>&ldquo;A robust and competitive commercial space sector is vital to continued progress in space. The United States is committed to encouraging and facilitating the growth of a U.S. commercial space sector that supports U.S. needs, is globally competitive, and advances U.S. leadership in the generation of new markets and innovation-driven entrepreneurship.&rdquo;</p><p>Flight Opportunities directly answers the call of the President&rsquo;s policy through the acquisition of suborbital launch services on commercial suborbital launch vehicles.&nbsp; By purchasing flight opportunities on U.S. commercial vehicles the Flight Opportunities program is encouraging and facilitating the growth of this market while simultaneously providing pathways to advance the technology readiness of a wide range of new launch vehicle and space technologies.</p><p>One of the greatest challenges NASA faces in incorporating advanced technologies into future missions is bridging the mid-technology readiness level (TRL) (4-7) gap (or &ldquo;valley of death&rdquo;), between component or prototype testing in a lab or ground facility setting, and the final infusion of a new technology into critical path exploration or science mission development.&nbsp; To cross this gap, the proposed new technology must pass system level testing in a relevant operational environment.&nbsp; Maturing a space technology to flight readiness status through relevant environment testing is a significant challenge from cost, schedule, and technical risk perspectives.</p><p>FO has its lineage from the former Innovative Partnership Program (IPP) of FY09, specifically the Facilitated Access to the Space Environment for Technology (FAST) project and the Commercial Reusable Suborbital Research (CRuSR) project.&nbsp; The FAST and CRuSR activities are continued within the FO Program, as the parabolic and suborbital, flight campaigns, respectively.&nbsp; The flights will provide opportunities to expose new technologies to low-g environments and/or high altitude environments.&nbsp; The intent is to demonstrate and mature various technologies for future applications.&nbsp; These emerging technologies will come from the nine other programs within the Space Technology Mission Directorate, from the other Mission Directorates and external sources (other Government Agencies, Academia, and Commercial Industries.</p> <p>The NASA Flight Opportunities (FO) Program has been established as a part of the Space Technologies Mission Directorate (STMD) to rapidly develop, demonstrate and infuse revolutionary, high-payoff technologies through transparent, collaborative partnerships, expanding the boundaries of the aerospace enterprise by providing the nation&rsquo;s investments in space technologies to make a difference in the world around us.&nbsp; FO focuses on maturation of technologies that are of benefit to multiple customers, to flight readiness status with an outcome of Technology Readiness Level (TRL) 6 or higher.&nbsp; These crosscutting capabilities are those that advance multiple future aerospace missions, including flight projects where near-space or in-space demonstration is needed before the capability can transition to direct mission application.&nbsp; Maturing technologies to a higher TRL status through relevant flight opportunities testing is a significant challenge from both a cost and risk perspective.</p>","programId":72,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36656,"title":"Flight Opportunities","manageGaps":false,"acronymOrTitle":"FO"},"description":"Fission power provides game-changing solutions for powering advanced NASA missions. Radiators are needed to reject waste heat from Fission Power Systems (FPS). Titanium – water heat pipes are being considered for use in the radiators of a fission power system option for lunar exploration. Embedded in the radiators and deployed on the surface, heat pipes would be oriented vertically and would operate as thermosyphons, a subset of heat pipes that have no wick in their condenser. Their design is determined in part by the flooding limit which is attributed to the interfacial shear force at the boundary between liquid and vapor, and occurs when concurrent vapor flow is so severe that liquid flow is prevented. Flooding is determined by the thickness of the fluid film on the walls and the interaction of fluid flow with concurrent vapor counter flow, both inversely proportional to gravity. The planned test objective of this project is to validate the gravity-dependent flooding limit model for thermosyphons. <br>This work continued with a suborbital flight test in 2015 under <a href=\"https://flightopportunities.nasa.gov/technologies/73/\">T0073 Radial Core Heat Spreader</a>.<br><br>Technical Report NASA/TM—2013-217905: <a href=\"http://ntrs.nasa.gov/search.jsp?R=20140000989\">Thermosyphon Flooding in Reduced Gravity Environments Test Results</a><br>Technical Report NASA/TM—2013-216536: <a href=\"https://ntrs.nasa.gov/search.jsp?R=20140010152\">Thermosyphon Flooding in Reduced Gravity Environments</a><br>Paper (2012): <a href=:\"https://arc.aiaa.org/doi/abs/10.2514/6.2012-4049\">Thermosyphon Flooding in Reduced Gravity Environments</a>","benefits":"To date, empirical data of heat pipe limits in microgravity is nonexistent. This adds significant risk to future heat pipe thermal control systems. HEMD and SMD are current and future customers utilizing nuclear power for space. ","releaseStatus":"Released","status":"Completed","destinationType":["Earth"],"trlBegin":4,"trlCurrent":6,"trlEnd":6,"favorited":false,"detailedFunding":false,"programContacts":[],"endDateString":"May 2015","startDateString":"Sep 2011"},"technologyOutcomePartner":"Other","technologyOutcomeDate":"2013-08-01","technologyOutcomePath":"Advanced_From","infoText":"Advanced from another project within the program","infoTextExtra":"Another project within the program (Heat Pipe Limits in Reduced Gravity Environments)","isIndirect":false,"infusionPretty":"","isBiDirectional":true,"technologyOutcomeDateFullString":"August 2013","technologyOutcomeDateString":"Aug 2013","technologyOutcomePartnerPretty":"Other","technologyOutcomePathPretty":"Advanced From","technologyOutcomeRationalePretty":""},{"technologyOutcomeId":96683,"projectId":91575,"project":{"projectId":91575,"title":"Scalable Unsupervised Learning for Unmanned Exploration","startDate":"2013-08-01","startYear":2013,"startMonth":8,"endDate":"2016-07-31","endYear":2016,"endMonth":7,"programId":69,"program":{"ableToSelect":false,"acronym":"STRG","isActive":true,"description":"<p> \tThe Space Technology Research Grants Program will accelerate the development of &quot;push&quot; technologies to support the future space science and exploration needs of NASA, other government agencies and the commercial space sector. Innovative efforts with high risk and high payoff will be encouraged. The program is composed of two competitively awarded components.</p> ","parentProgram":{"ableToSelect":false,"isActive":true,"description":"Catalyst is a portfolio of early stage programs that specialize in different innovation constituencies and mechanisms to push the state of the art in aerospace technology development","programId":92327,"responsibleMd":{"canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":""},"title":"Catalyst","manageGaps":false,"acronymOrTitle":"Catalyst"},"parentProgramId":92327,"programId":69,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36658,"title":"Space Technology Research Grants","manageGaps":false,"acronymOrTitle":"STRG"},"description":"Though we dream of the day when humans will first walk on Mars, these dreams remain in the distance. For now, we explore vicariously by sending robotic agents  like the Curiosity rover  in our stead. Though our current robotic systems are extremely capable, they lack perceptual common sense. This characteristic will be increasingly needed as we create robotic extensions of humanity to reach across the stars, for several reasons. First, robots can go places that humans cannot. If we manage to get a human on Mars by 2035, as predicted by the current NASA timeline, this will still represent a 60 year lag from the time of the first robotic lander.  Second, while it is possible to replace common sense in robots with human teleoperated control to some extent, this becomes infeasible as the distance to the base planet and the associated radio signal delay increase. Finally, as we pack more and more sensors onboard, the fraction of data that can be sent back to earth decreases. Data triage (finding the few frames containing a curious object on a planet's surface out of terabytes of data) becomes more important. In the last few years, research into a class of scalable unsupervised algorithms, also called deep learning algorithms, has blossomed, in part due to state of the art performance in a number of areas. A common thread among many recent deep learning algorithms is that they tend to represent the world in ways similar to how our brains represent the world. For example, thanks to decades of work by neuroscientists, we now know that in the V1 area of the visual cortex, the first region that visual information passes through after the retina, neurons tune themselves to respond to oriented edges and do so in a way that groups them together based on similarity. With this behavior as a goal, researchers set out to devise simple algorithms that reproduce this effect. It turns out that there are several. One, known as Topographic Independent Component Analysis, has each neuron start with random connections and then look for patterns that are statistically out of the ordinary. When it finds one, it locks onto this pattern, discouraging other neurons from duplicating its findings but simultaneously trying to group itself with other neurons that have learned patterns which are similar, but not identical. My proposed research plan is to develop existing and new unsupervised learning algorithms of this type and apply them to a robotic system. Specifically, I will demonstrate a prototype system capable of (1) learning about itself and its environment and of (2) actively carrying out experiments to learn more about itself and its environment. Research will be kept focused by developing a system aimed at eventual deployment on an unmanned space mission. Key components of the project will include synthetic data experiments, experiments on data recorded from a real robot, and finally experiments with learning in the loop as the robot explores its environment and learns actively. The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration. Tantalizing though this is, it is equally exciting that unsupervised learning is already finding application with surprisingly impressive performance right now, indicating great promise for near-term application to unmanned space exploration.","benefits":"The unsupervised algorithms in question are applicable not only to a single domain, but to creating models for a wide range of applications. Thus, advances are likely to have far-reaching implications for many areas of autonomous space exploration.","releaseStatus":"Released","status":"Completed","destinationType":["Foundational_Knowledge"],"trlBegin":2,"trlCurrent":3,"trlEnd":3,"favorited":false,"detailedFunding":false,"programContacts":[],"endDateString":"Jul 2016","startDateString":"Aug 2013"},"technologyOutcomeDate":"2016-07-31","technologyOutcomePath":"Closed_Out","details":"The original goals of the proposed research were to develop existing and new learning algorithms for the purpose of application to autonomous off-world exploration, specifically, for performing data triage on off-world autonomous mobile robots to reduce the volume of data from the huge amount collected to a much smaller subset that may be sent back to a base station for analysis by human technicians. I identified early on the importance of using deep learning methods for attacking this problem and then spent the next few years developing new algorithms for generative modeling (unsupervised learning) as well as for supervised learning. Specific contributions to the field are given below. In total, the contributions bring us significantly closer to being able to deploy capable deep learning models on off-world robots  Notable accomplishments during the fellowship fall under the following eight projects, all of which involve improvements to neural network modeling or understanding. Generative Stochastic Networks: these are a general family of generative models for which we proved important properties, enabling much further work and greater understanding of generative modeling. Our 2013 paper [1] has been cited 121 times.   Transfer Learning: we carefully measured transfer learning performance and uncovered several properties not previously appreciated, like fragile co-adaptation between neurons on neighboring layers. Our 2014 paper [2] has been cited 252 times.  Fooling Deep Neural Networks: we showed provocative findings that neural nets can be easily fooled using a variety of methods, results which generated much discussion in the field. Our 2014/2015 paper [3] has been cited 163 times and was listed as one of the top 100 articles of the year across all fields of science (alongside, e.g., the paper reporting water on Mars).  Optimization-based visualization (visualization of neurons): we've obtained several important results in optimization-based visualization, including setting the state of the art several times (2015 ICML DL workshop [4], 2016 ICML Workshop on Visualization for Deep Learning [5], and 2016 arXiv and to-be NIPS paper [6]).  Facial-keypoint recognition models: we set the start of the art for three keypoint datasets using a new type of network dubbed the Recombinator Network [7].  Understanding Convergent Learning: our paper measuring inter-network differences and similarities, showing how internal representations could be local or distributed, was given an oral at ICLR [8] and opened the path for a new style of research in interpreting network behavior by comparing training across networks.  Deep Visualization Toolbox (visualization of activations): we released a set of open-source tools for visualizing neural networks on both static images (e.g. jpgs loaded from disk) as well as live video frames (e.g. a feed from the user's webcam). Our 2015 paper [4] has been cited 48 times, and the GitHub repository for the project has been starred 836 times.  Automated Agricultural Disease Phenotyping: in collaboration with the researchers from the Cornell Plant Sciences department, my adviser (Hod Lipson) and I wrote and obtained an NSF grant for $1.1m to use deep learning techniques to automatically detect and map agricultural disease spread via Unmanned Aircraft System (UAS) robots.","infoText":"Closed out","infoTextExtra":"Project closed out","isIndirect":false,"infusionPretty":"","isBiDirectional":false,"technologyOutcomeDateFullString":"July 2016","technologyOutcomeDateString":"Jul 2016","technologyOutcomePartnerPretty":"","technologyOutcomePathPretty":"Closed Out","technologyOutcomeRationalePretty":""}],"libraryItems":[{"files":[],"libraryItemId":364529,"title":"Project Website","libraryItemType":"Link","url":"https://www.nasa.gov/directorates/spacetech/home/index.html","projectId":91575,"internalOnly":false,"publishedDateString":"","entryDateString":"01/22/25 01:10 AM","libraryItemTypePretty":"Link","modifiedDateString":"10/25/24 02:23 PM"}],"states":[{"abbreviation":"NY","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"New York","stateTerritoryId":55,"isTerritory":false}],"endDateString":"Jul 2016","startDateString":"Aug 2013"}}