{"projectId":9873,"project":{"projectId":9873,"title":"Perception Engine for Activity Recognition and Logging","startDate":"2012-02-13","startYear":2012,"startMonth":2,"endDate":"2012-08-13","endYear":2012,"endMonth":8,"programId":73,"program":{"ableToSelect":false,"acronym":"SBIR/STTR","isActive":true,"description":"<p>The NASA SBIR and STTR programs fund the research, development, and demonstration of innovative technologies that fulfill NASA needs as described in the annual Solicitations and have significant potential for successful commercialization. If you are a small business concern (SBC) with 500 or fewer employees or a non-profit RI such as a university or a research laboratory with ties to an SBC, then NASA encourages you to learn more about the SBIR and STTR programs as a potential source of seed funding for the development of your innovations.</p><p><strong>The SBIR and STTR programs have 3 phases</strong>:</p><ul><li><strong>Phase I</strong> is the opportunity to establish the scientific, technical, and commercial feasibility of the proposed innovation in fulfillment of NASA needs.</li><li><strong>Phase II</strong> is focused on the development, demonstration and delivery of the proposed innovation.</li></ul><p>The SBIR and STTR Phase I contracts last for 6 months with a maximum funding of $125,000, and Phase II contracts last for 24 months with a maximum funding of $750,000 - $1.5 million.</p><ul><li><strong>Phase III</strong> is the commercialization of innovative technologies, products, and services resulting from either a Phase I or Phase II contract. Phase III contracts are funded from sources other than the SBIR and STTR programs and may be awarded without further competition.</li></ul><p><strong>Opportunity for Continued Technology Development Post-Phase II</strong>:</p><p>The NASA SBIR/STTR Program currently has in place two initiatives for supporting its small business partners past the basic Phase I and Phase II elements of the program that emphasize opportunities for commercialization. Specifically, the NASA SBIR/STTR Program has the Phase II Enhancement (Phase II-E) and Phase II eXpanded (Phase II-X) contract options.&nbsp;</p><p><strong>Please review the links below to obtain more information on the SBIR/STTR programs.</strong></p><ul><li><strong><a target=\"_blank\" href=\"http://sbir.gsfc.nasa.gov/sites/default/files/ParticipationGuide.pdf\">Participation Guide</a></strong></li></ul><p>Provides an overview of the SBIR and STTR programs as implemented by NASA</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/solicitations\">Program Solicitations</a></strong></li></ul><p>Provides access to the annual SBIR/STTR Solicitations containing detailed information on the program eligibility requirements, proposal instructions and research topics and subtopics</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/prg_sched_anncmnt\">Schedule and Awards</a></strong></li></ul><p>Schedule and links for the SBIR/STTR solicitations and selection announcements</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/content/additional-sources-assistance\">Sources of Assistance</a></strong></li></ul><p>Federal and non-Federal sources of assistance for small business</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/abstract_archives\">Awarded Abstracts</a></strong></li></ul><p>Search our complete archive of awarded project abstracts to learn about what NASA has funded</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/content/frequently-asked-questions\">Frequently Asked Questions</a></strong></li></ul><p>&nbsp;Still have questions? Visit the program FAQs</p>","parentProgram":{"ableToSelect":false,"isActive":true,"description":"Catalyst is a portfolio of early stage programs that specialize in different innovation constituencies and mechanisms to push the state of the art in aerospace technology development","programId":92327,"responsibleMd":{"canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":""},"title":"Catalyst","manageGaps":false,"acronymOrTitle":"Catalyst"},"parentProgramId":92327,"programId":73,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36648,"title":"Small Business Innovation Research/Small Business Tech Transfer","manageGaps":false,"acronymOrTitle":"SBIR/STTR"},"description":"Ten of thousands of hours of video footage already exist and countless more hours will be logged as spacecraft continue to orbit the Earth and explore the solar system. These video logs contain immeasurable amounts of useful data on crew social interactions, crew task performance, and crew-vehicle interaction. Currently, these videos must be searched and indexed by hand. This is a long process that involves many man hours of labor. Automated video processing techniques can integrated into a comprehensive toolbox that drastically reduces the time to search and analyze videos. This would allow specific regions in a video stream to be isolated for monitoring, which can provide quick indexing for human viewing of all motion-based activity in the area of a vehicle. It could also allow the user to query for specific activities or events that occurred in this region. These could be automatically detected by software and presented directly to the user. In support of NASA's needs, we propose to design a system that detects and tracks humans, human activity, human-station interaction, and team interactions using existing cameras and videos. Our overall objectives can be achieved by developing a suite of algorithms that can handle several key sub-challenges: 1) Robustly handling unconstrained video content and capture conditions; 2) Extracting functional descriptions of complex human events; 3) Handling ad hoc event queries effectively; 4) Operating efficiently, so the system can keep up with the flood of videos being added to current databases and provide effective interactive search over such databases.","benefits":"Our immediate NASA application is to find key events in video logs from space station and from ground testing. Our intended users include the Habitability and Environmental Factors Division at NASA Johnson Space Center. This work could have immediate application for International Space Station (ISS). The system could be used to monitor specific areas of station that have chronic maintenance issues of unknown cause. It could be used to analyze individual patterns in crew members and highlight unusual behaviors. It could also be used to monitor crew interaction issues, both with each other and with specific hardware on station. Our system is also applicable for vehicle/habitat design issues, by analyzing video of how environments are used by crew members.<br /> <br />The military is a major consumer of video analysis software. We believe that the innovations in this project will enable a general-purpose multimedia interpretation system that will dramatically improve the productivity of intelligence community analysts working at such places as National Media Exploitation Center within the Defense Intelligence Agency. While DARPA has funded Mind's Eye to analyze scenes for verbs, they have not placed the focus on a toolbox that allows humans to place themselves in-the-loop with the video analysis process. By allowing users to make adhoc queries using selected processing components on specific regions of video, human expert knowledge that has yet to be automated can be leveraged to detect novel events. We expect to market our software to military customers. Additional non-NASA applications include activity recognition and configurable video monitoring for airport security, large factories and plants, oil exploration operations, and hospitals. The educational arena is also a potential consumer, as students and classrooms can be monitored at universities, which improves facility maintenance and potentially instructor performance. We also see civilian applications in searching for critical events in massive unconstrained video databases, such as on YouTube and Facebook.","releaseStatus":"Released","status":"Completed","viewCount":772,"destinationType":["Earth"],"trlBegin":2,"trlCurrent":3,"trlEnd":3,"lastUpdated":"01/22/26","favorited":false,"detailedFunding":false,"projectContacts":[{"contactId":3164563,"canUserEdit":false,"firstName":"Mary","lastName":"Kaiser","fullName":"Mary Kaiser","fullNameInverted":"Kaiser, Mary","email":"Mary.K.Kaiser@nasa.gov","receiveEmail":"Subscribed_Contact","projectContactRole":"Project_Manager","projectContactId":540542,"projectId":9873,"programContactRolePretty":"","projectContactRolePretty":"Project Manager"},{"contactId":365600,"canUserEdit":false,"firstName":"Patrick","lastName":"Beeson","fullName":"Patrick F Beeson","fullNameInverted":"Beeson, Patrick F","middleInitial":"F","email":"pbeeson@traclabs.com","receiveEmail":"Subscribed_User","projectContactRole":"Principal_Investigator","projectContactId":540543,"projectId":9873,"programContactRolePretty":"","projectContactRolePretty":"Principal Investigator"}],"programContacts":[{"contactId":206378,"canUserEdit":false,"firstName":"Jason","lastName":"Kessler","fullName":"Jason L Kessler","fullNameInverted":"Kessler, Jason L","middleInitial":"L","email":"jason.l.kessler@nasa.gov","receiveEmail":"Subscribed_User","programContactRole":"Program_Director","programContactId":143,"programId":73,"programContactRolePretty":"Program Director","projectContactRolePretty":""},{"contactId":62051,"canUserEdit":false,"firstName":"Carlos","lastName":"Torrez","fullName":"Carlos Torrez","fullNameInverted":"Torrez, Carlos","email":"carlos.torrez@nasa.gov","receiveEmail":"Subscribed_User","programContactRole":"Program_Manager","programContactId":194,"programId":73,"programContactRolePretty":"Program Manager","projectContactRolePretty":""}],"leadOrganization":{"organizationId":2615,"organizationName":"TRACLabs, Inc.","organizationType":"Industry","city":"Webster","stateTerritoryId":29,"stateTerritory":{"abbreviation":"TX","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Texas","stateTerritoryId":29,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"77598","dunsNumber":"193786014","uei":"CEL6Q7QSVHA7","cageCode":"37ZK6","congressionalDistrict":"Texas 21","projectId":9873,"projectOrganizationId":568086,"organizationRole":"Lead_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Lead Organization","organizationTypePretty":"Industry"},"otherOrganizations":[{"organizationId":2615,"organizationName":"TRACLabs, Inc.","organizationType":"Industry","city":"Webster","stateTerritoryId":29,"stateTerritory":{"abbreviation":"TX","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Texas","stateTerritoryId":29,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"77598","dunsNumber":"193786014","uei":"CEL6Q7QSVHA7","cageCode":"37ZK6","congressionalDistrict":"Texas 21","projectId":9873,"projectOrganizationId":568086,"organizationRole":"Lead_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Lead Organization","organizationTypePretty":"Industry"},{"organizationId":4941,"organizationName":"Ames Research Center","acronym":"ARC","organizationType":"NASA_Center","city":"Moffett Field","stateTerritoryId":59,"stateTerritory":{"abbreviation":"CA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"California","stateTerritoryId":59,"isTerritory":false},"country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"zipCode":"94035","projectId":9873,"projectOrganizationId":568085,"organizationRole":"Supporting_Organization","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"Supporting Organization","organizationTypePretty":"NASA Center"}],"primaryTx":{"taxonomyNodeId":11189,"taxonomyRootId":8817,"parentNodeId":11188,"code":"TX06.6.1","title":"Human Factors Engineering","description":"Human factors engineering focuses on ensuring that the system design is integrated and compatible with human tasks and the sensory, perceptual, mental, and physical attributes of the personnel who will operate, control, maintain, train, and support the equipment, system, or facility throughout its life cycle.","exampleTechnologies":"Frameworks for dynamic multi-agent function allocation, advanced user interfaces, tools to augment human physical and cognitive performance, integrated human-system verification and validation (V&V) methods, human physical and cognitive performance models, human-systems interfaces for increased autonomy and new environments, new con-ops models for crew-vehicle-ground interactions.","level":3,"hasChildren":false,"selected":false,"isPrimary":true,"hasInteriorContent":true},"primaryTxTree":[[{"taxonomyNodeId":11157,"taxonomyRootId":8817,"code":"TX06","title":"Human Health, Life Support, and Habitation Systems","level":1,"hasChildren":true,"selected":false,"hasInteriorContent":true},{"taxonomyNodeId":11188,"taxonomyRootId":8817,"parentNodeId":11157,"code":"TX06.6","title":"Human Systems Integration","description":"Human systems integration (HSI) focuses on improving total system performance by integrating human considerations throughout the design, implementation, and operation of hardware and software. These considerations are incorporated through applying technologies that support analysis, testing, and modeling of human performance, interface controls/displays, and human interaction with automations. Activities associated with human factors engineering, training, habitability, operations effectiveness, safety, and maintainability are considered concurrently and integrated with all other system design activities.","level":2,"hasChildren":true,"selected":false,"hasInteriorContent":true},{"taxonomyNodeId":11189,"taxonomyRootId":8817,"parentNodeId":11188,"code":"TX06.6.1","title":"Human Factors Engineering","description":"Human factors engineering focuses on ensuring that the system design is integrated and compatible with human tasks and the sensory, perceptual, mental, and physical attributes of the personnel who will operate, control, maintain, train, and support the equipment, system, or facility throughout its life cycle.","exampleTechnologies":"Frameworks for dynamic multi-agent function allocation, advanced user interfaces, tools to augment human physical and cognitive performance, integrated human-system verification and validation (V&V) methods, human physical and cognitive performance models, human-systems interfaces for increased autonomy and new environments, new con-ops models for crew-vehicle-ground interactions.","level":3,"hasChildren":false,"selected":true,"hasInteriorContent":true}]],"technologyOutcomes":[{"technologyOutcomeId":92002,"projectId":9873,"project":{"projectId":9873,"title":"Perception Engine for Activity Recognition and Logging","startDate":"2012-02-13","startYear":2012,"startMonth":2,"endDate":"2012-08-13","endYear":2012,"endMonth":8,"programId":73,"program":{"ableToSelect":false,"acronym":"SBIR/STTR","isActive":true,"description":"<p>The NASA SBIR and STTR programs fund the research, development, and demonstration of innovative technologies that fulfill NASA needs as described in the annual Solicitations and have significant potential for successful commercialization. If you are a small business concern (SBC) with 500 or fewer employees or a non-profit RI such as a university or a research laboratory with ties to an SBC, then NASA encourages you to learn more about the SBIR and STTR programs as a potential source of seed funding for the development of your innovations.</p><p><strong>The SBIR and STTR programs have 3 phases</strong>:</p><ul><li><strong>Phase I</strong> is the opportunity to establish the scientific, technical, and commercial feasibility of the proposed innovation in fulfillment of NASA needs.</li><li><strong>Phase II</strong> is focused on the development, demonstration and delivery of the proposed innovation.</li></ul><p>The SBIR and STTR Phase I contracts last for 6 months with a maximum funding of $125,000, and Phase II contracts last for 24 months with a maximum funding of $750,000 - $1.5 million.</p><ul><li><strong>Phase III</strong> is the commercialization of innovative technologies, products, and services resulting from either a Phase I or Phase II contract. Phase III contracts are funded from sources other than the SBIR and STTR programs and may be awarded without further competition.</li></ul><p><strong>Opportunity for Continued Technology Development Post-Phase II</strong>:</p><p>The NASA SBIR/STTR Program currently has in place two initiatives for supporting its small business partners past the basic Phase I and Phase II elements of the program that emphasize opportunities for commercialization. Specifically, the NASA SBIR/STTR Program has the Phase II Enhancement (Phase II-E) and Phase II eXpanded (Phase II-X) contract options.&nbsp;</p><p><strong>Please review the links below to obtain more information on the SBIR/STTR programs.</strong></p><ul><li><strong><a target=\"_blank\" href=\"http://sbir.gsfc.nasa.gov/sites/default/files/ParticipationGuide.pdf\">Participation Guide</a></strong></li></ul><p>Provides an overview of the SBIR and STTR programs as implemented by NASA</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/solicitations\">Program Solicitations</a></strong></li></ul><p>Provides access to the annual SBIR/STTR Solicitations containing detailed information on the program eligibility requirements, proposal instructions and research topics and subtopics</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/prg_sched_anncmnt\">Schedule and Awards</a></strong></li></ul><p>Schedule and links for the SBIR/STTR solicitations and selection announcements</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/content/additional-sources-assistance\">Sources of Assistance</a></strong></li></ul><p>Federal and non-Federal sources of assistance for small business</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/abstract_archives\">Awarded Abstracts</a></strong></li></ul><p>Search our complete archive of awarded project abstracts to learn about what NASA has funded</p><ul><li><strong><a href=\"http://sbir.gsfc.nasa.gov/content/frequently-asked-questions\">Frequently Asked Questions</a></strong></li></ul><p>&nbsp;Still have questions? Visit the program FAQs</p>","parentProgram":{"ableToSelect":false,"isActive":true,"description":"Catalyst is a portfolio of early stage programs that specialize in different innovation constituencies and mechanisms to push the state of the art in aerospace technology development","programId":92327,"responsibleMd":{"canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":""},"title":"Catalyst","manageGaps":false,"acronymOrTitle":"Catalyst"},"parentProgramId":92327,"programId":73,"responsibleMd":{"organizationId":4875,"organizationName":"Space Technology Mission Directorate","acronym":"STMD","organizationType":"NASA_Mission_Directorate","canUserEdit":false,"locationEdit":false,"organizationRolePretty":"","organizationTypePretty":"NASA Mission Directorate"},"responsibleMdOffice":4875,"stockImageFileId":36648,"title":"Small Business Innovation Research/Small Business Tech Transfer","manageGaps":false,"acronymOrTitle":"SBIR/STTR"},"description":"Ten of thousands of hours of video footage already exist and countless more hours will be logged as spacecraft continue to orbit the Earth and explore the solar system. These video logs contain immeasurable amounts of useful data on crew social interactions, crew task performance, and crew-vehicle interaction. Currently, these videos must be searched and indexed by hand. This is a long process that involves many man hours of labor. Automated video processing techniques can integrated into a comprehensive toolbox that drastically reduces the time to search and analyze videos. This would allow specific regions in a video stream to be isolated for monitoring, which can provide quick indexing for human viewing of all motion-based activity in the area of a vehicle. It could also allow the user to query for specific activities or events that occurred in this region. These could be automatically detected by software and presented directly to the user. In support of NASA's needs, we propose to design a system that detects and tracks humans, human activity, human-station interaction, and team interactions using existing cameras and videos. Our overall objectives can be achieved by developing a suite of algorithms that can handle several key sub-challenges: 1) Robustly handling unconstrained video content and capture conditions; 2) Extracting functional descriptions of complex human events; 3) Handling ad hoc event queries effectively; 4) Operating efficiently, so the system can keep up with the flood of videos being added to current databases and provide effective interactive search over such databases.","benefits":"Our immediate NASA application is to find key events in video logs from space station and from ground testing. Our intended users include the Habitability and Environmental Factors Division at NASA Johnson Space Center. This work could have immediate application for International Space Station (ISS). The system could be used to monitor specific areas of station that have chronic maintenance issues of unknown cause. It could be used to analyze individual patterns in crew members and highlight unusual behaviors. It could also be used to monitor crew interaction issues, both with each other and with specific hardware on station. Our system is also applicable for vehicle/habitat design issues, by analyzing video of how environments are used by crew members.<br /> <br />The military is a major consumer of video analysis software. We believe that the innovations in this project will enable a general-purpose multimedia interpretation system that will dramatically improve the productivity of intelligence community analysts working at such places as National Media Exploitation Center within the Defense Intelligence Agency. While DARPA has funded Mind's Eye to analyze scenes for verbs, they have not placed the focus on a toolbox that allows humans to place themselves in-the-loop with the video analysis process. By allowing users to make adhoc queries using selected processing components on specific regions of video, human expert knowledge that has yet to be automated can be leveraged to detect novel events. We expect to market our software to military customers. Additional non-NASA applications include activity recognition and configurable video monitoring for airport security, large factories and plants, oil exploration operations, and hospitals. The educational arena is also a potential consumer, as students and classrooms can be monitored at universities, which improves facility maintenance and potentially instructor performance. We also see civilian applications in searching for critical events in massive unconstrained video databases, such as on YouTube and Facebook.","releaseStatus":"Released","status":"Completed","destinationType":["Earth"],"trlBegin":2,"trlCurrent":3,"trlEnd":3,"favorited":false,"detailedFunding":false,"programContacts":[{"contactId":62051,"canUserEdit":false,"firstName":"Carlos","lastName":"Torrez","fullName":"Carlos Torrez","fullNameInverted":"Torrez, Carlos","email":"carlos.torrez@nasa.gov","receiveEmail":"Subscribed_User","programContactRole":"Program_Manager","programContactId":194,"programId":73,"programContactRolePretty":"Program Manager","projectContactRolePretty":""},{"contactId":206378,"canUserEdit":false,"firstName":"Jason","lastName":"Kessler","fullName":"Jason L Kessler","fullNameInverted":"Kessler, Jason L","middleInitial":"L","email":"jason.l.kessler@nasa.gov","receiveEmail":"Subscribed_User","programContactRole":"Program_Director","programContactId":143,"programId":73,"programContactRolePretty":"Program Director","projectContactRolePretty":""}],"endDateString":"Aug 2012","startDateString":"Feb 2012"},"technologyOutcomeDate":"2012-08-13","technologyOutcomePath":"Closed_Out","files":[{"title":"Final Summary Chart","file":{"fileExtension":"pdf","fileId":354698,"fileName":"SBIR_2011_1_FSC_X15_01-8981","fileSize":118446,"objectId":92002,"objectType":"technologyOutcomeFiles","presignedUpload":false,"fileSizeString":"115.7 KB"},"technologyOutcomeId":92002,"fileId":354698}],"infoText":"Closed out","infoTextExtra":"Project closed out","isIndirect":false,"infusionPretty":"","isBiDirectional":false,"technologyOutcomeDateString":"Aug 2012","technologyOutcomeDateFullString":"August 2012","technologyOutcomePartnerPretty":"","technologyOutcomePathPretty":"Closed Out","technologyOutcomeRationalePretty":""}],"libraryItems":[],"states":[{"abbreviation":"CA","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"California","stateTerritoryId":59,"isTerritory":false},{"abbreviation":"TX","country":{"abbreviation":"US","countryId":236,"name":"United States"},"countryId":236,"name":"Texas","stateTerritoryId":29,"isTerritory":false}],"endDateString":"Aug 2012","startDateString":"Feb 2012"}}