Archiving, Processing and Dissemination for the Big Data Era
Project Description
This task will research and deliver solutions to 4 BIGDATA technology areas: (1) Rapid Science Algorithm Integration -- automatically and efficiently integrating IDL, Python, Matlab, etc. algorithms in the U.S. National Climate Assessment and into projects using the Common Astronomical Software Applications (CASA) software from NRAO; (2) data movement - exploring the tradeoffs between the architectural propertie and scalability properties of 4-5 modern data movement technologies under realistic scenarios for the U.S. NCAs and for the SKA; (3) cloud computing - for processing and for storage of Earth and astronomical data; (4) automatic and rapid data/metadata extraction from file formats - the use and application of technologies for automatically extracting text and metadata from science data formats.
More »Anticipated Benefits
Missions will benefit from solutions to 4 BIGDATA technology areas: (1) Rapid Science Algorithm Integration -- automatically and efficiently integrating IDL, Python, Matlab, etc. algorithms in the U.S. National Climate Assessment and into projects using the Common Astronomical Software Applications (CASA) software from NRAO; (2) data movement - exploring the tradeoffs between the architectural propertie and scalability properties of 4-5 modern data movement technologies under realistic scenarios for the U.S. NCAs and for the SKA; (3) cloud computing - for processing and for storage of Earth and astronomical data; (4) automatic and rapid data/metadata extraction from file formats - the use and application of technologies for automatically extracting text and metadata from science data formats.
More »Project Library
Primary U.S. Work Locations and Key Partners
| Organizations Performing Work | Role | Type | Location |
|---|---|---|---|
| Jet Propulsion Laboratory (JPL) | Lead Organization | FFRDC/UARC | Pasadena, California |
Primary U.S. Work Locations
-
California
