Skip Navigation
Center Independent Research & Development: JPL IRAD

Archiving, Processing and Dissemination for the Big Data Era

Completed Technology Project

Project Description

Archiving, Processing and Dissemination for the Big Data Era

This task will research and deliver solutions to 4 BIGDATA technology areas: (1) Rapid Science Algorithm Integration -- automatically and efficiently integrating IDL, Python, Matlab, etc. algorithms in the U.S. National Climate Assessment and into projects using the Common Astronomical Software Applications (CASA) software from NRAO; (2) data movement - exploring the tradeoffs between the architectural propertie and scalability properties of 4-5 modern data movement technologies under realistic scenarios for the U.S. NCAs and for the SKA; (3) cloud computing - for processing and for storage of Earth and astronomical data; (4) automatic and rapid data/metadata extraction from file formats - the use and application of technologies for automatically extracting text and metadata from science data formats.

More »

Anticipated Benefits

Project Library

Primary U.S. Work Locations and Key Partners

Light bulb

Suggest an Edit

Recommend changes and additions to this project record.