IN041-04
A Prototype Data Analysis Pipeline for NASA’s Surface Biology and Geology Directed Observables Mission

Wednesday, 16 December 2020: 04:09
Virtual
Jon Jenkins1, Peter Tenenbaum1,2, Ian G Brosnan3, Yohei Shinozuka1,4, Jennifer L Dungan1, Bill Wohler5,6, Philip A Townsend7,8, Michelle M Gierach9 and Benjamin Poulter10, (1)NASA Ames Research Center, Moffett Field, CA, United States, (2)SETI Institute Mountain View, Mountain View, CA, United States, (3)NASA Ames Research Center, Earth Science Division, Moffett Field, CA, United States, (4)Universities Space Research Association, Moffett Field, CA, United States, (5)SETI Institute Mountain View, Mountain View, United States, (6)NASA Ames Research Center, Moffett Field, United States, (7)University of Wisconsin, Department of Forest and Wildlife Ecology, Madison, WI, United States, (8)NASA Jet Propulsion Laboratory, Pasadena, WI, United States, (9)Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, United States, (10)NASA GSFC, Biospheric Science, Greenbelt, MD, United States
Abstract:
One of NASA’s future global orbital missions, currently in development as the Surface Biology and Geology (SBG) Designated Observable study, will acquire high resolution solar-reflected spectroscopy and thermal infrared observations. Innovative processes are needed to handle the high volume of data anticipated to be collected, which may exceed 100 terabytes/day and will be greater than NASA’s total extant airborne hyperspectral data collection. Collecting, processing/re-processing, disseminating, and exploiting this volume of data presents new challenges. To begin addressing them, NASA is drawing upon the expertise developed from its astrophysics programs to address Earth science and applications. Specifically, NASA is adapting the science processing operations technology developed for the Kepler and TESS planet-hunting missions for imaging spectroscopy data processing. This technology development has been the foundation for the remarkable scientific successes of Kepler and TESS. The Kepler/TESS data processing technology provides a scalable architecture for robust, repeatable, and replicable science and application products while enabling the Earth science community to develop, test, and implement new algorithms. Our effort to leverage this existing capability has begun by ingesting data and applying workflows from the EO-1/Hyperion 17-year mission archive that provides globally sampled visible through shortwave infrared spectra that are representative of SBG data types and volumes. We provide a progress report in setting up this pipeline and reprocessing the entire 50 TB Hyperion data set, as well as defining and scoping synthetic dataset characteristics for future pipeline verification and validation. This pathfinding data processing system will help define the solutions to processing SBG data volumes and will enable the scientific community to interact with the data and processing pipeline to create new science products.
<< Previous Abstract | Next Abstract >>