Developing a Common Cloud Platform for Geophysical Data Services

Abstract:

The Data Services of IRIS and the Geodetic Data Services of UNAVCO have been managing repositories of seismological, geodetic and related data for many decades. Historically, these two facilities have independently managed data repositories on self-managed systems. In recent years, exploratory cloud work is being done in the GeoSciCloud and GeoSCIFramework projects, supported by NSF’s EarthCube program. A few services are already operating in cloud environments due to either very large volumes or to take advantage of the robustness afforded. Following a joint review of the data service facilities in 2019, NSF directed the two groups to form a single project to prototype a common, cloud-based system for the combined data management needs.

In response to NSF, and motivated by the potential for providing enhanced data services, we initiated the Common Cloud Platform (CCP) project. The CCP project aims to create a cloud-based platform to handle the needs of both data facilities by 2023. Beyond the migration of repositories and support systems, the project aims to combine these aspects whenever possible by merging sub-systems. Major anticipated advantages of CCP include: 1) cost-effective, 2) scalable capacity, 3) accommodating new data types, and 4) simplicity. The project affords an opportunity to retire technical debt, while including modernizations at a low-level such as FAIR data capabilities, identity management, leveraging existing open-source software whenever possible, etc. In the context of an anticipated merger of the two organizations, the project is an opportunity for staff members of the two facilities to develop common practices. The project is currently in the planning and evaluation stages. We will report on the status of the project, anticipated directions and challenges identified.