21 July 2008 Storage options for petabytes of data
Author Affiliations +
Abstract
New instrumentation that produces extremely large quantities of data presents a challenge in data processing and management. The Solar Dynamics Observatory (SDO) will house instruments that will produce 1.4TB of data per day. Processing and storing that quantity of data is a serious challenge. The instrument team for the Atmospheric Imaging Assembly (AIA) that will fly on SDO spent the last 2 weeks in September doing a large-scale side-by-side comparison of archive equipment from Apple, BlueArc, EMC, Network Appliance, SGI and Sun Microsystems. Each vendor provided 100TB of SATA disk space and the required servers to showcase their unique solutions to the problem of petabyte sized archives. The results of the testing demonstrate some of the options available in this arena. We will discuss the results of the testing, the differences and similarities between the vendors and the applicability of the technologies to various environments.
© (2008) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Lisa Paton, Lisa Paton, Jonathan Cirtain, Jonathan Cirtain, Paul Grant, Paul Grant, } "Storage options for petabytes of data", Proc. SPIE 7019, Advanced Software and Control for Astronomy II, 70192Z (21 July 2008); doi: 10.1117/12.789763; https://doi.org/10.1117/12.789763
PROCEEDINGS
9 PAGES


SHARE
RELATED CONTENT

Data products of the ALMA and NRAO archives
Proceedings of SPIE (July 14 2016)
NOAO data products program
Proceedings of SPIE (January 01 2002)
Data Vault providing simple web access to NRAO data...
Proceedings of SPIE (July 14 2008)
Technology And Future Ground Processing Systems
Proceedings of SPIE (November 05 1981)
SOLIS observation control system
Proceedings of SPIE (June 15 2000)

Back to Top