Managing the evolution of the LSST data management system

Jeffrey P. Kantor

doi:10.1117/12.671685

27 June 2006 Managing the evolution of the LSST data management system

Jeffrey P. Kantor

Proceedings Volume 6274, Advanced Software and Control for Astronomy; 62740P (2006) https://doi.org/10.1117/12.671685
Event: SPIE Astronomical Telescopes + Instrumentation, 2006, Orlando, Florida , United States

Abstract

The Large Synoptic Survey Telescope (LSST) is planned to start construction in early 2009 and achieve first light in late 2012. The LSST Data Management System (DMS) has the responsibility to: 1) process the stream of raw images (15 TB/night) generated during observing to create and archive the nightly data products; 2) reprocess archived data products to incorporate pipeline improvements and generate longer-term data products; 3) provide a public interface that makes available all generated data products. The DMS must perform these duties throughout the multi-decade lifetime of the survey and its data products. It is given that computing hardware undergoes generational changes every 3 to 5 years, software engineering paradigms shift every decade, and astronomy data reduction and analysis algorithms are in constant evolution. Thus, if the useful life of the LSST Data Products is even 2 decades, the raw data will be completely re-processed at least 20 times with improved algorithms, the computing on which this is executed will be completely changed at least 4 times, and the software engineering paradigm and software architecture will completely change at least once. Managing this evolution in the DMS will require strategies in all areas of LSST Data Management, including: 1) a layered system architecture; 2) stable interfaces preserving backward compatibility; 3) plug-and-play components for pipeline construction; 4) extendable data and metadata types for catalog construction; 5) open interfaces for resource registration and access; 6) provenance and preservation mechanisms. This paper describes how we plan to employ these strategies and the expected benefits.

Citation Download Citation

Jeffrey P. Kantor "Managing the evolution of the LSST data management system", Proc. SPIE 6274, Advanced Software and Control for Astronomy, 62740P (27 June 2006); https://doi.org/10.1117/12.671685

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Large Synoptic Survey Telescope

Data archive systems

Astronomy

Data processing

Computer architecture

Software engineering

Observatories

Show All Keywords

Keywords/Phrases

Search In:

Publication Years