VISTA data flow system: overview

James P. Emerson; Mike J. Irwin; Jim Lewis; Simon Hodgkin; Dafydd Evans; Peter Bunclark; Richard McMahon; Nigel C. Hambly; Robert G. Mann; Ian Bond; Eckhard Sutorius; Michael Read; Peredur Williams; Andrew Lawrence; Malcolm Stewart

doi:10.1117/12.551582

16 September 2004 VISTA data flow system: overview

James P. Emerson, Mike J. Irwin, Jim Lewis, Simon Hodgkin, Dafydd Evans, Peter Bunclark, Richard McMahon, Nigel C. Hambly, Robert G. Mann, Ian Bond, Eckhard Sutorius, Michael Read, Peredur Williams, Andrew Lawrence, Malcolm Stewart

Author Affiliations +

Proceedings Volume 5493, Optimizing Scientific Return for Astronomy through Information Technologies; (2004) https://doi.org/10.1117/12.551582
Event: SPIE Astronomical Telescopes + Instrumentation, 2004, Glasgow, United Kingdom

Abstract

Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.

Citation Download Citation

James P. Emerson, Mike J. Irwin, Jim Lewis, Simon Hodgkin, Dafydd Evans, Peter Bunclark, Richard McMahon, Nigel C. Hambly, Robert G. Mann, Ian Bond, Eckhard Sutorius, Michael Read, Peredur Williams, Andrew Lawrence, and Malcolm Stewart "VISTA data flow system: overview", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); https://doi.org/10.1117/12.551582

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available