16 September 2004 VISTA data flow system: overview
Author Affiliations +
Abstract
Data from the two IR survey cameras WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching 1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibility of curated and user-specified data products in the context of the Virtual Observatory. Accompanying papers by Irwin et al and Hambly et al detail the design of the pipeline and science archive aspects of the project.
© (2004) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
James P. Emerson, James P. Emerson, Mike J. Irwin, Mike J. Irwin, Jim Lewis, Jim Lewis, Simon Hodgkin, Simon Hodgkin, Dafydd Evans, Dafydd Evans, Peter Bunclark, Peter Bunclark, Richard McMahon, Richard McMahon, Nigel C. Hambly, Nigel C. Hambly, Robert G. Mann, Robert G. Mann, Ian Bond, Ian Bond, Eckhard Sutorius, Eckhard Sutorius, Michael Read, Michael Read, Peredur Williams, Peredur Williams, Andrew Lawrence, Andrew Lawrence, Malcolm Stewart, Malcolm Stewart, } "VISTA data flow system: overview", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); doi: 10.1117/12.551582; https://doi.org/10.1117/12.551582
PROCEEDINGS
10 PAGES


SHARE
RELATED CONTENT

The WFCAM/UKIDSS data archive: problems and opportunities
Proceedings of SPIE (December 24 2002)
VLT data flow system: the NTT prototype experience
Proceedings of SPIE (September 18 1997)
Archive systems for the TNG telescope lessons learned in...
Proceedings of SPIE (December 16 2002)
Moor web access to end to end data flow...
Proceedings of SPIE (September 16 2004)

Back to Top