24 December 2002 The WFCAM/UKIDSS data archive: problems and opportunities
Author Affiliations +
The UKIRT Wide Field Camera (WFCAM) is an IR mosaic camera that represents an enormous leap in deep IR survey capability. It will be used as both an open time facility, and to perform a public IR Deep Sky Survey (the UKIDSS project), starting in early 2004. Here we present current plans for the data archive system, which will be provided as a standard service for all UK WFCAM data whether private or public survey data. The data rate is an order of magnitude larger than any previous survey experiment. WFCAM is therefore a crucial stepping stone between current day surveys such as SuperCOSMOS, APM and SDSS, and future facilities such as VISTA and the LSST. Pipeline processing presents a technical challenge, but the strongest challenges come in operation and curation of such a pipeline and of the rapidly accumulating database. For the public archive, there is little technical challenge in simply storing the data, and the real challenge comes in the rapidly increasing expectations of the user community for the kind of on-line services available with the archive. We describe three levels of archive service and the challenges they present, and discuss the hardware and software solutions we are likely to deploy.
© (2002) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Andrew Lawrence, Andrew Lawrence, Nigel Hambly, Nigel Hambly, Bob Mann, Bob Mann, Mike Irwin, Mike Irwin, Richard G. McMahon, Richard G. McMahon, James R. Lewis, James R. Lewis, Andrew J. Adamson, Andrew J. Adamson, } "The WFCAM/UKIDSS data archive: problems and opportunities", Proc. SPIE 4836, Survey and Other Telescope Technologies and Discoveries, (24 December 2002); doi: 10.1117/12.457008; https://doi.org/10.1117/12.457008


VISTA data flow system: status
Proceedings of SPIE (June 28 2006)
Planning and scheduling the Spitzer Space Telescope
Proceedings of SPIE (June 29 2006)
SIRTF science operations system
Proceedings of SPIE (March 04 2003)
VISTA data flow system: overview
Proceedings of SPIE (September 15 2004)
From Chile to Europe in minutes handling the data...
Proceedings of SPIE (July 29 2010)

Back to Top