Translator Disclaimer
Paper
27 November 2002 ESO's ArchiveComputing framework
Author Affiliations +
Abstract
ESO's Science Archive is distributed across four different sites on two continents. With the huge amount of data produced by the various instruments this poses special requirements on the way data is transfered between the sites and distributed to the various subscribers. ESO's latest development, the Next Generation Archive System (NGAS), is based on cheap ATA disks connected to custom PCs running http based servers controlling the archiving process, supporting retrieval and checking the health status of the disks and the data itself. The current deployment of this system covers just a single 8kx8k pixel wide field imager, which is producing about 30 GB of raw data per night. The next generation of wide field telescopes/instruments VISTA/VISTACam and VST/OmegaCam will produce data rates well exceeding 500 GB and 125 GB during a single typical night, respectively. The total data rate of all ESO telescopes/instruments will grow to about 0.75 TB/night once VISTA is operational. The archiving of this data is essential, the next important step is to support not just only retrieval, but also flexible processing schemes of the data within the archive cluster directly.
© (2002) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Andreas J. Wicenec and Jens Knudstrup "ESO's ArchiveComputing framework", Proc. SPIE 4845, Advanced Global Communications Technologies for Astronomy II, (27 November 2002); https://doi.org/10.1117/12.461148
PROCEEDINGS
8 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT

Public surveys at ESO
Proceedings of SPIE (July 15 2016)
VLT service mode operations at seven years
Proceedings of SPIE (June 30 2006)
Data interface control at the European Southern Observatory
Proceedings of SPIE (September 16 2004)
Metrics for Hubble Space Telescope science operations
Proceedings of SPIE (January 02 2002)
Korea microlensing telescope network: data management plan
Proceedings of SPIE (September 24 2012)
The TJO-OAdM Robotic Observatory: the scheduler
Proceedings of SPIE (July 19 2010)
From Chile to Europe in minutes handling the data...
Proceedings of SPIE (July 29 2010)

Back to Top