29 July 2010 From Chile to Europe in minutes: handling the data stream from ESO's Paranal Observatory
Author Affiliations +
The ESO telescopes in Chile are operated in a geographically distributed scheme, in which some of the essential steps in the end-to-end observing chain take place in Europe. Most notably, the health status of the instruments as derived from the data themselves is monitored in Europe and the results fed back to the observatory within the hour. The flexibility of this scheme strongly depends on the speed with which the data stream produced by the telescopes can be sent to Europe for analysis and storage. The main challenge to achieve a fast intercontinental data transfer is the data volume itself, which currently reaches an average 25 GB/night (compressed) for the four VLT Unit Telescopes. Since late 2008, this stream has been entirely transferred through the internet via a 4.56 Mbit/s bandwidth assured via a Quality of Service policy, which sufficed to transfer an average night of data within a few hours. A very recent enlargement of this capacity to 9.12 Mbit/s will soon allow the addition of the calibration data for VISTA, the new infrared survey telescope on Paranal, to the data stream transferred through the internet. Ultimately, the average data volume produced on Paranal once the visible VLT Survey Telescope (VST) and the full complement of second-generation VLT instruments becomes available is expected to exceed 200 GB/night. Transferring it over the internet will require a new fiber-based infrastructure currently under construction, as well as the use of additional high bandwidth channels. This infrastructure, provided by the European Union co-funded project EVALSO, should provide a data transfer capacity exceeding 1 Gbit/s that will allow the transfer to Europe of the entire Paranal data stream, as well as that of the nearby Observatory of Cerro Armazones and of the future European Extremely Large Telescope, with a delay of minutes at most since the data were taken.
© (2010) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Martino Romaniello, Martino Romaniello, Stefano Zampieri, Stefano Zampieri, Cecilia Cerón, Cecilia Cerón, Andrew Wright, Andrew Wright, Reinhard Hanuschik, Reinhard Hanuschik, Cédric Ledoux, Cédric Ledoux, Fernando Comerón, Fernando Comerón, "From Chile to Europe in minutes: handling the data stream from ESO's Paranal Observatory", Proc. SPIE 7737, Observatory Operations: Strategies, Processes, and Systems III, 773724 (29 July 2010); doi: 10.1117/12.859670; https://doi.org/10.1117/12.859670


Public surveys at ESO
Proceedings of SPIE (July 14 2016)
Validation of ESO Phase 3 data submissions
Proceedings of SPIE (July 14 2016)
VLT service mode operations at seven years
Proceedings of SPIE (June 29 2006)
The WFCAM/UKIDSS data archive: problems and opportunities
Proceedings of SPIE (December 23 2002)
Online scientific data curation, publication, and archiving
Proceedings of SPIE (December 15 2002)

Back to Top