11 July 2016 Delivering data reduction pipelines to science users
Author Affiliations +
Abstract
The European Southern Observatory has a long history of providing specialized data processing algorithms, called recipes, for most of its instruments. These recipes are used for both operational purposes at the observatory sites, and for data reduction by the scientists at their home institutions. The two applications require substantially different environments for running and controlling the recipes. In this papers, we describe the ESOReflex environment that is used for running recipes on the users’ desktops. ESOReflex is a workflow driven data reduction environment. It allows intuitive representation, execution and modification of the data reduction workflow, and has facilities for inspection of and interaction with the data. It includes fully automatic data organization and visualization, interaction with recipes, and the exploration of the provenance tree of intermediate and final data products. ESOReflex uses a number of innovative concepts that have been described in Ref. 1. In October 2015, the complete system was released to the public. ESOReflex allows highly efficient data reduction, using its internal bookkeeping database to recognize and skip previously completed steps during repeated processing of the same or similar data sets. It has been widely adopted by the science community for the reduction of VLT data.
© (2016) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Wolfram Freudling, Wolfram Freudling, Martino Romaniello, Martino Romaniello, } "Delivering data reduction pipelines to science users", Proc. SPIE 9910, Observatory Operations: Strategies, Processes, and Systems VI, 99101U (11 July 2016); doi: 10.1117/12.2232734; https://doi.org/10.1117/12.2232734
PROCEEDINGS
6 PAGES


SHARE
RELATED CONTENT

ALMA science operations and user support: software
Proceedings of SPIE (July 29 2010)
AstroGrid: powering the Virtual Observatory
Proceedings of SPIE (December 15 2002)
The JWST data management system engineering database
Proceedings of SPIE (September 12 2012)
The Chandra X ray Center a combined science and...
Proceedings of SPIE (June 28 2006)
ESO data flow system in operations closing the data...
Proceedings of SPIE (July 24 2000)

Back to Top