24 September 2012 Cure-WISE: HETDEX data reduction with Astro-WISE
Author Affiliations +
Abstract
The Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) is a blind spectroscopic survey to map the evolution of dark energy using Lyman-alpha emitting galaxies at redshifts 1:9 < z < 3:5 as tracers. The survey instrument, VIRUS, consists of 75 IFUs distributed across the 22-arcmin field of the upgraded 9.2-m HET. Each exposure gathers 33,600 spectra. Over the projected five year run of the survey we expect about 170 GB of data per night. For the data reduction we developed the Cure pipeline. Cure is designed to automatically find and calibrate the observed spectra, subtract the sky background, and detect and classify different types of sources. Cure employs rigorous statistical methods and complete pixel-level error propagation throughout the reduction process to ensure Poisson-limited performance and meaningful significance values. To automate the reduction of the whole dataset we implemented the Cure pipeline in the Astro-WISE framework. This integration provides for HETDEX a database backend with complete dependency tracking of the various reduction steps, automated checks, and a searchable interface to the detected sources and user management. It can be used to create various web interfaces for data access and quality control. Astro-WISE allows us to reduce the data from all the IFUs in parallel on a compute cluster. This cluster allows us to reduce the observed data in quasi real time and still have excess capacity for rerunning parts of the reduction. Finally, the Astro-WISE interface will be used to provide access to reduced data products to the general community.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
J. M. Snigula, J. M. Snigula, M. E. Cornell, M. E. Cornell, N. Drory, N. Drory, Max. Fabricius, Max. Fabricius, M. Landriau, M. Landriau, G. J. Hill, G. J. Hill, K. Gebhardt, K. Gebhardt, } "Cure-WISE: HETDEX data reduction with Astro-WISE", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 845125 (24 September 2012); doi: 10.1117/12.925179; https://doi.org/10.1117/12.925179
PROCEEDINGS
7 PAGES


SHARE
Back to Top