Cure-WISE: HETDEX data reduction with Astro-WISE

J. M. Snigula; M. E. Cornell; N. Drory; Max. Fabricius; M. Landriau; G. J. Hill; K. Gebhardt

doi:10.1117/12.925179

24 September 2012 Cure-WISE: HETDEX data reduction with Astro-WISE

J. M. Snigula, M. E. Cornell, N. Drory, Max. Fabricius, M. Landriau, G. J. Hill, K. Gebhardt

Proceedings Volume 8451, Software and Cyberinfrastructure for Astronomy II; 845125 (2012) https://doi.org/10.1117/12.925179
Event: SPIE Astronomical Telescopes + Instrumentation, 2012, Amsterdam, Netherlands

Abstract

The Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) is a blind spectroscopic survey to map the evolution of dark energy using Lyman-alpha emitting galaxies at redshifts 1:9 < z < 3:5 as tracers. The survey instrument, VIRUS, consists of 75 IFUs distributed across the 22-arcmin field of the upgraded 9.2-m HET. Each exposure gathers 33,600 spectra. Over the projected five year run of the survey we expect about 170 GB of data per night. For the data reduction we developed the Cure pipeline. Cure is designed to automatically find and calibrate the observed spectra, subtract the sky background, and detect and classify different types of sources. Cure employs rigorous statistical methods and complete pixel-level error propagation throughout the reduction process to ensure Poisson-limited performance and meaningful significance values. To automate the reduction of the whole dataset we implemented the Cure pipeline in the Astro-WISE framework. This integration provides for HETDEX a database backend with complete dependency tracking of the various reduction steps, automated checks, and a searchable interface to the detected sources and user management. It can be used to create various web interfaces for data access and quality control. Astro-WISE allows us to reduce the data from all the IFUs in parallel on a compute cluster. This cluster allows us to reduce the observed data in quasi real time and still have excess capacity for rerunning parts of the reduction. Finally, the Astro-WISE interface will be used to provide access to reduced data products to the general community.

Citation Download Citation

J. M. Snigula, M. E. Cornell, N. Drory, Max. Fabricius, M. Landriau, G. J. Hill, and K. Gebhardt "Cure-WISE: HETDEX data reduction with Astro-WISE", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 845125 (24 September 2012); https://doi.org/10.1117/12.925179

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available