18 January 2018 Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey
Author Affiliations +
The Gemini Planet Imager Exoplanet Survey (GPIES) is a multiyear direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines (DRPs) together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our DRPs. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizes our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.
© 2018 Society of Photo-Optical Instrumentation Engineers (SPIE)
Jason J. Wang, Jason J. Wang, Marshall D. Perrin, Marshall D. Perrin, Dmitry Savransky, Dmitry Savransky, Pauline Arriaga, Pauline Arriaga, Jeffrey K. Chilcote, Jeffrey K. Chilcote, Robert J. De Rosa, Robert J. De Rosa, Maxwell A. Millar-Blanchaer, Maxwell A. Millar-Blanchaer, Christian Marois, Christian Marois, Julien Rameau, Julien Rameau, Schuyler G. Wolff, Schuyler G. Wolff, Jacob Shapiro, Jacob Shapiro, Jean-Baptiste Ruffio, Jean-Baptiste Ruffio, Jérôme Maire, Jérôme Maire, Franck Marchis, Franck Marchis, James R. Graham, James R. Graham, Bruce Macintosh, Bruce Macintosh, S. Mark Ammons, S. Mark Ammons, Vanessa P. Bailey, Vanessa P. Bailey, Travis S. Barman, Travis S. Barman, Sebastian Bruzzone, Sebastian Bruzzone, Joanna Bulger, Joanna Bulger, Tara Cotten, Tara Cotten, René Doyon, René Doyon, Gaspard Duchêne, Gaspard Duchêne, Michael P. Fitzgerald, Michael P. Fitzgerald, Katherine B. Follette, Katherine B. Follette, Stephen Goodsell, Stephen Goodsell, Alexandra Z. Greenbaum, Alexandra Z. Greenbaum, Pascale Hibon, Pascale Hibon, Li-Wei Hung, Li-Wei Hung, Patrick Ingraham, Patrick Ingraham, Paul Kalas, Paul Kalas, Quinn M. Konopacky, Quinn M. Konopacky, James E. Larkin, James E. Larkin, Mark S. Marley, Mark S. Marley, Stanimir Metchev, Stanimir Metchev, Eric L. Nielsen, Eric L. Nielsen, Rebecca Oppenheimer, Rebecca Oppenheimer, David W. Palmer, David W. Palmer, Jennifer Patience, Jennifer Patience, Lisa A. Poyneer, Lisa A. Poyneer, Laurent Pueyo, Laurent Pueyo, Abhijith Rajan, Abhijith Rajan, Fredrik T. Rantakyrö, Fredrik T. Rantakyrö, Adam C. Schneider, Adam C. Schneider, Anand Sivaramakrishnan, Anand Sivaramakrishnan, Inseok Song, Inseok Song, Rémi Soummer, Rémi Soummer, Sandrine Thomas, Sandrine Thomas, J. Kent Wallace, J. Kent Wallace, Kimberly Ward-Duong, Kimberly Ward-Duong, Sloane J. Wiktorowicz, Sloane J. Wiktorowicz, } "Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey," Journal of Astronomical Telescopes, Instruments, and Systems 4(1), 018002 (18 January 2018). https://doi.org/10.1117/1.JATIS.4.1.018002 . Submission: Received: 18 September 2017; Accepted: 18 December 2017
Received: 18 September 2017; Accepted: 18 December 2017; Published: 18 January 2018

Back to Top