Data central's data aggregation service

Brent Miszalski; Simon J. O'Toole; James Tocknell; Lachlan Marnoch; Stuart D. Ryder

doi:10.1117/12.2642065

29 August 2022 Data central's data aggregation service

Brent Miszalski, Simon J. O'Toole, James Tocknell, Lachlan Marnoch, Stuart D. Ryder

Proceedings Volume 12189, Software and Cyberinfrastructure for Astronomy VII; 121892S (2022) https://doi.org/10.1117/12.2642065
Event: SPIE Astronomical Telescopes + Instrumentation, 2022, Montréal, Québec, Canada

Conference Poster

Abstract

Astronomers routinely have to collate heterogeneous observational data for one or several targets from a variety of online resources. Traditionally this process of data aggregation can be time consuming and error prone, especially if multiple telescope archives or data centres are searched individually. To streamline this task we have developed Data Central’s Data Aggregation Service (DAS), an interactive web application that leverages Aladin Lite to display images and catalogues resulting from multiple online service queries of a given target. The modern asynchronous Python design allows these queries to be sent simultaneously and individual results are quickly displayed as soon as they are received. The DAS also hosts Pipeline As a Web Service (PAWS) data reduction workflows that may be triggered on demand. The DAS can effectively unlock science from unreduced data in telescope archives and may help manage the massive data volumes expected from next generation facilities.

Citation Download Citation

Brent Miszalski, Simon J. O'Toole, James Tocknell, Lachlan Marnoch, and Stuart D. Ryder "Data central's data aggregation service", Proc. SPIE 12189, Software and Cyberinfrastructure for Astronomy VII, 121892S (29 August 2022); https://doi.org/10.1117/12.2642065

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available