Translator Disclaimer
24 September 2012 The DIRP framework: flexible HPC based post-processing of TB size datasets
Author Affiliations +
Abstract
The immense scale of data from modern radio interferometer arrays results in processing demands requiring HPC facilities to produce scientific results. However, in the modern era such facilities are more complex than a single monolithic HPC system. The transfer and processing of scientific data must be managed across hierarchies of storage and processing architectures; including traditional HPC, heterogeneous HPC, database and visualisation systems. The ICRAR Data Intensive Research Pathfinder (DIRP) will consist of an integrated system of the hardware, middleware, tools and interfaces to support ICRAR data intensive research primarily focused on data owing from the Australian SKA Pathfinder (ASKAP1) and the Murchison Widefield Array (MWA) telescopes.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Andreas Wicenec, Christopher J. Harris, Kevin Vinsen, and Peter J. Quinn "The DIRP framework: flexible HPC based post-processing of TB size datasets", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 84510X (24 September 2012); https://doi.org/10.1117/12.925261
PROCEEDINGS
10 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT


Back to Top