Translator Disclaimer
16 September 2004 SIP: a modern flexible data pipeline
Author Affiliations +
Abstract
IRAC, the Infrared Array Camera on the Spitzer Space Telescope, generated well over 150,000 images during the in-orbit checkout and science verification phase of the mission. All of these were processed with SIP, the SAO IRAC Pipeline. SIP was created by and for the members of the IRAC instrument team at the Smithsonian Astrophysical Observatory, to allow short-timescale data processing and rapid-turnaround software testing and algorithm modification. SIP makes use of perl scripting and data mirroring to transfer and manage data, a mySQL database to select calibration data, and Python/numarray to process the image data; it is designed to run with no user interaction. SIP is fast, flexible, and robust. We present some 'lessons learned' from the construction and maintenance of SIP, and discuss prospects for future improvement.
© (2004) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Pauline Barmby, Zhong Wang, Massimo Marengo, and Matthew L.N. Ashby "SIP: a modern flexible data pipeline", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); https://doi.org/10.1117/12.550468
PROCEEDINGS
7 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT

JWST science data products
Proceedings of SPIE (July 27 2014)
Data quality analysis at the Spitzer Science Center
Proceedings of SPIE (June 29 2006)
SIRTF science operations system
Proceedings of SPIE (March 04 2003)
Real time time variability analysis of GB to TB datasets...
Proceedings of SPIE (December 23 2002)

Back to Top