24 September 2012 Design of LAMOST data processing and production database
Author Affiliations +
Abstract
Before LAMOST spectra release, raw data need to go through a series of processes, i.e. a pipeline after observed, including 2D reduction, spectral analysis, eyeball identification. It is a proper strategy that utilizing a database to integrate them. By using database the coupling between relative modules would be reduced to make the adding or removing of them more convenient, and the dataflow seems to be more clearly. The information of a specific object, from target selection to intermediate results and spectrum production, can be efficiently accessed and traced back through the database search, rather than via FITS reading. Furthermore, since the pipeline has not been perfected yet, the eyeball check is needed before the spectra are released, and an appropriate database can make the feedback period of eyeball check result more conveniently, thus the improvement of the pipeline will be more purposely. Finally, database can be a data mining tools for the statistics and analysis of massive astronomical data. This article focuses on the database design and the data processing flow built on it for LAMOST. The database design requirement of the existing routines, such as input/output, the relationship or dependence between them is introduced. Accordingly, the database structure suited for multiple version data process and eyeball verification is presented. The dataflow, how the pipeline is integrated relied on such a dedicated database system and how it worked are also explained. In addition, some user interfaces, eyeball check interfaces, statistical functions are also presented.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yanxin Guo, Yanxin Guo, Ali Luo, Ali Luo, Fengfei Wang, Fengfei Wang, Zhongrui Bai, Zhongrui Bai, Jian Li, Jian Li, } "Design of LAMOST data processing and production database", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 84512I (24 September 2012); doi: 10.1117/12.925959; https://doi.org/10.1117/12.925959
PROCEEDINGS
6 PAGES


SHARE
RELATED CONTENT

Web-based data providing system for Hyper Suprime-Cam
Proceedings of SPIE (August 06 2014)
Analysis framework for GLORIA
Proceedings of SPIE (November 07 2012)
Focas-Faint Object Classification And Analysis System
Proceedings of SPIE (May 03 1979)
The DIRP framework Flexible HPC based post processing of...
Proceedings of SPIE (September 24 2012)
Drift Scan Observations With A Charge-Coupled Device (CCD)
Proceedings of SPIE (November 16 1982)
Real time time variability analysis of GB to TB datasets...
Proceedings of SPIE (December 24 2002)

Back to Top