Improving sensor data analysis through diverse data source integration

Jennifer Casper; Ronald Albuquerque; Jeremy Hyland; Peter Leveille; Jing Hu; Eddy Cheung; Dan Mauer; Ronald Couture; Barry Lai

doi:10.1117/12.819233

19 May 2009 Improving sensor data analysis through diverse data source integration

Jennifer Casper, Ronald Albuquerque, Jeremy Hyland, Peter Leveille, Jing Hu, Eddy Cheung, Dan Mauer, Ronald Couture, Barry Lai

Author Affiliations +

Proceedings Volume 7352, Intelligent Sensing, Situation Management, Impact Assessment, and Cyber-Sensing; 73520M (2009) https://doi.org/10.1117/12.819233
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

Daily sensor data volumes are increasing from gigabytes to multiple terabytes. The manpower and resources needed to analyze the increasing amount of data are not growing at the same rate. Current volumes of diverse data, both live streaming and historical, are not fully analyzed. Analysts are left mostly to analyzing the individual data sources manually. This is both time consuming and mentally exhausting. Expanding data collections only exacerbate this problem. Improved data management techniques and analysis methods are required to process the increasing volumes of historical and live streaming data sources simultaneously. Improved techniques are needed to reduce an analysts decision response time and to enable more intelligent and immediate situation awareness. This paper describes the Sensor Data and Analysis Framework (SDAF) system built to provide analysts with the ability to pose integrated queries on diverse live and historical data sources, and plug in needed algorithms for upstream processing and filtering. The SDAF system was inspired by input and feedback from field analysts and experts. This paper presents SDAF's capabilities, implementation, and reasoning behind implementation decisions. Finally, lessons learned from preliminary tests and deployments are captured for future work.

Citation Download Citation

Jennifer Casper, Ronald Albuquerque, Jeremy Hyland, Peter Leveille, Jing Hu, Eddy Cheung, Dan Mauer, Ronald Couture, and Barry Lai "Improving sensor data analysis through diverse data source integration", Proc. SPIE 7352, Intelligent Sensing, Situation Management, Impact Assessment, and Cyber-Sensing, 73520M (19 May 2009); https://doi.org/10.1117/12.819233

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available