4 May 2018 Can multimodal sensing detect and localize transient events?
Kasthuri Jayarajah, Vigneshwaran Subbaraju, Noel Athaide, Lakmal Meeghapola, Andrew Tan, Archan Misra
Author Affiliations +
With the increased focus on making cities “smarter”, we see an upsurge in investment in sensing technologies embedded in the urban infrastructure. The deployment of GPS sensors aboard taxis and buses, smartcards replacing paper tickets, and other similar initiatives have led to an abundance of data on human mobility, generated at scale and available real-time. Further still, users of social media platforms such as Twitter and LBSNs continue to voluntarily share multimedia content revealing in-situ information on their respective localities. The availability of such longitudinal multimodal data not only allows for both the characterization of the dynamics of the city, but also, in detecting anomalies, resulting from events (e.g., concerts) that disrupt such dynamics, transiently. In this work, we investigate the capabilities of such urban sensor modalities, both physical and social, in detecting a variety of local events of varying intensities (e.g., concerts) using statistical outlier detection techniques. We look at loading levels on arriving bus stops, telecommunication records and taxi trips, accrued via the public APIs made available through the local transport authorities from Singapore and New York City, and Twitter/Foursquare check-ins collected during the same period, and evaluate against a set of events assimilated from multiple event websites. In particular, we report on our early findings on (1) the spatial impact evident via each modality (i.e., how far from the event venue is the anomaly still present), and (2) the utility in combining decisions from the collection of sensors using rudimentary fusion techniques.
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Kasthuri Jayarajah, Vigneshwaran Subbaraju, Noel Athaide, Lakmal Meeghapola, Andrew Tan, and Archan Misra "Can multimodal sensing detect and localize transient events?", Proc. SPIE 10635, Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX, 106351A (4 May 2018); Logo
Cited by 5 scholarly publications.
Get copyright permission  Get copyright permission on Copyright Marketplace

Data fusion


Sensor fusion




The Autonomous Helicopter System
Proceedings of SPIE (June 14 1984)
Symbolic Fusion Of MMW And IR Imagery
Proceedings of SPIE (January 05 1989)
Scene recognition with audio-visual sensor fusion
Proceedings of SPIE (March 28 2005)
Autonomous mobility for Demo III
Proceedings of SPIE (January 08 1999)
Multiresolutional Sensor Fusion By Conductivity Analysis
Proceedings of SPIE (March 01 1990)

Back to Top