Translator Disclaimer
Presentation + Paper
10 May 2019 Data column prediction: experiment in automated column tagging using machine learning
Author Affiliations +
Abstract
The lack of tools to rapidly identify and align data from different sources is a critical, needed capability for the Department of Defense especially when it comes to automated ingestion. In the current open source Karma Mapping Tool, the Steiner tree optimization algorithm suggests semantic types during data alignment. We hypothesize that Machine Learning (ML) may perform better than the Steiner approach on a subset of column types, or “labels”, where 1.) the data is extremely similar in structure and content and 2.) inferring column type correctly is highly dependent on the interrelated components of the dataset. In this session we discuss the experimental design, our initial results, and a path toward future work in broader applications beginning with intelligence analysis in the maritime domain. The initial results from this experiment show there is promise in using ML to do column prediction in analysis environments where there are many similar or overlapping data.
Conference Presentation
© (2019) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
S. McCabe, B. Cropp, J. Coles, J. Del Vecchio, and J. Ekstrum "Data column prediction: experiment in automated column tagging using machine learning", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 110060E (10 May 2019); https://doi.org/10.1117/12.2519305
PROCEEDINGS
8 PAGES + PRESENTATION

SHARE
Advertisement
Advertisement
RELATED CONTENT


Back to Top