20 August 1993 Grounding language in perception
Author Affiliations +
Proceedings Volume 2055, Intelligent Robots and Computer Vision XII: Algorithms and Techniques; (1993) https://doi.org/10.1117/12.150137
Event: Optical Tools for Manufacturing and Advanced Automation, 1993, Boston, MA, United States
We describe an implemented computer program that recognizes the occurrence of simple spatial motion events in simulated video input. The program receives an animated line-drawing as input and produces as output a semantic representation of the events occurring in that movie. We suggest that the notions of support, contact, and attachment are crucial to specifying many simple spatial motion event types and present a logical notation for describing classes of events that incorporates such notions as primitives. We then suggest that the truth values of such primitives can be recovered from perceptual input by a process of counterfactual simulation, predicting the effect of hypothetical changes to the world on the immediate future. Finally, we suggest that such counterfactual simulation is performed using knowledge of naive physical constraints such as substantiality, continuity, gravity, and ground plane. We describe the algorithms that incorporate these ideas in the program and illustrate the operation of the program on sample input.
© (1993) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jeffrey Mark Siskind "Grounding language in perception", Proc. SPIE 2055, Intelligent Robots and Computer Vision XII: Algorithms and Techniques, (20 August 1993); doi: 10.1117/12.150137; https://doi.org/10.1117/12.150137


Using logic in a model-based approach to object recognition
Proceedings of SPIE (January 31 1992)
Color segmentation using MDL clustering
Proceedings of SPIE (January 31 1991)
Simulation tool for flexible manufacturing system
Proceedings of SPIE (January 31 1992)
Shape From Symmetry
Proceedings of SPIE (February 28 1990)
Image Compression In Orthogonal Spline Space
Proceedings of SPIE (March 26 1989)

Back to Top