20 August 1993 Coping with delays for real-time gaze control: the fall and rise of the Smith "Predictor"
Author Affiliations +
Proceedings Volume 2059, Sensor Fusion VI; (1993) https://doi.org/10.1117/12.150264
Event: Optical Tools for Manufacturing and Advanced Automation, 1993, Boston, MA, United States
In this paper we describe how to cope with the delays inherent in a real time control system for a steerable stereo head/eye platform. A purposive and reactive system requires the use of fast vision algorithms to provide the controller with the error signals to drive the platform. The time-critical implementation of these algorithms is necessary, not only to enable short latency reaction to real world events, but also to provide sufficiently high frequency results with small enough delays that controller remain stable. However, even with precise knowledge of that delay, nonlinearities in the plant make modelling of that plant impossible, thus precluding the use of a Smith Regulator. Moreover, the major delay in the system is in the feedback (image capture and vision processing) rather than feed forward (controller) loop. Delays ranging between 40 msecs and 80 msecs are common for the simple 2D processes, but might extend to several hundred milliseconds for more sophisticated 3D processes. The strategy presented gives precise control over the gaze direction of the cameras despite the lack of a priori knowledge of the delays involved. The resulting controller is shown to have a similar structure to the Smith Regulator, but with essential modifications.
© (1993) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Paul M. Sharkey, Paul M. Sharkey, David W. Murray, David W. Murray, } "Coping with delays for real-time gaze control: the fall and rise of the Smith "Predictor"", Proc. SPIE 2059, Sensor Fusion VI, (20 August 1993); doi: 10.1117/12.150264; https://doi.org/10.1117/12.150264


Sign language for telemanipulation
Proceedings of SPIE (December 21 1995)
Flexible task-specific control using active vision
Proceedings of SPIE (April 30 1992)
Object-oriented vision for a behavior-based robot
Proceedings of SPIE (October 29 1996)
Nonanthropomorphic viewing for teleoperation
Proceedings of SPIE (August 20 1993)

Back to Top