This paper discusses the Human Factors or Ergonomic considerations related to the manual control of an optical line of sight. The general concept of the human operator as an element in the servo loop is presented, along with some examples of how this concept has been used in the design of optical tracking devices. "Aided Tracking" is described. Comparisons are made between commonly used force and displacement joysticks. Bibliographical references are provided.