In this paper, a real-time eye tracking technology for the adaptive human-computer interaction has been introduced. The principle of system adaptability is presented, and the system architecture is also described. The adaptive system can segment the interesting eyes' area in jittering images through utilizing the digital image processing technologies, which involve image filter, edge enhance, feature extraction et al. Then, the ideal detection algorithm for the eye-gazing direction is put forward, and the revising approach for the head slight movement is given which can calculate relative position deviation between the Purkinje image and the pupil. The system can accurately distinguish among as many as nine dialog boxes arranged in a 3x3 matrix on the display screen. At the same time, the manipulation ofperipheral equipment based on this kind ofinterface through eye-gaze is discussed. The results of the experiments have been given. The system will be used widely for disabled people.