A general purpose interactive pattern anal-sys and image display system has been developed for medical applications. The system consists of a PDP 11/70 under RSX 11/M operating system, a drum scanner and a TV camera input subsystems, an interactive color image display, and some other special peripherals. It can process nearly all types of patterns that we encounter in medical research except dynamic image sequence such as cineangiograms. The system has been developed through versatile requirement from clinical collaborators. After the usefulness of the system for the image analysis was approved, the system has been extended to geo-health data display in an epidemiological study and also to molecular imagery in pharmacological applications. Based on these past experience a revised plan of the system, which will overcome the shortcoming of the present system is on going.