The popularity of the Internet results in tremendous impact to our society. In this paper, we integrate state of the art technologies, such as image segmentation and multimedia transmission in the design and implementation of a networked control system. To illustrate the whole design concept, a test platform is established. The controlled end of the test platform includes I/O, A/D and D/A channels, and CCD cameras. The controller can be allocated at the other end on the Internet. We perform the developed real time image segmentation scheme in the controlled end to capture the trajectory of target object. This information is transmitted back to the controller end for further processing, and then the control signals are transmitted back to the controlled end. The proposed system architecture is of benefits in many areas, e.g., remote device control, intelligent home services, and visual surveillance systems.