According to the characteristics of video sensor output, a method based on DSP (Digital Signal Processor) and VLSI (Very-Large Scale Integrated Circuit) memory is provided. Firstly, this paper introduces the signal characteristics of the video sensors, e.g. high-speed 2-D array charge coupled device and infrared image devices. Then the special requests are got to process and store video signals from the point of view of output speed and data capacity. In the sequence of the function modules of normal signal processing system, the pipeline cache, pre-process, smart trigger, dynamic storage, and permanence storage of signals or data are systematically explained. And to satisfy the need of video frequency process system, different devices and operation modes are determined for every module. Among these, the selection and performance request of DSP applied in video system, the characters of all kinds of memory, and the begotten problems when they are applied in the system are described in detail. Secondly, the interfaces that utilize video FIFO, great- capacity DRAM, and flash memory for permanence storage are emphasized. In the last design, the DMA (Direct Memory Access) page operation mode is presented in detail when DSP and flash memory are used. At the end of this paper, the methods by which the video signal process system communicates with computer are introduced.