In this paper, a new approach to multi-objects motion segmentation in image sequence based on cellular neural networks (CNN) is proposed. As the core ofthis approach, difference merged image algorithm is presented. In order to realize the algorithm, the reverse CNN template, the addition CNN template, the patch-filled CNN template and the composition CNN template are presented and designed. For based on CNN, this approach can improve the capability of real-time in motion segmentation. And on the other hand, because difference merged image algorithm we improved is directly used in gray-scale image processing instead of in binary image processing, it can get more information of motion and increase the accuracy of segmentation. Finally, we show the experiment results, which prove that this approach has a good capability in multi-objects motion segmentation.