This paper outlines a new technique for processing structural color texture image to obtain textural units at multiple structural layers. The multi-layered color texture unit segmentation and feature abstraction allows for efficient structural texture classification and synthesis. In the three-phase process, color texture is first quantized and transformed into a grey-scale texture image. An efficient procedure for color feature clustering using PAM is introduced. In the second pahse, the global statistical features of texture are used to determine the texture unit size and the spatial relationship between the texture units in a periodic texture pattern. Finally, for texture units with internal structures, multi-layered segmenter is developed to separated these internal structures at different layers. Feature extraction and synthesis can be conducted at these multiple layers.