A new method for fabric defect detection is proposed. It is based on the filter group containing four annular Gaussian band-pass filters and aimed at detecting defects in fabrics with plain and twill structures. A fabric sample image is processed by using this filter group and the filtered images are obtained. These filtered images are binarized and fused in order to reconstruct the defect binary image that distinguishes defects from texture background. In the performance evaluation and comparison experiments, this method is applied to a variety of fabrics with various defects. Experiment results have confirmed this method has good real time performance and is effective in fabric defect detection.