This paper proposes a vector error diffusion method for smear artifact reduction in the boundary region. This artifact mainly results from a large accumulation of quantization errors. In particular, color bands with a smear artifact the width of a few pixels appear along the edges. Accordingly, to reduce this artifact, the proposed halftoning process excludes the large accumulated quantization error by comparing the vector norms and vector angles between the error-corrected vector and eight primary color patches. When the vector norm of the error corrected vector is larger than those of eight primary color patches, the quantization error vector is excluded from the quantization error distribution process. In addition, the quantization error is also excluded when the angle between eight primary color patches and error-corrected vector is large. As a result, the proposed method enables a visually pleasing halftone pattern to be generated by all three color separations into account in a device-independent color space and reduces smear artifact in the boundary regions.