Texture description is a challenging problem with color images. Despite some attempts to include colors in local binary patterns (LBPs), no proposal has emerged as a color counterpart of grayscale LBPs. This is because colors are defined by vectors that are not naturally ordered and several ways exist to compare them. We propose an LBP extension that takes the vector information of color into account due to a color order. As several color orders are available and the selection of the most suitable one is difficult, we combine two of them in a texture descriptor called “mixed color order LBPs.” This small-size feature provides good performance on several benchmark databases for two classification problems with regard to larger-size LBP-based features of color textures.