Color is an important visual feature of images. However, a major drawback of color histogram is that it will loss spatial information and lead to false retrieval. In this paper, we present a "Back"-shape regional division approach and combine with pyramid histogram of orientated gradients (PHOG) to extract image edge features, termed refined edge histogram (REH). Moreover, the REH descriptor is applied to color image retrieval. Experimental results show that the proposed EDH are suitable for color image retrieval and has higher precision and recall compared to other existing methods.