Apple quality grading is a critical issue in apple industry which is one economical pillar of many countries. Artificial grading is inefficient and of poor accuracy. Here we proposed to develop a portable, convenient, real-time, and low cost method aimed at grading apple. Color images of the apples were collected with a smartphone and the grade of sampled apple was assessed by a customized smartphone app, which offered the functions translating RGB color values of the apple to color grade and translating the edge of apple image to weight grade. The algorithms are based on modeling with a large number of apple image at different grades. The apple grade data evaluated by the smartphone are in accordance with the actual data. This study demonstrated the potential of smart phone in apple quality grading/online monitoring at gathering and transportation stage for apple industry.