The scheme proposed combines an existing image interpolation algorithm with an artificial neural network (ANN) used to model the residual errors between the interpolated image and the respective original image. Mathematical analysis shows that the performance of the proposed method is superior to that of known single-frame interpolation algorithms. The image restoration results using the presented scheme indicate that the restored images are very similar to the real high-resolution images. We also illustrate that the performance of any single-frame interpolation algorithm can be enhanced by combining the interpolation algorithm into our scheme. Experimental results show the proposed method on generalization and computation complexity is superior to other neural network schemes.