Video transmission over Internet or wireless channels usually suffers from network congestion. However, for transmission of video coded by Motion JPEG 2000 (MJP2), the effect of network congestion can be greatly moderated by exploiting the progressive transmission. When network congestion occurs, data packets representing detailed information will be dropped selectively, and this will lead to degradation of image quality in the corresponding frames. In this paper, we present an algorithm to enhance the image quality of the degraded frames by utilizing inter-frame correlation. For a degraded frame, its detailed information is recovered from the previously decoded frame. Simulation results show that both the objective and visual quality of these frames are greatly improved.