Phase diversity speckle (PDS) is an image restoration technique which is based on the idea of phase diversity (PD). It uses multi-frame short-exposure image sequence to calculate their corresponding wave-front information. Each image pair consists of two images collected by two cameras at the same time with one in focus and the other with known defocus value. Multi-frame processing can significantly improve the target signal to noise ratio (SNR), and decrease noise influence. In this paper, based on the principle of pupil Fourier imaging, by adjusting the pupil size, we get different scales of the optical point spread function (PSF). Also, we analysis different camera noise distribution channels, location differences and other factors to improve the processing speed of image restoration. In the indoor environment, we build optical platform, and use multi-frame phase diversity speckle to make experiment under different turbulence conditions. The experimental results show that with the camera size of 128×128 pixels, the image restoration effect is close to the diffraction limit.