In order to obtain quantitative phase distributions from interferograms, phase retrieval composed of phase extracting and unwrapping is adopted in quantitative interferometric microscopy. However, phase unwrapping often requires a long time, limiting applications such as high-speed phase observations and measurements. In order to accelerate the processing speed, a phase unwrapping free Hilbert transform (HT)-based phase retrieval method is proposed. Though another background interferogram without a sample is needed, phase unwrapping can be omitted, saving a large amount of time for phase recovery. Additionally, the proposed HT-based method can maintain more sample details, thus providing high-accurate quantitative phase imaging. Considering its fast speed and high accuracy in phase retrieval, it is believed that the unwrapping free HT-based phase retrieval method can be potentially applied in high throughput cellular observations and measurements.