In recent years, noninvasive, nonstaining, and nondestructive quantitative cell measurement techniques have become increasingly important in the medical field. These cell measurement techniques enable the quantitative analysis of living cells, and are therefore applied to various cell identification processes, such as those determining the passage number limit during cell culturing in regenerative medicine. To enable cell measurement, we developed a quantitative microscopic phase imaging system based on a Mach–Zehnder interferometer that measures the optical path length difference distribution without phase unwrapping using optical phase locking. The applicability of our phase imaging system was demonstrated by successful identification of breast cancer cells amongst normal cells. However, the cell identification method using this phase imaging system exhibited a false identification rate of approximately 7%. In this study, we implemented a polarimetric imaging system by introducing a polarimetric module to one arm of the Mach–Zehnder interferometer of our conventional phase imaging system. This module was comprised of a quarter wave plate and a rotational polarizer on the illumination side of the sample, and a linear polarizer on the optical detector side. In addition, we developed correction methods for the measurement errors of the optical path length and birefringence phase differences that arose through the influence of elements other than cells, such as the Petri dish. As the Petri dish holding the fluid specimens was transparent, it did not affect the amplitude information; however, the optical path length and birefringence phase differences were affected. Therefore, we proposed correction of the optical path length and birefringence phase for the influence of elements other than cells, as a prerequisite for obtaining highly precise phase and polarimetric images.