The measurement of holes in the engine block top surface determines the general coupling effect of the engine. All of these holes are strictly restricted by the requirements of the dimensional tolerance and the geometrical tolerance, which determines the final engine quality. At present, these holes are measured mostly by the coordinate measuring machine (CMM) in the production line, and meeting the industry demands of automation, rapidity, and online testing with the method is difficult. A new rapid solution measuring the holes in the engine block top surface is proposed, which is based on the combination of multiple visual sensors. The flexible location method of the block is designed, and the global data fusion model based on multiple visual sensors is studied. Finally, the unified correction model of the lens distortion and the system inclination is proposed, and a revised system model with more precision is researched. The CMM measures the holes sizes and the spatial relationship between holes, and the data obtained are substituted into the global data fusion model to complete the system on-site rapid calibration. The experimental results show that the scheme is feasible. The measurement system can meet the production line needs of intelligence, rapidity, and high precision.