Along with the maturity and development of Optical Fiber Bragg Grating (OFBG) sensing technology, OFBG sensors with different functions have been developed and applied in large-scale engineering structure health monitoring and construction monitoring. In this paper, an acceleration transducer with a characteristic of temperature self-compensating is introduced. It is a cantilever structure model with equal strength beam, fixed with a mass block at the end of the beam, and two consecutive OFBGs are pasted on the upper and lower surface axis of the beam at the corresponding places. Because of the two OFBGs are near to each other, the wavelength changes caused by the environment temperature is the same. According to the temperature self-compensating principle and acceleration measurement principle developed in this paper, we can achieve the temperature self-compensating function of real acceleration measurement by simply calculating the test results. The experimental results show that this type of acceleration transducer has high sensitivity and stability and its measuring range can also be changed according to the practical requirements. This type of acceleration transducer is suitable for engineering structure acceleration measurement in different environment conditions.