The Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) is a special quasi-meridian reflecting Schmidt telescope that is installed with 4000 optical fibers, and these fibers should precisely align the celestial target when the astronomical observation is performing. Hence, it is necessary to kwon the precise position of the fiber end for tracking the celestial target. The existence of various error sources can affect the process of camera calibration and measurement, causing the measurement results to be less accurate than expected. In order to acquire the precise position of the fiber end on the focal plane of LAMOST, a novel algorithm for fiber end positioning based on the bundle adjustment and laser tracker is proposed in this paper. We also need reduce some error sources. The bundle adjustment algorithm applied in the paper has been implemented with special emphasis on accuracy and performance efficiency. The preliminary results show that this new bundle adjustment algorithm can achieve better accuracy than conventional calibration method. The precision error of fibers position is less than 17μm on the plane of the mechanical structure movement.