21 May 2018 Preliminary research on focal plane calibration method in LAMOST based on flexible planar target
Author Affiliations +
Abstract
In the large sky area multiobject optical fiber spectroscopy telescope project, to capture the spectrum of a particular object, the optical fiber positioner must position the optical fiber end face to a specified location on the focal plane. The accuracy of the optical fiber positioner is guaranteed by feedback from photogrammetry. Photogrammetry accuracy is based on accurate calibration. However, given the complexities in the optical fiber focal plane and the optical fiber positioner, the accurate standard point is considerably difficult to obtain, which results in insufficient calibration accuracy. To solve this problem, a convenient calibration method based on the combination of small, planar targets is proposed. In this method, each optical fiber positioner positions the optical fiber to several designed locations, which are relatively accurate. These points form a high-precision, two-dimensional point array that can be used as the planar target. In this manner, each optical fiber positioner can be regarded as a small, high-precision planar target. All small, high-precision planar targets are assembled to form the flexible planar target, which is used for calibration. The experimental result indicates that this method is highly accurate and can be applied in focal plane calibration.
Wang, Zhu, Lu, Gu, and Zhai: Preliminary research on focal plane calibration method in LAMOST based on flexible planar target

1.

Introduction

Large sky area multiobject optical fiber spectroscopy telescope (LAMOST) is one of the world’s largest optical fiber spectroscopy telescopes, which are a kind of comprehensive, large-scale optical instrument used to record the spectrum of numerous stars.1 The LAMOST simultaneously observes and records the spectrum of 4000 stars through 4000 optical fibers, which are driven by high-precision optical fiber positioners on the focal plane. Each optical fiber positioner, which contains two noncoaxial motors, has two degrees of freedom. Each optical fiber positioner can also position the optical fiber anywhere within a 33-mm-diameter circular patrol region. In order to capture the spectrum of a particular object, the optical fiber positioner requires multiple iterations to position the optical fiber end face precisely to a target location in its corresponding patrol region. The required positioning accuracy of each optical fiber is σ40  μm. Position feedback and closed-loop control are necessary to compensate positioning errors. Therefore, the metrology of optical fiber position is mandatory. Photogrammetry is selected as the metrology technology in this research because of its ability to measure the position of numerous targets simultaneously. In photogrammetry, the calibration of the spatial relationship between the camera and the optical fiber on the focal plane is fundamental.

Given that the optical fiber positioners are densely distributed on the focal plane, additional control points cannot be placed. Researchers have developed several calibration methods. Liu et al.2 assumed that the center of the optical fiber positioners coincides with the center of the installation hole. The three-dimensional (3-D) coordinate of this hole under the global coordinate system is designed and known. The focal plane can be calibrated using the 3-D position of the installation hole. This method is feasible but does not take into consideration the assembly errors, which can lead to unacceptable calibration error. Fisher et al.3 installed the optical fiber positioners on a fixture containing several reference optical fibers in order to test the positioning accuracy of the optical fiber positioned. The reference optical fiber and the optical fiber to be tested are imaged by a camera to determine the position of the optical fiber. However, this method can only be used for offline detection; online testing does not allow the presence of a reference optical fiber. Other researchers also proposed several calibration methods for the optical fiber focal plane. For example, excellent calibration is achieved by upgrading the hardware of the camera.45.6.7.8 Some researches on the calibration of optical fiber focal plane were also conducted without taking into consideration the assembly error.910.11

To solve this problem, this article draws on the characteristic that optical fiber positioner can precisely carry out the relative displacement. In this method, each optical fiber positioner positions the optical fiber to 16 designed locations that are relatively accurate. These points form a high-precision, two-dimensional point array that can be used as the small, high-precision planar target. The proposed method does not use the absolute position of the optical fiber positioner, so the effect of assembly errors on the calibration is avoided. To calibrate the entire focal plane using these small planar targets, an improved calibration method based on flexible planar target (FPT) method is also proposed. Multiple small, high-precision targets are assembled to form the FPT, which is used as a large, planar target.1213.14.15.16.17

The remaining part of this paper is organized as follows: in Sec. 2, the camera model is described. Focal plane and small planar target models are presented in Sec. 3. Section 4 describes the calibration algorithm based on FPT method. Section 5 provides the experimental results. Finally, Sec. 6 concludes the paper.

2.

Camera Projection Model

Under linear assumption, the relationship between the point (u,v) under ca amera coordinate system and (X,Y,Z) under the world coordinate system satisfies the following equation:

(1)

[uv1]=s[FxβCx00FyCy00010][RT0T1][XYZ1]=s·A·[RT]·qW=H·qW.

In this equation, the homomorphic matrix H includes the nonzero scale factor s, intrinsic parameter A, and extrinsic parameter [RT]. Five parameters are used in intrinsic parameter A. Fx and Fy are the scale factors along the image axes u and v, and (Cx,Cy) is the principal point. Parameter β is the skew of the two image axes. [RT] represents the rotation matrix and the translation vector from the world coordinate frame to the camera coordinate frame.

Given the processing, installation, and other reasons, the camera lens is often distorted, and spatial projection does not strictly follow the perspective projection imaging model. Camera lens distortion can be classified as radial distortion, tangential distortion, centrifugal distortion, and thin prism distortion. The distortion model used in this paper is the Plumb Bob model.18 The distortion correction equation is as follows:

(2)

{xcorrected=(1+k1r2+k2r4+k5r6)*x+2k3xy+k4(r2+2x2)ycorrected=(1+k1r2+k2r4+k5r6)*y+2k4xy+k3(r2+2y2).

Suppose [xy]=[x˜CxFxy˜CyFy],r2=x2+y2, where (xcorrected,xcorrected) represent the corrected coordinates, (x,y) is the normalized image coordinate, (x˜,y˜) is based on the central perspective projection model given the ideal pixel, and k1k5 is the distortion factor.

3.

Focal Plane and Small Planar Target Model

The focal plane is a spherical crown with a diameter of 1.75 m and a curvature radius of 19.88. A total of 4000 optical fiber positioners uniformly plugged in the focal plane are shown in Fig. 1. As shown in Fig. 2, the Z-axis direction of the world coordinate system is the normal direction at point O of the focal plane. The XY plane coincides with the tangent plane at O point. The error of the optical fiber in the Z-direction is denoted as δZ, the error in the XY plane is δXY, and the error on the spherical surface of the focal plane is δS. According to the geometric relationship in Fig. 2, the following equations are obtained:

(3)

δZ=δSsinϕ0,

(4)

δXY=δScosϕδS.

Fig. 1

Physical map of the focal plane.

OE_57_5_054109_f001.png

Fig. 2

Focal plane error model.

OE_57_5_054109_f002.png

Given that angle φ is very small, we can assume that sinϕ0 and cosϕ1. Evidently, δZ0 and δXYδS. Therefore, the optical fiber end faces positioning error on the focal plane δS, which is mainly reflected in δXY. The Z-direction error δZ is negligible. Hence, the following error analysis is mainly the analysis on δXY.

In each observation, 4000 optical fiber positioners drive 4000 optical fibers, so each optical fiber is aligned with a single object. Each optical fiber positioner shows a double-swing mechanism, as shown in Fig. 3. The range of motion of an optical fiber positioner is a 33-mm-diameter circular area driven by two stepper motors. The distance between two adjacent optical fiber positioners is 25.6 mm, and an overlapping area exists between adjacent optical fiber positioners. This area ensures that the observation possesses no blind spots and improves the observation efficiency.

Fig. 3

Optical fiber positioner model.

OE_57_5_054109_f003.png

Given the increasingly sophisticated stepping motor hardware and software and the use of the piezoelectric ceramic drive instead of the traditional stepper motor applications, optical fiber positioner can precisely carry out the relative movement. Each optical fiber positioner performs precise relative movements for 16 times. Afterward, each optical fiber positioner can be considered a precision small planar target, as shown in Fig. 4. However, the absolute position between each small planar target is unknown due to the assembly error between the optical fiber positioner and the mounting hole on the focal plane.

Fig. 4

Small planar target model.

OE_57_5_054109_f004.png

4.

Calibration Principle

In this section, the conversion of each small planar target into FPT is introduced. Then, the calibration method based on FPT is also described in detail. Finally, the optimization model is proposed.

4.1.

Flexible Planar Target Model

According to Sec. 3, 4000 small, high-precision planar targets can be obtained from the entire focal plane. As shown in Fig. 5, the small planar target is densely distributed on the focal plane, and the small planar target 1 is selected as the reference datum target. The reference datum target coincides with the FPT. The m’th feature point on the n’th small planar target is marked as Xnm. The connection between and the optical center O intersects with the CCD plane at Xnm and the reference datum target plane at X˜nm. OXnm and OX˜nm are the collinear, that is, the projection relationship of OXnm and OX˜nm is consistent. X˜nm is the corresponding virtual point for Xnm. The virtual point X˜nm can be used instead of Xnm for calibration. Similarly, transforming all small planar targets into virtual targets creates the FPT.

Fig. 5

Schematic diagram of FPT model.

OE_57_5_054109_f005.png

The conversion of X˜nm by Xnm is described in the following. The process of obtaining FPT without losing generality will be described using two small planar targets. The small planar target 1 is selected as the reference datum target.

According to Eq. (1), the following equations are obtained:

(5)

xnm=sn·A·[RnTn]·Xnm,

(6)

xnm=s1·A·[R1T1]·X˜nm.

The integration of these equations is as follows:

(7)

X˜nm={s1·A·[R1T1]}1·{sn·A·[RnTn]}·Xnm=Un·Xnm,
where Un={s1·A·[R1T1]}1·{sn·A·[RnTn]}=H11·Hn, so that X˜nm can be obtained via the coordinates Xnm and homomorphic matrices Hn. Similarly, this method can be generalized to construct the FPT with multiple small planar targets.

4.2.

Calibration Based on FPT

According to Sec. 4.1, a large FPT can be obtained. This FPT is calibrated using the two-step method. In the first step, assuming that the camera is undistorted, the projection model is a linear model, such as that in Eq. (1). With establishment and solving over determined linear equations, the homomorphic matrix H can be calculated as follows:

(8)

xnm=H·X˜nm,H=[h1h2h3h4h5h6h7h8h9].

In the second step, with consideration of the distortion factor, we use the distortion model described in Sec. 2 to correct the effects of distortion. After the completion of these two steps, loop iteration is performed until the residual is minimal.

When Eqs. (7) and (8) are combined, the following equation is obtained:

(9)

xnm=H·Un·Xnm,
where H is a homomorphic matrix between the camera and the FPT, which can be obtained from Eq. (8). Un is the transformation matrix of the n’th subcalibration plate that can be obtained by Eq. (7). However, the obtained parameters are all initial values and require optimization. The above equation is not strictly satisfied, because there is an error δ

(10)

δ=xnmH·Un·Xnm=xnmx˜nm,
where X˜nm is the projection point of point Xnm, Xnm is the actual imaging point of point Xnm. The parameters must be optimized, and the detailed optimization method is discussed in Sec. 4.3. The optimized parameters H˜ and U˜n are obtained.

We can rewrite Eq. (9) as follows:

(11)

Xnm=U˜n1·H˜1·xnm.

When the calibration is completed, the U˜n and H˜ values can be obtained. The 3-D position Xnm of the optical fiber end surface can be calculated from the pixel coordinate Xnm according to the above equation.

4.3.

Optimization Model

According to the projection model Eq. (9) and the distortion model Eq. (2), the sum of the reprojection error between the projection point X˜nm and the actual imaging point xnm is optimized to a minimum. The sum of the reprojection error of all points on the FPT is as follows:

(12)

f(Z)=minn=1Nm=1Md2(xnm,x˜nm),
where N is the number of small planar targets in the field of view, and M is the number of feature point in each small planar target. The optimization parameter Z contains distortion coefficients k1k5, homomorphic matrix H, and transformation matrix U2Un. The nonlinear optimization problem is solved via the Levenberg–Marquardt algorithm.

5.

Experiments

To verify the calibration method proposed in this paper, several experiments were implemented. The experiments were carried out according to the following settings: (1) the camera focal length is 16 mm, (2) the image size is 1040  pixels×1040  pixels, (3) the field of view of the camera is about 350  mm×350  mm, (4) the measuring distance is about 400 mm, and (5) the camera intrinsic parameter matrix is A=[2963.40521.402964.2486.0001]. Furthermore, the distortion factors are k1=0.009, k2=0.241, k3=0.000427, k4=0.000744, and k5=0. This configuration is only used for validation experiments, not in actual measurement process. These parameters are the internal parameters of the camera, and they are obtained in precalibration experiments using Zhang’s algorithm and a precision calibration board. The precalibration obtained these parameters as initial values for optimization; the following experiments did not verify calibration accuracy with these parameters. The accuracy of the calibration method proposed in this paper is verified by solving the error between the measurement position obtained by this method and its true value (measured by a laser tracker).

As shown in Fig. 6, the experimental system is set up on an optical table. The system consists of a high-precision monochrome CCD camera, several optical fiber positioners, and a reduced scale model of the focal plane. The following experiments were carried out to study the effects of three factors on the calibration accuracy, including size of the FPT area, number of small targets, and number of points in each small target.

Fig. 6

Physical map of the experimental system.

OE_57_5_054109_f006.png

5.1.

Analysis on the Effects of the FPT Area on Calibration Accuracy

The FPT area is the smallest convex polygon that contains all small planar targets, as shown in Fig. 7. The following experiment explores the effects of the FPT area on calibration accuracy.

Fig. 7

Schematic diagram of the FPT area.

OE_57_5_054109_f007.png

In this experiment, nine optical fiber positioners were used, and each fiber positioner was subjected to 16 relative movements, then nine small, 4×4 planar targets were obtained. In other words, the FPT used in this experiment consists of nine small planar targets, and the number of feature points in each small planar target is 4×4. In order to explore the effects of the FPT area on calibration accuracy, in these experiments, the FPT area varies from 36  mm×36  mm to 120  mm×120  mm, respectively. We have calibrated the parameters H˜ and U˜n in different FPT areas, and the 3-D position Xnm of the optical fiber end surface can be calculated from the pixel coordinate Xnm according to Eq. (11) in different H˜ and U˜n. Due to image noise, lens distortion, inaccurate model errors, etc., the above-measured Xnm and its true value Xnm (detected by the laser tracker) have errors which are called backprojection error.

The backprojection errors of each point are shown in Fig. 8. Figure 9 presents the percentage of points that satisfy the backprojection error of less than 40 μm. In Fig. 9, the x-coordinate denotes the area of the FPT. It can be concluded from Fig. 9 that the small FPT area results in improved measurement result and vice versa. When each small planar target is distant from each other, the position of each small planar target becomes complex. Optimization may fall into the local optimal solution. Thus, the measurement accuracy decreases slightly.

Fig. 8

Backprojection error distribution [when the area of the FPT of (a) to (h) is 36  mm×36  mm to 120  mm×120  mm, respectively].

OE_57_5_054109_f008.png

Fig. 9

Effects of the FPT area on calibration accuracy.

OE_57_5_054109_f009.png

5.2.

Analysis on the Effects of the Number of Small Planar Targets on Calibration Accuracy

The effects of the number of small planar targets on the calibration accuracy are investigated under the condition that the FPT area and the number of feature point are the same. The following comparative experiment ensures that the FPT area is the same as that in Sec. 5.1 experiment: 48×48, 60×60, 72×72, 84×84, 96×96, 108×108, and 120×120. The number of feature points in each small planar target is 4×4. The number of small planar targets is increased to 16, which means that the use of 16 optical fiber positioners in the same area.

Figure 10 displays a ratio comparison to satisfy the backprojection error of <40  μm when the number of small planar targets is 9 and 16. When the number of small planar target increases to 16, the calibration accuracy slightly decreases. This result can be attributed to that when the number of small planar target increases, the parameters to be optimized also increase correspondingly. The difficulty in optimization also increases.

Fig. 10

Effects of the number of small planar targets on calibration accuracy.

OE_57_5_054109_f010.png

5.3.

Analysis on the Effects of the Number of Points in Each Small Planar Target on Calibration Accuracy

The area of the FPT and the number of small planar targets are the same circumstances, the influence of the number of feature points in each small planar target on the calibration accuracy is investigated. In comparison with the experiment in Sec. 5.1, the number of feature points in each small planar target is changed to 6×6, which means that each fiber positioner was subjected to 36 relative movements. The number of small planar targets is still 9, and the FPT areas are 60×60, 72×72, 84×84, 96×96, 108×108, and 120×120.

Figure 11 provides a comparison of the experiments in Secs. 5.1 and 5.3. The number of feature points in each small planar target increases to 36, and the calibration accuracy is improved. From the above experiment, it can be concluded that the effect of the number of feature points in each small planar target on camera calibration accuracy is more remarkable than that of the number of small planar targets and the FPT area. Thus, the number of feature points in each small planar target is the key consideration when FPT is used to calibrate the focal plane.

Fig. 11

Effects of the number of points in small planar target on calibration accuracy.

OE_57_5_054109_f011.png

6.

Conclusions

This paper presents a focal plane calibration method based on FPT. The use of the characteristic of optical fiber positioner can precisely carry out the relative displacement to avoid the influence of absolute position error, which is caused by the assembly error. This method considers each optical fiber positioner as a small planar target. All small planar targets feature points constitute an FPT. Subsequently, the FPT is used for calibration. The experiments proved the feasibility of using FPT calibration to satisfy the accuracy of 40  μm in the proportion of >85%. The effects of various factors on accuracy are also explored. Notably, the method used in this paper uses many nonlinear optimization methods during solving, and its operation time is much longer than those of traditional calibration methods. Future study should determine how to further improve the computational efficiency of this method, and the extension of this method into practical application of focal plane calibration still needs further study.

References

1. S.-G. Wang et al., “Special configuration of a very large Schmidt telescope for extensive astronomical spectroscopic observation,” Appl. Opt. 35(25), 5155–5161 (1996).APOPAI0003-6935 https://doi.org/10.1364/AO.35.005155 Google Scholar

2. Z.-G. Liu, J.-Z. Bao and S.-H. Tang, “Application of least squares fitting circle based on VC in LAMOST,” Mod. Manuf. Eng. 1, 94–95 (2008). Google Scholar

3. C. Fisher et al., “Developing engineering model Cobra optical fiber positioners for the Subaru telescope’s prime focus spectrometer,” Proc. SPIE 9151, 91511Y (2014).PSISDG0277-786X https://doi.org/10.1117/12.2054700 Google Scholar

4. S.-Y. Wang et al., “The metrology cameras for Subaru PFS and FMOS,” Proc. SPIE 8446, 84464Z (2012).PSISDG0277-786X https://doi.org/10.1117/12.925772 Google Scholar

5. S.-Y. Wang et al., “Metrology camera system of prime focus spectrograph for Subaru telescope,” Proc. SPIE 9147, 91475S (2014).PSISDG0277-786X https://doi.org/10.1117/12.2055787 Google Scholar

6. W. Saunders et al., “‘MOHAWK’: a 4000-optical fiber positioner for DESpec,” Proc. SPIE 8446, 84464W (2012).PSISDG0277-786X https://doi.org/10.1117/12.925724 Google Scholar

7. C. Fisher et al., “Cobra: a two-degree of freedom optical fiber optic positioning mechanism,” in IEEE Aerospace Conf., IEEE (2009). https://doi.org/10.1109/AERO.2009.4839435 Google Scholar

8. G. Smith et al., “A survey of fiber-positioning technologies,” Proc. SPIE 5495, 348–359 (2004). https://doi.org/10.1117/12.551004 Google Scholar

9. W. Li et al., “Calibration method with separation patterns of a single-camera,” Proc. SPIE 6269, 62695I (2006).PSISDG0277-786X https://doi.org/10.1117/12.662268 Google Scholar

10. Y. Gu et al., “A new method for measuring the position of the end of optical fibers for LAMOST,” Proc. SPIE 7014, 701444 (2008).PSISDG0277-786X https://doi.org/10.1117/12.788550 Google Scholar

11. Y. Jin et al., “Preliminary study on the measurement system for LAMOST small focal plane optical fiber positioning system,” Proc. SPIE 6269, 62693B (2006).PSISDG0277-786X https://doi.org/10.1117/12.670126 Google Scholar

12. L. Yu et al., “A calibration method based on virtual large planar target for cameras with large FOV,” Opt. Lasers Eng. 101, 67–77 (2018).OLENDN0143-8166 https://doi.org/10.1016/j.optlaseng.2017.10.003 Google Scholar

13. Z. Liu et al., “A novel and accurate calibration method for cameras with large field of view using combined small planar targets,” Measurement 64, 1–16 (2015).0263-2241 https://doi.org/10.1016/j.measurement.2014.11.027 Google Scholar

14. J. Kannala and S. S. Brandt, “A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses,” IEEE Trans. Pattern Anal. Mach. Intell. 28(8), 1335–1340 (2006).ITPIDJ0162-8828 https://doi.org/10.1109/TPAMI.2006.153 Google Scholar

15. J. Huo et al., “An on-line calibration method for camera with large FOV based on prior information,” Optik 126(15–16), 1394–1399 (2015). https://doi.org/10.1016/j.ijleo.2015.04.024 Google Scholar

16. F. Chen, G. M. Brown and M. Song, “Overview of 3-D shape measurement using optical methods,” Opt. Eng. 39(1), 10–22 (2000). https://doi.org/10.1117/1.602438 Google Scholar

17. S. Zhang and P. S. Huang, “High-resolution, real-time three-dimensional shape measurement,” Opt. Eng. 45(12), 123601 (2006). https://doi.org/10.1117/1.2402128 Google Scholar

18. D. C. Brown, “Decentering distortion of lenses,” Photogramm. Eng. Remote Sens. 32(3), 444–462 (1966). Google Scholar

Biography

Lianpo Wang is a master’s student in the Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China. He mainly engaged in the research of visual measurement, optical precision measurement, etc.

Biographies for the other authors are not available.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Lianpo Wang, Lianpo Wang, Ye Zhu, Ye Zhu, Xiang Lu, Xiang Lu, Yonggang Gu, Yonggang Gu, Chao Zhai, Chao Zhai, } "Preliminary research on focal plane calibration method in LAMOST based on flexible planar target," Optical Engineering 57(5), 054109 (21 May 2018). https://doi.org/10.1117/1.OE.57.5.054109 . Submission: Received: 5 March 2018; Accepted: 1 May 2018
Received: 5 March 2018; Accepted: 1 May 2018; Published: 21 May 2018
JOURNAL ARTICLE
7 PAGES


SHARE
Back to Top