Correction of distorted 3-D images for misalignment of an optical structure in a multiview 3-D display system

Yongjoon Kwon; Donghwan Kim; Sung-Kyu Kim

doi:10.1117/1.OE.57.6.061602

19 January 2018 Correction of distorted 3-D images for misalignment of an optical structure in a multiview 3-D display system

Yongjoon Kwon; Donghwan Kim; Sung-Kyu Kim

Author Affiliations +

Optical Engineering, 57(6), 061602 (2018). https://doi.org/10.1117/1.OE.57.6.061602

Abstract

For a multiview three-dimensional (3-D) display system using a two-dimensional (2-D) flat panel display, it is very important to attach accurately an optical plate such as a parallax barrier and a lenticular lens sheet onto a 2-D display panel for the best quality of 3-D images. In most practical cases, however, misalignment occurs since it is too difficult to align perfectly in assembly process. In general, angular misalignment results in the deterioration of 3-D image quality by some increase of crosstalk, so that the resulting 3-D images are even distorted as tilted ones. To correct distorted 3-D images, we propose a method to skew 3-D objects before each image for multiviews is taken by multiple cameras. For this, a formula is derived to determine the amount of skewing 3-D objects. And by using it, some experimental results are shown that distorted 3-D images in a misaligned multiview 3-D display system are completely corrected. Since skewing 3-D objects implies a coordinate transformation of 3-D space, this method can be also used in the manipulation of 3-D image data obtained from a depth camera in order to correct the distorted 3-D images caused by angular misalignment.

Kwon, Kim, and Kim: Correction of distorted 3-D images for misalignment of an optical structure in a multiview 3-D display system

1. Introduction

Among research on diverse three-dimensional (3-D) displays, there have been a lot of studies on the autostereoscopic 3-D display¹2.3.4.5.6.7.8.9.^–¹⁰ which provides multiview 3-D images. The basic principle of this multiview 3-D display is to provide more than two views by making each view spatially distributed within the viewing zone using an optical structure. Then, two different views among many views can enter into each pupil of an observer, so that the one can recognize 3-D images seen differently according to the observing position. Not only that but also a motion parallax can be provided from many different views along the horizontal direction of viewing zone. In order to provide different view images according to a position in the viewing zone, any type of optical plate such as a parallax barrier and a lenticular lens sheet is conventionally used by being attached onto a flat two-dimensional (2-D) display panel. Those optical plates play a role of controlling the light path so that many different views can be properly separated in the viewing zone at optimum viewing distance (OVD). That is how to have an observer able to recognize a 3-D scene from different images coming into each eye. For this, different color information corresponding to each view image should be assigned to subpixels on the flat panel display, for example, a 2-D LCD display. In general, such optical plates can be slanted to be attached onto the 2-D display panel. In this case, a group of subpixels on a line with a slanted angle is supposed to correspond to one of the multiview images.

Therefore, in order to make the images for each view spatially separated at OVD, an optical plate must be accurately attached to the 2-D display panel without any misalignment. Otherwise, 3-D image quality can be significantly degraded with some increased crosstalk. Practically, however, it is very hard to align the optical plate accurately to the 2-D display panel. In the process of assembly, the occurrence of some misalignment is very likely. To reduce 3-D image distortion in a misaligned 3-D display, there have been some studies¹¹12.13.^–¹⁴ that suggested some methods using an image processing to resolve the image quality problem from the mismatch of an optical plate.

In this paper, however, we propose an alternative correction method for distorted 3-D images caused by the misalignment of an optical plate without changing the pixel mapping of view number assigned to each subpixel for a designed angle. It will be shown that the correction can be done by simply skewing 3-D objects with appropriate angles according to the amount of misalignment. In the first section, it is introduced how the misalignment can result in the distortion of 3-D image. By analyzing the distortion phenomenon, the formula that determines a skewing angle to correct the distorted 3-D image is derived in the second section. In the next section, it will be shown with some examples that distorted 3-D images in a misaligned 3-D display are perfectly corrected with skewing angles given by the formula. In conclusion, we summarize our result with some comments.

2. Distortion Phenomenon of 3-D Images Caused by Angular Misalignment

Misalignment can be categorized into three cases which are the angular, axial, and lateral misalignments.¹⁵ The angular misalignment implies the mismatch between the designed and assembled angles of a slanted optical plate. The axial misalignment can occur when the assembled gap between the optical plate and 2-D display panel is different from the designed gap. The lateral misalignment comes from the vertical or horizontal translation of the optical plate. In general, the lateral misalignment results in shifting the viewing zone to the left or right from the center of the display. But it is relatively easy to correct that kind of misalignment. We can have a centered viewing zone by simply shifting a pixel mapping entirely with some proper amount. And the axial misalignment can result in a change of the OVD position, particularly for the barrier type of 3-D display. For the lenticular type of 3-D display, due to the mismatch between the focal length of lenticular lens and the gap the crosstalk can be increased, so that the 3-D image quality can be aggravated. However, this can be also controlled by using the gap glass with proper thickness. Compared to those misalignments, the angular misalignment has more something to do with 3-D image quality since it can happen very often in a manufacturing process and it is also difficult to resolve the 3-D image quality problem. It can not only deteriorate 3-D image quality from the increase of crosstalk but can also make the 3-D image remarkably distorted. Even though there could be some image processing¹¹12.13.^–¹⁴ to be able to make the 3-D images better by reducing some crosstalk, it is rather hard to completely fix the image quality problem since the mismatch of a mapping rule to subpixels has different amounts on the entire 2-D display. In this paper, we will only focus on the distortion phenomenon of 3-D images caused by the angular misalignment and suggest a method to correct the distorted 3-D images without changing a mapping rule on subpixels of a 2-D display. For this, let us first show an example about how 3-D images can be distorted by the (angular) misalignment. If there is no misalignment between an optical plate and a 2-D display panel, the 3-D image must be correctly expressed without any distortion as in Fig. 1(a). However, when there is some misalignment, the distortion phenomenon of 3-D image happens as in Fig. 1(b). As seen in Fig. 1, the distortion of the 3-D image by the misalignment appears as a tilted image. The reason why an object with some depth in 3-D images is tilted is because the misalignment makes 3-D images of different views seen at the same time even though the observer is at the OVD position of one view. Therefore, the objects become more tilted when not only the amount of misalignment but also the expressed depth increases. That is, the object with more disparity is more tilted. It can be also checked in Fig. 1 that the objects with different depths are tilted with different amounts. For the case of a well-aligned 3-D display, but not perfectly, as shown in Fig. 1(a), the 3-D image shows that the vertical sticks are all upright. In the case of a misaligned 3-D display, however, it is shown in Fig. 1(b) that all vertical sticks are not upright but tilted except for the stick with zero depth. Note that the tilted direction of objects is completely opposite depending on the sign of an expressed depth. In our convention, a negative depth means an object with a negative disparity, which is seen as located in front of the 2-D display panel.

Fig. 1

Example of a distorted phenomenon of 3-D image: the first stick from the left has $- 200 mm$ depth, the second one from the left has $- 100 mm$ depth, and the stick at the center has no depth, while the first stick from the right has $+ 200 mm$ depth and the second one from the right has $+ 100 mm$ depth. (a) Right expression of 3-D image in a well-aligned 3-D display and (b) distorted 3-D image in a misaligned 3-D display.

3. How to Correct Distorted 3-D Images

In order to correct the distortion of tilted 3-D images, it can be simply considered to skew 3-D objects in the opposite direction to the tilted one. For this, it is necessary to know how much the objects should be skewed and which parameters have something to do with the skewed amount of them. In this section, we will derive an equation which determines the amount of skewing an object, depending on the amount of misalignment and the depth of the object. Let us think more of the reason why 3-D images are tilted in detail. As mentioned before, because of the misalignment we are supposed to see not only the subpixels for a certain view but also the subpixels for different views at the same time even at OVD. Suppose that total view number is $N_{tot}$ and the optical plate is slanted with the angle $α$ as in Fig. 2. When the designed angle is $α$ , it can be generically expressed in terms of the vertical and horizontal number of subpixels as follows:

(1)

α = \tan^{- 1} (\frac{n a}{m b}) = \tan^{- 1} (\frac{n N_{h} a}{N_{tot} b}) = \tan^{- 1} (\frac{n N_{h} a}{N_{⊥} b}),

where

a

and

b

are the horizontal and vertical pitches of subpixels, respectively,

m

and

n

are integers in an irreducible rational number, and

N_{h}

represents the number of subpixels in the horizontal direction corresponding to a periodicity of an optical plate. In Fig. 3, if there is no misalignment, the maximum vertical distance

H

between two subpixels

A

and

B

both of which belong to the

p

’th view can be written as

H = b R

, where

R \equiv (⌈ \frac{h}{m} ⌉ - 1) m = (k - 1) m

with the vertical resolution

h

of a 2-D display and an integer

k

. In the case of misalignment with a misaligned angle

α^{'}

, however,

B

cannot be seen together with

A

at the same time any longer while a subpixel

C

for a different view is seen with

A

simultaneously. The subpixel

C

corresponds to the

(p - m Δ M)

’th view, where

Δ M

represents the (total) amount of the misalignment given by the number of subpixels from

B

to

C

. The sign of

Δ M

is taken as a positive when the misaligned angle is smaller than the designed one as in Fig. 3. Indeed, since all subpixels on the red line with the angle

α^{'}

do not correspond to the same view, an observer at the OVD position of the

p

’th view cannot help seeing subpixels corresponding to many different views at the same time. As a result, 3-D image could be distorted in the form of tilted one.

Fig. 2

Scheme for some parameters related to a designed angle and an assembled angle.

Fig. 3

Scheme for the definition of total misalignment amount $Δ M$ in a misaligned 3-D display.

Now, in order to find the skewed amount to correct the distortion of tilted 3-D images, let us consider a vertical line with a negative depth of which the two end points $A$ and $B^{'}$ corresponding to the same $p$ ’th view has the vertical distance $H$ in a 2-D display panel, as in Fig. 4(a). For simplicity, it is supposed that the natural number $k$ is satisfied with the condition, $k = k^{'} N_{h} + 1$ with a natural number $k^{'}$ . If the alignment is perfect, two subpixels $A$ and $B^{'}$ for the $p$ ’th view will be seen together at the OVD position of its view. But, when there are some misalignment $Δ M$ , not $B^{'}$ but $C^{'}$ corresponding to $(p - m Δ M)$ ’th view is seen together with $A$ at the same time, so that two subpixels being seen are not on the vertical line but on a tilted line. When the displacement of $C^{'}$ from $B^{'}$ is given by $x$ in a 2-D display panel, the resulting 3-D image is tilted as the red line in Fig. 4(a). For the case of a negative depth, the geometric relation between camera interval $l$ in 3-D space and the displacement $x$ on the 2-D display is described in Fig. 4(b) where the $X$ plane just represents the disparity zero plane of the 2-D display panel and the $X^{'}$ object plane indicates a sliced 2-D plane with a negative depth in the 3-D space. To obtain the corrected 3-D images, the $B^{'}$ point should be skewed in the opposite direction with the same amount of the displacement $x$ before rendering each 3-D image for all cameras. In other words, in Fig. 4(a) the $B^{'}$ point should be shifted to the left with $x$ amount in order to make it seen with A on a vertical line. That implies the line object on the $x^{'}$ object plane should be skewed with the amount of $x^{'}$ . However, since the displacement has different values according to the vertical position on the $X$ plane, it depends on the height of an object on the $X^{'}$ plane. Therefore, it is necessary to introduce an invariant quantity regardless of an object’s height. For this, the skewing angle $θ_{-}$ is introduced as represented in Fig. 5(a). Then, using the geometric relations in Fig. 4, the skewing angle can be obtained as

(2)

θ_{-} = \tan^{- 1} (\frac{x}{H}) = \tan^{- 1} (\frac{x}{b R}) = \tan^{- 1} [\frac{- l | d |}{b R (L - | d |)}] = \tan^{- 1} [\frac{m Δ M Δ C | d |}{b R (| d | - L)}],

where

L

is the distance from the 2-D display to the cameras at OVD,

l

is the distance between the

p

’th camera and the

(p - m Δ M)

’th camera, and

Δ C

is the interval of each camera. Since the

X^{'}

plane is just a projected plane of the

X

plane, the skewing angle

θ_{-}

is invariant in the

X

and

X^{'}

planes. Therefore, in order to correct the tilted 3-D image, an object on the

X^{'}

object plane in a certain depth should be skewed with the skewing angle determined by Eq. (2). In other words, the relation of the coordinate between two planes

X

and

X^{'}

can be just considered as some rescaling, even though the physical size of the two planes is different. So, the skewing angle

θ_{-}

can be applied to the

X^{'}

object plane without any change. Using the geometric relation between

X

and

X^{'}

planes of Fig. 5 and the relation (3) among

x

,

x^{'}

and

l

in Fig. 4(b)

(3)

x^{'} = \frac{(L - | d |)}{L} x and x = \frac{- l | d |}{L - | d |},

the fact that the skewing angle

θ_{-}

is just the same in

X

and

X^{'}

planes can be readily checked from

(4)

θ_{-} = \tan^{- 1} (\frac{m Δ M Δ C}{b R} \cdot \frac{- | d |}{L} \cdot \frac{L}{L - | d |}) = \tan^{- 1} (\frac{x^{'}}{H} \cdot \frac{L}{L - | d |}) = \tan^{- 1} (\frac{x^{'}}{H^{'}}) .

Fig. 4

Geometric scheme for the correction of the distorted 3-D image with a negative depth: (a) tilted phenomenon for an upright straight line and (b) geometric relation among the camera interval at the OVD position, $X$ plane on the 2-D display panel, and $X^{'}$ object plane with a negative depth in 3-D space.

Fig. 5

Geometric relation among the $X$ plane, $X^{'}$ object plane, and OVD position in 3-D space: (a) $X$ plane with no depth, (b) sliced object plane $X^{'}$ with a negative depth in 3-D space, and (c) side view of the $X$ and $X^{'}$ planes in 3-D space.

Likewise, we can also obtain a similar equation for the case of a 3-D object with a positive depth by using trigonometry. Therefore, regardless of the sign of depth, the skewing angle $θ$ for the correction of a distorted 3-D image can be finally obtained as follows:

(5)

θ = \tan^{- 1} (\frac{x}{H}) = \tan^{- 1} (\frac{x}{b R}) = \tan^{- 1} [\frac{l d}{b R (L + d)}] = \tan^{- 1} [\frac{m Δ M Δ C d}{b R (L + d)}],

where

d < 0

for a negative depth and

d > 0

for a positive depth. According to the sign of

θ

value, the skewed direction is determined as in Fig. 6. When it is positive, the object should be skewed counterclockwise, while it should be skewed clockwise for a negative value. If

θ

is zero, there is no need to be skewed, so that an object with no depth of zero disparity does not have to be corrected. Indeed, to skew objects in 3-D space with different angles according to their depths is nothing but to skew sliced planes with different depths normal to the depth direction of 3-D space with different skewing angles. Note that skewing does not mean a rotation, but a just coordinate transformation with different skewing angles depending on depths, which can be written as

(6)

x_{skew}^{'} = y^{'} \tan θ + x^{'} = y^{'} [\frac{m Δ M Δ C d}{b R (L + d)}] + x^{'}, and y_{skew}^{'} = y^{'},

where

(x^{'}, y^{'})

is a coordinate on a sliced

x^{'}

object plane with a depth

d

. Figure 6 schematically shows how the sliced object plane

x^{'}

should be skewed according to the coordinate transformation (6). The red parallelogram represents the skewed object plane.

Fig. 6

Skewed direction of a sliced object plane $X^{'}$ in 3-D space according to the sign of $θ$ value: (a) $θ > 0$ case and (b) $θ < 0$ case.

Now, let us comment on how to measure the amount of a misalignment $Δ M$ . Even though there must be various ways to find out how much an optical plate is misaligned, some examples about how to measure the amount of misalignment $Δ M$ are left in Appendix A. In summary, one method is to use the subpixels of a 2-D display as a coordinate. Basically, if two subpixels are seen together at the same time at a fixed position of OVD, the displacement between them in vertical and horizontal directions can be found in terms of the number of subpixels. Another way is to make use of the fact that the resulting 3-D images are tilted if there is some misalignment. So, the test patterns with some skewed images corrected for various $Δ M$ can be used. If a skewed image among those test patterns is upright as a corrected one, the corresponding misalignment $Δ M$ is nothing but the amount of the misalignment of the optical plate in a 3-D display. Alternatively, some test patterns made for various attached angles can be also used. Similarly, by finding the resulting 3-D image is not tilted but upright the actual attached angle of an optical plate can be easily found. Then the amount of the misalignment $Δ M$ can be obtained from the difference of the designed and assembled angles. Note that even if $Δ M$ is measured as not an integer but a rational number, Eq. (5) still holds.

4. Examples for Corrected 3-D Images through Experiments

In this section, we will show some experimental results that distorted 3-D images can be corrected with Eq. (5). To show some examples, a misaligned 3-D display of which the amount of the misalignment is $Δ M = + 14$ is used. The designed angle of the multiview 3-D display is $ArcTan (1 / 9)$ , which implies $m = 3$ and $n = 1$ in the form of Eq. (1). And the vertical pitch of the subpixel is $b = 0.158 mm$ and the vertical resolution of the 2-D display is 2160.

In Fig. 7 some vertical sticks with different depth are used as 3-D objects. Figure 7(a) represents distorted 3-D images because of the misalignment, so that the vertical sticks are seen tilted with different amounts according to the depth. By skewing the objects with different skewing angles, however, it can be shown in Fig. 7(b) that the tilted vertical sticks are all corrected and upright completely. The skewing angles for each object are obtained from Eq. (5).

Fig. 7

Example of correction of 3-D image in a misaligned 3-D display: the first object (stick) from the left is at $- 200 mm$ depth, the second one is at $- 100 mm$ depth, and the third one has no depth. The fourth one is at $+ 100 mm$ depth and the fifth one has $+ 200 mm$ depth. (a) Before correction and (b) after correction by skewing 3-D objects.

Another corrected example is shown in Fig. 8. Before correction, Fig. 8(a) represents the distortion of 3-D images in which it can be also checked that each card is tilted with different amounts on account of different depths. However, after the correction by skewing all 3-D objects with the determined angles from Eq. (5), it is shown in Fig. 8(b) that all the distorted 3-D images are completely corrected.

Fig. 8

Example of correction of 3-D image in a misaligned 3-D display: The 11 cards have all different depths from $- 200$ to $+ 200 mm$ with 40 mm depth gap in order. So, card number 1 has $- 200 mm$ depth, card 6 has no depth, and card 11 has $+ 200 mm$ depth. The background picture is located at $+ 250 mm$ depth. (a) Before correction and (b) after correction by skewing 3-D objects.

The other example for the correction of some other figures is shown in Fig. 9. Even though circles are used as 3-D objects, it appears as ellipses because of the misalignment. In Fig. 9, it is shown that the distorted 3-D images as ellipses are all corrected as exact circles.

Fig. 9

Example of correction of 3-D image in a misaligned 3-D display: the left one has $- 220 mm$ depth, the center one has no depth, and the right one has $+ 220 mm$ depth. (a) Before correction and (b) after correction by skewing 3-D objects.

5. Conclusion

In this paper, an alternative method to correct distorted 3-D images has been suggested. Since the resulting tilted 3-D images as distortion are attributed to the misalignment of the optical plate on a 2-D LCD display panel, they can be corrected by skewing 3-D objects in the opposite direction to tilted ones, without changing a mapping rule. To determine the amount of skewing angles for the correction of distorted 3-D images, we have derived the formula depending on the amount of misalignment and the depth of objects. By using the formula we have showed that the distorted 3-D images can be corrected by skewing the 3-D objects with different angles according to their depths when they are rendered by multiple cameras. With some examples, it has been shown that the skewed objects can be expressed correctly in a misaligned multiview 3-D display. In other words, if the 3-D space is skewed with some proper amount according to the depth, the distortion of 3-D image can be completely corrected. Practically, since skewing 3-D space is nothing but a coordinate transformation of the 3-D space, distorted 3-D image in a misaligned 3-D display can be also corrected by manipulating 3-D image data obtained from a depth camera. This method to skew 3-D space according to depth can resolve the problem of distorted 3-D images by angular misalignment regardless of no matter how much the misalignment occurs, which implies that it is not needed to align perfectly an optical structure in a multiview 3-D display system. However, since angular misalignment can have an influence on the formation of viewing zone, too much misalignment can lead to the reduction of the viewing zone.

In order to check how well distorted 3-D images are corrected, the tilted image with a certain depth can be compared to the image with zero depth since the zero-depth image is not distorted by the misalignment. If they are observed parallel, it can be considered that the distorted image is corrected completely up to the perceptual limit. Since the image with more depth is tilted more, the image with enough depth can facilitate checking the level of correction unless the 3-D image quality degraded by some crosstalk due to depth expression impedes the observation. Since the tilted images can be perfectly corrected and upright with the exact skewing angles theoretically given through the accurate measurement of misalignment, unparalleled results can imply the inaccurate measurement of the misalignment. There could be various ways to measure quantitatively how parallel they are. As a simple example, by drawing lines along the images from the taken pictures what can be checked is how much they are unparalleled. To decide the parallelism more objectively, however, it might be needed to find another method to assess quantitatively how well distorted 3-D images are corrected. Since the correction of tilted 3-D images in a misaligned multiview 3-D display has been performed in this paper by skewing 3-D objects in 3-D space, the environment where each image for multiple cameras is rendered is not same so that the corrected output image is completely different to the original one. So, for the assessment on correction it could be inadequate to compare those two images with a typical image quality assessment metric such as structural similarity or peak signal-to-noise ratio. As mentioned, since it would rather be related to the accurate measurement of misalignment, the assessment on the accuracy of a measured misalignment would be able to reflect the level of correction more accurately in a quantitative way.

Appendices

Appendix:

Some Examples about How to Measure the Amount of Misalignment

As mentioned in the main text, the misalignment of an optical plate, such as a parallax barrier or a lenticular lens sheet, to a 2-D display panel can cause the distortion of 3-D images as tilted images. The more misaligned it is, the more distorted the 3-D images are. To correct them, a method to skew 3-D objects in the opposite direction to tilted ones has been suggested. For this, skewing angle [Eq. (5)] has been introduced and derived. To obtain the value of the skewing angle, the amount of the misalignment of a 3-D display should be found. It can be described with a quantity $Δ M$ which represents how much it is misaligned in terms of the number of subpixels, as explained in the main text. As examples, some methods to measure the amount of the misalignment $Δ M$ will be explained below.

Suppose that the optical plate is misaligned with an assembled angle $α^{'}$ different to the designed slanted angle $α$ as represented in Fig. 10 where the points indicate the centers of subpixels. In general, the designed slanted angle can be written as $α = \tan^{- 1} (z / y) = \tan^{- 1} (\frac{n a}{m b})$ , where $n / m$ is an irreducible rational number with integers $m$ and $n$ , and the horizontal and vertical subpixel pitches are $a$ and $b$ , respectively.

Fig. 10

Scheme for the measurement of amount of misalignment.

In Fig. 10, when $A$ and $B$ subpixels correspond to the same view, without any misalignment both subpixels can be seen simultaneously at the OVD position of the corresponding view. However, if there is some misalignment, the two subpixels are not seen at the same time any more. In this case, the assembled angle can be obtained by finding the subpixel $C$ which is seen together with $A$ at the same time. As in Fig. 10, when the distance between subpixels $B$ and $C$ is $a Δ n$ , the assembled angle $α^{'}$ can be written as

(7)

α^{'} = \tan^{- 1} (\frac{z^{'}}{y}) = \tan^{- 1} (\frac{z - a Δ n}{y}) = \tan^{- 1} (\frac{n^{'} a}{m^{'} b}),

where

y

and

z^{'}

are vertical and horizontal lengths between

A

and

C

, respectively. Note that the term

n^{'} / m^{'}

in Eq. (7) is not an irreducible rational number. Then the amount of the total misalignment

Δ M

can be obtained as

(8)

Δ M = R \frac{Δ n}{m^{'}},

where

R \equiv (⌈ \frac{h}{m} ⌉ - 1) m = (k - 1) m

. And

H = b R

is the maximum vertical length between subpixels with the same view on the designed angle in the 2-D display panel. Also, multiple points can be used to check the attached angle with the same way as mentioned above.

As another example to find out the assembled angle, a test pattern including some objects such as vertical sticks with a certain depth can be used. If the optical plate of a 3-D display is misaligned, it can be observed that the resulting 3-D image is not upright but tilted. If the skewed images corrected for various $Δ M$ from Eq. (5) are prepared in advance, the misalignment $Δ M$ can be also found by checking which 3-D image becomes upright. For example, from Fig. 11, it can be checked that the misalignment of that 3-D display is $Δ M = + 2$ .

Fig. 11

Example of the measurement of misalignment in a 3-D display [left stick has zero depth and right stick has some negative depth ( $d = - 300 mm$ )]: (a) before correction, (b) correction for $Δ M = + 1$ , and (c) correction for $Δ M = + 2$ .

Alternatively, test patterns including some objects such as vertical sticks with some depths for various slanted angles can be used as well. Since the designed angle $α$ can be given as

(9)

α = \tan^{- 1} (\frac{n a}{m b}) = \tan^{- 1} (\frac{n_{0} a}{R b}),

where

n_{0} \equiv n R / m

. It can be possible to check the 3-D image result with different number

s

from the value of

n_{0}

. As an example,

s

could be

n_{0} + q

with

q = \pm 1, \pm 2, \dots

However, it is not necessary that

q

is an integer. While the 3-D images for the designed angle are tilted on account of some misalignment

Δ M

, the 3-D images corresponding to an assembled angle will be not tilted but upright. Therefore, once the 3-D images not tilted are found through some trial and error, the corresponding angle is nothing but a practically assembled angle. In other words, when the upright 3-D images correspond to the angle with

s = s_{0}

, the amount of the misalignment is

Δ M = n_{0} - s_{0}

.

Acknowledgments

This work was supported by “The Cross-Ministry Giga KOREA Project” grant funded by the Korea government (MSIT) [No. GK17D0200, Development of Super Multi-View (SMV) Display Providing Real-Time Interaction]. YK thanks Mr. Arbin Aquino Sangalang for the aid to the concretization of this work some time ago.

References

1. N. A. Dodgson, “Autostereoscopic 3D displays,” Computer 38(8), 31–36 (2005). http://dx.doi.org/10.1109/MC.2005.252 Google Scholar

2. J.-Y. Son, B. Javidi and K.-D. Kwack, “Methods for displaying three-dimensional images,” Proc. IEEE 94(3), 502–523 (2006).IEEPAD0018-9219 http://dx.doi.org/10.1109/JPROC.2006.870686 Google Scholar

3. J.-Y. Son and B. Javidi, “Three-dimensional imaging methods based on multiview images,” J. Disp. Technol. 1(1), 125–140 (2005).IJDTAL1551-319X http://dx.doi.org/10.1109/JDT.2005.853354 Google Scholar

4. S.-K. Kim et al., “Defragment image based autostereoscopic 3D displays with dynamic eye tracking,” Opt. Commun. 357, 185–192 (2015).OPCOB80030-4018 http://dx.doi.org/10.1016/j.optcom.2015.08.082 Google Scholar

5. B. Lee, “Three-dimensional displays, past and present,” Phys. Today 66(4), 36–41 (2013).PHTOAD0031-9228 http://dx.doi.org/10.1063/PT.3.1947 Google Scholar

6. J. Geng, “Three-dimensional display technologies,” Adv. Opt. Photonics 5(4), 456–535 (2013).AOPAC71943-8206 http://dx.doi.org/10.1364/AOP.5.000456 Google Scholar

7. J. Hong et al., “Three-dimensional display technologies of recent interest: principles, status, and issues,” Appl. Opt. 50(34), H87–H115 (2011).APOPAI0003-6935 http://dx.doi.org/10.1364/AO.50.000H87 Google Scholar

8. H.-J. Im et al., “Auto-stereoscopic 60 view 3D using slanted lenticular lens arrays,” J. Inf. Disp. 8(4), 23–26 (2007).JSIDE80734-1768 http://dx.doi.org/10.1080/15980316.2007.9652042 Google Scholar

9. T. Okoshi, Three-Dimensional Imaging Techniques, Academic Press, New York (1976). Google Scholar

10. Y. Takaki and N. Nago, “Multi-projection of lenticular displays to construct a 256-view super multi-view display,” Opt. Express 18(9), 8824–8835 (2010).OPEXFF1094-4087 http://dx.doi.org/10.1364/OE.18.008824 Google Scholar

11. Y.-G. Lee and J. B. Ra, “Image distortion correction for lenticula misalignment in three-dimensional lenticular displays,” Opt. Eng. 45(1), 017007 (2006). http://dx.doi.org/10.1117/1.2159012 Google Scholar

12. Y.-G. Lee and J. B. Ra, “New image multiplexing scheme for compensating lens mismatch and viewing zone shifts in three-dimensional lenticular displays,” Opt. Eng. 48(4), 044001 (2009). http://dx.doi.org/10.1117/1.3116705 Google Scholar

13. H. Hwang, H. S. Chang and I. S. Kweon, “Local deformation calibration for autostereoscopic 3D display,” Opt. Express 25(10), 10801 (2017).OPEXFF1094-4087 http://dx.doi.org/10.1364/OE.25.010801 Google Scholar

14. Y.-G. Lee and J. B. Ra, “A fast image multiplexing method robust to viewer’s position and lens misalignment in lenticular 3D display,” Proc. SPIE 6055, 60550M (2006).PSISDG0277-786X http://dx.doi.org/10.1117/12.642504 Google Scholar

15. J. Kim et al., “Calibration method for the panel-type multi-view display,” J. Opt. Soc. Korea 19(5), 477–486 (2015).1226-4776 http://dx.doi.org/10.3807/JOSK.2015.19.5.477 Google Scholar

Biography

Yongjoon Kwon is a researcher at Korea Institute of Science and Technology. He received his BS degree in physics from Kyung Hee University in 1998, his MS degree in physics from Korea Advanced Institute of Science and Technology in 2000, and his PhD in theoretical physics from Kyung Hee University in 2010. He worked as a researcher at Sogang University and Kyung Hee University for three and a half years, and at Samsung Electronics Co., Ltd. for a little over 2 years.

Donghwan Kim is a fourth-year student in the Nano-Physics Department at Gachon University and a student-researcher at Korea Institute of Science and Technology.

Sung-Kyu Kim is a principal researcher at Korea Institute of Science and Technology. He received his BS, MS, and PhD degrees from the Quantum Optics Group of Physics at Korea University in 1989, 1991, and 2000, respectively. He worked as an invited researcher at the 3-D TV Group of Telecommunications Advancement Organization in Japan for 2 years. His research interests include optical design of 3-D display system, super multiview display, multiview image processing, and multifocus 3-D display.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation Download Citation

Yongjoon Kwon, Donghwan Kim, Sung-Kyu Kim, "Correction of distorted 3-D images for misalignment of an optical structure in a multiview 3-D display system," Optical Engineering 57(6), 061602 (19 January 2018). https://doi.org/10.1117/1.OE.57.6.061602 Submission: Received 6 September 2017; Accepted 29 December 2017

Submission: Received 6 September 2017; Accepted 29 December 2017

Access the abstract

JOURNAL ARTICLE
7 PAGES

DOWNLOAD PDF + SAVE TO MY LIBRARY