The grayscale frames interpolation problem is the process of creating intermediary grayscale frames between two given frames.1 The interpolated grayscale frame , , depends on the content of an input grayscale frame and an output grayscale frame. For , the interpolated grayscale frame is equal to the input grayscale frame ; for , the interpolated grayscale frame is equal to the output grayscale frame .2
The simplest method involves linear interpolation.3, 4 In Ref. 5, a dynamically elastic surface interpolation scheme was proposed. A hybrid approach that combined elastic interpolation, spline theory, and the surface consistency theorem was proposed to produce further improvement.6, 7 Grevera and Udupa8 and Herman 9 interpolated the distance and proposed shape-based methods by encoding the segmented image with distance codes. Guo developed a morphology-based interpolation method and successfully resolved the problems in objects with holes and large offsets.10 Lee proposed another morphology-based scheme that was simpler in computational complexity.11 Goshtasby selected feature points from successive frames to control the gray-level interpolation.12 In Ref. 13, feature points were used that were based on a fuzzy measure of the boundaries and medial axis transforms. In Ref. 14, a morphological skeleton interpolation was proposed in which interpolated sets were generated from a succession of skeletons derived from the matching of two neighboring set skeletons. Berier and Neely computed the interpolation with feature line-segment control.15 An example of object-based methods that used features is shape-based interpolation,16 which was extended by allowing registration between frames17 and using feature guidance.18 For grayscale images, mathematical morphology provides a well-founded theory.19
The new interpolation grayscale frame method presented in this paper is based on the morphological transform (MST) and consists of partially changing, step by step using growing structuring elements (SEs) the morphological transforms of the foreground content of an input grayscale frame with the MSTs of the foreground content of an output grayscale frame. Better performance comes at the expense of not very great computational complexity.
This paper is organized as follows. Section 2 defines the grayscale MST. Section 3 presents the grayscale frames interpolation algorithm. Section 4 provides experimental results. The conclusions of this study are drawn in Sec. 5.
Morphological Transform (MST)
The MST of a grayscale image can be calculated by means of morphological operations.19 For any SE , we have
The morphological transform of a grayscale image by SE is given by
A grayscale image can be represented using the morphological formulais the maximum value defined by
The new and improved grayscale frame interpolation method presented in this paper consists of partially changing, step by step using growing SEs for with , the MST of the foreground content of a grayscale input frame with the MST of the foreground content of an output grayscale frame.
Based on the grayscale input frame and grayscale output frame , the foreground contents are defined astransform and SE , the foreground content of input grayscale frame and the foreground content of output grayscale frame can be perfectly reconstructed using 3.
The interpolated foreground content of grayscale interpolated frame , for and for , obtained by using the morphological formula. Finally, the grayscale interpolated frame is given by
Using morphological formula 7, we can build a large number, , of not necessarily different interpolated grayscale frames.
We used the proposed algorithm for grayscale frame interpolation by constructing a frame using growing SEs and different values. We performed the experiments using grayscale images.
An example is presented in Fig. 1 . Test input and output grayscale frames are presented in Figs. 1 and 1, and the “missing” frame is in Fig. 1. This frame will be used as reference to compare our results. Our frames have dimensions [256, 256].
Using formula 5, we obtained the foreground contents for input and output frame and for input and output frame and [Figs. 2 and 2 ]. The background content for both the input and output frames (content the frames have in common), [Fig. 2], is given by
Using the morphological transform and crosses or squares as SE , we obtained , , and for the crosses and , , and for the squares. Interpolated foreground content , with (for the crosses) and (for the squares), was obtained using morphological formula 7. Finally, grayscale interpolated frame was given by formula 8. For the crosses, we built 34 interpolated grayscale frames, but only 21 were different. For the squares, we built 30 interpolated grayscale frames, but only 17 were different. Using a standard computer and an optimized C routine implementation, we obtained a grayscale interpolated frame at . For , we can define error function by
Error function ric .
Error function ris .
After simulations using different SEs and different values, we observed that one of the interpolated frames offered by our method was similar to the original reference frame.
This paper has addressed the grayscale frames generalized interpolation by means of mathematical morphology.
After describing the algorithm, we provided experimental results that were very encouraging. We applied the proposed scheme to real-world data. For many situations, the proposed scheme was experimentally shown to successfully resolve complex interpolation problems. Some preprocessing could improve the results. The algorithm is fully morphological and can be applied quickly. This entire process is efficient without significant computational complexity. However, it is difficult to state rigorously that our method produces theoretically correct interpolated results for any frames.
This research was founded by UEFISCSU, contract PII, IDEI, no. 100/2007, D.N. VIZIREANU.