This paper looks at some of the challenges associated with building a coder for video telephony that operates at bit rates below 20 kbps. It then proceeds to present a novel hierarchically structured coder that provides a mechanism for addressing many of these difficulties. The hierarchical structure employs several different simple predictors that are ordered according to their coding gains. This structure is contrasted with traditional predictive coders for video head and shoulders sequences and its performance is demonstrated with several examples.

The Moving Pictures Experts Group (MPEG) of the International Standardization Organization has initiated a standardization effort, known as MPEG-4, addressing generic audiovisual coding at very low bit-rates (up to 64 kbits/s) with applications in videotelephony, mobile audiovisual communications, video database retrieval, computer games, video over Internet, remote sensing, etc. This paper gives a survey of the status of MPEG-4, including its planned schedule, and initial ideas about requirements and applications. A significant part of this paper is summarizing an incomplete draft version of a `requirements document' which presents specifications of desirable features on the video, audio, and system level of the forthcoming standard. Very low bit-rate coding algorithms are not described, because no endorsement of any particular algorithm, or class of algorithms, has yet been made by MPEG-4, and several seminars held concurrently with MPEG-4 meetings have not so far provided evidence that such high performance coding schemes are achievable.

The huge increase of the communication services has suggested to investigate new algorithmic avenues to solve the perpetual rate/distortion trade-off in video coding applications. The problem is drawn nowadays according to very severe constraints: bit-rate budgets become smaller and domestic communication networks at 8 Kbit/s. Two approaches are explored. The first consists of extending the standards already developed in image communication by successive improvements and alternatives inside the algorithmic frameworks. The second proposes a complete change of the basic tools and a design of hybrid schemes by introducing some new methodological techniques which have been already validated by the Computer vision community but never introduced, for compatibility or complexity reasons, into the encoding strategies. This tutorial paper presents these different issues and evokes their advantages. Some experiments performed in our laboratory to encode efficiently time-varying image sequences are eventually presented.

One of the keys to obtaining acceptable quality imagery/video encoded at very low bit rates is to transmit only that information which is critical to human perception. To successfully achieve this goal, one must not only understand the human visual system, but be able to utilize this information in the design of their codec. This paper will present an overview of the properties associated with color science and human visual perception, and how they could make an impact on very low bit-rate image coding.

The term matching pursuits refers to a greedy algorithm which matches signal structures to a large, diverse dictionary of functions. The technique was proposed by Mallat and Zhang with an application to signal analysis. In this paper, we show how matching pursuits can be used to effectively code the motion residual in a hybrid video coding system at bit rates below 20 kbit/s. One advantage of this technique at low bit rates is that bits are assigned progressively to high energy areas in the motion residual. The proper choice of a dictionary set can lead to other advantages. For instance, a large dictionary with a wide variety of structures can represent a residual signal using fewer coefficients than the DCT basis. Also, a dictionary which is not block-based can reduce block distortions common to low bit rate DCT systems. Experimental results are presented in which the DCT residual coder from a standard coding system is replaced by a matching pursuit coder. These results show a substantial improvement in both PSNR and perceived visual quality. Further improvements result when the matching pursuit coder is paired with a smooth motion model using overlapping motion blocks.

This paper describes a novel intelligent low bit rate coding technique for motion pictures, named Video Sequence Quantizer (VSQ). VSQ is one of the semantic coding. The concept is very simple. The encoder extracts motion information about target objects and transmit it as a few control parameters. The decoder has several video sequences in its database and outputs them selectively according to the transmitted parameters. It can reproduce natural movements with a simple operation compared with another semantic coding scheme called computer graphics model-based coding. We make clear the concept of VSQ and also apply it to a very low bit rate TV phone system. Computer simulation of TV phone has been done using twelve video sequences. It can naturally reproduce the speaker's movements by 80 bit/sec. VSQ is a very simple but basic concept for video coding. It will be also useful for mobile and multimedia communications.

Small visual features are often meaningful for the subjective quality of the coded images in very-low bit-rate video systems. If some significant features of the original images are coded, large improvements in the perceived quality can be achieved at low cost. Perceptual factors must be taken into account in order to select only the most significant features for coding. Perceptual coding is the key issue in second generation video coding systems in order to reach the lowest bit-rates with acceptable quality. In this paper, some solutions are proposed for the extraction, selection and coding of small image features in video sequences. The extraction step is based on morphological tools and the selection is performed according to explicit perceptual criteria. The selected features are motion compensated and then coded with an efficient technique derived from the READ coding (2D run-length) taking references in the temporal dimension. The results at very low bit-rates validate the use of perceptual factors in advanced second generation coding techniques.

In this paper, we derive the optimal structuring elements of morphological filters in image restoration. The expected pattern transformation of random sets is presented. An estimation theory framework for random sets is subsequently proposed. This framework is based on the least mean difference (LMD) estimator. The LMD estimator is defined to minimize the cardinality of the expected pattern transformation of the set-difference of the parameter and the estimate. Several important results for the determination of the LMD estimator are derived. The LMD structuring elements of morphological filters in image restoration are finally derived.

In pattern recognition tasks, it is often convenient to alter the sampling rate of the signal, either to convert to a more appropriate scale/resolution, or to produce an image pyramid and perform the task in an multiresolution fashion. In many of these applications, the mse criteria optimized by the Shannon Sampling Theorem is not appropriate, and other sampling strategies should be considered. In this paper we present a new Critical Sampling Theorem, and extends the results to the case where the connection between several parts of the signal (i.e., the homotopy of the set) is of primary interest. The results are presented for binary signals in an hexagonal grid. Extension for square grids with some specific cases of connectivity criteria is also presented. The results show that it is possible to preserve homotopy while using a sampling density 3 to 4 times smaller than required by previous results. This can be used to reduce the sample density or to improve the detail preservation, and has the potential of improving many multiresolution techniques.

In this paper, a greedy and A^*-based searching algorithm is proposed to find the optimal morphological filter on binary images. According to the Matheron representation, the estimator for mean square error (MSE) is defined as the union of multiple erosions. Unfortunately, finding the optimal solution is a long search and time consuming procedure because we have to compute the MSE values over all possible structuring element combinations and make comparisons among them. In this presented paper, the search for the solution is reduced to the problem of obtaining a path with the minimal cost from the root node to one vertex on error code graph. Two graph searching techniques, greedy and A^* algorithms are applied to avoid the search on the extremely large number of search space. Experimental results are illustrated to show the efficiency and performances of our proposed method.

In this paper, we present an investigation of the generalized morphological center. The generalized morphological center is introduced. The idempotence of morphological filters is investigated. Conditions are subsequently derived for the idempotence of the generalized morphological center. Several important examples of idempotent generalized morphological centers are finally presented.

In this paper, we shall investigate thinning algorithms based on morphological hit/miss transform. Our target is to extract skeletons of closed-loop objects in noisy images. After the thinning process, many skeletal legs are generated and some of them may be very long, which require much time to be shortened. First, we propose three algorithms which can speed up the skeletal leg shortening process in different situations and investigate their performance to a single skeletal leg. Secondly we suggest a method of classifying an image using the skeletal leg patterns. Finally we investigate the efficiencies of the three proposed algorithms to different kinds of skeletal leg patterns and propose a decision method to select the most efficient algorithm for a particular image.

In this paper, we present a new morphological approach to obtain a surface orientation using the variation of texture image caused by projective distortions. The perspective effect and the foreshortening are considered as the projective distortions. Under the assumption that the surface of texture image is plane, we apply the mathematical morphology in order to compute the 3D surface orientation. Centroids of texels can be obtained from the farthest texel to the nearest texel sequentially by recursive erosions, so the entire texture image is segmented into several sub-regions. We may compute a major axis of each sub-region with centroids and an average slope with all major axes. Intersections between the line perpendicular to the average slope and the major axes are obtained. Using the relations between the intersections and the size of structuring elements in each sub-region, we can compute the vanishing point. The entire region is rearranged using the major axes of sub-regions and the lines converging to the vanishing point. We can obtain the surface orientation by using the vanishing point and the perpendicular line. We have demonstrated experimental results with the artificial image and the natural images. In the experimental results, we have ascertained the proposed algorithm was more effective than the algorithm using the aggregation transform with the texel edge.

This paper presents a new technique for designing a jointly optimized Multi-stage Vector Quantizer which is also known as the Residual Vector Quantizer (RVQ). In conventional stage-by-stage design procedure, each stage codebook is optimized for that particular stage distortion and does not consider the distortion from the subsequent stages. However, the overall performance can be improved if each stage codebook is optimized by minimizing the distortion from the subsequent stage quantizers as well as the distortion from the previous stage quantizers. This can only be achieved when stage codebooks are jointly designed for each other. In this paper, the proposed codebook design procedure is based on a multi-layer competitive neural network where each layer of this network represents one stage of the RVQ. The weight connecting these layers form the corresponding stage codebooks of the RVQ. The joint design problem of the RVQ's codebooks is formulated as a nonlinearly constrained optimization task which is based on a Lagrangian error function. The proposed procedure seeks a locally optimal solution by iteratively solving these equations for this Lagrangian error function. Simulation results show an improvement in the performance of an RVQ when designed using the proposed joint optimization technique as compared to the stage-by-stage design, where both Generalized Lloyd Algorithm and the Kohonen Learning Algorithm were used to design each stage codebook independently, as well as the conventional joint- optimization technique.

In order to provide a high quality of the reconstructed images with a reduced transmission bit rate, taking into account both statistical redundancy and perceptual characteristics of the DCT coefficients, we apply perceptual windowing and sequential vector quantization to encoding of the coefficients: first, the coefficients are decomposed into 16 slightly overlapping subvectors so as that each subvector has reasonable dimension and conveys key information about one directional image, and then the decomposed subvectors are quantized in a sequential manner. The proposed scheme is good at encoding images with a wide range of transmission bit rates which can be easily controlled by adjusting only the stopping criterion of the sequential vector quantizer.

Subband coding and vector quantization have been shown to be effective methods for coding images at low bit rates. In this paper, we propose a new subband finite-state vector quantization scheme that combines the SBC and FSVQ. A frequency band decomposition of the image is carried out by means of 2D separable quadrature mirror filters, which split the image spectrum into 16 subbands. In general, the 16 subbands can be encoded by intra-band VQ or inter-band VQ. We will use the inter-band VQ to exploit the correlations among the subband images. Moreover, the FSVQ is used to improve the performance by using the correlations of the neighboring samples in the same subband. It is well known that the inter- band VQ scheme has several advantages over coding each subband separately. Our subband- FSVQ scheme not only has all the advantages of the inter-band VQ scheme but also reduces the bit rate and improves the image quality. Comparisons are made between our scheme and some other coding techniques. The new scheme yields a good peak signal-to-noise ratio performance in the region between 0.30 and 0.31 bit per pixel, both for images inside and outside a training set of five 512 X 512 mono-chrome images. In the experiments, the improvement of our scheme over the ordinary VQ without SBC is up to 3.42 dB and over the inter-band VQ is up to 1.20 dB at nearly the same bit rate for the image Lena. The PSNR of the encoded image Lena using the proposed scheme is 32.1 dB at 0.31 bit per pixel.

Side-match vector quantization is an attractive finite-state coding technique for images. This research shows that the side-match vector quantization is similar to catastrophic code where infinite number of decoding errors is caused by a finite number of channel errors. A 1D side- match vector quantization is first proposed to limit the error propagation across different row of blocks when the channel is noisy. Then three tests are proposed for noisy rows detection with minimum overhead information. These tests include the 1D side-match vector quantization decoding test, double-row test, and triple-row test. Finally, a modified Viterbi algorithm is proposed to decode the images encoded by the 1D side-match vector quantization.

A vital step in building a vector quantizer is to generate an optimal codebook. Among the algorithms presented in the literature, the Maximum Descent (MD) algorithm appears to be a promising alternative codevector generation technique to the generalized Lloyd (LBG) algorithm, when dealing with vector quantization of images. In this paper, a novel vector quantization codebook generation approach is presented. The algorithm uses an MD codebook as an initial codebook and a compression of this codebook is then achieved based on a simple feature clustering technique. According to this technique, we attempt to arrange the codevectors of the MD codebook in a way that prefixed number of clusters results. The centroids of the resulted clusters form a reduced MD codebook. Using this new technique we can produce codebooks with about 0.2 - 0.6 db improvement in peak-signal to noise ratio and a reduction of 10% - 20% in the codebook size compared to the LBG algorithm.

The discrete wavelet transform (DWT) has recently emerged as a powerful technique for image compression in conjunction with a variety of quantization schemes. In this paper, a new image coding scheme--classified wavelet transform/vector quantization (DWT/CVQ)--is proposed to efficiently exploit correlation among different DWT layers aiming to improve its performance. In this scheme, DWT coefficients are rearranged to form the small blocks, which are composed of the corresponding coefficients from all the subbands. The block matrices are classified into four classes depending on the directional activities, i.e., energy distribution along each direction. These are further divided adaptively into subvectors depending on the DWT coefficient statistics as this allows efficient distribution of bits. The subvectors are then vector quantized. Simulation results show that under this technique the reconstruction images preserve the detail and structure in a subjective sense compared to other approaches at a bit rate of 0.3 bit/pel.

In this paper a novel algorithm is presented for the efficient 2D Least Squares FIR filtering and system identification. Filter masks of general boundaries are allowed. Efficient order updating recursions are developed by exploiting the spatial shift invariance property of the 2D data set. In contrast to the existing column (row)-wise 2D recursive schemes based on the Levinson-Wiggins-Robinson's multichannel algorithm, the proposed technique offers the greatest maneuverability in the 2D index space in a computational efficient way. This flexibility can be taken into advantage if the shape of the 2D mask is not a priori known and has to be dynamically configured. The recursive character of the algorithm allows for a continuous reshaping of the filter mask. Search for the optimal filter mask, essentially reconfigures the filter mask to achieve an optimal match. The optimum determination of the mask shape offers important advantages in 2D system modeling, filtering and image restorations.

It is expected that a globally optimal restored multichannel image should be superior to a suboptimally restored image without the use of cross-channel information. In this paper, a regularized multichannel image restoration approach is proposed, which is based on the minimum multichannel regularized noise power criterion. Furthermore, no prior knowledge about the variance of the noise at each channel and a bound on the high frequency energy of the image are assumed, but this information is estimated based on the partially restored result at each step. The multichannel smoothing functional to be minimized is formulated to have a global minimizer with the proper choice of the multichannel regularization functionals. With this algorithm, the regularization functional for each channel is determined by incorporating not only within-channel information but also cross-channel information. It is also shown that the proposed multichannel smoothing functional is convex, and therefore, has a global minimizer. The proposed multichannel algorithm not only does not depend on initial conditions but is also shown to be much more computationally efficient than existing algorithms.

In an image restoration problem we usually have two different kinds of information. In the first stage, we have knowledge about the structural form of the noise and local characteristics of the image. These noise and image models normally depend on unknown hyperparameters. The hierarchical Bayesian approach adds a second stage by putting a hyperprior on these hyperparameters, through which information about these hyperparameters is included. In this work we relate the hierarchical Bayesian approach to image restoration to an iterative approach for estimating these hyperparameters in a deterministic way.

Incorporating spatiotemporal jitter into the scanning of time-varying imagery on a rectangular lattice effects the severity of baseband noise under the conditions of sampling at or below the Nyquist rate. Sampling spatiotemporal images on a hexagonal lattice has been shown to provide a 13.4% reduction in the sample rate over that of a comparable rectangular system. The relationship between the increased performance due to sampling on a hexagonal lattice and the performance degradation due to the presence of jitter in the scanning process is investigated in this paper. Spatiotemporal pixel jitter is included in the scanning of time- varying imagery on a hexagonal grid. The aliasing noise is dependent on the statistical properties of the jitter as well as the pattern used to scan the image. The signal-to-aliasing noise power ratio is used as a performance measure.

The mismatch between dynamic ranges of intensities in non-uniformly illuminated videophone scenes and of intensities reproducible at display devices is addressed. Displayed portrait images with no details visible in some facial regions result from this mismatch and lead in turn to a reduced impression of telepresence. A novel image processing approach for dynamic range compression of video phone portrait images is presented in this paper. Unlike conventional methods, it provides compressed images with a most natural appearance. The basic idea is to simulate a more uniform scene illumination in the video signals of videophone portrait images. This requires a determination of the scene's reflectance function. An extension of the classical lightness approach of Land and McCann to curved surfaces is proposed for this task.

Noise removal is important in many applications. When the noise has impulsive characteristics, linear techniques do not perform well, and median filter or its derivatives are often used. Although median-based filters preserve edges reasonably well, they tend to remove some of the finer details in the image. Switching schemes--where the filter is switched between two or more filters--have been proposed, but they usually lack a decision rule efficient enough to yield good results on different regions of the image. In this paper we present a strategy to overcome this problem. A decision rule based on the second order local statistics of the signal (within a window) is used to switch between the identity filter and a median filter. The results on a test image show an improvement of around 4 dB over the median filter alone, and 2 dB over other techniques.

This paper describes an inverse halftoning algorithm to reconstruct a continuous-tone image given its error diffused halftone. We develop a modular class of non-linear filters, denoted as a class of binary permutation filters, which can reconstruct the continuous-tone information preserving image details and edges which provide important visual cues. The proposed non- linear reconstruction algorithm is based on the space-rank ordering of the halftone samples, which is provided by the multiset permutation of the `on' pixels in a halftone observation window. By varying the space-rank order information utilized in the estimate, for a given window size, we obtain a wide range of filters. A constrained LMS type algorithm is employed to design optimal reconstruction filters which minimize the reconstruction mean squared error. We present simulations showing that the proposed class of filters is modular, robust to image source characteristics, and that the results produce high visual quality image reconstruction.

A rate control in video coding using an analysis model is described. Video coding and the rate control presented in this paper are MPEG2 and its Test Model since they are known to provide better performance than the conventional one. The rate control can be modeled as a linear feedback system with some statistical assumptions. By this model, we can adjust the feedback response of the system. It is required to generate constant bits per picture for the communication application since it gives the shorter delay by using a smaller area of the buffer memory. Thus, the method to improve the tracking ability to the target bit in a certain period is proposed. It can generate more precise bit amount for a group of pictures (GOP) than the normal case. The deviation from the target value at the GOP level can be lowered to less than 1/70 in the simulation It can be applied to any video coding which determines a quantization step at every macroblock.

The second phase of the ISO Moving Picture Experts Group audio-visual coding standard (MPEG-2) is nearly complete and this standard is expected to be used in a wide range of applications at variety of bitrates. While the standard specifies the syntax of the compressed bitstream and the semantics of the decoding process, it allows considerably flexibility in choice of encoding parameters and options enabling appropriate tradeoffs in performance versus complexity as might be suitable for an application. First, we present a review of profile and level structure in MPEG-2 which is the key for enabling use of coding tools in MPEG-2. Next, we include a brief review of tools for nonscalable coding within MPEG-2 standard. Finally, we investigate via simulations, tradeoffs in coding performance with choice of various parameters and options so that within the encoder complexity that can be afforded, encoder design with good performance tradeoffs can be accomplished. Simulations are performed on standard TV and HDTV resolution video of various formats and at many bitrates using nonscalable (single layer) video coding tools of the MPEG-2 standard.

In this paper several formatting solutions which trick mode (fast forward, fast reverse) support for helical scan recording are proposed. First, two basic methods where the trick mode signal is built up from semi-random sections of the normal stream, will be discussed. These low complexity methods form the basis for the extension to more advanced solutions that employ a dedicated bit stream for trick modes. A method of formatting this dedicated trick stream on a recorder without phase lock between the scanner and the tape during fast forward is presented by means of three separate case studies. In order to guarantee that the trick mode stream is read at the chosen speed multiple copies of the same stream need to be placed at well chosen places on the tape. This solution is extremely attractive for systems where a limited number of speedup levels are required. Recorders that can perform phase locking during fast forward yield a particular advantage for high speed-up (n equals 12, 18, ...) factors and allow for the support of more distinct speedup levels.

The Moving Picture Experts Group (MPEG) has standardized the bit-stream syntax for the coded representation of video. This means that MPEG specifies only a decoding method and allows much flexibility in encoding methods. Therefore the picture quality of the reconstructed video sequences is considerably dependent on the rate control strategy in the encoding method. We propose a new rate control strategy conforming to the MPEG syntax that improves the reconstructed picture quality. The new rate control strategy allocates the target number of bits and assigns quantization step sizes adaptively based on the human visual sensitivity and the complexity of the picture to be coded. The proposed rate control strategy consists of the following steps. First, a 16 X 16 macroblock is classified into one of 8 macroblock classes based on human visual sensitivity for luminance and color components in the macroblock and then an 8 X 8 block is classified into one of block classes by its variance. Next, the target number of bits is allocated to a block and the quantization step size is assigned to a macroblock. The result of subjective tests showed the proposed rate control strategy improved the picture quality of the reconstructed video sequences considerably over the conventional strategy. Especially in the proposed strategy, the subjective picture quality between frames was more constant and hence was less degraded than conventional rate control strategies.

In low bit-rate applications, MPEG based compressed video exhibits annoying coding artifacts. In this paper, image recovery algorithms based on the theory of projections onto convex sets are proposed to decode video images from MPEG data without coding artifacts. According to this approach, each video frame is reconstructed using not only the transmitted data but also other prior knowledge which is available and not explicitly used by the conventional MPEG decoding algorithm. Numerical experiments demonstrate that the proposed algorithm yield images superior to those from conventional MPEG decoders.

This paper studies the problem of error accumulation with hybrid DPCM/DCT video coding. It is shown that the error accumulation results from quantization of the temporal prediction errors in the DCT domain. When the temporal prediction error for a coefficient is smaller than the quantization dead zone for a number of successive frames, error accumulates for that coefficient. This is particularly the case for the high order DCT coefficients, which, in general, exhibit small amplitude and low temporal correlation. To alleviate the error accumulation, it is proposed that a loop filter be inserted in the hybrid coding loop to remove the temporal prediction for the coefficients whose temporal prediction errors contain more information than the coefficients themselves.

Motion compensation is a powerful tool used in the compression of video. While much work has been done on various techniques of progressive motion compensation, interlaced motion compensation has not been considered in as much detail. This paper proposes several new techniques of interlaced motion compensation using multiple fields, the de-interlacing interpolation. A novel technique, hybrid motion compensation, is presented that uses linear combination of previous fields to construct better block matches. In addition, the effects of several different interpolation techniques including spatial and Bayesian motion estimation, are considered.

This paper presents a classified vector quantizer based on Peano scanning. The Peano scanning, which is used to reduce the dimensionality of the data provides a 1D algorithm to classify an image block. The class of the block is determined based on its Peano scanning value from a look up table (LUT) of representative Peano scanning values and their associated classes. The Peano scanning algorithm is easily implemented in hardware and the class can be determined in a logarithmic time proportional to the number of entries in the LUT when using a binary search algorithm on the sorted LUT. Moreover, the class look up table is easily implemented in real time. An effective algorithm to generate all the codebooks of the classes simultaneously in a systematic way based on the greedy tree growing algorithm is also presented. The monochromatic images encoded in the range of 0.625 - 0.813 with a 16 dimensional input vectors are shown to preserve the edge integrity and quality as determined by subjective and objective measures.

Vector quantization (VQ) is an effective image coding technique at low bit rate. Side-match finite-state vector quantizer (SMVQ) exploits the correlations between the neighboring blocks (vectors) to avoid large gray level transition across block boundaries. In this paper, a new adaptive quadtree-based side-match finite-state vector quantizer (QBSMVQ) has been proposed. In QBSMVQ, the blocks are classified into two main classes, edge blocks and nonedge blocks, to avoid selecting a wrong state codebook for an input block. In order to improve the image quality, edge vectors are reclassified into sixteen classes. Each class uses a master codebook that is different from the codebook of other classes. In our experiments, results are given and comparisons are made between the new scheme and ordinary SMVQ coding techniques. As will be shown, the improvement of QBSMVQ over the ordinary SMVQ is up to 3.13 dB at nearly the same bit rate. Moreover, the improvement over the ordinary VQ can be up to 4.30 dB at the same bit rate for the image Lena. Further, block boundaries and edge degradation are less visible because of edge-vector classification. Hence, the perceived improvement in quality over ordinary SMVQ is even greater for human sight.

A method for optimal variable rate mean-gain-shape vector quantization (MGSVQ) is presented with application to image compression. Conditions are derived within an entropy- constrained product code framework that result in an optimal bit allocation between mean, gain, and shape vectors at all rates. An extension to MGSVQ called hierarchical mean-gain- shape vector quantization (HMGSVQ) is similarly introduced. By considering statistical dependence between adjacent means, this method is able to provide improvement in rate- distortion performance over traditional MGSVQ, especially at low bit rates. Simulation results are provided to demonstrate the rate-distortion performance of MGSVQ and HMGSVQ for image data.

Vector transform coding (VTC) has been shown to be a promising new technique for image and video compression. Vector transformation (VT) reduces inter-vector correlation and preserves intra-vector correlation much better than scalar-based transforms such as the discrete cosine transform (DCT) so that vector quantization (VQ) in the VT domain can be made more efficient. In addition to finding a good vector transform, another important aspect of VTC is the codebook structure and bit-allocation in the VT domain. Vectors with different indices in the VT domain have very different characteristics. Given a total number of bits, the question is now to construct the codebooks and allocate bits to the vectors so that distortion is minimized. A new multi-layered codebook structure and a dynamic bit-allocation scheme have been developed. The main advantage of this method over a fixed bit-allocation scheme is that distortion is controlled by dynamically allocating more bits to vectors causing larger distortions and less bits to vectors causing smaller subband coding into vector case so that scalar-based operations are replaced by vector-based operations. In VSC, an image is first decomposed into a set of vector subbands (VSBs) using a vector filter bank (VFB), and then VQ is performed on all vectors in each VSB. The proposed VFB not only reduces inter-vector and inter-band correlation, but also preserves intra-vector correlation. This property makes the subsequent VQ much more efficient and allows large coding gain over conventional subband coding.

This paper proposes a new trellis-searched vector quantization scheme with an optimal codebook design algorithm. The proposed vector quantizer employs a conditional index encoder to efficiently exploit high interblock correlation, where each index is adaptively encoded using a different Huffman table which is selected according to the index of the previously decoded block. We also modify the Viterbit algorithm in order to find the optimal path through the trellis of indices. For an optimal codebook design an iterative descent method is used, which is very similar to that for ECVQ (entropy-constrained vector quantization) codebook design. Simulation results show that at the same bitrate the proposed method provides higher PSNR performances than the conventional ECVQ by 1.0 approximately 3.0 dB when applied to image coding.

The paper develops a new fast and low complexity method for image coding. It is based on Lattice Vector Quantization (for both L₁ and L₂ norms). A solution is proposed to solve the labelling of quantized vectors, which is a crucial problem in Lattice Vector Quantization.

In this paper, two image coding techniques employing an entropy constrained vector quantizer (ECVQ) in the transform domain are presented. In both techniques, the transformed DCT coefficients are rearranged into the Mandala blocks for vector quantization. The first technique is based on the unstructured ECVQ designed separately for each Mandala block, while the second technique employs a structured ECVQ, i.e., an entropy constrained lattice vector quantizer (ECLVQ). In the ECLVQ, unlike the conventional lattice VQ combined with entropy coding, we take into account both the distortion and entropy in the encoding. Moreover, in order to improve the performance further, the ECLVQ parameters are optimized according to the input image statistics. Also we reduce the size of the variable word-length code table, by decomposing the lattice codeword into its magnitude and sign information. The performances of both techniques are evaluated on the real images, and it is found that the proposed techniques provide 1 - 2 dB gain over the DCT-classified VQ at bit rates in the range of 0.3 - 0.5 bits per pixel.

Fractal compression has not lived up to its promise as a high-quality low bit-rate image compression scheme. The existing algorithms for finding self-mapping contractive transforms for images are computationally expensive and offer a poor rate-quality tradeoff. In this paper we explore the error images resulting from a simple fractal compression scheme. We use a set of fractal maps as a predictor for the image, and store the error-image using the Discrete Cosine Transform (DCT). Our experiments show that such a composite scheme has worse rate-quality tradeoff than DCT alone.

A new fractal-based image compression system based on a so-called Adaptive Side-Coupling Quadtree (ASCQ) structure is proposed. The proposed system consists of three processes: a preprocessing process, a compression process, and a decompression process. In the compression process, the original image is represented by an ASCQ structure. The set of Iterated Function System (IFS) codes, which is a powerful tool usually derived in the encoding process, can be calculated directly from this tree structure. Using these IFS codes, an image which is similar to the original one can be reconstructed. The proposed ASCQ structure not only represents the original image but also contains both the domain and range pools in it. The number of fractal codes in an ASCQ structure will be different when it is extracted from different original images. Since the proposed ASCQ is adaptive in its structure, it is beneficial for representing those images that contain more homogeneous regions. Also, the inherent dynamic structure of its range pool and domain pool, which is different from the fixed pools proposed by Jacquin, will certainly shorten the searching time and speed up the image retrieval process. We also propose a First-N-Maximum function as a decision function to choose those blocks in the domain pool that are most similar to the terminal ones. Experimental results reflect that the ASCQ structure is indeed an efficient structure for the fractal-based image compression system.

In modeling terrain images corresponding to infrared scenes it has been found the images are characterized by a long-range dependence structure and high variability. The long-range dependence manifests itself in a `1/f' type behavior in the power spectral density and statistical self-similarity, both of which suggest the use of a stochastic fractal model. The traditional stochastic fractal model is fractional Brownian motion, which assumes the increment process arises from a Gaussian distribution. This model has been found to be rather limiting due to this restriction and therefore is incapable of modeling processes possessing high variability and emanating from long-tailed non-Gaussian distributions. Stable distributions have been shown to be good models of such behavior and have been incorporated into the stochastic fractal model, resulting in the fractional Levy stable motion model. The model is demonstrated on a terrain image and is used in an interpolation scheme to improve the resolution of the image.

Biorthogonal wavelets or filterbanks are shown to be superior in coding gain performance than orthogonal ones for logarithmic subband decompositions (limited to iterative decomposition of the downsampled output of the analysis low-pass filter). As a consequence, for logarithmic decompositions, the optimal filter is not an ideal filter. This is shown for maximally regular biorthogonal and orthogonal filters, as well as filters designed to optimize the subband coding grain.

Image compression methods for progressive transmission using optimal subband/wavelet decomposition, partition priority coding (PPC) and multiple distribution entropy coding (MDEC) are presented. In the proposed coder, hierarchical wavelet decomposition of the original image is achieved using wavelets generated by IIR minimum variance filters. The smoothed subband coefficients are coded by an efficient triple state DPCM coder and the corresponding prediction error is Lloyd-Max quantized. The detail coefficients are coded using a novel hierarchical PPC (HPPC) approach. That is, given a suitable partitioning of their absolute range, the detail coefficients are ordered based on their decomposition level and magnitude, and the address map is appropriately coded. Finally, adaptive MDEC is applied to both the DPCM and HPPC outputs by considering a division of the source of the quantized coefficients into multiple subsources and adaptive arithmetic coding based on their corresponding histograms.

Biorthogonal and orthogonal filter pairs derived from the class of binomial product filters are considered for wavelet transform implementation with the goal of high performance lossy compression. To help narrow the potential candidate filters, a number of design objectives based on filter frequency response and orthonormality are introduced with final selection being determined by experimental rate-distortion performance. While image data compression is specifically addressed, many of the proposed techniques are applicable to other coding applications.

This paper presents a new design technique for obtaining optimum M channel orthogonal subband coders where M equals 2ⁱ. All filters that constitute the subband coder are FIR type filters with linear phase. We carry out the design in time domain, based on time domain orthonormality constraints that the filters must satisfy. Once a suitable low pass filter h₀(n) is found, the remaining (M-1) filters of the coder are obtained through the use of shuffling operators on that filter. Since all resulting subband filters use the same numerical coefficient values (in different shift positions), this technique leads to a set of filters that can be implemented very efficiently. If, on the other hand, maximization of the coding gain is more important consideration than efficient implementation, the set of impulse responses obtained through shuffling can be further processed to remove the correlation between the subbands. This process leads to a new set of orthonormal linear phase filters that no longer share the same numerical coefficient values. In general, coding gain performance for this new set is better compared to the initial design. This uncorrelated decomposition can be thought of as counterpart of Karhunen-Loeve transform in an M channel filter bank.

This paper describes an image modeling scheme based on wavelet signal decomposition and statistical texture analysis, and its application in model-based image coding. In this approach, the image being considered is first decomposed into octal signal bands which contains different spectral components of the images. Based on the property of the signal decomposition statistical texture analysis techniques are hierarchically employed to separate the image into different categories with distinct modeling parameters. Coding is performed based on the texture image model.

Model-based image coding is potentially a powerful technique for compressing scenes dominated by the head-shoulder images, as in a videotelephone scene with a closeup of the human upper-body. In this paper we describe a Kalman filtering-based technique to robustly recover 3D structure and kinematics of the head and arm in view from optical flow. Because of its explicit modeling of measurement noise and modeling uncertainty, the extended Kalman filter has been shown to improve the robustness of shape-from-motion technique. The robustness of the recursive estimation technique is further enhanced by (1) confining feature- tracking within the neighborhoods of skeleton sketch of the head and arm, (2) formulating measurement noise of the optical flow as a function of the optical flow's confidence measures, and (3) fusing into the recursive estimation a set of constraints which govern kinematic linkages of an articulated arm.

A new scheme based on priori face knowledge and shift template method for fast face feature points extraction are presented in this paper. A fairly good accuracy and speed in detecting the feature points of eyebrows, eyes, nose and mouth have been achieved by a pair of complementary templates. It is shown by computer simulation that the scheme is very suitable for very low bit rate model-based image coding in real time applications.

This paper studies the performance of an image sequence model based on Compound Random Fields when used for segmentation purposes. The fact of using a hierarchical model allows characterizing separately the texture and contour information within the sequence. Moreover, temporal and spatial contour behavior can also be described independently. This separated characterization allows to impose constraints on the kind of contours to be obtained and to introduce some a priori knowledge in the segmentation procedure. The way to exploit these features for an object-based sequence coding scheme is analyzed. The influence of the model parameters on the segmentation results is analyzed, in order to achieve segmentations which can be easily coded. The main sought characteristics are smooth spatial contours, slow temporal variations and homogeneous textures. Two different segmentation algorithms are used for this analysis, a recursive and a nonrecursive one.

In this paper, we describe a method to train and classify form class. We consider the form shape as a special graph, and propose a representation of a form class and an efficient matching algorithm. The matching algorithm is simple and can find the optimal map. When the form class is trained, our approach can correct some errors in the input form; thus a high tolerance of noise on the image is obtained.

In common associative neural network practice, the updating rule remains unchanged during neuron evolution. Once the evolution is stuck in a local minimum, simulated annealing is used to resolve the problem. In this paper, the local minimum problem in associative neural networks is treated from a novel perspective. In particular a generalized neuron evolution algorithm is introduced. It is shown in the paper that the probability of local minima associated with different learning schemes having the same locations on the surfaces of their respective energy functions is extremely small. Thus once evolution terminates in a local minimum associated with one learning scheme, another learning scheme is invoked to continue the evolution. Numerical examples are used to demonstrate the performance of this. The results show that the local minimum problem is effectively resolved.

This paper describes an object recognition technique based on the concept of local symmetry. A technique is described which can detect 1D features under situations of extreme low contrast. The effectiveness of the technique is shown through application to DNA autoradiographs. The technique is then expanded so that 2D objects can be located and then recognized. In the 2D case the resulting output of the technique is a locus which can be compared to those in a database. It is further shown how the technique is robust against changes in both scale and orientation.

This paper presents an associative memory called an multidimensional holographic associative computing (MHAC), which can be potentially used to perform feature based image database query using image snippet. MHAC has the unique capability to selectively focus on specific segments of a query frame during associative retrieval. As a result, this model can perform search on the basis of featural significance described by a subset of the snippet pixels. This capability is critical for visual query in image database because quite often the cognitive index features in the snippet are statistically weak. Unlike, the conventional artificial associative memories, MHAC uses a two level representation and incorporates additional meta-knowledge about the reliability status of segments of information it receives and forwards. In this paper we present the analysis of focus characteristics of MHAC.

A fast algorithm to detect rectangles in aerial images is suggested. A contour image is used as an input for the algorithm. the primitive lines are extracted in the contour image and joined into line segments by cluster analysis method. the line-merging algorithm is developed, and an algorithm to detect rectangles from the extracted straight lines is suggested. The developed algorithm allows a good relation between computational time and line quality.

A novel approach for classification of deformed images is presented. It is shown that by using the Fourier phase of the deformed images, a set of invariants can be calculated and used for identification of each image. Phase-only, as is well known, is also good for compression and reconstruction of images. Computational results are presented and discussed.

An algorithm is described for the joint estimation of motion and disparity vector fields from stereoscopic image sequences. Gibbs-Markov random fields are used to model local interaction processes. Interaction of neighboring motion, disparity vectors across a discontinuity line is prohibited via hidden Markov chains signaling discontinuities in the vector fields. The coherence of motion and disparity vector fields, is exploited by means of the epipolar constraint and the so called `loop constraint'. A simulated annealing algorithm is employed to find the global maximum of the posterior probability.

In contrast to previous global 3D motion concept, a Gibbs random field based method, which models local interactions between motion parameters defined at each point on the object, is proposed. An energy function which gives the joint probability distribution of motion vectors, is constructed. The energy function is minimized in order to find the most likely motion vector set. Some convergence problems, due to ill-posedness of the problem, are overcome by using the concept of hierarchical rigidity. In hierarchical rigidity, the objects are assumed to be almost rigid in the coarsest level and this rigidness is weakened at each level until the finest level is reached. The propagation of motion information between levels, is encouraged. At the finest level, each point have a motion vector associated with it and the interaction between these vectors are described by the energy function. The minimization of the energy function is achieved by using hierarchical rigidity, without trapping into a local minimum. The results are promising.

Optical flow is an important source of information of motion and structure of objects in 3D world. Once the optical flow field is computed accurately, the measurement of image velocity can be used widely in many tasks in computer vision area. Current computer vision techniques require that the relative errors in the optical flow be less than 10%. However, to reduce error in optical flow determination is still a difficult problem. In this paper, we propose a Kalman filtering for improving accuracy in determining optical flow along moving boundaries. Firstly, a quantitative analysis on the error decreasing rate in iteratively determining optical flow using the correlation-based technique is given. It concludes that this error decreasing rate is varied for different regions in an image plane: it is larger for the regions where intensity varies more drastically, it is smaller for those where intensity varies more smoothly. This indicates that the iterations needed in optical flow determination should not be uniform for different image regions. That is, for the moving boundaries, where intensity usually changes bigger, less iterations are needed than for other regions. This is reasonable. In fact, the confidence measure is usually high along moving boundaries since richer information exists there. Therefore, an optical flow algorithm needs to have less iterations along moving boundaries than in other areas so that the better estimation of optical flow along boundaries can be propagated into other areas instead of being blurred by those in other areas. Secondly, we propose a Kalman filter to realize the task of applying different number of necessary iterations in determining optical flow to deblur boundary and enhance accuracy. Loosely speaking, the idea is whenever the standard deviation of optical flow at a pixel is less than certain criterion, i.e., good accuracy has been achieved, the Kalman filter will not further update optical flow at this pixel, thus conserving accuracy along moving boundaries. Assuming that estimated optical flow field is contaminated by a Gaussian white noise, we give appropriate considerations to the system and measurement noise covariance matrices, Q and R, respectively. In this way, the Kalman filter is used to eliminate noise, raise accuracy and refine accuracy along discontinuities. Finally, an experiment is presented to demonstrate the efficiency of our Kalman filter. Two objects are considered. One is stationary, while another is in translation. Unified optical flow field (UOFF) quantities are determined by using the proposed technique. The 3D position and speeds are then estimated by using UOFF approach. Both results obtained with and without the Kalman filter are given. A more than 10% improvement is achieved in this experiment. It is expected that the more moving boundaries in the scene, the more effectively the scheme works.

An annealed Hopfield neural network has been shown to solve an image segmentation problem and good image segmentation was successfully achieved. In this paper, a new motion estimation algorithm using an annealed Hopfield neural network is developed. Motion estimation process can simply be described as finding the corresponding pixels in the consecutive images. Optimization function E_me1 equals E_g to achieve this simple process is defined first. This optimization function finds the motion vector for a given pixel in a frame by finding a corresponding pixel in the next frame. However, the image sequence usually contains the noise. In this case, only finding the corresponding pixels does not work well in estimating the correct vector field. To make the motion vectors smooth within a moving object and to make the motion vectors different between the objects moving in different directions, weak continuity constraints terms, E_me2 equals E_d + E_s + E_p, are added to the previously defined optimization function E_me1, resulting in E_me equals E_me1 + E_me2. E_me2 controls the smoothness of the detected motion vectors within objects as well as maintains the motion vector boundaries between the objects moving to the different directions. Simulation are done for the synthetic image sequence and the real image sequence.

Currently two major limitations to applying computer vision to real-time robotic vision tasks are robustness in unsimulated and uncontrolled environments, and the computational resources required for real-time operation. In particular, many current visual motion detection algorithms (optical flow) are not suited for practical applications such as crash detection because they either require highly specialized hardware or up to several minutes on a scientific workstation. A recent optical flow algorithm [C94] however has been shown to run in real-time on a standard scientific workstation and yields very accurate time-to-contact calculations.

Wavelet transform has recently emerged as a promising technique for video processing applications due to its flexibility in representing nonstationary video signals. In this paper, we propose a fast multiresolution motion estimation (FMRME) scheme based on the wavelet transform for video compression. In FMRME, the set of orientation subimages at each level of the wavelet pyramid are first combined together into a single (all-orientation) sub-image, and then the motion estimation is performed on the newly formed subimage. This contrasts with the MRME scheme (recently reported in the literature) where motion estimation is separately performed on all the individual wavelet subimages. The motion vectors of an all-orientation subimage at a lower level are predicted from the motion vectors at the higher (preceding) level and are refined at each step. The proposed scheme reduces the search time for motion vectors by 66% compared to MRME. In addition, the FMRME scheme has the advantage of significantly reduced side information for the description of motion vectors. Simulations show that the FMRME scheme has considerable reductions in the bit rate which results to significant improvements in coding performance of the FMRME based wavelet coding compared to the MRME based wavelet coding for video compression.

This paper proposes a new motion-compensated frame (field) interpolation algorithm for frame (field) rate upconversion, which allows us to interpolate frame (or pairs of fields) between two originally continuous frames (fields) of a digital television sequence by preserving the stationary background. First, for a interlace format, the de-interlacing process was used to reduce the motion range after converting the interlace format to progressive one. A video scene can be temporally categorized by the change detector into changed and unchanged regions. Each changed region is further separated into moving objects, covered and uncovered regions. To interpolate the intermediate field (frame), we have developed direct motion interpolation method and indirect motion interpolation method to fill the moving object areas in the changed regions, and then apply the forward/backward motion extrapolation method to fill the covered/uncovered regions. Finally the hybrid repetition is used to interpolate the unchanged regions. In the experiment, we will show the interpolated fields and frames for two standard image sequences.

Frame rate conversion is widely used in transformation among various different video standards. This paper describes an efficient frame rate conversion method using block motion compensation. In this approach, a predicted motion vector and a motion vector preselecting process are invoked. This results in lower complexity, while maintains a higher SNR compared with the existing efficient method.

The problem of grouping 3D coplanar line segmented obtained from a single view is addressed. The proposed method is efficient and has been tested on both synthetic and real images. First, a Hough-based algorithm is used to detect 2D line segments in a sequence of images representing a 3D scene. Secondly, the 3D coordinates of the line segments are estimated, at each time instant, by means of an extended Kalman filter, based on the displacements (u,v) of the line segment endpoints on the image plane. Finally, 3D coplanar segments are grouped by a 3D voting approach. The novelty of this method lies in the possibility of using a simple voting scheme similar to that associated with the standard Hough transform for line extraction, where each edge point votes for a sheaf of rectilinear lines. In the proposed approach, each line segment votes for a sheaf of planes.

The problem of grouping 3D coplanar line segmented obtained from a single view is addressed. The proposed method is efficient and has been tested on both synthetic and real images. First, a Hough-based algorithm is used to detect 2D line segments in a sequence of images representing a 3D scene. Secondly, the 3D coordinates of the line segments are estimated, at each time instant, by means of an extended Kalman filter, based on the displacements (u,v) of the line segment endpoints on the image plane. Finally, 3D coplanar segments are grouped by a 3D voting approach. The novelty of this method lies in the possibility of using a simple voting scheme similar to that associated with the standard Hough transform for line extraction, where each edge point votes for a sheaf of rectilinear lines. In the proposed approach, each line segment votes for a sheaf of planes.

Dialogic modification using picture processing and painting in combination is proposed as an effective method. Picture painting is realized by a sequence of basic processes specifying points, lines, luminance and chrominance. Picture processing consists of processes extracting feature objects. The modification processes consist of both processes so to have interaction between them. In these modification processes, a client can select interactive scheme of switching between processing and painting. Dialogic modification is defined as a set of modification processes given by communication sequences between a client and a server. An example is illustrated. In the example, a client intends to change a highlight position to generate a new picture required by a change of view point. The modification methods are classified and used. In dialogic modification, the selecting a revised sequence is executed by communication between a client and a server. To realize the communication, the common platform is introduced as an interface in the color picture processing and painting system based on the extensible window-based elaboration language. As the results, it is shown that dialogic modification of picture by interactive process of processing and painting is the excellent method.

An excellent system environment is required for realizing various services for picture processing and painting like geometrical feature processing and modification processing with susceptible constraints. Service management will play important roles in the system environment in order to integrate processing and painting of many kinds of pictures including moving picture. Integration of service management is inevitable to realize interactive process such as our Extensible WELL (Window-based ELaboration Language). Our system can handle all kinds of domain specific language by using concept of common platform including object network and of communication manager. Every object network specifies consecutive process, and communication manager controls cooperation between a client and several servers.

A new multiresolution image analysis approach using adaptive Hermite-Binomial filters is presented in this paper. According to the local image structural and textural properties, the analysis filter kernels are made adaptive both in their scales and orders. Applications of such an adaptive filtering approach, including image texture resolution analysis, multiscaled image edge curve estimation and adaptive edge-texture-based image compression, are then presented. Simulation results on image texture resolution and edge curve estimation as well as image compression are included.

This paper presents a robust texture encoding technique for texture processing using a covariance-based approach. This encoder produces a texture code which is invariant to local and global textural rotations. Our proposed method uses six statistical features obtained from two rotation invariant local descriptors. The covariance technique is used to compute local descriptors and to index roughness, anisotropy, or general textural differences. Texture classification and segmentation is carried out to evaluate the proposed encoding scheme. Classification and segmentation results for synthetic and natural textures are presented to show the robustness of our method.

We demonstrate how the formulation of a nonlinear scale-space filter can be used for edge detection and junction analysis. By casting edge-preserving filtering in terms of maximizing information content subject to an average cost function, the computed cost at each pixel location becomes a local measure of edgeness. This computation depends on a single scale parameter and the given image data. Unlike previous approaches which require careful tuning of the filter kernels for various types of edges, our scheme is general enough to be able to handle different edges, such as lines, step edges, corners and junctions. Anisotropy in the data is handled automatically by the nonlinear dynamics.

In image wrapping, the post-filtering is necessary to avoid aliasing effect. Here, we develop a hybrid space-variant directional filtering for post-processing. In order to reduce the computation, we classify the filter area as three blocks: constant, oriented, and irregular. The constant and irregular blocks are local average filtering and elliptical weighted average filtering. In oriented model, we propose a new filtering method called elliptical weighted adaptive directional moving average filter. In the experiments, we show that our method may correct the distorted images and have better results, with better subjective quality, especially with high magnification ratio, such as four times or more.

A hidden markov model, which describes the evolution of a (binary) edge-image along the resolution axis, is presented. The model integrates two layers: A hidden layer consists of sources having the ability of `breeding' along the resolution axis according to a markovian rule. A second layer consists of a Gibbs random field which is defined by all the sources. The available image is a realization of this field. After fitting such a model to a given pyramid, it is possible to estimate the super-resolution images by synthesizing additional levels of the process which created the pyramid. The hidden markov model is found to be a useful tool, allowing us to incorporate selected properties in the process of evolution along the resolution axis, while simultaneously providing an interpretation of this process. The properties incorporated into the model significantly influence the super-resolution image.

In this paper, a new notion called Morphological Gradient Texture Spectrum (MGTS) is proposed for texture analysis and classification. The MGTS is used as a discriminating tool in texture analysis and classification. To evaluate the performance of the proposed method in the discrimination of textures, we perform a supervised classification procedure to classify texture images extracted from Brodatz's album. A simple measure is defined to determine the distance between two MGTS. Promising results indicate that our method is efficient in texture classification. We also evaluate two basic texture features, namely, coarseness and directionality from the MGTS for visual-perceptual feature extraction.

In this paper, we propose a new texture classification method. Previously, for texture analysis and classification, the gray tone co-occurrence matrix was adopted most frequently. However, due to the complexity in its derivation process, it is not the best choice if the processing time is a major concern. In this work, we propose a more compact matrix called C-matrix to solve the above problem. The proposed C-matrix characterizes both qualitative and quantitative properties between each pixel and its neighbors in an image. Based on this matrix, a set of statistical features can be defined. These features are then fed into a trained fuzzy neural network for texture classification. Experimental results based on two ground surface images are reported to corroborate the proposed theory.

In this paper, we propose a geometrical method for reconstruction of particular objects, typically polyhedrons whose faces are parallelepipeds. The originality of this approach lies in the use of Pluckerian coordinates for the parameterization of the lines supporting segments. The intrinsic relationships between the 3D co-ordinates of a segment of line and its projection on the retina plane have enabled to determine the 3D structure from 2D data together with a partial knowledge of the object. We have developed the 3D reconstruction method and presented results.

Recent developments in automatic building management systems and in road traffic monitoring systems have highlighted a need for accurate real time data relating to occupancy and flow of pedestrians in relatively unconstrained physical areas. In buildings where constrained pedestrian flow is possible to arrange either light beams or turn stiles have been used to count people, but in less constrained areas, counting has been achieved by some manual means i.e. hand counting of live or recorded scenes. The ESPRIT PEDMON (PEDestrian MONitoring) project is focused on the development of technologies to enable the automated counting of pedestrians in unconstrained areas, with the target of producing a cost effective real time demonstration at the projects conclusion. A number of mechanisms are being investigated within the project and image processing is taking a leading role in the development of wide area monitoring and counting systems. This report will describe the image processing work performed by the authors in fulfillment of the project.

Multipoint videoconferencing is a natural evolution of two-point videoconferencing and can increase its value to users. Currently, ITU-T's SG8 and SG15 are working on multipoint control related issues; ANSI's T1A1.5 is also working in this area. The video coding and related communication standards of the upcoming MPEG4 and H.26P will all include multipoint communication capability. This paper investigates transport structures and the associated combining schemes that can be used to support multipoint videoconferencing. Since low delay is a major issue for multipoint interactive communications, a distributed structure which renders the lowest delay with many other system advantages is especially investigated. We first analyze the insertion delay of a QCIF combiner bridge which have been proposing for multipoint videoconferencing. Partial input-output pipelining has been used to reduce the delay. To reduce the insertion delay caused by unevenly distributed inputs, a parallel parsing scheme is proposed. This parallel parsing scheme allows low complexity inputs not to be held up by high complexity inputs and can reduce insertion delay significantly. An efficient delay- reduction algorithm using intraslice coding was also cited in a previous proposal. As a comparison, we describe low delay pel-domain transcoding schemes which have similar delay performance with coded-domain combining but have much higher complexities. We also describe a recent proposal which eliminates most of the insertion delay but which require major changes to existing standards and encoder and decoder implementations. The performance of a distributed transport structure in providing multipoint video services is then investigated. Using the face that bandwidth usage is an important factor in estimating network complexity, it is shown that a distributed transport structure saves 40 to 62.5% bandwidth for a 4-point conferencing and also renders the shortest delay when compared with other center- bridged structures. We then discuss multipoint control and decoder implementations using the distributed transport structure. It is shown that a parallel decoding structure can be used to combine multiple inputs to realize a short delay which is identical to the delay of a two-point conference. The complexity of this special decoder, though, is larger than a regular decoder. A cascaded combiner-decoder at the user site is then shown to make a good compromise between implementation complexity, bandwidth efficiency and delay performance.

In this work, we present several methods of reduction of specific distortions such as `blocking effect', `staircase structure' and `details blurring' accompanying vector quantization (VQ) process in coding both still and moving pictures. These methods include: (1) the overlap method in forming and rebuilding blocks (vectors); (2) the classified vector quantization based on a composite source model supplying with better perceptual quality of reconstructed images; (3) adaptive VQ with Discrete Cosine-III Transform, which gives better performances than VQ with standard Discrete Cosine Transform; (4) the 3D vector quantizer giving the possibility of exploiting both intra- and inter-frame correlations in image sequence coding and thus resulting in higher reconstruction quality, even at a very low bit rate. Moreover, a large codebook built partially outside training is used to encode the image sequence. The 3D VQ gives the possibility of reducing the annoying floating noises in image sequence coding. At last we proposed an algorithm for VQ with channel coding (for Gaussian channel). In the first experiment we used Phase Shift Keying (PSK), in the other experiment we used Minimum Shift Keying and error correcting convolutional codes (66,35) which gives superbly better performances than with PSK.

Baseband image communication systems using code division multiple access are proposed. We investigate such a system using fixed-length pseudonoise (PN) codes and one using variable- length PN codes. We can find that the number of channels can be reduced when the latter is employed. Such a situation leads us to employ chaotic sequences, whose code-lengths can be arbitrarily chosen, for such variable-length PN codes.

A well-designed visual communication channel is one which transmits the most information about a radiance field with the fewest artifacts. The role of image processing, encoding and restoration is to improve the quality of visual communication channels by minimizing the error in the transmitted data. Conventionally this role has been analyzed strictly in the digital domain neglecting the effects of image-gathering and image-display devices on the quality of the image. This results in the design of a visual communication channel which is `suboptimal.' We propose an end-to-end assessment of the imaging process which incorporates the influences of these devices in the design of the encoder and the restoration process. This assessment combines Shannon's communication theory with Wiener's restoration filter and with the critical design factors of the image gathering and display devices, thus providing the metrics needed to quantify and optimize the end-to-end performance of the visual communication channel. Results show that the design of the image-gathering device plays a significant role in determining the quality of the visual communication channel and in designing the analysis filters for subband encoding.

A new DCT/IDCT architecture capable of handling higher input/output data rates has been proposed. In the proposed architecture, the 8-point input data vector for DCT/IDCT is divided into two 4-point data vectors, the even part and the odd part. These two parts are parallelly processed. As a result, the 8-point DCT/IDCT is completed for 4 clock cycles, while the conventional DCT/IDCT processors need 8 clock cycles. Therefore, our novel DCT/IDCT architecture achieves twice higher data rates, which is useful for the applications like the real- time HDTV. For the purpose of reducing the hardware size, we replaced the Modified Booth Multiplier by the Pre-Rounded Multiplier, in which some lower significant bits of partial sums are rounded before summations. To achieve high data rates, multipliers and accumulators were composed of Carry Save Adders and Pipeline Registers. Although the proposed DCT/IDCT architecture has a larger chip size than the one based on the Distributed Arithmetic method, the size is reasonable in 1.0 micrometers CMOS technology. In spite of a larger chip size, the proposed architecture can achieve higher data rates and high accuracy. The high regularity of the proposed architecture is also appropriate for VLSI implementation.

Methods for reliable transmission of information, especially digital television, are considered. In the broadcast channel, several different receiver configurations and channel conditions make an optimization of the channel coding practically impossible. To efficiently utilize available spectrum and to allow robust reception in adverse channel conditions, joint source- channel coding is applied. This is achieved utilizing multiresolution modulation combined with unequal error protection in the channel coding part and data prioritization in source coder. These design parameters for the joint system are considered. The emphasis of this paper is on the modulation part. Multiresolution 32 QAM is presented. Simulations show good performance in the additive white gaussian noise channel and, moreover, results in multipath fading channel are encouraging as far as high priority level of the data is considered.

This paper presents the principle to enhance the spatial 2D resolution of spatial 2D resolution and the possibility of available limitation of maximum resolution. The paper also reports on image signal processing for 2D high definition pictures and the hanging-up piezoelectric bimorph construction designed to improve both horizontal and vertical resolution respectively by one time. The regenerated signal can be compatible with current TV mode.

This paper examines a super-exponential method for blind deconvolution. Possibly non- minimal phase point spread functions (PSFs) are identified. The PSF is assumed to be low pass in nature. No other prior knowledge of the PSF or the original image is necessary to assure convergence of the algorithm. Results are shown using synthetically degraded satellite images in order to demonstrate the accuracy of the PSF estimates. In addition, radiographic images are restored with no knowledge of the PSF of the x-ray imaging system. These experiments suggest a promising application of this algorithm to a variety of blur identification problems.

This paper is concerned with the data compression and interpolation of multi-view image. In this paper, we formulate the compression and interpolation problem of 3D image and propose a novel coding scheme of autostereoscopic 3D images. First, we introduce a general representation of an autostereoscopic 3D image and explain the concept of `space coding'. In this concept, multi-view image can be regarded as sampled data of the `space', and the objective of transmitting multi-view image can be considered as the reconstruction of the `space' in the remote site. From this viewpoint, we then examine the 3D structure extraction coding. In the experiment, we assume a simple wireframe model and evaluate the coding efficiency in terms of the bit rate and SNR is decoded images. Finally, we report the experiment, where two sets of multi-view images were used as original images and the amount of data was reduced to 1/20 with SNR 34 dB.

We address the problem of the display of vector valued images, also known as vector fields or multiparameter images, in which a vector of data, rather than a scalar, is associated with each pixel of a pixel grid. Each component of the vector field defines a gray-scale image on the pixel grid. Vector fields usually arise when more than one physical property (henceforth an attribute) is measured for the object being imaged. Mapping the measured values of any one attribute to gray-scale on a pixel grid defines an image. The collection of these images then defines a vector field, with a vector of attributes, corresponding to each pixel. The object usually consists of several disjoint regions, each made up of a region type, which we shall call a class. A set of attributes separates the classes (and therefore also the regions) if, for any two different classes, there exists an attribute in the set that has distinct values for the two. We refer to a pixel grid where the pixels are labeled as belonging to different regions as an Underlying Image (UI) . Vector fields arise naturally in any application that involves the display of multiparameter data, or multisensor fusion, as surveyed in [1], the classical example being multispectral satellite images. Once we have a vector field of an object consisting of measurements of a set of attributes that separate all of the classes in the object, we have the potential to distinguish between all of its regions. Regardless of the ultimate goal of the specific imaging application, most applications share a common intermediate goal, which is the one we address: to present a specialist human observer with an image that will maximize his chances to classify correctly the image pixels into different regions, that is, segment the image. Unfortunately, the human observer is inefficient at assimilating and intergrating multidimensional data, and traditional methods like the parallel display of the component images are often misleading, as demonstrated by an example in [1]. Another technique for vector field visualization is automatic image segmentation, which suffers from a serious drawback. Our premise is that the specialist human observer should be able to bring to bear all his prior knowledge and experience, which are difficult to capture in a computer program, on the final analysis process. This specialized prior knowledge could include information about the spatial structure of the different regions in the image, the contrast levels between the various regions and the within-region variability. An automatically segmented image would deprive the specialist of a chance to apply this knowledge, and result in inferior performance in many situations. Instead, we have recently proposed [1] an approach involving the fusion of the vector field into a single most informative gray-scale image. This is done by finding linear combinations of the component images of vector field that yield images with high discriminating power. (See also [2, 3]). We note that, although the problem is closely related to the classical problem of optimum feature extraction, our approach is non-classical. It explicitly takes into account the spatial structure of the data. This paper concentrates on the quantitative analysis and objective performance evaluation of the proposed algorithms.

Multimedia and Picture Archiving and Communication System (PACS) applications require efficient ways of handling images for communication and visualization. In many Visual Information and Management Systems (VIMS), it may be required to get quick responses to queries. Usually, a VIMS database has a huge number of images and may provide lots of images for each query. For example, in a PACS, the VIMS provides 10 to 100 images for a typical query. Only a few of these images may actually be needed. In order to find the useful ones, the user has to preview each image by fully decompressing it. This is neither computationally efficient, nor user friendly. In this paper, we propose a scheme which provides a magnifying glass type previewing feature. With this method, a multiresolution previewing without decompressing the whole image is possible. Our scheme is based on block transform coding which is the most widely used technique in image and video coding. In the first step of our scheme, all of the queried images are displayed in the lowest possible resolution (constructed from the DC coefficients of the coded blocks). If the user requests more information for a region of a particular image by specifying its size and place, then that region is hierarchically decompressed and displayed. In this way, large amounts of computations and bandwidth usage are avoided and a good user interface is accomplished. This method changes the ordering strategy of transform coefficients, thus reduces the compression ratio, however this effect is small.

This paper considers perfect reconstruction lattice filter banks. When optimizing for coding gain the purpose is to find a simple perfect reconstruction structure with few multiplication and reasonable gain. We present such a system which also possesses a certain regularity when expanding from N to 2N channels. Results including both obtained gain and the number of filter multiplications and filter magnitude responses are presented. The results show that the system gives strange filter responses, but good coding gain considering the number of multiplications.

In applications that demand highly detailed images, it is often not feasible or sometimes possible to acquire images of such high resolution by just using hardware (high precision optics and charge coupled devices). Instead, image processing approaches can be used to construct a high resolution image from multiple, degraded, low resolution images. It is assumed that the low resolution images have been subsampled (thus introducing aliasing) and displaced by sub-pixel shifts with respect to a reference frame. Therefore, the problem can be divided into three sub-problems: registration (estimating the shifts), restoration, and interpolation. None of the methods which appeared in the literature solve the registration and restoration sub-problems simultaneously. This is sub-optimal, since the registration and restoration steps are inter-dependent. Based on previous restoration and identification work using the Expectation-Maximization algorithm, the proposed approach estimates the sub-pixel shifts and conditional mean (restored images) simultaneously. In addition, the registration and restoration sub-problems are cast in a multi-channel framework to take advantage of the cross- channel information. Experimental results show the validity of this method.

Recently, there has been growing interest in the use of mean field theory (MFT) in Markov random field (MRF) model-based estimation problems. In many image processing and computer vision applications, the MFT approach can provide comparable performance to that of the simulated annealing, but requires much less computational effort and has easy hardware implementation. The Gibbs-Bogoliubov-Feynman inequality from statistical mechanics provides a general, systematic, and optimal approach for deriving mean field approximations. In this paper, this approach is applied to two important classes of MRF's, the compound Gauss-Markov model and the vector Ising model. The results obtained are compared and related to other methods of deriving mean field equations. Experimental results are also provided to demonstrate the efficacy of this approach.

This study presents design of 2D nonseparable Perfect Reconstruction Filter Bank (PRFB) for two different sampling lattices: the quincuncial and rectangular. In quincunx case z-domain PR conditions are mapped into Bernstein-x domain. Desired power spectrum of 2D nonseparable filter is approximated by using Bernstein polynomial. Since we introduce mapping from complex periodic domain to real polynomial domain, PRFB design in Bernstein-x domain is much easier to handle. The parametric solution for 2D nonseparable design technique is obtained with desired regularity for quincunx sampling lattices. This technique allows us to design of 2D wavelet transform. For rectangular downsampling, the use of signed shuffling operations to obtain a PRFB from a low pass filter enables the reduction of PR conditions. This design technique leads us to efficient implementation structure since all the filters in the bank have the same coefficients with sign and position changes. This structure overcomes the high complexity problem that is the major shortcoming of 2D nonseparable filter banks. Designed filter banks are tested on 2D image models and real images in terms of compaction performance. It has been shown that nonseparable design can outperform separable ones in the application of data compression.

A 3D relational image matching/fusion algorithm is introduced. It is implemented in the domain of medical imaging and is based on Artificial Intelligence paradigms--in particular, knowledge base representation and tree search. The 2D reference and target images are selected from 3D sets and segmented into non-touching and non-overlapping regions, using iterative thresholding and/or knowledge about the anatomical shapes of human organs. Selected image region attributes are calculated. Region matches are obtained using a tree search, and the error is minimized by evaluating a `goodness' of matching function based on similarities of region attributes. Once the matched regions are found and the spline geometric transform is applied to regional centers of gravity, images are ready for fusion and visualization into a single 3D image of higher clarity.

This study uses Computed Tomography (CT) for reconstructing images of solid propellant rocket motors during static firing tests. Implementation, verification and comparison of four CT algorithms are presented. These four algorithms are: Algebraic Reconstruction Technique, Linear Superposition with Compensation, and Fourier Convolution technique with parallel beams and fan-beam. The phantom used in the comparison between algorithms is similar in cross-section to a solid propellant rocket motor. Comparison between algorithms on the ability to detect artifacts is made. Also, a comparison is made using data obtained by optical tomography of the absorption coefficient inside a 20 mm gas gun barrel. Finally, a comparison of the running time versus number of projections, number of ray sums, and resolution is studied.

In this paper we present a new fully automatic method to quantify the motion of the left ventricle in a 2D echocardiographic image sequence. The approach is based on a matched filter which is designed to give a strong response at the curved boundary. This type of filter is used to detect boundary points on the left ventricle cavity wall for any selected (tangent) directions with high reliability in the presence of noise. The algorithm is divided into two stages. In the first stage the estimated cavity center point is identified by processing a sequence of frames corresponding to about one half of the heart beat cycle. In the second stage, two boundary points are located in each frame of the image sequence. The algorithm has been applied two different image sequences, a short-axis view and a long axis view, both of which are quite noisy. The results show accurate tracking of specific tangent points on the endocardial boundary, without any user intervention being required.

A theoretical frame work for rate-constrained motion estimation is introduced. The best trade- off between displacement vector rate and prediction error rate is shown to be the point were the partial derivatives of the multivariate distortion rate function are equal. Low bit-rate coders are severely rate-constrained, and coarser motion compensation is appropriate for lower bit- rates. A new region-based motion estimator builds a tree of nested regions from back to front, where each region is encoded by a closed B-spline contour. The rate-constraint is a natural termination criterion when building the region tree. Experimental results show that rate- constrained motion compensation is superior to a full-search block matching scheme when incorporated into a motion-compensating hybrid coding scheme, yielding up to 3 dB SNR improvement at 15 kbps.

Historically. progress in image coding tecliniqnes has been made by incorporating resnits from other fields SUCh as information theory. Most of the existing coding methods such as predictive coding. transform coding, and vector quantization belong to information-theory-based methods in which image signals are considered as ranidoni signals aiid compressed by exploiting their stochastic properties. Apart from these iiiformation-tlieoretic coding iniethods, research on new approaches such as modelbased coding (which is related to 1)0th image analysis and computer graphics) has recently intensified. An essential difference between conventional coding methods and these new approaches is the image model they assume. Contrary to conventional coding methods which efficiently represent 2-D waveforms of image signals model-based co ding represent iniage signals using structural image models which take into accomit the 3-D properties of the scene in some sense. There have been two major approaches to model-based image coding. One approach uses general niodels such as planar patches and sniooth surfaces to represent the 3-D properties of the oI)jects [11, 19, 28. 31, 33. 36, 39. 40, 43]. The other approach utilizes detailed 1)arameterized 3-D object models such as a parameterized facial model [2. 6, 13. 15. 17, 22. 24. 2G. 32, 35. 41. 47, 48. 49. 51. 54]. TIne former approach has been discussed in the context of advanced motion compensation. The latter approach is clearly different from the conventional approaches. since it uses an explicit 3—D model and encodes images with coniputer—vision— Oiieiite(il tecliniques an(I 1eJ)1()(luces iniages with colnj)uter—grapllics—oriented techniques . Both approaches will potentially achieves very low l)it rate video compression. Iii the following sectionis. unage co(ling schemes are described froni the point of view of their associated image IIli)delS. Amoiig our works related to these paradignins in the Univ. of Tokyo [2. 3, 4. 8, 9, 10, 36, 41 42. 40]. 3-D model-based coding and 2-D deforniable triangle based niotion compensation are described.

High-compression video coding at very low bit rates has recently received much attention in academia, industry, and standard bodies. ISO/IEC/JTC1/SC29 has recently started a new initiative for very low bitrate coding of audio and video information (MPEG 4). ITU-T (formerly CCITT) SG 15/WP15/1, targeted primarily at video-telephony applications, has outlined near-term (H.VLC/N) specifications for audio/video coding, data interface, multiplexing, error control, modem, and overall system integration. This paper presents a new approach for very low bit rate video coding based on generic vector mapping and quantization (GVMQ). The vector mapping (VM) can be considered as an extension to the existing pixel- based mapping techniques, in which pixel-based operation is replaced by vector-based operations. Since VM intends to preserve the internal correlation structure within a vector while decorrelating different vectors, the subsequent VQ becomes highly efficient, recalling the fact that better VQ performance can be achieved when inter-vector correlation is reduced while intra-vector correlation is preserved. Two examples of the GVMQ for image coding are Vector Transform Coding (VTC) and Vector Subband Coding (VSC), developed previously by the authors. VTC and VSC can also be considered as extensions of DCT and subband coding to vector forms. From the preliminary study, we feel that GVMQ presents a promising approach to very low bit rate coding. It can be considered as a bridge between the conventional coding schemes and the object-oriented representation. The scheme is being further optimized for submission to relevant standard bodies including ISO/IEC/JTC1/SC29 and ITU-T SG 15.

Following the development of digital communications, focus is now on interactive multimedia services on telephone networks. To provide such applications, very low bit rate video coding algorithms have to be designed and optimized. A standardization process is being started within MPEG under the MPEG-4 denomination, to build a generic scheme for bit rates from 10 to 64 kbit/s. The Laboratories d'Electronique Philips are currently involved in European projects which are devoting their efforts to the elaboration of a common European proposal towards MPEG-4. This paper gives an overview of the research status on very low bit rate video coding within Philips and within Europe. Most of the European studies are concerned with region based compression technique; emphasis will therefore be put on the two major algorithms enhancing this technique.

This paper describes a spatio-temporal segmentation of image sequences for object-oriented low bit rate image coding. The spatio-temporal segmentation is received by merging the spatial homogeneous regions into motion homogeneous ones. Each of these regions is characterized by a motion parameters vector and structural information which represents a polygonal approximation of region border. The segmentation of the current frames in the sequence is obtained by prediction and refinement. A predictive coding scheme is developed. Some estimates of the quantity of information are given.

The model-based image coding open up a wide aspect of applications in very/ultra low bit rate transmissions such as video telephone/teleconference and multimedia communication etc. This paper proposed a new scheme of model-based image sequence coding based on interframe AUs correlation which would be suitable for very/ultra low bit rates transmission. A new criteria based on Cauchy-Schwaz-Inequality for facial expressions, a fast automatic face feature point extraction method for real time applications and the method of AUs separation of a face on various expressions had been given. In this paper, the deformable model controlled by motion compensation, expressive facial images synthesized by given AUs and knowledge base were realized. The results of computer simulation are given.

This paper shows that performance improvements are possible if different filter banks in the different levels, even in the nodes, of a subband tree are used. A progressive optimization technique is proposed for fine tuning of the product subband filters in a tree structure. The time and frequency properties of product subband filters are evaluated and comparisons made.

This paper proposes a fast splitting algorithm (FSA) for a signal that when combined with an optimally criterion defined in the frequency domain leads to coherent tilings of the time- frequency plane. For a given set of basis regions formed by allowed subsets of the signal and a cost function defined over this set, we find the minimum cost cover of the signal by means of a fast algorithm. We show how when an additive cost measure is defined over the subband decomposition induced by a given filter bank, the method admits a solution in the form of a progressive orthogonal tiling. When progressive conditions are verified this method can be modelled with simple structures such as trellis diagrams or ordinary Petri nets. The extension of this method to bidimensional signals and conditions for fast algorithms are also discussed. The set of partitions obtained by the double tree algorithm is included in those considered by the FSA, allowing the later better signal analysis. We also present two approaches that reduced properly the complexity of the FSA maintaining the improvements of the method. The first one is based in constraining the set of basis regions to those with dyadic support, while the second one bounds the maximum support of basis regions.

The paper investigates the design of filter banks generating the optimal signal representation by M-band one-dimensional and multi-dimensional biorthogonal wavelet frames. Criterion of optimality is the minimization of the average mean-square approximation error at each level of the decomposition. Preliminary results of the application of such filter banks to two- dimensional image compression are included.

The matrix algebra approach was previously applied in the analysis of the continuous Gabor representation in the Zak transform domain. In this study we analyze the discrete and finite (periodic) scheme by the same approach. A direct relation that exists between the two schemes, based on the sampling of the Zak transform, is established. Specifically, we show that sampling of the Gabor expansion in the Zak transform domain yields a discrete scheme of representation. Such a derivation yields a simple relation between the schemes by means of the periodic extension of the signal. We show that in the discrete Zak domain the frame operator can be expressed by means of a matrix-valued function which is simply the sampled version of the matrix-valued function of the continuous scheme. This result establishes a direct relation between the frame properties of the two schemes.

The standard way to obtain suitable coefficients for the (non-orthogonal) Gabor expansion of a general signal for a given Gabor atom g and a pair of lattice constants in the (discrete) time/frequency plane, requires to compute the dual Gabor window function g^- first. In this paper, we present an explicit description of the sparsity, the block and banded structure of the Gabor frame matrix G. On this basis efficient algorithms are developed for computing g^- by solving the linear equation g^- * G equals g with the conjugate- gradients method. Using the dual Gabor wavelet, a fast Gabor reconstruction algorithm with very low computational complexity is proposed.

The library of orthonormal bases includes Short Time Fourier Transform and Wavelet Transform bases. The widely-used DFT lacks flexibility in dealing with signals possessing a time-varying spectrum. Such signals require a variable time-frequency-localizability feature for adequate resolution. In this paper, we introduce new orthonormal transforms which are constructed from the DFT yet have variable time-frequency-localizability feature and fast computing capability. We create a framework for constructing Time Localization Linear Transform (TLLT) upon the concept that time localizability can be recovered by inverse transform of selected partial collection of forward transform coefficients. By coding the coefficients of TLLT, we can combine the adaptability of Vector Quantization with the speed of linear transform.

The paper investigates the design of minimum-variance perfect reconstruction filter banks for use in image compression applications. These filter banks are formed so that the variance of the difference between input and output of each band is minimized. This has the effect of minimizing the error occurring when only one of all filter banks is retained and the rest are omitted. The paper presents a method for the design of such banks so as to achieve in each band minimum variance and a linear-phase realization appropriate for application to images. Some results of the actual implementation of these filter bands to image compression are included.

The guiding principle of this study is to find an optimum way to simplify the contours produced by a second generation coding scheme based on morphological segmentation. For this purpose, evaluations of existing methods for contour simplification are carried out first. Based on the human visual phenomenon, a new nonlinear filter by means of majority operation is designed to simplify the contours in order to obtain an optimum compromise between the cost for contour coding and visual quality. Applications for region-based still image coding and video coding are demonstrated. Experimental results have shown an average of 20% reduction of bits for contour coding while keeping good visual quality.

Linear predictive techniques perform poorly when used with color mapped images as there is no linear relationship between neighboring pixels values. Re-ordering the color table, however, can lead to a lower entropy of prediction errors. The problem of ordering the color table such that the absolute weight of the prediction errors is minimized turns out to be intractable. In fact, even for the simplest prediction scheme that uses the value of the previous pixel for the current pixel, the problem of obtaining an optimal ordering turns out to be the optimal linear arrangement problem. The optimal rearrangement problem can be abstracted as a graph problem, and is known to be intractable. We give two heuristics for the problem and use them for ordering the color table of a color mapped image. The first heuristic is based on the famous network flow problem and is computationally expensive. The second heuristic involves successive transposition of color table entries and is simple in terms of implementation and time complexity. Simulation results giving comparison of the two heuristics are presented. Application of the ordering techniques to lossless compression of gray scale image data is also presented. Re-ordering intensity values for images sometimes leads to significant improvements in compression rates. For example, improvements of almost one bit per pixel were obtained with the well known USC-Girl image. Simulation results for a set of standard images are presented.