You have requested a machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Neither SPIE nor the owners and publishers of the content make, and they explicitly disclaim, any express or implied representations or warranties of any kind, including, without limitation, representations and warranties as to the functionality of the translation feature or the accuracy or completeness of the translations.
Translations are not retained in our system. Your use of this feature and the translations is subject to all use restrictions contained in the Terms and Conditions of Use of the SPIE website.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print format on
SPIE.org.
Abstract
While the noiseless coding theorem provides for the existence of a code that can achieve a rate equal to or approaching the entropy of a source, it unfortunately does not provide a means for constructing an actual code. Generally, variable-length codes are used together with source extensions to achieve the desired performance. In this chapter, we discuss the use and construction of variable-length codes for source encoding.
Consider an example in which a DMS S has four symbols, s 1 , s 2 , s 3 , and s 4 , with probabilities given in Table 3.1. We wish to construct an efficient code using a binary alphabet to encode this source. Our code should have some desired characteristics. For instance, each codeword in the sequence should be instantaneously decodable, i.e., decodable without reference to the succeeding codewords. A necessary and sufficient condition for constructing such codes is that no codeword be a prefix of some other codeword. Any code satisfying this condition is called a prefix condition code. Code I in Table 3.1, which is a fixed-length code, has an average length of 2 bits/symbol and is clearly a prefix condition code.
Online access to SPIE eBooks is limited to subscribing institutions.