Compressed data organization for high throughput parallel entropy coding

Amir Said; Abo-Talib Mahfoodh; Sehoon Yea

doi:10.1117/12.2191624

22 September 2015 Compressed data organization for high throughput parallel entropy coding

Amir Said, Abo-Talib Mahfoodh, Sehoon Yea

Proceedings Volume 9599, Applications of Digital Image Processing XXXVIII; 95991K (2015) https://doi.org/10.1117/12.2191624
Event: SPIE Optical Engineering + Applications, 2015, San Diego, California, United States

Abstract

The difficulty of parallelizing entropy coding is increasingly limiting the data throughputs achievable in media compression. In this work we analyze what are the fundamental limitations, using finite-state-machine models for identifying the best manner of separating tasks that can be processed independently, while minimizing compression losses. This analysis confirms previous works showing that effective parallelization is feasible only if the compressed data is organized in a proper way, which is quite different from conventional formats. The proposed new formats exploit the fact that optimal compression is not affected by the arrangement of coded bits, but it goes further in exploiting the decreasing cost of data processing and memory. Additional advantages include the ability to use, within this framework, increasingly more complex data modeling techniques, and the freedom to mix different types of coding. We confirm the parallelization effectiveness using coding simulations that run on multi-core processors, and show how throughput scales with the number of cores, and analyze the additional bit-rate overhead.

Citation Download Citation

Amir Said, Abo-Talib Mahfoodh, and Sehoon Yea "Compressed data organization for high throughput parallel entropy coding", Proc. SPIE 9599, Applications of Digital Image Processing XXXVIII, 95991K (22 September 2015); https://doi.org/10.1117/12.2191624

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available