A hybrid data compression approach for online backup service

Hua Wang; Ke Zhou; MingKang Qin

doi:10.1117/12.843524

23 October 2009 A hybrid data compression approach for online backup service

Hua Wang, Ke Zhou, MingKang Qin

Proceedings Volume 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies; 751703 (2009) https://doi.org/10.1117/12.843524
Event: Photonics and Optoelectronics Meetings 2009, 2009, Wuhan, China

Abstract

With the popularity of Saas (Software as a service), backup service has becoming a hot topic of storage application. Due to the numerous backup users, how to reduce the massive data load is a key problem for system designer. Data compression provides a good solution. Traditional data compression application used to adopt a single method, which has limitations in some respects. For example data stream compression can only realize intra-file compression, de-duplication is used to eliminate inter-file redundant data, compression efficiency cannot meet the need of backup service software. This paper proposes a novel hybrid compression approach, which includes two levels: global compression and block compression. The former can eliminate redundant inter-file copies across different users, the latter adopts data stream compression technology to realize intra-file de-duplication. Several compressing algorithms were adopted to measure the compression ratio and CPU time. Adaptability using different algorithm in certain situation is also analyzed. The performance analysis shows that great improvement is made through the hybrid compression policy.

Citation Download Citation

Hua Wang, Ke Zhou, and MingKang Qin "A hybrid data compression approach for online backup service", Proc. SPIE 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies, 751703 (23 October 2009); https://doi.org/10.1117/12.843524

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available