Real-time video super-resolution reconstruction using wavelet transforms and sparse representation

Yeredith G. Mora-Martinez; Volodymyr I. Ponomaryov; Beatriz P. Garcia-Salgado; Rogelio Reyes-Reyes; Clara Cruz-Ramos

doi:10.1117/12.2665401

7 June 2023 Real-time video super-resolution reconstruction using wavelet transforms and sparse representation

Yeredith G. Mora-Martinez, Volodymyr I. Ponomaryov, Beatriz P. Garcia-Salgado, Rogelio Reyes-Reyes, Clara Cruz-Ramos

Proceedings Volume 12571, Real-time Processing of Image, Depth and Video Information 2023; 1257106 (2023) https://doi.org/10.1117/12.2665401
Event: SPIE Optics + Optoelectronics, 2023, Prague, Czech Republic

Abstract

Video super-resolution reconstruction consists of generating high-resolution frames by processing low-resolution ones. This process enhances the video quality, allowing the visualisation of fine details. Moreover, it can be considered a primary step in a video processing pipeline for further applications, such as object detection, classification and tracking from uncrewed aerial vehicles (UAV). For this reason, the super-resolution process should be performed quickly and accurately. Implementing a real-time video super-resolution method through parallel programming contributes to the efficiency of this pipeline. This work proposes two parallel super-resolution approaches for videos taken from UAVs: one using multi-core CPUs and another on a GPU architecture. The method is based on sparse representation and Wavelet transforms. First, it makes an edge correction performed in the Wavelet domain, then employs dictionaries previously trained with k-Singular Value Decomposition (k- SVD) to reconstruct the Wavelet subbands of the frames, and the high-resolution frames are computed from the Inverse Discrete Wavelet Transform (IDWT). The performance of this method was measured with the Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM) and Edge Preservation Index (EPI). The implementations are tested in a workstation with a Ryzen multi-core processor and a CUDA-enabled GPU; furthermore, they are compared with the non-parallel method regarding algorithm complexity and computing time.

Conference Presentation

Citation Download Citation

Yeredith G. Mora-Martinez, Volodymyr I. Ponomaryov, Beatriz P. Garcia-Salgado, Rogelio Reyes-Reyes, and Clara Cruz-Ramos "Real-time video super-resolution reconstruction using wavelet transforms and sparse representation", Proc. SPIE 12571, Real-time Processing of Image, Depth and Video Information 2023, 1257106 (7 June 2023); https://doi.org/10.1117/12.2665401

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available