Graphics to H.264 video encoding for 3D scene representation and interaction on mobile devices using region of interest

Minh Tuan Le; Congdu Nguyen; Dae-Il Yoon; Eun Ku Jung; Jie Jia; Hae-Kwang Kim

doi:10.1117/12.784010

9 January 2008 Graphics to H.264 video encoding for 3D scene representation and interaction on mobile devices using region of interest

Minh Tuan Le, Congdu Nguyen, Dae-Il Yoon, Eun Ku Jung, Jie Jia, Hae-Kwang Kim

Author Affiliations +

Proceedings Volume 6794, ICMIT 2007: Mechatronics, MEMS, and Smart Materials; 67943X (2008) https://doi.org/10.1117/12.784010
Event: ICMIT 2007: Mechatronics, MEMS, and Smart Materials, 2007, Gifu, Japan

Abstract

In this paper, we propose a method of 3D graphics to video encoding and streaming that are embedded into a remote interactive 3D visualization system for rapidly representing a 3D scene on mobile devices without having to download it from the server. In particular, a 3D graphics to video framework is presented that increases the visual quality of regions of interest (ROI) of the video by performing more bit allocation to ROI during H.264 video encoding. The ROI are identified by projection 3D objects to a 2D plane during rasterization. The system offers users to navigate the 3D scene and interact with objects of interests for querying their descriptions. We developed an adaptive media streaming server that can provide an adaptive video stream in term of object-based quality to the client according to the user's preferences and the variation of network bandwidth. Results show that by doing ROI mode selection, PSNR of test sample slightly change while visual quality of objects increases evidently.

Citation Download Citation

Minh Tuan Le, Congdu Nguyen, Dae-Il Yoon, Eun Ku Jung, Jie Jia, and Hae-Kwang Kim "Graphics to H.264 video encoding for 3D scene representation and interaction on mobile devices using region of interest", Proc. SPIE 6794, ICMIT 2007: Mechatronics, MEMS, and Smart Materials, 67943X (9 January 2008); https://doi.org/10.1117/12.784010

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available