A fusion network for semantic segmentation using RGB-D data

Jiahui Yuan; Kun Zhang; Yifan Xia; Lin Qi; Junyu Dong

doi:10.1117/12.2304501

10 April 2018 A fusion network for semantic segmentation using RGB-D data

Jiahui Yuan, Kun Zhang, Yifan Xia, Lin Qi, Junyu Dong

Proceedings Volume 10615, Ninth International Conference on Graphic and Image Processing (ICGIP 2017); 1061523 (2018) https://doi.org/10.1117/12.2304501
Event: Ninth International Conference on Graphic and Image Processing, 2017, Qingdao, China

Abstract

Semantic scene parsing is considerable in many intelligent field, including perceptual robotics. For the past few years, pixel-wise prediction tasks like semantic segmentation with RGB images has been extensively studied and has reached very remarkable parsing levels, thanks to convolutional neural networks (CNNs) and large scene datasets. With the development of stereo cameras and RGBD sensors, it is expected that additional depth information will help improving accuracy. In this paper, we propose a semantic segmentation framework incorporating RGB and complementary depth information. Motivated by the success of fully convolutional networks (FCN) in semantic segmentation field, we design a fully convolutional networks consists of two branches which extract features from both RGB and depth data simultaneously and fuse them as the network goes deeper. Instead of aggregating multiple model, our goal is to utilize RGB data and depth data more effectively in a single model. We evaluate our approach on the NYU-Depth V2 dataset, which consists of 1449 cluttered indoor scenes, and achieve competitive results with the state-of-the-art methods.

Citation Download Citation

Jiahui Yuan, Kun Zhang, Yifan Xia, Lin Qi, and Junyu Dong "A fusion network for semantic segmentation using RGB-D data", Proc. SPIE 10615, Ninth International Conference on Graphic and Image Processing (ICGIP 2017), 1061523 (10 April 2018); https://doi.org/10.1117/12.2304501

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

RGB color model

Image segmentation

Data fusion

Convolution

Data modeling

Image fusion

Computer programming

Show All Keywords

Keywords/Phrases

Search In:

Publication Years