Translation-aware semantic segmentation via conditional least-square generative adversarial networks

Mi Zhang; Xiangyun Hu; Like Zhao; Shiyan Pang; Jinqi Gong; Min Luo

doi:10.1117/1.JRS.11.042622

Abstract

Semantic segmentation has recently made rapid progress in the field of remote sensing and computer vision. However, many leading approaches cannot simultaneously translate label maps to possible source images with a limited number of training images. The core issue is insufficient adversarial information to interpret the inverse process and proper objective loss function to overcome the vanishing gradient problem. We propose the use of conditional least squares generative adversarial networks (CLS-GAN) to delineate visual objects and solve these problems. We trained the CLS-GAN network for semantic segmentation to discriminate dense prediction information either from training images or generative networks. We show that the optimal objective function of CLS-GAN is a special class of

f

-divergence and yields a generator that lies on the decision boundary of discriminator that reduces possible vanished gradient. We also demonstrate the effectiveness of the proposed architecture at translating images from label maps in the learning process. Experiments on a limited number of high resolution images, including close-range and remote sensing datasets, indicate that the proposed method leads to the improved semantic segmentation accuracy and can simultaneously generate high quality images from label maps.

Citation Download Citation

Mi Zhang, Xiangyun Hu, Like Zhao, Shiyan Pang, Jinqi Gong, Min Luo, "Translation-aware semantic segmentation via conditional least-square generative adversarial networks," Journal of Applied Remote Sensing 11(4), 042622 (23 December 2017). https://doi.org/10.1117/1.JRS.11.042622 . Submission: Received: 17 June 2017; Accepted: 22 November 2017

Received: 17 June 2017; Accepted: 22 November 2017; Published: 23 December 2017

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $20.00

Non-members: $25.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years