Transformer couplet generation model based on joint word segmentation

Zhong Shao; Hongyu Fang

doi:10.1117/12.2627659

11 March 2022 Transformer couplet generation model based on joint word segmentation

Zhong Shao, Hongyu Fang

Proceedings Volume 12160, International Conference on Computational Modeling, Simulation, and Data Analysis (CMSDA 2021); 121600E (2022) https://doi.org/10.1117/12.2627659
Event: International Conference on Computational Modeling, Simulation, and Data Analysis (CMSDA 2021), 2021, Sanya, China

Abstract

Chinese couplet is an art form with concise and strict antithesis. Given a sentence (namely an antecedent clause), people reply with another sentence (namely a subsequent clause) equal in length. It has made the machine-generated couplets readable and consistent for the result of existing deep learning methods. However, the generation process is character based which is different from the word-based use of Chinese. It is still a gap in semantic consistency between the results and the artificial creation. In this paper, a joint word segmentation of couplet is designed for the symmetry of couplet word segmentation results, and a word-based transformer couplet generation model is built to improve the semantic coherence of subsequent clauses generated. Moreover, word count information and part of speech information are added into the word vectors to provide the features of generating. Finally, the effectiveness of our model was confirmed in BLEU, Perplexity and human evaluation.

Citation Download Citation

Zhong Shao and Hongyu Fang "Transformer couplet generation model based on joint word segmentation", Proc. SPIE 12160, International Conference on Computational Modeling, Simulation, and Data Analysis (CMSDA 2021), 121600E (11 March 2022); https://doi.org/10.1117/12.2627659

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available