Improved method of dialogue model based on character and word fusion

Qingli Yang; Zhiliang Wang; Ruoxiu Xiao

doi:10.1117/12.2685609

15 August 2023 Improved method of dialogue model based on character and word fusion

Qingli Yang, Zhiliang Wang, Ruoxiu Xiao

Proceedings Volume 12719, Second International Conference on Electronic Information Technology (EIT 2023); 127191U (2023) https://doi.org/10.1117/12.2685609
Event: Second International Conference on Electronic Information Technology (EIT 2023), 2023, Wuhan, China

Abstract

An important part of the dialogue robot is the understanding of semantics and the analysis of sentences. At present, most of the models are trained based on character vector and word vector. Compared with traditional models, this method can fully consider the long and irregular language characteristics of daily chit-chat dialogues, and make full use of character and word fusion to improve the dialogue performance of the model. At the same time, the word embedding matrix trained by the pre-trained model is calculated to obtain the same dimension as the character embedding. Then, the character vector and word vector are fused, and the transformer model is used for dialogue training. The experimental results show that the proposed method can better improve the understanding ability of the dialogue model.

Citation Download Citation

Qingli Yang, Zhiliang Wang, and Ruoxiu Xiao "Improved method of dialogue model based on character and word fusion", Proc. SPIE 12719, Second International Conference on Electronic Information Technology (EIT 2023), 127191U (15 August 2023); https://doi.org/10.1117/12.2685609

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available