ESSM: an extractive summarization model with enhanced spatial-temporal information and span mask encoding

Ran Li; Fengbo Zheng; Gongbo Liang; Lifen Jiang; Panpan Wu; Bowei Chen

doi:10.1117/12.2656799

20 October 2022 ESSM: an extractive summarization model with enhanced spatial-temporal information and span mask encoding

Ran Li, Fengbo Zheng, Gongbo Liang, Lifen Jiang, Panpan Wu, Bowei Chen

Author Affiliations +

Proceedings Volume 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022); 124514A (2022) https://doi.org/10.1117/12.2656799
Event: 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 2022, Chongqing, China

Abstract

Extractive reading comprehension is to extract consecutive subsequences from a given article to answer the given question. Previous work often adopted Byte Pair Encoding (BPE) that could cause semantically correlated words to be separated. Also, previous features extraction strategy cannot effectively capture the global semantic information. In this paper, an extractive summarization model is proposed with enhanced spatial-temporal information and span mask encoding (ESSM) to promote global semantic information. ESSM utilizes Embedding Layer to reduce semantic segmentation of correlated words, and adopts TemporalConvNet Layer to relief the loss of feature information. The model can also deal with unanswerable questions. To verify the effectiveness of the model, experiments on datasets SQuAD1.1 and SQuAD2.0 are conducted. Our model achieved an EM of 86.31% and a F1 score of 92.49% on SQuAD1.1 and the numbers are 80.54% and 83.27% for SQuAD2.0. It was proved that the model is effective for extractive QA task.

Citation Download Citation

Ran Li, Fengbo Zheng, Gongbo Liang, Lifen Jiang, Panpan Wu, and Bowei Chen "ESSM: an extractive summarization model with enhanced spatial-temporal information and span mask encoding", Proc. SPIE 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 124514A (20 October 2022); https://doi.org/10.1117/12.2656799

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Computer programming

Data modeling

Performance modeling

Feature extraction

Convolution

Computer security

Lithium

Show All Keywords

Keywords/Phrases

Search In:

Publication Years