Detecting student depression on Weibo based on various multimodal fusion methods

Yiming Luo; Zhanghao Ye; Rui Lyu

doi:10.1117/12.3027177

1 April 2024 Detecting student depression on Weibo based on various multimodal fusion methods

Yiming Luo, Zhanghao Ye, Rui Lyu

Proceedings Volume 13077, Fourth International Conference on Signal Processing and Machine Learning (CONF-SPML 2024); 130770M (2024) https://doi.org/10.1117/12.3027177
Event: 4th International Conference on Signal Processing and Machine Learning (CONF-SPML 2024), 2024, Chicago, IL, United States

Abstract

This study uses a multimodal fusion model for early student depression detection by analysing student data from Sina Weibo. It compares early and late fusion methods with traditional Natural Language Processing models and achieves a 3% accuracy improvement over 100 cycles. The study shows that standardising only structured data without neural network mapping reduces predictive performance. It was also found that while both fusion methods exhibited similar predictive capabilities, the late fusion model exhibited overfitting, suggesting that there is potential for the late fusion strategy to further improve model performance performance. This study summarises the ability of multimodal fusion models to effectively detect early signs of student depression and lays the foundation for future research on model interpretability for early student depression detection and future research on student behaviour analysis.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yiming Luo, Zhanghao Ye, and Rui Lyu "Detecting student depression on Weibo based on various multimodal fusion methods", Proc. SPIE 13077, Fourth International Conference on Signal Processing and Machine Learning (CONF-SPML 2024), 130770M (1 April 2024); https://doi.org/10.1117/12.3027177

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available