Missing data reconstruction method based on Kmeans and GBDT combined model

Jianbin Deng; Fusheng Li; Bin Guo; Ji Wang; Xingxing Feng; Ye Zhao; Fan Zhang

doi:10.1117/12.2640126

23 May 2022 Missing data reconstruction method based on Kmeans and GBDT combined model

Jianbin Deng, Fusheng Li, Bin Guo, Ji Wang, Xingxing Feng, Ye Zhao, Fan Zhang

Proceedings Volume 12254, International Conference on Electronic Information Technology (EIT 2022); 122542N (2022) https://doi.org/10.1117/12.2640126
Event: International Conference on Electronic Information Technology (EIT 2022), 2022, Chengdu, China

Abstract

Complete and available data is of great significance for improving the theoretical line loss calculation in the low-voltage transformer area. However, with the upgrading of equipment, the electrical data presents the characteristics of small granularity and high complexity, resulting in insufficient line loss calculation accuracy. This paper proposes a missing data reconstruction method based on Kmeans and GBDT combined model. Since it is difficult to unify the reconstruction models of different types of data, the data set is clustered and divided by Kmeans, and GBDT is used for training respectively. During the test, the corresponding GBDT model is used for reconstruction according to the sample category. The simulation results show that the proposed method is suitable for actual data and has higher reconstruction accuracy compared with the traditional mean filling, KNN and decision tree methods. The proposed method can reconstruct the missing of multiple datasets and has good generalization.

Citation Download Citation

Jianbin Deng, Fusheng Li, Bin Guo, Ji Wang, Xingxing Feng, Ye Zhao, and Fan Zhang "Missing data reconstruction method based on Kmeans and GBDT combined model", Proc. SPIE 12254, International Conference on Electronic Information Technology (EIT 2022), 122542N (23 May 2022); https://doi.org/10.1117/12.2640126

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Reconstruction algorithms

Transformers

Data communications

Statistical modeling

Computer simulations

Expectation maximization algorithms

Show All Keywords

Keywords/Phrases

Search In:

Publication Years