An intelligent cloud-based neural network algorithm for cross-platform migration and deployment optimization

Qing Luo; Zhening Dong; Pengjiao Li

doi:10.1117/12.2681535

1 June 2023 An intelligent cloud-based neural network algorithm for cross-platform migration and deployment optimization

Qing Luo, Zhening Dong, Pengjiao Li

Author Affiliations +

Proceedings Volume 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023); 127182F (2023) https://doi.org/10.1117/12.2681535
Event: International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 2023, Nanjing, China

Abstract

With the emergence of AI application ecology, an increasing number of AI applications are being developed and deployed on end devices. For some applications, due to various reasons (such as delay, bandwidth and privacy issues), inference must be performed on the edge nodes. To realize the efficient deployment of multiple networks on different chips, this paper uses cloud service technology and container resource management technology to achieve cloud deployment and uses a variety of model optimization technologies, such as model format conversion, graph optimization, chip optimization, model low-precision calculation optimization, model cutting and distillation. To achieve the effect of saving considerable memory and reducing energy consumption on the premise of satisfying the accuracy.

Citation Download Citation

Qing Luo, Zhening Dong, and Pengjiao Li "An intelligent cloud-based neural network algorithm for cross-platform migration and deployment optimization", Proc. SPIE 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 127182F (1 June 2023); https://doi.org/10.1117/12.2681535

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available