Designed a web crawler which oriented network public opinion data acquisition

Shan Lu; Hui Ma; Ying Gao

doi:10.1117/12.2203492

3 December 2015 Designed a web crawler which oriented network public opinion data acquisition

Shan Lu, Hui Ma, Ying Gao

Proceedings Volume 9794, Sixth International Conference on Electronics and Information Engineering; 97940F (2015) https://doi.org/10.1117/12.2203492
Event: Sixth International Conference on Electronics and Information Engineering, 2015, Dalian, China

Abstract

The paper describes the meaning of network public opinion and the network public opinion research of data acquisition technique. Designed and implemented a web crawler which oriented network public opinion data acquisition. Insufficient analysis of the generic web crawler, using asynchronous Socket, DNS cache, and queue downloads to improve its bottom story frame, increase the speed of collecting.

Citation Download Citation

Shan Lu, Hui Ma, and Ying Gao "Designed a web crawler which oriented network public opinion data acquisition", Proc. SPIE 9794, Sixth International Conference on Electronics and Information Engineering, 97940F (3 December 2015); https://doi.org/10.1117/12.2203492

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available