An efficient method for extracting web news content

J. Sun; Luyang Tang; Dan Liao; Victor Chang

doi:10.1109/ICEngTechnol.2017.8308202

An efficient method for extracting web news content

J. Sun, Luyang Tang, Dan Liao, Victor Chang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.

Original language	English
Title of host publication	Proceedings of 2017 International Conference on Engineering and Technology, ICET 2017
ISBN (Electronic)	9781538619490
DOIs	https://doi.org/10.1109/ICEngTechnol.2017.8308202
Publication status	Published - 8 Mar 2018
Event	2017 International Conference on Engineering and Technology - UniversityAntalya, Antalya, Turkey Duration: 21 Aug 2017 → 23 Aug 2017

Conference

Conference	2017 International Conference on Engineering and Technology
Abbreviated title	ICET 2017
Country/Territory	Turkey
City	Antalya
Period	21/08/17 → 23/08/17

Access to Document

10.1109/ICEngTechnol.2017.8308202

Cite this

@inproceedings{6e466ac95a764c94ad8e1a7c03d340d1,

title = "An efficient method for extracting web news content",

abstract = "Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.",

author = "J. Sun and Luyang Tang and Dan Liao and Victor Chang",

year = "2018",

month = mar,

day = "8",

doi = "10.1109/ICEngTechnol.2017.8308202",

language = "English",

booktitle = "Proceedings of 2017 International Conference on Engineering and Technology, ICET 2017",

note = "2017 International Conference on Engineering and Technology, ICET 2017 ; Conference date: 21-08-2017 Through 23-08-2017",

}

TY - GEN

T1 - An efficient method for extracting web news content

AU - Sun, J.

AU - Tang, Luyang

AU - Liao, Dan

AU - Chang, Victor

PY - 2018/3/8

Y1 - 2018/3/8

N2 - Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.

AB - Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.

UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-85047858446&partnerID=MN8TOARS

U2 - 10.1109/ICEngTechnol.2017.8308202

DO - 10.1109/ICEngTechnol.2017.8308202

M3 - Conference contribution

BT - Proceedings of 2017 International Conference on Engineering and Technology, ICET 2017

T2 - 2017 International Conference on Engineering and Technology

Y2 - 21 August 2017 through 23 August 2017

ER -

An efficient method for extracting web news content

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this