Web Content Extraction Based on Tag-Row-Block Web Mining

Authors

  • T. Velumani Assistant Professor, Department of Computer Science, Kongu Arts and Science College (Autonomous), Erode, Tamil Nadu, India. EMAIL: velumani46[at]gmail[dot]com

Abstract

Information retrieval and Web mining are closely related to the content of Web pages. Due to the rapid development of Web technology, some previous automatic Web content extraction methods are no longer well suited to the current situation. Therefore, this paper proposes a universal content extraction method (CETRB) based on Tag-Row-Block, which is suitable for the current environment. The CETRB method, which combines the visual features and functional features of HTML tags with the row-block distribution function, further improves the precision, recall, and extraction efficiency of the existing Web content extraction methods, and solves the problems of manual threshold setting and universality of multi-source information. Our empirical study on different types of real-world Web pages demonstrates that the method we proposed has great extraction effect and high efficiency for single-content and multi-content pages, English and Chinese pages. It also supports the extraction of multimedia information, and the display effect is consistent with the original semantics, which can provide a comfortable reading experience. At the same time, we conducted the same experiments using the current popular Chinese extraction method Cx-Extractor and the English extraction method Readability. The conclusion is that our proposal outperforms them in terms of precision and recall, and is superior to the Readability method in terms of extraction efficiency. At the same time, it has great advantages in terms of universality and user reading experience.

Keywords:Content extraction, information retrieval, Web data mining, knowledge-based Systems, Web Content.

Cite this Article: T. Velumani. Web Content Extraction Based on Tag-Row-Block Web Mining. Journal of Web Engineering & Technology. 2020; 7(2): 18–31p.

Downloads

Published

2020-08-11

Issue

Vol. 7 No. 2 (2020)

Section

Research Articles

License


Declaration and Copyright Transfer Form

(to be completed by authors)

I/ We, the undersigned author(s) of the submitted manuscript, hereby declare, that the above manuscript which is submitted for publication in the STM Journals(s), is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere.

  • I/We will not withdraw the manuscript after 1 week of submission as I have read the Author Guidelines and will adhere to the guidelines.
  • I/We Author(s ) have niether given nor will give this manuscript elsewhere for publishing after submitting in STM Journal(s).
  • I/ We have read the original version of the manuscript and am/ are responsible for the thought contents embodied in it. The work dealt in the manuscript is my/ our own, and my/ our individual contribution to this work is significant enough to qualify for authorship.
  •  I/We also agree to the authorship of the article in the following order:

Author’s name                                    

 

1. ________________

2. ________________

3. ________________

4. ________________

We  Author(s) tick this box and would request you to consider it as our signature as we agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal.