New method of generating template from webpage structure
Yuncheng Du
Abstract
Yuncheng Du
Abstract
Web is a vast resource of information,but the main information on a web page is always hidden among unimportant features such as unnecessary images and extraneous links,which makes it difficult for the users to acquire the topical information.In order to automatically extract topical information from template-based web pages efficiently,a new template-generating method based on the structure analysis of HTML webpages is proposed in this paper.On the basis of document object model(DOM),the similarity of two pages can be calculated by analyzing their DOM tree hierarchy structure,then the similar pages in structure are put into a sample-collection,with which the structure-template of pages can be deduced with little effort.In this way,information from webpages can be extracted efficiently.The experiments indicate that the accuracy of this new method reaches 97%.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Web is a vast resource of information,but the main information on a web page is always hidden among unimportant features such as unnecessary images and extraneous links,which makes it difficult for the users to acquire the topical information.In order to automatically extract topical information from template-based web pages efficiently,a new template-generating method based on the structure analysis of HTML webpages is proposed in this paper.On the basis of document object model(DOM),the similarity of two pages can be calculated by analyzing their DOM tree hierarchy structure,then the similar pages in structure are put into a sample-collection,with which the structure-template of pages can be deduced with little effort.In this way,information from webpages can be extracted efficiently.The experiments indicate that the accuracy of this new method reaches 97%.
Key concepts: Web page, Computer science, Document Object Model, Information retrieval, HTML element, HITS algorithm, Hierarchy, Template