The Application of Web Mining Based on Web Crawler
Hu Sheng
Abstract
Hu Sheng
Abstract
This article firstly analyze the importance of applications of web-mining.Then,the key technical and operational principles of the architecture in web information search and data-mining are introduced.After the analysis of the functions of ordinary Web Crawlers,the principle,implementation,functions and performance of designed Web Crawler are elaborated.At last,passed tests show that the Web Crawler can effectively access a good range of information on the world wide web resources.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
This article firstly analyze the importance of applications of web-mining.Then,the key technical and operational principles of the architecture in web information search and data-mining are introduced.After the analysis of the functions of ordinary Web Crawlers,the principle,implementation,functions and performance of designed Web Crawler are elaborated.At last,passed tests show that the Web Crawler can effectively access a good range of information on the world wide web resources.
Key concepts: Web crawler, Focused crawler, World Wide Web, Web modeling, Computer science, Web standards, Data Web, Web mining