Customized web crawling based on meta search engine

To reduce the cost of network resource of traditional web crawling system and enhance its ability of customized supporting, a customized web information crawling system based on meta search engine is designed.This system combines the user interest vector model and applies the meta search engine technique to web crawling.The destination web is found which is correlated to user's interest through calling the member search engine.And the contents of page in destination web are crawled by the crawler program.When it comes to finding interest web, this system is more powerful, it could reduce the quantity of crawler effectively.System architecture, and customized web crawling workflow are mainly introduced.The system's application situation is proposed at last.