The Design & Implementation of a Small Scale Crawler based Web Search Engine

This paper presents a framework of a small-scale crawler based web search engine, being implemented togather content over the web. Our Search Engine is efficiently designed to search and store the Web content, thereby producing equally effective search results as other similar structures. The process behind a search engine is complicated. Search engines indexesa large content crawled fromnumber of web pages havingheaps of unique words. They respondsa large number of queries every seconds. Although there is a greatsignificance of web search engines at large-scale, less analysis has been done regarding their working. With the recent advancement in technology and increment in the usage of web,the way a web search engine is created few years back is quite different as it created now. This project provides an in-depth explanation of our small-scale crawler based web search engine.