Abstract :
|
With vast expansion of Web as Information
resource, extracting knowledge from the Web is becoming
difficult. To find Web pages, one typically uses search
engines that are based on the Web crawling framework.
This paper describes the basic architecture, and
components of search engine. Major issues and
challenges in implementing effective Web crawlers are
also identified. An insight into the next generation search
engines is being provided.
|