Two major functions:
1.Crawling and building an index
2.Providing users searching a ranked list of websites they’ve deemed the most relevant
Web crawlers are responsible for finding information that is publicly available on the Internet.
Information identified by the crawlers needs to be organized, sorted and stored.
Information is processed by the search engine algorithms before made available to the end user.