Search engines crawl the Web to see what is there. This task is performed by a piece of software, called a crawler or a spider. Spiders follow links from one page to another and index everything they find on their way. Having in mind the number of pages on the Web (many many