Crawling

The process by which search engine crawlers discover and fetch web pages and other accessible resources.